2024-09-10T23:02:15.148 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T23:02:15.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T23:02:15.330 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899776 branch: wip-hemanth-testing-2024-09-10-0723 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/fsync-tester}} email: hyelloji@redhat.com first_in_suite: false job_id: '7899776' kernel: flavor: default kdb: 1 sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-hemanth-testing-2024-09-10-0723 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug cephsqlite: 20 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mgr/snap_schedule/log_level: debug mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: mds: mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 mgr: cephsqlite lock renewal timeout: 900000 client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy mgr-modules: - snap_schedule sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 subvols: create: 2 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount dry_run: true install: ceph: flavor: default sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-hemanth-testing-2024-09-10-0723 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 owner: scheduled_hyelloji@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 6190 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 sleep_before_teardown: 0 subset: 479/1024 suite: fs suite_branch: wip-hemanth-testing-2024-09-10-0723 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi003.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGNDX6rRa2pjM9848loZxPx3+1rrKVwEpLUidZqFuZt4wdTc8Vdo2BmloId4LQebvqcxd5f1lgCP3U9N+LwpCAU= smithi038.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNW2+TixPqNd2YiNiJ3NcsGaMpTnb0kRxWmnFgNzkpXka5iS5XJxRPH0xqP0x7iylgsK4uWVyGdiNepv7aiKIeg= smithi194.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLUq8gyoRaV/PIsM/QCo9ThTfxKMB7BDzqlWfPUiYOYsSh9hcmTm6nvGDaa/55ZZL1AUEgl+rcOqMGGgc00eIEQ= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - quiescer: null - workunit: clients: all: - suites/fsync-tester.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_16:59:47 tube: smithi user: hyelloji verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T23:02:15.330 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa; will attempt to use it 2024-09-10T23:02:15.331 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks 2024-09-10T23:02:15.331 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T23:02:15.332 INFO:teuthology.task.internal:Checking packages... 2024-09-10T23:02:15.352 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8f219c476cb4f26fc5719c661c0323719a45cb30' 2024-09-10T23:02:15.353 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T23:02:15.353 INFO:teuthology.packaging:ref: None 2024-09-10T23:02:15.353 INFO:teuthology.packaging:tag: None 2024-09-10T23:02:15.353 INFO:teuthology.packaging:branch: wip-hemanth-testing-2024-09-10-0723 2024-09-10T23:02:15.353 INFO:teuthology.packaging:sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:02:15.353 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-hemanth-testing-2024-09-10-0723 2024-09-10T23:02:15.501 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4854.g8f219c47 2024-09-10T23:02:15.502 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T23:02:15.507 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T23:02:15.508 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T23:02:15.546 INFO:teuthology.task.internal:Saving configuration 2024-09-10T23:02:15.566 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T23:02:15.613 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T23:02:15.647 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi003.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899776', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 22:57:06.899013', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGNDX6rRa2pjM9848loZxPx3+1rrKVwEpLUidZqFuZt4wdTc8Vdo2BmloId4LQebvqcxd5f1lgCP3U9N+LwpCAU='} 2024-09-10T23:02:15.676 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899776', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 22:57:06.902096', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNW2+TixPqNd2YiNiJ3NcsGaMpTnb0kRxWmnFgNzkpXka5iS5XJxRPH0xqP0x7iylgsK4uWVyGdiNepv7aiKIeg='} 2024-09-10T23:02:15.708 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899776', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 22:57:06.900694', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLUq8gyoRaV/PIsM/QCo9ThTfxKMB7BDzqlWfPUiYOYsSh9hcmTm6nvGDaa/55ZZL1AUEgl+rcOqMGGgc00eIEQ='} 2024-09-10T23:02:15.709 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T23:02:15.714 INFO:teuthology.task.internal:roles: ubuntu@smithi003.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-10T23:02:15.715 INFO:teuthology.task.internal:roles: ubuntu@smithi038.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-10T23:02:15.715 INFO:teuthology.task.internal:roles: ubuntu@smithi194.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-10T23:02:15.715 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T23:02:15.840 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5dda953be0>, signals=[15]) 2024-09-10T23:02:15.840 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T23:02:15.846 INFO:teuthology.task.internal:Opening connections... 2024-09-10T23:02:15.846 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi003.front.sepia.ceph.com 2024-09-10T23:02:15.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:02:15.930 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi038.front.sepia.ceph.com 2024-09-10T23:02:15.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:02:16.014 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi194.front.sepia.ceph.com 2024-09-10T23:02:16.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:02:16.099 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T23:02:16.104 DEBUG:teuthology.orchestra.run.smithi003:> uname -m 2024-09-10T23:02:16.123 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2024-09-10T23:02:16.123 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2024-09-10T23:02:16.181 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream" 2024-09-10T23:02:16.181 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="9" 2024-09-10T23:02:16.181 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2024-09-10T23:02:16.181 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2024-09-10T23:02:16.181 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="9" 2024-09-10T23:02:16.181 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el9" 2024-09-10T23:02:16.181 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T23:02:16.181 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2024-09-10T23:02:16.182 INFO:teuthology.orchestra.run.smithi003.stdout:LOGO="fedora-logo-icon" 2024-09-10T23:02:16.182 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T23:02:16.182 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/" 2024-09-10T23:02:16.182 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T23:02:16.182 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T23:02:16.182 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T23:02:16.182 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2024-09-10T23:02:16.215 DEBUG:teuthology.orchestra.run.smithi038:> uname -m 2024-09-10T23:02:16.233 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2024-09-10T23:02:16.233 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2024-09-10T23:02:16.291 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream" 2024-09-10T23:02:16.291 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="9" 2024-09-10T23:02:16.291 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos" 2024-09-10T23:02:16.291 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora" 2024-09-10T23:02:16.291 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="9" 2024-09-10T23:02:16.292 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el9" 2024-09-10T23:02:16.292 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T23:02:16.292 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2024-09-10T23:02:16.292 INFO:teuthology.orchestra.run.smithi038.stdout:LOGO="fedora-logo-icon" 2024-09-10T23:02:16.292 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T23:02:16.292 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/" 2024-09-10T23:02:16.292 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T23:02:16.292 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T23:02:16.292 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T23:02:16.292 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2024-09-10T23:02:16.323 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2024-09-10T23:02:16.341 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2024-09-10T23:02:16.342 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2024-09-10T23:02:16.400 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2024-09-10T23:02:16.400 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="9" 2024-09-10T23:02:16.400 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2024-09-10T23:02:16.400 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2024-09-10T23:02:16.400 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="9" 2024-09-10T23:02:16.400 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el9" 2024-09-10T23:02:16.400 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T23:02:16.401 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2024-09-10T23:02:16.401 INFO:teuthology.orchestra.run.smithi194.stdout:LOGO="fedora-logo-icon" 2024-09-10T23:02:16.401 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T23:02:16.401 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2024-09-10T23:02:16.401 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T23:02:16.401 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T23:02:16.401 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T23:02:16.401 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2024-09-10T23:02:16.431 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T23:02:16.440 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T23:02:16.463 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T23:02:16.463 DEBUG:teuthology.orchestra.run.smithi003:> test '!' -e /home/ubuntu/cephtest 2024-09-10T23:02:16.466 DEBUG:teuthology.orchestra.run.smithi038:> test '!' -e /home/ubuntu/cephtest 2024-09-10T23:02:16.468 DEBUG:teuthology.orchestra.run.smithi194:> test '!' -e /home/ubuntu/cephtest 2024-09-10T23:02:16.485 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T23:02:16.490 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T23:02:16.491 DEBUG:teuthology.orchestra.run.smithi003:> test -z $(ls -A /var/lib/ceph) 2024-09-10T23:02:16.523 DEBUG:teuthology.orchestra.run.smithi038:> test -z $(ls -A /var/lib/ceph) 2024-09-10T23:02:16.526 DEBUG:teuthology.orchestra.run.smithi194:> test -z $(ls -A /var/lib/ceph) 2024-09-10T23:02:16.646 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T23:02:16.749 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T23:02:16.764 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'} 2024-09-10T23:02:16.764 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}, 'mon.b': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}, 'mon.c': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}}, timeout 300 2024-09-10T23:02:16.765 DEBUG:teuthology.orchestra.run.smithi003:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T23:02:16.765 DEBUG:teuthology.orchestra.run.smithi038:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T23:02:16.766 DEBUG:teuthology.orchestra.run.smithi194:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T23:02:16.783 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:02:16.783 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:02:16.784 DEBUG:teuthology.task.kernel:sha1 for mon.a is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:02:16.784 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-10T23:02:16.784 DEBUG:teuthology.orchestra.run.smithi003:> uname -r 2024-09-10T23:02:16.784 DEBUG:teuthology.task.kernel:sha1 for mon.b is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:02:16.784 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-10T23:02:16.784 DEBUG:teuthology.orchestra.run.smithi038:> uname -r 2024-09-10T23:02:16.785 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:02:16.785 DEBUG:teuthology.task.kernel:sha1 for mon.c is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:02:16.786 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-10T23:02:16.786 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2024-09-10T23:02:16.842 INFO:teuthology.orchestra.run.smithi003.stdout:5.14.0-503.el9.x86_64 2024-09-10T23:02:16.842 INFO:teuthology.orchestra.run.smithi038.stdout:5.14.0-503.el9.x86_64 2024-09-10T23:02:16.842 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:02:16.842 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-10T23:02:16.843 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:02:16.844 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:02:16.844 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-10T23:02:16.844 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:02:16.865 INFO:teuthology.orchestra.run.smithi194.stdout:5.14.0-503.el9.x86_64 2024-09-10T23:02:16.866 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:02:16.866 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-10T23:02:16.866 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:02:16.995 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum upgrade -y linux-firmware 2024-09-10T23:02:17.008 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum upgrade -y linux-firmware 2024-09-10T23:02:17.020 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum upgrade -y linux-firmware 2024-09-10T23:02:19.507 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.2 MB 00:00 2024-09-10T23:02:20.292 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 8.2 MB 00:01 2024-09-10T23:02:20.505 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.2 MB 00:01 2024-09-10T23:02:21.607 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-09-10T23:02:22.534 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - AppStream 19 MB/s | 20 MB 00:01 2024-09-10T23:02:22.873 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - AppStream 17 MB/s | 20 MB 00:01 2024-09-10T23:02:25.791 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - CRB 18 MB/s | 6.5 MB 00:00 2024-09-10T23:02:27.101 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-10T23:02:27.258 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - Extras packages 71 kB/s | 19 kB 00:00 2024-09-10T23:02:27.348 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-10T23:02:28.362 INFO:teuthology.orchestra.run.smithi194.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-10T23:02:28.899 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - Extras packages 65 kB/s | 19 kB 00:00 2024-09-10T23:02:29.019 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - Extras packages 28 kB/s | 19 kB 00:00 2024-09-10T23:02:30.231 INFO:teuthology.orchestra.run.smithi003.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-10T23:02:30.278 INFO:teuthology.orchestra.run.smithi038.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-10T23:02:33.793 INFO:teuthology.orchestra.run.smithi194.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-10T23:02:35.888 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-10T23:02:35.889 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-09-10T23:02:35.889 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-10T23:02:35.943 INFO:teuthology.orchestra.run.smithi038.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2024-09-10T23:02:35.953 INFO:teuthology.orchestra.run.smithi003.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-10T23:02:35.996 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.c... 2024-09-10T23:02:35.996 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:02:36.144 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:00:01 ago on Tue 10 Sep 2024 11:02:35 PM UTC. 2024-09-10T23:02:36.148 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-10T23:02:36.148 DEBUG:teuthology.orchestra.run.smithi194:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-10T23:02:36.150 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi194.front.sepia.ceph.com to complete... 2024-09-10T23:02:36.158 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:00:01 ago on Tue 10 Sep 2024 11:02:35 PM UTC. 2024-09-10T23:02:38.144 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-10T23:02:38.145 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2024-09-10T23:02:38.145 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-10T23:02:38.213 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-10T23:02:38.214 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2024-09-10T23:02:38.214 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-10T23:02:38.260 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.b... 2024-09-10T23:02:38.260 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:02:38.328 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.a... 2024-09-10T23:02:38.328 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:02:38.408 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-10T23:02:38.409 DEBUG:teuthology.orchestra.run.smithi038:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-10T23:02:38.411 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi038.front.sepia.ceph.com to complete... 2024-09-10T23:02:38.481 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-10T23:02:38.482 DEBUG:teuthology.orchestra.run.smithi003:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-10T23:02:38.484 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi003.front.sepia.ceph.com to complete... 2024-09-10T23:02:49.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10 23:02:49 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-10T23:02:49.081 INFO:teuthology.orchestra.run.smithi194.stderr:FINISHED --2024-09-10 23:02:49-- 2024-09-10T23:02:49.081 INFO:teuthology.orchestra.run.smithi194.stderr:Total wall clock time: 13s 2024-09-10T23:02:49.081 INFO:teuthology.orchestra.run.smithi194.stderr:Downloaded: 1 files, 343M in 13s (27.2 MB/s) 2024-09-10T23:02:49.084 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.c... 2024-09-10T23:02:49.084 DEBUG:teuthology.orchestra.run.smithi194:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-10T23:02:51.219 INFO:teuthology.orchestra.run.smithi194.stdout:Verifying... ######################################## 2024-09-10T23:02:51.467 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing... ######################################## 2024-09-10T23:02:51.578 INFO:teuthology.orchestra.run.smithi194.stdout:Updating / installing... 2024-09-10T23:02:53.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10 23:02:53 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-10T23:02:53.415 INFO:teuthology.orchestra.run.smithi003.stderr:FINISHED --2024-09-10 23:02:53-- 2024-09-10T23:02:53.415 INFO:teuthology.orchestra.run.smithi003.stderr:Total wall clock time: 15s 2024-09-10T23:02:53.415 INFO:teuthology.orchestra.run.smithi003.stderr:Downloaded: 1 files, 343M in 14s (23.7 MB/s) 2024-09-10T23:02:53.417 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.a... 2024-09-10T23:02:53.417 DEBUG:teuthology.orchestra.run.smithi003:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-10T23:02:55.634 INFO:teuthology.orchestra.run.smithi003.stdout:Verifying... ######################################## 2024-09-10T23:02:55.783 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing... ######################################## 2024-09-10T23:02:55.874 INFO:teuthology.orchestra.run.smithi003.stdout:Updating / installing... 2024-09-10T23:02:55.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10 23:02:55 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-10T23:02:55.901 INFO:teuthology.orchestra.run.smithi038.stderr:FINISHED --2024-09-10 23:02:55-- 2024-09-10T23:02:55.901 INFO:teuthology.orchestra.run.smithi038.stderr:Total wall clock time: 17s 2024-09-10T23:02:55.901 INFO:teuthology.orchestra.run.smithi038.stderr:Downloaded: 1 files, 343M in 17s (20.1 MB/s) 2024-09-10T23:02:55.904 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.b... 2024-09-10T23:02:55.904 DEBUG:teuthology.orchestra.run.smithi038:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-10T23:02:58.125 INFO:teuthology.orchestra.run.smithi038.stdout:Verifying... ######################################## 2024-09-10T23:02:58.273 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing... ######################################## 2024-09-10T23:02:58.407 INFO:teuthology.orchestra.run.smithi038.stdout:Updating / installing... 2024-09-10T23:02:59.534 INFO:teuthology.orchestra.run.smithi194.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-10T23:03:04.206 INFO:teuthology.orchestra.run.smithi003.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-10T23:03:06.703 INFO:teuthology.orchestra.run.smithi038.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-10T23:03:38.746 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi194.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-10T23:03:38.747 DEBUG:teuthology.orchestra.run.smithi194:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-10T23:03:38.838 INFO:teuthology.orchestra.run.smithi194.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:03:38.838 INFO:teuthology.orchestra.run.smithi194.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:03:38.838 INFO:teuthology.orchestra.run.smithi194.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:03:38.838 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:03:38.838 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-10T23:03:38.838 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-10T23:03:38.838 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-10T23:03:38.838 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-10T23:03:38.838 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-10T23:03:38.839 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-10T23:03:38.839 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-10T23:03:38.839 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-10T23:03:38.839 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-10T23:03:38.839 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-10T23:03:38.839 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-10T23:03:38.839 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-10T23:03:38.839 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-10T23:03:38.839 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-10T23:03:38.839 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-10T23:03:38.840 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-10T23:03:38.840 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-10T23:03:38.840 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-10T23:03:38.840 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-10T23:03:38.840 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-10T23:03:38.840 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-10T23:03:38.840 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-10T23:03:38.840 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-10T23:03:38.840 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-10T23:03:38.840 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-10T23:03:38.840 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-10T23:03:38.840 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-10T23:03:38.841 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-10T23:03:38.841 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-10T23:03:38.841 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-10T23:03:38.841 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-10T23:03:38.841 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-10T23:03:38.841 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-10T23:03:38.841 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-10T23:03:38.841 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-10T23:03:38.841 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-10T23:03:38.841 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-10T23:03:38.841 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-10T23:03:38.841 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-10T23:03:38.841 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-10T23:03:38.842 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-10T23:03:38.842 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-10T23:03:38.842 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-10T23:03:38.842 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-10T23:03:38.842 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-10T23:03:38.842 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-10T23:03:38.842 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-10T23:03:38.842 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-10T23:03:38.843 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-10T23:03:38.843 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-10T23:03:38.843 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-10T23:03:38.843 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-10T23:03:38.843 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-10T23:03:38.843 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-10T23:03:38.843 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-10T23:03:38.843 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-10T23:03:38.843 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-10T23:03:38.843 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-10T23:03:38.843 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-10T23:03:38.843 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-10T23:03:38.843 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-10T23:03:38.844 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-10T23:03:38.844 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-10T23:03:38.844 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-10T23:03:38.844 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-10T23:03:38.844 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-10T23:03:38.844 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-10T23:03:38.844 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-10T23:03:38.844 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-10T23:03:38.844 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-10T23:03:38.844 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-10T23:03:38.844 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-10T23:03:38.844 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-10T23:03:38.844 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-10T23:03:38.845 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-10T23:03:38.845 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-10T23:03:38.845 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-10T23:03:38.845 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-10T23:03:38.845 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-10T23:03:38.845 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-10T23:03:38.845 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-10T23:03:38.845 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-10T23:03:38.845 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-10T23:03:38.845 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-10T23:03:38.845 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-10T23:03:38.845 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-10T23:03:38.845 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-10T23:03:38.846 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-10T23:03:38.846 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-10T23:03:38.846 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-10T23:03:38.846 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-10T23:03:38.846 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-10T23:03:38.846 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-10T23:03:38.846 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-10T23:03:38.846 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-10T23:03:38.846 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-10T23:03:38.846 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-10T23:03:38.846 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-10T23:03:38.846 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-10T23:03:38.846 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-10T23:03:38.847 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-10T23:03:38.847 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-10T23:03:38.847 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-10T23:03:38.847 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-10T23:03:38.847 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-10T23:03:38.847 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-10T23:03:38.847 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-10T23:03:38.847 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-10T23:03:38.847 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-10T23:03:38.847 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-10T23:03:38.848 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-10T23:03:38.848 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-10T23:03:38.848 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-10T23:03:38.848 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-10T23:03:38.848 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-10T23:03:38.848 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-10T23:03:38.848 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-10T23:03:38.848 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-10T23:03:38.848 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-10T23:03:38.848 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-10T23:03:38.848 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-10T23:03:38.849 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-10T23:03:38.849 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-10T23:03:38.849 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-10T23:03:38.849 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-10T23:03:38.849 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-10T23:03:38.849 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-10T23:03:38.849 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-10T23:03:38.849 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-10T23:03:38.849 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-10T23:03:38.849 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-10T23:03:38.849 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-10T23:03:38.850 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-10T23:03:38.850 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-10T23:03:38.850 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-10T23:03:38.850 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-10T23:03:38.850 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-10T23:03:38.850 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-10T23:03:38.850 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-10T23:03:38.850 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-10T23:03:38.850 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-10T23:03:38.850 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-10T23:03:38.850 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-10T23:03:38.850 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-10T23:03:38.850 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-10T23:03:38.851 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-10T23:03:38.851 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-10T23:03:38.851 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-10T23:03:38.851 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-10T23:03:38.851 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-10T23:03:38.851 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-10T23:03:38.851 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-10T23:03:38.851 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-10T23:03:38.851 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-10T23:03:38.851 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-10T23:03:38.851 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-10T23:03:38.851 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-10T23:03:38.851 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-10T23:03:38.852 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-10T23:03:38.852 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-10T23:03:38.852 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-10T23:03:38.852 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-10T23:03:38.852 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-10T23:03:38.852 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-10T23:03:38.852 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-10T23:03:38.852 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-10T23:03:38.853 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-10T23:03:38.853 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-10T23:03:38.853 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-10T23:03:38.853 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-10T23:03:38.853 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-10T23:03:38.853 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-10T23:03:38.853 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-10T23:03:38.853 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-10T23:03:38.853 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-10T23:03:38.853 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-10T23:03:38.853 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-10T23:03:38.854 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-10T23:03:38.854 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-10T23:03:38.854 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-10T23:03:38.854 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-10T23:03:38.854 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-10T23:03:38.854 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-10T23:03:38.854 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-10T23:03:38.854 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-10T23:03:38.854 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-10T23:03:38.854 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-10T23:03:38.854 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-10T23:03:38.854 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-10T23:03:38.854 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-10T23:03:38.854 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-10T23:03:38.855 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-10T23:03:38.855 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-10T23:03:38.855 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-10T23:03:38.855 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-10T23:03:38.855 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-10T23:03:38.855 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-10T23:03:38.855 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-10T23:03:38.855 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-10T23:03:38.855 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-10T23:03:38.855 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-10T23:03:38.855 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-10T23:03:38.855 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-10T23:03:38.855 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-10T23:03:38.855 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-10T23:03:38.856 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-10T23:03:38.856 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-10T23:03:38.856 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-10T23:03:38.856 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-10T23:03:38.856 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-10T23:03:38.856 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-10T23:03:38.856 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-10T23:03:38.856 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-10T23:03:38.856 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-10T23:03:38.857 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-10T23:03:38.857 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-10T23:03:38.857 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-10T23:03:38.857 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-10T23:03:38.857 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-10T23:03:38.857 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-10T23:03:38.857 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-10T23:03:38.857 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-10T23:03:38.857 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-10T23:03:38.857 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-10T23:03:38.857 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-10T23:03:38.857 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-10T23:03:38.857 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-10T23:03:38.858 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-10T23:03:38.858 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-10T23:03:38.858 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-10T23:03:38.858 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-10T23:03:38.858 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-10T23:03:38.858 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-10T23:03:38.858 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-10T23:03:38.858 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-10T23:03:38.858 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-10T23:03:38.858 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-10T23:03:38.858 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-10T23:03:38.858 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-10T23:03:38.858 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-10T23:03:38.859 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-10T23:03:38.859 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-10T23:03:38.859 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-10T23:03:38.859 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-10T23:03:38.859 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-10T23:03:38.859 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-10T23:03:38.859 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-10T23:03:38.859 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-10T23:03:38.859 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-10T23:03:38.859 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-10T23:03:38.859 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-10T23:03:38.859 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-10T23:03:38.859 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-10T23:03:38.859 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-10T23:03:38.860 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-10T23:03:38.860 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-10T23:03:38.860 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-10T23:03:38.860 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-10T23:03:38.860 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-10T23:03:38.860 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-10T23:03:38.860 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-10T23:03:38.860 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-10T23:03:38.860 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-10T23:03:38.860 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-10T23:03:38.860 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-10T23:03:38.860 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-10T23:03:38.860 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-10T23:03:38.861 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-10T23:03:38.861 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-10T23:03:38.861 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-10T23:03:38.861 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-10T23:03:38.861 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-10T23:03:38.861 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-10T23:03:38.861 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-10T23:03:38.861 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-10T23:03:38.861 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-10T23:03:38.861 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-10T23:03:38.861 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-10T23:03:38.861 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-10T23:03:38.861 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-10T23:03:38.862 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-10T23:03:38.862 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-10T23:03:38.862 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-10T23:03:38.862 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-10T23:03:38.862 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-10T23:03:38.862 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-10T23:03:38.862 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-10T23:03:38.862 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-10T23:03:38.862 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-10T23:03:38.862 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-10T23:03:38.862 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-10T23:03:38.862 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-10T23:03:38.862 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-10T23:03:38.862 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-10T23:03:38.863 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-10T23:03:38.863 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-10T23:03:38.863 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-10T23:03:38.863 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-10T23:03:38.863 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-10T23:03:38.863 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-10T23:03:38.863 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-10T23:03:38.863 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-10T23:03:38.863 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-10T23:03:38.863 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-10T23:03:38.863 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-10T23:03:38.863 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-10T23:03:38.863 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-10T23:03:38.864 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-10T23:03:38.864 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-10T23:03:38.864 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-10T23:03:38.864 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-10T23:03:38.864 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-10T23:03:38.864 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-10T23:03:38.864 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-10T23:03:38.864 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-10T23:03:38.864 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-10T23:03:38.864 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-10T23:03:38.864 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-10T23:03:38.864 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-10T23:03:38.864 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-10T23:03:38.864 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-10T23:03:38.865 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-10T23:03:38.865 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-10T23:03:38.865 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-10T23:03:38.865 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-10T23:03:38.865 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-10T23:03:38.865 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-10T23:03:38.865 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-10T23:03:38.865 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-10T23:03:38.865 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-10T23:03:38.865 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-10T23:03:38.865 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-10T23:03:38.865 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-10T23:03:38.865 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-10T23:03:38.865 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-10T23:03:38.866 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-10T23:03:38.866 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-10T23:03:38.866 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-10T23:03:38.866 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-10T23:03:38.866 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-10T23:03:38.866 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-10T23:03:38.866 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-10T23:03:38.866 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-10T23:03:38.866 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-10T23:03:38.866 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-10T23:03:38.866 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-10T23:03:38.866 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-10T23:03:38.866 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-10T23:03:38.867 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-10T23:03:38.867 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-10T23:03:38.867 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-10T23:03:38.867 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-10T23:03:38.867 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-10T23:03:38.867 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-10T23:03:38.868 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-10T23:03:38.868 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-10T23:03:38.868 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-10T23:03:38.868 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-10T23:03:38.868 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-10T23:03:38.868 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-10T23:03:38.868 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-10T23:03:38.868 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-10T23:03:38.868 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-10T23:03:38.868 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-10T23:03:38.869 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-10T23:03:38.869 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-10T23:03:38.869 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-10T23:03:38.869 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-10T23:03:38.869 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-10T23:03:38.869 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-10T23:03:38.869 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-10T23:03:38.869 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-10T23:03:38.869 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-10T23:03:38.869 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-10T23:03:38.869 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-10T23:03:38.869 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-10T23:03:38.869 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-10T23:03:38.869 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-10T23:03:38.870 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-10T23:03:38.870 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-10T23:03:38.870 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-10T23:03:38.870 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-10T23:03:38.870 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-10T23:03:38.870 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-10T23:03:38.870 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-10T23:03:38.870 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-10T23:03:38.870 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-10T23:03:38.870 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-10T23:03:38.870 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-10T23:03:38.870 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-10T23:03:38.870 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-10T23:03:38.871 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-10T23:03:38.871 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-10T23:03:38.871 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-10T23:03:38.871 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-10T23:03:38.871 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-10T23:03:38.871 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-10T23:03:38.871 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-10T23:03:38.871 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-10T23:03:38.871 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-10T23:03:38.871 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-10T23:03:38.871 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-10T23:03:38.871 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-10T23:03:38.871 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-10T23:03:38.871 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-10T23:03:38.872 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-10T23:03:38.872 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-10T23:03:38.872 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-10T23:03:38.872 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-10T23:03:38.872 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-10T23:03:38.872 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-10T23:03:38.872 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-10T23:03:38.872 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-10T23:03:38.872 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-10T23:03:38.872 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-10T23:03:38.872 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-10T23:03:38.872 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-10T23:03:38.872 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-10T23:03:38.872 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-10T23:03:38.873 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-10T23:03:38.873 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-10T23:03:38.873 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-10T23:03:38.873 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-10T23:03:38.873 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-10T23:03:38.873 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-10T23:03:38.873 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-10T23:03:38.874 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-10T23:03:38.874 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-10T23:03:38.874 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-10T23:03:38.874 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-10T23:03:38.874 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-10T23:03:38.874 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-10T23:03:38.875 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-10T23:03:38.875 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-10T23:03:38.875 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-10T23:03:38.875 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-10T23:03:38.875 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-10T23:03:38.875 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-10T23:03:38.876 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-10T23:03:38.876 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-10T23:03:38.876 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-10T23:03:38.876 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-10T23:03:38.876 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-10T23:03:38.876 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-10T23:03:38.877 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-10T23:03:38.877 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-10T23:03:38.877 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-10T23:03:38.877 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-10T23:03:38.877 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-10T23:03:38.877 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-10T23:03:38.877 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-10T23:03:38.877 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-10T23:03:38.878 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-10T23:03:38.878 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-10T23:03:38.878 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-10T23:03:38.878 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-10T23:03:38.878 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-10T23:03:38.878 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-10T23:03:38.878 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-10T23:03:38.878 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-10T23:03:38.879 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-10T23:03:38.879 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-10T23:03:38.879 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-10T23:03:38.879 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-10T23:03:38.879 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-10T23:03:38.879 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-10T23:03:38.879 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-10T23:03:38.879 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-10T23:03:38.880 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-10T23:03:38.880 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-10T23:03:38.880 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-10T23:03:38.880 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-10T23:03:38.880 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-10T23:03:38.880 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-10T23:03:38.880 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-10T23:03:38.880 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-10T23:03:38.881 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-10T23:03:38.881 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-10T23:03:38.881 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-10T23:03:38.881 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-10T23:03:38.881 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-10T23:03:38.881 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-10T23:03:38.881 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-10T23:03:38.882 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-10T23:03:38.882 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-10T23:03:38.882 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-10T23:03:38.882 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-10T23:03:38.882 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-10T23:03:38.882 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-10T23:03:38.882 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-10T23:03:38.882 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-10T23:03:38.883 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-10T23:03:38.883 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-10T23:03:38.883 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-10T23:03:38.883 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-10T23:03:38.883 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-10T23:03:38.883 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-10T23:03:38.883 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-10T23:03:38.883 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-10T23:03:38.883 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-10T23:03:38.883 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-10T23:03:38.883 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-10T23:03:38.883 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-10T23:03:38.884 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-10T23:03:38.884 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-10T23:03:38.884 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-10T23:03:38.884 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-10T23:03:38.884 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-10T23:03:38.884 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-10T23:03:38.884 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-10T23:03:38.884 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-10T23:03:38.884 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-10T23:03:38.884 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-10T23:03:38.884 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-10T23:03:38.884 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-10T23:03:38.884 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-10T23:03:38.885 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-10T23:03:38.885 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-10T23:03:38.885 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-10T23:03:38.885 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-10T23:03:38.885 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-10T23:03:38.885 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-10T23:03:38.885 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-10T23:03:38.885 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-10T23:03:38.885 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-10T23:03:38.885 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-10T23:03:38.886 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-10T23:03:38.886 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-10T23:03:38.886 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-10T23:03:38.886 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-10T23:03:38.886 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-10T23:03:38.886 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-10T23:03:38.886 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-10T23:03:38.886 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-10T23:03:38.886 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-10T23:03:38.886 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-10T23:03:38.886 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-10T23:03:38.886 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-10T23:03:38.886 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-10T23:03:38.886 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-10T23:03:38.887 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-10T23:03:38.887 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-10T23:03:38.887 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-10T23:03:38.887 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-10T23:03:38.887 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-10T23:03:38.887 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-10T23:03:38.887 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-10T23:03:38.887 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-10T23:03:38.887 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-10T23:03:38.887 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-10T23:03:38.887 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-10T23:03:38.887 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-10T23:03:38.887 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-10T23:03:38.888 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-10T23:03:38.888 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-10T23:03:38.888 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-10T23:03:38.888 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-10T23:03:38.888 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-10T23:03:38.888 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-10T23:03:38.888 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-10T23:03:38.888 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-10T23:03:38.888 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-10T23:03:38.888 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-10T23:03:38.889 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-10T23:03:38.889 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-10T23:03:38.889 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-10T23:03:38.889 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-10T23:03:38.889 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-10T23:03:38.889 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-10T23:03:38.889 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-10T23:03:38.890 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-10T23:03:38.890 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-10T23:03:38.890 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-10T23:03:38.890 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-10T23:03:38.890 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-10T23:03:38.890 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-10T23:03:38.890 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-10T23:03:38.890 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-10T23:03:38.890 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-10T23:03:38.890 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-10T23:03:38.890 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-10T23:03:38.890 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-10T23:03:38.890 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-10T23:03:38.891 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-10T23:03:38.891 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-10T23:03:38.891 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-10T23:03:38.891 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-10T23:03:38.891 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-10T23:03:38.891 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-10T23:03:38.891 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-10T23:03:38.891 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-10T23:03:38.891 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-10T23:03:38.891 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-10T23:03:38.892 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-10T23:03:38.892 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-10T23:03:38.892 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-10T23:03:38.892 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-10T23:03:38.892 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-10T23:03:38.892 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-10T23:03:38.892 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-10T23:03:38.892 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-10T23:03:38.892 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-10T23:03:38.892 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-10T23:03:38.892 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-10T23:03:38.892 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-10T23:03:38.892 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-10T23:03:38.892 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-10T23:03:38.893 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-10T23:03:38.893 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-10T23:03:38.893 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-10T23:03:38.893 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-10T23:03:38.893 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-10T23:03:38.893 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-10T23:03:38.893 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-10T23:03:38.893 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-10T23:03:38.893 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-10T23:03:38.893 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-10T23:03:38.893 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-10T23:03:38.893 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-10T23:03:38.893 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-10T23:03:38.894 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-10T23:03:38.894 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-10T23:03:38.894 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-10T23:03:38.894 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-10T23:03:38.894 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-10T23:03:38.894 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-10T23:03:38.894 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-10T23:03:38.894 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-10T23:03:38.894 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-10T23:03:38.894 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-10T23:03:38.894 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-10T23:03:38.894 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-10T23:03:38.894 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-10T23:03:38.894 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-10T23:03:38.894 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-10T23:03:38.895 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-10T23:03:38.895 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-10T23:03:38.895 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-10T23:03:38.895 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-10T23:03:38.895 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-10T23:03:38.895 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-10T23:03:38.895 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-10T23:03:38.895 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-10T23:03:38.895 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-10T23:03:38.895 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-10T23:03:38.895 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-10T23:03:38.895 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-10T23:03:38.895 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-10T23:03:38.896 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-10T23:03:38.896 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-10T23:03:38.896 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-10T23:03:38.896 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-10T23:03:38.896 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-10T23:03:38.896 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-10T23:03:38.896 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-10T23:03:38.896 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-10T23:03:38.896 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-10T23:03:38.896 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-10T23:03:38.896 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-10T23:03:38.896 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-10T23:03:38.896 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-10T23:03:38.896 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-10T23:03:38.897 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-10T23:03:38.897 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-10T23:03:38.897 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-10T23:03:38.897 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-10T23:03:38.897 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-10T23:03:38.897 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-10T23:03:38.897 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-10T23:03:38.897 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-10T23:03:38.897 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-10T23:03:38.897 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-10T23:03:38.897 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-10T23:03:38.897 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-10T23:03:38.898 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-10T23:03:38.898 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-10T23:03:38.898 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-10T23:03:38.898 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-10T23:03:38.898 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-10T23:03:38.898 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-10T23:03:38.898 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-10T23:03:38.898 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-10T23:03:38.898 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-10T23:03:38.898 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-10T23:03:38.898 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-10T23:03:38.898 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-10T23:03:38.898 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-10T23:03:38.899 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-10T23:03:38.899 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-10T23:03:38.899 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-10T23:03:38.899 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-10T23:03:38.899 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-10T23:03:38.899 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-10T23:03:38.899 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-10T23:03:38.899 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-10T23:03:38.899 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-10T23:03:38.899 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-10T23:03:38.899 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-10T23:03:38.899 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-10T23:03:38.899 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-10T23:03:38.899 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-10T23:03:38.899 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-10T23:03:38.900 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-10T23:03:38.900 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-10T23:03:38.900 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-10T23:03:38.900 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-10T23:03:38.900 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-10T23:03:38.900 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-10T23:03:38.900 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-10T23:03:38.900 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-10T23:03:38.900 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-10T23:03:38.900 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-10T23:03:38.900 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-10T23:03:38.900 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-10T23:03:38.900 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-10T23:03:38.900 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-10T23:03:38.901 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-10T23:03:38.901 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-10T23:03:38.901 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-10T23:03:38.901 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-10T23:03:38.901 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-10T23:03:38.901 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-10T23:03:38.901 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-10T23:03:38.901 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-10T23:03:38.901 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-10T23:03:38.901 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-10T23:03:38.901 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-10T23:03:38.901 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-10T23:03:38.901 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-10T23:03:38.901 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-10T23:03:38.902 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-10T23:03:38.902 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-10T23:03:38.902 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-10T23:03:38.902 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-10T23:03:38.902 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-10T23:03:38.902 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-10T23:03:38.902 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-10T23:03:38.902 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-10T23:03:38.902 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-10T23:03:38.902 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-10T23:03:38.902 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-10T23:03:38.902 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-10T23:03:38.902 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-10T23:03:38.902 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-10T23:03:38.903 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-10T23:03:38.903 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-10T23:03:38.903 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-10T23:03:38.903 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-10T23:03:38.903 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-10T23:03:38.903 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-10T23:03:38.903 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-10T23:03:38.903 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-10T23:03:38.903 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-10T23:03:38.903 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-10T23:03:38.903 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-10T23:03:38.903 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-10T23:03:38.903 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-10T23:03:38.903 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-10T23:03:38.903 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-10T23:03:38.904 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-10T23:03:38.904 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-10T23:03:38.904 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-10T23:03:38.904 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-10T23:03:38.904 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-10T23:03:38.904 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-10T23:03:38.904 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-10T23:03:38.904 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-10T23:03:38.904 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-10T23:03:38.904 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-10T23:03:38.904 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-10T23:03:38.904 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-10T23:03:38.904 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-10T23:03:38.905 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-10T23:03:38.905 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-10T23:03:38.905 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-10T23:03:38.905 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-10T23:03:38.905 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-10T23:03:38.905 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-10T23:03:38.905 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-10T23:03:38.905 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-10T23:03:38.905 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-10T23:03:38.905 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-10T23:03:38.905 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-10T23:03:38.905 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-10T23:03:38.906 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-10T23:03:38.906 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-10T23:03:38.906 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-10T23:03:38.906 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-10T23:03:38.906 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-10T23:03:38.906 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-10T23:03:38.906 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-10T23:03:38.906 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-10T23:03:38.906 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-10T23:03:38.906 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-10T23:03:38.906 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-10T23:03:38.906 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-10T23:03:38.907 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-10T23:03:38.907 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-10T23:03:38.907 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-10T23:03:38.907 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-10T23:03:38.907 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-10T23:03:38.907 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-10T23:03:38.907 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-10T23:03:38.907 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-10T23:03:38.907 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-10T23:03:38.907 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-10T23:03:38.907 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-10T23:03:38.907 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-10T23:03:38.908 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-10T23:03:38.908 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-10T23:03:38.908 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-10T23:03:38.908 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-10T23:03:38.908 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-10T23:03:38.908 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-10T23:03:38.908 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-10T23:03:38.908 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-10T23:03:38.908 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-10T23:03:38.908 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-10T23:03:38.908 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-10T23:03:38.908 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-10T23:03:38.908 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-10T23:03:38.908 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-10T23:03:38.909 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-10T23:03:38.909 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-10T23:03:38.909 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-10T23:03:38.909 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-10T23:03:38.909 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-10T23:03:38.909 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-10T23:03:38.909 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-10T23:03:38.909 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-10T23:03:38.909 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-10T23:03:38.909 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-10T23:03:38.909 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-10T23:03:38.909 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-10T23:03:38.910 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-10T23:03:38.910 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-10T23:03:38.910 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-10T23:03:38.910 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-10T23:03:38.910 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-10T23:03:38.910 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-10T23:03:38.910 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-10T23:03:38.910 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-10T23:03:38.910 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-10T23:03:38.910 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-10T23:03:38.910 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-10T23:03:38.910 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-10T23:03:38.910 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-10T23:03:38.910 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-10T23:03:38.911 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-10T23:03:38.911 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-10T23:03:38.911 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-10T23:03:38.911 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-10T23:03:38.911 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-10T23:03:38.911 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-10T23:03:38.911 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-10T23:03:38.911 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-10T23:03:38.911 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-10T23:03:38.911 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-10T23:03:38.911 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-10T23:03:38.912 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-10T23:03:38.912 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-10T23:03:38.912 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-10T23:03:38.912 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-10T23:03:38.912 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-10T23:03:38.912 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-10T23:03:38.913 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-10T23:03:38.913 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-10T23:03:38.913 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-10T23:03:38.913 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-10T23:03:38.913 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-10T23:03:38.914 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-10T23:03:38.914 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-10T23:03:38.914 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-10T23:03:38.914 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-10T23:03:38.914 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-10T23:03:38.914 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-10T23:03:38.914 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-10T23:03:38.915 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-10T23:03:38.915 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-10T23:03:38.915 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-10T23:03:38.915 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-10T23:03:38.915 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-10T23:03:38.915 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-10T23:03:38.916 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-10T23:03:38.916 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-10T23:03:38.916 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-10T23:03:38.916 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-10T23:03:38.916 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-10T23:03:38.916 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-10T23:03:38.917 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-10T23:03:38.917 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-10T23:03:38.917 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-10T23:03:38.917 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-10T23:03:38.917 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-10T23:03:38.917 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-10T23:03:38.918 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-10T23:03:38.918 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-10T23:03:38.918 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-10T23:03:38.918 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-10T23:03:38.918 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-10T23:03:38.918 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-10T23:03:38.919 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-10T23:03:38.919 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-10T23:03:38.919 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-10T23:03:38.919 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-10T23:03:38.919 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-10T23:03:38.919 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-10T23:03:38.920 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-10T23:03:38.920 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-10T23:03:38.920 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-10T23:03:38.920 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-10T23:03:38.920 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-10T23:03:38.920 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-10T23:03:38.921 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-10T23:03:38.921 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-10T23:03:38.921 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-10T23:03:38.921 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-10T23:03:38.922 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-10T23:03:38.922 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-10T23:03:38.922 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-10T23:03:38.922 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-10T23:03:38.922 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-10T23:03:38.923 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-10T23:03:38.923 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-10T23:03:38.923 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-10T23:03:38.923 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-10T23:03:38.923 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-10T23:03:38.924 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-10T23:03:38.924 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-10T23:03:38.924 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-10T23:03:38.924 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-10T23:03:38.924 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-10T23:03:38.924 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-10T23:03:38.925 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-10T23:03:38.925 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-10T23:03:38.925 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-10T23:03:38.925 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-10T23:03:38.925 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-10T23:03:38.926 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-10T23:03:38.926 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-10T23:03:38.926 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-10T23:03:38.926 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-10T23:03:38.926 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-10T23:03:38.926 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-10T23:03:38.927 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-10T23:03:38.927 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-10T23:03:38.927 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-10T23:03:38.927 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-10T23:03:38.927 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-10T23:03:38.927 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-10T23:03:38.928 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-10T23:03:38.928 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-10T23:03:38.928 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-10T23:03:38.928 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-10T23:03:38.928 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-10T23:03:38.928 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-10T23:03:38.929 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-10T23:03:38.929 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-10T23:03:38.929 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-10T23:03:38.929 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-10T23:03:38.929 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-10T23:03:38.930 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-10T23:03:38.930 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-10T23:03:38.930 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-10T23:03:38.930 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-10T23:03:38.930 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-10T23:03:38.930 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-10T23:03:38.931 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-10T23:03:38.931 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-10T23:03:38.931 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-10T23:03:38.931 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-10T23:03:38.931 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-10T23:03:38.931 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-10T23:03:38.932 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-10T23:03:38.932 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-10T23:03:38.932 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-10T23:03:38.932 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-10T23:03:38.932 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-10T23:03:38.933 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-10T23:03:38.933 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-10T23:03:38.933 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-10T23:03:38.933 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-10T23:03:38.933 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-10T23:03:38.933 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-10T23:03:38.934 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-10T23:03:38.934 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-10T23:03:38.934 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-10T23:03:38.934 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-10T23:03:38.934 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-10T23:03:38.935 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-10T23:03:38.935 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-10T23:03:38.935 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-10T23:03:38.935 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-10T23:03:38.935 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-10T23:03:38.935 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-10T23:03:38.936 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-10T23:03:38.936 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-10T23:03:38.936 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-10T23:03:38.936 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-10T23:03:38.936 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-10T23:03:38.937 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-10T23:03:38.937 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-10T23:03:38.937 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-10T23:03:38.937 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-10T23:03:38.937 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-10T23:03:38.937 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-10T23:03:38.938 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-10T23:03:38.938 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-10T23:03:38.938 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-10T23:03:38.938 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-10T23:03:38.938 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-10T23:03:38.938 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-10T23:03:38.939 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-10T23:03:38.939 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-10T23:03:38.939 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-10T23:03:38.939 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-10T23:03:38.939 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-10T23:03:38.940 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-10T23:03:38.940 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-10T23:03:38.940 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-10T23:03:38.940 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-10T23:03:38.940 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-10T23:03:38.941 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-10T23:03:38.941 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-10T23:03:38.941 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-10T23:03:38.941 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-10T23:03:38.941 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-10T23:03:38.941 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-10T23:03:38.942 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-10T23:03:38.942 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-10T23:03:38.942 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-10T23:03:38.942 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-10T23:03:38.942 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-10T23:03:38.942 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-10T23:03:38.943 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-10T23:03:38.943 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-10T23:03:38.943 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-10T23:03:38.943 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-10T23:03:38.943 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-10T23:03:38.944 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-10T23:03:38.944 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-10T23:03:38.944 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-10T23:03:38.944 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-10T23:03:38.944 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-10T23:03:38.944 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-10T23:03:38.945 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-10T23:03:38.945 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-10T23:03:38.945 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-10T23:03:38.945 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-10T23:03:38.945 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-10T23:03:38.945 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-10T23:03:38.946 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-10T23:03:38.946 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-10T23:03:38.946 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-10T23:03:38.946 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-10T23:03:38.946 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-10T23:03:38.947 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-10T23:03:38.947 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-10T23:03:38.947 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-10T23:03:38.947 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-10T23:03:38.947 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-10T23:03:38.947 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-10T23:03:38.948 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-10T23:03:38.948 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-10T23:03:38.948 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-10T23:03:38.948 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-10T23:03:38.948 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-10T23:03:38.949 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-10T23:03:38.949 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-10T23:03:38.949 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-10T23:03:38.949 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-10T23:03:38.949 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-10T23:03:38.950 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-10T23:03:38.950 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-10T23:03:38.950 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-10T23:03:38.950 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-10T23:03:38.950 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-10T23:03:38.951 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-10T23:03:38.951 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-10T23:03:38.951 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-10T23:03:38.951 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-10T23:03:38.951 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-10T23:03:38.951 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-10T23:03:38.952 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-10T23:03:38.952 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-10T23:03:38.952 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-10T23:03:38.952 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-10T23:03:38.952 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-10T23:03:38.952 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-10T23:03:38.953 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-10T23:03:38.953 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-10T23:03:38.953 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-10T23:03:38.953 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-10T23:03:38.953 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-10T23:03:38.954 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-10T23:03:38.954 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-10T23:03:38.954 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-10T23:03:38.954 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-10T23:03:38.956 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-10T23:03:38.956 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-10T23:03:38.956 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-10T23:03:38.956 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-10T23:03:38.956 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-10T23:03:38.956 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-10T23:03:38.957 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-10T23:03:38.957 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-10T23:03:38.957 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-10T23:03:38.957 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-10T23:03:38.957 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-10T23:03:38.958 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-10T23:03:38.958 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-10T23:03:38.958 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-10T23:03:38.958 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-10T23:03:38.958 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-10T23:03:38.958 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-10T23:03:38.959 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-10T23:03:38.959 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-10T23:03:38.959 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-10T23:03:38.959 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-10T23:03:38.959 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-10T23:03:38.960 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-10T23:03:38.960 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-10T23:03:38.960 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-10T23:03:38.960 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-10T23:03:38.960 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-10T23:03:38.960 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-10T23:03:38.961 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-10T23:03:38.961 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-10T23:03:38.961 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-10T23:03:38.961 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-10T23:03:38.961 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-10T23:03:38.962 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-10T23:03:38.962 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-10T23:03:38.962 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-10T23:03:38.962 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-10T23:03:38.962 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-10T23:03:38.962 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-10T23:03:38.963 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-10T23:03:38.963 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-10T23:03:38.963 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-10T23:03:38.963 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-10T23:03:38.963 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-10T23:03:38.964 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-10T23:03:38.964 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-10T23:03:38.964 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-10T23:03:38.964 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-10T23:03:38.964 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-10T23:03:38.964 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-10T23:03:38.965 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-10T23:03:38.965 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-10T23:03:38.965 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-10T23:03:38.965 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-10T23:03:38.965 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-10T23:03:38.966 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-10T23:03:38.966 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-10T23:03:38.966 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-10T23:03:38.966 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-10T23:03:38.966 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-10T23:03:38.966 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-10T23:03:38.967 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-10T23:03:38.967 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-10T23:03:38.967 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-10T23:03:38.967 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-10T23:03:38.967 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-10T23:03:38.967 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-10T23:03:38.967 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-10T23:03:38.968 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-10T23:03:38.968 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-10T23:03:38.968 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-10T23:03:38.968 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-10T23:03:38.968 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-10T23:03:38.968 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-10T23:03:38.968 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-10T23:03:38.968 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-10T23:03:38.968 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-10T23:03:38.969 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-10T23:03:38.969 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-10T23:03:38.969 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-10T23:03:38.969 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-10T23:03:38.969 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-10T23:03:38.969 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-10T23:03:38.969 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-10T23:03:38.969 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-10T23:03:38.969 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-10T23:03:38.969 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-10T23:03:38.970 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-10T23:03:38.970 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-10T23:03:38.970 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-10T23:03:38.970 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-10T23:03:38.970 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-10T23:03:38.970 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-10T23:03:38.970 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-10T23:03:38.970 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-10T23:03:38.970 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-10T23:03:38.971 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-10T23:03:38.971 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-10T23:03:38.971 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-10T23:03:38.971 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-10T23:03:38.971 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-10T23:03:38.971 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-10T23:03:38.971 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-10T23:03:38.971 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-10T23:03:38.971 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-10T23:03:38.971 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-10T23:03:38.972 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-10T23:03:38.972 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-10T23:03:38.972 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-10T23:03:38.972 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-10T23:03:38.972 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-10T23:03:38.972 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-10T23:03:38.972 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-10T23:03:38.972 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-10T23:03:38.972 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-10T23:03:38.972 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-10T23:03:38.973 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-10T23:03:38.973 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-10T23:03:38.973 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-10T23:03:38.973 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-10T23:03:38.973 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-10T23:03:38.973 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-10T23:03:38.973 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-10T23:03:38.973 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-10T23:03:38.973 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-10T23:03:38.974 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-10T23:03:38.974 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-10T23:03:38.974 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-10T23:03:38.974 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-10T23:03:38.974 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-10T23:03:38.974 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-10T23:03:38.974 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-10T23:03:38.974 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-10T23:03:38.974 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-10T23:03:38.975 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-10T23:03:38.975 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-10T23:03:38.975 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-10T23:03:38.975 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-10T23:03:38.975 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-10T23:03:38.975 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-10T23:03:38.975 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-10T23:03:38.975 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-10T23:03:38.975 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-10T23:03:38.975 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-10T23:03:38.976 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-10T23:03:38.976 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-10T23:03:38.976 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-10T23:03:38.976 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-10T23:03:38.976 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-10T23:03:38.976 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-10T23:03:38.976 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-10T23:03:38.976 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-10T23:03:38.976 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-10T23:03:38.977 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-10T23:03:38.977 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-10T23:03:38.977 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-10T23:03:38.977 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-10T23:03:38.977 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-10T23:03:38.977 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-10T23:03:38.977 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-10T23:03:38.977 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-10T23:03:38.977 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-10T23:03:38.978 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-10T23:03:38.978 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-10T23:03:38.978 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-10T23:03:38.978 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-10T23:03:38.978 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-10T23:03:38.978 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-10T23:03:38.978 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-10T23:03:38.978 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-10T23:03:38.978 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-10T23:03:38.978 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-10T23:03:38.979 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-10T23:03:38.979 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-10T23:03:38.979 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-10T23:03:38.979 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-10T23:03:38.979 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-10T23:03:38.979 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-10T23:03:38.980 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-10T23:03:38.980 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-10T23:03:38.980 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-10T23:03:38.980 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-10T23:03:38.980 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-10T23:03:38.980 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-10T23:03:38.981 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-10T23:03:38.981 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-10T23:03:38.981 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-10T23:03:38.981 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-10T23:03:38.981 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-10T23:03:38.981 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-10T23:03:38.982 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-10T23:03:38.982 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-10T23:03:38.982 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-10T23:03:38.982 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-10T23:03:38.982 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-10T23:03:38.982 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-10T23:03:38.983 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-10T23:03:38.983 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-10T23:03:38.983 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-10T23:03:38.983 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-10T23:03:38.983 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-10T23:03:38.983 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-10T23:03:38.983 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-10T23:03:38.984 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-10T23:03:38.984 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-10T23:03:38.984 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-10T23:03:38.984 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-10T23:03:38.984 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-10T23:03:38.984 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-10T23:03:38.984 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-10T23:03:38.985 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-10T23:03:38.985 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-10T23:03:38.985 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-10T23:03:38.985 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-10T23:03:38.985 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-10T23:03:38.985 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-10T23:03:38.986 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-10T23:03:38.986 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-10T23:03:38.986 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-10T23:03:38.986 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-10T23:03:38.986 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-10T23:03:38.987 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-10T23:03:38.987 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-10T23:03:38.987 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-10T23:03:38.987 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-10T23:03:38.987 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-10T23:03:38.987 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-10T23:03:38.988 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-10T23:03:38.988 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-10T23:03:38.988 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-10T23:03:38.988 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-10T23:03:38.988 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-10T23:03:38.988 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-10T23:03:38.988 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-10T23:03:38.989 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-10T23:03:38.989 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-10T23:03:38.989 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-10T23:03:38.989 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-10T23:03:38.989 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-10T23:03:38.990 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-10T23:03:38.990 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-10T23:03:38.990 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-10T23:03:38.990 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-10T23:03:38.990 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-10T23:03:38.990 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-10T23:03:38.990 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-10T23:03:38.991 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-10T23:03:38.991 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-10T23:03:38.991 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-10T23:03:38.991 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-10T23:03:38.991 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-10T23:03:38.992 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-10T23:03:38.992 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-10T23:03:38.992 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-10T23:03:38.992 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-10T23:03:38.992 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-10T23:03:38.992 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-10T23:03:38.993 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-10T23:03:38.993 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-10T23:03:38.993 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-10T23:03:38.993 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-10T23:03:38.993 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-10T23:03:38.993 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-10T23:03:38.994 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-10T23:03:38.994 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-10T23:03:38.994 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-10T23:03:38.994 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-10T23:03:38.994 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-10T23:03:38.995 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-10T23:03:38.995 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-10T23:03:38.995 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-10T23:03:38.995 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-10T23:03:38.995 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-10T23:03:38.996 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-10T23:03:38.996 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-10T23:03:38.996 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-10T23:03:38.996 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-10T23:03:38.996 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-10T23:03:38.996 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-10T23:03:38.997 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-10T23:03:38.997 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-10T23:03:38.997 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-10T23:03:38.997 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-10T23:03:38.997 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-10T23:03:38.998 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-10T23:03:38.998 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-10T23:03:38.998 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-10T23:03:38.998 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-10T23:03:38.998 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-10T23:03:38.998 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-10T23:03:38.999 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-10T23:03:38.999 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-10T23:03:38.999 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-10T23:03:38.999 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-10T23:03:38.999 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-10T23:03:38.999 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-10T23:03:39.000 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-10T23:03:39.000 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-10T23:03:39.000 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-10T23:03:39.000 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-10T23:03:39.000 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-10T23:03:39.001 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-10T23:03:39.001 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-10T23:03:39.001 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-10T23:03:39.001 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-10T23:03:39.001 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-10T23:03:39.001 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-10T23:03:39.002 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-10T23:03:39.002 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-10T23:03:39.002 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-10T23:03:39.002 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-10T23:03:39.002 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-10T23:03:39.002 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-10T23:03:39.002 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-10T23:03:39.002 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-10T23:03:39.003 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-10T23:03:39.003 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-10T23:03:39.003 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-10T23:03:39.003 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-10T23:03:39.003 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-10T23:03:39.003 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-10T23:03:39.003 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-10T23:03:39.003 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-10T23:03:39.003 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-10T23:03:39.003 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-10T23:03:39.003 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-10T23:03:39.003 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-10T23:03:39.003 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-10T23:03:39.003 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-10T23:03:39.004 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-10T23:03:39.004 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-10T23:03:39.004 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-10T23:03:39.004 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-10T23:03:39.004 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-10T23:03:39.004 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-10T23:03:39.004 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-10T23:03:39.004 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-10T23:03:39.004 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-10T23:03:39.004 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-10T23:03:39.004 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-10T23:03:39.004 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-10T23:03:39.004 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-10T23:03:39.004 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-10T23:03:39.005 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-10T23:03:39.005 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-10T23:03:39.005 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-10T23:03:39.005 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-10T23:03:39.005 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-10T23:03:39.005 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-10T23:03:39.005 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-10T23:03:39.005 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-10T23:03:39.005 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-10T23:03:39.005 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-10T23:03:39.005 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-10T23:03:39.005 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-10T23:03:39.005 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-10T23:03:39.005 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-10T23:03:39.006 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-10T23:03:39.006 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-10T23:03:39.006 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-10T23:03:39.006 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-10T23:03:39.006 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-10T23:03:39.006 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-10T23:03:39.006 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-10T23:03:39.006 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-10T23:03:39.006 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-10T23:03:39.006 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-10T23:03:39.006 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-10T23:03:39.006 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-10T23:03:39.006 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-10T23:03:39.007 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-10T23:03:39.007 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-10T23:03:39.007 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-10T23:03:39.007 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-10T23:03:39.007 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-10T23:03:39.007 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-10T23:03:39.007 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-10T23:03:39.007 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-10T23:03:39.007 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-10T23:03:39.007 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-10T23:03:39.007 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-10T23:03:39.007 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-10T23:03:39.007 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-10T23:03:39.007 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-10T23:03:39.008 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-10T23:03:39.008 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-10T23:03:39.008 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-10T23:03:39.008 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-10T23:03:39.008 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-10T23:03:39.008 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-10T23:03:39.008 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-10T23:03:39.008 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-10T23:03:39.008 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-10T23:03:39.008 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-10T23:03:39.008 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-10T23:03:39.008 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-10T23:03:39.008 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-10T23:03:39.008 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-10T23:03:39.009 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-10T23:03:39.009 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-10T23:03:39.009 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-10T23:03:39.009 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-10T23:03:39.009 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-10T23:03:39.009 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-10T23:03:39.009 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-10T23:03:39.009 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-10T23:03:39.009 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-10T23:03:39.009 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-10T23:03:39.009 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-10T23:03:39.009 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-10T23:03:39.009 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-10T23:03:39.009 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-10T23:03:39.010 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-10T23:03:39.010 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-10T23:03:39.010 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-10T23:03:39.010 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-10T23:03:39.010 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-10T23:03:39.010 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-10T23:03:39.010 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-10T23:03:39.010 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-10T23:03:39.010 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-10T23:03:39.010 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-10T23:03:39.010 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-10T23:03:39.010 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-10T23:03:39.010 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-10T23:03:39.010 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-10T23:03:39.011 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-10T23:03:39.011 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-10T23:03:39.011 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-10T23:03:39.011 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-10T23:03:39.011 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-10T23:03:39.011 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-10T23:03:39.011 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-10T23:03:39.011 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-10T23:03:39.011 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-10T23:03:39.011 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-10T23:03:39.011 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-10T23:03:39.011 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-10T23:03:39.011 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-10T23:03:39.011 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-10T23:03:39.012 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-10T23:03:39.012 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-10T23:03:39.012 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-10T23:03:39.012 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-10T23:03:39.012 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-10T23:03:39.012 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-10T23:03:39.012 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-10T23:03:39.012 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-10T23:03:39.012 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-10T23:03:39.012 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-10T23:03:39.012 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-10T23:03:39.012 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-10T23:03:39.012 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-10T23:03:39.012 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-10T23:03:39.013 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-10T23:03:39.013 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-10T23:03:39.013 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-10T23:03:39.013 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-10T23:03:39.013 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-10T23:03:39.013 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-10T23:03:39.013 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-10T23:03:39.013 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-10T23:03:39.013 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-10T23:03:39.013 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-10T23:03:39.013 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-10T23:03:39.013 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-10T23:03:39.013 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-10T23:03:39.013 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-10T23:03:39.014 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-10T23:03:39.014 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-10T23:03:39.014 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-10T23:03:39.014 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-10T23:03:39.014 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-10T23:03:39.014 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-10T23:03:39.014 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-10T23:03:39.014 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-10T23:03:39.014 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-10T23:03:39.014 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-10T23:03:39.014 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-10T23:03:39.014 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-10T23:03:39.014 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-10T23:03:39.014 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-10T23:03:39.014 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-10T23:03:39.015 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-10T23:03:39.015 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-10T23:03:39.015 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-10T23:03:39.015 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-10T23:03:39.015 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-10T23:03:39.015 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-10T23:03:39.015 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-10T23:03:39.015 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-10T23:03:39.015 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-10T23:03:39.015 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-10T23:03:39.015 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-10T23:03:39.015 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-10T23:03:39.015 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-10T23:03:39.015 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-10T23:03:39.016 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-10T23:03:39.016 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-10T23:03:39.016 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-10T23:03:39.016 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-10T23:03:39.016 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-10T23:03:39.016 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-10T23:03:39.016 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-10T23:03:39.016 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-10T23:03:39.016 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-10T23:03:39.016 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-10T23:03:39.016 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-10T23:03:39.016 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-10T23:03:39.016 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-10T23:03:39.016 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-10T23:03:39.016 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-10T23:03:39.017 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-10T23:03:39.017 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-10T23:03:39.017 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-10T23:03:39.017 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-10T23:03:39.017 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-10T23:03:39.017 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-10T23:03:39.017 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-10T23:03:39.017 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-10T23:03:39.017 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-10T23:03:39.017 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-10T23:03:39.017 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-10T23:03:39.017 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-10T23:03:39.017 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-10T23:03:39.017 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-10T23:03:39.018 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-10T23:03:39.018 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-10T23:03:39.018 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-10T23:03:39.018 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-10T23:03:39.018 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-10T23:03:39.018 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-10T23:03:39.018 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-10T23:03:39.018 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-10T23:03:39.018 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-10T23:03:39.018 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-10T23:03:39.018 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-10T23:03:39.018 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-10T23:03:39.018 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-10T23:03:39.019 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-10T23:03:39.019 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-10T23:03:39.019 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-10T23:03:39.019 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-10T23:03:39.019 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-10T23:03:39.019 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-10T23:03:39.019 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-10T23:03:39.019 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-10T23:03:39.019 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-10T23:03:39.019 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-10T23:03:39.019 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-10T23:03:39.019 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-10T23:03:39.019 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-10T23:03:39.019 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-10T23:03:39.019 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-10T23:03:39.020 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-10T23:03:39.020 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-10T23:03:39.020 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-10T23:03:39.020 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-10T23:03:39.020 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-10T23:03:39.020 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-10T23:03:39.020 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-10T23:03:39.020 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-10T23:03:39.020 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-10T23:03:39.020 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-10T23:03:39.020 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-10T23:03:39.020 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-10T23:03:39.020 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-10T23:03:39.021 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-10T23:03:39.021 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-10T23:03:39.021 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-10T23:03:39.021 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-10T23:03:39.021 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-10T23:03:39.021 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-10T23:03:39.021 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-10T23:03:39.021 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-10T23:03:39.021 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-10T23:03:39.021 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-10T23:03:39.021 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-10T23:03:39.021 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-10T23:03:39.021 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-10T23:03:39.022 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-10T23:03:39.022 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-10T23:03:39.022 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-10T23:03:39.022 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-10T23:03:39.022 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-10T23:03:39.022 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-10T23:03:39.022 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-10T23:03:39.022 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-10T23:03:39.022 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-10T23:03:39.022 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-10T23:03:39.023 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-10T23:03:39.023 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-10T23:03:39.023 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-10T23:03:39.023 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-10T23:03:39.023 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-10T23:03:39.023 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-10T23:03:39.023 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-10T23:03:39.023 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-10T23:03:39.023 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-10T23:03:39.023 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-10T23:03:39.023 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-10T23:03:39.023 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-10T23:03:39.023 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-10T23:03:39.023 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-10T23:03:39.024 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-10T23:03:39.024 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-10T23:03:39.024 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-10T23:03:39.024 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-10T23:03:39.024 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-10T23:03:39.024 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-10T23:03:39.024 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-10T23:03:39.024 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-10T23:03:39.024 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-10T23:03:39.024 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-10T23:03:39.024 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-10T23:03:39.024 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-10T23:03:39.025 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-10T23:03:39.025 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-10T23:03:39.025 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-10T23:03:39.025 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-10T23:03:39.025 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-10T23:03:39.025 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-10T23:03:39.025 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-10T23:03:39.025 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-10T23:03:39.025 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-10T23:03:39.025 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-10T23:03:39.025 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-10T23:03:39.025 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-10T23:03:39.025 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-10T23:03:39.025 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-10T23:03:39.026 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-10T23:03:39.026 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-10T23:03:39.026 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-10T23:03:39.026 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-10T23:03:39.026 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-10T23:03:39.026 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-10T23:03:39.026 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-10T23:03:39.026 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-10T23:03:39.026 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-10T23:03:39.026 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-10T23:03:39.026 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-10T23:03:39.026 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-10T23:03:39.026 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-10T23:03:39.026 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-10T23:03:39.027 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-10T23:03:39.027 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-10T23:03:39.027 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-10T23:03:39.027 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-10T23:03:39.027 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-10T23:03:39.027 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-10T23:03:39.027 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-10T23:03:39.027 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-10T23:03:39.027 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-10T23:03:39.027 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-10T23:03:39.027 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-10T23:03:39.027 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-10T23:03:39.027 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-10T23:03:39.027 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-10T23:03:39.028 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-10T23:03:39.028 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-10T23:03:39.028 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-10T23:03:39.028 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-10T23:03:39.028 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-10T23:03:39.028 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-10T23:03:39.028 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-10T23:03:39.028 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-10T23:03:39.028 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-10T23:03:39.028 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-10T23:03:39.028 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-10T23:03:39.028 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-10T23:03:39.028 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-10T23:03:39.028 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-10T23:03:39.028 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-10T23:03:39.029 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-10T23:03:39.029 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-10T23:03:39.029 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-10T23:03:39.029 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-10T23:03:39.029 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-10T23:03:39.029 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-10T23:03:39.029 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-10T23:03:39.029 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-10T23:03:39.029 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-10T23:03:39.029 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-10T23:03:39.029 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-10T23:03:39.029 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-10T23:03:39.029 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-10T23:03:39.030 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-10T23:03:39.030 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-10T23:03:39.030 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-10T23:03:39.030 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-10T23:03:39.030 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-10T23:03:39.030 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-10T23:03:39.030 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-10T23:03:39.030 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-10T23:03:39.030 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-10T23:03:39.030 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-10T23:03:39.030 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-10T23:03:39.030 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-10T23:03:39.030 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-10T23:03:39.030 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-10T23:03:39.030 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-10T23:03:39.031 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-10T23:03:39.031 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-10T23:03:39.031 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-10T23:03:39.031 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-10T23:03:39.031 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-10T23:03:39.031 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-10T23:03:39.031 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-10T23:03:39.031 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-10T23:03:39.031 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-10T23:03:39.031 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-10T23:03:39.031 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-10T23:03:39.031 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-10T23:03:39.031 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-10T23:03:39.031 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-10T23:03:39.031 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-10T23:03:39.032 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-10T23:03:39.032 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-10T23:03:39.032 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-10T23:03:39.032 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-10T23:03:39.032 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-10T23:03:39.032 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-10T23:03:39.032 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-10T23:03:39.032 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-10T23:03:39.032 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-10T23:03:39.032 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-10T23:03:39.032 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-10T23:03:39.032 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-10T23:03:39.032 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-10T23:03:39.032 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-10T23:03:39.032 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-10T23:03:39.033 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-10T23:03:39.033 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-10T23:03:39.033 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-10T23:03:39.033 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-10T23:03:39.033 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-10T23:03:39.033 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-10T23:03:39.033 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-10T23:03:39.033 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-10T23:03:39.033 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-10T23:03:39.033 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-10T23:03:39.033 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-10T23:03:39.033 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-10T23:03:39.033 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-10T23:03:39.033 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-10T23:03:39.033 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-10T23:03:39.034 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-10T23:03:39.034 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-10T23:03:39.034 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-10T23:03:39.034 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-10T23:03:39.034 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-10T23:03:39.034 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-10T23:03:39.034 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-10T23:03:39.034 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-10T23:03:39.034 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-10T23:03:39.034 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-10T23:03:39.034 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-10T23:03:39.034 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-10T23:03:39.034 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-10T23:03:39.035 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-10T23:03:39.035 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-10T23:03:39.035 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-10T23:03:39.035 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-10T23:03:39.035 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-10T23:03:39.035 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-10T23:03:39.035 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-10T23:03:39.035 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-10T23:03:39.035 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-10T23:03:39.035 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-10T23:03:39.035 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-10T23:03:39.035 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-10T23:03:39.035 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-10T23:03:39.035 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-10T23:03:39.035 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-10T23:03:39.036 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-10T23:03:39.036 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-10T23:03:39.036 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-10T23:03:39.036 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-10T23:03:39.036 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-10T23:03:39.036 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-10T23:03:39.036 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-10T23:03:39.036 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-10T23:03:39.036 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-10T23:03:39.036 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-10T23:03:39.036 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-10T23:03:39.036 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-10T23:03:39.036 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-10T23:03:39.036 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-10T23:03:39.037 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-10T23:03:39.037 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-10T23:03:39.037 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-10T23:03:39.037 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-10T23:03:39.037 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-10T23:03:39.037 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-10T23:03:39.037 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-10T23:03:39.037 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-10T23:03:39.037 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-10T23:03:39.037 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-10T23:03:39.037 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-10T23:03:39.037 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-10T23:03:39.037 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-10T23:03:39.037 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-10T23:03:39.038 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-10T23:03:39.038 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-10T23:03:39.038 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-10T23:03:39.038 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-10T23:03:39.038 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-10T23:03:39.038 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-10T23:03:39.038 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-10T23:03:39.038 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-10T23:03:39.038 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-10T23:03:39.038 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-10T23:03:39.038 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-10T23:03:39.038 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-10T23:03:39.038 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-10T23:03:39.038 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-10T23:03:39.039 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-10T23:03:39.039 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-10T23:03:39.039 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-10T23:03:39.039 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-10T23:03:39.039 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-10T23:03:39.039 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-10T23:03:39.039 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-10T23:03:39.039 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-10T23:03:39.039 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-10T23:03:39.039 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-10T23:03:39.039 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-10T23:03:39.039 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-10T23:03:39.039 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-10T23:03:39.039 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-10T23:03:39.039 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-10T23:03:39.040 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-10T23:03:39.040 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-10T23:03:39.040 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-10T23:03:39.040 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-10T23:03:39.040 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-10T23:03:39.040 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-10T23:03:39.040 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-10T23:03:39.040 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-10T23:03:39.040 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-10T23:03:39.040 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-10T23:03:39.040 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-10T23:03:39.040 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-10T23:03:39.040 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-10T23:03:39.041 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-10T23:03:39.041 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-10T23:03:39.041 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-10T23:03:39.041 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-10T23:03:39.041 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-10T23:03:39.041 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-10T23:03:39.041 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-10T23:03:39.041 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-10T23:03:39.041 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T23:03:39.045 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:03:39.046 DEBUG:teuthology.orchestra.run.smithi194:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-10T23:03:39.070 INFO:teuthology.orchestra.run.smithi194.stdout:postinstall scriptlet (using /bin/sh): 2024-09-10T23:03:39.070 INFO:teuthology.orchestra.run.smithi194.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T23:03:39.070 INFO:teuthology.orchestra.run.smithi194.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T23:03:39.070 INFO:teuthology.orchestra.run.smithi194.stdout:fi 2024-09-10T23:03:39.070 INFO:teuthology.orchestra.run.smithi194.stdout:for file in vmlinuz System.map config; do 2024-09-10T23:03:39.070 INFO:teuthology.orchestra.run.smithi194.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-10T23:03:39.070 INFO:teuthology.orchestra.run.smithi194.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T23:03:39.071 INFO:teuthology.orchestra.run.smithi194.stdout: fi 2024-09-10T23:03:39.071 INFO:teuthology.orchestra.run.smithi194.stdout:done 2024-09-10T23:03:39.071 INFO:teuthology.orchestra.run.smithi194.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-10T23:03:39.071 INFO:teuthology.orchestra.run.smithi194.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-10T23:03:39.071 INFO:teuthology.orchestra.run.smithi194.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T23:03:39.071 INFO:teuthology.orchestra.run.smithi194.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T23:03:39.071 INFO:teuthology.orchestra.run.smithi194.stdout:fi 2024-09-10T23:03:39.071 INFO:teuthology.orchestra.run.smithi194.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-10T23:03:39.071 INFO:teuthology.orchestra.run.smithi194.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:03:39.071 INFO:teuthology.orchestra.run.smithi194.stdout:fi 2024-09-10T23:03:39.071 INFO:teuthology.orchestra.run.smithi194.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-10T23:03:39.071 INFO:teuthology.orchestra.run.smithi194.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T23:03:39.071 INFO:teuthology.orchestra.run.smithi194.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:03:39.071 INFO:teuthology.orchestra.run.smithi194.stdout:fi 2024-09-10T23:03:39.072 DEBUG:teuthology.orchestra.run.smithi194:> sudo rpm -qi grub2-tools 2024-09-10T23:03:39.148 INFO:teuthology.orchestra.run.smithi194.stdout:Name : grub2-tools 2024-09-10T23:03:39.148 INFO:teuthology.orchestra.run.smithi194.stdout:Epoch : 1 2024-09-10T23:03:39.148 INFO:teuthology.orchestra.run.smithi194.stdout:Version : 2.06 2024-09-10T23:03:39.148 INFO:teuthology.orchestra.run.smithi194.stdout:Release : 82.el9 2024-09-10T23:03:39.148 INFO:teuthology.orchestra.run.smithi194.stdout:Architecture: x86_64 2024-09-10T23:03:39.148 INFO:teuthology.orchestra.run.smithi194.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T23:03:39.148 INFO:teuthology.orchestra.run.smithi194.stdout:Group : Unspecified 2024-09-10T23:03:39.149 INFO:teuthology.orchestra.run.smithi194.stdout:Size : 8274670 2024-09-10T23:03:39.149 INFO:teuthology.orchestra.run.smithi194.stdout:License : GPLv3+ 2024-09-10T23:03:39.149 INFO:teuthology.orchestra.run.smithi194.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T23:03:39.149 INFO:teuthology.orchestra.run.smithi194.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T23:03:39.149 INFO:teuthology.orchestra.run.smithi194.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T23:03:39.149 INFO:teuthology.orchestra.run.smithi194.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T23:03:39.149 INFO:teuthology.orchestra.run.smithi194.stdout:Packager : builder@centos.org 2024-09-10T23:03:39.149 INFO:teuthology.orchestra.run.smithi194.stdout:Vendor : CentOS 2024-09-10T23:03:39.149 INFO:teuthology.orchestra.run.smithi194.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T23:03:39.149 INFO:teuthology.orchestra.run.smithi194.stdout:Summary : Support tools for GRUB. 2024-09-10T23:03:39.149 INFO:teuthology.orchestra.run.smithi194.stdout:Description : 2024-09-10T23:03:39.149 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-10T23:03:39.149 INFO:teuthology.orchestra.run.smithi194.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T23:03:39.149 INFO:teuthology.orchestra.run.smithi194.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T23:03:39.150 INFO:teuthology.orchestra.run.smithi194.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T23:03:39.150 INFO:teuthology.orchestra.run.smithi194.stdout:hardware devices. 2024-09-10T23:03:39.150 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-10T23:03:39.150 INFO:teuthology.orchestra.run.smithi194.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T23:03:39.151 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T23:03:39.151 INFO:teuthology.task.kernel:Updating grub on smithi194 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:03:39.151 DEBUG:teuthology.orchestra.run.smithi194:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T23:03:39.734 INFO:teuthology.orchestra.run.smithi194.stderr:Generating grub configuration file ... 2024-09-10T23:03:41.110 INFO:teuthology.orchestra.run.smithi194.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T23:03:41.138 INFO:teuthology.orchestra.run.smithi194.stderr:done 2024-09-10T23:03:41.140 DEBUG:teuthology.orchestra.run.smithi194:> mktemp 2024-09-10T23:03:41.155 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.JZ4P07AEZJ 2024-09-10T23:03:41.156 DEBUG:teuthology.orchestra.run.smithi194:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.JZ4P07AEZJ 2024-09-10T23:03:41.223 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.JZ4P07AEZJ 2024-09-10T23:03:41.359 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.JZ4P07AEZJ is 6KB 2024-09-10T23:03:41.409 DEBUG:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.JZ4P07AEZJ 2024-09-10T23:03:41.423 DEBUG:teuthology.orchestra.run.smithi194:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T23:03:41.487 INFO:teuthology.orchestra.run.smithi194.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T23:03:41.487 INFO:teuthology.orchestra.run.smithi194.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T23:03:41.487 INFO:teuthology.orchestra.run.smithi194.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T23:03:41.487 INFO:teuthology.orchestra.run.smithi194.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-10T23:03:41.488 DEBUG:teuthology.orchestra.run.smithi194:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:03:41.645 DEBUG:teuthology.orchestra.run.smithi194:> sudo shutdown -r now 2024-09-10T23:03:43.902 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi003.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-10T23:03:43.902 DEBUG:teuthology.orchestra.run.smithi003:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-10T23:03:44.009 INFO:teuthology.orchestra.run.smithi003.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:03:44.009 INFO:teuthology.orchestra.run.smithi003.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:03:44.010 INFO:teuthology.orchestra.run.smithi003.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:03:44.010 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:03:44.010 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-10T23:03:44.010 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-10T23:03:44.010 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-10T23:03:44.010 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-10T23:03:44.010 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-10T23:03:44.011 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-10T23:03:44.011 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-10T23:03:44.011 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-10T23:03:44.011 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-10T23:03:44.011 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-10T23:03:44.011 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-10T23:03:44.011 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-10T23:03:44.012 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-10T23:03:44.012 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-10T23:03:44.012 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-10T23:03:44.012 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-10T23:03:44.012 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-10T23:03:44.012 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-10T23:03:44.013 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-10T23:03:44.013 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-10T23:03:44.013 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-10T23:03:44.013 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-10T23:03:44.013 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-10T23:03:44.013 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-10T23:03:44.013 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-10T23:03:44.013 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-10T23:03:44.013 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-10T23:03:44.013 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-10T23:03:44.013 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-10T23:03:44.014 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-10T23:03:44.014 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-10T23:03:44.014 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-10T23:03:44.014 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-10T23:03:44.014 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-10T23:03:44.014 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-10T23:03:44.014 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-10T23:03:44.014 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-10T23:03:44.014 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-10T23:03:44.014 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-10T23:03:44.014 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-10T23:03:44.014 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-10T23:03:44.015 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-10T23:03:44.015 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-10T23:03:44.015 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-10T23:03:44.015 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-10T23:03:44.015 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-10T23:03:44.015 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-10T23:03:44.015 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-10T23:03:44.015 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-10T23:03:44.015 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-10T23:03:44.015 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-10T23:03:44.015 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-10T23:03:44.015 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-10T23:03:44.015 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-10T23:03:44.015 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-10T23:03:44.016 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-10T23:03:44.016 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-10T23:03:44.016 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-10T23:03:44.016 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-10T23:03:44.016 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-10T23:03:44.016 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-10T23:03:44.016 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-10T23:03:44.016 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-10T23:03:44.016 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-10T23:03:44.016 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-10T23:03:44.016 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-10T23:03:44.016 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-10T23:03:44.016 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-10T23:03:44.017 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-10T23:03:44.017 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-10T23:03:44.017 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-10T23:03:44.017 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-10T23:03:44.017 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-10T23:03:44.017 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-10T23:03:44.017 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-10T23:03:44.017 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-10T23:03:44.017 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-10T23:03:44.017 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-10T23:03:44.017 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-10T23:03:44.017 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-10T23:03:44.017 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-10T23:03:44.018 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-10T23:03:44.018 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-10T23:03:44.018 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-10T23:03:44.018 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-10T23:03:44.018 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-10T23:03:44.018 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-10T23:03:44.018 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-10T23:03:44.018 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-10T23:03:44.018 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-10T23:03:44.018 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-10T23:03:44.018 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-10T23:03:44.018 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-10T23:03:44.018 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-10T23:03:44.019 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-10T23:03:44.019 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-10T23:03:44.019 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-10T23:03:44.019 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-10T23:03:44.019 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-10T23:03:44.019 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-10T23:03:44.019 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-10T23:03:44.019 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-10T23:03:44.019 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-10T23:03:44.019 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-10T23:03:44.019 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-10T23:03:44.019 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-10T23:03:44.019 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-10T23:03:44.020 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-10T23:03:44.020 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-10T23:03:44.020 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-10T23:03:44.020 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-10T23:03:44.020 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-10T23:03:44.020 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-10T23:03:44.020 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-10T23:03:44.020 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-10T23:03:44.020 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-10T23:03:44.020 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-10T23:03:44.020 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-10T23:03:44.021 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-10T23:03:44.021 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-10T23:03:44.021 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-10T23:03:44.021 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-10T23:03:44.021 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-10T23:03:44.021 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-10T23:03:44.021 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-10T23:03:44.021 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-10T23:03:44.021 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-10T23:03:44.021 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-10T23:03:44.021 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-10T23:03:44.021 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-10T23:03:44.022 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-10T23:03:44.022 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-10T23:03:44.022 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-10T23:03:44.022 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-10T23:03:44.022 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-10T23:03:44.022 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-10T23:03:44.022 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-10T23:03:44.022 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-10T23:03:44.022 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-10T23:03:44.022 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-10T23:03:44.022 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-10T23:03:44.022 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-10T23:03:44.022 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-10T23:03:44.023 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-10T23:03:44.023 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-10T23:03:44.023 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-10T23:03:44.023 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-10T23:03:44.023 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-10T23:03:44.023 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-10T23:03:44.023 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-10T23:03:44.023 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-10T23:03:44.023 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-10T23:03:44.023 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-10T23:03:44.023 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-10T23:03:44.023 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-10T23:03:44.023 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-10T23:03:44.023 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-10T23:03:44.024 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-10T23:03:44.024 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-10T23:03:44.024 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-10T23:03:44.024 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-10T23:03:44.024 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-10T23:03:44.024 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-10T23:03:44.024 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-10T23:03:44.024 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-10T23:03:44.024 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-10T23:03:44.025 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-10T23:03:44.025 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-10T23:03:44.025 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-10T23:03:44.025 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-10T23:03:44.026 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-10T23:03:44.026 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-10T23:03:44.026 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-10T23:03:44.026 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-10T23:03:44.026 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-10T23:03:44.026 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-10T23:03:44.027 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-10T23:03:44.027 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-10T23:03:44.027 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-10T23:03:44.027 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-10T23:03:44.027 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-10T23:03:44.027 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-10T23:03:44.028 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-10T23:03:44.028 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-10T23:03:44.028 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-10T23:03:44.028 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-10T23:03:44.028 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-10T23:03:44.028 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-10T23:03:44.028 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-10T23:03:44.028 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-10T23:03:44.028 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-10T23:03:44.029 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-10T23:03:44.029 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-10T23:03:44.029 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-10T23:03:44.029 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-10T23:03:44.029 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-10T23:03:44.029 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-10T23:03:44.029 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-10T23:03:44.029 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-10T23:03:44.029 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-10T23:03:44.029 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-10T23:03:44.029 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-10T23:03:44.029 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-10T23:03:44.030 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-10T23:03:44.030 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-10T23:03:44.030 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-10T23:03:44.030 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-10T23:03:44.030 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-10T23:03:44.030 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-10T23:03:44.030 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-10T23:03:44.030 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-10T23:03:44.030 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-10T23:03:44.030 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-10T23:03:44.030 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-10T23:03:44.030 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-10T23:03:44.031 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-10T23:03:44.031 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-10T23:03:44.031 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-10T23:03:44.031 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-10T23:03:44.031 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-10T23:03:44.031 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-10T23:03:44.031 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-10T23:03:44.031 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-10T23:03:44.031 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-10T23:03:44.031 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-10T23:03:44.031 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-10T23:03:44.031 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-10T23:03:44.031 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-10T23:03:44.031 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-10T23:03:44.032 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-10T23:03:44.032 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-10T23:03:44.032 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-10T23:03:44.032 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-10T23:03:44.032 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-10T23:03:44.032 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-10T23:03:44.032 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-10T23:03:44.032 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-10T23:03:44.032 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-10T23:03:44.032 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-10T23:03:44.032 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-10T23:03:44.032 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-10T23:03:44.033 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-10T23:03:44.033 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-10T23:03:44.033 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-10T23:03:44.033 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-10T23:03:44.033 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-10T23:03:44.033 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-10T23:03:44.033 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-10T23:03:44.033 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-10T23:03:44.033 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-10T23:03:44.033 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-10T23:03:44.033 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-10T23:03:44.033 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-10T23:03:44.033 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-10T23:03:44.034 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-10T23:03:44.034 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-10T23:03:44.034 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-10T23:03:44.034 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-10T23:03:44.034 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-10T23:03:44.034 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-10T23:03:44.034 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-10T23:03:44.034 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-10T23:03:44.034 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-10T23:03:44.034 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-10T23:03:44.034 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-10T23:03:44.034 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-10T23:03:44.034 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-10T23:03:44.035 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-10T23:03:44.035 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-10T23:03:44.035 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-10T23:03:44.035 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-10T23:03:44.035 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-10T23:03:44.035 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-10T23:03:44.035 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-10T23:03:44.035 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-10T23:03:44.035 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-10T23:03:44.035 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-10T23:03:44.035 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-10T23:03:44.035 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-10T23:03:44.035 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-10T23:03:44.035 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-10T23:03:44.036 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-10T23:03:44.036 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-10T23:03:44.036 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-10T23:03:44.036 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-10T23:03:44.036 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-10T23:03:44.036 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-10T23:03:44.036 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-10T23:03:44.036 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-10T23:03:44.036 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-10T23:03:44.036 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-10T23:03:44.036 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-10T23:03:44.036 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-10T23:03:44.036 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-10T23:03:44.037 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-10T23:03:44.037 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-10T23:03:44.037 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-10T23:03:44.037 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-10T23:03:44.037 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-10T23:03:44.037 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-10T23:03:44.037 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-10T23:03:44.037 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-10T23:03:44.037 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-10T23:03:44.037 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-10T23:03:44.038 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-10T23:03:44.038 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-10T23:03:44.038 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-10T23:03:44.038 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-10T23:03:44.038 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-10T23:03:44.038 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-10T23:03:44.038 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-10T23:03:44.038 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-10T23:03:44.038 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-10T23:03:44.038 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-10T23:03:44.038 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-10T23:03:44.038 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-10T23:03:44.038 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-10T23:03:44.039 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-10T23:03:44.039 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-10T23:03:44.039 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-10T23:03:44.039 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-10T23:03:44.039 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-10T23:03:44.039 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-10T23:03:44.039 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-10T23:03:44.039 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-10T23:03:44.039 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-10T23:03:44.039 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-10T23:03:44.039 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-10T23:03:44.039 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-10T23:03:44.039 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-10T23:03:44.039 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-10T23:03:44.040 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-10T23:03:44.040 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-10T23:03:44.040 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-10T23:03:44.040 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-10T23:03:44.040 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-10T23:03:44.040 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-10T23:03:44.040 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-10T23:03:44.040 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-10T23:03:44.040 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-10T23:03:44.040 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-10T23:03:44.040 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-10T23:03:44.040 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-10T23:03:44.040 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-10T23:03:44.040 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-10T23:03:44.041 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-10T23:03:44.041 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-10T23:03:44.041 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-10T23:03:44.041 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-10T23:03:44.041 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-10T23:03:44.041 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-10T23:03:44.041 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-10T23:03:44.041 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-10T23:03:44.041 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-10T23:03:44.041 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-10T23:03:44.041 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-10T23:03:44.041 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-10T23:03:44.042 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-10T23:03:44.042 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-10T23:03:44.042 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-10T23:03:44.042 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-10T23:03:44.042 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-10T23:03:44.042 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-10T23:03:44.042 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-10T23:03:44.042 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-10T23:03:44.042 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-10T23:03:44.042 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-10T23:03:44.042 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-10T23:03:44.042 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-10T23:03:44.042 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-10T23:03:44.042 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-10T23:03:44.043 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-10T23:03:44.043 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-10T23:03:44.043 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-10T23:03:44.043 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-10T23:03:44.043 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-10T23:03:44.043 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-10T23:03:44.043 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-10T23:03:44.043 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-10T23:03:44.043 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-10T23:03:44.043 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-10T23:03:44.043 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-10T23:03:44.043 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-10T23:03:44.043 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-10T23:03:44.043 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-10T23:03:44.044 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-10T23:03:44.044 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-10T23:03:44.044 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-10T23:03:44.044 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-10T23:03:44.044 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-10T23:03:44.044 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-10T23:03:44.044 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-10T23:03:44.044 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-10T23:03:44.044 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-10T23:03:44.044 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-10T23:03:44.044 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-10T23:03:44.044 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-10T23:03:44.044 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-10T23:03:44.044 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-10T23:03:44.045 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-10T23:03:44.045 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-10T23:03:44.045 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-10T23:03:44.045 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-10T23:03:44.045 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-10T23:03:44.045 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-10T23:03:44.045 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-10T23:03:44.045 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-10T23:03:44.045 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-10T23:03:44.045 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-10T23:03:44.045 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-10T23:03:44.045 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-10T23:03:44.045 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-10T23:03:44.045 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-10T23:03:44.046 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-10T23:03:44.046 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-10T23:03:44.046 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-10T23:03:44.046 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-10T23:03:44.046 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-10T23:03:44.046 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-10T23:03:44.046 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-10T23:03:44.046 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-10T23:03:44.046 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-10T23:03:44.046 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-10T23:03:44.046 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-10T23:03:44.046 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-10T23:03:44.047 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-10T23:03:44.047 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-10T23:03:44.047 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-10T23:03:44.047 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-10T23:03:44.047 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-10T23:03:44.047 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-10T23:03:44.047 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-10T23:03:44.047 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-10T23:03:44.047 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-10T23:03:44.047 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-10T23:03:44.047 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-10T23:03:44.048 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-10T23:03:44.048 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-10T23:03:44.048 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-10T23:03:44.048 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-10T23:03:44.048 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-10T23:03:44.048 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-10T23:03:44.048 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-10T23:03:44.048 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-10T23:03:44.048 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-10T23:03:44.048 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-10T23:03:44.048 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-10T23:03:44.049 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-10T23:03:44.049 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-10T23:03:44.049 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-10T23:03:44.049 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-10T23:03:44.049 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-10T23:03:44.049 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-10T23:03:44.049 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-10T23:03:44.049 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-10T23:03:44.049 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-10T23:03:44.049 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-10T23:03:44.049 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-10T23:03:44.050 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-10T23:03:44.050 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-10T23:03:44.050 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-10T23:03:44.050 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-10T23:03:44.050 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-10T23:03:44.050 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-10T23:03:44.050 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-10T23:03:44.050 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-10T23:03:44.050 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-10T23:03:44.050 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-10T23:03:44.050 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-10T23:03:44.050 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-10T23:03:44.050 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-10T23:03:44.051 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-10T23:03:44.051 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-10T23:03:44.051 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-10T23:03:44.051 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-10T23:03:44.051 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-10T23:03:44.051 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-10T23:03:44.051 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-10T23:03:44.051 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-10T23:03:44.051 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-10T23:03:44.051 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-10T23:03:44.051 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-10T23:03:44.051 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-10T23:03:44.051 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-10T23:03:44.051 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-10T23:03:44.051 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-10T23:03:44.052 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-10T23:03:44.052 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-10T23:03:44.052 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-10T23:03:44.052 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-10T23:03:44.052 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-10T23:03:44.052 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-10T23:03:44.052 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-10T23:03:44.052 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-10T23:03:44.052 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-10T23:03:44.052 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-10T23:03:44.052 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-10T23:03:44.052 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-10T23:03:44.052 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-10T23:03:44.052 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-10T23:03:44.052 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-10T23:03:44.053 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-10T23:03:44.053 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-10T23:03:44.053 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-10T23:03:44.053 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-10T23:03:44.053 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-10T23:03:44.053 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-10T23:03:44.053 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-10T23:03:44.053 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-10T23:03:44.053 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-10T23:03:44.053 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-10T23:03:44.053 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-10T23:03:44.053 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-10T23:03:44.053 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-10T23:03:44.054 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-10T23:03:44.054 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-10T23:03:44.054 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-10T23:03:44.054 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-10T23:03:44.054 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-10T23:03:44.054 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-10T23:03:44.054 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-10T23:03:44.054 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-10T23:03:44.054 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-10T23:03:44.054 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-10T23:03:44.054 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-10T23:03:44.054 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-10T23:03:44.054 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-10T23:03:44.054 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-10T23:03:44.055 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-10T23:03:44.055 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-10T23:03:44.055 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-10T23:03:44.055 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-10T23:03:44.055 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-10T23:03:44.055 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-10T23:03:44.055 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-10T23:03:44.055 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-10T23:03:44.055 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-10T23:03:44.055 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-10T23:03:44.055 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-10T23:03:44.055 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-10T23:03:44.055 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-10T23:03:44.055 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-10T23:03:44.056 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-10T23:03:44.056 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-10T23:03:44.056 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-10T23:03:44.056 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-10T23:03:44.056 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-10T23:03:44.056 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-10T23:03:44.056 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-10T23:03:44.056 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-10T23:03:44.056 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-10T23:03:44.056 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-10T23:03:44.056 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-10T23:03:44.056 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-10T23:03:44.056 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-10T23:03:44.057 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-10T23:03:44.057 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-10T23:03:44.057 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-10T23:03:44.057 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-10T23:03:44.057 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-10T23:03:44.057 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-10T23:03:44.057 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-10T23:03:44.057 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-10T23:03:44.057 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-10T23:03:44.057 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-10T23:03:44.057 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-10T23:03:44.057 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-10T23:03:44.057 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-10T23:03:44.058 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-10T23:03:44.058 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-10T23:03:44.058 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-10T23:03:44.058 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-10T23:03:44.058 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-10T23:03:44.058 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-10T23:03:44.058 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-10T23:03:44.058 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-10T23:03:44.058 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-10T23:03:44.058 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-10T23:03:44.058 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-10T23:03:44.058 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-10T23:03:44.058 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-10T23:03:44.058 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-10T23:03:44.059 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-10T23:03:44.059 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-10T23:03:44.059 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-10T23:03:44.059 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-10T23:03:44.059 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-10T23:03:44.059 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-10T23:03:44.059 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-10T23:03:44.059 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-10T23:03:44.059 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-10T23:03:44.059 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-10T23:03:44.059 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-10T23:03:44.059 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-10T23:03:44.059 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-10T23:03:44.060 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-10T23:03:44.060 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-10T23:03:44.060 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-10T23:03:44.060 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-10T23:03:44.060 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-10T23:03:44.060 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-10T23:03:44.060 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-10T23:03:44.060 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-10T23:03:44.061 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-10T23:03:44.061 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-10T23:03:44.061 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-10T23:03:44.061 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-10T23:03:44.061 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-10T23:03:44.061 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-10T23:03:44.061 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-10T23:03:44.061 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-10T23:03:44.061 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-10T23:03:44.061 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-10T23:03:44.061 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-10T23:03:44.062 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-10T23:03:44.062 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-10T23:03:44.062 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-10T23:03:44.062 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-10T23:03:44.062 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-10T23:03:44.062 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-10T23:03:44.063 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-10T23:03:44.063 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-10T23:03:44.063 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-10T23:03:44.063 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-10T23:03:44.063 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-10T23:03:44.063 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-10T23:03:44.063 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-10T23:03:44.064 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-10T23:03:44.064 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-10T23:03:44.064 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-10T23:03:44.064 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-10T23:03:44.064 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-10T23:03:44.064 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-10T23:03:44.064 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-10T23:03:44.065 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-10T23:03:44.065 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-10T23:03:44.065 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-10T23:03:44.065 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-10T23:03:44.065 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-10T23:03:44.065 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-10T23:03:44.065 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-10T23:03:44.066 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-10T23:03:44.066 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-10T23:03:44.066 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-10T23:03:44.066 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-10T23:03:44.066 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-10T23:03:44.066 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-10T23:03:44.066 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-10T23:03:44.066 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-10T23:03:44.066 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-10T23:03:44.066 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-10T23:03:44.066 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-10T23:03:44.066 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-10T23:03:44.066 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-10T23:03:44.066 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-10T23:03:44.067 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-10T23:03:44.067 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-10T23:03:44.067 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-10T23:03:44.067 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-10T23:03:44.067 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-10T23:03:44.067 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-10T23:03:44.067 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-10T23:03:44.067 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-10T23:03:44.067 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-10T23:03:44.067 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-10T23:03:44.067 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-10T23:03:44.067 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-10T23:03:44.068 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-10T23:03:44.068 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-10T23:03:44.068 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-10T23:03:44.068 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-10T23:03:44.068 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-10T23:03:44.068 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-10T23:03:44.068 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-10T23:03:44.068 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-10T23:03:44.068 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-10T23:03:44.068 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-10T23:03:44.068 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-10T23:03:44.068 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-10T23:03:44.069 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-10T23:03:44.069 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-10T23:03:44.069 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-10T23:03:44.069 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-10T23:03:44.069 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-10T23:03:44.069 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-10T23:03:44.069 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-10T23:03:44.069 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-10T23:03:44.069 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-10T23:03:44.069 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-10T23:03:44.069 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-10T23:03:44.069 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-10T23:03:44.069 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-10T23:03:44.070 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-10T23:03:44.070 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-10T23:03:44.070 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-10T23:03:44.070 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-10T23:03:44.070 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-10T23:03:44.070 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-10T23:03:44.070 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-10T23:03:44.070 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-10T23:03:44.070 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-10T23:03:44.070 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-10T23:03:44.071 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-10T23:03:44.071 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-10T23:03:44.071 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-10T23:03:44.071 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-10T23:03:44.071 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-10T23:03:44.071 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-10T23:03:44.071 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-10T23:03:44.071 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-10T23:03:44.071 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-10T23:03:44.071 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-10T23:03:44.071 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-10T23:03:44.072 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-10T23:03:44.072 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-10T23:03:44.072 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-10T23:03:44.072 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-10T23:03:44.072 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-10T23:03:44.072 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-10T23:03:44.072 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-10T23:03:44.072 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-10T23:03:44.072 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-10T23:03:44.072 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-10T23:03:44.072 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-10T23:03:44.072 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-10T23:03:44.072 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-10T23:03:44.073 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-10T23:03:44.073 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-10T23:03:44.073 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-10T23:03:44.073 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-10T23:03:44.073 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-10T23:03:44.073 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-10T23:03:44.073 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-10T23:03:44.073 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-10T23:03:44.073 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-10T23:03:44.073 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-10T23:03:44.073 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-10T23:03:44.073 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-10T23:03:44.073 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-10T23:03:44.074 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-10T23:03:44.074 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-10T23:03:44.074 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-10T23:03:44.074 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-10T23:03:44.074 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-10T23:03:44.074 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-10T23:03:44.074 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-10T23:03:44.074 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-10T23:03:44.074 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-10T23:03:44.074 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-10T23:03:44.074 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-10T23:03:44.074 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-10T23:03:44.074 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-10T23:03:44.074 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-10T23:03:44.075 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-10T23:03:44.075 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-10T23:03:44.075 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-10T23:03:44.075 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-10T23:03:44.075 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-10T23:03:44.075 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-10T23:03:44.075 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-10T23:03:44.075 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-10T23:03:44.075 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-10T23:03:44.075 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-10T23:03:44.075 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-10T23:03:44.075 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-10T23:03:44.075 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-10T23:03:44.076 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-10T23:03:44.076 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-10T23:03:44.076 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-10T23:03:44.076 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-10T23:03:44.076 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-10T23:03:44.076 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-10T23:03:44.076 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-10T23:03:44.076 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-10T23:03:44.076 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-10T23:03:44.076 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-10T23:03:44.076 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-10T23:03:44.076 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-10T23:03:44.076 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-10T23:03:44.077 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-10T23:03:44.077 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-10T23:03:44.077 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-10T23:03:44.077 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-10T23:03:44.077 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-10T23:03:44.077 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-10T23:03:44.077 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-10T23:03:44.077 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-10T23:03:44.077 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-10T23:03:44.077 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-10T23:03:44.077 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-10T23:03:44.078 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-10T23:03:44.078 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-10T23:03:44.078 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-10T23:03:44.078 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-10T23:03:44.078 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-10T23:03:44.078 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-10T23:03:44.078 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-10T23:03:44.078 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-10T23:03:44.078 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-10T23:03:44.078 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-10T23:03:44.078 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-10T23:03:44.078 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-10T23:03:44.078 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-10T23:03:44.078 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-10T23:03:44.079 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-10T23:03:44.079 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-10T23:03:44.079 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-10T23:03:44.079 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-10T23:03:44.079 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-10T23:03:44.079 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-10T23:03:44.079 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-10T23:03:44.079 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-10T23:03:44.079 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-10T23:03:44.079 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-10T23:03:44.079 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-10T23:03:44.079 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-10T23:03:44.080 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-10T23:03:44.080 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-10T23:03:44.080 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-10T23:03:44.080 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-10T23:03:44.080 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-10T23:03:44.080 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-10T23:03:44.080 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-10T23:03:44.080 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-10T23:03:44.080 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-10T23:03:44.080 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-10T23:03:44.080 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-10T23:03:44.080 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-10T23:03:44.080 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-10T23:03:44.081 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-10T23:03:44.081 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-10T23:03:44.081 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-10T23:03:44.081 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-10T23:03:44.081 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-10T23:03:44.081 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-10T23:03:44.081 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-10T23:03:44.081 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-10T23:03:44.082 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-10T23:03:44.082 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-10T23:03:44.082 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-10T23:03:44.082 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-10T23:03:44.082 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-10T23:03:44.082 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-10T23:03:44.082 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-10T23:03:44.082 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-10T23:03:44.082 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-10T23:03:44.082 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-10T23:03:44.082 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-10T23:03:44.082 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-10T23:03:44.082 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-10T23:03:44.083 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-10T23:03:44.083 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-10T23:03:44.083 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-10T23:03:44.083 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-10T23:03:44.083 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-10T23:03:44.083 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-10T23:03:44.083 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-10T23:03:44.083 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-10T23:03:44.083 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-10T23:03:44.083 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-10T23:03:44.083 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-10T23:03:44.083 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-10T23:03:44.083 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-10T23:03:44.083 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-10T23:03:44.084 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-10T23:03:44.084 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-10T23:03:44.084 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-10T23:03:44.084 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-10T23:03:44.084 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-10T23:03:44.084 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-10T23:03:44.084 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-10T23:03:44.084 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-10T23:03:44.084 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-10T23:03:44.084 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-10T23:03:44.084 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-10T23:03:44.084 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-10T23:03:44.084 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-10T23:03:44.085 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-10T23:03:44.085 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-10T23:03:44.085 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-10T23:03:44.085 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-10T23:03:44.085 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-10T23:03:44.085 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-10T23:03:44.085 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-10T23:03:44.085 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-10T23:03:44.085 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-10T23:03:44.085 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-10T23:03:44.085 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-10T23:03:44.085 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-10T23:03:44.085 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-10T23:03:44.086 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-10T23:03:44.086 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-10T23:03:44.086 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-10T23:03:44.086 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-10T23:03:44.086 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-10T23:03:44.086 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-10T23:03:44.086 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-10T23:03:44.086 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-10T23:03:44.086 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-10T23:03:44.086 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-10T23:03:44.086 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-10T23:03:44.086 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-10T23:03:44.087 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-10T23:03:44.087 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-10T23:03:44.087 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-10T23:03:44.087 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-10T23:03:44.087 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-10T23:03:44.087 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-10T23:03:44.087 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-10T23:03:44.087 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-10T23:03:44.087 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-10T23:03:44.087 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-10T23:03:44.087 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-10T23:03:44.087 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-10T23:03:44.087 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-10T23:03:44.088 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-10T23:03:44.088 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-10T23:03:44.088 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-10T23:03:44.088 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-10T23:03:44.088 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-10T23:03:44.088 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-10T23:03:44.088 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-10T23:03:44.088 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-10T23:03:44.088 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-10T23:03:44.088 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-10T23:03:44.088 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-10T23:03:44.088 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-10T23:03:44.088 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-10T23:03:44.089 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-10T23:03:44.089 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-10T23:03:44.089 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-10T23:03:44.089 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-10T23:03:44.089 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-10T23:03:44.089 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-10T23:03:44.089 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-10T23:03:44.089 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-10T23:03:44.089 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-10T23:03:44.089 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-10T23:03:44.089 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-10T23:03:44.089 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-10T23:03:44.090 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-10T23:03:44.090 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-10T23:03:44.090 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-10T23:03:44.090 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-10T23:03:44.090 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-10T23:03:44.090 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-10T23:03:44.090 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-10T23:03:44.090 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-10T23:03:44.090 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-10T23:03:44.090 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-10T23:03:44.090 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-10T23:03:44.090 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-10T23:03:44.090 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-10T23:03:44.091 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-10T23:03:44.091 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-10T23:03:44.091 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-10T23:03:44.091 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-10T23:03:44.091 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-10T23:03:44.091 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-10T23:03:44.091 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-10T23:03:44.091 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-10T23:03:44.091 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-10T23:03:44.091 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-10T23:03:44.091 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-10T23:03:44.091 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-10T23:03:44.092 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-10T23:03:44.092 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-10T23:03:44.092 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-10T23:03:44.092 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-10T23:03:44.092 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-10T23:03:44.092 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-10T23:03:44.092 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-10T23:03:44.092 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-10T23:03:44.093 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-10T23:03:44.093 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-10T23:03:44.093 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-10T23:03:44.093 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-10T23:03:44.093 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-10T23:03:44.093 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-10T23:03:44.093 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-10T23:03:44.093 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-10T23:03:44.093 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-10T23:03:44.093 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-10T23:03:44.093 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-10T23:03:44.093 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-10T23:03:44.094 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-10T23:03:44.094 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-10T23:03:44.094 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-10T23:03:44.094 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-10T23:03:44.094 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-10T23:03:44.094 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-10T23:03:44.094 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-10T23:03:44.094 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-10T23:03:44.094 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-10T23:03:44.094 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-10T23:03:44.094 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-10T23:03:44.094 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-10T23:03:44.094 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-10T23:03:44.094 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-10T23:03:44.095 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-10T23:03:44.095 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-10T23:03:44.095 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-10T23:03:44.095 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-10T23:03:44.095 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-10T23:03:44.095 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-10T23:03:44.095 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-10T23:03:44.095 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-10T23:03:44.095 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-10T23:03:44.095 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-10T23:03:44.095 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-10T23:03:44.095 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-10T23:03:44.095 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-10T23:03:44.096 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-10T23:03:44.096 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-10T23:03:44.096 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-10T23:03:44.096 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-10T23:03:44.096 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-10T23:03:44.096 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-10T23:03:44.096 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-10T23:03:44.096 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-10T23:03:44.096 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-10T23:03:44.096 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-10T23:03:44.096 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-10T23:03:44.096 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-10T23:03:44.096 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-10T23:03:44.096 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-10T23:03:44.097 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-10T23:03:44.097 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-10T23:03:44.097 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-10T23:03:44.097 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-10T23:03:44.097 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-10T23:03:44.097 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-10T23:03:44.097 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-10T23:03:44.097 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-10T23:03:44.097 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-10T23:03:44.097 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-10T23:03:44.097 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-10T23:03:44.097 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-10T23:03:44.097 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-10T23:03:44.098 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-10T23:03:44.098 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-10T23:03:44.098 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-10T23:03:44.098 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-10T23:03:44.098 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-10T23:03:44.098 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-10T23:03:44.098 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-10T23:03:44.098 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-10T23:03:44.098 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-10T23:03:44.098 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-10T23:03:44.098 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-10T23:03:44.098 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-10T23:03:44.098 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-10T23:03:44.098 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-10T23:03:44.099 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-10T23:03:44.099 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-10T23:03:44.099 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-10T23:03:44.099 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-10T23:03:44.099 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-10T23:03:44.099 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-10T23:03:44.099 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-10T23:03:44.099 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-10T23:03:44.099 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-10T23:03:44.099 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-10T23:03:44.099 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-10T23:03:44.099 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-10T23:03:44.099 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-10T23:03:44.100 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-10T23:03:44.100 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-10T23:03:44.100 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-10T23:03:44.100 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-10T23:03:44.100 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-10T23:03:44.100 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-10T23:03:44.100 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-10T23:03:44.100 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-10T23:03:44.100 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-10T23:03:44.100 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-10T23:03:44.100 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-10T23:03:44.100 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-10T23:03:44.100 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-10T23:03:44.101 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-10T23:03:44.101 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-10T23:03:44.101 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-10T23:03:44.101 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-10T23:03:44.101 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-10T23:03:44.101 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-10T23:03:44.101 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-10T23:03:44.101 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-10T23:03:44.101 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-10T23:03:44.102 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-10T23:03:44.102 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-10T23:03:44.102 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-10T23:03:44.102 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-10T23:03:44.102 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-10T23:03:44.102 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-10T23:03:44.102 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-10T23:03:44.102 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-10T23:03:44.102 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-10T23:03:44.103 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-10T23:03:44.103 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-10T23:03:44.103 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-10T23:03:44.103 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-10T23:03:44.103 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-10T23:03:44.103 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-10T23:03:44.103 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-10T23:03:44.103 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-10T23:03:44.103 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-10T23:03:44.103 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-10T23:03:44.103 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-10T23:03:44.103 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-10T23:03:44.104 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-10T23:03:44.104 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-10T23:03:44.104 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-10T23:03:44.104 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-10T23:03:44.104 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-10T23:03:44.104 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-10T23:03:44.104 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-10T23:03:44.104 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-10T23:03:44.104 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-10T23:03:44.104 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-10T23:03:44.104 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-10T23:03:44.104 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-10T23:03:44.105 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-10T23:03:44.105 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-10T23:03:44.105 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-10T23:03:44.105 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-10T23:03:44.105 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-10T23:03:44.105 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-10T23:03:44.105 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-10T23:03:44.105 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-10T23:03:44.105 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-10T23:03:44.105 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-10T23:03:44.105 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-10T23:03:44.105 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-10T23:03:44.105 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-10T23:03:44.105 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-10T23:03:44.106 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-10T23:03:44.106 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-10T23:03:44.106 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-10T23:03:44.106 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-10T23:03:44.106 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-10T23:03:44.106 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-10T23:03:44.106 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-10T23:03:44.106 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-10T23:03:44.106 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-10T23:03:44.106 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-10T23:03:44.106 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-10T23:03:44.106 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-10T23:03:44.107 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-10T23:03:44.107 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-10T23:03:44.107 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-10T23:03:44.107 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-10T23:03:44.107 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-10T23:03:44.107 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-10T23:03:44.107 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-10T23:03:44.107 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-10T23:03:44.107 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-10T23:03:44.107 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-10T23:03:44.107 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-10T23:03:44.107 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-10T23:03:44.107 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-10T23:03:44.108 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-10T23:03:44.108 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-10T23:03:44.108 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-10T23:03:44.108 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-10T23:03:44.108 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-10T23:03:44.108 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-10T23:03:44.108 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-10T23:03:44.108 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-10T23:03:44.108 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-10T23:03:44.108 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-10T23:03:44.108 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-10T23:03:44.109 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-10T23:03:44.109 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-10T23:03:44.109 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-10T23:03:44.109 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-10T23:03:44.109 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-10T23:03:44.109 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-10T23:03:44.109 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-10T23:03:44.109 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-10T23:03:44.109 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-10T23:03:44.109 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-10T23:03:44.110 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-10T23:03:44.110 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-10T23:03:44.110 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-10T23:03:44.110 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-10T23:03:44.110 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-10T23:03:44.110 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-10T23:03:44.110 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-10T23:03:44.110 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-10T23:03:44.110 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-10T23:03:44.110 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-10T23:03:44.110 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-10T23:03:44.110 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-10T23:03:44.110 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-10T23:03:44.110 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-10T23:03:44.110 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-10T23:03:44.111 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-10T23:03:44.111 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-10T23:03:44.111 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-10T23:03:44.111 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-10T23:03:44.111 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-10T23:03:44.111 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-10T23:03:44.111 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-10T23:03:44.111 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-10T23:03:44.111 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-10T23:03:44.111 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-10T23:03:44.111 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-10T23:03:44.111 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-10T23:03:44.111 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-10T23:03:44.111 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-10T23:03:44.112 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-10T23:03:44.112 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-10T23:03:44.112 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-10T23:03:44.112 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-10T23:03:44.112 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-10T23:03:44.112 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-10T23:03:44.112 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-10T23:03:44.112 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-10T23:03:44.112 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-10T23:03:44.112 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-10T23:03:44.112 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-10T23:03:44.112 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-10T23:03:44.112 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-10T23:03:44.112 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-10T23:03:44.113 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-10T23:03:44.113 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-10T23:03:44.113 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-10T23:03:44.113 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-10T23:03:44.113 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-10T23:03:44.113 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-10T23:03:44.113 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-10T23:03:44.113 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-10T23:03:44.114 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-10T23:03:44.114 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-10T23:03:44.114 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-10T23:03:44.114 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-10T23:03:44.114 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-10T23:03:44.114 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-10T23:03:44.114 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-10T23:03:44.114 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-10T23:03:44.114 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-10T23:03:44.114 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-10T23:03:44.114 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-10T23:03:44.114 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-10T23:03:44.114 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-10T23:03:44.114 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-10T23:03:44.115 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-10T23:03:44.115 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-10T23:03:44.115 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-10T23:03:44.115 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-10T23:03:44.115 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-10T23:03:44.115 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-10T23:03:44.115 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-10T23:03:44.115 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-10T23:03:44.115 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-10T23:03:44.115 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-10T23:03:44.115 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-10T23:03:44.115 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-10T23:03:44.115 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-10T23:03:44.116 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-10T23:03:44.116 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-10T23:03:44.116 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-10T23:03:44.116 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-10T23:03:44.116 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-10T23:03:44.116 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-10T23:03:44.116 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-10T23:03:44.116 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-10T23:03:44.116 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-10T23:03:44.116 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-10T23:03:44.116 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-10T23:03:44.116 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-10T23:03:44.116 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-10T23:03:44.117 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-10T23:03:44.117 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-10T23:03:44.117 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-10T23:03:44.117 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-10T23:03:44.117 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-10T23:03:44.117 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-10T23:03:44.117 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-10T23:03:44.117 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-10T23:03:44.118 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-10T23:03:44.118 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-10T23:03:44.118 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-10T23:03:44.118 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-10T23:03:44.118 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-10T23:03:44.118 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-10T23:03:44.118 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-10T23:03:44.118 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-10T23:03:44.118 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-10T23:03:44.118 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-10T23:03:44.119 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-10T23:03:44.119 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-10T23:03:44.119 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-10T23:03:44.119 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-10T23:03:44.119 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-10T23:03:44.119 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-10T23:03:44.119 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-10T23:03:44.119 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-10T23:03:44.119 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-10T23:03:44.119 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-10T23:03:44.119 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-10T23:03:44.119 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-10T23:03:44.119 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-10T23:03:44.120 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-10T23:03:44.120 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-10T23:03:44.120 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-10T23:03:44.120 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-10T23:03:44.120 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-10T23:03:44.120 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-10T23:03:44.120 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-10T23:03:44.120 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-10T23:03:44.120 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-10T23:03:44.120 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-10T23:03:44.120 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-10T23:03:44.120 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-10T23:03:44.121 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-10T23:03:44.121 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-10T23:03:44.121 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-10T23:03:44.121 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-10T23:03:44.121 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-10T23:03:44.121 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-10T23:03:44.121 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-10T23:03:44.121 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-10T23:03:44.121 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-10T23:03:44.121 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-10T23:03:44.121 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-10T23:03:44.121 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-10T23:03:44.122 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-10T23:03:44.122 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-10T23:03:44.122 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-10T23:03:44.122 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-10T23:03:44.122 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-10T23:03:44.122 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-10T23:03:44.122 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-10T23:03:44.122 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-10T23:03:44.122 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-10T23:03:44.122 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-10T23:03:44.123 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-10T23:03:44.123 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-10T23:03:44.123 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-10T23:03:44.123 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-10T23:03:44.123 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-10T23:03:44.123 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-10T23:03:44.123 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-10T23:03:44.123 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-10T23:03:44.123 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-10T23:03:44.123 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-10T23:03:44.123 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-10T23:03:44.123 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-10T23:03:44.124 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-10T23:03:44.124 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-10T23:03:44.124 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-10T23:03:44.124 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-10T23:03:44.124 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-10T23:03:44.124 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-10T23:03:44.124 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-10T23:03:44.124 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-10T23:03:44.125 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-10T23:03:44.125 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-10T23:03:44.125 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-10T23:03:44.125 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-10T23:03:44.125 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-10T23:03:44.125 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-10T23:03:44.125 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-10T23:03:44.125 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-10T23:03:44.125 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-10T23:03:44.125 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-10T23:03:44.125 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-10T23:03:44.125 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-10T23:03:44.125 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-10T23:03:44.125 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-10T23:03:44.126 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-10T23:03:44.126 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-10T23:03:44.126 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-10T23:03:44.126 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-10T23:03:44.126 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-10T23:03:44.126 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-10T23:03:44.126 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-10T23:03:44.126 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-10T23:03:44.126 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-10T23:03:44.126 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-10T23:03:44.126 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-10T23:03:44.126 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-10T23:03:44.126 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-10T23:03:44.126 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-10T23:03:44.127 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-10T23:03:44.127 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-10T23:03:44.127 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-10T23:03:44.127 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-10T23:03:44.127 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-10T23:03:44.127 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-10T23:03:44.127 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-10T23:03:44.127 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-10T23:03:44.127 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-10T23:03:44.127 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-10T23:03:44.127 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-10T23:03:44.127 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-10T23:03:44.127 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-10T23:03:44.128 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-10T23:03:44.128 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-10T23:03:44.128 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-10T23:03:44.128 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-10T23:03:44.128 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-10T23:03:44.128 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-10T23:03:44.128 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-10T23:03:44.128 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-10T23:03:44.128 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-10T23:03:44.129 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-10T23:03:44.129 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-10T23:03:44.129 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-10T23:03:44.129 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-10T23:03:44.129 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-10T23:03:44.130 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-10T23:03:44.130 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-10T23:03:44.130 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-10T23:03:44.130 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-10T23:03:44.130 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-10T23:03:44.130 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-10T23:03:44.130 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-10T23:03:44.131 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-10T23:03:44.131 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-10T23:03:44.131 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-10T23:03:44.131 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-10T23:03:44.131 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-10T23:03:44.131 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-10T23:03:44.132 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-10T23:03:44.132 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-10T23:03:44.132 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-10T23:03:44.132 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-10T23:03:44.132 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-10T23:03:44.132 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-10T23:03:44.132 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-10T23:03:44.133 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-10T23:03:44.133 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-10T23:03:44.133 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-10T23:03:44.133 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-10T23:03:44.133 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-10T23:03:44.133 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-10T23:03:44.133 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-10T23:03:44.134 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-10T23:03:44.134 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-10T23:03:44.134 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-10T23:03:44.134 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-10T23:03:44.134 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-10T23:03:44.134 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-10T23:03:44.135 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-10T23:03:44.135 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-10T23:03:44.135 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-10T23:03:44.135 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-10T23:03:44.135 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-10T23:03:44.135 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-10T23:03:44.136 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-10T23:03:44.136 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-10T23:03:44.136 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-10T23:03:44.136 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-10T23:03:44.136 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-10T23:03:44.137 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-10T23:03:44.137 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-10T23:03:44.137 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-10T23:03:44.137 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-10T23:03:44.137 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-10T23:03:44.137 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-10T23:03:44.137 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-10T23:03:44.137 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-10T23:03:44.138 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-10T23:03:44.138 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-10T23:03:44.138 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-10T23:03:44.138 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-10T23:03:44.138 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-10T23:03:44.138 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-10T23:03:44.138 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-10T23:03:44.138 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-10T23:03:44.138 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-10T23:03:44.139 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-10T23:03:44.139 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-10T23:03:44.139 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-10T23:03:44.139 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-10T23:03:44.139 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-10T23:03:44.139 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-10T23:03:44.139 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-10T23:03:44.139 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-10T23:03:44.139 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-10T23:03:44.139 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-10T23:03:44.139 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-10T23:03:44.139 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-10T23:03:44.140 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-10T23:03:44.140 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-10T23:03:44.140 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-10T23:03:44.140 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-10T23:03:44.140 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-10T23:03:44.140 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-10T23:03:44.140 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-10T23:03:44.140 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-10T23:03:44.140 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-10T23:03:44.140 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-10T23:03:44.140 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-10T23:03:44.140 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-10T23:03:44.141 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-10T23:03:44.141 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-10T23:03:44.141 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-10T23:03:44.141 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-10T23:03:44.141 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-10T23:03:44.141 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-10T23:03:44.141 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-10T23:03:44.141 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-10T23:03:44.141 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-10T23:03:44.141 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-10T23:03:44.141 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-10T23:03:44.141 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-10T23:03:44.142 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-10T23:03:44.142 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-10T23:03:44.142 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-10T23:03:44.142 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-10T23:03:44.142 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-10T23:03:44.142 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-10T23:03:44.142 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-10T23:03:44.142 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-10T23:03:44.142 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-10T23:03:44.142 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-10T23:03:44.142 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-10T23:03:44.142 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-10T23:03:44.142 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-10T23:03:44.143 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-10T23:03:44.143 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-10T23:03:44.143 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-10T23:03:44.143 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-10T23:03:44.143 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-10T23:03:44.143 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-10T23:03:44.143 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-10T23:03:44.143 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-10T23:03:44.143 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-10T23:03:44.143 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-10T23:03:44.143 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-10T23:03:44.143 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-10T23:03:44.144 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-10T23:03:44.144 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-10T23:03:44.144 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-10T23:03:44.144 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-10T23:03:44.144 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-10T23:03:44.144 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-10T23:03:44.144 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-10T23:03:44.144 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-10T23:03:44.144 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-10T23:03:44.144 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-10T23:03:44.144 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-10T23:03:44.144 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-10T23:03:44.144 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-10T23:03:44.145 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-10T23:03:44.145 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-10T23:03:44.145 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-10T23:03:44.145 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-10T23:03:44.145 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-10T23:03:44.145 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-10T23:03:44.145 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-10T23:03:44.145 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-10T23:03:44.145 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-10T23:03:44.145 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-10T23:03:44.145 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-10T23:03:44.146 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-10T23:03:44.146 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-10T23:03:44.146 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-10T23:03:44.146 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-10T23:03:44.146 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-10T23:03:44.146 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-10T23:03:44.146 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-10T23:03:44.146 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-10T23:03:44.146 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-10T23:03:44.146 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-10T23:03:44.146 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-10T23:03:44.146 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-10T23:03:44.146 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-10T23:03:44.147 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-10T23:03:44.147 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-10T23:03:44.147 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-10T23:03:44.147 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-10T23:03:44.147 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-10T23:03:44.147 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-10T23:03:44.147 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-10T23:03:44.147 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-10T23:03:44.147 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-10T23:03:44.147 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-10T23:03:44.147 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-10T23:03:44.147 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-10T23:03:44.147 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-10T23:03:44.148 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-10T23:03:44.148 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-10T23:03:44.148 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-10T23:03:44.148 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-10T23:03:44.148 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-10T23:03:44.148 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-10T23:03:44.148 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-10T23:03:44.148 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-10T23:03:44.148 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-10T23:03:44.148 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-10T23:03:44.149 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-10T23:03:44.149 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-10T23:03:44.149 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-10T23:03:44.149 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-10T23:03:44.149 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-10T23:03:44.149 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-10T23:03:44.149 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-10T23:03:44.149 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-10T23:03:44.149 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-10T23:03:44.150 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-10T23:03:44.150 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-10T23:03:44.150 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-10T23:03:44.150 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-10T23:03:44.150 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-10T23:03:44.150 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-10T23:03:44.150 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-10T23:03:44.150 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-10T23:03:44.150 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-10T23:03:44.150 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-10T23:03:44.151 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-10T23:03:44.151 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-10T23:03:44.151 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-10T23:03:44.151 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-10T23:03:44.151 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-10T23:03:44.151 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-10T23:03:44.151 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-10T23:03:44.151 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-10T23:03:44.151 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-10T23:03:44.151 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-10T23:03:44.151 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-10T23:03:44.151 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-10T23:03:44.152 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-10T23:03:44.152 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-10T23:03:44.152 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-10T23:03:44.152 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-10T23:03:44.152 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-10T23:03:44.152 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-10T23:03:44.152 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-10T23:03:44.152 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-10T23:03:44.152 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-10T23:03:44.152 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-10T23:03:44.153 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-10T23:03:44.153 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-10T23:03:44.153 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-10T23:03:44.153 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-10T23:03:44.153 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-10T23:03:44.153 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-10T23:03:44.153 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-10T23:03:44.153 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-10T23:03:44.153 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-10T23:03:44.153 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-10T23:03:44.153 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-10T23:03:44.154 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-10T23:03:44.154 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-10T23:03:44.154 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-10T23:03:44.154 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-10T23:03:44.154 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-10T23:03:44.154 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-10T23:03:44.154 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-10T23:03:44.155 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-10T23:03:44.155 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-10T23:03:44.155 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-10T23:03:44.155 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-10T23:03:44.156 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-10T23:03:44.156 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-10T23:03:44.156 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-10T23:03:44.156 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-10T23:03:44.156 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-10T23:03:44.157 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-10T23:03:44.157 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-10T23:03:44.157 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-10T23:03:44.157 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-10T23:03:44.157 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-10T23:03:44.157 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-10T23:03:44.158 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-10T23:03:44.158 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-10T23:03:44.158 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-10T23:03:44.158 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-10T23:03:44.158 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-10T23:03:44.158 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-10T23:03:44.159 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-10T23:03:44.159 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-10T23:03:44.159 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-10T23:03:44.159 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-10T23:03:44.159 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-10T23:03:44.160 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-10T23:03:44.160 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-10T23:03:44.160 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-10T23:03:44.160 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-10T23:03:44.160 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-10T23:03:44.160 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-10T23:03:44.161 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-10T23:03:44.161 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-10T23:03:44.161 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-10T23:03:44.161 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-10T23:03:44.161 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-10T23:03:44.161 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-10T23:03:44.161 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-10T23:03:44.162 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-10T23:03:44.162 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-10T23:03:44.162 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-10T23:03:44.162 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-10T23:03:44.162 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-10T23:03:44.162 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-10T23:03:44.162 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-10T23:03:44.162 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-10T23:03:44.163 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-10T23:03:44.163 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-10T23:03:44.163 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-10T23:03:44.163 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-10T23:03:44.163 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-10T23:03:44.163 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-10T23:03:44.163 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-10T23:03:44.164 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-10T23:03:44.164 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-10T23:03:44.164 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-10T23:03:44.164 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-10T23:03:44.164 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-10T23:03:44.164 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-10T23:03:44.164 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-10T23:03:44.164 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-10T23:03:44.164 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-10T23:03:44.165 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-10T23:03:44.165 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-10T23:03:44.165 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-10T23:03:44.165 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-10T23:03:44.165 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-10T23:03:44.165 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-10T23:03:44.165 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-10T23:03:44.166 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-10T23:03:44.166 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-10T23:03:44.166 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-10T23:03:44.166 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-10T23:03:44.166 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-10T23:03:44.166 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-10T23:03:44.166 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-10T23:03:44.166 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-10T23:03:44.166 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-10T23:03:44.167 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-10T23:03:44.167 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-10T23:03:44.167 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-10T23:03:44.167 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-10T23:03:44.167 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-10T23:03:44.167 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-10T23:03:44.167 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-10T23:03:44.168 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-10T23:03:44.168 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-10T23:03:44.168 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-10T23:03:44.168 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-10T23:03:44.168 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-10T23:03:44.168 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-10T23:03:44.168 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-10T23:03:44.168 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-10T23:03:44.168 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-10T23:03:44.168 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-10T23:03:44.169 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-10T23:03:44.169 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-10T23:03:44.169 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-10T23:03:44.169 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-10T23:03:44.169 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-10T23:03:44.169 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-10T23:03:44.169 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-10T23:03:44.169 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-10T23:03:44.169 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-10T23:03:44.169 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-10T23:03:44.169 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-10T23:03:44.169 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-10T23:03:44.169 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-10T23:03:44.169 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-10T23:03:44.170 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-10T23:03:44.170 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-10T23:03:44.170 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-10T23:03:44.170 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-10T23:03:44.170 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-10T23:03:44.170 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-10T23:03:44.170 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-10T23:03:44.170 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-10T23:03:44.170 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-10T23:03:44.170 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-10T23:03:44.170 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-10T23:03:44.170 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-10T23:03:44.170 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-10T23:03:44.171 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-10T23:03:44.171 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-10T23:03:44.171 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-10T23:03:44.171 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-10T23:03:44.171 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-10T23:03:44.171 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-10T23:03:44.171 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-10T23:03:44.171 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-10T23:03:44.171 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-10T23:03:44.171 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-10T23:03:44.171 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-10T23:03:44.171 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-10T23:03:44.171 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-10T23:03:44.172 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-10T23:03:44.172 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-10T23:03:44.172 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-10T23:03:44.172 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-10T23:03:44.172 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-10T23:03:44.172 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-10T23:03:44.172 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-10T23:03:44.172 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-10T23:03:44.172 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-10T23:03:44.172 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-10T23:03:44.172 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-10T23:03:44.172 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-10T23:03:44.173 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-10T23:03:44.173 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-10T23:03:44.173 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-10T23:03:44.173 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-10T23:03:44.173 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-10T23:03:44.173 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-10T23:03:44.173 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-10T23:03:44.173 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-10T23:03:44.173 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-10T23:03:44.173 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-10T23:03:44.173 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-10T23:03:44.173 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-10T23:03:44.173 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-10T23:03:44.174 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-10T23:03:44.174 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-10T23:03:44.174 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-10T23:03:44.174 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-10T23:03:44.174 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-10T23:03:44.174 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-10T23:03:44.174 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-10T23:03:44.174 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-10T23:03:44.174 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-10T23:03:44.174 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-10T23:03:44.174 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-10T23:03:44.174 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-10T23:03:44.174 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-10T23:03:44.175 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-10T23:03:44.175 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-10T23:03:44.175 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-10T23:03:44.175 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-10T23:03:44.175 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-10T23:03:44.175 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-10T23:03:44.175 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-10T23:03:44.175 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-10T23:03:44.175 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-10T23:03:44.175 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-10T23:03:44.175 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-10T23:03:44.175 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-10T23:03:44.175 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-10T23:03:44.175 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-10T23:03:44.176 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-10T23:03:44.176 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-10T23:03:44.176 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-10T23:03:44.176 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-10T23:03:44.176 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-10T23:03:44.176 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-10T23:03:44.176 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-10T23:03:44.176 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-10T23:03:44.176 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-10T23:03:44.176 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-10T23:03:44.176 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-10T23:03:44.176 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-10T23:03:44.177 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-10T23:03:44.177 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-10T23:03:44.177 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-10T23:03:44.177 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-10T23:03:44.177 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-10T23:03:44.177 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-10T23:03:44.177 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-10T23:03:44.177 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-10T23:03:44.177 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-10T23:03:44.177 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-10T23:03:44.177 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-10T23:03:44.177 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-10T23:03:44.177 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-10T23:03:44.178 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-10T23:03:44.178 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-10T23:03:44.178 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-10T23:03:44.178 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-10T23:03:44.178 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-10T23:03:44.178 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-10T23:03:44.178 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-10T23:03:44.178 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-10T23:03:44.178 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-10T23:03:44.178 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-10T23:03:44.178 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-10T23:03:44.178 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-10T23:03:44.178 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-10T23:03:44.179 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-10T23:03:44.179 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-10T23:03:44.179 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-10T23:03:44.179 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-10T23:03:44.179 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-10T23:03:44.179 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-10T23:03:44.179 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-10T23:03:44.179 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-10T23:03:44.179 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-10T23:03:44.179 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-10T23:03:44.179 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-10T23:03:44.179 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-10T23:03:44.179 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-10T23:03:44.180 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-10T23:03:44.180 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-10T23:03:44.180 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-10T23:03:44.180 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-10T23:03:44.180 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-10T23:03:44.180 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-10T23:03:44.180 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-10T23:03:44.180 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-10T23:03:44.180 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-10T23:03:44.180 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-10T23:03:44.180 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-10T23:03:44.180 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-10T23:03:44.180 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-10T23:03:44.181 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-10T23:03:44.181 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-10T23:03:44.181 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-10T23:03:44.181 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-10T23:03:44.181 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-10T23:03:44.181 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-10T23:03:44.181 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-10T23:03:44.181 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-10T23:03:44.181 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-10T23:03:44.181 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-10T23:03:44.181 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-10T23:03:44.181 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-10T23:03:44.181 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-10T23:03:44.182 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-10T23:03:44.182 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-10T23:03:44.182 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-10T23:03:44.182 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-10T23:03:44.182 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-10T23:03:44.182 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-10T23:03:44.182 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-10T23:03:44.182 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-10T23:03:44.182 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-10T23:03:44.182 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-10T23:03:44.182 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-10T23:03:44.183 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-10T23:03:44.183 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-10T23:03:44.183 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-10T23:03:44.183 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-10T23:03:44.183 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-10T23:03:44.183 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-10T23:03:44.183 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-10T23:03:44.183 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-10T23:03:44.183 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-10T23:03:44.183 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-10T23:03:44.184 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-10T23:03:44.184 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-10T23:03:44.184 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-10T23:03:44.184 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-10T23:03:44.184 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-10T23:03:44.184 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-10T23:03:44.184 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-10T23:03:44.184 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-10T23:03:44.184 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-10T23:03:44.184 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-10T23:03:44.184 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-10T23:03:44.184 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T23:03:44.188 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:03:44.189 DEBUG:teuthology.orchestra.run.smithi003:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-10T23:03:44.214 INFO:teuthology.orchestra.run.smithi003.stdout:postinstall scriptlet (using /bin/sh): 2024-09-10T23:03:44.214 INFO:teuthology.orchestra.run.smithi003.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T23:03:44.214 INFO:teuthology.orchestra.run.smithi003.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T23:03:44.214 INFO:teuthology.orchestra.run.smithi003.stdout:fi 2024-09-10T23:03:44.214 INFO:teuthology.orchestra.run.smithi003.stdout:for file in vmlinuz System.map config; do 2024-09-10T23:03:44.214 INFO:teuthology.orchestra.run.smithi003.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-10T23:03:44.214 INFO:teuthology.orchestra.run.smithi003.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T23:03:44.214 INFO:teuthology.orchestra.run.smithi003.stdout: fi 2024-09-10T23:03:44.214 INFO:teuthology.orchestra.run.smithi003.stdout:done 2024-09-10T23:03:44.214 INFO:teuthology.orchestra.run.smithi003.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-10T23:03:44.215 INFO:teuthology.orchestra.run.smithi003.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-10T23:03:44.215 INFO:teuthology.orchestra.run.smithi003.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T23:03:44.215 INFO:teuthology.orchestra.run.smithi003.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T23:03:44.215 INFO:teuthology.orchestra.run.smithi003.stdout:fi 2024-09-10T23:03:44.215 INFO:teuthology.orchestra.run.smithi003.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-10T23:03:44.215 INFO:teuthology.orchestra.run.smithi003.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:03:44.215 INFO:teuthology.orchestra.run.smithi003.stdout:fi 2024-09-10T23:03:44.215 INFO:teuthology.orchestra.run.smithi003.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-10T23:03:44.215 INFO:teuthology.orchestra.run.smithi003.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T23:03:44.215 INFO:teuthology.orchestra.run.smithi003.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:03:44.215 INFO:teuthology.orchestra.run.smithi003.stdout:fi 2024-09-10T23:03:44.216 DEBUG:teuthology.orchestra.run.smithi003:> sudo rpm -qi grub2-tools 2024-09-10T23:03:44.297 INFO:teuthology.orchestra.run.smithi003.stdout:Name : grub2-tools 2024-09-10T23:03:44.297 INFO:teuthology.orchestra.run.smithi003.stdout:Epoch : 1 2024-09-10T23:03:44.297 INFO:teuthology.orchestra.run.smithi003.stdout:Version : 2.06 2024-09-10T23:03:44.297 INFO:teuthology.orchestra.run.smithi003.stdout:Release : 82.el9 2024-09-10T23:03:44.297 INFO:teuthology.orchestra.run.smithi003.stdout:Architecture: x86_64 2024-09-10T23:03:44.297 INFO:teuthology.orchestra.run.smithi003.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T23:03:44.297 INFO:teuthology.orchestra.run.smithi003.stdout:Group : Unspecified 2024-09-10T23:03:44.298 INFO:teuthology.orchestra.run.smithi003.stdout:Size : 8274670 2024-09-10T23:03:44.298 INFO:teuthology.orchestra.run.smithi003.stdout:License : GPLv3+ 2024-09-10T23:03:44.298 INFO:teuthology.orchestra.run.smithi003.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T23:03:44.298 INFO:teuthology.orchestra.run.smithi003.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T23:03:44.298 INFO:teuthology.orchestra.run.smithi003.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T23:03:44.298 INFO:teuthology.orchestra.run.smithi003.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T23:03:44.298 INFO:teuthology.orchestra.run.smithi003.stdout:Packager : builder@centos.org 2024-09-10T23:03:44.298 INFO:teuthology.orchestra.run.smithi003.stdout:Vendor : CentOS 2024-09-10T23:03:44.298 INFO:teuthology.orchestra.run.smithi003.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T23:03:44.298 INFO:teuthology.orchestra.run.smithi003.stdout:Summary : Support tools for GRUB. 2024-09-10T23:03:44.298 INFO:teuthology.orchestra.run.smithi003.stdout:Description : 2024-09-10T23:03:44.298 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:03:44.298 INFO:teuthology.orchestra.run.smithi003.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T23:03:44.298 INFO:teuthology.orchestra.run.smithi003.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T23:03:44.299 INFO:teuthology.orchestra.run.smithi003.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T23:03:44.299 INFO:teuthology.orchestra.run.smithi003.stdout:hardware devices. 2024-09-10T23:03:44.299 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:03:44.299 INFO:teuthology.orchestra.run.smithi003.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T23:03:44.300 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T23:03:44.300 INFO:teuthology.task.kernel:Updating grub on smithi003 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:03:44.300 DEBUG:teuthology.orchestra.run.smithi003:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T23:03:44.885 INFO:teuthology.orchestra.run.smithi003.stderr:Generating grub configuration file ... 2024-09-10T23:03:46.281 INFO:teuthology.orchestra.run.smithi003.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T23:03:46.311 INFO:teuthology.orchestra.run.smithi003.stderr:done 2024-09-10T23:03:46.313 DEBUG:teuthology.orchestra.run.smithi003:> mktemp 2024-09-10T23:03:46.347 INFO:teuthology.orchestra.run.smithi003.stdout:/tmp/tmp.W69s7pKq01 2024-09-10T23:03:46.348 DEBUG:teuthology.orchestra.run.smithi003:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.W69s7pKq01 2024-09-10T23:03:46.414 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0666 /tmp/tmp.W69s7pKq01 2024-09-10T23:03:46.557 DEBUG:teuthology.orchestra.remote:smithi003:/tmp/tmp.W69s7pKq01 is 6KB 2024-09-10T23:03:46.606 DEBUG:teuthology.orchestra.run.smithi003:> rm -fr /tmp/tmp.W69s7pKq01 2024-09-10T23:03:46.620 DEBUG:teuthology.orchestra.run.smithi003:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T23:03:46.683 INFO:teuthology.orchestra.run.smithi003.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T23:03:46.683 INFO:teuthology.orchestra.run.smithi003.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T23:03:46.683 INFO:teuthology.orchestra.run.smithi003.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T23:03:46.683 INFO:teuthology.orchestra.run.smithi003.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-10T23:03:46.684 DEBUG:teuthology.orchestra.run.smithi003:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:03:46.860 DEBUG:teuthology.orchestra.run.smithi003:> sudo shutdown -r now 2024-09-10T23:03:47.325 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi038.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-10T23:03:47.325 DEBUG:teuthology.orchestra.run.smithi038:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-10T23:03:47.397 INFO:teuthology.orchestra.run.smithi038.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:03:47.397 INFO:teuthology.orchestra.run.smithi038.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:03:47.397 INFO:teuthology.orchestra.run.smithi038.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:03:47.397 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:03:47.398 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-10T23:03:47.398 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-10T23:03:47.398 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-10T23:03:47.398 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-10T23:03:47.398 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-10T23:03:47.398 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-10T23:03:47.398 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-10T23:03:47.398 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-10T23:03:47.398 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-10T23:03:47.398 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-10T23:03:47.398 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-10T23:03:47.398 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-10T23:03:47.398 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-10T23:03:47.399 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-10T23:03:47.399 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-10T23:03:47.399 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-10T23:03:47.399 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-10T23:03:47.399 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-10T23:03:47.399 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-10T23:03:47.399 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-10T23:03:47.399 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-10T23:03:47.399 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-10T23:03:47.399 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-10T23:03:47.399 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-10T23:03:47.399 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-10T23:03:47.399 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-10T23:03:47.399 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-10T23:03:47.400 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-10T23:03:47.400 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-10T23:03:47.400 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-10T23:03:47.400 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-10T23:03:47.400 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-10T23:03:47.400 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-10T23:03:47.400 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-10T23:03:47.400 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-10T23:03:47.400 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-10T23:03:47.400 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-10T23:03:47.400 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-10T23:03:47.400 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-10T23:03:47.400 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-10T23:03:47.401 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-10T23:03:47.401 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-10T23:03:47.401 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-10T23:03:47.401 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-10T23:03:47.401 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-10T23:03:47.401 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-10T23:03:47.401 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-10T23:03:47.401 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-10T23:03:47.401 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-10T23:03:47.401 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-10T23:03:47.401 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-10T23:03:47.401 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-10T23:03:47.401 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-10T23:03:47.402 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-10T23:03:47.402 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-10T23:03:47.402 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-10T23:03:47.402 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-10T23:03:47.402 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-10T23:03:47.402 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-10T23:03:47.402 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-10T23:03:47.402 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-10T23:03:47.402 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-10T23:03:47.402 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-10T23:03:47.402 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-10T23:03:47.402 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-10T23:03:47.402 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-10T23:03:47.402 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-10T23:03:47.403 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-10T23:03:47.403 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-10T23:03:47.403 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-10T23:03:47.403 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-10T23:03:47.403 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-10T23:03:47.403 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-10T23:03:47.403 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-10T23:03:47.403 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-10T23:03:47.403 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-10T23:03:47.403 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-10T23:03:47.403 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-10T23:03:47.403 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-10T23:03:47.403 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-10T23:03:47.403 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-10T23:03:47.404 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-10T23:03:47.404 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-10T23:03:47.404 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-10T23:03:47.404 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-10T23:03:47.404 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-10T23:03:47.404 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-10T23:03:47.404 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-10T23:03:47.404 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-10T23:03:47.404 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-10T23:03:47.404 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-10T23:03:47.404 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-10T23:03:47.404 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-10T23:03:47.404 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-10T23:03:47.405 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-10T23:03:47.405 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-10T23:03:47.405 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-10T23:03:47.405 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-10T23:03:47.405 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-10T23:03:47.405 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-10T23:03:47.405 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-10T23:03:47.405 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-10T23:03:47.405 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-10T23:03:47.405 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-10T23:03:47.405 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-10T23:03:47.405 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-10T23:03:47.405 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-10T23:03:47.405 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-10T23:03:47.406 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-10T23:03:47.406 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-10T23:03:47.406 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-10T23:03:47.406 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-10T23:03:47.406 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-10T23:03:47.406 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-10T23:03:47.406 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-10T23:03:47.406 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-10T23:03:47.406 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-10T23:03:47.406 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-10T23:03:47.406 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-10T23:03:47.406 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-10T23:03:47.406 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-10T23:03:47.407 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-10T23:03:47.407 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-10T23:03:47.407 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-10T23:03:47.407 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-10T23:03:47.407 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-10T23:03:47.407 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-10T23:03:47.407 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-10T23:03:47.407 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-10T23:03:47.407 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-10T23:03:47.407 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-10T23:03:47.407 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-10T23:03:47.407 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-10T23:03:47.407 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-10T23:03:47.408 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-10T23:03:47.408 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-10T23:03:47.408 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-10T23:03:47.408 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-10T23:03:47.408 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-10T23:03:47.408 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-10T23:03:47.408 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-10T23:03:47.408 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-10T23:03:47.408 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-10T23:03:47.408 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-10T23:03:47.408 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-10T23:03:47.408 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-10T23:03:47.408 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-10T23:03:47.409 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-10T23:03:47.409 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-10T23:03:47.409 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-10T23:03:47.409 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-10T23:03:47.409 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-10T23:03:47.409 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-10T23:03:47.409 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-10T23:03:47.409 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-10T23:03:47.409 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-10T23:03:47.409 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-10T23:03:47.409 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-10T23:03:47.409 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-10T23:03:47.409 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-10T23:03:47.410 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-10T23:03:47.410 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-10T23:03:47.410 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-10T23:03:47.410 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-10T23:03:47.410 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-10T23:03:47.410 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-10T23:03:47.410 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-10T23:03:47.410 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-10T23:03:47.410 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-10T23:03:47.410 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-10T23:03:47.410 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-10T23:03:47.410 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-10T23:03:47.410 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-10T23:03:47.411 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-10T23:03:47.411 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-10T23:03:47.411 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-10T23:03:47.411 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-10T23:03:47.411 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-10T23:03:47.411 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-10T23:03:47.411 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-10T23:03:47.411 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-10T23:03:47.411 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-10T23:03:47.411 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-10T23:03:47.411 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-10T23:03:47.411 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-10T23:03:47.411 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-10T23:03:47.411 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-10T23:03:47.412 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-10T23:03:47.412 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-10T23:03:47.412 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-10T23:03:47.412 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-10T23:03:47.412 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-10T23:03:47.412 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-10T23:03:47.412 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-10T23:03:47.412 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-10T23:03:47.412 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-10T23:03:47.413 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-10T23:03:47.413 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-10T23:03:47.413 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-10T23:03:47.413 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-10T23:03:47.413 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-10T23:03:47.413 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-10T23:03:47.413 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-10T23:03:47.413 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-10T23:03:47.413 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-10T23:03:47.414 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-10T23:03:47.414 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-10T23:03:47.414 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-10T23:03:47.414 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-10T23:03:47.414 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-10T23:03:47.414 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-10T23:03:47.414 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-10T23:03:47.414 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-10T23:03:47.414 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-10T23:03:47.414 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-10T23:03:47.414 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-10T23:03:47.414 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-10T23:03:47.414 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-10T23:03:47.414 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-10T23:03:47.415 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-10T23:03:47.415 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-10T23:03:47.415 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-10T23:03:47.415 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-10T23:03:47.415 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-10T23:03:47.415 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-10T23:03:47.415 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-10T23:03:47.415 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-10T23:03:47.415 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-10T23:03:47.415 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-10T23:03:47.415 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-10T23:03:47.415 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-10T23:03:47.415 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-10T23:03:47.416 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-10T23:03:47.416 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-10T23:03:47.416 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-10T23:03:47.416 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-10T23:03:47.416 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-10T23:03:47.416 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-10T23:03:47.416 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-10T23:03:47.416 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-10T23:03:47.416 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-10T23:03:47.416 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-10T23:03:47.416 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-10T23:03:47.416 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-10T23:03:47.416 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-10T23:03:47.417 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-10T23:03:47.417 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-10T23:03:47.417 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-10T23:03:47.417 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-10T23:03:47.417 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-10T23:03:47.417 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-10T23:03:47.417 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-10T23:03:47.417 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-10T23:03:47.417 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-10T23:03:47.417 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-10T23:03:47.417 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-10T23:03:47.417 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-10T23:03:47.417 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-10T23:03:47.418 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-10T23:03:47.418 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-10T23:03:47.418 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-10T23:03:47.418 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-10T23:03:47.418 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-10T23:03:47.418 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-10T23:03:47.418 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-10T23:03:47.418 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-10T23:03:47.418 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-10T23:03:47.418 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-10T23:03:47.418 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-10T23:03:47.418 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-10T23:03:47.418 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-10T23:03:47.418 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-10T23:03:47.419 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-10T23:03:47.419 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-10T23:03:47.419 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-10T23:03:47.419 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-10T23:03:47.419 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-10T23:03:47.419 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-10T23:03:47.419 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-10T23:03:47.419 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-10T23:03:47.419 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-10T23:03:47.419 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-10T23:03:47.419 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-10T23:03:47.419 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-10T23:03:47.419 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-10T23:03:47.420 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-10T23:03:47.420 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-10T23:03:47.420 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-10T23:03:47.420 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-10T23:03:47.420 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-10T23:03:47.420 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-10T23:03:47.420 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-10T23:03:47.420 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-10T23:03:47.420 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-10T23:03:47.420 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-10T23:03:47.420 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-10T23:03:47.420 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-10T23:03:47.420 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-10T23:03:47.421 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-10T23:03:47.421 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-10T23:03:47.421 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-10T23:03:47.421 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-10T23:03:47.421 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-10T23:03:47.421 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-10T23:03:47.421 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-10T23:03:47.421 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-10T23:03:47.421 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-10T23:03:47.421 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-10T23:03:47.421 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-10T23:03:47.421 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-10T23:03:47.421 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-10T23:03:47.421 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-10T23:03:47.422 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-10T23:03:47.422 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-10T23:03:47.422 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-10T23:03:47.422 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-10T23:03:47.422 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-10T23:03:47.422 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-10T23:03:47.422 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-10T23:03:47.422 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-10T23:03:47.422 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-10T23:03:47.422 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-10T23:03:47.422 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-10T23:03:47.422 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-10T23:03:47.422 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-10T23:03:47.422 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-10T23:03:47.423 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-10T23:03:47.423 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-10T23:03:47.423 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-10T23:03:47.423 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-10T23:03:47.423 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-10T23:03:47.423 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-10T23:03:47.423 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-10T23:03:47.423 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-10T23:03:47.423 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-10T23:03:47.423 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-10T23:03:47.423 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-10T23:03:47.423 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-10T23:03:47.423 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-10T23:03:47.423 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-10T23:03:47.424 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-10T23:03:47.424 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-10T23:03:47.424 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-10T23:03:47.424 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-10T23:03:47.424 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-10T23:03:47.424 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-10T23:03:47.424 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-10T23:03:47.424 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-10T23:03:47.424 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-10T23:03:47.424 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-10T23:03:47.424 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-10T23:03:47.424 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-10T23:03:47.425 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-10T23:03:47.425 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-10T23:03:47.425 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-10T23:03:47.425 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-10T23:03:47.425 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-10T23:03:47.425 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-10T23:03:47.425 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-10T23:03:47.425 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-10T23:03:47.425 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-10T23:03:47.425 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-10T23:03:47.425 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-10T23:03:47.425 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-10T23:03:47.425 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-10T23:03:47.426 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-10T23:03:47.426 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-10T23:03:47.426 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-10T23:03:47.426 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-10T23:03:47.426 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-10T23:03:47.426 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-10T23:03:47.426 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-10T23:03:47.426 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-10T23:03:47.426 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-10T23:03:47.426 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-10T23:03:47.426 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-10T23:03:47.426 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-10T23:03:47.426 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-10T23:03:47.426 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-10T23:03:47.427 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-10T23:03:47.427 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-10T23:03:47.427 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-10T23:03:47.427 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-10T23:03:47.427 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-10T23:03:47.427 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-10T23:03:47.427 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-10T23:03:47.427 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-10T23:03:47.427 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-10T23:03:47.427 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-10T23:03:47.427 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-10T23:03:47.427 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-10T23:03:47.427 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-10T23:03:47.427 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-10T23:03:47.428 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-10T23:03:47.428 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-10T23:03:47.428 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-10T23:03:47.428 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-10T23:03:47.428 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-10T23:03:47.428 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-10T23:03:47.428 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-10T23:03:47.428 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-10T23:03:47.428 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-10T23:03:47.428 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-10T23:03:47.428 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-10T23:03:47.428 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-10T23:03:47.428 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-10T23:03:47.429 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-10T23:03:47.429 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-10T23:03:47.429 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-10T23:03:47.429 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-10T23:03:47.429 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-10T23:03:47.429 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-10T23:03:47.429 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-10T23:03:47.429 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-10T23:03:47.429 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-10T23:03:47.429 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-10T23:03:47.429 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-10T23:03:47.429 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-10T23:03:47.429 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-10T23:03:47.429 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-10T23:03:47.430 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-10T23:03:47.430 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-10T23:03:47.430 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-10T23:03:47.430 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-10T23:03:47.430 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-10T23:03:47.430 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-10T23:03:47.430 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-10T23:03:47.430 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-10T23:03:47.430 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-10T23:03:47.430 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-10T23:03:47.430 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-10T23:03:47.430 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-10T23:03:47.430 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-10T23:03:47.430 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-10T23:03:47.431 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-10T23:03:47.431 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-10T23:03:47.431 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-10T23:03:47.431 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-10T23:03:47.431 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-10T23:03:47.431 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-10T23:03:47.431 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-10T23:03:47.431 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-10T23:03:47.431 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-10T23:03:47.431 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-10T23:03:47.431 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-10T23:03:47.431 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-10T23:03:47.431 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-10T23:03:47.431 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-10T23:03:47.432 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-10T23:03:47.432 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-10T23:03:47.432 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-10T23:03:47.432 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-10T23:03:47.432 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-10T23:03:47.432 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-10T23:03:47.432 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-10T23:03:47.432 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-10T23:03:47.432 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-10T23:03:47.432 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-10T23:03:47.432 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-10T23:03:47.432 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-10T23:03:47.432 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-10T23:03:47.432 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-10T23:03:47.433 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-10T23:03:47.433 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-10T23:03:47.433 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-10T23:03:47.433 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-10T23:03:47.433 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-10T23:03:47.433 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-10T23:03:47.433 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-10T23:03:47.433 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-10T23:03:47.433 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-10T23:03:47.433 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-10T23:03:47.433 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-10T23:03:47.433 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-10T23:03:47.433 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-10T23:03:47.434 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-10T23:03:47.434 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-10T23:03:47.434 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-10T23:03:47.434 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-10T23:03:47.434 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-10T23:03:47.434 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-10T23:03:47.434 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-10T23:03:47.434 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-10T23:03:47.434 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-10T23:03:47.434 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-10T23:03:47.434 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-10T23:03:47.434 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-10T23:03:47.434 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-10T23:03:47.434 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-10T23:03:47.435 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-10T23:03:47.435 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-10T23:03:47.435 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-10T23:03:47.435 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-10T23:03:47.435 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-10T23:03:47.435 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-10T23:03:47.435 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-10T23:03:47.435 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-10T23:03:47.435 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-10T23:03:47.435 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-10T23:03:47.435 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-10T23:03:47.435 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-10T23:03:47.435 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-10T23:03:47.436 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-10T23:03:47.436 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-10T23:03:47.436 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-10T23:03:47.436 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-10T23:03:47.436 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-10T23:03:47.436 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-10T23:03:47.436 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-10T23:03:47.436 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-10T23:03:47.436 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-10T23:03:47.436 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-10T23:03:47.436 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-10T23:03:47.436 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-10T23:03:47.436 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-10T23:03:47.436 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-10T23:03:47.437 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-10T23:03:47.437 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-10T23:03:47.437 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-10T23:03:47.437 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-10T23:03:47.437 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-10T23:03:47.437 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-10T23:03:47.437 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-10T23:03:47.437 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-10T23:03:47.437 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-10T23:03:47.437 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-10T23:03:47.437 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-10T23:03:47.437 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-10T23:03:47.437 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-10T23:03:47.437 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-10T23:03:47.438 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-10T23:03:47.438 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-10T23:03:47.438 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-10T23:03:47.438 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-10T23:03:47.438 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-10T23:03:47.438 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-10T23:03:47.438 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-10T23:03:47.438 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-10T23:03:47.438 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-10T23:03:47.438 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-10T23:03:47.438 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-10T23:03:47.438 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-10T23:03:47.438 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-10T23:03:47.438 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-10T23:03:47.439 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-10T23:03:47.439 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-10T23:03:47.439 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-10T23:03:47.439 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-10T23:03:47.439 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-10T23:03:47.439 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-10T23:03:47.439 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-10T23:03:47.439 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-10T23:03:47.439 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-10T23:03:47.439 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-10T23:03:47.439 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-10T23:03:47.439 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-10T23:03:47.439 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-10T23:03:47.440 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-10T23:03:47.440 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-10T23:03:47.440 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-10T23:03:47.440 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-10T23:03:47.440 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-10T23:03:47.440 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-10T23:03:47.440 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-10T23:03:47.440 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-10T23:03:47.440 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-10T23:03:47.440 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-10T23:03:47.440 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-10T23:03:47.440 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-10T23:03:47.440 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-10T23:03:47.441 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-10T23:03:47.441 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-10T23:03:47.441 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-10T23:03:47.441 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-10T23:03:47.441 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-10T23:03:47.441 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-10T23:03:47.441 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-10T23:03:47.441 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-10T23:03:47.441 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-10T23:03:47.441 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-10T23:03:47.441 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-10T23:03:47.441 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-10T23:03:47.441 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-10T23:03:47.442 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-10T23:03:47.442 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-10T23:03:47.442 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-10T23:03:47.442 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-10T23:03:47.442 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-10T23:03:47.442 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-10T23:03:47.442 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-10T23:03:47.442 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-10T23:03:47.442 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-10T23:03:47.442 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-10T23:03:47.442 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-10T23:03:47.442 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-10T23:03:47.442 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-10T23:03:47.443 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-10T23:03:47.443 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-10T23:03:47.443 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-10T23:03:47.443 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-10T23:03:47.443 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-10T23:03:47.443 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-10T23:03:47.443 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-10T23:03:47.443 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-10T23:03:47.443 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-10T23:03:47.443 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-10T23:03:47.443 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-10T23:03:47.443 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-10T23:03:47.443 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-10T23:03:47.443 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-10T23:03:47.444 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-10T23:03:47.444 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-10T23:03:47.444 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-10T23:03:47.444 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-10T23:03:47.444 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-10T23:03:47.444 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-10T23:03:47.444 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-10T23:03:47.444 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-10T23:03:47.444 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-10T23:03:47.444 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-10T23:03:47.444 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-10T23:03:47.444 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-10T23:03:47.444 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-10T23:03:47.445 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-10T23:03:47.445 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-10T23:03:47.445 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-10T23:03:47.445 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-10T23:03:47.445 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-10T23:03:47.445 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-10T23:03:47.445 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-10T23:03:47.445 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-10T23:03:47.445 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-10T23:03:47.445 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-10T23:03:47.445 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-10T23:03:47.445 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-10T23:03:47.445 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-10T23:03:47.445 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-10T23:03:47.446 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-10T23:03:47.446 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-10T23:03:47.446 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-10T23:03:47.446 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-10T23:03:47.446 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-10T23:03:47.446 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-10T23:03:47.446 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-10T23:03:47.446 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-10T23:03:47.446 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-10T23:03:47.446 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-10T23:03:47.446 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-10T23:03:47.446 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-10T23:03:47.446 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-10T23:03:47.447 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-10T23:03:47.447 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-10T23:03:47.447 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-10T23:03:47.447 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-10T23:03:47.447 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-10T23:03:47.447 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-10T23:03:47.447 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-10T23:03:47.447 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-10T23:03:47.447 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-10T23:03:47.447 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-10T23:03:47.447 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-10T23:03:47.447 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-10T23:03:47.447 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-10T23:03:47.448 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-10T23:03:47.448 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-10T23:03:47.448 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-10T23:03:47.448 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-10T23:03:47.448 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-10T23:03:47.448 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-10T23:03:47.448 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-10T23:03:47.448 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-10T23:03:47.448 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-10T23:03:47.448 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-10T23:03:47.448 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-10T23:03:47.448 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-10T23:03:47.448 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-10T23:03:47.449 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-10T23:03:47.449 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-10T23:03:47.449 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-10T23:03:47.449 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-10T23:03:47.449 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-10T23:03:47.449 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-10T23:03:47.449 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-10T23:03:47.449 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-10T23:03:47.449 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-10T23:03:47.449 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-10T23:03:47.449 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-10T23:03:47.449 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-10T23:03:47.449 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-10T23:03:47.450 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-10T23:03:47.450 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-10T23:03:47.450 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-10T23:03:47.450 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-10T23:03:47.450 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-10T23:03:47.450 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-10T23:03:47.450 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-10T23:03:47.450 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-10T23:03:47.450 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-10T23:03:47.450 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-10T23:03:47.450 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-10T23:03:47.450 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-10T23:03:47.450 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-10T23:03:47.451 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-10T23:03:47.451 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-10T23:03:47.451 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-10T23:03:47.451 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-10T23:03:47.451 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-10T23:03:47.451 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-10T23:03:47.451 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-10T23:03:47.451 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-10T23:03:47.451 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-10T23:03:47.451 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-10T23:03:47.451 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-10T23:03:47.451 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-10T23:03:47.451 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-10T23:03:47.452 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-10T23:03:47.452 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-10T23:03:47.452 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-10T23:03:47.452 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-10T23:03:47.452 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-10T23:03:47.452 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-10T23:03:47.452 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-10T23:03:47.452 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-10T23:03:47.452 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-10T23:03:47.452 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-10T23:03:47.452 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-10T23:03:47.452 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-10T23:03:47.452 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-10T23:03:47.453 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-10T23:03:47.453 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-10T23:03:47.453 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-10T23:03:47.453 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-10T23:03:47.453 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-10T23:03:47.453 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-10T23:03:47.453 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-10T23:03:47.453 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-10T23:03:47.453 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-10T23:03:47.453 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-10T23:03:47.453 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-10T23:03:47.453 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-10T23:03:47.453 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-10T23:03:47.454 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-10T23:03:47.454 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-10T23:03:47.454 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-10T23:03:47.454 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-10T23:03:47.454 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-10T23:03:47.454 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-10T23:03:47.454 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-10T23:03:47.454 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-10T23:03:47.454 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-10T23:03:47.454 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-10T23:03:47.454 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-10T23:03:47.454 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-10T23:03:47.454 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-10T23:03:47.455 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-10T23:03:47.455 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-10T23:03:47.455 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-10T23:03:47.455 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-10T23:03:47.455 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-10T23:03:47.455 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-10T23:03:47.455 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-10T23:03:47.455 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-10T23:03:47.455 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-10T23:03:47.455 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-10T23:03:47.455 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-10T23:03:47.455 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-10T23:03:47.455 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-10T23:03:47.455 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-10T23:03:47.456 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-10T23:03:47.456 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-10T23:03:47.456 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-10T23:03:47.456 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-10T23:03:47.456 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-10T23:03:47.456 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-10T23:03:47.456 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-10T23:03:47.456 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-10T23:03:47.456 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-10T23:03:47.456 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-10T23:03:47.456 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-10T23:03:47.456 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-10T23:03:47.456 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-10T23:03:47.457 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-10T23:03:47.457 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-10T23:03:47.457 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-10T23:03:47.457 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-10T23:03:47.457 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-10T23:03:47.457 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-10T23:03:47.457 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-10T23:03:47.457 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-10T23:03:47.457 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-10T23:03:47.458 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-10T23:03:47.458 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-10T23:03:47.458 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-10T23:03:47.458 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-10T23:03:47.458 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-10T23:03:47.458 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-10T23:03:47.458 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-10T23:03:47.458 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-10T23:03:47.458 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-10T23:03:47.458 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-10T23:03:47.458 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-10T23:03:47.458 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-10T23:03:47.458 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-10T23:03:47.459 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-10T23:03:47.459 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-10T23:03:47.459 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-10T23:03:47.459 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-10T23:03:47.459 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-10T23:03:47.459 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-10T23:03:47.459 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-10T23:03:47.459 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-10T23:03:47.459 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-10T23:03:47.459 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-10T23:03:47.459 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-10T23:03:47.459 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-10T23:03:47.459 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-10T23:03:47.459 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-10T23:03:47.460 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-10T23:03:47.460 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-10T23:03:47.460 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-10T23:03:47.460 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-10T23:03:47.460 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-10T23:03:47.460 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-10T23:03:47.460 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-10T23:03:47.460 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-10T23:03:47.460 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-10T23:03:47.460 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-10T23:03:47.460 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-10T23:03:47.460 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-10T23:03:47.460 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-10T23:03:47.461 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-10T23:03:47.461 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-10T23:03:47.461 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-10T23:03:47.461 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-10T23:03:47.461 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-10T23:03:47.461 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-10T23:03:47.461 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-10T23:03:47.461 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-10T23:03:47.461 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-10T23:03:47.461 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-10T23:03:47.461 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-10T23:03:47.461 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-10T23:03:47.461 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-10T23:03:47.462 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-10T23:03:47.462 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-10T23:03:47.462 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-10T23:03:47.462 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-10T23:03:47.462 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-10T23:03:47.462 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-10T23:03:47.462 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-10T23:03:47.462 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-10T23:03:47.462 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-10T23:03:47.462 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-10T23:03:47.462 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-10T23:03:47.462 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-10T23:03:47.462 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-10T23:03:47.462 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-10T23:03:47.463 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-10T23:03:47.463 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-10T23:03:47.463 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-10T23:03:47.463 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-10T23:03:47.463 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-10T23:03:47.463 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-10T23:03:47.463 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-10T23:03:47.463 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-10T23:03:47.463 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-10T23:03:47.463 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-10T23:03:47.463 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-10T23:03:47.463 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-10T23:03:47.463 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-10T23:03:47.463 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-10T23:03:47.463 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-10T23:03:47.464 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-10T23:03:47.464 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-10T23:03:47.464 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-10T23:03:47.464 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-10T23:03:47.464 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-10T23:03:47.464 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-10T23:03:47.464 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-10T23:03:47.464 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-10T23:03:47.464 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-10T23:03:47.464 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-10T23:03:47.464 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-10T23:03:47.464 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-10T23:03:47.464 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-10T23:03:47.464 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-10T23:03:47.465 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-10T23:03:47.465 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-10T23:03:47.465 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-10T23:03:47.465 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-10T23:03:47.465 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-10T23:03:47.465 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-10T23:03:47.465 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-10T23:03:47.465 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-10T23:03:47.465 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-10T23:03:47.465 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-10T23:03:47.465 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-10T23:03:47.465 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-10T23:03:47.465 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-10T23:03:47.465 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-10T23:03:47.466 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-10T23:03:47.466 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-10T23:03:47.466 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-10T23:03:47.466 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-10T23:03:47.466 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-10T23:03:47.466 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-10T23:03:47.466 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-10T23:03:47.466 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-10T23:03:47.466 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-10T23:03:47.466 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-10T23:03:47.466 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-10T23:03:47.466 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-10T23:03:47.466 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-10T23:03:47.467 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-10T23:03:47.467 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-10T23:03:47.467 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-10T23:03:47.467 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-10T23:03:47.467 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-10T23:03:47.467 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-10T23:03:47.467 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-10T23:03:47.467 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-10T23:03:47.467 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-10T23:03:47.467 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-10T23:03:47.468 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-10T23:03:47.468 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-10T23:03:47.468 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-10T23:03:47.468 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-10T23:03:47.468 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-10T23:03:47.468 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-10T23:03:47.468 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-10T23:03:47.468 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-10T23:03:47.468 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-10T23:03:47.468 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-10T23:03:47.468 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-10T23:03:47.468 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-10T23:03:47.469 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-10T23:03:47.469 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-10T23:03:47.469 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-10T23:03:47.469 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-10T23:03:47.469 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-10T23:03:47.469 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-10T23:03:47.469 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-10T23:03:47.469 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-10T23:03:47.469 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-10T23:03:47.469 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-10T23:03:47.469 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-10T23:03:47.469 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-10T23:03:47.469 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-10T23:03:47.470 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-10T23:03:47.470 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-10T23:03:47.470 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-10T23:03:47.470 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-10T23:03:47.470 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-10T23:03:47.470 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-10T23:03:47.470 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-10T23:03:47.470 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-10T23:03:47.470 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-10T23:03:47.470 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-10T23:03:47.470 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-10T23:03:47.470 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-10T23:03:47.470 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-10T23:03:47.470 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-10T23:03:47.470 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-10T23:03:47.471 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-10T23:03:47.471 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-10T23:03:47.471 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-10T23:03:47.471 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-10T23:03:47.471 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-10T23:03:47.471 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-10T23:03:47.471 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-10T23:03:47.471 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-10T23:03:47.471 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-10T23:03:47.471 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-10T23:03:47.471 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-10T23:03:47.471 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-10T23:03:47.471 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-10T23:03:47.471 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-10T23:03:47.472 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-10T23:03:47.472 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-10T23:03:47.472 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-10T23:03:47.472 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-10T23:03:47.472 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-10T23:03:47.472 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-10T23:03:47.472 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-10T23:03:47.472 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-10T23:03:47.472 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-10T23:03:47.472 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-10T23:03:47.472 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-10T23:03:47.472 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-10T23:03:47.472 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-10T23:03:47.473 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-10T23:03:47.473 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-10T23:03:47.473 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-10T23:03:47.473 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-10T23:03:47.473 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-10T23:03:47.473 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-10T23:03:47.473 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-10T23:03:47.473 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-10T23:03:47.473 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-10T23:03:47.473 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-10T23:03:47.473 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-10T23:03:47.473 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-10T23:03:47.473 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-10T23:03:47.474 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-10T23:03:47.474 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-10T23:03:47.474 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-10T23:03:47.474 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-10T23:03:47.474 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-10T23:03:47.474 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-10T23:03:47.474 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-10T23:03:47.474 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-10T23:03:47.474 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-10T23:03:47.474 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-10T23:03:47.474 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-10T23:03:47.474 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-10T23:03:47.474 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-10T23:03:47.475 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-10T23:03:47.475 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-10T23:03:47.475 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-10T23:03:47.475 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-10T23:03:47.475 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-10T23:03:47.475 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-10T23:03:47.475 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-10T23:03:47.475 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-10T23:03:47.475 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-10T23:03:47.475 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-10T23:03:47.475 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-10T23:03:47.475 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-10T23:03:47.475 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-10T23:03:47.476 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-10T23:03:47.476 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-10T23:03:47.476 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-10T23:03:47.476 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-10T23:03:47.476 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-10T23:03:47.476 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-10T23:03:47.476 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-10T23:03:47.476 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-10T23:03:47.476 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-10T23:03:47.476 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-10T23:03:47.476 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-10T23:03:47.476 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-10T23:03:47.477 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-10T23:03:47.477 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-10T23:03:47.477 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-10T23:03:47.477 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-10T23:03:47.477 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-10T23:03:47.477 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-10T23:03:47.477 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-10T23:03:47.477 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-10T23:03:47.477 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-10T23:03:47.477 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-10T23:03:47.477 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-10T23:03:47.477 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-10T23:03:47.477 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-10T23:03:47.478 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-10T23:03:47.478 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-10T23:03:47.478 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-10T23:03:47.478 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-10T23:03:47.478 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-10T23:03:47.478 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-10T23:03:47.478 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-10T23:03:47.478 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-10T23:03:47.478 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-10T23:03:47.478 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-10T23:03:47.478 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-10T23:03:47.478 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-10T23:03:47.478 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-10T23:03:47.478 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-10T23:03:47.479 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-10T23:03:47.479 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-10T23:03:47.479 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-10T23:03:47.479 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-10T23:03:47.479 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-10T23:03:47.479 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-10T23:03:47.479 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-10T23:03:47.479 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-10T23:03:47.479 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-10T23:03:47.479 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-10T23:03:47.479 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-10T23:03:47.479 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-10T23:03:47.479 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-10T23:03:47.480 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-10T23:03:47.480 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-10T23:03:47.480 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-10T23:03:47.480 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-10T23:03:47.480 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-10T23:03:47.480 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-10T23:03:47.480 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-10T23:03:47.480 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-10T23:03:47.480 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-10T23:03:47.480 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-10T23:03:47.480 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-10T23:03:47.480 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-10T23:03:47.480 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-10T23:03:47.480 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-10T23:03:47.481 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-10T23:03:47.481 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-10T23:03:47.481 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-10T23:03:47.481 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-10T23:03:47.481 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-10T23:03:47.481 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-10T23:03:47.481 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-10T23:03:47.481 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-10T23:03:47.481 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-10T23:03:47.481 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-10T23:03:47.481 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-10T23:03:47.481 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-10T23:03:47.481 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-10T23:03:47.482 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-10T23:03:47.482 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-10T23:03:47.482 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-10T23:03:47.482 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-10T23:03:47.482 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-10T23:03:47.482 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-10T23:03:47.482 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-10T23:03:47.482 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-10T23:03:47.482 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-10T23:03:47.482 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-10T23:03:47.482 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-10T23:03:47.482 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-10T23:03:47.482 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-10T23:03:47.482 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-10T23:03:47.483 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-10T23:03:47.483 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-10T23:03:47.483 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-10T23:03:47.483 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-10T23:03:47.483 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-10T23:03:47.483 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-10T23:03:47.483 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-10T23:03:47.483 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-10T23:03:47.483 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-10T23:03:47.483 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-10T23:03:47.483 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-10T23:03:47.483 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-10T23:03:47.483 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-10T23:03:47.484 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-10T23:03:47.484 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-10T23:03:47.484 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-10T23:03:47.484 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-10T23:03:47.484 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-10T23:03:47.484 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-10T23:03:47.484 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-10T23:03:47.484 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-10T23:03:47.484 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-10T23:03:47.484 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-10T23:03:47.484 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-10T23:03:47.484 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-10T23:03:47.484 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-10T23:03:47.484 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-10T23:03:47.485 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-10T23:03:47.485 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-10T23:03:47.485 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-10T23:03:47.485 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-10T23:03:47.485 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-10T23:03:47.485 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-10T23:03:47.485 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-10T23:03:47.485 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-10T23:03:47.485 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-10T23:03:47.485 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-10T23:03:47.485 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-10T23:03:47.485 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-10T23:03:47.486 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-10T23:03:47.486 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-10T23:03:47.486 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-10T23:03:47.486 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-10T23:03:47.486 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-10T23:03:47.486 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-10T23:03:47.486 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-10T23:03:47.486 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-10T23:03:47.486 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-10T23:03:47.486 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-10T23:03:47.486 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-10T23:03:47.486 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-10T23:03:47.486 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-10T23:03:47.487 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-10T23:03:47.487 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-10T23:03:47.487 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-10T23:03:47.487 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-10T23:03:47.487 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-10T23:03:47.487 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-10T23:03:47.487 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-10T23:03:47.487 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-10T23:03:47.487 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-10T23:03:47.487 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-10T23:03:47.487 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-10T23:03:47.487 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-10T23:03:47.487 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-10T23:03:47.488 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-10T23:03:47.488 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-10T23:03:47.488 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-10T23:03:47.488 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-10T23:03:47.488 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-10T23:03:47.488 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-10T23:03:47.488 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-10T23:03:47.488 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-10T23:03:47.488 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-10T23:03:47.488 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-10T23:03:47.488 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-10T23:03:47.488 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-10T23:03:47.489 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-10T23:03:47.489 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-10T23:03:47.489 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-10T23:03:47.489 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-10T23:03:47.489 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-10T23:03:47.489 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-10T23:03:47.489 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-10T23:03:47.489 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-10T23:03:47.489 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-10T23:03:47.489 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-10T23:03:47.489 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-10T23:03:47.489 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-10T23:03:47.490 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-10T23:03:47.490 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-10T23:03:47.490 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-10T23:03:47.490 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-10T23:03:47.490 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-10T23:03:47.490 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-10T23:03:47.490 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-10T23:03:47.490 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-10T23:03:47.490 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-10T23:03:47.490 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-10T23:03:47.490 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-10T23:03:47.490 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-10T23:03:47.491 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-10T23:03:47.491 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-10T23:03:47.491 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-10T23:03:47.491 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-10T23:03:47.491 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-10T23:03:47.491 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-10T23:03:47.491 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-10T23:03:47.491 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-10T23:03:47.491 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-10T23:03:47.491 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-10T23:03:47.491 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-10T23:03:47.491 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-10T23:03:47.492 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-10T23:03:47.492 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-10T23:03:47.492 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-10T23:03:47.492 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-10T23:03:47.492 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-10T23:03:47.492 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-10T23:03:47.492 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-10T23:03:47.492 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-10T23:03:47.492 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-10T23:03:47.492 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-10T23:03:47.492 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-10T23:03:47.492 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-10T23:03:47.493 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-10T23:03:47.493 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-10T23:03:47.493 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-10T23:03:47.493 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-10T23:03:47.493 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-10T23:03:47.493 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-10T23:03:47.493 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-10T23:03:47.493 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-10T23:03:47.493 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-10T23:03:47.493 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-10T23:03:47.493 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-10T23:03:47.493 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-10T23:03:47.494 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-10T23:03:47.494 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-10T23:03:47.494 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-10T23:03:47.494 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-10T23:03:47.494 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-10T23:03:47.494 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-10T23:03:47.494 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-10T23:03:47.494 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-10T23:03:47.494 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-10T23:03:47.494 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-10T23:03:47.494 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-10T23:03:47.494 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-10T23:03:47.494 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-10T23:03:47.494 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-10T23:03:47.495 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-10T23:03:47.495 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-10T23:03:47.495 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-10T23:03:47.495 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-10T23:03:47.495 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-10T23:03:47.495 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-10T23:03:47.495 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-10T23:03:47.495 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-10T23:03:47.495 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-10T23:03:47.495 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-10T23:03:47.495 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-10T23:03:47.495 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-10T23:03:47.496 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-10T23:03:47.496 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-10T23:03:47.496 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-10T23:03:47.496 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-10T23:03:47.496 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-10T23:03:47.496 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-10T23:03:47.496 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-10T23:03:47.496 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-10T23:03:47.496 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-10T23:03:47.496 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-10T23:03:47.496 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-10T23:03:47.496 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-10T23:03:47.496 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-10T23:03:47.497 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-10T23:03:47.497 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-10T23:03:47.497 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-10T23:03:47.497 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-10T23:03:47.497 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-10T23:03:47.497 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-10T23:03:47.497 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-10T23:03:47.497 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-10T23:03:47.497 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-10T23:03:47.497 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-10T23:03:47.497 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-10T23:03:47.497 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-10T23:03:47.497 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-10T23:03:47.498 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-10T23:03:47.498 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-10T23:03:47.498 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-10T23:03:47.498 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-10T23:03:47.498 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-10T23:03:47.498 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-10T23:03:47.498 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-10T23:03:47.498 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-10T23:03:47.498 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-10T23:03:47.498 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-10T23:03:47.498 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-10T23:03:47.498 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-10T23:03:47.498 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-10T23:03:47.499 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-10T23:03:47.499 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-10T23:03:47.499 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-10T23:03:47.499 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-10T23:03:47.499 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-10T23:03:47.499 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-10T23:03:47.499 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-10T23:03:47.499 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-10T23:03:47.499 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-10T23:03:47.499 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-10T23:03:47.499 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-10T23:03:47.499 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-10T23:03:47.499 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-10T23:03:47.500 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-10T23:03:47.500 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-10T23:03:47.500 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-10T23:03:47.500 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-10T23:03:47.500 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-10T23:03:47.500 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-10T23:03:47.500 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-10T23:03:47.500 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-10T23:03:47.500 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-10T23:03:47.500 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-10T23:03:47.500 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-10T23:03:47.501 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-10T23:03:47.501 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-10T23:03:47.501 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-10T23:03:47.501 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-10T23:03:47.501 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-10T23:03:47.501 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-10T23:03:47.501 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-10T23:03:47.501 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-10T23:03:47.501 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-10T23:03:47.501 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-10T23:03:47.501 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-10T23:03:47.501 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-10T23:03:47.502 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-10T23:03:47.502 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-10T23:03:47.502 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-10T23:03:47.502 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-10T23:03:47.502 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-10T23:03:47.502 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-10T23:03:47.502 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-10T23:03:47.502 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-10T23:03:47.502 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-10T23:03:47.502 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-10T23:03:47.502 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-10T23:03:47.502 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-10T23:03:47.502 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-10T23:03:47.503 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-10T23:03:47.503 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-10T23:03:47.503 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-10T23:03:47.503 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-10T23:03:47.503 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-10T23:03:47.503 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-10T23:03:47.503 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-10T23:03:47.503 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-10T23:03:47.503 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-10T23:03:47.503 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-10T23:03:47.503 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-10T23:03:47.503 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-10T23:03:47.503 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-10T23:03:47.504 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-10T23:03:47.504 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-10T23:03:47.504 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-10T23:03:47.504 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-10T23:03:47.504 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-10T23:03:47.504 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-10T23:03:47.504 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-10T23:03:47.504 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-10T23:03:47.504 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-10T23:03:47.504 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-10T23:03:47.504 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-10T23:03:47.504 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-10T23:03:47.505 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-10T23:03:47.505 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-10T23:03:47.505 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-10T23:03:47.505 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-10T23:03:47.505 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-10T23:03:47.505 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-10T23:03:47.505 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-10T23:03:47.505 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-10T23:03:47.505 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-10T23:03:47.505 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-10T23:03:47.505 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-10T23:03:47.505 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-10T23:03:47.506 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-10T23:03:47.506 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-10T23:03:47.506 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-10T23:03:47.506 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-10T23:03:47.506 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-10T23:03:47.506 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-10T23:03:47.506 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-10T23:03:47.506 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-10T23:03:47.506 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-10T23:03:47.506 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-10T23:03:47.506 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-10T23:03:47.506 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-10T23:03:47.506 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-10T23:03:47.507 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-10T23:03:47.507 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-10T23:03:47.507 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-10T23:03:47.507 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-10T23:03:47.507 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-10T23:03:47.507 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-10T23:03:47.507 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-10T23:03:47.507 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-10T23:03:47.507 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-10T23:03:47.507 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-10T23:03:47.507 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-10T23:03:47.507 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-10T23:03:47.508 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-10T23:03:47.508 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-10T23:03:47.508 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-10T23:03:47.508 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-10T23:03:47.508 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-10T23:03:47.508 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-10T23:03:47.508 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-10T23:03:47.508 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-10T23:03:47.508 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-10T23:03:47.508 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-10T23:03:47.508 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-10T23:03:47.508 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-10T23:03:47.509 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-10T23:03:47.509 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-10T23:03:47.509 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-10T23:03:47.509 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-10T23:03:47.509 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-10T23:03:47.509 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-10T23:03:47.509 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-10T23:03:47.509 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-10T23:03:47.509 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-10T23:03:47.509 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-10T23:03:47.509 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-10T23:03:47.509 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-10T23:03:47.510 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-10T23:03:47.510 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-10T23:03:47.510 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-10T23:03:47.510 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-10T23:03:47.510 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-10T23:03:47.510 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-10T23:03:47.510 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-10T23:03:47.510 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-10T23:03:47.510 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-10T23:03:47.510 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-10T23:03:47.511 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-10T23:03:47.511 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-10T23:03:47.511 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-10T23:03:47.511 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-10T23:03:47.511 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-10T23:03:47.511 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-10T23:03:47.511 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-10T23:03:47.511 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-10T23:03:47.511 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-10T23:03:47.511 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-10T23:03:47.512 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-10T23:03:47.512 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-10T23:03:47.512 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-10T23:03:47.512 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-10T23:03:47.512 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-10T23:03:47.512 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-10T23:03:47.512 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-10T23:03:47.512 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-10T23:03:47.512 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-10T23:03:47.512 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-10T23:03:47.512 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-10T23:03:47.512 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-10T23:03:47.512 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-10T23:03:47.513 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-10T23:03:47.513 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-10T23:03:47.513 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-10T23:03:47.513 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-10T23:03:47.513 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-10T23:03:47.513 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-10T23:03:47.513 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-10T23:03:47.514 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-10T23:03:47.514 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-10T23:03:47.514 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-10T23:03:47.514 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-10T23:03:47.514 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-10T23:03:47.514 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-10T23:03:47.514 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-10T23:03:47.514 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-10T23:03:47.514 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-10T23:03:47.514 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-10T23:03:47.514 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-10T23:03:47.514 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-10T23:03:47.515 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-10T23:03:47.515 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-10T23:03:47.515 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-10T23:03:47.515 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-10T23:03:47.515 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-10T23:03:47.515 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-10T23:03:47.515 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-10T23:03:47.515 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-10T23:03:47.515 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-10T23:03:47.515 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-10T23:03:47.515 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-10T23:03:47.515 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-10T23:03:47.515 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-10T23:03:47.516 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-10T23:03:47.516 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-10T23:03:47.516 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-10T23:03:47.516 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-10T23:03:47.516 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-10T23:03:47.516 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-10T23:03:47.516 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-10T23:03:47.516 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-10T23:03:47.516 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-10T23:03:47.516 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-10T23:03:47.516 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-10T23:03:47.516 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-10T23:03:47.516 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-10T23:03:47.517 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-10T23:03:47.517 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-10T23:03:47.517 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-10T23:03:47.517 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-10T23:03:47.517 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-10T23:03:47.517 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-10T23:03:47.517 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-10T23:03:47.517 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-10T23:03:47.517 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-10T23:03:47.517 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-10T23:03:47.517 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-10T23:03:47.517 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-10T23:03:47.518 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-10T23:03:47.518 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-10T23:03:47.518 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-10T23:03:47.518 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-10T23:03:47.518 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-10T23:03:47.518 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-10T23:03:47.518 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-10T23:03:47.518 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-10T23:03:47.518 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-10T23:03:47.518 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-10T23:03:47.518 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-10T23:03:47.518 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-10T23:03:47.519 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-10T23:03:47.519 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-10T23:03:47.519 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-10T23:03:47.519 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-10T23:03:47.519 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-10T23:03:47.519 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-10T23:03:47.519 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-10T23:03:47.519 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-10T23:03:47.519 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-10T23:03:47.519 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-10T23:03:47.519 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-10T23:03:47.519 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-10T23:03:47.519 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-10T23:03:47.520 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-10T23:03:47.520 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-10T23:03:47.520 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-10T23:03:47.520 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-10T23:03:47.520 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-10T23:03:47.520 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-10T23:03:47.520 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-10T23:03:47.520 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-10T23:03:47.520 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-10T23:03:47.520 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-10T23:03:47.520 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-10T23:03:47.520 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-10T23:03:47.521 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-10T23:03:47.521 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-10T23:03:47.521 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-10T23:03:47.521 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-10T23:03:47.521 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-10T23:03:47.521 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-10T23:03:47.521 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-10T23:03:47.521 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-10T23:03:47.521 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-10T23:03:47.521 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-10T23:03:47.521 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-10T23:03:47.521 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-10T23:03:47.522 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-10T23:03:47.522 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-10T23:03:47.522 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-10T23:03:47.522 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-10T23:03:47.522 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-10T23:03:47.522 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-10T23:03:47.522 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-10T23:03:47.522 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-10T23:03:47.522 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-10T23:03:47.522 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-10T23:03:47.522 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-10T23:03:47.522 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-10T23:03:47.522 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-10T23:03:47.523 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-10T23:03:47.523 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-10T23:03:47.523 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-10T23:03:47.523 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-10T23:03:47.523 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-10T23:03:47.523 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-10T23:03:47.523 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-10T23:03:47.523 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-10T23:03:47.523 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-10T23:03:47.523 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-10T23:03:47.523 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-10T23:03:47.524 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-10T23:03:47.524 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-10T23:03:47.524 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-10T23:03:47.524 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-10T23:03:47.524 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-10T23:03:47.524 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-10T23:03:47.524 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-10T23:03:47.524 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-10T23:03:47.524 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-10T23:03:47.524 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-10T23:03:47.524 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-10T23:03:47.524 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-10T23:03:47.524 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-10T23:03:47.525 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-10T23:03:47.525 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-10T23:03:47.525 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-10T23:03:47.525 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-10T23:03:47.525 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-10T23:03:47.525 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-10T23:03:47.525 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-10T23:03:47.525 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-10T23:03:47.525 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-10T23:03:47.525 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-10T23:03:47.525 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-10T23:03:47.525 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-10T23:03:47.525 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-10T23:03:47.526 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-10T23:03:47.526 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-10T23:03:47.526 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-10T23:03:47.526 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-10T23:03:47.526 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-10T23:03:47.526 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-10T23:03:47.526 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-10T23:03:47.526 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-10T23:03:47.526 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-10T23:03:47.526 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-10T23:03:47.526 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-10T23:03:47.526 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-10T23:03:47.526 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-10T23:03:47.527 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-10T23:03:47.527 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-10T23:03:47.527 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-10T23:03:47.527 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-10T23:03:47.527 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-10T23:03:47.527 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-10T23:03:47.527 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-10T23:03:47.527 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-10T23:03:47.527 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-10T23:03:47.527 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-10T23:03:47.527 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-10T23:03:47.528 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-10T23:03:47.528 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-10T23:03:47.528 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-10T23:03:47.528 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-10T23:03:47.528 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-10T23:03:47.528 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-10T23:03:47.528 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-10T23:03:47.528 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-10T23:03:47.528 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-10T23:03:47.528 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-10T23:03:47.529 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-10T23:03:47.529 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-10T23:03:47.529 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-10T23:03:47.529 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-10T23:03:47.529 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-10T23:03:47.529 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-10T23:03:47.529 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-10T23:03:47.529 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-10T23:03:47.529 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-10T23:03:47.529 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-10T23:03:47.529 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-10T23:03:47.529 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-10T23:03:47.530 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-10T23:03:47.530 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-10T23:03:47.530 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-10T23:03:47.530 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-10T23:03:47.530 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-10T23:03:47.530 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-10T23:03:47.530 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-10T23:03:47.530 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-10T23:03:47.530 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-10T23:03:47.530 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-10T23:03:47.530 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-10T23:03:47.531 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-10T23:03:47.531 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-10T23:03:47.531 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-10T23:03:47.531 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-10T23:03:47.531 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-10T23:03:47.531 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-10T23:03:47.531 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-10T23:03:47.531 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-10T23:03:47.531 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-10T23:03:47.531 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-10T23:03:47.531 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-10T23:03:47.532 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-10T23:03:47.532 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-10T23:03:47.532 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-10T23:03:47.532 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-10T23:03:47.532 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-10T23:03:47.532 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-10T23:03:47.532 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-10T23:03:47.532 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-10T23:03:47.532 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-10T23:03:47.532 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-10T23:03:47.532 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-10T23:03:47.533 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-10T23:03:47.533 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-10T23:03:47.533 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-10T23:03:47.533 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-10T23:03:47.533 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-10T23:03:47.533 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-10T23:03:47.533 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-10T23:03:47.533 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-10T23:03:47.533 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-10T23:03:47.533 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-10T23:03:47.533 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-10T23:03:47.534 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-10T23:03:47.534 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-10T23:03:47.534 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-10T23:03:47.534 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-10T23:03:47.534 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-10T23:03:47.534 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-10T23:03:47.534 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-10T23:03:47.534 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-10T23:03:47.534 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-10T23:03:47.534 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-10T23:03:47.535 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-10T23:03:47.535 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-10T23:03:47.535 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-10T23:03:47.535 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-10T23:03:47.535 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-10T23:03:47.535 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-10T23:03:47.535 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-10T23:03:47.535 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-10T23:03:47.535 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-10T23:03:47.535 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-10T23:03:47.535 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-10T23:03:47.535 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-10T23:03:47.536 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-10T23:03:47.536 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-10T23:03:47.536 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-10T23:03:47.536 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-10T23:03:47.536 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-10T23:03:47.536 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-10T23:03:47.536 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-10T23:03:47.536 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-10T23:03:47.536 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-10T23:03:47.536 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-10T23:03:47.536 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-10T23:03:47.537 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-10T23:03:47.537 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-10T23:03:47.537 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-10T23:03:47.537 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-10T23:03:47.537 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-10T23:03:47.537 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-10T23:03:47.537 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-10T23:03:47.537 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-10T23:03:47.537 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-10T23:03:47.537 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-10T23:03:47.537 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-10T23:03:47.538 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-10T23:03:47.538 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-10T23:03:47.538 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-10T23:03:47.538 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-10T23:03:47.538 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-10T23:03:47.538 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-10T23:03:47.538 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-10T23:03:47.538 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-10T23:03:47.538 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-10T23:03:47.538 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-10T23:03:47.538 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-10T23:03:47.539 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-10T23:03:47.539 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-10T23:03:47.539 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-10T23:03:47.539 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-10T23:03:47.539 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-10T23:03:47.539 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-10T23:03:47.539 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-10T23:03:47.539 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-10T23:03:47.539 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-10T23:03:47.539 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-10T23:03:47.539 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-10T23:03:47.539 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-10T23:03:47.539 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-10T23:03:47.540 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-10T23:03:47.540 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-10T23:03:47.540 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-10T23:03:47.540 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-10T23:03:47.540 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-10T23:03:47.540 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-10T23:03:47.540 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-10T23:03:47.540 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-10T23:03:47.540 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-10T23:03:47.540 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-10T23:03:47.540 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-10T23:03:47.540 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-10T23:03:47.540 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-10T23:03:47.540 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-10T23:03:47.541 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-10T23:03:47.541 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-10T23:03:47.541 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-10T23:03:47.541 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-10T23:03:47.541 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-10T23:03:47.541 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-10T23:03:47.541 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-10T23:03:47.541 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-10T23:03:47.541 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-10T23:03:47.541 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-10T23:03:47.541 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-10T23:03:47.541 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-10T23:03:47.541 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-10T23:03:47.542 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-10T23:03:47.542 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-10T23:03:47.542 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-10T23:03:47.542 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-10T23:03:47.542 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-10T23:03:47.542 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-10T23:03:47.542 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-10T23:03:47.542 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-10T23:03:47.542 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-10T23:03:47.542 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-10T23:03:47.542 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-10T23:03:47.542 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-10T23:03:47.542 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-10T23:03:47.543 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-10T23:03:47.543 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-10T23:03:47.543 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-10T23:03:47.543 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-10T23:03:47.543 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-10T23:03:47.543 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-10T23:03:47.543 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-10T23:03:47.543 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-10T23:03:47.543 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-10T23:03:47.543 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-10T23:03:47.543 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-10T23:03:47.543 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-10T23:03:47.544 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-10T23:03:47.544 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-10T23:03:47.544 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-10T23:03:47.544 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-10T23:03:47.544 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-10T23:03:47.544 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-10T23:03:47.544 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-10T23:03:47.544 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-10T23:03:47.544 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-10T23:03:47.544 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-10T23:03:47.544 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-10T23:03:47.544 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-10T23:03:47.544 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-10T23:03:47.545 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-10T23:03:47.545 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-10T23:03:47.545 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-10T23:03:47.545 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-10T23:03:47.545 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-10T23:03:47.545 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-10T23:03:47.545 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-10T23:03:47.545 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-10T23:03:47.545 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-10T23:03:47.545 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-10T23:03:47.545 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-10T23:03:47.545 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-10T23:03:47.545 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-10T23:03:47.546 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-10T23:03:47.546 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-10T23:03:47.546 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-10T23:03:47.546 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-10T23:03:47.546 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-10T23:03:47.546 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-10T23:03:47.546 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-10T23:03:47.546 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-10T23:03:47.546 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-10T23:03:47.546 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-10T23:03:47.546 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-10T23:03:47.546 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-10T23:03:47.546 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-10T23:03:47.547 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-10T23:03:47.547 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-10T23:03:47.547 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-10T23:03:47.547 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-10T23:03:47.547 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-10T23:03:47.547 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-10T23:03:47.547 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-10T23:03:47.547 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-10T23:03:47.547 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-10T23:03:47.547 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-10T23:03:47.547 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-10T23:03:47.547 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-10T23:03:47.547 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-10T23:03:47.548 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-10T23:03:47.548 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-10T23:03:47.548 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-10T23:03:47.548 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-10T23:03:47.548 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-10T23:03:47.548 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-10T23:03:47.548 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-10T23:03:47.548 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-10T23:03:47.548 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-10T23:03:47.548 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-10T23:03:47.548 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-10T23:03:47.548 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-10T23:03:47.549 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-10T23:03:47.549 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-10T23:03:47.549 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-10T23:03:47.549 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-10T23:03:47.549 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-10T23:03:47.549 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-10T23:03:47.549 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-10T23:03:47.549 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-10T23:03:47.549 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-10T23:03:47.549 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-10T23:03:47.549 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-10T23:03:47.549 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-10T23:03:47.550 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-10T23:03:47.550 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-10T23:03:47.550 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-10T23:03:47.550 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-10T23:03:47.550 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-10T23:03:47.550 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-10T23:03:47.550 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-10T23:03:47.550 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-10T23:03:47.550 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-10T23:03:47.550 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-10T23:03:47.550 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-10T23:03:47.550 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-10T23:03:47.550 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-10T23:03:47.551 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-10T23:03:47.551 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-10T23:03:47.551 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-10T23:03:47.551 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T23:03:47.555 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:03:47.555 DEBUG:teuthology.orchestra.run.smithi038:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-10T23:03:47.579 INFO:teuthology.orchestra.run.smithi038.stdout:postinstall scriptlet (using /bin/sh): 2024-09-10T23:03:47.579 INFO:teuthology.orchestra.run.smithi038.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T23:03:47.579 INFO:teuthology.orchestra.run.smithi038.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T23:03:47.579 INFO:teuthology.orchestra.run.smithi038.stdout:fi 2024-09-10T23:03:47.579 INFO:teuthology.orchestra.run.smithi038.stdout:for file in vmlinuz System.map config; do 2024-09-10T23:03:47.580 INFO:teuthology.orchestra.run.smithi038.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-10T23:03:47.580 INFO:teuthology.orchestra.run.smithi038.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T23:03:47.580 INFO:teuthology.orchestra.run.smithi038.stdout: fi 2024-09-10T23:03:47.580 INFO:teuthology.orchestra.run.smithi038.stdout:done 2024-09-10T23:03:47.580 INFO:teuthology.orchestra.run.smithi038.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-10T23:03:47.580 INFO:teuthology.orchestra.run.smithi038.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-10T23:03:47.580 INFO:teuthology.orchestra.run.smithi038.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T23:03:47.580 INFO:teuthology.orchestra.run.smithi038.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T23:03:47.580 INFO:teuthology.orchestra.run.smithi038.stdout:fi 2024-09-10T23:03:47.580 INFO:teuthology.orchestra.run.smithi038.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-10T23:03:47.581 INFO:teuthology.orchestra.run.smithi038.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:03:47.581 INFO:teuthology.orchestra.run.smithi038.stdout:fi 2024-09-10T23:03:47.581 INFO:teuthology.orchestra.run.smithi038.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-10T23:03:47.581 INFO:teuthology.orchestra.run.smithi038.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T23:03:47.581 INFO:teuthology.orchestra.run.smithi038.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:03:47.581 INFO:teuthology.orchestra.run.smithi038.stdout:fi 2024-09-10T23:03:47.582 DEBUG:teuthology.orchestra.run.smithi038:> sudo rpm -qi grub2-tools 2024-09-10T23:03:47.666 INFO:teuthology.orchestra.run.smithi038.stdout:Name : grub2-tools 2024-09-10T23:03:47.667 INFO:teuthology.orchestra.run.smithi038.stdout:Epoch : 1 2024-09-10T23:03:47.667 INFO:teuthology.orchestra.run.smithi038.stdout:Version : 2.06 2024-09-10T23:03:47.667 INFO:teuthology.orchestra.run.smithi038.stdout:Release : 82.el9 2024-09-10T23:03:47.667 INFO:teuthology.orchestra.run.smithi038.stdout:Architecture: x86_64 2024-09-10T23:03:47.667 INFO:teuthology.orchestra.run.smithi038.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T23:03:47.667 INFO:teuthology.orchestra.run.smithi038.stdout:Group : Unspecified 2024-09-10T23:03:47.667 INFO:teuthology.orchestra.run.smithi038.stdout:Size : 8274670 2024-09-10T23:03:47.667 INFO:teuthology.orchestra.run.smithi038.stdout:License : GPLv3+ 2024-09-10T23:03:47.667 INFO:teuthology.orchestra.run.smithi038.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T23:03:47.667 INFO:teuthology.orchestra.run.smithi038.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T23:03:47.667 INFO:teuthology.orchestra.run.smithi038.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T23:03:47.667 INFO:teuthology.orchestra.run.smithi038.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T23:03:47.667 INFO:teuthology.orchestra.run.smithi038.stdout:Packager : builder@centos.org 2024-09-10T23:03:47.668 INFO:teuthology.orchestra.run.smithi038.stdout:Vendor : CentOS 2024-09-10T23:03:47.668 INFO:teuthology.orchestra.run.smithi038.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T23:03:47.668 INFO:teuthology.orchestra.run.smithi038.stdout:Summary : Support tools for GRUB. 2024-09-10T23:03:47.668 INFO:teuthology.orchestra.run.smithi038.stdout:Description : 2024-09-10T23:03:47.668 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T23:03:47.668 INFO:teuthology.orchestra.run.smithi038.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T23:03:47.668 INFO:teuthology.orchestra.run.smithi038.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T23:03:47.668 INFO:teuthology.orchestra.run.smithi038.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T23:03:47.669 INFO:teuthology.orchestra.run.smithi038.stdout:hardware devices. 2024-09-10T23:03:47.669 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T23:03:47.669 INFO:teuthology.orchestra.run.smithi038.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T23:03:47.670 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T23:03:47.670 INFO:teuthology.task.kernel:Updating grub on smithi038 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:03:47.670 DEBUG:teuthology.orchestra.run.smithi038:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T23:03:48.276 INFO:teuthology.orchestra.run.smithi038.stderr:Generating grub configuration file ... 2024-09-10T23:03:49.829 INFO:teuthology.orchestra.run.smithi038.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T23:03:49.848 INFO:teuthology.orchestra.run.smithi038.stderr:done 2024-09-10T23:03:49.854 DEBUG:teuthology.orchestra.run.smithi038:> mktemp 2024-09-10T23:03:49.869 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.XhQe6Pnrdc 2024-09-10T23:03:49.870 DEBUG:teuthology.orchestra.run.smithi038:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.XhQe6Pnrdc 2024-09-10T23:03:49.935 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.XhQe6Pnrdc 2024-09-10T23:03:50.074 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.XhQe6Pnrdc is 6KB 2024-09-10T23:03:50.122 DEBUG:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.XhQe6Pnrdc 2024-09-10T23:03:50.136 DEBUG:teuthology.orchestra.run.smithi038:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T23:03:50.207 INFO:teuthology.orchestra.run.smithi038.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T23:03:50.207 INFO:teuthology.orchestra.run.smithi038.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T23:03:50.207 INFO:teuthology.orchestra.run.smithi038.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T23:03:50.207 INFO:teuthology.orchestra.run.smithi038.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-10T23:03:50.209 DEBUG:teuthology.orchestra.run.smithi038:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:03:50.367 DEBUG:teuthology.orchestra.run.smithi038:> sudo shutdown -r now 2024-09-10T23:04:11.669 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-09-10T23:04:11.670 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-10T23:04:11.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:04:16.865 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-10T23:04:16.865 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-09-10T23:04:16.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:04:20.373 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-10T23:04:20.373 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-10T23:04:20.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:04:30.017 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-09-10T23:04:35.389 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.3 2024-09-10T23:04:38.717 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.38 2024-09-10T23:04:39.019 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-10T23:04:39.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:04:42.109 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-09-10T23:04:44.391 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-09-10T23:04:44.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:04:47.721 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-10T23:04:47.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:04:50.781 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.38 2024-09-10T23:04:54.113 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-10T23:04:54.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:05:02.789 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-10T23:05:02.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:05:12.513 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-09-10T23:05:27.529 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-10T23:05:27.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:05:27.940 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-09-10T23:05:28.691 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-10T23:05:28.691 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-10T23:05:28.692 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2024-09-10T23:05:28.725 INFO:teuthology.orchestra.run.smithi194.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:05:28.726 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:05:28.726 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T23:05:28.726 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T23:05:29.727 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-09-10T23:05:29.727 DEBUG:teuthology.orchestra.run.smithi194:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T23:05:29.896 INFO:teuthology.orchestra.run.smithi194.stdout:ttyS1 2024-09-10T23:05:29.933 DEBUG:teuthology.parallel:result is None 2024-09-10T23:05:44.403 DEBUG:teuthology.orchestra.remote:timed out 2024-09-10T23:05:56.403 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-09-10T23:05:56.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:05:56.789 DEBUG:teuthology.orchestra.run.smithi003:> true 2024-09-10T23:05:57.307 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-09-10T23:05:57.307 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-10T23:05:57.308 DEBUG:teuthology.orchestra.run.smithi003:> uname -r 2024-09-10T23:05:57.342 INFO:teuthology.orchestra.run.smithi003.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:05:57.342 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:05:57.342 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T23:05:57.342 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T23:05:58.343 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-10T23:05:58.343 DEBUG:teuthology.orchestra.run.smithi003:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T23:05:58.447 INFO:teuthology.orchestra.run.smithi003.stdout:ttyS1 2024-09-10T23:05:58.481 DEBUG:teuthology.parallel:result is None 2024-09-10T23:06:02.801 DEBUG:teuthology.orchestra.remote:timed out 2024-09-10T23:06:17.801 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-10T23:06:17.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:06:18.184 DEBUG:teuthology.orchestra.run.smithi038:> true 2024-09-10T23:06:18.716 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-10T23:06:18.716 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-10T23:06:18.716 DEBUG:teuthology.orchestra.run.smithi038:> uname -r 2024-09-10T23:06:18.751 INFO:teuthology.orchestra.run.smithi038.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:06:18.752 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:06:18.752 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T23:06:18.752 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T23:06:19.755 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-10T23:06:19.756 DEBUG:teuthology.orchestra.run.smithi038:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T23:06:19.857 INFO:teuthology.orchestra.run.smithi038.stdout:ttyS1 2024-09-10T23:06:19.889 DEBUG:teuthology.parallel:result is None 2024-09-10T23:06:19.889 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T23:06:19.897 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T23:06:19.897 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T23:06:19.902 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T23:06:19.905 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T23:06:19.946 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T23:06:19.985 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T23:06:20.060 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T23:06:20.060 DEBUG:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T23:06:20.064 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T23:06:20.068 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T23:06:20.121 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T23:06:20.127 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T23:06:20.127 DEBUG:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T23:06:20.147 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T23:06:20.151 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T23:06:20.204 INFO:teuthology.orchestra.run.smithi003.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:06:20.207 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:06:20.220 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:06:20.227 INFO:teuthology.orchestra.run.smithi003.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:06:20.231 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:06:20.243 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:06:20.246 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T23:06:20.253 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T23:06:20.253 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T23:06:20.257 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T23:06:20.261 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T23:06:20.317 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T23:06:20.326 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T23:06:20.327 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T23:06:20.330 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T23:06:20.334 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T23:06:20.369 DEBUG:teuthology.orchestra.run.smithi003:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:06:20.473 DEBUG:teuthology.orchestra.run.smithi003:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:06:20.558 DEBUG:teuthology.orchestra.run.smithi003:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:06:20.630 DEBUG:teuthology.orchestra.run.smithi003:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:06:20.692 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-10T23:06:20.692 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T23:06:20.747 DEBUG:teuthology.orchestra.run.smithi038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:06:20.818 DEBUG:teuthology.orchestra.run.smithi038:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:06:20.915 DEBUG:teuthology.orchestra.run.smithi038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:06:20.986 DEBUG:teuthology.orchestra.run.smithi038:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:06:21.047 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-10T23:06:21.047 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T23:06:21.102 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:06:21.177 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:06:21.277 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:06:21.350 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:06:21.411 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-10T23:06:21.412 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T23:06:21.466 DEBUG:teuthology.orchestra.run.smithi003:> sudo service rsyslog restart 2024-09-10T23:06:21.470 DEBUG:teuthology.orchestra.run.smithi038:> sudo service rsyslog restart 2024-09-10T23:06:21.473 DEBUG:teuthology.orchestra.run.smithi194:> sudo service rsyslog restart 2024-09-10T23:06:21.550 INFO:teuthology.orchestra.run.smithi003.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:06:21.552 INFO:teuthology.orchestra.run.smithi038.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:06:21.593 INFO:teuthology.orchestra.run.smithi194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:06:22.034 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T23:06:22.041 INFO:teuthology.task.internal:Starting timer... 2024-09-10T23:06:22.042 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T23:06:22.073 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T23:06:22.104 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-10T23:06:22.104 DEBUG:teuthology.orchestra.run.smithi003:> sudo service auditd rotate 2024-09-10T23:06:22.319 INFO:teuthology.orchestra.run.smithi003.stdout:Rotating logs: 2024-09-10T23:06:22.323 DEBUG:teuthology.orchestra.run.smithi038:> sudo service auditd rotate 2024-09-10T23:06:22.423 INFO:teuthology.orchestra.run.smithi038.stdout:Rotating logs: 2024-09-10T23:06:22.427 DEBUG:teuthology.orchestra.run.smithi194:> sudo service auditd rotate 2024-09-10T23:06:22.519 INFO:teuthology.orchestra.run.smithi194.stdout:Rotating logs: 2024-09-10T23:06:22.524 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T23:06:22.524 DEBUG:teuthology.orchestra.run.smithi003:> /usr/sbin/getenforce 2024-09-10T23:06:22.565 INFO:teuthology.orchestra.run.smithi003.stdout:Permissive 2024-09-10T23:06:22.566 DEBUG:teuthology.orchestra.run.smithi038:> /usr/sbin/getenforce 2024-09-10T23:06:22.624 INFO:teuthology.orchestra.run.smithi038.stdout:Permissive 2024-09-10T23:06:22.625 DEBUG:teuthology.orchestra.run.smithi194:> /usr/sbin/getenforce 2024-09-10T23:06:22.666 INFO:teuthology.orchestra.run.smithi194.stdout:Permissive 2024-09-10T23:06:22.666 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi003.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi038.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi194.front.sepia.ceph.com': 'permissive'} 2024-09-10T23:06:22.666 DEBUG:teuthology.orchestra.run.smithi003:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T23:06:22.724 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:06:22.724 DEBUG:teuthology.orchestra.run.smithi038:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T23:06:22.781 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:06:22.782 DEBUG:teuthology.orchestra.run.smithi194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T23:06:22.839 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:06:22.839 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T23:06:22.839 DEBUG:teuthology.orchestra.run.smithi003:> sudo /usr/sbin/setenforce permissive 2024-09-10T23:06:22.903 DEBUG:teuthology.orchestra.run.smithi038:> sudo /usr/sbin/setenforce permissive 2024-09-10T23:06:22.979 DEBUG:teuthology.orchestra.run.smithi194:> sudo /usr/sbin/setenforce permissive 2024-09-10T23:06:23.044 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T23:06:23.054 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T23:06:23.066 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T23:06:23.067 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi003.front.sepia.ceph.com,smithi038.front.sepia.ceph.com,smithi194.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T23:11:09.122 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi003.front.sepia.ceph.com'), Remote(name='ubuntu@smithi038.front.sepia.ceph.com'), Remote(name='ubuntu@smithi194.front.sepia.ceph.com')] 2024-09-10T23:11:09.124 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-09-10T23:11:09.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:11:09.235 DEBUG:teuthology.orchestra.run.smithi003:> true 2024-09-10T23:11:09.355 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-09-10T23:11:09.356 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-10T23:11:09.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:11:09.449 DEBUG:teuthology.orchestra.run.smithi038:> true 2024-09-10T23:11:09.563 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-10T23:11:09.564 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-10T23:11:09.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:11:09.657 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-09-10T23:11:09.769 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-10T23:11:09.770 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T23:11:09.781 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T23:11:09.781 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T23:11:09.781 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:11:09.785 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T23:11:09.786 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:11:09.789 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T23:11:09.790 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:11:09.845 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T23:11:09.849 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T23:11:09.871 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T23:11:09.875 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T23:11:09.879 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T23:11:09.901 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T23:11:09.927 INFO:teuthology.orchestra.run.smithi003.stderr:sudo: ntpd: command not found 2024-09-10T23:11:09.930 INFO:teuthology.orchestra.run.smithi038.stderr:sudo: ntpd: command not found 2024-09-10T23:11:09.951 INFO:teuthology.orchestra.run.smithi003.stdout:506 Cannot talk to daemon 2024-09-10T23:11:09.952 INFO:teuthology.orchestra.run.smithi194.stderr:sudo: ntpd: command not found 2024-09-10T23:11:09.955 INFO:teuthology.orchestra.run.smithi038.stdout:506 Cannot talk to daemon 2024-09-10T23:11:09.976 INFO:teuthology.orchestra.run.smithi194.stdout:506 Cannot talk to daemon 2024-09-10T23:11:09.981 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T23:11:09.984 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T23:11:10.006 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T23:11:10.011 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T23:11:10.014 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T23:11:10.035 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T23:11:10.118 INFO:teuthology.orchestra.run.smithi038.stderr:bash: line 1: ntpq: command not found 2024-09-10T23:11:10.119 INFO:teuthology.orchestra.run.smithi003.stderr:bash: line 1: ntpq: command not found 2024-09-10T23:11:10.125 INFO:teuthology.orchestra.run.smithi038.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T23:11:10.125 INFO:teuthology.orchestra.run.smithi038.stdout:=============================================================================== 2024-09-10T23:11:10.125 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:11:10.125 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:11:10.125 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:11:10.125 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:11:10.127 INFO:teuthology.orchestra.run.smithi003.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T23:11:10.127 INFO:teuthology.orchestra.run.smithi003.stdout:=============================================================================== 2024-09-10T23:11:10.127 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:11:10.127 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:11:10.127 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:11:10.127 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:11:10.127 INFO:teuthology.orchestra.run.smithi194.stderr:bash: line 1: ntpq: command not found 2024-09-10T23:11:10.133 INFO:teuthology.orchestra.run.smithi194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T23:11:10.133 INFO:teuthology.orchestra.run.smithi194.stdout:=============================================================================== 2024-09-10T23:11:10.133 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:11:10.133 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:11:10.133 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:11:10.133 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:11:10.134 INFO:teuthology.run_tasks:Running task install... 2024-09-10T23:11:10.142 DEBUG:teuthology.task.install:project ceph 2024-09-10T23:11:10.142 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}} 2024-09-10T23:11:10.143 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'} 2024-09-10T23:11:10.143 INFO:teuthology.task.install:Using flavor: default 2024-09-10T23:11:10.148 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T23:11:10.148 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-10T23:11:10.148 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T23:11:10.149 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:11:10.151 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T23:11:10.151 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:11:10.152 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T23:11:10.152 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:11:10.300 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T23:11:10.300 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T23:11:10.313 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T23:11:10.313 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T23:11:10.324 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T23:11:10.324 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T23:11:10.427 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T23:11:10.427 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-10T23:11:10.427 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T23:11:10.433 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T23:11:10.433 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-10T23:11:10.433 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T23:11:10.440 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T23:11:10.440 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-10T23:11:10.440 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T23:11:10.485 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T23:11:10.485 DEBUG:teuthology.orchestra.run.smithi003:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T23:11:10.491 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T23:11:10.491 DEBUG:teuthology.orchestra.run.smithi038:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T23:11:10.496 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T23:11:10.496 DEBUG:teuthology.orchestra.run.smithi194:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T23:11:10.582 DEBUG:teuthology.orchestra.run.smithi003:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T23:11:10.590 DEBUG:teuthology.orchestra.run.smithi038:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T23:11:10.592 DEBUG:teuthology.orchestra.run.smithi194:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T23:11:10.662 DEBUG:teuthology.orchestra.run.smithi003:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T23:11:10.669 DEBUG:teuthology.orchestra.run.smithi038:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T23:11:10.670 DEBUG:teuthology.orchestra.run.smithi194:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T23:11:10.716 INFO:teuthology.orchestra.run.smithi003.stdout:check_obsoletes = 1 2024-09-10T23:11:10.719 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum clean all 2024-09-10T23:11:10.727 INFO:teuthology.orchestra.run.smithi194.stdout:check_obsoletes = 1 2024-09-10T23:11:10.727 INFO:teuthology.orchestra.run.smithi038.stdout:check_obsoletes = 1 2024-09-10T23:11:10.728 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum clean all 2024-09-10T23:11:10.729 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum clean all 2024-09-10T23:11:11.001 INFO:teuthology.orchestra.run.smithi003.stdout:45 files removed 2024-09-10T23:11:11.001 INFO:teuthology.orchestra.run.smithi038.stdout:45 files removed 2024-09-10T23:11:11.004 INFO:teuthology.orchestra.run.smithi194.stdout:45 files removed 2024-09-10T23:11:11.034 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T23:11:11.035 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T23:11:11.037 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T23:11:11.730 INFO:teuthology.orchestra.run.smithi003.stdout:ceph packages for x86_64 293 kB/s | 84 kB 00:00 2024-09-10T23:11:11.736 INFO:teuthology.orchestra.run.smithi038.stdout:ceph packages for x86_64 287 kB/s | 84 kB 00:00 2024-09-10T23:11:11.775 INFO:teuthology.orchestra.run.smithi194.stdout:ceph packages for x86_64 250 kB/s | 84 kB 00:00 2024-09-10T23:11:12.039 INFO:teuthology.orchestra.run.smithi003.stdout:ceph noarch packages 92 kB/s | 24 kB 00:00 2024-09-10T23:11:12.053 INFO:teuthology.orchestra.run.smithi038.stdout:ceph noarch packages 89 kB/s | 24 kB 00:00 2024-09-10T23:11:12.109 INFO:teuthology.orchestra.run.smithi194.stdout:ceph noarch packages 83 kB/s | 24 kB 00:00 2024-09-10T23:11:12.323 INFO:teuthology.orchestra.run.smithi003.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-10T23:11:12.346 INFO:teuthology.orchestra.run.smithi038.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-10T23:11:12.412 INFO:teuthology.orchestra.run.smithi194.stdout:ceph source packages 7.4 kB/s | 1.9 kB 00:00 2024-09-10T23:11:12.846 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.2 MB 00:00 2024-09-10T23:11:12.873 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.2 MB 00:00 2024-09-10T23:11:14.631 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - AppStream 35 MB/s | 20 MB 00:00 2024-09-10T23:11:14.932 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-10T23:11:15.084 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - BaseOS 3.1 MB/s | 8.2 MB 00:02 2024-09-10T23:11:19.555 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - AppStream 6.1 MB/s | 20 MB 00:03 2024-09-10T23:11:19.698 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - CRB 7.3 MB/s | 6.5 MB 00:00 2024-09-10T23:11:21.516 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 19 kB 00:00 2024-09-10T23:11:21.924 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 6.5 MB 00:02 2024-09-10T23:11:22.670 INFO:teuthology.orchestra.run.smithi038.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-10T23:11:23.567 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - Extras packages 72 kB/s | 19 kB 00:00 2024-09-10T23:11:24.327 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - CRB 9.0 MB/s | 6.5 MB 00:00 2024-09-10T23:11:24.879 INFO:teuthology.orchestra.run.smithi003.stdout:Extra Packages for Enterprise Linux 19 MB/s | 23 MB 00:01 2024-09-10T23:11:25.886 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - Extras packages 72 kB/s | 19 kB 00:00 2024-09-10T23:11:26.907 INFO:teuthology.orchestra.run.smithi194.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-10T23:11:29.292 INFO:teuthology.orchestra.run.smithi038.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-10T23:11:31.793 INFO:teuthology.orchestra.run.smithi003.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-10T23:11:31.955 INFO:teuthology.orchestra.run.smithi038.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T23:11:31.956 INFO:teuthology.orchestra.run.smithi038.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T23:11:31.969 INFO:teuthology.orchestra.run.smithi038.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T23:11:31.970 INFO:teuthology.orchestra.run.smithi038.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T23:11:31.971 INFO:teuthology.orchestra.run.smithi038.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T23:11:31.972 INFO:teuthology.orchestra.run.smithi038.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T23:11:31.974 INFO:teuthology.orchestra.run.smithi038.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T23:11:31.977 INFO:teuthology.orchestra.run.smithi038.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T23:11:31.977 INFO:teuthology.orchestra.run.smithi038.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T23:11:32.048 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-10T23:11:32.074 INFO:teuthology.orchestra.run.smithi038.stdout:======================================================================================= 2024-09-10T23:11:32.074 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-09-10T23:11:32.075 INFO:teuthology.orchestra.run.smithi038.stdout:======================================================================================= 2024-09-10T23:11:32.075 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-10T23:11:32.075 INFO:teuthology.orchestra.run.smithi038.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T23:11:32.075 INFO:teuthology.orchestra.run.smithi038.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T23:11:32.075 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T23:11:32.076 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T23:11:32.076 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T23:11:32.076 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T23:11:32.076 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T23:11:32.077 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T23:11:32.077 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T23:11:32.077 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T23:11:32.077 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T23:11:32.078 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T23:11:32.078 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T23:11:32.078 INFO:teuthology.orchestra.run.smithi038.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T23:11:32.079 INFO:teuthology.orchestra.run.smithi038.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T23:11:32.079 INFO:teuthology.orchestra.run.smithi038.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T23:11:32.079 INFO:teuthology.orchestra.run.smithi038.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T23:11:32.079 INFO:teuthology.orchestra.run.smithi038.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T23:11:32.080 INFO:teuthology.orchestra.run.smithi038.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T23:11:32.080 INFO:teuthology.orchestra.run.smithi038.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T23:11:32.080 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T23:11:32.081 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T23:11:32.081 INFO:teuthology.orchestra.run.smithi038.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T23:11:32.081 INFO:teuthology.orchestra.run.smithi038.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T23:11:32.081 INFO:teuthology.orchestra.run.smithi038.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T23:11:32.081 INFO:teuthology.orchestra.run.smithi038.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T23:11:32.081 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T23:11:32.082 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T23:11:32.082 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T23:11:32.082 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T23:11:32.082 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T23:11:32.082 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T23:11:32.082 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T23:11:32.082 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T23:11:32.082 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T23:11:32.082 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T23:11:32.083 INFO:teuthology.orchestra.run.smithi038.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T23:11:32.083 INFO:teuthology.orchestra.run.smithi038.stdout:Upgrading: 2024-09-10T23:11:32.083 INFO:teuthology.orchestra.run.smithi038.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T23:11:32.083 INFO:teuthology.orchestra.run.smithi038.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T23:11:32.083 INFO:teuthology.orchestra.run.smithi038.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T23:11:32.083 INFO:teuthology.orchestra.run.smithi038.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T23:11:32.083 INFO:teuthology.orchestra.run.smithi038.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T23:11:32.083 INFO:teuthology.orchestra.run.smithi038.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T23:11:32.083 INFO:teuthology.orchestra.run.smithi038.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T23:11:32.083 INFO:teuthology.orchestra.run.smithi038.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T23:11:32.083 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-09-10T23:11:32.083 INFO:teuthology.orchestra.run.smithi038.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T23:11:32.083 INFO:teuthology.orchestra.run.smithi038.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T23:11:32.084 INFO:teuthology.orchestra.run.smithi038.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T23:11:32.084 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T23:11:32.084 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T23:11:32.084 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T23:11:32.084 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T23:11:32.084 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T23:11:32.084 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T23:11:32.084 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T23:11:32.084 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T23:11:32.084 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T23:11:32.084 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T23:11:32.084 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T23:11:32.084 INFO:teuthology.orchestra.run.smithi038.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T23:11:32.085 INFO:teuthology.orchestra.run.smithi038.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T23:11:32.085 INFO:teuthology.orchestra.run.smithi038.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T23:11:32.085 INFO:teuthology.orchestra.run.smithi038.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T23:11:32.085 INFO:teuthology.orchestra.run.smithi038.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T23:11:32.085 INFO:teuthology.orchestra.run.smithi038.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T23:11:32.085 INFO:teuthology.orchestra.run.smithi038.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T23:11:32.085 INFO:teuthology.orchestra.run.smithi038.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T23:11:32.085 INFO:teuthology.orchestra.run.smithi038.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T23:11:32.085 INFO:teuthology.orchestra.run.smithi038.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T23:11:32.085 INFO:teuthology.orchestra.run.smithi038.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T23:11:32.085 INFO:teuthology.orchestra.run.smithi038.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T23:11:32.085 INFO:teuthology.orchestra.run.smithi038.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T23:11:32.086 INFO:teuthology.orchestra.run.smithi038.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T23:11:32.086 INFO:teuthology.orchestra.run.smithi038.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T23:11:32.086 INFO:teuthology.orchestra.run.smithi038.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T23:11:32.086 INFO:teuthology.orchestra.run.smithi038.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T23:11:32.086 INFO:teuthology.orchestra.run.smithi038.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T23:11:32.086 INFO:teuthology.orchestra.run.smithi038.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T23:11:32.086 INFO:teuthology.orchestra.run.smithi038.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T23:11:32.086 INFO:teuthology.orchestra.run.smithi038.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T23:11:32.086 INFO:teuthology.orchestra.run.smithi038.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T23:11:32.086 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T23:11:32.086 INFO:teuthology.orchestra.run.smithi038.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T23:11:32.086 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T23:11:32.086 INFO:teuthology.orchestra.run.smithi038.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T23:11:32.086 INFO:teuthology.orchestra.run.smithi038.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T23:11:32.087 INFO:teuthology.orchestra.run.smithi038.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T23:11:32.087 INFO:teuthology.orchestra.run.smithi038.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T23:11:32.087 INFO:teuthology.orchestra.run.smithi038.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T23:11:32.087 INFO:teuthology.orchestra.run.smithi038.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T23:11:32.087 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T23:11:32.087 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T23:11:32.087 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T23:11:32.087 INFO:teuthology.orchestra.run.smithi038.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T23:11:32.087 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T23:11:32.087 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T23:11:32.087 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T23:11:32.087 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T23:11:32.087 INFO:teuthology.orchestra.run.smithi038.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T23:11:32.087 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T23:11:32.088 INFO:teuthology.orchestra.run.smithi038.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T23:11:32.088 INFO:teuthology.orchestra.run.smithi038.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T23:11:32.088 INFO:teuthology.orchestra.run.smithi038.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T23:11:32.088 INFO:teuthology.orchestra.run.smithi038.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T23:11:32.088 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T23:11:32.088 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T23:11:32.088 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T23:11:32.088 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T23:11:32.088 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T23:11:32.088 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T23:11:32.088 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T23:11:32.088 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T23:11:32.088 INFO:teuthology.orchestra.run.smithi038.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T23:11:32.089 INFO:teuthology.orchestra.run.smithi038.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T23:11:32.089 INFO:teuthology.orchestra.run.smithi038.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T23:11:32.089 INFO:teuthology.orchestra.run.smithi038.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T23:11:32.089 INFO:teuthology.orchestra.run.smithi038.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T23:11:32.089 INFO:teuthology.orchestra.run.smithi038.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T23:11:32.089 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T23:11:32.089 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T23:11:32.089 INFO:teuthology.orchestra.run.smithi038.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T23:11:32.089 INFO:teuthology.orchestra.run.smithi038.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T23:11:32.089 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T23:11:32.089 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T23:11:32.089 INFO:teuthology.orchestra.run.smithi038.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T23:11:32.089 INFO:teuthology.orchestra.run.smithi038.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T23:11:32.090 INFO:teuthology.orchestra.run.smithi038.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T23:11:32.090 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T23:11:32.090 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T23:11:32.090 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T23:11:32.090 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T23:11:32.090 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T23:11:32.090 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T23:11:32.090 INFO:teuthology.orchestra.run.smithi038.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T23:11:32.090 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T23:11:32.090 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T23:11:32.090 INFO:teuthology.orchestra.run.smithi038.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T23:11:32.090 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T23:11:32.090 INFO:teuthology.orchestra.run.smithi038.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T23:11:32.090 INFO:teuthology.orchestra.run.smithi038.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T23:11:32.091 INFO:teuthology.orchestra.run.smithi038.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T23:11:32.091 INFO:teuthology.orchestra.run.smithi038.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T23:11:32.091 INFO:teuthology.orchestra.run.smithi038.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T23:11:32.091 INFO:teuthology.orchestra.run.smithi038.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T23:11:32.091 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T23:11:32.091 INFO:teuthology.orchestra.run.smithi038.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T23:11:32.091 INFO:teuthology.orchestra.run.smithi038.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T23:11:32.091 INFO:teuthology.orchestra.run.smithi038.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T23:11:32.091 INFO:teuthology.orchestra.run.smithi038.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T23:11:32.091 INFO:teuthology.orchestra.run.smithi038.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T23:11:32.091 INFO:teuthology.orchestra.run.smithi038.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T23:11:32.091 INFO:teuthology.orchestra.run.smithi038.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T23:11:32.091 INFO:teuthology.orchestra.run.smithi038.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T23:11:32.091 INFO:teuthology.orchestra.run.smithi038.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T23:11:32.091 INFO:teuthology.orchestra.run.smithi038.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T23:11:32.092 INFO:teuthology.orchestra.run.smithi038.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T23:11:32.092 INFO:teuthology.orchestra.run.smithi038.stdout:Installing weak dependencies: 2024-09-10T23:11:32.092 INFO:teuthology.orchestra.run.smithi038.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T23:11:32.092 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T23:11:32.092 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-10T23:11:32.092 INFO:teuthology.orchestra.run.smithi038.stdout:======================================================================================= 2024-09-10T23:11:32.092 INFO:teuthology.orchestra.run.smithi038.stdout:Install 149 Packages 2024-09-10T23:11:32.092 INFO:teuthology.orchestra.run.smithi038.stdout:Upgrade 8 Packages 2024-09-10T23:11:32.092 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T23:11:32.093 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 240 M 2024-09-10T23:11:32.093 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-10T23:11:32.553 INFO:teuthology.orchestra.run.smithi038.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 54 kB/s | 6.6 kB 00:00 2024-09-10T23:11:32.719 INFO:teuthology.orchestra.run.smithi038.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 5.3 MB/s | 900 kB 00:00 2024-09-10T23:11:32.761 INFO:teuthology.orchestra.run.smithi038.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 3.4 MB/s | 145 kB 00:00 2024-09-10T23:11:32.970 INFO:teuthology.orchestra.run.smithi038.stdout:(4/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 11 MB/s | 2.4 MB 00:00 2024-09-10T23:11:33.045 INFO:teuthology.orchestra.run.smithi038.stdout:(5/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 9.0 MB/s | 5.5 MB 00:00 2024-09-10T23:11:33.145 INFO:teuthology.orchestra.run.smithi038.stdout:(6/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 8.7 MB/s | 1.5 MB 00:00 2024-09-10T23:11:33.196 INFO:teuthology.orchestra.run.smithi194.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-10T23:11:33.387 INFO:teuthology.orchestra.run.smithi038.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 14 MB/s | 4.8 MB 00:00 2024-09-10T23:11:33.954 INFO:teuthology.orchestra.run.smithi038.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 14 MB/s | 22 MB 00:01 2024-09-10T23:11:33.996 INFO:teuthology.orchestra.run.smithi038.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 609 kB/s | 25 kB 00:00 2024-09-10T23:11:34.205 INFO:teuthology.orchestra.run.smithi038.stdout:(10/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 13 MB/s | 11 MB 00:00 2024-09-10T23:11:34.255 INFO:teuthology.orchestra.run.smithi038.stdout:(11/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 4.4 MB/s | 225 kB 00:00 2024-09-10T23:11:34.339 INFO:teuthology.orchestra.run.smithi003.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T23:11:34.340 INFO:teuthology.orchestra.run.smithi003.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T23:11:34.352 INFO:teuthology.orchestra.run.smithi003.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T23:11:34.353 INFO:teuthology.orchestra.run.smithi003.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T23:11:34.354 INFO:teuthology.orchestra.run.smithi003.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T23:11:34.355 INFO:teuthology.orchestra.run.smithi003.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T23:11:34.357 INFO:teuthology.orchestra.run.smithi003.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T23:11:34.359 INFO:teuthology.orchestra.run.smithi003.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T23:11:34.360 INFO:teuthology.orchestra.run.smithi003.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T23:11:34.430 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-10T23:11:34.447 INFO:teuthology.orchestra.run.smithi038.stdout:(12/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 13 MB/s | 17 MB 00:01 2024-09-10T23:11:34.449 INFO:teuthology.orchestra.run.smithi003.stdout:======================================================================================= 2024-09-10T23:11:34.449 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2024-09-10T23:11:34.449 INFO:teuthology.orchestra.run.smithi003.stdout:======================================================================================= 2024-09-10T23:11:34.449 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-10T23:11:34.449 INFO:teuthology.orchestra.run.smithi003.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T23:11:34.449 INFO:teuthology.orchestra.run.smithi003.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T23:11:34.449 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T23:11:34.450 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T23:11:34.450 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T23:11:34.450 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T23:11:34.450 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T23:11:34.450 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T23:11:34.450 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T23:11:34.450 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T23:11:34.450 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T23:11:34.450 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T23:11:34.450 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T23:11:34.450 INFO:teuthology.orchestra.run.smithi003.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T23:11:34.450 INFO:teuthology.orchestra.run.smithi003.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T23:11:34.450 INFO:teuthology.orchestra.run.smithi003.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T23:11:34.450 INFO:teuthology.orchestra.run.smithi003.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T23:11:34.451 INFO:teuthology.orchestra.run.smithi003.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T23:11:34.451 INFO:teuthology.orchestra.run.smithi003.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T23:11:34.451 INFO:teuthology.orchestra.run.smithi003.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T23:11:34.451 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T23:11:34.451 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T23:11:34.451 INFO:teuthology.orchestra.run.smithi003.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T23:11:34.451 INFO:teuthology.orchestra.run.smithi003.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T23:11:34.451 INFO:teuthology.orchestra.run.smithi003.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T23:11:34.451 INFO:teuthology.orchestra.run.smithi003.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T23:11:34.451 INFO:teuthology.orchestra.run.smithi003.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T23:11:34.451 INFO:teuthology.orchestra.run.smithi003.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T23:11:34.451 INFO:teuthology.orchestra.run.smithi003.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T23:11:34.452 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T23:11:34.452 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T23:11:34.452 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T23:11:34.452 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T23:11:34.452 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T23:11:34.452 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T23:11:34.452 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T23:11:34.452 INFO:teuthology.orchestra.run.smithi003.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T23:11:34.452 INFO:teuthology.orchestra.run.smithi003.stdout:Upgrading: 2024-09-10T23:11:34.452 INFO:teuthology.orchestra.run.smithi003.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T23:11:34.452 INFO:teuthology.orchestra.run.smithi003.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T23:11:34.452 INFO:teuthology.orchestra.run.smithi003.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T23:11:34.453 INFO:teuthology.orchestra.run.smithi003.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T23:11:34.453 INFO:teuthology.orchestra.run.smithi003.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T23:11:34.453 INFO:teuthology.orchestra.run.smithi003.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T23:11:34.453 INFO:teuthology.orchestra.run.smithi003.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T23:11:34.453 INFO:teuthology.orchestra.run.smithi003.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T23:11:34.453 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2024-09-10T23:11:34.453 INFO:teuthology.orchestra.run.smithi003.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T23:11:34.453 INFO:teuthology.orchestra.run.smithi003.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T23:11:34.453 INFO:teuthology.orchestra.run.smithi003.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T23:11:34.453 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T23:11:34.453 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T23:11:34.454 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T23:11:34.454 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T23:11:34.454 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T23:11:34.454 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T23:11:34.454 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T23:11:34.454 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T23:11:34.454 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T23:11:34.454 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T23:11:34.454 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T23:11:34.454 INFO:teuthology.orchestra.run.smithi003.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T23:11:34.454 INFO:teuthology.orchestra.run.smithi003.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T23:11:34.455 INFO:teuthology.orchestra.run.smithi003.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T23:11:34.455 INFO:teuthology.orchestra.run.smithi003.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T23:11:34.455 INFO:teuthology.orchestra.run.smithi003.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T23:11:34.455 INFO:teuthology.orchestra.run.smithi003.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T23:11:34.455 INFO:teuthology.orchestra.run.smithi003.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T23:11:34.455 INFO:teuthology.orchestra.run.smithi003.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T23:11:34.456 INFO:teuthology.orchestra.run.smithi003.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T23:11:34.456 INFO:teuthology.orchestra.run.smithi003.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T23:11:34.456 INFO:teuthology.orchestra.run.smithi003.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T23:11:34.456 INFO:teuthology.orchestra.run.smithi003.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T23:11:34.456 INFO:teuthology.orchestra.run.smithi003.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T23:11:34.456 INFO:teuthology.orchestra.run.smithi003.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T23:11:34.456 INFO:teuthology.orchestra.run.smithi003.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T23:11:34.456 INFO:teuthology.orchestra.run.smithi003.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T23:11:34.457 INFO:teuthology.orchestra.run.smithi003.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T23:11:34.457 INFO:teuthology.orchestra.run.smithi003.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T23:11:34.457 INFO:teuthology.orchestra.run.smithi003.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T23:11:34.457 INFO:teuthology.orchestra.run.smithi003.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T23:11:34.457 INFO:teuthology.orchestra.run.smithi003.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T23:11:34.457 INFO:teuthology.orchestra.run.smithi003.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T23:11:34.457 INFO:teuthology.orchestra.run.smithi003.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T23:11:34.458 INFO:teuthology.orchestra.run.smithi003.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T23:11:34.458 INFO:teuthology.orchestra.run.smithi003.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T23:11:34.458 INFO:teuthology.orchestra.run.smithi003.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T23:11:34.458 INFO:teuthology.orchestra.run.smithi003.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T23:11:34.458 INFO:teuthology.orchestra.run.smithi003.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T23:11:34.458 INFO:teuthology.orchestra.run.smithi003.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T23:11:34.458 INFO:teuthology.orchestra.run.smithi003.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T23:11:34.459 INFO:teuthology.orchestra.run.smithi003.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T23:11:34.459 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T23:11:34.459 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T23:11:34.459 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T23:11:34.459 INFO:teuthology.orchestra.run.smithi003.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T23:11:34.459 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T23:11:34.459 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T23:11:34.459 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T23:11:34.459 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T23:11:34.459 INFO:teuthology.orchestra.run.smithi003.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T23:11:34.460 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T23:11:34.460 INFO:teuthology.orchestra.run.smithi003.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T23:11:34.460 INFO:teuthology.orchestra.run.smithi003.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T23:11:34.460 INFO:teuthology.orchestra.run.smithi003.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T23:11:34.460 INFO:teuthology.orchestra.run.smithi003.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T23:11:34.460 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T23:11:34.460 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T23:11:34.460 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T23:11:34.460 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T23:11:34.460 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T23:11:34.461 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T23:11:34.461 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T23:11:34.461 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T23:11:34.461 INFO:teuthology.orchestra.run.smithi003.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T23:11:34.461 INFO:teuthology.orchestra.run.smithi003.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T23:11:34.461 INFO:teuthology.orchestra.run.smithi003.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T23:11:34.461 INFO:teuthology.orchestra.run.smithi003.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T23:11:34.461 INFO:teuthology.orchestra.run.smithi003.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T23:11:34.461 INFO:teuthology.orchestra.run.smithi003.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T23:11:34.461 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T23:11:34.462 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T23:11:34.462 INFO:teuthology.orchestra.run.smithi003.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T23:11:34.462 INFO:teuthology.orchestra.run.smithi003.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T23:11:34.462 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T23:11:34.462 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T23:11:34.462 INFO:teuthology.orchestra.run.smithi003.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T23:11:34.462 INFO:teuthology.orchestra.run.smithi003.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T23:11:34.462 INFO:teuthology.orchestra.run.smithi003.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T23:11:34.462 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T23:11:34.463 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T23:11:34.463 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T23:11:34.463 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T23:11:34.463 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T23:11:34.463 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T23:11:34.463 INFO:teuthology.orchestra.run.smithi003.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T23:11:34.463 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T23:11:34.463 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T23:11:34.464 INFO:teuthology.orchestra.run.smithi003.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T23:11:34.464 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T23:11:34.464 INFO:teuthology.orchestra.run.smithi003.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T23:11:34.464 INFO:teuthology.orchestra.run.smithi003.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T23:11:34.464 INFO:teuthology.orchestra.run.smithi003.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T23:11:34.464 INFO:teuthology.orchestra.run.smithi003.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T23:11:34.464 INFO:teuthology.orchestra.run.smithi003.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T23:11:34.464 INFO:teuthology.orchestra.run.smithi003.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T23:11:34.465 INFO:teuthology.orchestra.run.smithi003.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T23:11:34.465 INFO:teuthology.orchestra.run.smithi003.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T23:11:34.465 INFO:teuthology.orchestra.run.smithi003.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T23:11:34.465 INFO:teuthology.orchestra.run.smithi003.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T23:11:34.465 INFO:teuthology.orchestra.run.smithi003.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T23:11:34.465 INFO:teuthology.orchestra.run.smithi003.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T23:11:34.465 INFO:teuthology.orchestra.run.smithi003.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T23:11:34.465 INFO:teuthology.orchestra.run.smithi003.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T23:11:34.465 INFO:teuthology.orchestra.run.smithi003.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T23:11:34.465 INFO:teuthology.orchestra.run.smithi003.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T23:11:34.465 INFO:teuthology.orchestra.run.smithi003.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T23:11:34.466 INFO:teuthology.orchestra.run.smithi003.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T23:11:34.466 INFO:teuthology.orchestra.run.smithi003.stdout:Installing weak dependencies: 2024-09-10T23:11:34.466 INFO:teuthology.orchestra.run.smithi003.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T23:11:34.466 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:11:34.466 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-10T23:11:34.466 INFO:teuthology.orchestra.run.smithi003.stdout:======================================================================================= 2024-09-10T23:11:34.466 INFO:teuthology.orchestra.run.smithi003.stdout:Install 149 Packages 2024-09-10T23:11:34.466 INFO:teuthology.orchestra.run.smithi003.stdout:Upgrade 8 Packages 2024-09-10T23:11:34.466 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:11:34.467 INFO:teuthology.orchestra.run.smithi038.stdout:(13/157): cephfs-shell-19.3.0-4854.g8f219c47.el 130 kB/s | 27 kB 00:00 2024-09-10T23:11:34.467 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 240 M 2024-09-10T23:11:34.467 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-10T23:11:34.481 INFO:teuthology.orchestra.run.smithi038.stdout:(14/157): libcephfs-devel-19.3.0-4854.g8f219c47 961 kB/s | 32 kB 00:00 2024-09-10T23:11:34.523 INFO:teuthology.orchestra.run.smithi038.stdout:(15/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 13 MB/s | 755 kB 00:00 2024-09-10T23:11:34.548 INFO:teuthology.orchestra.run.smithi038.stdout:(16/157): libcephsqlite-19.3.0-4854.g8f219c47.e 2.4 MB/s | 162 kB 00:00 2024-09-10T23:11:34.573 INFO:teuthology.orchestra.run.smithi038.stdout:(17/157): librados-devel-19.3.0-4854.g8f219c47. 2.5 MB/s | 127 kB 00:00 2024-09-10T23:11:34.607 INFO:teuthology.orchestra.run.smithi038.stdout:(18/157): libradosstriper1-19.3.0-4854.g8f219c4 8.5 MB/s | 507 kB 00:00 2024-09-10T23:11:34.665 INFO:teuthology.orchestra.run.smithi038.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 777 kB/s | 45 kB 00:00 2024-09-10T23:11:34.741 INFO:teuthology.orchestra.run.smithi038.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 1.9 MB/s | 143 kB 00:00 2024-09-10T23:11:34.858 INFO:teuthology.orchestra.run.smithi038.stdout:(21/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 19 MB/s | 5.5 MB 00:00 2024-09-10T23:11:34.883 INFO:teuthology.orchestra.run.smithi038.stdout:(22/157): python3-cephfs-19.3.0-4854.g8f219c47. 1.1 MB/s | 161 kB 00:00 2024-09-10T23:11:34.895 INFO:teuthology.orchestra.run.smithi003.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 34 kB/s | 6.6 kB 00:00 2024-09-10T23:11:34.917 INFO:teuthology.orchestra.run.smithi038.stdout:(23/157): python3-rados-19.3.0-4854.g8f219c47.e 5.4 MB/s | 321 kB 00:00 2024-09-10T23:11:34.950 INFO:teuthology.orchestra.run.smithi038.stdout:(24/157): python3-rbd-19.3.0-4854.g8f219c47.el9 4.5 MB/s | 306 kB 00:00 2024-09-10T23:11:34.984 INFO:teuthology.orchestra.run.smithi038.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.5 MB/s | 99 kB 00:00 2024-09-10T23:11:35.009 INFO:teuthology.orchestra.run.smithi038.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.4 MB/s | 85 kB 00:00 2024-09-10T23:11:35.085 INFO:teuthology.orchestra.run.smithi038.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 2.2 MB/s | 171 kB 00:00 2024-09-10T23:11:35.136 INFO:teuthology.orchestra.run.smithi003.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 3.6 MB/s | 900 kB 00:00 2024-09-10T23:11:35.160 INFO:teuthology.orchestra.run.smithi038.stdout:(28/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 18 MB/s | 3.2 MB 00:00 2024-09-10T23:11:35.185 INFO:teuthology.orchestra.run.smithi038.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4854.g 343 kB/s | 34 kB 00:00 2024-09-10T23:11:35.203 INFO:teuthology.orchestra.run.smithi003.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 2.1 MB/s | 145 kB 00:00 2024-09-10T23:11:35.219 INFO:teuthology.orchestra.run.smithi038.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 2.6 MB/s | 154 kB 00:00 2024-09-10T23:11:35.667 INFO:teuthology.orchestra.run.smithi194.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T23:11:35.668 INFO:teuthology.orchestra.run.smithi194.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T23:11:35.679 INFO:teuthology.orchestra.run.smithi194.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T23:11:35.680 INFO:teuthology.orchestra.run.smithi194.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T23:11:35.681 INFO:teuthology.orchestra.run.smithi194.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T23:11:35.682 INFO:teuthology.orchestra.run.smithi194.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T23:11:35.684 INFO:teuthology.orchestra.run.smithi194.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T23:11:35.686 INFO:teuthology.orchestra.run.smithi194.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T23:11:35.687 INFO:teuthology.orchestra.run.smithi194.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T23:11:35.752 INFO:teuthology.orchestra.run.smithi038.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 14 MB/s | 7.4 MB 00:00 2024-09-10T23:11:35.753 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-10T23:11:35.775 INFO:teuthology.orchestra.run.smithi194.stdout:======================================================================================= 2024-09-10T23:11:35.775 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-09-10T23:11:35.775 INFO:teuthology.orchestra.run.smithi194.stdout:======================================================================================= 2024-09-10T23:11:35.776 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-10T23:11:35.776 INFO:teuthology.orchestra.run.smithi194.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T23:11:35.776 INFO:teuthology.orchestra.run.smithi194.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T23:11:35.776 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T23:11:35.776 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T23:11:35.776 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T23:11:35.776 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T23:11:35.776 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T23:11:35.776 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T23:11:35.776 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T23:11:35.776 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T23:11:35.776 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T23:11:35.776 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T23:11:35.777 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T23:11:35.777 INFO:teuthology.orchestra.run.smithi194.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T23:11:35.777 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T23:11:35.777 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T23:11:35.777 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T23:11:35.777 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T23:11:35.777 INFO:teuthology.orchestra.run.smithi194.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T23:11:35.777 INFO:teuthology.orchestra.run.smithi194.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T23:11:35.777 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T23:11:35.777 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T23:11:35.777 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T23:11:35.777 INFO:teuthology.orchestra.run.smithi194.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T23:11:35.777 INFO:teuthology.orchestra.run.smithi194.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T23:11:35.777 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T23:11:35.778 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T23:11:35.778 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T23:11:35.778 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T23:11:35.778 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T23:11:35.778 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T23:11:35.778 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T23:11:35.778 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T23:11:35.778 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T23:11:35.778 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T23:11:35.778 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T23:11:35.778 INFO:teuthology.orchestra.run.smithi194.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T23:11:35.778 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrading: 2024-09-10T23:11:35.778 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T23:11:35.778 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T23:11:35.779 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T23:11:35.779 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T23:11:35.779 INFO:teuthology.orchestra.run.smithi194.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T23:11:35.779 INFO:teuthology.orchestra.run.smithi194.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T23:11:35.779 INFO:teuthology.orchestra.run.smithi194.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T23:11:35.779 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T23:11:35.779 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-09-10T23:11:35.779 INFO:teuthology.orchestra.run.smithi194.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T23:11:35.779 INFO:teuthology.orchestra.run.smithi194.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T23:11:35.779 INFO:teuthology.orchestra.run.smithi194.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T23:11:35.779 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T23:11:35.779 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T23:11:35.779 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T23:11:35.780 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T23:11:35.780 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T23:11:35.780 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T23:11:35.780 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T23:11:35.780 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T23:11:35.780 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T23:11:35.780 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T23:11:35.780 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T23:11:35.780 INFO:teuthology.orchestra.run.smithi194.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T23:11:35.780 INFO:teuthology.orchestra.run.smithi194.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T23:11:35.780 INFO:teuthology.orchestra.run.smithi194.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T23:11:35.780 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T23:11:35.780 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T23:11:35.781 INFO:teuthology.orchestra.run.smithi194.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T23:11:35.781 INFO:teuthology.orchestra.run.smithi194.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T23:11:35.781 INFO:teuthology.orchestra.run.smithi194.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T23:11:35.781 INFO:teuthology.orchestra.run.smithi194.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T23:11:35.781 INFO:teuthology.orchestra.run.smithi194.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T23:11:35.781 INFO:teuthology.orchestra.run.smithi194.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T23:11:35.781 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T23:11:35.781 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T23:11:35.781 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T23:11:35.781 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T23:11:35.781 INFO:teuthology.orchestra.run.smithi194.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T23:11:35.781 INFO:teuthology.orchestra.run.smithi194.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T23:11:35.781 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T23:11:35.781 INFO:teuthology.orchestra.run.smithi194.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T23:11:35.782 INFO:teuthology.orchestra.run.smithi194.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T23:11:35.782 INFO:teuthology.orchestra.run.smithi194.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T23:11:35.782 INFO:teuthology.orchestra.run.smithi194.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T23:11:35.782 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T23:11:35.782 INFO:teuthology.orchestra.run.smithi194.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T23:11:35.782 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T23:11:35.782 INFO:teuthology.orchestra.run.smithi194.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T23:11:35.782 INFO:teuthology.orchestra.run.smithi194.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T23:11:35.782 INFO:teuthology.orchestra.run.smithi194.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T23:11:35.782 INFO:teuthology.orchestra.run.smithi194.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T23:11:35.782 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T23:11:35.782 INFO:teuthology.orchestra.run.smithi194.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T23:11:35.782 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T23:11:35.782 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T23:11:35.783 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T23:11:35.783 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T23:11:35.783 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T23:11:35.783 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T23:11:35.783 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T23:11:35.783 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T23:11:35.783 INFO:teuthology.orchestra.run.smithi194.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T23:11:35.783 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T23:11:35.783 INFO:teuthology.orchestra.run.smithi194.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T23:11:35.783 INFO:teuthology.orchestra.run.smithi194.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T23:11:35.783 INFO:teuthology.orchestra.run.smithi194.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T23:11:35.783 INFO:teuthology.orchestra.run.smithi194.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T23:11:35.783 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T23:11:35.784 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T23:11:35.784 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T23:11:35.784 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T23:11:35.784 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T23:11:35.784 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T23:11:35.784 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T23:11:35.784 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T23:11:35.784 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T23:11:35.784 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T23:11:35.784 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T23:11:35.784 INFO:teuthology.orchestra.run.smithi194.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T23:11:35.784 INFO:teuthology.orchestra.run.smithi194.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T23:11:35.784 INFO:teuthology.orchestra.run.smithi194.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T23:11:35.785 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T23:11:35.785 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T23:11:35.785 INFO:teuthology.orchestra.run.smithi194.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T23:11:35.785 INFO:teuthology.orchestra.run.smithi194.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T23:11:35.785 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T23:11:35.785 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T23:11:35.785 INFO:teuthology.orchestra.run.smithi194.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T23:11:35.785 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T23:11:35.785 INFO:teuthology.orchestra.run.smithi194.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T23:11:35.786 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T23:11:35.786 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T23:11:35.786 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T23:11:35.786 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T23:11:35.786 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T23:11:35.786 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T23:11:35.786 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T23:11:35.786 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T23:11:35.786 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T23:11:35.786 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T23:11:35.786 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T23:11:35.786 INFO:teuthology.orchestra.run.smithi194.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T23:11:35.786 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T23:11:35.787 INFO:teuthology.orchestra.run.smithi194.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T23:11:35.787 INFO:teuthology.orchestra.run.smithi194.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T23:11:35.787 INFO:teuthology.orchestra.run.smithi194.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T23:11:35.787 INFO:teuthology.orchestra.run.smithi194.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T23:11:35.787 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T23:11:35.787 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T23:11:35.787 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T23:11:35.787 INFO:teuthology.orchestra.run.smithi194.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T23:11:35.787 INFO:teuthology.orchestra.run.smithi194.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T23:11:35.787 INFO:teuthology.orchestra.run.smithi194.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T23:11:35.787 INFO:teuthology.orchestra.run.smithi194.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T23:11:35.787 INFO:teuthology.orchestra.run.smithi194.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T23:11:35.787 INFO:teuthology.orchestra.run.smithi194.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T23:11:35.788 INFO:teuthology.orchestra.run.smithi194.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T23:11:35.788 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T23:11:35.788 INFO:teuthology.orchestra.run.smithi194.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T23:11:35.788 INFO:teuthology.orchestra.run.smithi194.stdout:Installing weak dependencies: 2024-09-10T23:11:35.788 INFO:teuthology.orchestra.run.smithi194.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T23:11:35.788 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-10T23:11:35.788 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-10T23:11:35.788 INFO:teuthology.orchestra.run.smithi194.stdout:======================================================================================= 2024-09-10T23:11:35.788 INFO:teuthology.orchestra.run.smithi194.stdout:Install 149 Packages 2024-09-10T23:11:35.788 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrade 8 Packages 2024-09-10T23:11:35.788 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-10T23:11:35.789 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 240 M 2024-09-10T23:11:35.789 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-10T23:11:35.819 INFO:teuthology.orchestra.run.smithi038.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 4.3 MB/s | 291 kB 00:00 2024-09-10T23:11:35.837 INFO:teuthology.orchestra.run.smithi003.stdout:(4/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 4.9 MB/s | 5.5 MB 00:01 2024-09-10T23:11:35.887 INFO:teuthology.orchestra.run.smithi038.stdout:(33/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 739 kB/s | 49 kB 00:00 2024-09-10T23:11:35.887 INFO:teuthology.orchestra.run.smithi003.stdout:(5/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 3.5 MB/s | 2.4 MB 00:00 2024-09-10T23:11:35.961 INFO:teuthology.orchestra.run.smithi038.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4854.g8 220 kB/s | 16 kB 00:00 2024-09-10T23:11:36.045 INFO:teuthology.orchestra.run.smithi038.stdout:(35/157): ceph-volume-19.3.0-4854.g8f219c47.el9 3.3 MB/s | 285 kB 00:00 2024-09-10T23:11:36.121 INFO:teuthology.orchestra.run.smithi003.stdout:(6/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 5.4 MB/s | 1.5 MB 00:00 2024-09-10T23:11:36.146 INFO:teuthology.orchestra.run.smithi038.stdout:(36/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 7.7 MB/s | 783 kB 00:00 2024-09-10T23:11:36.321 INFO:teuthology.orchestra.run.smithi038.stdout:(37/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 12 MB/s | 14 MB 00:01 2024-09-10T23:11:36.346 INFO:teuthology.orchestra.run.smithi038.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 91 kB/s | 18 kB 00:00 2024-09-10T23:11:36.654 INFO:teuthology.orchestra.run.smithi003.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 6.2 MB/s | 4.8 MB 00:00 2024-09-10T23:11:37.130 INFO:teuthology.orchestra.run.smithi038.stdout:(39/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 16 MB/s | 50 MB 00:03 2024-09-10T23:11:37.447 INFO:teuthology.orchestra.run.smithi194.stdout:(1/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 4.1 MB/s | 5.5 MB 00:01 2024-09-10T23:11:37.497 INFO:teuthology.orchestra.run.smithi038.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 68 kB/s | 80 kB 00:01 2024-09-10T23:11:37.556 INFO:teuthology.orchestra.run.smithi194.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 8.1 MB/s | 900 kB 00:00 2024-09-10T23:11:37.606 INFO:teuthology.orchestra.run.smithi194.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 2.8 MB/s | 145 kB 00:00 2024-09-10T23:11:37.696 INFO:teuthology.orchestra.run.smithi003.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 7.3 MB/s | 22 MB 00:02 2024-09-10T23:11:37.763 INFO:teuthology.orchestra.run.smithi003.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 379 kB/s | 25 kB 00:00 2024-09-10T23:11:37.772 INFO:teuthology.orchestra.run.smithi038.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 562 kB/s | 801 kB 00:01 2024-09-10T23:11:37.873 INFO:teuthology.orchestra.run.smithi194.stdout:(4/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 8.9 MB/s | 2.4 MB 00:00 2024-09-10T23:11:37.906 INFO:teuthology.orchestra.run.smithi038.stdout:(42/157): libquadmath-11.5.0-2.el9.x86_64.rpm 247 kB/s | 191 kB 00:00 2024-09-10T23:11:37.955 INFO:teuthology.orchestra.run.smithi003.stdout:(10/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 9.4 MB/s | 17 MB 00:01 2024-09-10T23:11:38.023 INFO:teuthology.orchestra.run.smithi194.stdout:(5/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 10 MB/s | 1.5 MB 00:00 2024-09-10T23:11:38.122 INFO:teuthology.orchestra.run.smithi003.stdout:(11/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 7.5 MB/s | 11 MB 00:01 2024-09-10T23:11:38.147 INFO:teuthology.orchestra.run.smithi003.stdout:(12/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 1.1 MB/s | 225 kB 00:00 2024-09-10T23:11:38.197 INFO:teuthology.orchestra.run.smithi003.stdout:(13/157): cephfs-shell-19.3.0-4854.g8f219c47.el 360 kB/s | 27 kB 00:00 2024-09-10T23:11:38.231 INFO:teuthology.orchestra.run.smithi003.stdout:(14/157): libcephfs-devel-19.3.0-4854.g8f219c47 380 kB/s | 32 kB 00:00 2024-09-10T23:11:38.331 INFO:teuthology.orchestra.run.smithi038.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 304 kB/s | 253 kB 00:00 2024-09-10T23:11:38.406 INFO:teuthology.orchestra.run.smithi003.stdout:(15/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 3.5 MB/s | 755 kB 00:00 2024-09-10T23:11:38.456 INFO:teuthology.orchestra.run.smithi003.stdout:(16/157): librados-devel-19.3.0-4854.g8f219c47. 2.5 MB/s | 127 kB 00:00 2024-09-10T23:11:38.531 INFO:teuthology.orchestra.run.smithi003.stdout:(17/157): libradosstriper1-19.3.0-4854.g8f219c4 6.6 MB/s | 507 kB 00:00 2024-09-10T23:11:38.564 INFO:teuthology.orchestra.run.smithi038.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 162 kB/s | 106 kB 00:00 2024-09-10T23:11:38.590 INFO:teuthology.orchestra.run.smithi194.stdout:(6/157): ceph-common-19.3.0-4854.g8f219c47.el9. 8.7 MB/s | 22 MB 00:02 2024-09-10T23:11:38.607 INFO:teuthology.orchestra.run.smithi003.stdout:(18/157): libcephsqlite-19.3.0-4854.g8f219c47.e 430 kB/s | 162 kB 00:00 2024-09-10T23:11:38.649 INFO:teuthology.orchestra.run.smithi003.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 1.1 MB/s | 45 kB 00:00 2024-09-10T23:11:38.674 INFO:teuthology.orchestra.run.smithi194.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 7.4 MB/s | 4.8 MB 00:00 2024-09-10T23:11:38.698 INFO:teuthology.orchestra.run.smithi038.stdout:(45/157): python3-cryptography-36.0.1-4.el9.x86 1.3 MB/s | 1.2 MB 00:00 2024-09-10T23:11:38.699 INFO:teuthology.orchestra.run.smithi003.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 2.8 MB/s | 143 kB 00:00 2024-09-10T23:11:38.766 INFO:teuthology.orchestra.run.smithi003.stdout:(21/157): python3-cephfs-19.3.0-4854.g8f219c47. 2.4 MB/s | 161 kB 00:00 2024-09-10T23:11:38.875 INFO:teuthology.orchestra.run.smithi003.stdout:(22/157): python3-rados-19.3.0-4854.g8f219c47.e 2.9 MB/s | 321 kB 00:00 2024-09-10T23:11:38.975 INFO:teuthology.orchestra.run.smithi003.stdout:(23/157): python3-rbd-19.3.0-4854.g8f219c47.el9 3.0 MB/s | 306 kB 00:00 2024-09-10T23:11:39.042 INFO:teuthology.orchestra.run.smithi003.stdout:(24/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.5 MB/s | 99 kB 00:00 2024-09-10T23:11:39.057 INFO:teuthology.orchestra.run.smithi038.stdout:(46/157): python3-pycparser-2.20-6.el9.noarch.r 186 kB/s | 135 kB 00:00 2024-09-10T23:11:39.109 INFO:teuthology.orchestra.run.smithi003.stdout:(25/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.3 MB/s | 85 kB 00:00 2024-09-10T23:11:39.192 INFO:teuthology.orchestra.run.smithi003.stdout:(26/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 8.4 MB/s | 5.5 MB 00:00 2024-09-10T23:11:39.259 INFO:teuthology.orchestra.run.smithi003.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 2.5 MB/s | 171 kB 00:00 2024-09-10T23:11:39.290 INFO:teuthology.orchestra.run.smithi038.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 175 kB/s | 125 kB 00:00 2024-09-10T23:11:39.318 INFO:teuthology.orchestra.run.smithi003.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4854.g 589 kB/s | 34 kB 00:00 2024-09-10T23:11:39.382 INFO:teuthology.orchestra.run.smithi194.stdout:(8/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 2.0 kB/s | 6.6 kB 00:03 2024-09-10T23:11:39.385 INFO:teuthology.orchestra.run.smithi003.stdout:(29/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 2.3 MB/s | 154 kB 00:00 2024-09-10T23:11:39.499 INFO:teuthology.orchestra.run.smithi038.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 268 kB/s | 215 kB 00:00 2024-09-10T23:11:39.549 INFO:teuthology.orchestra.run.smithi194.stdout:(9/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x86 18 MB/s | 17 MB 00:00 2024-09-10T23:11:39.574 INFO:teuthology.orchestra.run.smithi194.stdout:(10/157): ceph-selinux-19.3.0-4854.g8f219c47.el 131 kB/s | 25 kB 00:00 2024-09-10T23:11:39.594 INFO:teuthology.orchestra.run.smithi003.stdout:(30/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 6.6 MB/s | 3.2 MB 00:00 2024-09-10T23:11:39.708 INFO:teuthology.orchestra.run.smithi194.stdout:(11/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 11 MB/s | 11 MB 00:01 2024-09-10T23:11:39.767 INFO:teuthology.orchestra.run.smithi194.stdout:(12/157): cephfs-shell-19.3.0-4854.g8f219c47.el 465 kB/s | 27 kB 00:00 2024-09-10T23:11:39.825 INFO:teuthology.orchestra.run.smithi194.stdout:(13/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 898 kB/s | 225 kB 00:00 2024-09-10T23:11:39.851 INFO:teuthology.orchestra.run.smithi194.stdout:(14/157): libcephfs-devel-19.3.0-4854.g8f219c47 381 kB/s | 32 kB 00:00 2024-09-10T23:11:39.891 INFO:teuthology.orchestra.run.smithi038.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 826 kB/s | 689 kB 00:00 2024-09-10T23:11:39.918 INFO:teuthology.orchestra.run.smithi194.stdout:(15/157): libcephsqlite-19.3.0-4854.g8f219c47.e 2.4 MB/s | 162 kB 00:00 2024-09-10T23:11:39.958 INFO:teuthology.orchestra.run.smithi038.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 233 kB/s | 107 kB 00:00 2024-09-10T23:11:39.976 INFO:teuthology.orchestra.run.smithi194.stdout:(16/157): librados-devel-19.3.0-4854.g8f219c47. 2.1 MB/s | 127 kB 00:00 2024-09-10T23:11:40.000 INFO:teuthology.orchestra.run.smithi038.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 200 kB/s | 22 kB 00:00 2024-09-10T23:11:40.093 INFO:teuthology.orchestra.run.smithi194.stdout:(17/157): libradosstriper1-19.3.0-4854.g8f219c4 4.3 MB/s | 507 kB 00:00 2024-09-10T23:11:40.108 INFO:teuthology.orchestra.run.smithi038.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 1.1 MB/s | 943 kB 00:00 2024-09-10T23:11:40.134 INFO:teuthology.orchestra.run.smithi038.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 245 kB/s | 33 kB 00:00 2024-09-10T23:11:40.152 INFO:teuthology.orchestra.run.smithi194.stdout:(18/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 2.3 MB/s | 755 kB 00:00 2024-09-10T23:11:40.218 INFO:teuthology.orchestra.run.smithi194.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 680 kB/s | 45 kB 00:00 2024-09-10T23:11:40.251 INFO:teuthology.orchestra.run.smithi038.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 1.0 MB/s | 313 kB 00:00 2024-09-10T23:11:40.276 INFO:teuthology.orchestra.run.smithi038.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 128 kB/s | 18 kB 00:00 2024-09-10T23:11:40.335 INFO:teuthology.orchestra.run.smithi194.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 1.2 MB/s | 143 kB 00:00 2024-09-10T23:11:40.359 INFO:teuthology.orchestra.run.smithi038.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 103 kB/s | 11 kB 00:00 2024-09-10T23:11:40.393 INFO:teuthology.orchestra.run.smithi038.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.4 MB/s | 171 kB 00:00 2024-09-10T23:11:40.452 INFO:teuthology.orchestra.run.smithi194.stdout:(21/157): python3-cephfs-19.3.0-4854.g8f219c47. 1.4 MB/s | 161 kB 00:00 2024-09-10T23:11:40.468 INFO:teuthology.orchestra.run.smithi038.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-09-10T23:11:40.519 INFO:teuthology.orchestra.run.smithi038.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 361 kB/s | 45 kB 00:00 2024-09-10T23:11:40.636 INFO:teuthology.orchestra.run.smithi038.stdout:(60/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.7 MB/s | 3.0 MB 00:00 2024-09-10T23:11:40.636 INFO:teuthology.orchestra.run.smithi194.stdout:(22/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 10 MB/s | 5.5 MB 00:00 2024-09-10T23:11:40.666 INFO:teuthology.orchestra.run.smithi194.stdout:(23/157): python3-rados-19.3.0-4854.g8f219c47.e 1.5 MB/s | 321 kB 00:00 2024-09-10T23:11:40.710 INFO:teuthology.orchestra.run.smithi003.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 6.6 MB/s | 7.4 MB 00:01 2024-09-10T23:11:40.717 INFO:teuthology.orchestra.run.smithi194.stdout:(24/157): python3-rbd-19.3.0-4854.g8f219c47.el9 3.7 MB/s | 306 kB 00:00 2024-09-10T23:11:40.745 INFO:teuthology.orchestra.run.smithi194.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.2 MB/s | 99 kB 00:00 2024-09-10T23:11:40.753 INFO:teuthology.orchestra.run.smithi038.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 210 kB/s | 24 kB 00:00 2024-09-10T23:11:40.770 INFO:teuthology.orchestra.run.smithi194.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.6 MB/s | 85 kB 00:00 2024-09-10T23:11:40.786 INFO:teuthology.orchestra.run.smithi038.stdout:(62/157): librdkafka-1.6.1-102.el9.x86_64.rpm 2.0 MB/s | 662 kB 00:00 2024-09-10T23:11:40.812 INFO:teuthology.orchestra.run.smithi038.stdout:(63/157): libtool-2.4.6-46.el9.x86_64.rpm 1.9 MB/s | 581 kB 00:00 2024-09-10T23:11:40.821 INFO:teuthology.orchestra.run.smithi194.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 3.3 MB/s | 171 kB 00:00 2024-09-10T23:11:40.865 INFO:teuthology.orchestra.run.smithi038.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-09-10T23:11:40.879 INFO:teuthology.orchestra.run.smithi194.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4854.g 588 kB/s | 34 kB 00:00 2024-09-10T23:11:40.902 INFO:teuthology.orchestra.run.smithi003.stdout:(32/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 9.3 MB/s | 14 MB 00:01 2024-09-10T23:11:40.904 INFO:teuthology.orchestra.run.smithi038.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-10T23:11:40.927 INFO:teuthology.orchestra.run.smithi003.stdout:(33/157): ceph-mgr-modules-core-19.3.0-4854.g8f 1.3 MB/s | 291 kB 00:00 2024-09-10T23:11:40.937 INFO:teuthology.orchestra.run.smithi038.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-09-10T23:11:40.938 INFO:teuthology.orchestra.run.smithi194.stdout:(29/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 2.6 MB/s | 154 kB 00:00 2024-09-10T23:11:40.961 INFO:teuthology.orchestra.run.smithi003.stdout:(34/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 842 kB/s | 49 kB 00:00 2024-09-10T23:11:40.971 INFO:teuthology.orchestra.run.smithi038.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 352 kB/s | 38 kB 00:00 2024-09-10T23:11:40.986 INFO:teuthology.orchestra.run.smithi003.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4854.g8 280 kB/s | 16 kB 00:00 2024-09-10T23:11:41.028 INFO:teuthology.orchestra.run.smithi003.stdout:(36/157): ceph-volume-19.3.0-4854.g8f219c47.el9 4.2 MB/s | 285 kB 00:00 2024-09-10T23:11:41.095 INFO:teuthology.orchestra.run.smithi003.stdout:(37/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 273 kB/s | 18 kB 00:00 2024-09-10T23:11:41.121 INFO:teuthology.orchestra.run.smithi038.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-10T23:11:41.170 INFO:teuthology.orchestra.run.smithi003.stdout:(38/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 4.2 MB/s | 783 kB 00:00 2024-09-10T23:11:41.287 INFO:teuthology.orchestra.run.smithi003.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 417 kB/s | 80 kB 00:00 2024-09-10T23:11:41.372 INFO:teuthology.orchestra.run.smithi194.stdout:(30/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 5.1 MB/s | 3.2 MB 00:00 2024-09-10T23:11:41.404 INFO:teuthology.orchestra.run.smithi003.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 191 kB 00:00 2024-09-10T23:11:41.471 INFO:teuthology.orchestra.run.smithi003.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.6 MB/s | 801 kB 00:00 2024-09-10T23:11:41.496 INFO:teuthology.orchestra.run.smithi003.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-09-10T23:11:41.547 INFO:teuthology.orchestra.run.smithi003.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-10T23:11:41.571 INFO:teuthology.orchestra.run.smithi038.stdout:(69/157): openblas-openmp-0.3.26-2.el9.x86_64.r 7.4 MB/s | 4.9 MB 00:00 2024-09-10T23:11:41.605 INFO:teuthology.orchestra.run.smithi003.stdout:(44/157): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-10T23:11:41.664 INFO:teuthology.orchestra.run.smithi003.stdout:(45/157): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-10T23:11:41.688 INFO:teuthology.orchestra.run.smithi038.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 1.2 MB/s | 137 kB 00:00 2024-09-10T23:11:41.722 INFO:teuthology.orchestra.run.smithi003.stdout:(46/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-10T23:11:41.823 INFO:teuthology.orchestra.run.smithi003.stdout:(47/157): python3-cryptography-36.0.1-4.el9.x86 3.5 MB/s | 1.2 MB 00:00 2024-09-10T23:11:41.856 INFO:teuthology.orchestra.run.smithi003.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 5.0 MB/s | 689 kB 00:00 2024-09-10T23:11:41.923 INFO:teuthology.orchestra.run.smithi003.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-09-10T23:11:41.982 INFO:teuthology.orchestra.run.smithi003.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 372 kB/s | 22 kB 00:00 2024-09-10T23:11:42.049 INFO:teuthology.orchestra.run.smithi003.stdout:(51/157): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-09-10T23:11:42.082 INFO:teuthology.orchestra.run.smithi003.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 3.5 MB/s | 943 kB 00:00 2024-09-10T23:11:42.116 INFO:teuthology.orchestra.run.smithi003.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 489 kB/s | 33 kB 00:00 2024-09-10T23:11:42.158 INFO:teuthology.orchestra.run.smithi003.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 441 kB/s | 18 kB 00:00 2024-09-10T23:11:42.164 INFO:teuthology.orchestra.run.smithi194.stdout:(31/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 19 MB/s | 50 MB 00:02 2024-09-10T23:11:42.209 INFO:teuthology.orchestra.run.smithi003.stdout:(55/157): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-10T23:11:42.267 INFO:teuthology.orchestra.run.smithi003.stdout:(56/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.9 MB/s | 171 kB 00:00 2024-09-10T23:11:42.339 INFO:teuthology.orchestra.run.smithi194.stdout:(32/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 10 MB/s | 14 MB 00:01 2024-09-10T23:11:42.364 INFO:teuthology.orchestra.run.smithi194.stdout:(33/157): ceph-mgr-modules-core-19.3.0-4854.g8f 1.4 MB/s | 291 kB 00:00 2024-09-10T23:11:42.381 INFO:teuthology.orchestra.run.smithi194.stdout:(34/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 1.2 MB/s | 49 kB 00:00 2024-09-10T23:11:42.398 INFO:teuthology.orchestra.run.smithi194.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4854.g8 494 kB/s | 16 kB 00:00 2024-09-10T23:11:42.490 INFO:teuthology.orchestra.run.smithi194.stdout:(36/157): ceph-mgr-diskprediction-local-19.3.0- 6.6 MB/s | 7.4 MB 00:01 2024-09-10T23:11:42.553 INFO:teuthology.orchestra.run.smithi038.stdout:(71/157): postgresql-contrib-13.16-1.el9.x86_64 642 kB/s | 910 kB 00:01 2024-09-10T23:11:42.553 INFO:teuthology.orchestra.run.smithi194.stdout:(37/157): ceph-volume-19.3.0-4854.g8f219c47.el9 2.0 MB/s | 285 kB 00:00 2024-09-10T23:11:42.553 INFO:teuthology.orchestra.run.smithi194.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 314 kB/s | 18 kB 00:00 2024-09-10T23:11:42.583 INFO:teuthology.orchestra.run.smithi194.stdout:(39/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 4.2 MB/s | 783 kB 00:00 2024-09-10T23:11:42.675 INFO:teuthology.orchestra.run.smithi194.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 530 kB/s | 80 kB 00:00 2024-09-10T23:11:42.733 INFO:teuthology.orchestra.run.smithi194.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-10T23:11:42.743 INFO:teuthology.orchestra.run.smithi003.stdout:(57/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 10 MB/s | 50 MB 00:04 2024-09-10T23:11:42.766 INFO:teuthology.orchestra.run.smithi194.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 3.6 MB/s | 801 kB 00:00 2024-09-10T23:11:42.768 INFO:teuthology.orchestra.run.smithi003.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 320 kB/s | 160 kB 00:00 2024-09-10T23:11:42.792 INFO:teuthology.orchestra.run.smithi194.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-10T23:11:42.826 INFO:teuthology.orchestra.run.smithi194.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-10T23:11:42.851 INFO:teuthology.orchestra.run.smithi194.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-10T23:11:42.884 INFO:teuthology.orchestra.run.smithi194.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-10T23:11:42.893 INFO:teuthology.orchestra.run.smithi003.stdout:(59/157): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-09-10T23:11:42.910 INFO:teuthology.orchestra.run.smithi194.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-10T23:11:42.952 INFO:teuthology.orchestra.run.smithi003.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 217 kB/s | 45 kB 00:00 2024-09-10T23:11:42.960 INFO:teuthology.orchestra.run.smithi194.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 5.4 MB/s | 1.2 MB 00:00 2024-09-10T23:11:42.985 INFO:teuthology.orchestra.run.smithi003.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 6.2 MB/s | 581 kB 00:00 2024-09-10T23:11:43.010 INFO:teuthology.orchestra.run.smithi003.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 420 kB/s | 24 kB 00:00 2024-09-10T23:11:43.035 INFO:teuthology.orchestra.run.smithi194.stdout:(49/157): bison-3.7.4-5.el9.x86_64.rpm 7.4 MB/s | 943 kB 00:00 2024-09-10T23:11:43.036 INFO:teuthology.orchestra.run.smithi003.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-10T23:11:43.069 INFO:teuthology.orchestra.run.smithi194.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 689 kB 00:00 2024-09-10T23:11:43.094 INFO:teuthology.orchestra.run.smithi194.stdout:(51/157): boost-program-options-1.75.0-8.el9.x8 799 kB/s | 107 kB 00:00 2024-09-10T23:11:43.119 INFO:teuthology.orchestra.run.smithi194.stdout:(52/157): elfutils-libelf-devel-0.191-4.el9.x86 259 kB/s | 22 kB 00:00 2024-09-10T23:11:43.153 INFO:teuthology.orchestra.run.smithi194.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-09-10T23:11:43.161 INFO:teuthology.orchestra.run.smithi003.stdout:(64/157): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-09-10T23:11:43.178 INFO:teuthology.orchestra.run.smithi194.stdout:(54/157): flexiblas-3.0.4-8.el9.x86_64.rpm 390 kB/s | 33 kB 00:00 2024-09-10T23:11:43.186 INFO:teuthology.orchestra.run.smithi003.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.6 MB/s | 292 kB 00:00 2024-09-10T23:11:43.211 INFO:teuthology.orchestra.run.smithi003.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 770 kB/s | 38 kB 00:00 2024-09-10T23:11:43.253 INFO:teuthology.orchestra.run.smithi194.stdout:(55/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 22 MB/s | 3.0 MB 00:00 2024-09-10T23:11:43.278 INFO:teuthology.orchestra.run.smithi194.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 111 kB/s | 11 kB 00:00 2024-09-10T23:11:43.304 INFO:teuthology.orchestra.run.smithi194.stdout:(57/157): flexiblas-openblas-openmp-3.0.4-8.el9 121 kB/s | 18 kB 00:00 2024-09-10T23:11:43.329 INFO:teuthology.orchestra.run.smithi194.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.2 MB/s | 171 kB 00:00 2024-09-10T23:11:43.363 INFO:teuthology.orchestra.run.smithi194.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-09-10T23:11:43.388 INFO:teuthology.orchestra.run.smithi194.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 540 kB/s | 45 kB 00:00 2024-09-10T23:11:43.430 INFO:teuthology.orchestra.run.smithi194.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 6.4 MB/s | 662 kB 00:00 2024-09-10T23:11:43.464 INFO:teuthology.orchestra.run.smithi194.stdout:(62/157): libtool-2.4.6-46.el9.x86_64.rpm 5.7 MB/s | 581 kB 00:00 2024-09-10T23:11:43.489 INFO:teuthology.orchestra.run.smithi194.stdout:(63/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 244 kB/s | 24 kB 00:00 2024-09-10T23:11:43.514 INFO:teuthology.orchestra.run.smithi194.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 567 kB/s | 47 kB 00:00 2024-09-10T23:11:43.548 INFO:teuthology.orchestra.run.smithi194.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-10T23:11:43.590 INFO:teuthology.orchestra.run.smithi194.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-10T23:11:43.597 INFO:teuthology.orchestra.run.smithi038.stdout:(72/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 1.7 MB/s | 4.4 MB 00:02 2024-09-10T23:11:43.615 INFO:teuthology.orchestra.run.smithi194.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 384 kB/s | 38 kB 00:00 2024-09-10T23:11:43.715 INFO:teuthology.orchestra.run.smithi194.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 30 MB/s | 4.9 MB 00:00 2024-09-10T23:11:43.766 INFO:teuthology.orchestra.run.smithi194.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-10T23:11:43.797 INFO:teuthology.orchestra.run.smithi038.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 438 kB/s | 87 kB 00:00 2024-09-10T23:11:43.807 INFO:teuthology.orchestra.run.smithi194.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 9.7 MB/s | 910 kB 00:00 2024-09-10T23:11:43.866 INFO:teuthology.orchestra.run.smithi194.stdout:(71/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-09-10T23:11:43.891 INFO:teuthology.orchestra.run.smithi194.stdout:(72/157): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-10T23:11:43.978 INFO:teuthology.orchestra.run.smithi003.stdout:(67/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 1.6 MB/s | 3.0 MB 00:01 2024-09-10T23:11:43.992 INFO:teuthology.orchestra.run.smithi194.stdout:(73/157): postgresql-server-13.16-1.el9.x86_64. 31 MB/s | 5.8 MB 00:00 2024-09-10T23:11:44.017 INFO:teuthology.orchestra.run.smithi194.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 699 kB/s | 87 kB 00:00 2024-09-10T23:11:44.059 INFO:teuthology.orchestra.run.smithi194.stdout:(75/157): protobuf-3.14.0-13.el9.x86_64.rpm 5.2 MB/s | 1.0 MB 00:00 2024-09-10T23:11:44.084 INFO:teuthology.orchestra.run.smithi194.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 917 kB/s | 61 kB 00:00 2024-09-10T23:11:44.134 INFO:teuthology.orchestra.run.smithi194.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 3.2 MB/s | 245 kB 00:00 2024-09-10T23:11:44.153 INFO:teuthology.orchestra.run.smithi003.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 5.1 MB/s | 4.9 MB 00:00 2024-09-10T23:11:44.168 INFO:teuthology.orchestra.run.smithi194.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-10T23:11:44.243 INFO:teuthology.orchestra.run.smithi194.stdout:(79/157): python3-babel-2.9.1-2.el9.noarch.rpm 24 MB/s | 6.0 MB 00:00 2024-09-10T23:11:44.268 INFO:teuthology.orchestra.run.smithi194.stdout:(80/157): python3-jsonpatch-1.21-16.el9.noarch. 192 kB/s | 26 kB 00:00 2024-09-10T23:11:44.318 INFO:teuthology.orchestra.run.smithi194.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 128 kB/s | 19 kB 00:00 2024-09-10T23:11:44.336 INFO:teuthology.orchestra.run.smithi194.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-09-10T23:11:44.337 INFO:teuthology.orchestra.run.smithi003.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 4.9 MB/s | 910 kB 00:00 2024-09-10T23:11:44.386 INFO:teuthology.orchestra.run.smithi194.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 520 kB/s | 35 kB 00:00 2024-09-10T23:11:44.395 INFO:teuthology.orchestra.run.smithi003.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-10T23:11:44.411 INFO:teuthology.orchestra.run.smithi194.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 250 kB 00:00 2024-09-10T23:11:44.431 INFO:teuthology.orchestra.run.smithi038.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 546 kB/s | 1.0 MB 00:01 2024-09-10T23:11:44.453 INFO:teuthology.orchestra.run.smithi194.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.2 MB/s | 222 kB 00:00 2024-09-10T23:11:44.552 INFO:teuthology.orchestra.run.smithi194.stdout:(86/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 22 MB/s | 5.1 MB 00:00 2024-09-10T23:11:44.565 INFO:teuthology.orchestra.run.smithi038.stdout:(75/157): postgresql-server-13.16-1.el9.x86_64. 2.0 MB/s | 5.8 MB 00:02 2024-09-10T23:11:44.578 INFO:teuthology.orchestra.run.smithi194.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 338 kB/s | 42 kB 00:00 2024-09-10T23:11:44.589 INFO:teuthology.orchestra.run.smithi038.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 386 kB/s | 61 kB 00:00 2024-09-10T23:11:44.604 INFO:teuthology.orchestra.run.smithi194.stdout:(88/157): python3-packaging-20.9-5.el9.noarch.r 401 kB/s | 77 kB 00:00 2024-09-10T23:11:44.629 INFO:teuthology.orchestra.run.smithi194.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-09-10T23:11:44.654 INFO:teuthology.orchestra.run.smithi194.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-10T23:11:44.680 INFO:teuthology.orchestra.run.smithi194.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-09-10T23:11:44.682 INFO:teuthology.orchestra.run.smithi038.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.1 MB/s | 245 kB 00:00 2024-09-10T23:11:44.707 INFO:teuthology.orchestra.run.smithi038.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-09-10T23:11:44.721 INFO:teuthology.orchestra.run.smithi194.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 553 kB/s | 51 kB 00:00 2024-09-10T23:11:44.747 INFO:teuthology.orchestra.run.smithi194.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 583 kB/s | 54 kB 00:00 2024-09-10T23:11:44.790 INFO:teuthology.orchestra.run.smithi038.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 236 kB/s | 26 kB 00:00 2024-09-10T23:11:44.797 INFO:teuthology.orchestra.run.smithi194.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 553 kB/s | 42 kB 00:00 2024-09-10T23:11:44.816 INFO:teuthology.orchestra.run.smithi038.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 177 kB/s | 19 kB 00:00 2024-09-10T23:11:44.822 INFO:teuthology.orchestra.run.smithi194.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 587 kB/s | 44 kB 00:00 2024-09-10T23:11:44.846 INFO:teuthology.orchestra.run.smithi003.stdout:(71/157): postgresql-13.16-1.el9.x86_64.rpm 1.8 MB/s | 1.6 MB 00:00 2024-09-10T23:11:44.872 INFO:teuthology.orchestra.run.smithi194.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-10T23:11:44.898 INFO:teuthology.orchestra.run.smithi194.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 477 kB/s | 36 kB 00:00 2024-09-10T23:11:44.908 INFO:teuthology.orchestra.run.smithi038.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-10T23:11:44.933 INFO:teuthology.orchestra.run.smithi038.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 297 kB/s | 35 kB 00:00 2024-09-10T23:11:44.940 INFO:teuthology.orchestra.run.smithi194.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 710 kB/s | 47 kB 00:00 2024-09-10T23:11:44.973 INFO:teuthology.orchestra.run.smithi194.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 4.0 MB/s | 304 kB 00:00 2024-09-10T23:11:45.059 INFO:teuthology.orchestra.run.smithi038.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.0 MB/s | 250 kB 00:00 2024-09-10T23:11:45.154 INFO:teuthology.orchestra.run.smithi003.stdout:(72/157): postgresql-server-13.16-1.el9.x86_64. 7.6 MB/s | 5.8 MB 00:00 2024-09-10T23:11:45.157 INFO:teuthology.orchestra.run.smithi194.stdout:(100/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2024-09-10T23:11:45.176 INFO:teuthology.orchestra.run.smithi038.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 222 kB 00:00 2024-09-10T23:11:45.182 INFO:teuthology.orchestra.run.smithi194.stdout:(101/157): uuid-1.6.2-55.el9.x86_64.rpm 239 kB/s | 58 kB 00:00 2024-09-10T23:11:45.207 INFO:teuthology.orchestra.run.smithi194.stdout:(102/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 410 kB/s | 96 kB 00:00 2024-09-10T23:11:45.241 INFO:teuthology.orchestra.run.smithi194.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 765 kB/s | 45 kB 00:00 2024-09-10T23:11:45.245 INFO:teuthology.orchestra.run.smithi003.stdout:(73/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.2 MB/s | 4.4 MB 00:02 2024-09-10T23:11:45.266 INFO:teuthology.orchestra.run.smithi194.stdout:(104/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 584 kB/s | 64 kB 00:00 2024-09-10T23:11:45.271 INFO:teuthology.orchestra.run.smithi003.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 751 kB/s | 87 kB 00:00 2024-09-10T23:11:45.276 INFO:teuthology.orchestra.run.smithi038.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 773 kB/s | 77 kB 00:00 2024-09-10T23:11:45.300 INFO:teuthology.orchestra.run.smithi194.stdout:(105/157): lua-devel-5.4.4-4.el9.x86_64.rpm 242 kB/s | 22 kB 00:00 2024-09-10T23:11:45.322 INFO:teuthology.orchestra.run.smithi003.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-10T23:11:45.367 INFO:teuthology.orchestra.run.smithi194.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 5.4 MB/s | 548 kB 00:00 2024-09-10T23:11:45.384 INFO:teuthology.orchestra.run.smithi038.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 391 kB/s | 42 kB 00:00 2024-09-10T23:11:45.392 INFO:teuthology.orchestra.run.smithi194.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 788 kB/s | 19 kB 00:00 2024-09-10T23:11:45.417 INFO:teuthology.orchestra.run.smithi194.stdout:(108/157): gperftools-libs-2.9.1-2.el9.x86_64.r 2.6 MB/s | 309 kB 00:00 2024-09-10T23:11:45.422 INFO:teuthology.orchestra.run.smithi003.stdout:(76/157): python3-babel-2.9.1-2.el9.noarch.rpm 34 MB/s | 6.0 MB 00:00 2024-09-10T23:11:45.443 INFO:teuthology.orchestra.run.smithi194.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-10T23:11:45.447 INFO:teuthology.orchestra.run.smithi003.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-10T23:11:45.481 INFO:teuthology.orchestra.run.smithi003.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-10T23:11:45.484 INFO:teuthology.orchestra.run.smithi194.stdout:(110/157): protobuf-compiler-3.14.0-13.el9.x86_ 3.5 MB/s | 863 kB 00:00 2024-09-10T23:11:45.501 INFO:teuthology.orchestra.run.smithi038.stdout:(87/157): python3-protobuf-3.14.0-13.el9.noarch 2.3 MB/s | 269 kB 00:00 2024-09-10T23:11:45.514 INFO:teuthology.orchestra.run.smithi003.stdout:(79/157): protobuf-3.14.0-13.el9.x86_64.rpm 1.5 MB/s | 1.0 MB 00:00 2024-09-10T23:11:45.535 INFO:teuthology.orchestra.run.smithi194.stdout:(111/157): liboath-2.6.7-2.el9.x86_64.rpm 529 kB/s | 49 kB 00:00 2024-09-10T23:11:45.539 INFO:teuthology.orchestra.run.smithi003.stdout:(80/157): python3-jsonpatch-1.21-16.el9.noarch. 279 kB/s | 26 kB 00:00 2024-09-10T23:11:45.565 INFO:teuthology.orchestra.run.smithi003.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 229 kB/s | 19 kB 00:00 2024-09-10T23:11:45.585 INFO:teuthology.orchestra.run.smithi194.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 3.8 MB/s | 151 kB 00:00 2024-09-10T23:11:45.590 INFO:teuthology.orchestra.run.smithi003.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 695 kB/s | 35 kB 00:00 2024-09-10T23:11:45.610 INFO:teuthology.orchestra.run.smithi194.stdout:(113/157): libunwind-1.6.2-1.el9.x86_64.rpm 537 kB/s | 67 kB 00:00 2024-09-10T23:11:45.618 INFO:teuthology.orchestra.run.smithi038.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-10T23:11:45.661 INFO:teuthology.orchestra.run.smithi194.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-10T23:11:45.665 INFO:teuthology.orchestra.run.smithi003.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 250 kB 00:00 2024-09-10T23:11:45.686 INFO:teuthology.orchestra.run.smithi194.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-10T23:11:45.691 INFO:teuthology.orchestra.run.smithi003.stdout:(84/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-10T23:11:45.719 INFO:teuthology.orchestra.run.smithi194.stdout:(116/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.1 MB/s | 839 kB 00:00 2024-09-10T23:11:45.724 INFO:teuthology.orchestra.run.smithi003.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-10T23:11:45.735 INFO:teuthology.orchestra.run.smithi038.stdout:(89/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-09-10T23:11:45.745 INFO:teuthology.orchestra.run.smithi194.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 551 kB/s | 32 kB 00:00 2024-09-10T23:11:45.770 INFO:teuthology.orchestra.run.smithi194.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-10T23:11:45.796 INFO:teuthology.orchestra.run.smithi194.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-10T23:11:45.799 INFO:teuthology.orchestra.run.smithi003.stdout:(86/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 22 MB/s | 5.1 MB 00:00 2024-09-10T23:11:45.825 INFO:teuthology.orchestra.run.smithi003.stdout:(87/157): python3-packaging-20.9-5.el9.noarch.r 577 kB/s | 77 kB 00:00 2024-09-10T23:11:45.829 INFO:teuthology.orchestra.run.smithi194.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-10T23:11:45.842 INFO:teuthology.orchestra.run.smithi003.stdout:(88/157): python3-prettytable-0.7.2-27.el9.noar 361 kB/s | 42 kB 00:00 2024-09-10T23:11:45.844 INFO:teuthology.orchestra.run.smithi038.stdout:(90/157): python3-pytz-2021.1-5.el9.noarch.rpm 471 kB/s | 51 kB 00:00 2024-09-10T23:11:45.863 INFO:teuthology.orchestra.run.smithi194.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-10T23:11:45.875 INFO:teuthology.orchestra.run.smithi003.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-09-10T23:11:45.888 INFO:teuthology.orchestra.run.smithi194.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-10T23:11:45.901 INFO:teuthology.orchestra.run.smithi003.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-10T23:11:45.921 INFO:teuthology.orchestra.run.smithi194.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-10T23:11:45.926 INFO:teuthology.orchestra.run.smithi003.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-10T23:11:45.951 INFO:teuthology.orchestra.run.smithi003.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-10T23:11:45.953 INFO:teuthology.orchestra.run.smithi038.stdout:(91/157): python3-requests-oauthlib-1.3.0-12.el 495 kB/s | 54 kB 00:00 2024-09-10T23:11:45.976 INFO:teuthology.orchestra.run.smithi003.stdout:(93/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.0 MB/s | 159 kB 00:00 2024-09-10T23:11:45.980 INFO:teuthology.orchestra.run.smithi194.stdout:(124/157): libarrow-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 4.4 MB 00:00 2024-09-10T23:11:46.005 INFO:teuthology.orchestra.run.smithi194.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 128 kB/s | 11 kB 00:00 2024-09-10T23:11:46.010 INFO:teuthology.orchestra.run.smithi003.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 713 kB/s | 42 kB 00:00 2024-09-10T23:11:46.031 INFO:teuthology.orchestra.run.smithi194.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-09-10T23:11:46.035 INFO:teuthology.orchestra.run.smithi003.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 754 kB/s | 44 kB 00:00 2024-09-10T23:11:46.056 INFO:teuthology.orchestra.run.smithi194.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-10T23:11:46.069 INFO:teuthology.orchestra.run.smithi003.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-10T23:11:46.073 INFO:teuthology.orchestra.run.smithi194.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 465 kB/s | 19 kB 00:00 2024-09-10T23:11:46.090 INFO:teuthology.orchestra.run.smithi194.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 586 kB/s | 20 kB 00:00 2024-09-10T23:11:46.094 INFO:teuthology.orchestra.run.smithi003.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 615 kB/s | 36 kB 00:00 2024-09-10T23:11:46.115 INFO:teuthology.orchestra.run.smithi194.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T23:11:46.119 INFO:teuthology.orchestra.run.smithi003.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 950 kB/s | 47 kB 00:00 2024-09-10T23:11:46.156 INFO:teuthology.orchestra.run.smithi194.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 1.9 MB/s | 79 kB 00:00 2024-09-10T23:11:46.169 INFO:teuthology.orchestra.run.smithi003.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-10T23:11:46.198 INFO:teuthology.orchestra.run.smithi194.stdout:(132/157): python3-kubernetes-26.1.0-2.el9.noar 8.2 MB/s | 1.0 MB 00:00 2024-09-10T23:11:46.223 INFO:teuthology.orchestra.run.smithi194.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 859 kB/s | 58 kB 00:00 2024-09-10T23:11:46.228 INFO:teuthology.orchestra.run.smithi003.stdout:(100/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-10T23:11:46.248 INFO:teuthology.orchestra.run.smithi194.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 666 kB/s | 16 kB 00:00 2024-09-10T23:11:46.274 INFO:teuthology.orchestra.run.smithi194.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-10T23:11:46.287 INFO:teuthology.orchestra.run.smithi003.stdout:(101/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-10T23:11:46.299 INFO:teuthology.orchestra.run.smithi194.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-10T23:11:46.312 INFO:teuthology.orchestra.run.smithi003.stdout:(102/157): socat-1.7.4.1-6.el9.x86_64.rpm 1.4 MB/s | 304 kB 00:00 2024-09-10T23:11:46.315 INFO:teuthology.orchestra.run.smithi194.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 677 kB/s | 28 kB 00:00 2024-09-10T23:11:46.337 INFO:teuthology.orchestra.run.smithi003.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 891 kB/s | 45 kB 00:00 2024-09-10T23:11:46.374 INFO:teuthology.orchestra.run.smithi194.stdout:(138/157): python3-grpcio-1.46.7-10.el9.x86_64. 4.0 MB/s | 2.0 MB 00:00 2024-09-10T23:11:46.391 INFO:teuthology.orchestra.run.smithi194.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 334 kB/s | 31 kB 00:00 2024-09-10T23:11:46.416 INFO:teuthology.orchestra.run.smithi194.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-09-10T23:11:46.434 INFO:teuthology.orchestra.run.smithi194.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 858 kB/s | 36 kB 00:00 2024-09-10T23:11:46.567 INFO:teuthology.orchestra.run.smithi194.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 495 kB/s | 74 kB 00:00 2024-09-10T23:11:46.593 INFO:teuthology.orchestra.run.smithi194.stdout:(143/157): python3-routes-2.5.1-5.el9.noarch.rp 681 kB/s | 188 kB 00:00 2024-09-10T23:11:46.618 INFO:teuthology.orchestra.run.smithi194.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-10T23:11:46.638 INFO:teuthology.orchestra.run.smithi003.stdout:(104/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2024-09-10T23:11:46.643 INFO:teuthology.orchestra.run.smithi194.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.1 MB/s | 230 kB 00:00 2024-09-10T23:11:46.663 INFO:teuthology.orchestra.run.smithi003.stdout:(105/157): lua-devel-5.4.4-4.el9.x86_64.rpm 64 kB/s | 22 kB 00:00 2024-09-10T23:11:46.669 INFO:teuthology.orchestra.run.smithi194.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-10T23:11:46.702 INFO:teuthology.orchestra.run.smithi194.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-10T23:11:46.728 INFO:teuthology.orchestra.run.smithi194.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-10T23:11:46.730 INFO:teuthology.orchestra.run.smithi003.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 5.9 MB/s | 548 kB 00:00 2024-09-10T23:11:46.763 INFO:teuthology.orchestra.run.smithi003.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 592 kB/s | 19 kB 00:00 2024-09-10T23:11:46.786 INFO:teuthology.orchestra.run.smithi194.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-10T23:11:46.797 INFO:teuthology.orchestra.run.smithi003.stdout:(108/157): gperftools-libs-2.9.1-2.el9.x86_64.r 2.3 MB/s | 309 kB 00:00 2024-09-10T23:11:46.822 INFO:teuthology.orchestra.run.smithi003.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-10T23:11:46.856 INFO:teuthology.orchestra.run.smithi003.stdout:(110/157): protobuf-compiler-3.14.0-13.el9.x86_ 1.6 MB/s | 863 kB 00:00 2024-09-10T23:11:46.881 INFO:teuthology.orchestra.run.smithi003.stdout:(111/157): liboath-2.6.7-2.el9.x86_64.rpm 832 kB/s | 49 kB 00:00 2024-09-10T23:11:46.923 INFO:teuthology.orchestra.run.smithi003.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.9 MB/s | 151 kB 00:00 2024-09-10T23:11:46.957 INFO:teuthology.orchestra.run.smithi003.stdout:(113/157): libunwind-1.6.2-1.el9.x86_64.rpm 669 kB/s | 67 kB 00:00 2024-09-10T23:11:47.015 INFO:teuthology.orchestra.run.smithi003.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.1 MB/s | 839 kB 00:00 2024-09-10T23:11:47.041 INFO:teuthology.orchestra.run.smithi003.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-10T23:11:47.066 INFO:teuthology.orchestra.run.smithi003.stdout:(116/157): python3-asyncssh-2.13.2-5.el9.noarch 4.9 MB/s | 548 kB 00:00 2024-09-10T23:11:47.091 INFO:teuthology.orchestra.run.smithi003.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 643 kB/s | 32 kB 00:00 2024-09-10T23:11:47.117 INFO:teuthology.orchestra.run.smithi003.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-10T23:11:47.150 INFO:teuthology.orchestra.run.smithi003.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-10T23:11:47.170 INFO:teuthology.orchestra.run.smithi194.stdout:(150/157): librados2-19.3.0-4854.g8f219c47.el9. 7.4 MB/s | 3.5 MB 00:00 2024-09-10T23:11:47.184 INFO:teuthology.orchestra.run.smithi003.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 5.3 MB/s | 358 kB 00:00 2024-09-10T23:11:47.217 INFO:teuthology.orchestra.run.smithi003.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-10T23:11:47.243 INFO:teuthology.orchestra.run.smithi003.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-10T23:11:47.276 INFO:teuthology.orchestra.run.smithi003.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-10T23:11:47.310 INFO:teuthology.orchestra.run.smithi003.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 320 kB/s | 11 kB 00:00 2024-09-10T23:11:47.328 INFO:teuthology.orchestra.run.smithi194.stdout:(151/157): NetworkManager-1.49.90-1.el9.x86_64. 4.3 MB/s | 2.3 MB 00:00 2024-09-10T23:11:47.335 INFO:teuthology.orchestra.run.smithi003.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 717 kB/s | 18 kB 00:00 2024-09-10T23:11:47.360 INFO:teuthology.orchestra.run.smithi003.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 936 kB/s | 23 kB 00:00 2024-09-10T23:11:47.386 INFO:teuthology.orchestra.run.smithi003.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 787 kB/s | 19 kB 00:00 2024-09-10T23:11:47.411 INFO:teuthology.orchestra.run.smithi003.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 792 kB/s | 20 kB 00:00 2024-09-10T23:11:47.427 INFO:teuthology.orchestra.run.smithi194.stdout:(152/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 4.6 MB/s | 3.2 MB 00:00 2024-09-10T23:11:47.454 INFO:teuthology.orchestra.run.smithi194.stdout:(153/157): NetworkManager-team-1.49.90-1.el9.x8 325 kB/s | 41 kB 00:00 2024-09-10T23:11:47.503 INFO:teuthology.orchestra.run.smithi003.stdout:(129/157): libarrow-9.0.0-11.el9.x86_64.rpm 6.0 MB/s | 4.4 MB 00:00 2024-09-10T23:11:47.545 INFO:teuthology.orchestra.run.smithi003.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2024-09-10T23:11:47.570 INFO:teuthology.orchestra.run.smithi003.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-10T23:11:47.595 INFO:teuthology.orchestra.run.smithi003.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-10T23:11:47.604 INFO:teuthology.orchestra.run.smithi194.stdout:(154/157): NetworkManager-tui-1.49.90-1.el9.x86 1.4 MB/s | 249 kB 00:00 2024-09-10T23:11:47.629 INFO:teuthology.orchestra.run.smithi003.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 4.7 MB/s | 1.0 MB 00:00 2024-09-10T23:11:47.654 INFO:teuthology.orchestra.run.smithi003.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 661 kB/s | 16 kB 00:00 2024-09-10T23:11:47.671 INFO:teuthology.orchestra.run.smithi194.stdout:(155/157): NetworkManager-libnm-1.49.90-1.el9.x 3.6 MB/s | 1.8 MB 00:00 2024-09-10T23:11:47.680 INFO:teuthology.orchestra.run.smithi003.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-10T23:11:47.705 INFO:teuthology.orchestra.run.smithi003.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-10T23:11:47.747 INFO:teuthology.orchestra.run.smithi003.stdout:(137/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.9 MB/s | 2.0 MB 00:00 2024-09-10T23:11:47.772 INFO:teuthology.orchestra.run.smithi003.stdout:(138/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 768 kB/s | 90 kB 00:00 2024-09-10T23:11:47.797 INFO:teuthology.orchestra.run.smithi003.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 335 kB/s | 31 kB 00:00 2024-09-10T23:11:47.823 INFO:teuthology.orchestra.run.smithi003.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-10T23:11:47.848 INFO:teuthology.orchestra.run.smithi003.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-10T23:11:47.873 INFO:teuthology.orchestra.run.smithi003.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-10T23:11:47.879 INFO:teuthology.orchestra.run.smithi194.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 8.7 MB/s | 2.4 MB 00:00 2024-09-10T23:11:47.899 INFO:teuthology.orchestra.run.smithi003.stdout:(143/157): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-10T23:11:47.924 INFO:teuthology.orchestra.run.smithi003.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-10T23:11:47.949 INFO:teuthology.orchestra.run.smithi003.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 809 kB/s | 20 kB 00:00 2024-09-10T23:11:47.963 INFO:teuthology.orchestra.run.smithi194.stdout:(157/157): openssl-3.2.2-6.el9.x86_64.rpm 2.7 MB/s | 1.4 MB 00:00 2024-09-10T23:11:47.970 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:11:47.970 INFO:teuthology.orchestra.run.smithi194.stdout:Total 20 MB/s | 240 MB 00:12 2024-09-10T23:11:47.974 INFO:teuthology.orchestra.run.smithi003.stdout:(146/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-10T23:11:48.008 INFO:teuthology.orchestra.run.smithi003.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-10T23:11:48.033 INFO:teuthology.orchestra.run.smithi003.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-10T23:11:48.092 INFO:teuthology.orchestra.run.smithi003.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-10T23:11:48.342 INFO:teuthology.orchestra.run.smithi003.stdout:(150/157): NetworkManager-1.49.90-1.el9.x86_64. 9.3 MB/s | 2.3 MB 00:00 2024-09-10T23:11:48.451 INFO:teuthology.orchestra.run.smithi003.stdout:(151/157): NetworkManager-libnm-1.49.90-1.el9.x 17 MB/s | 1.8 MB 00:00 2024-09-10T23:11:48.534 INFO:teuthology.orchestra.run.smithi003.stdout:(152/157): NetworkManager-team-1.49.90-1.el9.x8 491 kB/s | 41 kB 00:00 2024-09-10T23:11:48.584 INFO:teuthology.orchestra.run.smithi003.stdout:(153/157): librados2-19.3.0-4854.g8f219c47.el9. 6.0 MB/s | 3.5 MB 00:00 2024-09-10T23:11:48.603 INFO:teuthology.orchestra.run.smithi038.stdout:(92/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.4 MB/s | 5.1 MB 00:03 2024-09-10T23:11:48.610 INFO:teuthology.orchestra.run.smithi003.stdout:(154/157): NetworkManager-tui-1.49.90-1.el9.x86 3.2 MB/s | 249 kB 00:00 2024-09-10T23:11:48.710 INFO:teuthology.orchestra.run.smithi003.stdout:(155/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 4.8 MB/s | 3.2 MB 00:00 2024-09-10T23:11:48.711 INFO:teuthology.orchestra.run.smithi038.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 385 kB/s | 42 kB 00:00 2024-09-10T23:11:48.768 INFO:teuthology.orchestra.run.smithi003.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 15 MB/s | 2.4 MB 00:00 2024-09-10T23:11:48.929 INFO:teuthology.orchestra.run.smithi038.stdout:(94/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 5.5 MB/s | 16 MB 00:02 2024-09-10T23:11:48.945 INFO:teuthology.orchestra.run.smithi038.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 189 kB/s | 44 kB 00:00 2024-09-10T23:11:49.010 INFO:teuthology.orchestra.run.smithi003.stdout:(157/157): openssl-3.2.2-6.el9.x86_64.rpm 3.2 MB/s | 1.4 MB 00:00 2024-09-10T23:11:49.016 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:11:49.016 INFO:teuthology.orchestra.run.smithi003.stdout:Total 17 MB/s | 240 MB 00:14 2024-09-10T23:11:49.096 INFO:teuthology.orchestra.run.smithi038.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 1.3 MB/s | 221 kB 00:00 2024-09-10T23:11:49.112 INFO:teuthology.orchestra.run.smithi038.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 215 kB/s | 36 kB 00:00 2024-09-10T23:11:49.213 INFO:teuthology.orchestra.run.smithi038.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 406 kB/s | 47 kB 00:00 2024-09-10T23:11:49.238 INFO:teuthology.orchestra.run.smithi038.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.4 MB/s | 304 kB 00:00 2024-09-10T23:11:49.347 INFO:teuthology.orchestra.run.smithi038.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 433 kB/s | 58 kB 00:00 2024-09-10T23:11:49.372 INFO:teuthology.orchestra.run.smithi038.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 718 kB/s | 96 kB 00:00 2024-09-10T23:11:49.489 INFO:teuthology.orchestra.run.smithi038.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 450 kB/s | 64 kB 00:00 2024-09-10T23:11:49.506 INFO:teuthology.orchestra.run.smithi038.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 335 kB/s | 45 kB 00:00 2024-09-10T23:11:49.615 INFO:teuthology.orchestra.run.smithi038.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 178 kB/s | 22 kB 00:00 2024-09-10T23:11:49.698 INFO:teuthology.orchestra.run.smithi038.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 6.5 MB/s | 548 kB 00:00 2024-09-10T23:11:49.732 INFO:teuthology.orchestra.run.smithi038.stdout:(106/157): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-10T23:11:49.757 INFO:teuthology.orchestra.run.smithi038.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 778 kB/s | 19 kB 00:00 2024-09-10T23:11:49.949 INFO:teuthology.orchestra.run.smithi038.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 23 MB/s | 4.4 MB 00:00 2024-09-10T23:11:49.974 INFO:teuthology.orchestra.run.smithi038.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-10T23:11:50.008 INFO:teuthology.orchestra.run.smithi038.stdout:(110/157): protobuf-compiler-3.14.0-13.el9.x86_ 1.7 MB/s | 863 kB 00:00 2024-09-10T23:11:50.033 INFO:teuthology.orchestra.run.smithi038.stdout:(111/157): liboath-2.6.7-2.el9.x86_64.rpm 828 kB/s | 49 kB 00:00 2024-09-10T23:11:50.062 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-10T23:11:50.075 INFO:teuthology.orchestra.run.smithi038.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.7 MB/s | 151 kB 00:00 2024-09-10T23:11:50.109 INFO:teuthology.orchestra.run.smithi038.stdout:(113/157): libunwind-1.6.2-1.el9.x86_64.rpm 669 kB/s | 67 kB 00:00 2024-09-10T23:11:50.143 INFO:teuthology.orchestra.run.smithi038.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 13 MB/s | 839 kB 00:00 2024-09-10T23:11:50.159 INFO:teuthology.orchestra.run.smithi038.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-10T23:11:50.176 INFO:teuthology.orchestra.run.smithi038.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-10T23:11:50.193 INFO:teuthology.orchestra.run.smithi038.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 865 kB/s | 14 kB 00:00 2024-09-10T23:11:50.227 INFO:teuthology.orchestra.run.smithi038.stdout:(118/157): python3-asyncssh-2.13.2-5.el9.noarch 4.6 MB/s | 548 kB 00:00 2024-09-10T23:11:50.246 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-10T23:11:50.246 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-10T23:11:50.252 INFO:teuthology.orchestra.run.smithi038.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-10T23:11:50.286 INFO:teuthology.orchestra.run.smithi038.stdout:(120/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-09-10T23:11:50.311 INFO:teuthology.orchestra.run.smithi038.stdout:(121/157): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-10T23:11:50.336 INFO:teuthology.orchestra.run.smithi038.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-10T23:11:50.370 INFO:teuthology.orchestra.run.smithi038.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-10T23:11:50.395 INFO:teuthology.orchestra.run.smithi038.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 435 kB/s | 11 kB 00:00 2024-09-10T23:11:50.421 INFO:teuthology.orchestra.run.smithi038.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 705 kB/s | 18 kB 00:00 2024-09-10T23:11:50.446 INFO:teuthology.orchestra.run.smithi038.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 938 kB/s | 23 kB 00:00 2024-09-10T23:11:50.471 INFO:teuthology.orchestra.run.smithi038.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 777 kB/s | 19 kB 00:00 2024-09-10T23:11:50.496 INFO:teuthology.orchestra.run.smithi038.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 799 kB/s | 20 kB 00:00 2024-09-10T23:11:50.563 INFO:teuthology.orchestra.run.smithi038.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 8.1 MB/s | 2.0 MB 00:00 2024-09-10T23:11:50.588 INFO:teuthology.orchestra.run.smithi038.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T23:11:50.614 INFO:teuthology.orchestra.run.smithi038.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-10T23:11:50.647 INFO:teuthology.orchestra.run.smithi038.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-09-10T23:11:50.690 INFO:teuthology.orchestra.run.smithi038.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-09-10T23:11:50.715 INFO:teuthology.orchestra.run.smithi038.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 668 kB/s | 16 kB 00:00 2024-09-10T23:11:50.740 INFO:teuthology.orchestra.run.smithi038.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-09-10T23:11:50.765 INFO:teuthology.orchestra.run.smithi038.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-10T23:11:50.790 INFO:teuthology.orchestra.run.smithi038.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-10T23:11:50.891 INFO:teuthology.orchestra.run.smithi038.stdout:(138/157): python3-babel-2.9.1-2.el9.noarch.rpm 861 kB/s | 6.0 MB 00:07 2024-09-10T23:11:50.916 INFO:teuthology.orchestra.run.smithi038.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 204 kB/s | 31 kB 00:00 2024-09-10T23:11:50.942 INFO:teuthology.orchestra.run.smithi038.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-10T23:11:50.975 INFO:teuthology.orchestra.run.smithi038.stdout:(141/157): python3-routes-2.5.1-5.el9.noarch.rp 1.0 MB/s | 188 kB 00:00 2024-09-10T23:11:51.001 INFO:teuthology.orchestra.run.smithi038.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-10T23:11:51.026 INFO:teuthology.orchestra.run.smithi038.stdout:(143/157): python3-tempora-5.0.0-2.el9.noarch.r 328 kB/s | 36 kB 00:00 2024-09-10T23:11:51.051 INFO:teuthology.orchestra.run.smithi038.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-10T23:11:51.076 INFO:teuthology.orchestra.run.smithi038.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.3 MB/s | 230 kB 00:00 2024-09-10T23:11:51.102 INFO:teuthology.orchestra.run.smithi038.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-10T23:11:51.120 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-10T23:11:51.127 INFO:teuthology.orchestra.run.smithi038.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-10T23:11:51.152 INFO:teuthology.orchestra.run.smithi038.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-10T23:11:51.203 INFO:teuthology.orchestra.run.smithi038.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-10T23:11:51.322 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-10T23:11:51.322 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-10T23:11:51.778 INFO:teuthology.orchestra.run.smithi038.stdout:(150/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 5.2 MB/s | 3.2 MB 00:00 2024-09-10T23:11:51.836 INFO:teuthology.orchestra.run.smithi038.stdout:(151/157): librados2-19.3.0-4854.g8f219c47.el9. 4.9 MB/s | 3.5 MB 00:00 2024-09-10T23:11:52.212 INFO:teuthology.orchestra.run.smithi038.stdout:(152/157): NetworkManager-1.49.90-1.el9.x86_64. 2.3 MB/s | 2.3 MB 00:01 2024-09-10T23:11:52.462 INFO:teuthology.orchestra.run.smithi038.stdout:(153/157): NetworkManager-team-1.49.90-1.el9.x8 65 kB/s | 41 kB 00:00 2024-09-10T23:11:52.698 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-10T23:11:52.698 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-10T23:11:52.771 INFO:teuthology.orchestra.run.smithi038.stdout:(154/157): NetworkManager-libnm-1.49.90-1.el9.x 1.8 MB/s | 1.8 MB 00:00 2024-09-10T23:11:52.954 INFO:teuthology.orchestra.run.smithi038.stdout:(155/157): NetworkManager-tui-1.49.90-1.el9.x86 335 kB/s | 249 kB 00:00 2024-09-10T23:11:53.413 INFO:teuthology.orchestra.run.smithi038.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 1.4 MB/s | 1.4 MB 00:00 2024-09-10T23:11:53.863 INFO:teuthology.orchestra.run.smithi038.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.2 MB/s | 2.4 MB 00:01 2024-09-10T23:11:53.870 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:11:53.870 INFO:teuthology.orchestra.run.smithi038.stdout:Total 11 MB/s | 240 MB 00:21 2024-09-10T23:11:53.893 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-10T23:11:53.894 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-10T23:11:55.977 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-10T23:11:56.178 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-10T23:11:56.178 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-10T23:11:58.764 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-10T23:11:58.765 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-10T23:11:59.333 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-10T23:11:59.467 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T23:11:59.518 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T23:11:59.582 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T23:11:59.619 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T23:11:59.781 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T23:11:59.985 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T23:12:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T23:12:00.468 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:12:00.597 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:12:00.628 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:12:00.665 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-10T23:12:00.723 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:12:00.763 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T23:12:00.807 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T23:12:00.814 INFO:teuthology.orchestra.run.smithi003.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T23:12:00.866 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T23:12:00.931 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T23:12:00.975 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T23:12:01.007 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T23:12:01.030 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T23:12:01.073 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T23:12:01.098 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T23:12:01.124 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:12:01.242 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:12:01.267 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T23:12:01.341 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T23:12:01.368 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T23:12:01.414 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T23:12:01.464 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T23:12:01.557 INFO:teuthology.orchestra.run.smithi003.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:12:01.661 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T23:12:01.706 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:12:01.733 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:12:01.838 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T23:12:01.848 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:12:01.887 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T23:12:01.929 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T23:12:02.019 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T23:12:02.143 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:12:02.154 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T23:12:02.225 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T23:12:02.251 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:12:02.254 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:12:02.383 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:12:02.414 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T23:12:02.506 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T23:12:02.526 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:12:02.548 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T23:12:02.589 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T23:12:02.665 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T23:12:02.698 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T23:12:02.742 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T23:12:02.775 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T23:12:02.824 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T23:12:02.878 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T23:12:02.925 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T23:12:02.956 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T23:12:02.980 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T23:12:03.035 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T23:12:03.069 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T23:12:03.105 INFO:teuthology.orchestra.run.smithi003.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T23:12:03.158 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T23:12:03.231 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T23:12:03.250 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:12:03.276 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T23:12:03.320 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T23:12:03.340 INFO:teuthology.orchestra.run.smithi003.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:12:03.411 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T23:12:03.460 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T23:12:03.504 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T23:12:03.532 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T23:12:03.621 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T23:12:03.632 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:12:03.676 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T23:12:03.766 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T23:12:03.804 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T23:12:03.837 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T23:12:03.882 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T23:12:03.928 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T23:12:03.968 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T23:12:03.987 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T23:12:04.027 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T23:12:04.065 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T23:12:04.120 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T23:12:04.158 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T23:12:04.191 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T23:12:04.276 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T23:12:04.345 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T23:12:04.380 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T23:12:04.542 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T23:12:04.636 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T23:12:04.637 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T23:12:04.674 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T23:12:04.719 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T23:12:04.737 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T23:12:04.746 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T23:12:04.782 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T23:12:04.826 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T23:12:04.842 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T23:12:04.864 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T23:12:04.908 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T23:12:05.003 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T23:12:05.159 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T23:12:05.175 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T23:12:05.236 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T23:12:05.413 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T23:12:05.483 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T23:12:05.589 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T23:12:05.661 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T23:12:05.746 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T23:12:05.785 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T23:12:05.790 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-10T23:12:05.821 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T23:12:05.896 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T23:12:05.906 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T23:12:05.935 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T23:12:05.937 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T23:12:05.982 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T23:12:05.986 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T23:12:06.032 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T23:12:06.036 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T23:12:06.052 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T23:12:06.071 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T23:12:06.096 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T23:12:06.115 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T23:12:06.128 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T23:12:06.153 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T23:12:06.187 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T23:12:06.208 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T23:12:06.217 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T23:12:06.252 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T23:12:06.295 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T23:12:06.413 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T23:12:06.439 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T23:12:06.452 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T23:12:06.495 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T23:12:06.533 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T23:12:06.548 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T23:12:06.573 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T23:12:06.678 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:12:06.679 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T23:12:06.682 INFO:teuthology.orchestra.run.smithi003.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T23:12:06.800 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T23:12:06.826 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:12:06.843 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T23:12:06.854 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:12:06.886 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T23:12:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T23:12:06.927 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T23:12:06.969 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:12:06.971 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T23:12:06.975 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T23:12:07.006 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T23:12:07.007 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T23:12:07.018 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T23:12:07.042 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T23:12:07.044 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T23:12:07.057 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T23:12:07.094 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T23:12:07.103 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T23:12:07.129 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T23:12:07.152 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T23:12:07.162 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T23:12:07.197 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T23:12:07.205 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T23:12:07.238 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T23:12:07.247 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T23:12:07.273 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T23:12:07.338 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T23:12:07.342 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T23:12:07.367 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:12:07.396 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T23:12:07.430 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T23:12:07.440 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T23:12:07.481 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T23:12:07.505 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:12:07.524 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T23:12:07.535 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T23:12:07.587 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T23:12:07.618 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T23:12:07.645 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T23:12:07.653 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T23:12:07.657 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T23:12:07.684 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T23:12:07.697 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T23:12:07.739 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T23:12:07.769 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T23:12:07.793 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T23:12:07.918 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T23:12:07.931 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T23:12:08.090 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T23:12:08.114 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T23:12:08.129 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T23:12:08.166 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T23:12:08.205 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T23:12:08.250 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T23:12:08.306 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T23:12:08.310 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T23:12:08.343 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T23:12:08.377 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T23:12:08.411 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T23:12:08.440 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:12:08.454 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T23:12:08.495 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T23:12:08.550 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T23:12:08.570 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:12:08.600 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T23:12:08.605 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T23:12:08.638 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T23:12:08.654 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T23:12:08.690 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T23:12:08.755 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T23:12:08.814 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T23:12:08.818 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T23:12:08.865 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:12:08.866 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T23:12:08.879 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T23:12:08.964 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T23:12:09.007 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T23:12:09.026 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T23:12:09.066 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T23:12:09.112 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T23:12:09.196 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T23:12:09.241 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T23:12:09.257 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T23:12:09.288 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T23:12:09.320 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T23:12:09.374 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T23:12:09.386 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T23:12:09.420 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T23:12:09.455 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T23:12:09.546 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T23:12:09.608 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T23:12:09.651 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T23:12:09.697 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T23:12:09.790 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T23:12:09.829 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T23:12:09.829 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T23:12:09.873 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T23:12:09.888 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T23:12:09.901 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T23:12:09.922 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T23:12:09.993 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T23:12:10.042 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T23:12:10.054 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T23:12:10.106 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T23:12:10.148 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T23:12:10.159 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T23:12:10.193 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T23:12:10.268 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T23:12:10.314 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T23:12:10.320 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T23:12:10.341 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T23:12:10.382 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T23:12:10.566 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T23:12:10.603 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T23:12:10.702 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T23:12:11.051 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T23:12:11.153 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T23:12:11.225 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T23:12:11.271 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T23:12:11.308 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T23:12:11.362 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T23:12:11.551 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T23:12:11.553 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T23:12:11.612 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T23:12:11.688 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T23:12:11.732 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T23:12:11.816 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T23:12:11.902 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T23:12:11.903 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T23:12:11.938 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T23:12:11.975 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T23:12:12.002 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T23:12:12.035 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T23:12:12.038 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T23:12:12.070 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T23:12:12.074 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T23:12:12.120 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T23:12:12.178 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T23:12:12.382 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T23:12:12.426 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T23:12:12.453 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T23:12:12.482 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T23:12:12.496 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T23:12:12.609 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T23:12:12.625 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T23:12:12.646 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T23:12:12.661 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T23:12:12.694 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T23:12:12.703 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T23:12:12.733 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T23:12:12.749 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T23:12:12.865 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T23:12:13.043 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T23:12:13.085 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T23:12:13.119 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T23:12:13.166 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T23:12:13.221 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T23:12:13.231 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T23:12:13.251 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T23:12:13.270 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T23:12:13.307 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T23:12:13.351 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T23:12:13.358 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T23:12:13.375 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T23:12:13.383 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T23:12:13.621 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T23:12:13.621 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T23:12:13.622 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T23:12:13.622 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T23:12:13.622 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T23:12:13.622 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T23:12:13.622 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T23:12:13.652 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T23:12:13.688 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T23:12:13.816 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T23:12:13.893 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T23:12:13.893 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T23:12:13.939 INFO:teuthology.orchestra.run.smithi003.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T23:12:14.078 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T23:12:14.112 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T23:12:14.161 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T23:12:14.730 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T23:12:14.827 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T23:12:14.878 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T23:12:14.912 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T23:12:14.942 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T23:12:15.029 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T23:12:15.033 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T23:12:15.060 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T23:12:15.087 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T23:12:15.167 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T23:12:15.275 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T23:12:15.314 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T23:12:15.562 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T23:12:15.594 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T23:12:15.682 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T23:12:16.033 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:12:16.074 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:12:16.534 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T23:12:16.688 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T23:12:16.712 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:12:16.761 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T23:12:16.884 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T23:12:16.884 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T23:12:16.884 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T23:12:16.884 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-10T23:12:16.937 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T23:12:17.739 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:12:17.781 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:12:18.346 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T23:12:18.466 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:12:18.509 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T23:12:18.518 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T23:12:18.546 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T23:12:18.579 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T23:12:18.660 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T23:12:18.660 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T23:12:18.660 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T23:12:18.660 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:12:18.711 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T23:12:18.944 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T23:12:18.999 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T23:12:19.120 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T23:12:19.154 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T23:12:19.203 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T23:12:19.774 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T23:12:19.801 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T23:12:19.892 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T23:12:19.928 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T23:12:22.553 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:12:22.591 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:12:23.282 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:12:23.327 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T23:12:23.468 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T23:12:23.468 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T23:12:23.468 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T23:12:23.468 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T23:12:23.511 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T23:12:29.391 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T23:12:29.391 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /sys 2024-09-10T23:12:29.391 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /proc 2024-09-10T23:12:29.392 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /mnt 2024-09-10T23:12:29.392 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /var/tmp 2024-09-10T23:12:29.392 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /home 2024-09-10T23:12:29.392 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /root 2024-09-10T23:12:29.392 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /tmp 2024-09-10T23:12:29.392 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-10T23:12:29.596 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T23:12:29.638 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T23:12:29.638 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:29.639 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T23:12:29.639 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-10T23:12:31.232 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T23:12:31.290 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T23:12:31.290 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:31.291 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T23:12:31.291 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:12:31.291 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:12:31.291 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-10T23:12:31.549 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T23:12:31.600 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T23:12:31.600 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:31.601 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T23:12:31.601 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:12:31.601 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:12:31.601 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-10T23:12:32.009 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T23:12:32.009 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /sys 2024-09-10T23:12:32.009 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /proc 2024-09-10T23:12:32.009 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /mnt 2024-09-10T23:12:32.009 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /var/tmp 2024-09-10T23:12:32.009 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /home 2024-09-10T23:12:32.009 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /root 2024-09-10T23:12:32.009 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /tmp 2024-09-10T23:12:32.010 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:12:32.091 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T23:12:32.143 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T23:12:32.143 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:32.143 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T23:12:32.143 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:12:32.144 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:12:32.144 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-10T23:12:32.238 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T23:12:32.275 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T23:12:32.275 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:32.275 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T23:12:32.275 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:12:32.276 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T23:12:32.336 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T23:12:32.400 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T23:12:32.629 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T23:12:32.696 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T23:12:32.803 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T23:12:32.916 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T23:12:33.092 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T23:12:33.139 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T23:12:33.176 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T23:12:33.202 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T23:12:33.810 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T23:12:33.843 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T23:12:33.885 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T23:12:33.965 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T23:12:33.966 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T23:12:33.998 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T23:12:34.025 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T23:12:34.025 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:34.025 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T23:12:34.025 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:12:34.025 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:12:34.025 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:12:34.282 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T23:12:34.333 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T23:12:34.333 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:34.333 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T23:12:34.333 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:12:34.334 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:12:34.334 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:12:34.850 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T23:12:34.901 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T23:12:34.902 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:34.902 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T23:12:34.902 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:12:34.902 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:12:34.902 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:12:35.034 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T23:12:35.096 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T23:12:35.169 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T23:12:35.407 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T23:12:35.579 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T23:12:35.668 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T23:12:35.788 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T23:12:35.963 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T23:12:36.012 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T23:12:36.052 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T23:12:36.102 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T23:12:36.635 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T23:12:36.697 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T23:12:36.735 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T23:12:36.819 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T23:12:36.857 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T23:12:36.976 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T23:12:36.976 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /sys 2024-09-10T23:12:36.976 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /proc 2024-09-10T23:12:36.976 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /mnt 2024-09-10T23:12:36.977 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /var/tmp 2024-09-10T23:12:36.977 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /home 2024-09-10T23:12:36.977 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /root 2024-09-10T23:12:36.977 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /tmp 2024-09-10T23:12:36.977 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T23:12:37.189 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T23:12:37.225 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T23:12:37.225 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:37.225 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T23:12:37.225 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T23:12:37.654 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T23:12:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T23:12:38.808 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T23:12:38.837 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T23:12:38.935 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T23:12:38.990 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T23:12:38.993 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T23:12:38.993 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:38.993 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T23:12:38.993 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:12:38.993 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:12:38.993 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T23:12:39.186 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T23:12:39.223 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T23:12:39.252 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T23:12:39.273 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T23:12:39.273 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:39.273 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T23:12:39.273 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:12:39.273 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:12:39.273 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-10T23:12:39.303 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T23:12:39.303 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:39.303 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T23:12:39.303 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:12:39.304 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:12:39.304 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T23:12:39.332 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T23:12:39.358 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T23:12:39.466 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T23:12:39.539 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T23:12:39.819 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T23:12:39.871 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T23:12:39.871 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:39.871 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T23:12:39.871 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:12:39.871 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:12:39.871 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T23:12:40.004 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T23:12:40.064 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T23:12:40.137 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T23:12:40.374 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T23:12:40.441 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T23:12:40.530 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T23:12:40.579 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T23:12:40.609 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T23:12:40.646 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T23:12:40.660 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T23:12:40.660 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:40.660 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T23:12:40.660 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:12:40.660 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:12:40.660 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-10T23:12:40.719 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T23:12:40.727 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T23:12:40.768 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T23:12:40.768 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:40.768 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T23:12:40.768 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-10T23:12:40.788 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T23:12:40.816 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T23:12:40.819 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T23:12:40.869 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T23:12:40.869 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:40.869 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T23:12:40.869 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:12:40.869 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:12:40.870 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-10T23:12:40.875 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T23:12:40.922 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T23:12:40.963 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T23:12:41.203 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T23:12:41.254 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T23:12:41.254 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:41.254 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T23:12:41.254 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:12:41.254 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:12:41.255 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-10T23:12:41.489 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T23:12:41.521 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T23:12:41.564 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T23:12:41.647 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T23:12:41.676 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T23:12:41.947 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T23:12:41.979 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T23:12:42.139 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T23:12:42.328 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T23:12:42.356 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T23:12:42.409 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T23:12:42.409 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:42.409 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T23:12:42.409 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:12:42.409 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:12:42.409 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:12:42.465 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T23:12:42.492 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T23:12:42.604 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T23:12:42.671 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T23:12:43.785 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T23:12:43.818 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T23:12:43.870 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T23:12:43.870 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:43.870 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T23:12:43.870 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:12:43.870 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:12:43.870 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:12:43.935 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T23:12:43.986 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T23:12:43.986 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:43.986 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T23:12:43.986 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:12:44.035 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T23:12:44.088 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T23:12:44.088 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:44.088 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T23:12:44.088 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:12:44.088 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:12:44.088 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:12:44.453 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T23:12:44.505 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T23:12:44.505 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:44.505 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T23:12:44.505 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:12:44.506 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:12:44.506 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:12:45.540 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T23:12:45.608 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T23:12:46.326 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T23:12:46.367 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T23:12:46.411 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T23:12:46.440 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T23:12:46.475 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T23:12:46.716 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T23:12:46.764 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T23:12:46.772 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T23:12:46.799 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T23:12:46.802 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T23:12:46.833 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T23:12:46.877 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T23:12:46.958 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T23:12:47.147 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T23:12:47.177 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T23:12:47.229 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T23:12:47.229 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:47.229 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T23:12:47.229 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:12:47.229 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:12:47.229 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T23:12:47.286 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T23:12:47.312 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T23:12:47.444 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T23:12:47.510 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T23:12:47.832 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:12:47.891 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:12:47.934 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:12:48.610 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T23:12:48.638 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T23:12:48.690 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T23:12:48.691 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:48.691 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T23:12:48.691 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:12:48.691 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:12:48.691 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T23:12:48.741 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T23:12:48.789 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T23:12:48.789 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:48.789 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T23:12:48.789 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T23:12:48.848 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T23:12:48.901 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T23:12:48.901 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:48.902 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T23:12:48.902 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:12:48.902 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:12:48.902 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T23:12:49.192 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T23:12:49.265 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T23:12:49.297 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T23:12:49.317 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T23:12:49.317 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:49.317 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T23:12:49.317 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:12:49.317 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:12:49.317 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T23:12:49.344 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T23:12:49.453 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T23:12:49.499 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T23:12:49.524 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T23:12:49.561 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T23:12:49.561 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T23:12:49.668 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T23:12:49.668 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T23:12:49.777 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T23:12:49.801 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T23:12:49.817 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:12:49.817 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:12:49.901 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T23:12:49.951 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T23:12:49.994 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T23:12:50.031 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T23:12:50.066 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T23:12:50.079 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:12:50.079 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T23:12:50.222 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T23:12:50.295 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:12:50.309 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T23:12:50.363 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T23:12:50.393 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T23:12:50.432 INFO:teuthology.orchestra.run.smithi003.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T23:12:50.476 INFO:teuthology.orchestra.run.smithi003.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T23:12:50.548 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:12:50.548 INFO:teuthology.orchestra.run.smithi194.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-10T23:12:50.548 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-10T23:12:51.249 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:12:51.298 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:12:51.341 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:12:52.716 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T23:12:52.837 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T23:12:52.894 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T23:12:53.015 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T23:12:53.056 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T23:12:53.081 INFO:teuthology.orchestra.run.smithi003.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T23:12:53.118 INFO:teuthology.orchestra.run.smithi003.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T23:12:53.118 INFO:teuthology.orchestra.run.smithi003.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T23:12:53.234 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T23:12:53.234 INFO:teuthology.orchestra.run.smithi003.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T23:12:53.343 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T23:12:53.367 INFO:teuthology.orchestra.run.smithi003.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T23:12:53.383 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:12:53.383 INFO:teuthology.orchestra.run.smithi003.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:12:53.636 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:12:53.637 INFO:teuthology.orchestra.run.smithi003.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T23:12:53.745 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T23:12:53.823 INFO:teuthology.orchestra.run.smithi003.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:12:54.031 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:12:54.031 INFO:teuthology.orchestra.run.smithi003.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-10T23:12:54.032 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:12:54.714 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T23:12:54.755 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T23:12:54.799 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T23:12:54.827 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T23:12:54.863 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T23:12:55.144 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T23:12:55.193 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T23:12:55.223 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T23:12:55.254 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T23:12:55.307 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T23:12:56.057 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:12:56.104 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:12:56.145 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:12:56.852 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T23:12:56.852 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T23:12:56.853 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T23:12:56.853 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T23:12:56.853 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T23:12:56.853 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T23:12:56.853 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T23:12:56.853 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:12:56.853 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:12:56.853 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T23:12:56.853 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T23:12:56.853 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T23:12:56.853 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T23:12:56.853 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:12:56.853 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T23:12:56.854 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T23:12:56.854 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T23:12:56.854 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T23:12:56.854 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T23:12:56.854 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T23:12:56.854 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T23:12:56.854 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T23:12:56.854 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T23:12:56.854 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T23:12:56.854 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T23:12:56.854 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T23:12:56.854 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T23:12:56.854 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T23:12:56.854 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T23:12:56.855 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T23:12:56.855 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T23:12:56.855 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T23:12:56.855 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T23:12:56.855 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T23:12:56.855 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T23:12:56.855 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T23:12:56.855 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T23:12:56.855 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T23:12:56.855 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T23:12:56.855 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T23:12:56.855 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T23:12:56.856 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T23:12:56.856 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T23:12:56.856 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T23:12:56.856 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T23:12:56.856 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T23:12:56.856 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T23:12:56.856 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T23:12:56.856 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T23:12:56.856 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T23:12:56.856 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T23:12:56.856 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T23:12:56.856 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T23:12:56.856 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T23:12:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T23:12:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T23:12:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T23:12:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T23:12:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T23:12:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T23:12:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T23:12:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T23:12:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T23:12:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T23:12:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T23:12:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T23:12:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T23:12:56.858 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T23:12:56.858 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T23:12:56.858 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T23:12:56.858 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T23:12:56.858 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T23:12:56.858 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T23:12:56.858 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T23:12:56.858 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T23:12:56.858 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T23:12:56.858 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T23:12:56.858 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T23:12:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T23:12:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T23:12:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T23:12:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T23:12:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T23:12:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T23:12:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T23:12:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T23:12:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T23:12:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T23:12:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T23:12:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T23:12:56.860 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T23:12:56.860 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T23:12:56.860 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T23:12:56.860 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T23:12:56.860 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T23:12:56.860 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T23:12:56.860 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T23:12:56.860 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T23:12:56.860 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T23:12:56.860 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T23:12:56.860 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T23:12:56.860 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T23:12:56.860 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T23:12:56.861 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T23:12:56.861 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T23:12:56.861 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T23:12:56.861 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T23:12:56.861 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T23:12:56.861 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T23:12:56.861 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T23:12:56.861 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T23:12:56.861 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T23:12:56.861 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T23:12:56.861 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T23:12:56.861 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T23:12:56.861 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T23:12:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T23:12:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T23:12:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T23:12:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T23:12:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T23:12:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T23:12:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T23:12:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T23:12:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T23:12:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T23:12:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T23:12:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T23:12:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T23:12:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T23:12:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T23:12:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T23:12:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T23:12:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T23:12:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T23:12:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T23:12:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T23:12:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T23:12:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T23:12:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T23:12:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T23:12:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T23:12:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T23:12:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T23:12:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T23:12:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T23:12:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T23:12:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T23:12:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T23:12:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T23:12:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T23:12:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T23:12:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T23:12:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T23:12:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T23:12:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T23:12:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T23:12:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T23:12:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T23:12:56.865 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T23:12:56.865 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T23:12:56.865 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T23:12:56.865 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T23:12:56.865 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T23:12:57.522 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T23:12:57.626 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T23:12:57.681 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T23:12:57.794 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T23:12:57.828 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T23:12:57.854 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T23:12:57.899 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T23:12:57.899 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T23:12:58.015 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T23:12:58.015 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T23:12:58.124 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T23:12:58.148 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T23:12:58.164 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:12:58.164 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:12:58.409 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:12:58.409 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T23:12:58.519 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T23:12:58.595 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:12:58.805 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:12:58.805 INFO:teuthology.orchestra.run.smithi038.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-10T23:12:58.805 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T23:12:59.030 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:12:59.030 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-10T23:12:59.031 INFO:teuthology.orchestra.run.smithi194.stdout:Upgraded: 2024-09-10T23:12:59.031 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T23:12:59.031 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T23:12:59.031 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T23:12:59.031 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T23:12:59.031 INFO:teuthology.orchestra.run.smithi194.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:59.031 INFO:teuthology.orchestra.run.smithi194.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:59.031 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T23:12:59.031 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T23:12:59.031 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-10T23:12:59.031 INFO:teuthology.orchestra.run.smithi194.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T23:12:59.031 INFO:teuthology.orchestra.run.smithi194.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T23:12:59.031 INFO:teuthology.orchestra.run.smithi194.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T23:12:59.032 INFO:teuthology.orchestra.run.smithi194.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T23:12:59.032 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:59.032 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:59.032 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:59.032 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:59.032 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:59.032 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:59.032 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:59.032 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:59.032 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:59.032 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:59.032 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:59.032 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:59.033 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:59.033 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:59.033 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:59.033 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:59.033 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:59.033 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:59.033 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:59.033 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:59.033 INFO:teuthology.orchestra.run.smithi194.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:59.033 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:59.033 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:59.033 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:59.033 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T23:12:59.034 INFO:teuthology.orchestra.run.smithi194.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T23:12:59.034 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T23:12:59.034 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T23:12:59.034 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T23:12:59.034 INFO:teuthology.orchestra.run.smithi194.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T23:12:59.034 INFO:teuthology.orchestra.run.smithi194.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T23:12:59.034 INFO:teuthology.orchestra.run.smithi194.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T23:12:59.034 INFO:teuthology.orchestra.run.smithi194.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T23:12:59.034 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T23:12:59.034 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T23:12:59.034 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:59.034 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:59.034 INFO:teuthology.orchestra.run.smithi194.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:59.034 INFO:teuthology.orchestra.run.smithi194.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T23:12:59.035 INFO:teuthology.orchestra.run.smithi194.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T23:12:59.035 INFO:teuthology.orchestra.run.smithi194.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T23:12:59.035 INFO:teuthology.orchestra.run.smithi194.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T23:12:59.035 INFO:teuthology.orchestra.run.smithi194.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T23:12:59.035 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T23:12:59.035 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:59.035 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:59.035 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T23:12:59.035 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:59.035 INFO:teuthology.orchestra.run.smithi194.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T23:12:59.035 INFO:teuthology.orchestra.run.smithi194.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T23:12:59.035 INFO:teuthology.orchestra.run.smithi194.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T23:12:59.035 INFO:teuthology.orchestra.run.smithi194.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T23:12:59.035 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T23:12:59.035 INFO:teuthology.orchestra.run.smithi194.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T23:12:59.036 INFO:teuthology.orchestra.run.smithi194.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T23:12:59.036 INFO:teuthology.orchestra.run.smithi194.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T23:12:59.036 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T23:12:59.036 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T23:12:59.036 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T23:12:59.036 INFO:teuthology.orchestra.run.smithi194.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T23:12:59.036 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T23:12:59.036 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T23:12:59.036 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T23:12:59.036 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T23:12:59.036 INFO:teuthology.orchestra.run.smithi194.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T23:12:59.036 INFO:teuthology.orchestra.run.smithi194.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T23:12:59.036 INFO:teuthology.orchestra.run.smithi194.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T23:12:59.036 INFO:teuthology.orchestra.run.smithi194.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T23:12:59.036 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T23:12:59.037 INFO:teuthology.orchestra.run.smithi194.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T23:12:59.037 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T23:12:59.037 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:59.037 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:59.037 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:59.037 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T23:12:59.037 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T23:12:59.037 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T23:12:59.037 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T23:12:59.037 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T23:12:59.037 INFO:teuthology.orchestra.run.smithi194.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T23:12:59.037 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T23:12:59.037 INFO:teuthology.orchestra.run.smithi194.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T23:12:59.038 INFO:teuthology.orchestra.run.smithi194.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T23:12:59.038 INFO:teuthology.orchestra.run.smithi194.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T23:12:59.038 INFO:teuthology.orchestra.run.smithi194.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T23:12:59.038 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T23:12:59.038 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T23:12:59.038 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T23:12:59.038 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T23:12:59.038 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T23:12:59.038 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T23:12:59.038 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T23:12:59.038 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T23:12:59.038 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T23:12:59.038 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T23:12:59.039 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T23:12:59.039 INFO:teuthology.orchestra.run.smithi194.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T23:12:59.039 INFO:teuthology.orchestra.run.smithi194.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T23:12:59.039 INFO:teuthology.orchestra.run.smithi194.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T23:12:59.039 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T23:12:59.039 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T23:12:59.039 INFO:teuthology.orchestra.run.smithi194.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T23:12:59.039 INFO:teuthology.orchestra.run.smithi194.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T23:12:59.039 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T23:12:59.039 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T23:12:59.039 INFO:teuthology.orchestra.run.smithi194.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T23:12:59.039 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T23:12:59.039 INFO:teuthology.orchestra.run.smithi194.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T23:12:59.039 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T23:12:59.040 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T23:12:59.040 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T23:12:59.040 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T23:12:59.040 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T23:12:59.040 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T23:12:59.040 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:59.040 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:59.040 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T23:12:59.040 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T23:12:59.040 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T23:12:59.040 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:59.040 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T23:12:59.040 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T23:12:59.040 INFO:teuthology.orchestra.run.smithi194.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T23:12:59.041 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T23:12:59.041 INFO:teuthology.orchestra.run.smithi194.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T23:12:59.041 INFO:teuthology.orchestra.run.smithi194.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T23:12:59.041 INFO:teuthology.orchestra.run.smithi194.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T23:12:59.041 INFO:teuthology.orchestra.run.smithi194.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T23:12:59.041 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T23:12:59.041 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T23:12:59.041 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T23:12:59.041 INFO:teuthology.orchestra.run.smithi194.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T23:12:59.041 INFO:teuthology.orchestra.run.smithi194.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T23:12:59.041 INFO:teuthology.orchestra.run.smithi194.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T23:12:59.041 INFO:teuthology.orchestra.run.smithi194.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T23:12:59.041 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:59.042 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:59.042 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:59.042 INFO:teuthology.orchestra.run.smithi194.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T23:12:59.042 INFO:teuthology.orchestra.run.smithi194.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T23:12:59.042 INFO:teuthology.orchestra.run.smithi194.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T23:12:59.042 INFO:teuthology.orchestra.run.smithi194.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T23:12:59.042 INFO:teuthology.orchestra.run.smithi194.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T23:12:59.042 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T23:12:59.042 INFO:teuthology.orchestra.run.smithi194.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T23:12:59.042 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-10T23:12:59.043 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-10T23:12:59.713 DEBUG:teuthology.parallel:result is None 2024-09-10T23:13:00.146 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T23:13:00.146 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T23:13:00.146 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T23:13:00.146 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T23:13:00.146 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T23:13:00.146 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T23:13:00.146 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T23:13:00.146 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:13:00.146 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:13:00.146 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T23:13:00.147 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T23:13:00.147 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T23:13:00.147 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T23:13:00.147 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:13:00.147 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T23:13:00.147 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T23:13:00.147 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T23:13:00.147 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T23:13:00.147 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T23:13:00.147 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T23:13:00.147 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T23:13:00.147 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T23:13:00.147 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T23:13:00.147 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T23:13:00.148 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T23:13:00.148 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T23:13:00.148 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T23:13:00.148 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T23:13:00.148 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T23:13:00.148 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T23:13:00.148 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T23:13:00.148 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T23:13:00.148 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T23:13:00.148 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T23:13:00.148 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T23:13:00.148 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T23:13:00.148 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T23:13:00.149 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T23:13:00.149 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T23:13:00.149 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T23:13:00.149 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T23:13:00.149 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T23:13:00.149 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T23:13:00.149 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T23:13:00.149 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T23:13:00.149 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T23:13:00.149 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T23:13:00.149 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T23:13:00.149 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T23:13:00.149 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T23:13:00.150 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T23:13:00.150 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T23:13:00.150 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T23:13:00.150 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T23:13:00.150 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T23:13:00.150 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T23:13:00.150 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T23:13:00.150 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T23:13:00.150 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T23:13:00.150 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T23:13:00.150 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T23:13:00.150 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T23:13:00.150 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T23:13:00.151 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T23:13:00.151 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T23:13:00.151 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T23:13:00.151 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T23:13:00.151 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T23:13:00.151 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T23:13:00.151 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T23:13:00.151 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T23:13:00.151 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T23:13:00.151 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T23:13:00.151 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T23:13:00.151 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T23:13:00.151 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T23:13:00.152 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T23:13:00.152 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T23:13:00.152 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T23:13:00.152 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T23:13:00.152 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T23:13:00.152 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T23:13:00.152 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T23:13:00.152 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T23:13:00.152 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T23:13:00.152 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T23:13:00.152 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T23:13:00.152 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T23:13:00.152 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T23:13:00.152 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T23:13:00.153 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T23:13:00.153 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T23:13:00.153 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T23:13:00.153 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T23:13:00.153 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T23:13:00.153 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T23:13:00.153 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T23:13:00.153 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T23:13:00.153 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T23:13:00.153 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T23:13:00.153 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T23:13:00.153 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T23:13:00.153 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T23:13:00.153 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T23:13:00.154 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T23:13:00.154 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T23:13:00.154 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T23:13:00.154 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T23:13:00.154 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T23:13:00.154 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T23:13:00.154 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T23:13:00.154 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T23:13:00.154 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T23:13:00.154 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T23:13:00.154 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T23:13:00.154 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T23:13:00.154 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T23:13:00.154 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T23:13:00.154 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T23:13:00.155 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T23:13:00.155 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T23:13:00.155 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T23:13:00.155 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T23:13:00.155 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T23:13:00.155 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T23:13:00.155 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T23:13:00.155 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T23:13:00.155 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T23:13:00.155 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T23:13:00.155 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T23:13:00.155 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T23:13:00.155 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T23:13:00.156 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T23:13:00.156 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T23:13:00.156 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T23:13:00.156 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T23:13:00.156 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T23:13:00.156 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T23:13:00.156 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T23:13:00.156 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T23:13:00.156 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T23:13:00.156 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T23:13:00.156 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T23:13:00.156 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T23:13:00.156 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T23:13:00.156 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T23:13:00.157 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T23:13:00.157 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T23:13:00.157 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T23:13:00.157 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T23:13:00.157 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T23:13:00.157 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T23:13:00.157 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T23:13:00.157 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T23:13:00.157 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T23:13:00.157 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T23:13:00.157 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T23:13:00.157 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T23:13:00.157 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T23:13:00.157 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T23:13:00.158 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T23:13:00.158 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T23:13:00.158 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T23:13:00.158 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T23:13:02.291 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:13:02.292 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:13:02.292 INFO:teuthology.orchestra.run.smithi003.stdout:Upgraded: 2024-09-10T23:13:02.292 INFO:teuthology.orchestra.run.smithi003.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T23:13:02.292 INFO:teuthology.orchestra.run.smithi003.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T23:13:02.292 INFO:teuthology.orchestra.run.smithi003.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T23:13:02.292 INFO:teuthology.orchestra.run.smithi003.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T23:13:02.292 INFO:teuthology.orchestra.run.smithi003.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:02.292 INFO:teuthology.orchestra.run.smithi003.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:02.292 INFO:teuthology.orchestra.run.smithi003.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T23:13:02.293 INFO:teuthology.orchestra.run.smithi003.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T23:13:02.293 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-10T23:13:02.293 INFO:teuthology.orchestra.run.smithi003.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T23:13:02.293 INFO:teuthology.orchestra.run.smithi003.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T23:13:02.293 INFO:teuthology.orchestra.run.smithi003.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T23:13:02.293 INFO:teuthology.orchestra.run.smithi003.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T23:13:02.293 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:02.293 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:02.293 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:02.293 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:02.293 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:13:02.294 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:02.294 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:02.294 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:02.294 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:13:02.294 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:13:02.294 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:13:02.294 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:13:02.294 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:13:02.294 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:02.294 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:02.295 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:13:02.295 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:02.295 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:02.295 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:02.295 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:13:02.295 INFO:teuthology.orchestra.run.smithi003.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:13:02.295 INFO:teuthology.orchestra.run.smithi003.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:02.295 INFO:teuthology.orchestra.run.smithi003.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:02.295 INFO:teuthology.orchestra.run.smithi003.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:13:02.295 INFO:teuthology.orchestra.run.smithi003.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T23:13:02.296 INFO:teuthology.orchestra.run.smithi003.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T23:13:02.296 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T23:13:02.296 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T23:13:02.296 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T23:13:02.296 INFO:teuthology.orchestra.run.smithi003.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T23:13:02.296 INFO:teuthology.orchestra.run.smithi003.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T23:13:02.296 INFO:teuthology.orchestra.run.smithi003.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T23:13:02.296 INFO:teuthology.orchestra.run.smithi003.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T23:13:02.297 INFO:teuthology.orchestra.run.smithi003.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T23:13:02.297 INFO:teuthology.orchestra.run.smithi003.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T23:13:02.297 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:02.297 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:02.297 INFO:teuthology.orchestra.run.smithi003.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:02.297 INFO:teuthology.orchestra.run.smithi003.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T23:13:02.297 INFO:teuthology.orchestra.run.smithi003.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T23:13:02.297 INFO:teuthology.orchestra.run.smithi003.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T23:13:02.297 INFO:teuthology.orchestra.run.smithi003.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T23:13:02.297 INFO:teuthology.orchestra.run.smithi003.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T23:13:02.298 INFO:teuthology.orchestra.run.smithi003.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T23:13:02.298 INFO:teuthology.orchestra.run.smithi003.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:02.298 INFO:teuthology.orchestra.run.smithi003.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:02.298 INFO:teuthology.orchestra.run.smithi003.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T23:13:02.298 INFO:teuthology.orchestra.run.smithi003.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:02.298 INFO:teuthology.orchestra.run.smithi003.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T23:13:02.298 INFO:teuthology.orchestra.run.smithi003.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T23:13:02.298 INFO:teuthology.orchestra.run.smithi003.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T23:13:02.298 INFO:teuthology.orchestra.run.smithi003.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T23:13:02.298 INFO:teuthology.orchestra.run.smithi003.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T23:13:02.298 INFO:teuthology.orchestra.run.smithi003.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T23:13:02.298 INFO:teuthology.orchestra.run.smithi003.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T23:13:02.299 INFO:teuthology.orchestra.run.smithi003.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T23:13:02.299 INFO:teuthology.orchestra.run.smithi003.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T23:13:02.299 INFO:teuthology.orchestra.run.smithi003.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T23:13:02.299 INFO:teuthology.orchestra.run.smithi003.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T23:13:02.299 INFO:teuthology.orchestra.run.smithi003.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T23:13:02.299 INFO:teuthology.orchestra.run.smithi003.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T23:13:02.299 INFO:teuthology.orchestra.run.smithi003.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T23:13:02.299 INFO:teuthology.orchestra.run.smithi003.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T23:13:02.299 INFO:teuthology.orchestra.run.smithi003.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T23:13:02.299 INFO:teuthology.orchestra.run.smithi003.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T23:13:02.299 INFO:teuthology.orchestra.run.smithi003.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T23:13:02.300 INFO:teuthology.orchestra.run.smithi003.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T23:13:02.300 INFO:teuthology.orchestra.run.smithi003.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T23:13:02.300 INFO:teuthology.orchestra.run.smithi003.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T23:13:02.300 INFO:teuthology.orchestra.run.smithi003.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T23:13:02.300 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T23:13:02.300 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:02.300 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:02.300 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:02.300 INFO:teuthology.orchestra.run.smithi003.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T23:13:02.300 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T23:13:02.300 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T23:13:02.301 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T23:13:02.301 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T23:13:02.301 INFO:teuthology.orchestra.run.smithi003.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T23:13:02.301 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T23:13:02.301 INFO:teuthology.orchestra.run.smithi003.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T23:13:02.301 INFO:teuthology.orchestra.run.smithi003.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T23:13:02.301 INFO:teuthology.orchestra.run.smithi003.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T23:13:02.301 INFO:teuthology.orchestra.run.smithi003.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T23:13:02.301 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T23:13:02.301 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T23:13:02.301 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T23:13:02.301 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T23:13:02.302 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T23:13:02.302 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T23:13:02.302 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T23:13:02.302 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T23:13:02.302 INFO:teuthology.orchestra.run.smithi003.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T23:13:02.302 INFO:teuthology.orchestra.run.smithi003.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T23:13:02.302 INFO:teuthology.orchestra.run.smithi003.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T23:13:02.302 INFO:teuthology.orchestra.run.smithi003.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T23:13:02.302 INFO:teuthology.orchestra.run.smithi003.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T23:13:02.302 INFO:teuthology.orchestra.run.smithi003.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T23:13:02.302 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T23:13:02.302 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T23:13:02.303 INFO:teuthology.orchestra.run.smithi003.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T23:13:02.303 INFO:teuthology.orchestra.run.smithi003.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T23:13:02.303 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T23:13:02.303 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T23:13:02.303 INFO:teuthology.orchestra.run.smithi003.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T23:13:02.303 INFO:teuthology.orchestra.run.smithi003.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T23:13:02.303 INFO:teuthology.orchestra.run.smithi003.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T23:13:02.303 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T23:13:02.303 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T23:13:02.303 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T23:13:02.303 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T23:13:02.303 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T23:13:02.304 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T23:13:02.304 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:02.304 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:02.304 INFO:teuthology.orchestra.run.smithi003.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T23:13:02.304 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T23:13:02.304 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T23:13:02.304 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:02.304 INFO:teuthology.orchestra.run.smithi003.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T23:13:02.304 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T23:13:02.304 INFO:teuthology.orchestra.run.smithi003.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T23:13:02.304 INFO:teuthology.orchestra.run.smithi003.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T23:13:02.304 INFO:teuthology.orchestra.run.smithi003.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T23:13:02.305 INFO:teuthology.orchestra.run.smithi003.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T23:13:02.305 INFO:teuthology.orchestra.run.smithi003.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T23:13:02.305 INFO:teuthology.orchestra.run.smithi003.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T23:13:02.305 INFO:teuthology.orchestra.run.smithi003.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T23:13:02.305 INFO:teuthology.orchestra.run.smithi003.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T23:13:02.305 INFO:teuthology.orchestra.run.smithi003.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T23:13:02.305 INFO:teuthology.orchestra.run.smithi003.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T23:13:02.305 INFO:teuthology.orchestra.run.smithi003.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T23:13:02.305 INFO:teuthology.orchestra.run.smithi003.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T23:13:02.305 INFO:teuthology.orchestra.run.smithi003.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T23:13:02.305 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:02.305 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:02.306 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:02.306 INFO:teuthology.orchestra.run.smithi003.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T23:13:02.306 INFO:teuthology.orchestra.run.smithi003.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T23:13:02.306 INFO:teuthology.orchestra.run.smithi003.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T23:13:02.306 INFO:teuthology.orchestra.run.smithi003.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T23:13:02.306 INFO:teuthology.orchestra.run.smithi003.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T23:13:02.306 INFO:teuthology.orchestra.run.smithi003.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T23:13:02.306 INFO:teuthology.orchestra.run.smithi003.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T23:13:02.306 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:13:02.307 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-10T23:13:02.902 DEBUG:teuthology.parallel:result is None 2024-09-10T23:13:05.410 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T23:13:05.410 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T23:13:05.410 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T23:13:05.410 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T23:13:05.410 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T23:13:05.410 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T23:13:05.410 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T23:13:05.410 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:13:05.410 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:13:05.410 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T23:13:05.410 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T23:13:05.410 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T23:13:05.411 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T23:13:05.411 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:13:05.411 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T23:13:05.411 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T23:13:05.411 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T23:13:05.411 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T23:13:05.411 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T23:13:05.411 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T23:13:05.411 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T23:13:05.411 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T23:13:05.411 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T23:13:05.412 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T23:13:05.412 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T23:13:05.412 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T23:13:05.412 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T23:13:05.428 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T23:13:05.428 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T23:13:05.428 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T23:13:05.429 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T23:13:05.429 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T23:13:05.429 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T23:13:05.429 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T23:13:05.429 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T23:13:05.429 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T23:13:05.429 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T23:13:05.429 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T23:13:05.429 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T23:13:05.429 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T23:13:05.429 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T23:13:05.429 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T23:13:05.430 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T23:13:05.430 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T23:13:05.430 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T23:13:05.430 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T23:13:05.430 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T23:13:05.430 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T23:13:05.430 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T23:13:05.430 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T23:13:05.430 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T23:13:05.430 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T23:13:05.430 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T23:13:05.430 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T23:13:05.430 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T23:13:05.430 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T23:13:05.431 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T23:13:05.431 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T23:13:05.431 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T23:13:05.431 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T23:13:05.431 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T23:13:05.431 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T23:13:05.431 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T23:13:05.431 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T23:13:05.431 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T23:13:05.431 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T23:13:05.431 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T23:13:05.431 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T23:13:05.431 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T23:13:05.432 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T23:13:05.432 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T23:13:05.432 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T23:13:05.432 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T23:13:05.432 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T23:13:05.432 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T23:13:05.432 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T23:13:05.432 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T23:13:05.432 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T23:13:05.432 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T23:13:05.432 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T23:13:05.432 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T23:13:05.432 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T23:13:05.433 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T23:13:05.433 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T23:13:05.433 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T23:13:05.433 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T23:13:05.433 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T23:13:05.433 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T23:13:05.433 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T23:13:05.433 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T23:13:05.433 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T23:13:05.433 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T23:13:05.433 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T23:13:05.433 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T23:13:05.433 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T23:13:05.434 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T23:13:05.434 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T23:13:05.434 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T23:13:05.434 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T23:13:05.434 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T23:13:05.434 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T23:13:05.434 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T23:13:05.434 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T23:13:05.434 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T23:13:05.434 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T23:13:05.434 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T23:13:05.434 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T23:13:05.434 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T23:13:05.434 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T23:13:05.434 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T23:13:05.435 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T23:13:05.435 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T23:13:05.435 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T23:13:05.435 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T23:13:05.435 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T23:13:05.435 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T23:13:05.435 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T23:13:05.435 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T23:13:05.435 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T23:13:05.435 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T23:13:05.435 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T23:13:05.435 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T23:13:05.435 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T23:13:05.435 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T23:13:05.436 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T23:13:05.436 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T23:13:05.436 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T23:13:05.436 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T23:13:05.436 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T23:13:05.436 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T23:13:05.436 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T23:13:05.436 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T23:13:05.436 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T23:13:05.436 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T23:13:05.436 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T23:13:05.436 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T23:13:05.436 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T23:13:05.436 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T23:13:05.437 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T23:13:05.437 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T23:13:05.437 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T23:13:05.437 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T23:13:05.437 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T23:13:05.437 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T23:13:05.437 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T23:13:05.437 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T23:13:05.437 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T23:13:05.437 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T23:13:05.437 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T23:13:05.437 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T23:13:05.437 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T23:13:05.437 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T23:13:05.438 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T23:13:05.438 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T23:13:05.438 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T23:13:05.438 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T23:13:05.438 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T23:13:05.438 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T23:13:05.438 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T23:13:05.438 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T23:13:05.438 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T23:13:05.438 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T23:13:05.438 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T23:13:05.438 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T23:13:07.760 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:13:07.760 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T23:13:07.760 INFO:teuthology.orchestra.run.smithi038.stdout:Upgraded: 2024-09-10T23:13:07.761 INFO:teuthology.orchestra.run.smithi038.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T23:13:07.761 INFO:teuthology.orchestra.run.smithi038.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T23:13:07.761 INFO:teuthology.orchestra.run.smithi038.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T23:13:07.761 INFO:teuthology.orchestra.run.smithi038.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T23:13:07.761 INFO:teuthology.orchestra.run.smithi038.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:07.761 INFO:teuthology.orchestra.run.smithi038.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:07.761 INFO:teuthology.orchestra.run.smithi038.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T23:13:07.761 INFO:teuthology.orchestra.run.smithi038.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T23:13:07.761 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-10T23:13:07.761 INFO:teuthology.orchestra.run.smithi038.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T23:13:07.761 INFO:teuthology.orchestra.run.smithi038.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T23:13:07.761 INFO:teuthology.orchestra.run.smithi038.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T23:13:07.761 INFO:teuthology.orchestra.run.smithi038.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T23:13:07.762 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:07.762 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:07.762 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:07.762 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:07.762 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:13:07.762 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:07.762 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:07.762 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:07.762 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:13:07.762 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:13:07.762 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:13:07.762 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:13:07.762 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:13:07.763 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:07.763 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:07.763 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:13:07.763 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:07.763 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:07.763 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:07.763 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:13:07.763 INFO:teuthology.orchestra.run.smithi038.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:13:07.763 INFO:teuthology.orchestra.run.smithi038.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:07.763 INFO:teuthology.orchestra.run.smithi038.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:07.763 INFO:teuthology.orchestra.run.smithi038.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:13:07.763 INFO:teuthology.orchestra.run.smithi038.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T23:13:07.763 INFO:teuthology.orchestra.run.smithi038.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T23:13:07.764 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T23:13:07.764 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T23:13:07.764 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T23:13:07.764 INFO:teuthology.orchestra.run.smithi038.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T23:13:07.764 INFO:teuthology.orchestra.run.smithi038.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T23:13:07.764 INFO:teuthology.orchestra.run.smithi038.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T23:13:07.764 INFO:teuthology.orchestra.run.smithi038.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T23:13:07.764 INFO:teuthology.orchestra.run.smithi038.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T23:13:07.764 INFO:teuthology.orchestra.run.smithi038.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T23:13:07.764 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:07.764 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:07.764 INFO:teuthology.orchestra.run.smithi038.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:07.764 INFO:teuthology.orchestra.run.smithi038.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T23:13:07.765 INFO:teuthology.orchestra.run.smithi038.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T23:13:07.765 INFO:teuthology.orchestra.run.smithi038.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T23:13:07.765 INFO:teuthology.orchestra.run.smithi038.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T23:13:07.765 INFO:teuthology.orchestra.run.smithi038.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T23:13:07.765 INFO:teuthology.orchestra.run.smithi038.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T23:13:07.765 INFO:teuthology.orchestra.run.smithi038.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:07.765 INFO:teuthology.orchestra.run.smithi038.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:07.765 INFO:teuthology.orchestra.run.smithi038.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T23:13:07.765 INFO:teuthology.orchestra.run.smithi038.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:07.765 INFO:teuthology.orchestra.run.smithi038.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T23:13:07.765 INFO:teuthology.orchestra.run.smithi038.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T23:13:07.765 INFO:teuthology.orchestra.run.smithi038.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T23:13:07.765 INFO:teuthology.orchestra.run.smithi038.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T23:13:07.766 INFO:teuthology.orchestra.run.smithi038.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T23:13:07.766 INFO:teuthology.orchestra.run.smithi038.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T23:13:07.766 INFO:teuthology.orchestra.run.smithi038.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T23:13:07.766 INFO:teuthology.orchestra.run.smithi038.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T23:13:07.766 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T23:13:07.766 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T23:13:07.766 INFO:teuthology.orchestra.run.smithi038.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T23:13:07.766 INFO:teuthology.orchestra.run.smithi038.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T23:13:07.766 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T23:13:07.766 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T23:13:07.766 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T23:13:07.766 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T23:13:07.766 INFO:teuthology.orchestra.run.smithi038.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T23:13:07.766 INFO:teuthology.orchestra.run.smithi038.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T23:13:07.767 INFO:teuthology.orchestra.run.smithi038.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T23:13:07.767 INFO:teuthology.orchestra.run.smithi038.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T23:13:07.767 INFO:teuthology.orchestra.run.smithi038.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T23:13:07.767 INFO:teuthology.orchestra.run.smithi038.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T23:13:07.767 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T23:13:07.767 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:07.767 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:07.767 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:07.767 INFO:teuthology.orchestra.run.smithi038.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T23:13:07.767 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T23:13:07.767 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T23:13:07.767 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T23:13:07.767 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T23:13:07.767 INFO:teuthology.orchestra.run.smithi038.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T23:13:07.767 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T23:13:07.768 INFO:teuthology.orchestra.run.smithi038.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T23:13:07.768 INFO:teuthology.orchestra.run.smithi038.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T23:13:07.768 INFO:teuthology.orchestra.run.smithi038.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T23:13:07.768 INFO:teuthology.orchestra.run.smithi038.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T23:13:07.768 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T23:13:07.768 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T23:13:07.768 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T23:13:07.768 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T23:13:07.768 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T23:13:07.768 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T23:13:07.768 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T23:13:07.768 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T23:13:07.768 INFO:teuthology.orchestra.run.smithi038.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T23:13:07.769 INFO:teuthology.orchestra.run.smithi038.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T23:13:07.769 INFO:teuthology.orchestra.run.smithi038.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T23:13:07.769 INFO:teuthology.orchestra.run.smithi038.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T23:13:07.769 INFO:teuthology.orchestra.run.smithi038.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T23:13:07.769 INFO:teuthology.orchestra.run.smithi038.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T23:13:07.769 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T23:13:07.769 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T23:13:07.769 INFO:teuthology.orchestra.run.smithi038.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T23:13:07.769 INFO:teuthology.orchestra.run.smithi038.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T23:13:07.769 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T23:13:07.769 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T23:13:07.769 INFO:teuthology.orchestra.run.smithi038.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T23:13:07.769 INFO:teuthology.orchestra.run.smithi038.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T23:13:07.770 INFO:teuthology.orchestra.run.smithi038.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T23:13:07.770 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T23:13:07.770 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T23:13:07.770 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T23:13:07.770 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T23:13:07.770 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T23:13:07.770 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T23:13:07.770 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:07.770 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:07.770 INFO:teuthology.orchestra.run.smithi038.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T23:13:07.770 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T23:13:07.771 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T23:13:07.771 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:07.771 INFO:teuthology.orchestra.run.smithi038.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T23:13:07.771 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T23:13:07.771 INFO:teuthology.orchestra.run.smithi038.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T23:13:07.771 INFO:teuthology.orchestra.run.smithi038.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T23:13:07.771 INFO:teuthology.orchestra.run.smithi038.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T23:13:07.771 INFO:teuthology.orchestra.run.smithi038.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T23:13:07.771 INFO:teuthology.orchestra.run.smithi038.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T23:13:07.771 INFO:teuthology.orchestra.run.smithi038.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T23:13:07.771 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T23:13:07.771 INFO:teuthology.orchestra.run.smithi038.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T23:13:07.771 INFO:teuthology.orchestra.run.smithi038.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T23:13:07.772 INFO:teuthology.orchestra.run.smithi038.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T23:13:07.772 INFO:teuthology.orchestra.run.smithi038.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T23:13:07.772 INFO:teuthology.orchestra.run.smithi038.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T23:13:07.772 INFO:teuthology.orchestra.run.smithi038.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T23:13:07.772 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:07.772 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:07.772 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:07.772 INFO:teuthology.orchestra.run.smithi038.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T23:13:07.772 INFO:teuthology.orchestra.run.smithi038.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T23:13:07.772 INFO:teuthology.orchestra.run.smithi038.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T23:13:07.772 INFO:teuthology.orchestra.run.smithi038.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T23:13:07.772 INFO:teuthology.orchestra.run.smithi038.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T23:13:07.772 INFO:teuthology.orchestra.run.smithi038.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T23:13:07.773 INFO:teuthology.orchestra.run.smithi038.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T23:13:07.773 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T23:13:07.773 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-10T23:13:08.500 DEBUG:teuthology.parallel:result is None 2024-09-10T23:13:08.501 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:13:08.651 DEBUG:teuthology.orchestra.run.smithi003:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T23:13:08.702 INFO:teuthology.orchestra.run.smithi003.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T23:13:08.702 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T23:13:08.702 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T23:13:08.704 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:13:08.849 DEBUG:teuthology.orchestra.run.smithi038:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T23:13:08.898 INFO:teuthology.orchestra.run.smithi038.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T23:13:08.898 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T23:13:08.898 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T23:13:08.900 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:13:09.045 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T23:13:09.096 INFO:teuthology.orchestra.run.smithi194.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T23:13:09.097 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T23:13:09.097 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T23:13:09.099 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T23:13:09.099 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-10T23:13:09.099 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T23:13:09.163 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-10T23:13:09.163 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T23:13:09.229 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-10T23:13:09.229 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T23:13:09.292 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T23:13:09.292 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-10T23:13:09.292 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T23:13:09.350 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T23:13:09.448 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-10T23:13:09.448 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T23:13:09.508 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T23:13:09.607 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-10T23:13:09.608 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T23:13:09.669 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T23:13:09.769 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T23:13:09.769 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-10T23:13:09.769 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T23:13:09.827 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T23:13:09.924 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-10T23:13:09.925 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T23:13:09.985 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T23:13:10.082 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-10T23:13:10.082 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T23:13:10.140 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T23:13:10.237 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T23:13:10.237 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-10T23:13:10.237 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T23:13:10.295 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T23:13:10.391 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-10T23:13:10.391 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T23:13:10.449 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T23:13:10.547 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-10T23:13:10.547 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T23:13:10.603 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T23:13:10.698 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-10T23:13:10.793 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug cephsqlite': 20, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True, 'mgr/snap_schedule/log_level': 'debug'}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'mds': {'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'mgr-modules': ['snap_schedule'], 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'subvols': {'create': 2}} 2024-09-10T23:13:10.793 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:13:10.794 INFO:tasks.cephadm:Cluster fsid is 3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:13:10.794 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-10T23:13:10.794 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.3', 'mon.b': '172.21.15.38', 'mon.c': '172.21.15.194'} 2024-09-10T23:13:10.794 INFO:tasks.cephadm:First mon is mon.a on smithi003 2024-09-10T23:13:10.794 INFO:tasks.cephadm:First mgr is x 2024-09-10T23:13:10.794 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-10T23:13:10.795 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname $(hostname -s) 2024-09-10T23:13:10.854 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname $(hostname -s) 2024-09-10T23:13:10.911 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname $(hostname -s) 2024-09-10T23:13:10.968 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-10T23:13:10.968 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:13:11.117 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82938/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4854-g8f219c47', 'node_name': '172.21.2.8+braggi08', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4854.g8f219c47'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-10 09:27:13.215997', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-hemanth-testing-2024-09-10-0723', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-10T23:13:11.272 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-hemanth-testing-2024-09-10-0723, sha1 8f219c476cb4f26fc5719c661c0323719a45cb30 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:13:11.273 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm 2024-09-10T23:13:11.273 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm 2024-09-10T23:13:11.274 DEBUG:teuthology.orchestra.run.smithi003:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T23:13:11.697 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 10 23:13 /home/ubuntu/cephtest/cephadm 2024-09-10T23:13:11.697 DEBUG:teuthology.orchestra.run.smithi038:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T23:13:12.122 INFO:teuthology.orchestra.run.smithi038.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 10 23:13 /home/ubuntu/cephtest/cephadm 2024-09-10T23:13:12.122 DEBUG:teuthology.orchestra.run.smithi194:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T23:13:12.532 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 10 23:13 /home/ubuntu/cephtest/cephadm 2024-09-10T23:13:12.533 DEBUG:teuthology.orchestra.run.smithi003:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T23:13:12.575 DEBUG:teuthology.orchestra.run.smithi038:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T23:13:12.617 DEBUG:teuthology.orchestra.run.smithi194:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T23:13:12.673 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 on all hosts... 2024-09-10T23:13:12.674 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-10T23:13:12.678 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-10T23:13:12.682 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-10T23:13:14.554 INFO:teuthology.orchestra.run.smithi003.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T23:13:14.657 INFO:teuthology.orchestra.run.smithi038.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T23:13:14.900 INFO:teuthology.orchestra.run.smithi194.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T23:13:47.820 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-10T23:13:47.821 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:13:47.821 INFO:teuthology.orchestra.run.smithi194.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-10T23:13:47.821 INFO:teuthology.orchestra.run.smithi194.stdout: "repo_digests": [ 2024-09-10T23:13:47.821 INFO:teuthology.orchestra.run.smithi194.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-10T23:13:47.821 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-10T23:13:47.821 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-10T23:13:49.803 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-10T23:13:49.803 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:13:49.804 INFO:teuthology.orchestra.run.smithi038.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-10T23:13:49.804 INFO:teuthology.orchestra.run.smithi038.stdout: "repo_digests": [ 2024-09-10T23:13:49.804 INFO:teuthology.orchestra.run.smithi038.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-10T23:13:49.804 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-09-10T23:13:49.804 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-10T23:13:50.970 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-10T23:13:50.970 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:13:50.970 INFO:teuthology.orchestra.run.smithi003.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-10T23:13:50.970 INFO:teuthology.orchestra.run.smithi003.stdout: "repo_digests": [ 2024-09-10T23:13:50.970 INFO:teuthology.orchestra.run.smithi003.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-10T23:13:50.970 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-10T23:13:50.970 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-10T23:13:51.001 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /etc/ceph 2024-09-10T23:13:51.060 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /etc/ceph 2024-09-10T23:13:51.121 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /etc/ceph 2024-09-10T23:13:51.180 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 777 /etc/ceph 2024-09-10T23:13:51.235 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 777 /etc/ceph 2024-09-10T23:13:51.292 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 777 /etc/ceph 2024-09-10T23:13:51.348 INFO:tasks.cephadm:Writing seed config... 2024-09-10T23:13:51.349 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-10T23:13:51.349 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-10T23:13:51.349 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-10T23:13:51.349 INFO:tasks.cephadm: override: [mgr] client mount timeout = 30 2024-09-10T23:13:51.349 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-10T23:13:51.349 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-10T23:13:51.349 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-10T23:13:51.350 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-10T23:13:51.350 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-10T23:13:51.350 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-10T23:13:51.350 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-10T23:13:51.350 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-10T23:13:51.350 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-10T23:13:51.350 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-10T23:13:51.350 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-10T23:13:51.350 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-10T23:13:51.350 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-10T23:13:51.350 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-10T23:13:51.350 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-10T23:13:51.350 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-10T23:13:51.350 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-10T23:13:51.350 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-10T23:13:51.350 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-10T23:13:51.351 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-10T23:13:51.351 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-10T23:13:51.351 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-10T23:13:51.351 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-10T23:13:51.351 DEBUG:teuthology.orchestra.run.smithi003:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-10T23:13:51.386 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 3f4e30d0-6fca-11ef-bcea-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 client mount timeout = 30 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 2024-09-10T23:13:51.386 DEBUG:teuthology.orchestra.run.smithi003:mon.a> sudo journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mon.a.service 2024-09-10T23:13:51.430 DEBUG:teuthology.orchestra.run.smithi003:mgr.x> sudo journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mgr.x.service 2024-09-10T23:13:51.475 INFO:tasks.cephadm:Bootstrapping... 2024-09-10T23:13:51.475 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 -v bootstrap --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.3 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:13:51.738 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:13:51.739 INFO:teuthology.orchestra.run.smithi003.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', '-v', 'bootstrap', '--fsid', '3f4e30d0-6fca-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.3', '--skip-admin-label'] 2024-09-10T23:13:51.739 INFO:teuthology.orchestra.run.smithi003.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-10T23:13:51.739 INFO:teuthology.orchestra.run.smithi003.stdout:Verifying podman|docker is present... 2024-09-10T23:13:51.784 INFO:teuthology.orchestra.run.smithi003.stdout:/bin/podman: stdout 5.2.2 2024-09-10T23:13:51.785 INFO:teuthology.orchestra.run.smithi003.stdout:Verifying lvm2 is present... 2024-09-10T23:13:51.785 INFO:teuthology.orchestra.run.smithi003.stdout:Verifying time synchronization is in place... 2024-09-10T23:13:51.799 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T23:13:51.799 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T23:13:51.811 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T23:13:51.811 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout inactive 2024-09-10T23:13:51.825 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout enabled 2024-09-10T23:13:51.837 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout active 2024-09-10T23:13:51.837 INFO:teuthology.orchestra.run.smithi003.stdout:Unit chronyd.service is enabled and running 2024-09-10T23:13:51.837 INFO:teuthology.orchestra.run.smithi003.stdout:Repeating the final host check... 2024-09-10T23:13:51.887 INFO:teuthology.orchestra.run.smithi003.stdout:/bin/podman: stdout 5.2.2 2024-09-10T23:13:51.887 INFO:teuthology.orchestra.run.smithi003.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-10T23:13:51.887 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl is present 2024-09-10T23:13:51.887 INFO:teuthology.orchestra.run.smithi003.stdout:lvcreate is present 2024-09-10T23:13:51.900 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T23:13:51.900 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T23:13:51.913 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T23:13:51.913 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout inactive 2024-09-10T23:13:51.926 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout enabled 2024-09-10T23:13:51.939 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout active 2024-09-10T23:13:51.939 INFO:teuthology.orchestra.run.smithi003.stdout:Unit chronyd.service is enabled and running 2024-09-10T23:13:51.939 INFO:teuthology.orchestra.run.smithi003.stdout:Host looks OK 2024-09-10T23:13:51.939 INFO:teuthology.orchestra.run.smithi003.stdout:Cluster fsid: 3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:13:51.939 INFO:teuthology.orchestra.run.smithi003.stdout:Acquiring lock 140165920547696 on /run/cephadm/3f4e30d0-6fca-11ef-bcea-c7b262605968.lock 2024-09-10T23:13:51.940 INFO:teuthology.orchestra.run.smithi003.stdout:Lock 140165920547696 acquired on /run/cephadm/3f4e30d0-6fca-11ef-bcea-c7b262605968.lock 2024-09-10T23:13:51.940 INFO:teuthology.orchestra.run.smithi003.stdout:Verifying IP 172.21.15.3 port 3300 ... 2024-09-10T23:13:51.940 INFO:teuthology.orchestra.run.smithi003.stdout:Verifying IP 172.21.15.3 port 6789 ... 2024-09-10T23:13:51.940 INFO:teuthology.orchestra.run.smithi003.stdout:Base mon IP(s) is [172.21.15.3:3300, 172.21.15.3:6789], mon addrv is [v2:172.21.15.3:3300,v1:172.21.15.3:6789] 2024-09-10T23:13:51.947 INFO:teuthology.orchestra.run.smithi003.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.3 metric 100 2024-09-10T23:13:51.947 INFO:teuthology.orchestra.run.smithi003.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.3 metric 100 2024-09-10T23:13:51.953 INFO:teuthology.orchestra.run.smithi003.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-10T23:13:51.953 INFO:teuthology.orchestra.run.smithi003.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-10T23:13:51.953 INFO:teuthology.orchestra.run.smithi003.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1772sec hoplimit 64 pref medium 2024-09-10T23:13:51.958 INFO:teuthology.orchestra.run.smithi003.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-10T23:13:51.959 INFO:teuthology.orchestra.run.smithi003.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-10T23:13:51.959 INFO:teuthology.orchestra.run.smithi003.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T23:13:51.959 INFO:teuthology.orchestra.run.smithi003.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-10T23:13:51.959 INFO:teuthology.orchestra.run.smithi003.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:15dc/64 scope link 2024-09-10T23:13:51.959 INFO:teuthology.orchestra.run.smithi003.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T23:13:51.960 INFO:teuthology.orchestra.run.smithi003.stdout:Mon IP `172.21.15.3` is in CIDR network `172.21.0.0/20` 2024-09-10T23:13:51.960 INFO:teuthology.orchestra.run.smithi003.stdout:Mon IP `172.21.15.3` is in CIDR network `172.21.0.0/20` 2024-09-10T23:13:51.960 INFO:teuthology.orchestra.run.smithi003.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-10T23:13:51.960 INFO:teuthology.orchestra.run.smithi003.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-10T23:13:51.961 INFO:teuthology.orchestra.run.smithi003.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T23:13:52.496 INFO:teuthology.orchestra.run.smithi003.stdout:/bin/podman: stdout 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 2024-09-10T23:13:52.496 INFO:teuthology.orchestra.run.smithi003.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T23:13:52.496 INFO:teuthology.orchestra.run.smithi003.stdout:/bin/podman: stderr Getting image source signatures 2024-09-10T23:13:52.496 INFO:teuthology.orchestra.run.smithi003.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-10T23:13:52.496 INFO:teuthology.orchestra.run.smithi003.stdout:/bin/podman: stderr Copying blob sha256:edd8cbe4deb828f809e8d76f308301dd93e971948e909d25cc03015fed1fd796 2024-09-10T23:13:52.496 INFO:teuthology.orchestra.run.smithi003.stdout:/bin/podman: stderr Copying config sha256:589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 2024-09-10T23:13:52.497 INFO:teuthology.orchestra.run.smithi003.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-10T23:14:03.274 INFO:teuthology.orchestra.run.smithi003.stdout:ceph: stdout ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev) 2024-09-10T23:14:03.274 INFO:teuthology.orchestra.run.smithi003.stdout:Ceph version: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev) 2024-09-10T23:14:03.274 INFO:teuthology.orchestra.run.smithi003.stdout:Extracting ceph user uid/gid from container image... 2024-09-10T23:14:04.303 INFO:teuthology.orchestra.run.smithi003.stdout:stat: stdout 167 167 2024-09-10T23:14:04.303 INFO:teuthology.orchestra.run.smithi003.stdout:Creating initial keys... 2024-09-10T23:14:05.301 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph-authtool: stdout AQC80uBmod8yKRAAj+GTppgbV8F/hg5kSC/uJw== 2024-09-10T23:14:06.277 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph-authtool: stdout AQC90uBmawAQJxAAh3wdJQ/MpE7RCCqmtDAiUQ== 2024-09-10T23:14:07.369 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph-authtool: stdout AQC+0uBmTIfQJhAAcKvORzuCvQb+6MXHbfg0ug== 2024-09-10T23:14:07.370 INFO:teuthology.orchestra.run.smithi003.stdout:Creating initial monmap... 2024-09-10T23:14:09.367 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T23:14:09.368 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-10T23:14:09.368 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:14:09.368 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T23:14:09.368 INFO:teuthology.orchestra.run.smithi003.stdout:monmaptool for a [v2:172.21.15.3:3300,v1:172.21.15.3:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T23:14:09.369 INFO:teuthology.orchestra.run.smithi003.stdout:setting min_mon_release = quincy 2024-09-10T23:14:09.369 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/monmaptool: set fsid to 3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:14:09.369 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T23:14:09.369 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:14:09.369 INFO:teuthology.orchestra.run.smithi003.stdout:Creating mon... 2024-09-10T23:14:10.354 INFO:teuthology.orchestra.run.smithi003.stdout:create mon.a on 2024-09-10T23:14:10.693 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-10T23:14:10.920 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-10T23:14:11.181 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968.target. 2024-09-10T23:14:11.181 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968.target. 2024-09-10T23:14:11.506 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mon.a 2024-09-10T23:14:11.507 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stderr Failed to reset failed state of unit ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-10T23:14:11.772 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968.target.wants/ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@.service. 2024-09-10T23:14:12.381 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:12 smithi003 podman[29972]: 2024-09-10 23:14:12.317307473 +0000 UTC m=+0.325263150 container start 92577528673dd475a81953da3a79389c54b5bd6cbce3e11e8ca2184d5f66e76b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mon-a, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T23:14:12.441 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T23:14:12.441 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout disabled 2024-09-10T23:14:12.455 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T23:14:12.455 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout inactive 2024-09-10T23:14:12.455 INFO:teuthology.orchestra.run.smithi003.stdout:firewalld.service is not enabled 2024-09-10T23:14:12.455 INFO:teuthology.orchestra.run.smithi003.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T23:14:12.456 INFO:teuthology.orchestra.run.smithi003.stdout:Waiting for mon to start... 2024-09-10T23:14:12.456 INFO:teuthology.orchestra.run.smithi003.stdout:Waiting for mon... 2024-09-10T23:14:12.702 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:12 smithi003 ceph-mon[29991]: mkfs 3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:14:12.702 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:12 smithi003 ceph-mon[29991]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T23:14:12.702 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:12 smithi003 bash[29972]: 92577528673dd475a81953da3a79389c54b5bd6cbce3e11e8ca2184d5f66e76b 2024-09-10T23:14:12.702 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:12 smithi003 systemd[1]: Started Ceph mon.a for 3f4e30d0-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:14:13.633 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:13 smithi003 ceph-mon[29991]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T23:14:13.634 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:13 smithi003 ceph-mon[29991]: monmap epoch 1 2024-09-10T23:14:13.634 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:13 smithi003 ceph-mon[29991]: fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:14:13.634 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:13 smithi003 ceph-mon[29991]: last_changed 2024-09-10T23:14:07.737715+0000 2024-09-10T23:14:13.634 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:13 smithi003 ceph-mon[29991]: created 2024-09-10T23:14:07.737715+0000 2024-09-10T23:14:13.634 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:13 smithi003 ceph-mon[29991]: min_mon_release 19 (squid) 2024-09-10T23:14:13.634 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:13 smithi003 ceph-mon[29991]: election_strategy: 1 2024-09-10T23:14:13.634 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:13 smithi003 ceph-mon[29991]: 0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2024-09-10T23:14:13.634 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:13 smithi003 ceph-mon[29991]: fsmap 2024-09-10T23:14:13.634 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:13 smithi003 ceph-mon[29991]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T23:14:13.634 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:13 smithi003 ceph-mon[29991]: mgrmap e1: no daemons active 2024-09-10T23:14:13.634 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:13 smithi003 ceph-mon[29991]: from='client.? 172.21.15.3:0/553164286' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-10T23:14:13.641 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout cluster: 2024-09-10T23:14:13.641 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout id: 3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:14:13.641 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-10T23:14:13.641 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-10T23:14:13.641 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout services: 2024-09-10T23:14:13.641 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.642774s) 2024-09-10T23:14:13.641 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-10T23:14:13.642 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-10T23:14:13.642 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-10T23:14:13.642 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout data: 2024-09-10T23:14:13.642 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-10T23:14:13.642 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-10T23:14:13.642 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-10T23:14:13.642 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout pgs: 2024-09-10T23:14:13.642 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-10T23:14:13.642 INFO:teuthology.orchestra.run.smithi003.stdout:mon is available 2024-09-10T23:14:13.642 INFO:teuthology.orchestra.run.smithi003.stdout:Assimilating anything we can from ceph.conf... 2024-09-10T23:14:14.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:14 smithi003 ceph-mon[29991]: from='client.? 172.21.15.3:0/2697782209' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-10T23:14:14.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:14 smithi003 ceph-mon[29991]: from='client.? 172.21.15.3:0/2697782209' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-10T23:14:14.789 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-10T23:14:14.789 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T23:14:14.789 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout fsid = 3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:14:14.790 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-10T23:14:14.790 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.3:3300,v1:172.21.15.3:6789] 2024-09-10T23:14:14.790 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T23:14:14.790 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T23:14:14.790 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T23:14:14.790 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T23:14:14.790 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-10T23:14:14.790 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T23:14:14.790 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T23:14:14.790 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-10T23:14:14.790 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T23:14:14.790 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T23:14:14.791 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T23:14:14.791 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T23:14:14.791 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T23:14:14.791 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T23:14:14.791 INFO:teuthology.orchestra.run.smithi003.stdout:Generating new minimal ceph.conf... 2024-09-10T23:14:15.668 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:15 smithi003 ceph-mon[29991]: from='client.? 172.21.15.3:0/3513474376' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:14:15.926 INFO:teuthology.orchestra.run.smithi003.stdout:Restarting the monitor... 2024-09-10T23:14:16.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:15 smithi003 systemd[1]: Stopping Ceph mon.a for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:14:16.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:16 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mon-a[29987]: 2024-09-10T23:14:16.319+0000 7f0b88c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:14:16.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:16 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mon-a[29987]: 2024-09-10T23:14:16.319+0000 7f0b88c00640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-10T23:14:16.871 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:16 smithi003 podman[30231]: 2024-09-10 23:14:16.58583171 +0000 UTC m=+0.416970433 container died 92577528673dd475a81953da3a79389c54b5bd6cbce3e11e8ca2184d5f66e76b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:14:17.216 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:16 smithi003 podman[30231]: 2024-09-10 23:14:16.964787647 +0000 UTC m=+0.795926367 container cleanup 92577528673dd475a81953da3a79389c54b5bd6cbce3e11e8ca2184d5f66e76b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=) 2024-09-10T23:14:17.216 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:16 smithi003 bash[30231]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mon-a 2024-09-10T23:14:17.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 podman[30243]: 2024-09-10 23:14:17.215732792 +0000 UTC m=+0.623404873 container remove 92577528673dd475a81953da3a79389c54b5bd6cbce3e11e8ca2184d5f66e76b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mon-a, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-10T23:14:17.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 systemd[1]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-10T23:14:17.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 systemd[1]: Stopped Ceph mon.a for 3f4e30d0-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:14:17.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 systemd[1]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mon.a.service: Consumed 1.217s CPU time. 2024-09-10T23:14:17.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 systemd[1]: Starting Ceph mon.a for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:14:17.969 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 podman[30330]: 2024-09-10 23:14:17.601517649 +0000 UTC m=+0.027201300 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:14:17.969 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 podman[30330]: 2024-09-10 23:14:17.708520249 +0000 UTC m=+0.134203900 container create 3744d202b7ecf0be37c7e7a56a24f7567a0c593d64857c7d9634c594a813d11a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-10T23:14:17.969 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 podman[30330]: 2024-09-10 23:14:17.927884699 +0000 UTC m=+0.353568350 container init 3744d202b7ecf0be37c7e7a56a24f7567a0c593d64857c7d9634c594a813d11a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-10T23:14:17.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 podman[30330]: 2024-09-10 23:14:17.934693469 +0000 UTC m=+0.360377122 container start 3744d202b7ecf0be37c7e7a56a24f7567a0c593d64857c7d9634c594a813d11a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mon-a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:14:18.020 INFO:teuthology.orchestra.run.smithi003.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-10T23:14:18.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T23:14:18.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev), process ceph-mon, pid 2 2024-09-10T23:14:18.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: pidfile_write: ignore empty --pid-file 2024-09-10T23:14:18.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: load: jerasure load: lrc 2024-09-10T23:14:18.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: RocksDB version: 7.9.2 2024-09-10T23:14:18.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Git sha 0 2024-09-10T23:14:18.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Compile date 2024-09-10 08:02:51 2024-09-10T23:14:18.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: DB SUMMARY 2024-09-10T23:14:18.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: DB Session ID: I0P3D05VV171IQI988P0 2024-09-10T23:14:18.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: CURRENT file: CURRENT 2024-09-10T23:14:18.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T23:14:18.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-10T23:14:18.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-10T23:14:18.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 95732 ; 2024-09-10T23:14:18.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.error_if_exists: 0 2024-09-10T23:14:18.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.create_if_missing: 0 2024-09-10T23:14:18.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.paranoid_checks: 1 2024-09-10T23:14:18.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T23:14:18.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T23:14:18.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T23:14:18.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.env: 0x55bc2c04c180 2024-09-10T23:14:18.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T23:14:18.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.info_log: 0x55bc62cd16e0 2024-09-10T23:14:18.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T23:14:18.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.statistics: (nil) 2024-09-10T23:14:18.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.use_fsync: 0 2024-09-10T23:14:18.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.max_log_file_size: 0 2024-09-10T23:14:18.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T23:14:18.224 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T23:14:18.224 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T23:14:18.224 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T23:14:18.224 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.allow_fallocate: 1 2024-09-10T23:14:18.224 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T23:14:18.224 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T23:14:18.224 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.use_direct_reads: 0 2024-09-10T23:14:18.224 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T23:14:18.224 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T23:14:18.224 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.db_log_dir: 2024-09-10T23:14:18.224 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.wal_dir: 2024-09-10T23:14:18.225 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T23:14:18.226 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T23:14:18.226 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T23:14:18.226 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T23:14:18.227 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T23:14:18.227 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T23:14:18.227 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T23:14:18.227 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T23:14:18.227 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.write_buffer_manager: 0x55bc62cd5b80 2024-09-10T23:14:18.227 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T23:14:18.227 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T23:14:18.227 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T23:14:18.227 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T23:14:18.227 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T23:14:18.228 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T23:14:18.228 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T23:14:18.228 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T23:14:18.228 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.unordered_write: 0 2024-09-10T23:14:18.228 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T23:14:18.228 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T23:14:18.228 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T23:14:18.228 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T23:14:18.228 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.row_cache: None 2024-09-10T23:14:18.228 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.wal_filter: None 2024-09-10T23:14:18.228 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T23:14:18.228 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T23:14:18.229 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.two_write_queues: 0 2024-09-10T23:14:18.229 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T23:14:18.229 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.wal_compression: 0 2024-09-10T23:14:18.229 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.atomic_flush: 0 2024-09-10T23:14:18.230 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T23:14:18.230 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T23:14:18.230 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T23:14:18.230 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.log_readahead_size: 0 2024-09-10T23:14:18.230 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T23:14:18.230 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T23:14:18.230 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T23:14:18.230 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T23:14:18.230 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T23:14:18.231 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T23:14:18.231 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T23:14:18.231 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.max_background_jobs: 2 2024-09-10T23:14:18.231 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.max_background_compactions: -1 2024-09-10T23:14:18.231 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.max_subcompactions: 1 2024-09-10T23:14:18.231 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T23:14:18.231 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T23:14:18.231 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T23:14:18.231 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T23:14:18.231 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T23:14:18.231 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T23:14:18.231 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T23:14:18.231 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T23:14:18.232 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.max_open_files: -1 2024-09-10T23:14:18.232 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T23:14:18.232 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T23:14:18.232 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T23:14:18.232 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T23:14:18.232 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.max_background_flushes: -1 2024-09-10T23:14:18.232 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Compression algorithms supported: 2024-09-10T23:14:18.232 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: kZSTD supported: 0 2024-09-10T23:14:18.232 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: kXpressCompression supported: 0 2024-09-10T23:14:18.232 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: kBZip2Compression supported: 0 2024-09-10T23:14:18.232 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T23:14:18.232 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: kLZ4Compression supported: 1 2024-09-10T23:14:18.232 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: kZlibCompression supported: 1 2024-09-10T23:14:18.233 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T23:14:18.233 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: kSnappyCompression supported: 1 2024-09-10T23:14:18.233 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T23:14:18.233 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T23:14:18.233 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-10T23:14:18.233 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T23:14:18.235 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T23:14:18.235 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.merge_operator: 2024-09-10T23:14:18.235 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.compaction_filter: None 2024-09-10T23:14:18.235 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T23:14:18.235 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T23:14:18.235 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T23:14:18.235 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T23:14:18.235 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55bc62cd1300) 2024-09-10T23:14:18.235 INFO:journalctl@ceph.mon.a.smithi003.stdout: cache_index_and_filter_blocks: 1 2024-09-10T23:14:18.236 INFO:journalctl@ceph.mon.a.smithi003.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T23:14:18.236 INFO:journalctl@ceph.mon.a.smithi003.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T23:14:18.236 INFO:journalctl@ceph.mon.a.smithi003.stdout: pin_top_level_index_and_filter: 1 2024-09-10T23:14:18.236 INFO:journalctl@ceph.mon.a.smithi003.stdout: index_type: 0 2024-09-10T23:14:18.236 INFO:journalctl@ceph.mon.a.smithi003.stdout: data_block_index_type: 0 2024-09-10T23:14:18.236 INFO:journalctl@ceph.mon.a.smithi003.stdout: index_shortening: 1 2024-09-10T23:14:18.236 INFO:journalctl@ceph.mon.a.smithi003.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T23:14:18.236 INFO:journalctl@ceph.mon.a.smithi003.stdout: checksum: 4 2024-09-10T23:14:18.236 INFO:journalctl@ceph.mon.a.smithi003.stdout: no_block_cache: 0 2024-09-10T23:14:18.236 INFO:journalctl@ceph.mon.a.smithi003.stdout: block_cache: 0x55bc62cc5610 2024-09-10T23:14:18.237 INFO:journalctl@ceph.mon.a.smithi003.stdout: block_cache_name: BinnedLRUCache 2024-09-10T23:14:18.237 INFO:journalctl@ceph.mon.a.smithi003.stdout: block_cache_options: 2024-09-10T23:14:18.237 INFO:journalctl@ceph.mon.a.smithi003.stdout: capacity : 536870912 2024-09-10T23:14:18.237 INFO:journalctl@ceph.mon.a.smithi003.stdout: num_shard_bits : 4 2024-09-10T23:14:18.237 INFO:journalctl@ceph.mon.a.smithi003.stdout: strict_capacity_limit : 0 2024-09-10T23:14:18.237 INFO:journalctl@ceph.mon.a.smithi003.stdout: high_pri_pool_ratio: 0.000 2024-09-10T23:14:18.237 INFO:journalctl@ceph.mon.a.smithi003.stdout: block_cache_compressed: (nil) 2024-09-10T23:14:18.237 INFO:journalctl@ceph.mon.a.smithi003.stdout: persistent_cache: (nil) 2024-09-10T23:14:18.237 INFO:journalctl@ceph.mon.a.smithi003.stdout: block_size: 4096 2024-09-10T23:14:18.237 INFO:journalctl@ceph.mon.a.smithi003.stdout: block_size_deviation: 10 2024-09-10T23:14:18.237 INFO:journalctl@ceph.mon.a.smithi003.stdout: block_restart_interval: 16 2024-09-10T23:14:18.238 INFO:journalctl@ceph.mon.a.smithi003.stdout: index_block_restart_interval: 1 2024-09-10T23:14:18.238 INFO:journalctl@ceph.mon.a.smithi003.stdout: metadata_block_size: 4096 2024-09-10T23:14:18.238 INFO:journalctl@ceph.mon.a.smithi003.stdout: partition_filters: 0 2024-09-10T23:14:18.238 INFO:journalctl@ceph.mon.a.smithi003.stdout: use_delta_encoding: 1 2024-09-10T23:14:18.238 INFO:journalctl@ceph.mon.a.smithi003.stdout: filter_policy: bloomfilter 2024-09-10T23:14:18.238 INFO:journalctl@ceph.mon.a.smithi003.stdout: whole_key_filtering: 1 2024-09-10T23:14:18.238 INFO:journalctl@ceph.mon.a.smithi003.stdout: verify_compression: 0 2024-09-10T23:14:18.238 INFO:journalctl@ceph.mon.a.smithi003.stdout: read_amp_bytes_per_bit: 0 2024-09-10T23:14:18.238 INFO:journalctl@ceph.mon.a.smithi003.stdout: format_version: 5 2024-09-10T23:14:18.238 INFO:journalctl@ceph.mon.a.smithi003.stdout: enable_index_compression: 1 2024-09-10T23:14:18.238 INFO:journalctl@ceph.mon.a.smithi003.stdout: block_align: 0 2024-09-10T23:14:18.238 INFO:journalctl@ceph.mon.a.smithi003.stdout: max_auto_readahead_size: 262144 2024-09-10T23:14:18.239 INFO:journalctl@ceph.mon.a.smithi003.stdout: prepopulate_block_cache: 0 2024-09-10T23:14:18.239 INFO:journalctl@ceph.mon.a.smithi003.stdout: initial_auto_readahead_size: 8192 2024-09-10T23:14:18.239 INFO:journalctl@ceph.mon.a.smithi003.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T23:14:18.239 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T23:14:18.239 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T23:14:18.239 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.compression: NoCompression 2024-09-10T23:14:18.239 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T23:14:18.239 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T23:14:18.239 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T23:14:18.239 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.num_levels: 7 2024-09-10T23:14:18.239 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T23:14:18.240 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T23:14:18.240 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T23:14:18.240 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T23:14:18.240 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T23:14:18.240 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T23:14:18.240 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T23:14:18.240 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T23:14:18.240 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T23:14:18.240 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T23:14:18.240 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T23:14:18.240 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T23:14:18.240 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T23:14:18.241 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T23:14:18.241 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T23:14:18.241 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T23:14:18.241 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T23:14:18.241 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T23:14:18.241 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T23:14:18.241 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T23:14:18.241 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T23:14:18.241 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T23:14:18.241 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T23:14:18.241 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T23:14:18.241 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T23:14:18.242 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T23:14:18.242 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T23:14:18.242 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T23:14:18.242 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T23:14:18.242 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T23:14:18.242 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T23:14:18.242 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T23:14:18.242 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T23:14:18.242 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T23:14:18.242 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T23:14:18.242 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T23:14:18.242 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T23:14:18.243 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T23:14:18.243 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T23:14:18.243 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T23:14:18.243 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T23:14:18.243 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T23:14:18.243 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T23:14:18.243 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T23:14:18.243 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T23:14:18.243 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T23:14:18.243 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T23:14:18.243 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T23:14:18.244 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T23:14:18.244 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T23:14:18.244 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T23:14:18.244 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T23:14:18.244 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T23:14:18.244 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T23:14:18.244 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.inplace_update_support: 0 2024-09-10T23:14:18.244 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T23:14:18.244 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T23:14:18.244 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T23:14:18.244 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T23:14:18.245 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.bloom_locality: 0 2024-09-10T23:14:18.245 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.max_successive_merges: 0 2024-09-10T23:14:18.245 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T23:14:18.245 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T23:14:18.245 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T23:14:18.245 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T23:14:18.245 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.ttl: 2592000 2024-09-10T23:14:18.245 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T23:14:18.245 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T23:14:18.245 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T23:14:18.245 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.enable_blob_files: false 2024-09-10T23:14:18.246 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.min_blob_size: 0 2024-09-10T23:14:18.246 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T23:14:18.246 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T23:14:18.246 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T23:14:18.246 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T23:14:18.246 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T23:14:18.246 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T23:14:18.246 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T23:14:18.246 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T23:14:18.246 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-10T23:14:18.246 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-10T23:14:18.247 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d0fec5c9-7d6f-46a5-a516-8e2dea376e5a 2024-09-10T23:14:18.247 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726010057977850, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-10T23:14:18.247 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-10T23:14:18.247 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726010057979241, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91855, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 287, "table_properties": {"data_size": 89902, "index_size": 273, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11825, "raw_average_key_size": 48, "raw_value_size": 83224, "raw_average_value_size": 338, "num_data_blocks": 12, "num_entries": 246, "num_filter_entries": 246, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726010057, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d0fec5c9-7d6f-46a5-a516-8e2dea376e5a", "db_session_id": "I0P3D05VV171IQI988P0", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-10T23:14:18.247 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726010057979425, "job": 1, "event": "recovery_finished"} 2024-09-10T23:14:18.247 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-10T23:14:18.247 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T23:14:18.247 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55bc62cf6e00 2024-09-10T23:14:18.247 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: DB pointer 0x55bc62df6000 2024-09-10T23:14:18.247 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T23:14:18.247 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T23:14:18.247 INFO:journalctl@ceph.mon.a.smithi003.stdout: ** DB Stats ** 2024-09-10T23:14:18.248 INFO:journalctl@ceph.mon.a.smithi003.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T23:14:18.248 INFO:journalctl@ceph.mon.a.smithi003.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T23:14:18.248 INFO:journalctl@ceph.mon.a.smithi003.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T23:14:18.248 INFO:journalctl@ceph.mon.a.smithi003.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T23:14:18.248 INFO:journalctl@ceph.mon.a.smithi003.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T23:14:18.248 INFO:journalctl@ceph.mon.a.smithi003.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T23:14:18.248 INFO:journalctl@ceph.mon.a.smithi003.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T23:14:18.248 INFO:journalctl@ceph.mon.a.smithi003.stdout: 2024-09-10T23:14:18.248 INFO:journalctl@ceph.mon.a.smithi003.stdout: ** Compaction Stats [default] ** 2024-09-10T23:14:18.248 INFO:journalctl@ceph.mon.a.smithi003.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T23:14:18.248 INFO:journalctl@ceph.mon.a.smithi003.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T23:14:18.249 INFO:journalctl@ceph.mon.a.smithi003.stdout: L0 2/0 91.56 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 102.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:14:18.249 INFO:journalctl@ceph.mon.a.smithi003.stdout: Sum 2/0 91.56 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 102.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:14:18.249 INFO:journalctl@ceph.mon.a.smithi003.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 102.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:14:18.249 INFO:journalctl@ceph.mon.a.smithi003.stdout: 2024-09-10T23:14:18.249 INFO:journalctl@ceph.mon.a.smithi003.stdout: ** Compaction Stats [default] ** 2024-09-10T23:14:18.249 INFO:journalctl@ceph.mon.a.smithi003.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T23:14:18.249 INFO:journalctl@ceph.mon.a.smithi003.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T23:14:18.249 INFO:journalctl@ceph.mon.a.smithi003.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 102.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:14:18.249 INFO:journalctl@ceph.mon.a.smithi003.stdout: 2024-09-10T23:14:18.249 INFO:journalctl@ceph.mon.a.smithi003.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T23:14:18.249 INFO:journalctl@ceph.mon.a.smithi003.stdout: 2024-09-10T23:14:18.249 INFO:journalctl@ceph.mon.a.smithi003.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T23:14:18.250 INFO:journalctl@ceph.mon.a.smithi003.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T23:14:18.250 INFO:journalctl@ceph.mon.a.smithi003.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T23:14:18.250 INFO:journalctl@ceph.mon.a.smithi003.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T23:14:18.250 INFO:journalctl@ceph.mon.a.smithi003.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T23:14:18.250 INFO:journalctl@ceph.mon.a.smithi003.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T23:14:18.250 INFO:journalctl@ceph.mon.a.smithi003.stdout: Cumulative compaction: 0.00 GB write, 16.08 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T23:14:18.250 INFO:journalctl@ceph.mon.a.smithi003.stdout: Interval compaction: 0.00 GB write, 16.08 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T23:14:18.250 INFO:journalctl@ceph.mon.a.smithi003.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T23:14:18.250 INFO:journalctl@ceph.mon.a.smithi003.stdout: Block cache BinnedLRUCache@0x55bc62cc5610#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-10T23:14:18.250 INFO:journalctl@ceph.mon.a.smithi003.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-10T23:14:18.250 INFO:journalctl@ceph.mon.a.smithi003.stdout: 2024-09-10T23:14:18.250 INFO:journalctl@ceph.mon.a.smithi003.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T23:14:18.251 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: starting mon.a rank 0 at public addrs [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] at bind addrs [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:14:18.251 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: mon.a@-1(???) e1 preinit fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:14:18.251 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: mon.a@-1(???).mds e1 new map 2024-09-10T23:14:18.251 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: mon.a@-1(???).mds e1 print_map 2024-09-10T23:14:18.251 INFO:journalctl@ceph.mon.a.smithi003.stdout: e1 2024-09-10T23:14:18.251 INFO:journalctl@ceph.mon.a.smithi003.stdout: btime 2024-09-10T23:14:12:377215+0000 2024-09-10T23:14:18.251 INFO:journalctl@ceph.mon.a.smithi003.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T23:14:18.251 INFO:journalctl@ceph.mon.a.smithi003.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T23:14:18.251 INFO:journalctl@ceph.mon.a.smithi003.stdout: legacy client fscid: -1 2024-09-10T23:14:18.251 INFO:journalctl@ceph.mon.a.smithi003.stdout: 2024-09-10T23:14:18.251 INFO:journalctl@ceph.mon.a.smithi003.stdout: No filesystems configured 2024-09-10T23:14:18.251 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T23:14:18.251 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:14:18.252 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:14:18.252 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:14:18.252 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:17 smithi003 ceph-mon[30348]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-10T23:14:18.252 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:18 smithi003 bash[30330]: 3744d202b7ecf0be37c7e7a56a24f7567a0c593d64857c7d9634c594a813d11a 2024-09-10T23:14:18.252 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:18 smithi003 systemd[1]: Started Ceph mon.a for 3f4e30d0-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:14:18.252 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:18 smithi003 ceph-mon[30348]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T23:14:18.252 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:18 smithi003 ceph-mon[30348]: monmap epoch 1 2024-09-10T23:14:18.252 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:18 smithi003 ceph-mon[30348]: fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:14:18.252 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:18 smithi003 ceph-mon[30348]: last_changed 2024-09-10T23:14:07.737715+0000 2024-09-10T23:14:18.252 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:18 smithi003 ceph-mon[30348]: created 2024-09-10T23:14:07.737715+0000 2024-09-10T23:14:18.252 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:18 smithi003 ceph-mon[30348]: min_mon_release 19 (squid) 2024-09-10T23:14:18.253 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:18 smithi003 ceph-mon[30348]: election_strategy: 1 2024-09-10T23:14:18.253 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:18 smithi003 ceph-mon[30348]: 0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2024-09-10T23:14:18.253 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:18 smithi003 ceph-mon[30348]: fsmap 2024-09-10T23:14:18.253 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:18 smithi003 ceph-mon[30348]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T23:14:18.253 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:18 smithi003 ceph-mon[30348]: mgrmap e1: no daemons active 2024-09-10T23:14:19.375 INFO:teuthology.orchestra.run.smithi003.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-10T23:14:19.401 INFO:teuthology.orchestra.run.smithi003.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:14:19.401 INFO:teuthology.orchestra.run.smithi003.stdout:Creating mgr... 2024-09-10T23:14:19.401 INFO:teuthology.orchestra.run.smithi003.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-10T23:14:19.402 INFO:teuthology.orchestra.run.smithi003.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-10T23:14:19.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:19 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/273090852' entity='client.admin' 2024-09-10T23:14:19.759 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mgr.x 2024-09-10T23:14:19.759 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stderr Failed to reset failed state of unit ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-10T23:14:20.000 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968.target.wants/ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@.service. 2024-09-10T23:14:20.349 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:20 smithi003 systemd[1]: Starting Ceph mgr.x for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:14:20.639 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:20 smithi003 podman[30561]: 2024-09-10 23:14:20.252735395 +0000 UTC m=+0.027891532 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:14:20.639 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:20 smithi003 podman[30561]: 2024-09-10 23:14:20.370252367 +0000 UTC m=+0.145408504 container create a0f70d5992d395319a32d5ccbc6c33158da4614204e13f291f76b1178378617c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2) 2024-09-10T23:14:20.639 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:20 smithi003 podman[30561]: 2024-09-10 23:14:20.572433958 +0000 UTC m=+0.347590106 container init a0f70d5992d395319a32d5ccbc6c33158da4614204e13f291f76b1178378617c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:14:20.639 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:20 smithi003 podman[30561]: 2024-09-10 23:14:20.578889829 +0000 UTC m=+0.354045966 container start a0f70d5992d395319a32d5ccbc6c33158da4614204e13f291f76b1178378617c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-10T23:14:20.670 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T23:14:20.671 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout disabled 2024-09-10T23:14:20.686 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T23:14:20.686 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout inactive 2024-09-10T23:14:20.687 INFO:teuthology.orchestra.run.smithi003.stdout:firewalld.service is not enabled 2024-09-10T23:14:20.687 INFO:teuthology.orchestra.run.smithi003.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T23:14:20.708 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T23:14:20.708 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout disabled 2024-09-10T23:14:20.723 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T23:14:20.723 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout inactive 2024-09-10T23:14:20.723 INFO:teuthology.orchestra.run.smithi003.stdout:firewalld.service is not enabled 2024-09-10T23:14:20.723 INFO:teuthology.orchestra.run.smithi003.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-10T23:14:20.723 INFO:teuthology.orchestra.run.smithi003.stdout:Waiting for mgr to start... 2024-09-10T23:14:20.723 INFO:teuthology.orchestra.run.smithi003.stdout:Waiting for mgr... 2024-09-10T23:14:20.889 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:20 smithi003 bash[30561]: a0f70d5992d395319a32d5ccbc6c33158da4614204e13f291f76b1178378617c 2024-09-10T23:14:20.889 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:20 smithi003 systemd[1]: Started Ceph mgr.x for 3f4e30d0-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:14:21.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:21 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2282025660' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-10T23:14:22.094 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-10T23:14:22.094 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:14:22.094 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "fsid": "3f4e30d0-6fca-11ef-bcea-c7b262605968", 2024-09-10T23:14:22.094 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T23:14:22.094 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T23:14:22.094 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T23:14:22.094 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T23:14:22.094 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:22.094 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T23:14:22.094 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T23:14:22.095 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 0 2024-09-10T23:14:22.095 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:14:22.095 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T23:14:22.095 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T23:14:22.095 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:14:22.095 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-10T23:14:22.095 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T23:14:22.095 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:14:22.095 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T23:14:22.095 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T23:14:22.095 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:22.095 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T23:14:22.096 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:14:22.096 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T23:14:22.096 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T23:14:22.096 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T23:14:22.096 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T23:14:22.096 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T23:14:22.096 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T23:14:22.096 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:22.096 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T23:14:22.096 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T23:14:22.097 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T23:14:22.097 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T23:14:22.097 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T23:14:22.097 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T23:14:22.097 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T23:14:22.097 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T23:14:22.097 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T23:14:22.097 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:22.097 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T23:14:22.097 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:14:22.098 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T23:14:12:377215+0000", 2024-09-10T23:14:22.098 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T23:14:22.098 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T23:14:22.098 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:22.098 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T23:14:22.098 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T23:14:22.098 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T23:14:22.098 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T23:14:22.098 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T23:14:22.098 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T23:14:22.098 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T23:14:22.099 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:14:22.099 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:14:22.099 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:22.099 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T23:14:22.099 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:14:22.099 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T23:14:12.377980+0000", 2024-09-10T23:14:22.099 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:14:22.099 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:22.099 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T23:14:22.099 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:14:22.099 INFO:teuthology.orchestra.run.smithi003.stdout:mgr not available, waiting (1/15)... 2024-09-10T23:14:24.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:24 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3402300161' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-10T23:14:25.301 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-10T23:14:25.301 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:14:25.301 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "fsid": "3f4e30d0-6fca-11ef-bcea-c7b262605968", 2024-09-10T23:14:25.302 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T23:14:25.302 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T23:14:25.302 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T23:14:25.302 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T23:14:25.302 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:25.302 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T23:14:25.302 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T23:14:25.302 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 0 2024-09-10T23:14:25.302 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:14:25.302 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T23:14:25.302 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T23:14:25.303 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:14:25.303 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-10T23:14:25.303 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T23:14:25.303 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:14:25.303 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T23:14:25.303 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T23:14:25.303 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:25.303 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T23:14:25.303 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:14:25.304 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T23:14:25.304 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T23:14:25.304 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T23:14:25.304 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T23:14:25.304 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T23:14:25.304 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T23:14:25.307 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:25.307 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T23:14:25.308 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T23:14:25.308 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T23:14:25.308 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T23:14:25.308 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T23:14:25.308 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T23:14:25.308 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T23:14:25.308 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T23:14:25.308 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T23:14:25.308 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:25.308 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T23:14:25.308 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:14:25.308 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T23:14:12:377215+0000", 2024-09-10T23:14:25.308 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T23:14:25.309 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T23:14:25.309 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:25.309 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T23:14:25.309 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T23:14:25.309 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T23:14:25.309 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T23:14:25.309 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T23:14:25.309 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T23:14:25.309 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T23:14:25.309 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:14:25.309 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:14:25.309 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:25.309 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T23:14:25.310 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:14:25.310 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T23:14:12.377980+0000", 2024-09-10T23:14:25.310 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:14:25.310 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:25.310 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T23:14:25.310 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:14:25.310 INFO:teuthology.orchestra.run.smithi003.stdout:mgr not available, waiting (2/15)... 2024-09-10T23:14:27.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:26 smithi003 ceph-mon[30348]: Activating manager daemon x 2024-09-10T23:14:27.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:26 smithi003 ceph-mon[30348]: mgrmap e2: x(active, starting, since 0.00455742s) 2024-09-10T23:14:27.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:26 smithi003 ceph-mon[30348]: from='mgr.14100 172.21.15.3:0/3942743352' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T23:14:27.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:26 smithi003 ceph-mon[30348]: from='mgr.14100 172.21.15.3:0/3942743352' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T23:14:27.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:26 smithi003 ceph-mon[30348]: from='mgr.14100 172.21.15.3:0/3942743352' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T23:14:27.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:26 smithi003 ceph-mon[30348]: from='mgr.14100 172.21.15.3:0/3942743352' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:14:27.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:26 smithi003 ceph-mon[30348]: from='mgr.14100 172.21.15.3:0/3942743352' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T23:14:27.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:26 smithi003 ceph-mon[30348]: Manager daemon x is now available 2024-09-10T23:14:27.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:26 smithi003 ceph-mon[30348]: from='mgr.14100 172.21.15.3:0/3942743352' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T23:14:27.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:26 smithi003 ceph-mon[30348]: from='mgr.14100 172.21.15.3:0/3942743352' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T23:14:27.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:26 smithi003 ceph-mon[30348]: from='mgr.14100 172.21.15.3:0/3942743352' entity='mgr.x' 2024-09-10T23:14:27.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:26 smithi003 ceph-mon[30348]: from='mgr.14100 172.21.15.3:0/3942743352' entity='mgr.x' 2024-09-10T23:14:27.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:26 smithi003 ceph-mon[30348]: from='mgr.14100 172.21.15.3:0/3942743352' entity='mgr.x' 2024-09-10T23:14:28.551 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-10T23:14:28.551 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:14:28.551 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "fsid": "3f4e30d0-6fca-11ef-bcea-c7b262605968", 2024-09-10T23:14:28.551 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T23:14:28.551 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T23:14:28.551 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T23:14:28.551 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T23:14:28.552 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:28.552 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T23:14:28.552 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T23:14:28.552 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 0 2024-09-10T23:14:28.552 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:14:28.552 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T23:14:28.552 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T23:14:28.552 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:14:28.552 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-10T23:14:28.552 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T23:14:28.552 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:14:28.552 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T23:14:28.552 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T23:14:28.552 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:28.553 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T23:14:28.553 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:14:28.553 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T23:14:28.553 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T23:14:28.553 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T23:14:28.553 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T23:14:28.553 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T23:14:28.553 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T23:14:28.553 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:28.553 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T23:14:28.553 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T23:14:28.553 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T23:14:28.553 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T23:14:28.553 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T23:14:28.554 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T23:14:28.554 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T23:14:28.554 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T23:14:28.554 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T23:14:28.554 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:28.554 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T23:14:28.554 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:14:28.554 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T23:14:12:377215+0000", 2024-09-10T23:14:28.554 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T23:14:28.554 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T23:14:28.554 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:28.554 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T23:14:28.554 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T23:14:28.554 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T23:14:28.555 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T23:14:28.555 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T23:14:28.555 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T23:14:28.555 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T23:14:28.555 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:14:28.555 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:14:28.555 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:28.555 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T23:14:28.555 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:14:28.555 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T23:14:12.377980+0000", 2024-09-10T23:14:28.555 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:14:28.555 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:14:28.555 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T23:14:28.555 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:14:28.555 INFO:teuthology.orchestra.run.smithi003.stdout:mgr is available 2024-09-10T23:14:29.053 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:28 smithi003 ceph-mon[30348]: mgrmap e3: x(active, since 1.00923s) 2024-09-10T23:14:29.053 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:28 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2362075471' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-10T23:14:30.065 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:29 smithi003 ceph-mon[30348]: mgrmap e4: x(active, since 2s) 2024-09-10T23:14:30.065 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:29 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/19461902' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-10T23:14:30.076 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-10T23:14:30.076 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T23:14:30.076 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout fsid = 3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:14:30.076 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-10T23:14:30.076 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.3:3300,v1:172.21.15.3:6789] 2024-09-10T23:14:30.076 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T23:14:30.076 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T23:14:30.076 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T23:14:30.076 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T23:14:30.077 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-10T23:14:30.077 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T23:14:30.077 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T23:14:30.077 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-10T23:14:30.077 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T23:14:30.077 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T23:14:30.077 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T23:14:30.077 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T23:14:30.077 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T23:14:30.077 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T23:14:30.077 INFO:teuthology.orchestra.run.smithi003.stdout:Enabling cephadm module... 2024-09-10T23:14:31.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:30 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/218152011' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-10T23:14:31.220 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:31 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: ignoring --setuser ceph since I am not root 2024-09-10T23:14:31.221 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:31 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: ignoring --setgroup ceph since I am not root 2024-09-10T23:14:32.140 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:31 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/218152011' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-10T23:14:32.140 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:31 smithi003 ceph-mon[30348]: mgrmap e5: x(active, since 4s) 2024-09-10T23:14:33.044 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:32 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3268074614' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-10T23:14:33.051 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:14:33.052 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-10T23:14:33.052 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T23:14:33.052 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-10T23:14:33.052 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T23:14:33.052 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:14:33.052 INFO:teuthology.orchestra.run.smithi003.stdout:Waiting for the mgr to restart... 2024-09-10T23:14:33.052 INFO:teuthology.orchestra.run.smithi003.stdout:Waiting for mgr epoch 5... 2024-09-10T23:14:37.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:37 smithi003 ceph-mon[30348]: Active manager daemon x restarted 2024-09-10T23:14:37.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:37 smithi003 ceph-mon[30348]: Activating manager daemon x 2024-09-10T23:14:37.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:37 smithi003 ceph-mon[30348]: osdmap e2: 0 total, 0 up, 0 in 2024-09-10T23:14:37.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:37 smithi003 ceph-mon[30348]: mgrmap e6: x(active, starting, since 0.00410485s) 2024-09-10T23:14:37.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:37 smithi003 ceph-mon[30348]: from='mgr.14118 172.21.15.3:0/173526284' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:14:37.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:37 smithi003 ceph-mon[30348]: from='mgr.14118 172.21.15.3:0/173526284' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T23:14:37.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:37 smithi003 ceph-mon[30348]: from='mgr.14118 172.21.15.3:0/173526284' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T23:14:37.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:37 smithi003 ceph-mon[30348]: from='mgr.14118 172.21.15.3:0/173526284' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T23:14:37.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:37 smithi003 ceph-mon[30348]: from='mgr.14118 172.21.15.3:0/173526284' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T23:14:37.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:37 smithi003 ceph-mon[30348]: Manager daemon x is now available 2024-09-10T23:14:39.141 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:38 smithi003 ceph-mon[30348]: from='mgr.14118 172.21.15.3:0/173526284' entity='mgr.x' 2024-09-10T23:14:39.141 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:38 smithi003 ceph-mon[30348]: from='mgr.14118 172.21.15.3:0/173526284' entity='mgr.x' 2024-09-10T23:14:39.141 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:38 smithi003 ceph-mon[30348]: Found migration_current of "None". Setting to last migration. 2024-09-10T23:14:39.141 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:38 smithi003 ceph-mon[30348]: from='mgr.14118 172.21.15.3:0/173526284' entity='mgr.x' 2024-09-10T23:14:39.141 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:38 smithi003 ceph-mon[30348]: from='mgr.14118 172.21.15.3:0/173526284' entity='mgr.x' 2024-09-10T23:14:39.141 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:38 smithi003 ceph-mon[30348]: from='mgr.14118 172.21.15.3:0/173526284' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:14:39.141 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:38 smithi003 ceph-mon[30348]: from='mgr.14118 172.21.15.3:0/173526284' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:14:39.141 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:38 smithi003 ceph-mon[30348]: from='mgr.14118 172.21.15.3:0/173526284' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T23:14:39.141 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:38 smithi003 ceph-mon[30348]: from='mgr.14118 172.21.15.3:0/173526284' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T23:14:39.142 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:38 smithi003 ceph-mon[30348]: mgrmap e7: x(active, since 1.00902s) 2024-09-10T23:14:39.148 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:14:39.148 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-10T23:14:39.148 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T23:14:39.148 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:14:39.148 INFO:teuthology.orchestra.run.smithi003.stdout:mgr epoch 5 is available 2024-09-10T23:14:39.148 INFO:teuthology.orchestra.run.smithi003.stdout:Setting orchestrator backend to cephadm... 2024-09-10T23:14:39.936 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:39 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T23:14:39.738+0000 7f43cdc00640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:23:14:39] ENGINE Error in HTTPServer.serve 2024-09-10T23:14:39.937 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:39 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: Traceback (most recent call last): 2024-09-10T23:14:39.937 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:39 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T23:14:39.937 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:39 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: self._connections.run(self.expiration_interval) 2024-09-10T23:14:39.937 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:39 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T23:14:39.938 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:39 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: self._run(expiration_interval) 2024-09-10T23:14:39.938 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:39 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T23:14:39.938 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:39 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T23:14:39.938 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:39 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T23:14:39.938 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:39 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T23:14:39.939 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:39 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T23:14:39.939 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:39 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: s = self.context.wrap_socket( 2024-09-10T23:14:39.939 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:39 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T23:14:39.939 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:39 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: return self.sslsocket_class._create( 2024-09-10T23:14:39.939 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:39 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T23:14:39.940 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:39 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: self.do_handshake() 2024-09-10T23:14:39.940 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:39 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T23:14:39.940 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:39 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: self._sslobj.do_handshake() 2024-09-10T23:14:39.940 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:39 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T23:14:39.940 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:39 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T23:14:40.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:39 smithi003 ceph-mon[30348]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-10T23:14:40.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:39 smithi003 ceph-mon[30348]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-10T23:14:40.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:39 smithi003 ceph-mon[30348]: from='mgr.14118 172.21.15.3:0/173526284' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:14:40.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:39 smithi003 ceph-mon[30348]: from='mgr.14118 172.21.15.3:0/173526284' entity='mgr.x' 2024-09-10T23:14:40.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:39 smithi003 ceph-mon[30348]: from='mgr.14118 172.21.15.3:0/173526284' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:14:41.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:40 smithi003 ceph-mon[30348]: [10/Sep/2024:23:14:39] ENGINE Bus STARTING 2024-09-10T23:14:41.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:40 smithi003 ceph-mon[30348]: [10/Sep/2024:23:14:39] ENGINE Serving on https://172.21.15.3:7150 2024-09-10T23:14:41.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:40 smithi003 ceph-mon[30348]: [10/Sep/2024:23:14:39] ENGINE Error in HTTPServer.serve 2024-09-10T23:14:41.221 INFO:journalctl@ceph.mon.a.smithi003.stdout: Traceback (most recent call last): 2024-09-10T23:14:41.221 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T23:14:41.221 INFO:journalctl@ceph.mon.a.smithi003.stdout: self._connections.run(self.expiration_interval) 2024-09-10T23:14:41.221 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T23:14:41.221 INFO:journalctl@ceph.mon.a.smithi003.stdout: self._run(expiration_interval) 2024-09-10T23:14:41.221 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T23:14:41.221 INFO:journalctl@ceph.mon.a.smithi003.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T23:14:41.222 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T23:14:41.222 INFO:journalctl@ceph.mon.a.smithi003.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T23:14:41.222 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T23:14:41.222 INFO:journalctl@ceph.mon.a.smithi003.stdout: s = self.context.wrap_socket( 2024-09-10T23:14:41.222 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T23:14:41.222 INFO:journalctl@ceph.mon.a.smithi003.stdout: return self.sslsocket_class._create( 2024-09-10T23:14:41.222 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T23:14:41.222 INFO:journalctl@ceph.mon.a.smithi003.stdout: self.do_handshake() 2024-09-10T23:14:41.222 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T23:14:41.222 INFO:journalctl@ceph.mon.a.smithi003.stdout: self._sslobj.do_handshake() 2024-09-10T23:14:41.222 INFO:journalctl@ceph.mon.a.smithi003.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T23:14:41.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:40 smithi003 ceph-mon[30348]: [10/Sep/2024:23:14:39] ENGINE Serving on http://172.21.15.3:8765 2024-09-10T23:14:41.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:40 smithi003 ceph-mon[30348]: [10/Sep/2024:23:14:39] ENGINE Bus STARTED 2024-09-10T23:14:41.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:40 smithi003 ceph-mon[30348]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:14:41.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:40 smithi003 ceph-mon[30348]: mgrmap e8: x(active, since 2s) 2024-09-10T23:14:41.925 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-10T23:14:41.925 INFO:teuthology.orchestra.run.smithi003.stdout:Generating ssh key... 2024-09-10T23:14:42.185 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:42 smithi003 ceph-mon[30348]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:14:43.211 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:42 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: Generating public/private rsa key pair. 2024-09-10T23:14:43.211 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:42 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: Your identification has been saved in /tmp/tmpbj76tn3k/key 2024-09-10T23:14:43.211 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:42 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: Your public key has been saved in /tmp/tmpbj76tn3k/key.pub 2024-09-10T23:14:43.211 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:42 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: The key fingerprint is: 2024-09-10T23:14:43.212 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:42 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: SHA256:zsdPt3lmA4aAqXIsI5S2XSEnojN/44cTDcDWaRGBMgc ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:14:43.212 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:42 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: The key's randomart image is: 2024-09-10T23:14:43.212 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:42 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: +---[RSA 3072]----+ 2024-09-10T23:14:43.212 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:42 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: |Eo o+= | 2024-09-10T23:14:43.212 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:42 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: |o.*o+o | 2024-09-10T23:14:43.212 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:42 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: |.=oo+ . o | 2024-09-10T23:14:43.212 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:42 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: |++ .. o . | 2024-09-10T23:14:43.212 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:42 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: |o+o oo. S . . | 2024-09-10T23:14:43.212 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:42 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: | o.=++.o . . o | 2024-09-10T23:14:43.212 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:42 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: | .o=+ o o o o | 2024-09-10T23:14:43.212 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:42 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: | + . . o . ++| 2024-09-10T23:14:43.212 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:42 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: | o . o+.| 2024-09-10T23:14:43.212 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:42 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: +----[SHA256]-----+ 2024-09-10T23:14:44.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:43 smithi003 ceph-mon[30348]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:14:44.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:43 smithi003 ceph-mon[30348]: Generating ssh key... 2024-09-10T23:14:44.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:43 smithi003 ceph-mon[30348]: from='mgr.14118 172.21.15.3:0/173526284' entity='mgr.x' 2024-09-10T23:14:44.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:43 smithi003 ceph-mon[30348]: from='mgr.14118 172.21.15.3:0/173526284' entity='mgr.x' 2024-09-10T23:14:44.823 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDeHKi7pJ4va/TvQ9MoLUyQGN+YmYtoNARU02hi6Z2NpTOh89dfuTAI3v6mIP/xNmQ4VG1vEJuZ1JV50hxO4Ki3L5K7VZ8WF61pPtJlPxoUeRKsrt82B+Lob9b1D3f4FruTIf48Z6abnPWnFKtsNx/hEUfDLdQz3YJu9ccBfmmhfVvGLaQgvRBbZK9VEagx7E17hRQBNGXLbdauG2bZfLH3wRRUU3Y4LWlZrNo3L3QDW9X1Gm9N9NXYm8BY6fDnbAM81feIWhI04lYDUgDBNa3w/hBKPR0AP7fKomRhDRRRvVF62UcelMgXq+kJQtC7FvNIGCNFfWKGdJ8wwr9CIXy1xRYOX5wC4UVEtv3fFjC0MVAGcIkhZLPvFdFKYkyzH16v4LwT2lO0S7yEGwu+Sk4XEVmzrAyx/0VwIowpOzxXTs6vRIjaBOtFvWUaVeWVyJN++rytfy6hBpOLQXC+83RTreD/dk6O597PqaF7sHqhDr7r8Xewf+JmVIvOzM2VYd0= ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:14:44.824 INFO:teuthology.orchestra.run.smithi003.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-10T23:14:44.824 INFO:teuthology.orchestra.run.smithi003.stdout:Adding key to root@localhost authorized_keys... 2024-09-10T23:14:44.827 INFO:teuthology.orchestra.run.smithi003.stdout:Adding host smithi003... 2024-09-10T23:14:45.127 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:45 smithi003 ceph-mon[30348]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:14:46.401 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:46 smithi003 ceph-mon[30348]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi003", "addr": "172.21.15.3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:14:47.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:47 smithi003 ceph-mon[30348]: Deploying cephadm binary to smithi003 2024-09-10T23:14:50.797 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout Added host 'smithi003' with addr '172.21.15.3' 2024-09-10T23:14:50.797 INFO:teuthology.orchestra.run.smithi003.stdout:Deploying unmanaged mon service... 2024-09-10T23:14:51.385 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:51 smithi003 ceph-mon[30348]: from='mgr.14118 172.21.15.3:0/173526284' entity='mgr.x' 2024-09-10T23:14:51.385 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:51 smithi003 ceph-mon[30348]: Added host smithi003 2024-09-10T23:14:51.385 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:51 smithi003 ceph-mon[30348]: from='mgr.14118 172.21.15.3:0/173526284' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:14:52.195 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-10T23:14:52.195 INFO:teuthology.orchestra.run.smithi003.stdout:Deploying unmanaged mgr service... 2024-09-10T23:14:52.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:52 smithi003 ceph-mon[30348]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:14:52.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:52 smithi003 ceph-mon[30348]: Saving service mon spec with placement count:5 2024-09-10T23:14:52.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:52 smithi003 ceph-mon[30348]: from='mgr.14118 172.21.15.3:0/173526284' entity='mgr.x' 2024-09-10T23:14:54.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:54 smithi003 ceph-mon[30348]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:14:54.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:54 smithi003 ceph-mon[30348]: Saving service mgr spec with placement count:2 2024-09-10T23:14:54.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:54 smithi003 ceph-mon[30348]: from='mgr.14118 172.21.15.3:0/173526284' entity='mgr.x' 2024-09-10T23:14:54.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:54 smithi003 ceph-mon[30348]: from='mgr.14118 172.21.15.3:0/173526284' entity='mgr.x' 2024-09-10T23:14:54.585 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-10T23:14:55.691 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:55 smithi003 ceph-mon[30348]: from='mgr.14118 172.21.15.3:0/173526284' entity='mgr.x' 2024-09-10T23:14:55.691 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:55 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3882436074' entity='client.admin' 2024-09-10T23:14:57.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:57 smithi003 ceph-mon[30348]: from='mgr.14118 172.21.15.3:0/173526284' entity='mgr.x' 2024-09-10T23:14:58.181 INFO:teuthology.orchestra.run.smithi003.stdout:Enabling the dashboard module... 2024-09-10T23:14:58.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:58 smithi003 ceph-mon[30348]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:14:58.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:58 smithi003 ceph-mon[30348]: from='mgr.14118 172.21.15.3:0/173526284' entity='mgr.x' 2024-09-10T23:14:58.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:58 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3934235841' entity='client.admin' 2024-09-10T23:14:59.933 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:14:59 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1606760712' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-10T23:14:59.934 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:59 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: ignoring --setuser ceph since I am not root 2024-09-10T23:14:59.934 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:14:59 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: ignoring --setgroup ceph since I am not root 2024-09-10T23:15:00.694 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:00 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1606760712' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-10T23:15:00.695 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:00 smithi003 ceph-mon[30348]: mgrmap e9: x(active, since 22s) 2024-09-10T23:15:01.476 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:01 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2839678637' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-10T23:15:01.887 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:15:01.887 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-10T23:15:01.888 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T23:15:01.888 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-10T23:15:01.888 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T23:15:01.888 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:15:01.888 INFO:teuthology.orchestra.run.smithi003.stdout:Waiting for the mgr to restart... 2024-09-10T23:15:01.888 INFO:teuthology.orchestra.run.smithi003.stdout:Waiting for mgr epoch 9... 2024-09-10T23:15:06.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:05 smithi003 ceph-mon[30348]: Active manager daemon x restarted 2024-09-10T23:15:06.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:05 smithi003 ceph-mon[30348]: Activating manager daemon x 2024-09-10T23:15:06.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:05 smithi003 ceph-mon[30348]: osdmap e3: 0 total, 0 up, 0 in 2024-09-10T23:15:06.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:05 smithi003 ceph-mon[30348]: mgrmap e10: x(active, starting, since 0.00460933s) 2024-09-10T23:15:06.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:05 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:15:06.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:05 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T23:15:06.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:05 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T23:15:06.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:05 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T23:15:06.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:05 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T23:15:06.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:05 smithi003 ceph-mon[30348]: Manager daemon x is now available 2024-09-10T23:15:07.185 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:06 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:15:07.185 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:06 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T23:15:07.185 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:06 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T23:15:07.185 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:06 smithi003 ceph-mon[30348]: mgrmap e11: x(active, since 1.00933s) 2024-09-10T23:15:07.472 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:15:07.472 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-10T23:15:07.472 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T23:15:07.472 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:15:07.472 INFO:teuthology.orchestra.run.smithi003.stdout:mgr epoch 9 is available 2024-09-10T23:15:07.472 INFO:teuthology.orchestra.run.smithi003.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-10T23:15:07.721 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:15:07 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T23:15:07.673+0000 7f9a20e00640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:23:15:07] ENGINE Error in HTTPServer.serve 2024-09-10T23:15:07.721 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:15:07 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: Traceback (most recent call last): 2024-09-10T23:15:07.721 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:15:07 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T23:15:07.721 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:15:07 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: self._connections.run(self.expiration_interval) 2024-09-10T23:15:07.721 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:15:07 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T23:15:07.721 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:15:07 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: self._run(expiration_interval) 2024-09-10T23:15:07.721 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:15:07 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T23:15:07.722 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:15:07 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T23:15:07.722 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:15:07 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T23:15:07.722 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:15:07 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T23:15:07.722 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:15:07 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T23:15:07.722 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:15:07 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: s = self.context.wrap_socket( 2024-09-10T23:15:07.722 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:15:07 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T23:15:07.722 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:15:07 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: return self.sslsocket_class._create( 2024-09-10T23:15:07.722 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:15:07 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T23:15:07.722 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:15:07 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: self.do_handshake() 2024-09-10T23:15:07.722 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:15:07 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T23:15:07.722 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:15:07 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: self._sslobj.do_handshake() 2024-09-10T23:15:07.722 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:15:07 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T23:15:07.722 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:15:07 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T23:15:08.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:07 smithi003 ceph-mon[30348]: [10/Sep/2024:23:15:07] ENGINE Bus STARTING 2024-09-10T23:15:09.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:08 smithi003 ceph-mon[30348]: [10/Sep/2024:23:15:07] ENGINE Serving on https://172.21.15.3:7150 2024-09-10T23:15:09.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:08 smithi003 ceph-mon[30348]: [10/Sep/2024:23:15:07] ENGINE Error in HTTPServer.serve 2024-09-10T23:15:09.221 INFO:journalctl@ceph.mon.a.smithi003.stdout: Traceback (most recent call last): 2024-09-10T23:15:09.221 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T23:15:09.221 INFO:journalctl@ceph.mon.a.smithi003.stdout: self._connections.run(self.expiration_interval) 2024-09-10T23:15:09.221 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T23:15:09.221 INFO:journalctl@ceph.mon.a.smithi003.stdout: self._run(expiration_interval) 2024-09-10T23:15:09.221 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T23:15:09.221 INFO:journalctl@ceph.mon.a.smithi003.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T23:15:09.221 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T23:15:09.221 INFO:journalctl@ceph.mon.a.smithi003.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T23:15:09.221 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T23:15:09.221 INFO:journalctl@ceph.mon.a.smithi003.stdout: s = self.context.wrap_socket( 2024-09-10T23:15:09.222 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T23:15:09.222 INFO:journalctl@ceph.mon.a.smithi003.stdout: return self.sslsocket_class._create( 2024-09-10T23:15:09.222 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T23:15:09.222 INFO:journalctl@ceph.mon.a.smithi003.stdout: self.do_handshake() 2024-09-10T23:15:09.222 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T23:15:09.222 INFO:journalctl@ceph.mon.a.smithi003.stdout: self._sslobj.do_handshake() 2024-09-10T23:15:09.222 INFO:journalctl@ceph.mon.a.smithi003.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T23:15:09.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:08 smithi003 ceph-mon[30348]: [10/Sep/2024:23:15:07] ENGINE Serving on http://172.21.15.3:8765 2024-09-10T23:15:09.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:08 smithi003 ceph-mon[30348]: [10/Sep/2024:23:15:07] ENGINE Bus STARTED 2024-09-10T23:15:09.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:08 smithi003 ceph-mon[30348]: mgrmap e12: x(active, since 2s) 2024-09-10T23:15:09.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:08 smithi003 ceph-mon[30348]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:15:09.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:08 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:09.530 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+jCCAuKgAwIBAgIUJu6dWIS058lwdJ6LO4eln5TIOaswDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkxMDIzMTUwOFoXDTM0\nMDkxMTIzMTUwOFowFjEUMBIGA1UEAwwLMTcyLjIxLjE1LjMwggIiMA0GCSqGSIb3\nDQEBAQUAA4ICDwAwggIKAoICAQCWtyFrZIM4zylJQS4hWYayAKzD81oxQlKpmJrS\nwbl8bmHlBgSn9MUAB/1rN00ZltWxVB1EFKiajZjWUFJ94vj+RQTOBrgc+LeY7eqD\noVXZwzoPJM0d8rLc3isVg6RaKmuipb9GcyyvqBC7Ittv2JAizW/Z+QqcI6AyO/Uf\n/tZxnQbXbChryous/CRjTT3Pk61L4AH7/u804azSGLGmtT+VmD5VpGxiBoN4KY5s\nFVnako2HqSgX2xOuFthx/jZKGC799mLa8y0nAqGMOvCFqk0CNjEf5QnvuU/FTO2G\nP6NEdRqqsV+fZBdNlSmbhbDQFkyXyc43ewJc89o8eDigCrqtZQFFFlwF7TM4or2I\nwrkbKKrlLcn8hnlsJqxz1rv1kAs/O6S7ru6+fDy5r/6Oi4uupmtrTwM1KCccDoLS\nVVahQPTAFwj8bXOpF7Uk89ADx7LOSDb3igQIVPh4s26938Z59FqzFVATB7DdVgNA\nDxjulwPFJJbx5742aka3f9Ma5Jf4HxeUMVnrBf/nyBfMrZVdK5Ptzync7v13JifF\nuepRVB5Lb+io+KjzOUG31Kib8U1FIQRFRhiOoZNgduKWYRklnMuKRlgPEXZ9vJ7y\nvCzzg/6nccddzJDkGNLfafk0PZz7/a3Hnwnox+I+V2Q9hsJR8it8vcFx2NRCmvQG\nF+eK4wIDAQABoz8wPTAtBgNVHREEJjAkgglzbWl0aGkwMDOCEWRhc2hib2FyZF9z\nZXJ2ZXJzhwSsFQ8DMAwGA1UdEwEB/wQCMAAwDQYJKoZIhvcNAQELBQADggIBAATv\nwCB/uXqIBJYX8z6+gDzPluEy0gQ2U9mfatzUln4Boe0YDuXPcgD/99LAACPgnqWm\nxHALBH4uvsgsshciLiZoah22nV7CNYXqkCKa+EJEwbYOWIpIZ/HF3amQhr+VmE6v\n0ylBx0CLjFcl0bh/hClv+tak+WU0H4qzR5Xc+24UeU8aYMbC++at8O+WEb5FBgzG\nywcg/Rh1eb89u0x7yFlem7e5GXmVUyykGsd1dmtADZU9cFnB3KqzMQFiz7IFHy+o\nAEhAQWf3lUUPjCo0Wnzs7BSSIEOzmk/qrIQS3/XCk4unMZH1QbCXT6Pt6I/XpTke\nu7vj5TrSpzsKIGLJzRoiGIiSBn0lHrmwzsFFQV4EwdWJvCOdDHiyaiZSnkoGELXE\nCJPhFagilkMJo5ufoNXwX6HZQiDzgowL8X5ZUH3o5nDArzBuG/hYkXlTkspoN6N9\nkVVDOHYlUVsH1F0FZurGnPf81nTVJQ3xDdAQsGBVGPOSzB0FQclgCkK9J9cPCKVC\nhqzEu1geo+7b+hGdi4ebZDFeGuILSZPLB4q2U1oRTR8Ap0o4bQeoMNW8MCLnCSmn\nIR6EQ3lgfeb32tc9iAXz2oZPstiFV5lKYMvTAIpoIj7PJGK6J6sZ0VcmlLZKkozX\nmLKH+Bb+g5YvUvv9BbS19TBq900BU1Igh+GuIZlG\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKAIBAAKCAgEAlrcha2SDOM8pSUEuIVmGsgCsw/NaMUJSqZia0sG5fG5h5QYE\np/TFAAf9azdNGZbVsVQdRBSomo2Y1lBSfeL4/kUEzga4HPi3mO3qg6FV2cM6DyTN\nHfKy3N4rFYOkWiproqW/RnMsr6gQuyLbb9iQIs1v2fkKnCOgMjv1H/7WcZ0G12wo\na8qLrPwkY009z5OtS+AB+/7vNOGs0hixprU/lZg+VaRsYgaDeCmObBVZ2pKNh6ko\nF9sTrhbYcf42Shgu/fZi2vMtJwKhjDrwhapNAjYxH+UJ77lPxUzthj+jRHUaqrFf\nn2QXTZUpm4Ww0BZMl8nON3sCXPPaPHg4oAq6rWUBRRZcBe0zOKK9iMK5Gyiq5S3J\n/IZ5bCasc9a79ZALPzuku67uvnw8ua/+jouLrqZra08DNSgnHA6C0lVWoUD0wBcI\n/G1zqRe1JPPQA8eyzkg294oECFT4eLNuvd/GefRasxVQEwew3VYDQA8Y7pcDxSSW\n8ee+NmpGt3/TGuSX+B8XlDFZ6wX/58gXzK2VXSuT7c8p3O79dyYnxbnqUVQeS2/o\nqPio8zlBt9Som/FNRSEERUYYjqGTYHbilmEZJZzLikZYDxF2fbye8rws84P+p3HH\nXcyQ5BjS32n5ND2c+/2tx58J6MfiPldkPYbCUfIrfL3BcdjUQpr0BhfniuMCAwEA\nAQKCAgATeeTasOl4LOUj70Vbz+rlE8s/ozHzjaOLAQp408n5d3Y1F1sArVPL1jx8\nX3AaL3C78qe5hYXoOwYWI9kVJYCRsy+UxC+Eputq2svkaLPkaSMWk+XhydwtSJR+\nuj1B3Zt9MDgQjY+nv2syE6YRxQWTScL7gwBI/x2TgEYD9XWWxvj8W6C5lToJh6fY\nIUIskePiGzeGbgJRbhxcJg7HAUMPPNZJUO8kl7zjiVM7SmMLKMcbUdO5iXj4lUEx\nMe2oE4n3DaDmtGgQU3m22mL8ku5Sq9gbTAjFrsfNMky7fXvGu+9PQY6e1VthjjYL\nP/KCYW9SaiS47K94fZalG9ANdnV7AfLzUMo6lSJ8ofqR/8cfceq6Kp5mQwe6vQar\nBqImvea6tZUVIeXHhWqfEVVIBSSluozD/JLcfGFPzopbQT+2ZCIL+lDGM+GK8Wgu\nRVap31o3rjEDx6ET44HiIKaufMTjqtxeRnSy6i0bj2RnQBOO/AgA3HPq3UMTo4kq\nW1+48M2Yin9QNqcpb3wsOwu3w0i3kJkxTdEMhND3UGaHvzyUVC6rsL0uL65iGEmq\nSb71PeH431is24YKXVIbhg46vTRlYWHu+l4EduPNzP1IZi2aCZbbZAgfS8C6uwp+\nwnfOEFYmc7150uqChMa+BZfqNCgAeasdhUXs8p6WkkKT1hzeuQKCAQEAzRt+OCbK\n0Z1LEnkQ4OI+7LFR4sitBXIWgZK8UfWJxowqjT5BaD4UaATl/IEH85R8d/Gzv2ms\n6QnGulx4rR+6lk0sxCEkXfXVzvZgewaPVY65VnWHqDjOAJRDfF3/gfmEVjOaEKUx\n1vPbJi2BjNWWwIrHgz6gKpCkiB+ezwOnagxFNUmFp93xQvGEeGwzj01tzgBv3xhg\niJBAE5sObBUgpffCkdVveNk5XFrNN22ZDK4CSc4tQVdGWWfd0zgG17JBAa9FapoW\nQB++5kHhtdm+6hG9ffP7eX7AseRxAwk4fCWNbAnM9QRD88zkHgIJR7S0Xz962Fqg\nct/m3vPnA3tYJwKCAQEAvByh6DolkxMMWghQwbvMsikmy20jFhUn22heRtzt8mFo\npRit/ySyU0Tmp8gWWDmcTkKgJ3/d73Civy6MVLnb8L1ljEFkwGSPZNK6RPK1pZ3H\nPw67Cg/MnW3NGBZsGkpU35hTyVx1EanSYabPojCCYX21pNPxGFEe8D6tbQG9pF1o\n2ia5U11xWqkxjKv3daAGDqDTTRGgfww1uznbX3nax6H1fn+YBqvKtbQlfFXLKFs5\nu4GJVkCixfbT6szI7SZedhJfoZVxAbIDR5CArC94Nx0ZBUgsu/X7RDFU5BBXZwSp\numuOjq+aJjwkE2tWy2zf7yEcsk2SLN45ywTsur7Q5QKCAQAfz0fABaQm5jIiZ0xK\n1EvWAZolheHvmkYLSmqSe3YmqM5goWsbc6VOjJPumURWbozvPTkXUphSfAWqGXVN\nxEH31Xg/4rP1Lo8+Tc+gxN+t8TilRA0J9eVdCaF9xEZALiZsCAy40CXupFs0jJIu\n+WEr81oF7MyCTXR2+BB1IqfwNn71SLXF1xH3w+U7l+xXKTcCX+b5vpoaE+UcJUwT\nTyOFGeu/Gk7zexz+ScbR9dlqsgIA2E0EeTib3RP2EhZdlXOngztM0SDqSQIeS9Fp\nlp+ZRa8Rvakeqp3P+RHd2qw79Mb+Hnb++O5g/UHTtZUi3c+rhfjTXRrNNhRkN4d4\nbsS5AoIBAFjHYppJJwacjM3I8uQcD+VdipOjdFWtslvYi/YBusMTueGBHk02Mnse\nH4W75t/IgL5mr1M1A7dHf2efPleWR/j8SfrBuh0a2JoK4iI8MgJxzmEyQI/lGPqL\noanmmyplPl0wdQqpeg7WCRZRNdkj78S3IY0jAbwqPOHBkvPJSIlUFHIwqHJxvVe+\nVkY/utBmr7UjrdXHpemQB6PPEHuk9N4Wz9fdvBAZ79eFp9NgYjsvorWd0wVECA5K\nCYXdFE7oNtien0eRUf4s12NlDXU2ChRoxTA6+fHTi7yJU7k3BSj3iGsU6/jnY2b8\nJ0KK/DGRtrYS+IomFgDa+IeaUWdpOwkCggEBAJVtZ5Qk55WPzo+d6N7DeP2sOnHW\nCOoxQN/FXID8KRLlOVqNb2MQKb2R8P2CwFDI2G/IEsY7fdtQ9r4bY/ZJ/pWt0ZKx\nPJQDQcnWpiGHqxuJjWYX+RIg7+mwavyL7x+wqQNYBqrgH1YgBRFwJvHh1PPPoIFc\nMTwWtuhewtvpLwhEiI6+KXY7hjGbnKzFL5s7HvtbRHmdS6Vu04eDazIC6RiSg1Kl\nWp49yGWbfEKxv1dH6RmVxFyw5z5Ij/8QRs5oXmnBpoz7eYbs/j/slTyqfcotK1r8\nikCjIRbZzOpr2++hJ5uBGnophzaAsrCiceCEzZhTxcqti4WjLPYzwTG0Llw=\n-----END RSA PRIVATE KEY-----\n"} 2024-09-10T23:15:10.956 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-10T23:15:11.199 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:11 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:11.199 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:11 smithi003 ceph-mon[30348]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:15:11.199 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:11 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:12.944 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-10T23:15:12.945 INFO:teuthology.orchestra.run.smithi003.stdout:Creating initial admin user... 2024-09-10T23:15:13.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:12 smithi003 ceph-mon[30348]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:15:13.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:12 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:14.572 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$q/ppH7JR.AU9tt6Emn8Uk.Oyd72cySdEoCLBWLRxfV4ebJoHLPGQW", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726010113, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-10T23:15:14.573 INFO:teuthology.orchestra.run.smithi003.stdout:Fetching dashboard port number... 2024-09-10T23:15:15.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:14 smithi003 ceph-mon[30348]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:15:15.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:14 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:15.888 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 8443 2024-09-10T23:15:15.906 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T23:15:15.906 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout disabled 2024-09-10T23:15:15.920 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T23:15:15.920 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout inactive 2024-09-10T23:15:15.920 INFO:teuthology.orchestra.run.smithi003.stdout:firewalld.service is not enabled 2024-09-10T23:15:15.920 INFO:teuthology.orchestra.run.smithi003.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-10T23:15:15.922 INFO:teuthology.orchestra.run.smithi003.stdout:Ceph Dashboard is now available at: 2024-09-10T23:15:15.922 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:15:15.922 INFO:teuthology.orchestra.run.smithi003.stdout: URL: https://smithi003.front.sepia.ceph.com:8443/ 2024-09-10T23:15:15.922 INFO:teuthology.orchestra.run.smithi003.stdout: User: admin 2024-09-10T23:15:15.922 INFO:teuthology.orchestra.run.smithi003.stdout: Password: ol8vum0cc8 2024-09-10T23:15:15.922 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:15:15.923 INFO:teuthology.orchestra.run.smithi003.stdout:Saving cluster configuration to /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config directory 2024-09-10T23:15:16.218 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:15 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1564819532' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-10T23:15:17.476 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-10T23:15:17.476 INFO:teuthology.orchestra.run.smithi003.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-10T23:15:17.477 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:15:17.477 INFO:teuthology.orchestra.run.smithi003.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:15:17.477 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:15:17.477 INFO:teuthology.orchestra.run.smithi003.stdout:Or, if you are only running a single cluster on this host: 2024-09-10T23:15:17.477 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:15:17.477 INFO:teuthology.orchestra.run.smithi003.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-10T23:15:17.477 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:15:17.478 INFO:teuthology.orchestra.run.smithi003.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-10T23:15:17.478 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:15:17.478 INFO:teuthology.orchestra.run.smithi003.stdout: ceph telemetry on 2024-09-10T23:15:17.478 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:15:17.478 INFO:teuthology.orchestra.run.smithi003.stdout:For more information see: 2024-09-10T23:15:17.478 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:15:17.478 INFO:teuthology.orchestra.run.smithi003.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-10T23:15:17.478 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:15:17.478 INFO:teuthology.orchestra.run.smithi003.stdout:Bootstrap complete. 2024-09-10T23:15:17.536 INFO:tasks.cephadm:Fetching config... 2024-09-10T23:15:17.536 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-10T23:15:17.536 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-10T23:15:17.572 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-10T23:15:17.572 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-10T23:15:17.572 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-10T23:15:17.648 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-10T23:15:17.648 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-10T23:15:17.648 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-10T23:15:17.745 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-10T23:15:17.746 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-10T23:15:17.746 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-10T23:15:17.821 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-10T23:15:17.821 DEBUG:teuthology.orchestra.run.smithi003:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDeHKi7pJ4va/TvQ9MoLUyQGN+YmYtoNARU02hi6Z2NpTOh89dfuTAI3v6mIP/xNmQ4VG1vEJuZ1JV50hxO4Ki3L5K7VZ8WF61pPtJlPxoUeRKsrt82B+Lob9b1D3f4FruTIf48Z6abnPWnFKtsNx/hEUfDLdQz3YJu9ccBfmmhfVvGLaQgvRBbZK9VEagx7E17hRQBNGXLbdauG2bZfLH3wRRUU3Y4LWlZrNo3L3QDW9X1Gm9N9NXYm8BY6fDnbAM81feIWhI04lYDUgDBNa3w/hBKPR0AP7fKomRhDRRRvVF62UcelMgXq+kJQtC7FvNIGCNFfWKGdJ8wwr9CIXy1xRYOX5wC4UVEtv3fFjC0MVAGcIkhZLPvFdFKYkyzH16v4LwT2lO0S7yEGwu+Sk4XEVmzrAyx/0VwIowpOzxXTs6vRIjaBOtFvWUaVeWVyJN++rytfy6hBpOLQXC+83RTreD/dk6O597PqaF7sHqhDr7r8Xewf+JmVIvOzM2VYd0= ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T23:15:17.944 INFO:teuthology.orchestra.run.smithi003.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDeHKi7pJ4va/TvQ9MoLUyQGN+YmYtoNARU02hi6Z2NpTOh89dfuTAI3v6mIP/xNmQ4VG1vEJuZ1JV50hxO4Ki3L5K7VZ8WF61pPtJlPxoUeRKsrt82B+Lob9b1D3f4FruTIf48Z6abnPWnFKtsNx/hEUfDLdQz3YJu9ccBfmmhfVvGLaQgvRBbZK9VEagx7E17hRQBNGXLbdauG2bZfLH3wRRUU3Y4LWlZrNo3L3QDW9X1Gm9N9NXYm8BY6fDnbAM81feIWhI04lYDUgDBNa3w/hBKPR0AP7fKomRhDRRRvVF62UcelMgXq+kJQtC7FvNIGCNFfWKGdJ8wwr9CIXy1xRYOX5wC4UVEtv3fFjC0MVAGcIkhZLPvFdFKYkyzH16v4LwT2lO0S7yEGwu+Sk4XEVmzrAyx/0VwIowpOzxXTs6vRIjaBOtFvWUaVeWVyJN++rytfy6hBpOLQXC+83RTreD/dk6O597PqaF7sHqhDr7r8Xewf+JmVIvOzM2VYd0= ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:15:17.969 DEBUG:teuthology.orchestra.run.smithi038:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDeHKi7pJ4va/TvQ9MoLUyQGN+YmYtoNARU02hi6Z2NpTOh89dfuTAI3v6mIP/xNmQ4VG1vEJuZ1JV50hxO4Ki3L5K7VZ8WF61pPtJlPxoUeRKsrt82B+Lob9b1D3f4FruTIf48Z6abnPWnFKtsNx/hEUfDLdQz3YJu9ccBfmmhfVvGLaQgvRBbZK9VEagx7E17hRQBNGXLbdauG2bZfLH3wRRUU3Y4LWlZrNo3L3QDW9X1Gm9N9NXYm8BY6fDnbAM81feIWhI04lYDUgDBNa3w/hBKPR0AP7fKomRhDRRRvVF62UcelMgXq+kJQtC7FvNIGCNFfWKGdJ8wwr9CIXy1xRYOX5wC4UVEtv3fFjC0MVAGcIkhZLPvFdFKYkyzH16v4LwT2lO0S7yEGwu+Sk4XEVmzrAyx/0VwIowpOzxXTs6vRIjaBOtFvWUaVeWVyJN++rytfy6hBpOLQXC+83RTreD/dk6O597PqaF7sHqhDr7r8Xewf+JmVIvOzM2VYd0= ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T23:15:18.043 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:17 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1955414633' entity='client.admin' 2024-09-10T23:15:18.151 INFO:teuthology.orchestra.run.smithi038.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDeHKi7pJ4va/TvQ9MoLUyQGN+YmYtoNARU02hi6Z2NpTOh89dfuTAI3v6mIP/xNmQ4VG1vEJuZ1JV50hxO4Ki3L5K7VZ8WF61pPtJlPxoUeRKsrt82B+Lob9b1D3f4FruTIf48Z6abnPWnFKtsNx/hEUfDLdQz3YJu9ccBfmmhfVvGLaQgvRBbZK9VEagx7E17hRQBNGXLbdauG2bZfLH3wRRUU3Y4LWlZrNo3L3QDW9X1Gm9N9NXYm8BY6fDnbAM81feIWhI04lYDUgDBNa3w/hBKPR0AP7fKomRhDRRRvVF62UcelMgXq+kJQtC7FvNIGCNFfWKGdJ8wwr9CIXy1xRYOX5wC4UVEtv3fFjC0MVAGcIkhZLPvFdFKYkyzH16v4LwT2lO0S7yEGwu+Sk4XEVmzrAyx/0VwIowpOzxXTs6vRIjaBOtFvWUaVeWVyJN++rytfy6hBpOLQXC+83RTreD/dk6O597PqaF7sHqhDr7r8Xewf+JmVIvOzM2VYd0= ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:15:18.177 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDeHKi7pJ4va/TvQ9MoLUyQGN+YmYtoNARU02hi6Z2NpTOh89dfuTAI3v6mIP/xNmQ4VG1vEJuZ1JV50hxO4Ki3L5K7VZ8WF61pPtJlPxoUeRKsrt82B+Lob9b1D3f4FruTIf48Z6abnPWnFKtsNx/hEUfDLdQz3YJu9ccBfmmhfVvGLaQgvRBbZK9VEagx7E17hRQBNGXLbdauG2bZfLH3wRRUU3Y4LWlZrNo3L3QDW9X1Gm9N9NXYm8BY6fDnbAM81feIWhI04lYDUgDBNa3w/hBKPR0AP7fKomRhDRRRvVF62UcelMgXq+kJQtC7FvNIGCNFfWKGdJ8wwr9CIXy1xRYOX5wC4UVEtv3fFjC0MVAGcIkhZLPvFdFKYkyzH16v4LwT2lO0S7yEGwu+Sk4XEVmzrAyx/0VwIowpOzxXTs6vRIjaBOtFvWUaVeWVyJN++rytfy6hBpOLQXC+83RTreD/dk6O597PqaF7sHqhDr7r8Xewf+JmVIvOzM2VYd0= ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T23:15:18.276 INFO:teuthology.orchestra.run.smithi194.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDeHKi7pJ4va/TvQ9MoLUyQGN+YmYtoNARU02hi6Z2NpTOh89dfuTAI3v6mIP/xNmQ4VG1vEJuZ1JV50hxO4Ki3L5K7VZ8WF61pPtJlPxoUeRKsrt82B+Lob9b1D3f4FruTIf48Z6abnPWnFKtsNx/hEUfDLdQz3YJu9ccBfmmhfVvGLaQgvRBbZK9VEagx7E17hRQBNGXLbdauG2bZfLH3wRRUU3Y4LWlZrNo3L3QDW9X1Gm9N9NXYm8BY6fDnbAM81feIWhI04lYDUgDBNa3w/hBKPR0AP7fKomRhDRRRvVF62UcelMgXq+kJQtC7FvNIGCNFfWKGdJ8wwr9CIXy1xRYOX5wC4UVEtv3fFjC0MVAGcIkhZLPvFdFKYkyzH16v4LwT2lO0S7yEGwu+Sk4XEVmzrAyx/0VwIowpOzxXTs6vRIjaBOtFvWUaVeWVyJN++rytfy6hBpOLQXC+83RTreD/dk6O597PqaF7sHqhDr7r8Xewf+JmVIvOzM2VYd0= ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:15:18.302 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-10T23:15:18.688 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:15:20.056 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:19 smithi003 ceph-mon[30348]: mgrmap e13: x(active, since 12s) 2024-09-10T23:15:20.056 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:19 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1318172110' entity='client.admin' 2024-09-10T23:15:20.647 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-10T23:15:20.647 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-10T23:15:21.209 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:15:21.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:21 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:21.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:21 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:21.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:21 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi003", "name": "osd_memory_target"} : dispatch 2024-09-10T23:15:21.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:21 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:21.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:21 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:15:21.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:21 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:23.273 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:23 smithi003 ceph-mon[30348]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:15:23.273 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:23 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:23.273 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:23 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:15:23.273 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:23 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:23.273 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:23 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:15:23.273 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:23 smithi003 ceph-mon[30348]: Updating smithi003:/etc/ceph/ceph.conf 2024-09-10T23:15:23.274 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:23 smithi003 ceph-mon[30348]: Updating smithi003:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:15:23.664 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi038 2024-09-10T23:15:23.664 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-10T23:15:23.665 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/etc/ceph/ceph.conf 2024-09-10T23:15:23.703 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-10T23:15:23.703 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:15:23.781 INFO:tasks.cephadm:Adding host smithi038 to orchestrator... 2024-09-10T23:15:23.781 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph orch host add smithi038 2024-09-10T23:15:24.163 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:15:24.301 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:24 smithi003 ceph-mon[30348]: Updating smithi003:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:15:24.302 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:24 smithi003 ceph-mon[30348]: Updating smithi003:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:15:24.302 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:24 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:24.302 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:24 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:25.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:25 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:26.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:26 smithi003 ceph-mon[30348]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi038", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:15:27.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:27 smithi003 ceph-mon[30348]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:27.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:27 smithi003 ceph-mon[30348]: Deploying cephadm binary to smithi038 2024-09-10T23:15:29.394 INFO:teuthology.orchestra.run.smithi003.stdout:Added host 'smithi038' with addr '172.21.15.38' 2024-09-10T23:15:29.394 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:29 smithi003 ceph-mon[30348]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:30.079 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T23:15:30.451 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:15:30.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:30 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:30.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:30 smithi003 ceph-mon[30348]: Added host smithi038 2024-09-10T23:15:30.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:30 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:15:30.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:30 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:30.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:30 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:31.231 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:15:31.231 INFO:teuthology.orchestra.run.smithi003.stdout:[{"addr": "172.21.15.3", "hostname": "smithi003", "labels": [], "status": ""}, {"addr": "172.21.15.38", "hostname": "smithi038", "labels": [], "status": ""}] 2024-09-10T23:15:31.593 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:31 smithi003 ceph-mon[30348]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:31.910 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi194 2024-09-10T23:15:31.910 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-10T23:15:31.910 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/etc/ceph/ceph.conf 2024-09-10T23:15:31.951 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-10T23:15:31.951 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:15:32.028 INFO:tasks.cephadm:Adding host smithi194 to orchestrator... 2024-09-10T23:15:32.028 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph orch host add smithi194 2024-09-10T23:15:32.392 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:15:32.749 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:32 smithi003 ceph-mon[30348]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:15:32.749 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:32 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:33.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:33 smithi003 ceph-mon[30348]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:34.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:34 smithi003 ceph-mon[30348]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi194", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:15:35.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:35 smithi003 ceph-mon[30348]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:35.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:35 smithi003 ceph-mon[30348]: Deploying cephadm binary to smithi194 2024-09-10T23:15:35.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:35 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:35.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:35 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:35.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:35 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:35.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:35 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:35.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:35 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi038", "name": "osd_memory_target"} : dispatch 2024-09-10T23:15:35.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:35 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:35.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:35 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:15:36.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:36 smithi003 ceph-mon[30348]: Updating smithi038:/etc/ceph/ceph.conf 2024-09-10T23:15:36.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:36 smithi003 ceph-mon[30348]: Updating smithi038:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:15:37.532 INFO:teuthology.orchestra.run.smithi003.stdout:Added host 'smithi194' with addr '172.21.15.194' 2024-09-10T23:15:37.860 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:37 smithi003 ceph-mon[30348]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:38.251 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T23:15:38.616 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:15:38.861 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:38 smithi003 ceph-mon[30348]: Updating smithi038:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:15:38.861 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:38 smithi003 ceph-mon[30348]: Updating smithi038:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:15:38.862 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:38 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:38.862 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:38 smithi003 ceph-mon[30348]: Added host smithi194 2024-09-10T23:15:38.862 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:38 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:38.862 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:38 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:38.862 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:38 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:38.862 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:38 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:15:38.862 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:38 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:39.287 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:15:39.287 INFO:teuthology.orchestra.run.smithi003.stdout:[{"addr": "172.21.15.3", "hostname": "smithi003", "labels": [], "status": ""}, {"addr": "172.21.15.38", "hostname": "smithi038", "labels": [], "status": ""}, {"addr": "172.21.15.194", "hostname": "smithi194", "labels": [], "status": ""}] 2024-09-10T23:15:39.647 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:39 smithi003 ceph-mon[30348]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:39.647 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:39 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:39.978 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-10T23:15:39.978 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-10T23:15:40.354 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:15:40.735 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:40 smithi003 ceph-mon[30348]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:15:40.735 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:40 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:41.539 INFO:teuthology.orchestra.run.smithi003.stderr:adjusted tunables profile to default 2024-09-10T23:15:41.798 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:41 smithi003 ceph-mon[30348]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:41.798 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:41 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/627502115' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-10T23:15:42.155 INFO:tasks.cephadm:Adding mon.a on smithi003 2024-09-10T23:15:42.155 INFO:tasks.cephadm:Adding mon.b on smithi038 2024-09-10T23:15:42.156 INFO:tasks.cephadm:Adding mon.c on smithi194 2024-09-10T23:15:42.156 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi003:172.21.15.3=a;smithi038:172.21.15.38=b;smithi194:172.21.15.194=c' 2024-09-10T23:15:42.521 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:15:42.614 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:15:42.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:42 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/627502115' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T23:15:42.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:42 smithi003 ceph-mon[30348]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:15:43.367 INFO:teuthology.orchestra.run.smithi194.stdout:Scheduled mon update... 2024-09-10T23:15:43.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:43 smithi003 ceph-mon[30348]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:43.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:43 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:44.155 DEBUG:teuthology.orchestra.run.smithi038:mon.b> sudo journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mon.b.service 2024-09-10T23:15:44.159 DEBUG:teuthology.orchestra.run.smithi194:mon.c> sudo journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mon.c.service 2024-09-10T23:15:44.164 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T23:15:44.165 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:15:44.684 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:15:44.776 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:15:44.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:44 smithi003 ceph-mon[30348]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi003:172.21.15.3=a;smithi038:172.21.15.38=b;smithi194:172.21.15.194=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:15:44.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:44 smithi003 ceph-mon[30348]: Saving service mon spec with placement smithi003:172.21.15.3=a;smithi038:172.21.15.38=b;smithi194:172.21.15.194=c;count:3 2024-09-10T23:15:45.556 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-10T23:15:45.556 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"3f4e30d0-6fca-11ef-bcea-c7b262605968","modified":"2024-09-10T23:14:07.737715Z","created":"2024-09-10T23:14:07.737715Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:3300","nonce":0},{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T23:15:45.556 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-09-10T23:15:45.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:45 smithi003 ceph-mon[30348]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:45.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:45 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:45.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:45 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:45.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:45 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:45.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:45 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:45.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:45 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"} : dispatch 2024-09-10T23:15:45.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:45 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:45.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:45 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:15:45.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:45 smithi003 ceph-mon[30348]: from='client.? 172.21.15.194:0/2181157494' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:15:46.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:46 smithi003 ceph-mon[30348]: Updating smithi194:/etc/ceph/ceph.conf 2024-09-10T23:15:46.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:46 smithi003 ceph-mon[30348]: Updating smithi194:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:15:46.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:46 smithi003 ceph-mon[30348]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:15:46.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:46 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:46.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:46 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:46.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:46 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:46.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:46 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:15:46.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:46 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:47.569 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T23:15:47.572 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:15:47.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:47 smithi003 ceph-mon[30348]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:47.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:47 smithi003 ceph-mon[30348]: Updating smithi194:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:15:47.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:47 smithi003 ceph-mon[30348]: Deploying daemon mon.c on smithi194 2024-09-10T23:15:48.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:48 smithi003 ceph-mon[30348]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:49.719 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:15:50.833 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-10T23:15:50.833 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"3f4e30d0-6fca-11ef-bcea-c7b262605968","modified":"2024-09-10T23:14:07.737715Z","created":"2024-09-10T23:14:07.737715Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:3300","nonce":0},{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T23:15:50.833 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-09-10T23:15:51.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:50 smithi003 ceph-mon[30348]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:51.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:50 smithi003 ceph-mon[30348]: from='client.? 172.21.15.194:0/2164903489' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:15:52.379 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 podman[33885]: 2024-09-10 23:15:52.343491951 +0000 UTC m=+0.347819543 container start 5dd3906c776c03ae7c71648abd91156910218eb7a3b374a29af36e1c76f60f96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mon-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-10T23:15:52.702 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T23:15:52.702 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev), process ceph-mon, pid 2 2024-09-10T23:15:52.702 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: pidfile_write: ignore empty --pid-file 2024-09-10T23:15:52.702 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: load: jerasure load: lrc 2024-09-10T23:15:52.702 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: RocksDB version: 7.9.2 2024-09-10T23:15:52.702 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Git sha 0 2024-09-10T23:15:52.703 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Compile date 2024-09-10 08:02:51 2024-09-10T23:15:52.703 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: DB SUMMARY 2024-09-10T23:15:52.703 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: DB Session ID: C3EY0UDE73C2UMW0X9OD 2024-09-10T23:15:52.703 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: CURRENT file: CURRENT 2024-09-10T23:15:52.703 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T23:15:52.703 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-10T23:15:52.703 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-10T23:15:52.703 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-10T23:15:52.703 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.error_if_exists: 0 2024-09-10T23:15:52.703 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.create_if_missing: 0 2024-09-10T23:15:52.703 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.paranoid_checks: 1 2024-09-10T23:15:52.703 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T23:15:52.703 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T23:15:52.704 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T23:15:52.704 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.env: 0x564528889180 2024-09-10T23:15:52.704 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T23:15:52.704 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.info_log: 0x564561bc56e0 2024-09-10T23:15:52.704 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T23:15:52.704 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.statistics: (nil) 2024-09-10T23:15:52.704 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.use_fsync: 0 2024-09-10T23:15:52.704 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.max_log_file_size: 0 2024-09-10T23:15:52.704 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T23:15:52.704 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T23:15:52.704 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T23:15:52.704 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T23:15:52.705 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.allow_fallocate: 1 2024-09-10T23:15:52.705 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T23:15:52.705 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T23:15:52.705 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.use_direct_reads: 0 2024-09-10T23:15:52.705 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T23:15:52.705 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T23:15:52.705 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.db_log_dir: 2024-09-10T23:15:52.705 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.wal_dir: 2024-09-10T23:15:52.705 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T23:15:52.705 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T23:15:52.705 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T23:15:52.705 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T23:15:52.705 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T23:15:52.706 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T23:15:52.706 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T23:15:52.706 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T23:15:52.706 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.write_buffer_manager: 0x564561bc9b80 2024-09-10T23:15:52.706 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T23:15:52.706 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T23:15:52.706 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T23:15:52.706 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T23:15:52.706 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T23:15:52.706 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T23:15:52.706 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T23:15:52.706 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T23:15:52.706 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.unordered_write: 0 2024-09-10T23:15:52.706 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T23:15:52.707 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T23:15:52.707 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T23:15:52.707 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T23:15:52.707 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.row_cache: None 2024-09-10T23:15:52.707 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.wal_filter: None 2024-09-10T23:15:52.707 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T23:15:52.707 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T23:15:52.707 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.two_write_queues: 0 2024-09-10T23:15:52.707 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T23:15:52.707 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.wal_compression: 0 2024-09-10T23:15:52.707 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.atomic_flush: 0 2024-09-10T23:15:52.707 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T23:15:52.707 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T23:15:52.707 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T23:15:52.708 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.log_readahead_size: 0 2024-09-10T23:15:52.708 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T23:15:52.708 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T23:15:52.708 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T23:15:52.708 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T23:15:52.708 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T23:15:52.708 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T23:15:52.708 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T23:15:52.708 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.max_background_jobs: 2 2024-09-10T23:15:52.708 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.max_background_compactions: -1 2024-09-10T23:15:52.708 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.max_subcompactions: 1 2024-09-10T23:15:52.708 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T23:15:52.708 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T23:15:52.709 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T23:15:52.709 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T23:15:52.709 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T23:15:52.709 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T23:15:52.709 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T23:15:52.709 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T23:15:52.709 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.max_open_files: -1 2024-09-10T23:15:52.709 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T23:15:52.709 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T23:15:52.709 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T23:15:52.709 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T23:15:52.709 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.max_background_flushes: -1 2024-09-10T23:15:52.709 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Compression algorithms supported: 2024-09-10T23:15:52.710 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: kZSTD supported: 0 2024-09-10T23:15:52.710 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: kXpressCompression supported: 0 2024-09-10T23:15:52.710 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: kBZip2Compression supported: 0 2024-09-10T23:15:52.710 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T23:15:52.710 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: kLZ4Compression supported: 1 2024-09-10T23:15:52.710 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: kZlibCompression supported: 1 2024-09-10T23:15:52.710 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T23:15:52.710 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: kSnappyCompression supported: 1 2024-09-10T23:15:52.710 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T23:15:52.710 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T23:15:52.710 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-10T23:15:52.710 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T23:15:52.710 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T23:15:52.710 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.merge_operator: 2024-09-10T23:15:52.711 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.compaction_filter: None 2024-09-10T23:15:52.711 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T23:15:52.711 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T23:15:52.711 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T23:15:52.711 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T23:15:52.711 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564561bc5300) 2024-09-10T23:15:52.711 INFO:journalctl@ceph.mon.c.smithi194.stdout: cache_index_and_filter_blocks: 1 2024-09-10T23:15:52.711 INFO:journalctl@ceph.mon.c.smithi194.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T23:15:52.711 INFO:journalctl@ceph.mon.c.smithi194.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T23:15:52.712 INFO:journalctl@ceph.mon.c.smithi194.stdout: pin_top_level_index_and_filter: 1 2024-09-10T23:15:52.712 INFO:journalctl@ceph.mon.c.smithi194.stdout: index_type: 0 2024-09-10T23:15:52.712 INFO:journalctl@ceph.mon.c.smithi194.stdout: data_block_index_type: 0 2024-09-10T23:15:52.712 INFO:journalctl@ceph.mon.c.smithi194.stdout: index_shortening: 1 2024-09-10T23:15:52.712 INFO:journalctl@ceph.mon.c.smithi194.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T23:15:52.712 INFO:journalctl@ceph.mon.c.smithi194.stdout: checksum: 4 2024-09-10T23:15:52.712 INFO:journalctl@ceph.mon.c.smithi194.stdout: no_block_cache: 0 2024-09-10T23:15:52.712 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_cache: 0x564561bb9610 2024-09-10T23:15:52.712 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_cache_name: BinnedLRUCache 2024-09-10T23:15:52.712 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_cache_options: 2024-09-10T23:15:52.712 INFO:journalctl@ceph.mon.c.smithi194.stdout: capacity : 536870912 2024-09-10T23:15:52.712 INFO:journalctl@ceph.mon.c.smithi194.stdout: num_shard_bits : 4 2024-09-10T23:15:52.712 INFO:journalctl@ceph.mon.c.smithi194.stdout: strict_capacity_limit : 0 2024-09-10T23:15:52.713 INFO:journalctl@ceph.mon.c.smithi194.stdout: high_pri_pool_ratio: 0.000 2024-09-10T23:15:52.713 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_cache_compressed: (nil) 2024-09-10T23:15:52.713 INFO:journalctl@ceph.mon.c.smithi194.stdout: persistent_cache: (nil) 2024-09-10T23:15:52.713 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_size: 4096 2024-09-10T23:15:52.713 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_size_deviation: 10 2024-09-10T23:15:52.713 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_restart_interval: 16 2024-09-10T23:15:52.713 INFO:journalctl@ceph.mon.c.smithi194.stdout: index_block_restart_interval: 1 2024-09-10T23:15:52.713 INFO:journalctl@ceph.mon.c.smithi194.stdout: metadata_block_size: 4096 2024-09-10T23:15:52.713 INFO:journalctl@ceph.mon.c.smithi194.stdout: partition_filters: 0 2024-09-10T23:15:52.713 INFO:journalctl@ceph.mon.c.smithi194.stdout: use_delta_encoding: 1 2024-09-10T23:15:52.713 INFO:journalctl@ceph.mon.c.smithi194.stdout: filter_policy: bloomfilter 2024-09-10T23:15:52.714 INFO:journalctl@ceph.mon.c.smithi194.stdout: whole_key_filtering: 1 2024-09-10T23:15:52.714 INFO:journalctl@ceph.mon.c.smithi194.stdout: verify_compression: 0 2024-09-10T23:15:52.714 INFO:journalctl@ceph.mon.c.smithi194.stdout: read_amp_bytes_per_bit: 0 2024-09-10T23:15:52.714 INFO:journalctl@ceph.mon.c.smithi194.stdout: format_version: 5 2024-09-10T23:15:52.714 INFO:journalctl@ceph.mon.c.smithi194.stdout: enable_index_compression: 1 2024-09-10T23:15:52.714 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_align: 0 2024-09-10T23:15:52.714 INFO:journalctl@ceph.mon.c.smithi194.stdout: max_auto_readahead_size: 262144 2024-09-10T23:15:52.714 INFO:journalctl@ceph.mon.c.smithi194.stdout: prepopulate_block_cache: 0 2024-09-10T23:15:52.714 INFO:journalctl@ceph.mon.c.smithi194.stdout: initial_auto_readahead_size: 8192 2024-09-10T23:15:52.715 INFO:journalctl@ceph.mon.c.smithi194.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T23:15:52.715 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T23:15:52.715 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T23:15:52.715 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.compression: NoCompression 2024-09-10T23:15:52.715 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T23:15:52.715 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T23:15:52.715 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T23:15:52.715 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.num_levels: 7 2024-09-10T23:15:52.716 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T23:15:52.716 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T23:15:52.716 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T23:15:52.716 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T23:15:52.716 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T23:15:52.716 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T23:15:52.716 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T23:15:52.716 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T23:15:52.716 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T23:15:52.716 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T23:15:52.716 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T23:15:52.716 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T23:15:52.716 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T23:15:52.717 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T23:15:52.717 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T23:15:52.717 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T23:15:52.717 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T23:15:52.717 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T23:15:52.717 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T23:15:52.717 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T23:15:52.717 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T23:15:52.717 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T23:15:52.717 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T23:15:52.717 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T23:15:52.717 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T23:15:52.717 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T23:15:52.717 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T23:15:52.718 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T23:15:52.718 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T23:15:52.718 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T23:15:52.718 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T23:15:52.718 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T23:15:52.718 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T23:15:52.718 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T23:15:52.718 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T23:15:52.718 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T23:15:52.718 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T23:15:52.718 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T23:15:52.718 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T23:15:52.718 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T23:15:52.718 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T23:15:52.719 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T23:15:52.719 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T23:15:52.719 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T23:15:52.719 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T23:15:52.719 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T23:15:52.719 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T23:15:52.719 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T23:15:52.719 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T23:15:52.719 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T23:15:52.719 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T23:15:52.719 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T23:15:52.719 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T23:15:52.719 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T23:15:52.719 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.inplace_update_support: 0 2024-09-10T23:15:52.720 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T23:15:52.720 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T23:15:52.720 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T23:15:52.720 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T23:15:52.720 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.bloom_locality: 0 2024-09-10T23:15:52.720 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.max_successive_merges: 0 2024-09-10T23:15:52.720 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T23:15:52.720 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T23:15:52.720 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T23:15:52.720 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T23:15:52.720 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.ttl: 2592000 2024-09-10T23:15:52.720 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T23:15:52.720 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T23:15:52.720 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T23:15:52.721 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.enable_blob_files: false 2024-09-10T23:15:52.721 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.min_blob_size: 0 2024-09-10T23:15:52.721 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T23:15:52.721 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T23:15:52.721 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T23:15:52.721 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T23:15:52.721 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T23:15:52.721 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T23:15:52.721 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T23:15:52.721 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T23:15:52.721 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-10T23:15:52.721 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-10T23:15:52.722 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 9a92e3d9-2e26-4de6-a352-04dad81273b3 2024-09-10T23:15:52.722 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726010152387304, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-10T23:15:52.722 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-10T23:15:52.722 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726010152388051, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726010152, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "9a92e3d9-2e26-4de6-a352-04dad81273b3", "db_session_id": "C3EY0UDE73C2UMW0X9OD", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-10T23:15:52.722 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726010152388333, "job": 1, "event": "recovery_finished"} 2024-09-10T23:15:52.722 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-10T23:15:52.722 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T23:15:52.722 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x564561beae00 2024-09-10T23:15:52.722 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: DB pointer 0x564561cea000 2024-09-10T23:15:52.722 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-10T23:15:52.722 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T23:15:52.722 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T23:15:52.723 INFO:journalctl@ceph.mon.c.smithi194.stdout: ** DB Stats ** 2024-09-10T23:15:52.723 INFO:journalctl@ceph.mon.c.smithi194.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T23:15:52.723 INFO:journalctl@ceph.mon.c.smithi194.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T23:15:52.723 INFO:journalctl@ceph.mon.c.smithi194.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T23:15:52.723 INFO:journalctl@ceph.mon.c.smithi194.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T23:15:52.723 INFO:journalctl@ceph.mon.c.smithi194.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T23:15:52.723 INFO:journalctl@ceph.mon.c.smithi194.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T23:15:52.723 INFO:journalctl@ceph.mon.c.smithi194.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T23:15:52.723 INFO:journalctl@ceph.mon.c.smithi194.stdout: 2024-09-10T23:15:52.723 INFO:journalctl@ceph.mon.c.smithi194.stdout: ** Compaction Stats [default] ** 2024-09-10T23:15:52.723 INFO:journalctl@ceph.mon.c.smithi194.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T23:15:52.723 INFO:journalctl@ceph.mon.c.smithi194.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T23:15:52.724 INFO:journalctl@ceph.mon.c.smithi194.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:15:52.724 INFO:journalctl@ceph.mon.c.smithi194.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:15:52.724 INFO:journalctl@ceph.mon.c.smithi194.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:15:52.724 INFO:journalctl@ceph.mon.c.smithi194.stdout: 2024-09-10T23:15:52.724 INFO:journalctl@ceph.mon.c.smithi194.stdout: ** Compaction Stats [default] ** 2024-09-10T23:15:52.724 INFO:journalctl@ceph.mon.c.smithi194.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T23:15:52.724 INFO:journalctl@ceph.mon.c.smithi194.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T23:15:52.724 INFO:journalctl@ceph.mon.c.smithi194.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:15:52.724 INFO:journalctl@ceph.mon.c.smithi194.stdout: 2024-09-10T23:15:52.724 INFO:journalctl@ceph.mon.c.smithi194.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T23:15:52.724 INFO:journalctl@ceph.mon.c.smithi194.stdout: 2024-09-10T23:15:52.724 INFO:journalctl@ceph.mon.c.smithi194.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T23:15:52.724 INFO:journalctl@ceph.mon.c.smithi194.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T23:15:52.725 INFO:journalctl@ceph.mon.c.smithi194.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T23:15:52.725 INFO:journalctl@ceph.mon.c.smithi194.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T23:15:52.725 INFO:journalctl@ceph.mon.c.smithi194.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T23:15:52.725 INFO:journalctl@ceph.mon.c.smithi194.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T23:15:52.725 INFO:journalctl@ceph.mon.c.smithi194.stdout: Cumulative compaction: 0.00 GB write, 0.32 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T23:15:52.725 INFO:journalctl@ceph.mon.c.smithi194.stdout: Interval compaction: 0.00 GB write, 0.32 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T23:15:52.725 INFO:journalctl@ceph.mon.c.smithi194.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T23:15:52.725 INFO:journalctl@ceph.mon.c.smithi194.stdout: Block cache BinnedLRUCache@0x564561bb9610#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-10T23:15:52.725 INFO:journalctl@ceph.mon.c.smithi194.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-10T23:15:52.725 INFO:journalctl@ceph.mon.c.smithi194.stdout: 2024-09-10T23:15:52.725 INFO:journalctl@ceph.mon.c.smithi194.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T23:15:52.725 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: using public_addr v2:172.21.15.194:0/0 -> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-10T23:15:52.725 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: starting mon.c rank -1 at public addrs [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] at bind addrs [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:15:52.725 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: mon.c@-1(???) e0 preinit fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:15:52.726 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: mon.c@-1(synchronizing).mds e1 new map 2024-09-10T23:15:52.726 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-10T23:15:52.726 INFO:journalctl@ceph.mon.c.smithi194.stdout: e1 2024-09-10T23:15:52.726 INFO:journalctl@ceph.mon.c.smithi194.stdout: btime 2024-09-10T23:14:12:377215+0000 2024-09-10T23:15:52.726 INFO:journalctl@ceph.mon.c.smithi194.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T23:15:52.726 INFO:journalctl@ceph.mon.c.smithi194.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T23:15:52.726 INFO:journalctl@ceph.mon.c.smithi194.stdout: legacy client fscid: -1 2024-09-10T23:15:52.726 INFO:journalctl@ceph.mon.c.smithi194.stdout: 2024-09-10T23:15:52.726 INFO:journalctl@ceph.mon.c.smithi194.stdout: No filesystems configured 2024-09-10T23:15:52.726 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-10T23:15:52.726 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-10T23:15:52.726 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-10T23:15:52.726 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-10T23:15:52.726 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-10T23:15:52.727 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-10T23:15:52.727 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T23:15:52.727 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:15:52.727 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:15:52.727 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:15:52.727 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:52.727 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:15:52.727 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:52.727 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:52.727 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi194", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:15:52.727 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:52.727 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: Deploying cephadm binary to smithi194 2024-09-10T23:15:52.727 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:52.727 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:52.728 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:52.728 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:52.728 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi038", "name": "osd_memory_target"} : dispatch 2024-09-10T23:15:52.728 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:52.728 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:15:52.728 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: Updating smithi038:/etc/ceph/ceph.conf 2024-09-10T23:15:52.728 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: Updating smithi038:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:15:52.728 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:52.728 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: Updating smithi038:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:15:52.728 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: Updating smithi038:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:15:52.728 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:52.728 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: Added host smithi194 2024-09-10T23:15:52.728 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:52.728 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:52.729 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:52.729 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:15:52.729 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:52.729 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:52.729 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:52.729 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:15:52.729 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:52.729 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:52.729 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/627502115' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-10T23:15:52.729 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/627502115' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T23:15:52.729 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:15:52.729 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:52.729 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:52.730 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi003:172.21.15.3=a;smithi038:172.21.15.38=b;smithi194:172.21.15.194=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:15:52.730 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: Saving service mon spec with placement smithi003:172.21.15.3=a;smithi038:172.21.15.38=b;smithi194:172.21.15.194=c;count:3 2024-09-10T23:15:52.730 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:52.730 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:52.730 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:52.730 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:52.730 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:52.730 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"} : dispatch 2024-09-10T23:15:52.730 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:52.730 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:15:52.730 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='client.? 172.21.15.194:0/2181157494' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:15:52.730 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: Updating smithi194:/etc/ceph/ceph.conf 2024-09-10T23:15:52.730 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: Updating smithi194:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:15:52.731 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:15:52.731 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:52.731 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:52.731 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:52.731 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:15:52.731 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:52.731 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:52.731 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: Updating smithi194:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:15:52.731 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: Deploying daemon mon.c on smithi194 2024-09-10T23:15:52.731 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:52.731 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:52.731 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: from='client.? 172.21.15.194:0/2164903489' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:15:52.731 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 ceph-mon[33904]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-10T23:15:52.731 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 bash[33885]: 5dd3906c776c03ae7c71648abd91156910218eb7a3b374a29af36e1c76f60f96 2024-09-10T23:15:52.732 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:52 smithi194 systemd[1]: Started Ceph mon.c for 3f4e30d0-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:15:52.873 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T23:15:52.873 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:15:53.240 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:15:57.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:57 smithi194 ceph-mon[33904]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:57.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:57 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:15:57.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:57 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:15:57.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:57 smithi194 ceph-mon[33904]: mon.a calling monitor election 2024-09-10T23:15:57.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:57 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:15:57.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:57 smithi194 ceph-mon[33904]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:57.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:57 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:15:57.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:57 smithi194 ceph-mon[33904]: mon.c calling monitor election 2024-09-10T23:15:57.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:57 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:15:57.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:57 smithi194 ceph-mon[33904]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:57.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:57 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:15:57.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:57 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:15:57.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:57 smithi194 ceph-mon[33904]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T23:15:57.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:57 smithi194 ceph-mon[33904]: monmap epoch 2 2024-09-10T23:15:57.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:57 smithi194 ceph-mon[33904]: fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:15:57.950 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:57 smithi194 ceph-mon[33904]: last_changed 2024-09-10T23:15:52.425354+0000 2024-09-10T23:15:57.950 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:57 smithi194 ceph-mon[33904]: created 2024-09-10T23:14:07.737715+0000 2024-09-10T23:15:57.950 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:57 smithi194 ceph-mon[33904]: min_mon_release 19 (squid) 2024-09-10T23:15:57.950 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:57 smithi194 ceph-mon[33904]: election_strategy: 1 2024-09-10T23:15:57.950 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:57 smithi194 ceph-mon[33904]: 0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2024-09-10T23:15:57.950 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:57 smithi194 ceph-mon[33904]: 1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.c 2024-09-10T23:15:57.950 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:57 smithi194 ceph-mon[33904]: fsmap 2024-09-10T23:15:57.950 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:57 smithi194 ceph-mon[33904]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:15:57.950 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:57 smithi194 ceph-mon[33904]: mgrmap e13: x(active, since 51s) 2024-09-10T23:15:57.950 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:57 smithi194 ceph-mon[33904]: overall HEALTH_OK 2024-09-10T23:15:57.950 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:57 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:57.950 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:57 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:57.951 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:57 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:57.951 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:57 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:15:57.951 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:57 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:57.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:57 smithi003 ceph-mon[30348]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:57.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:57 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:15:57.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:57 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:15:57.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:57 smithi003 ceph-mon[30348]: mon.a calling monitor election 2024-09-10T23:15:57.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:57 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:15:57.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:57 smithi003 ceph-mon[30348]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:57.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:57 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:15:57.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:57 smithi003 ceph-mon[30348]: mon.c calling monitor election 2024-09-10T23:15:57.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:57 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:15:57.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:57 smithi003 ceph-mon[30348]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:57.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:57 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:15:57.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:57 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:15:57.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:57 smithi003 ceph-mon[30348]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T23:15:57.973 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:57 smithi003 ceph-mon[30348]: monmap epoch 2 2024-09-10T23:15:57.973 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:57 smithi003 ceph-mon[30348]: fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:15:57.973 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:57 smithi003 ceph-mon[30348]: last_changed 2024-09-10T23:15:52.425354+0000 2024-09-10T23:15:57.973 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:57 smithi003 ceph-mon[30348]: created 2024-09-10T23:14:07.737715+0000 2024-09-10T23:15:57.973 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:57 smithi003 ceph-mon[30348]: min_mon_release 19 (squid) 2024-09-10T23:15:57.973 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:57 smithi003 ceph-mon[30348]: election_strategy: 1 2024-09-10T23:15:57.973 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:57 smithi003 ceph-mon[30348]: 0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2024-09-10T23:15:57.973 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:57 smithi003 ceph-mon[30348]: 1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.c 2024-09-10T23:15:57.973 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:57 smithi003 ceph-mon[30348]: fsmap 2024-09-10T23:15:57.973 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:57 smithi003 ceph-mon[30348]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:15:57.973 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:57 smithi003 ceph-mon[30348]: mgrmap e13: x(active, since 51s) 2024-09-10T23:15:57.973 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:57 smithi003 ceph-mon[30348]: overall HEALTH_OK 2024-09-10T23:15:57.973 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:57 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:57.974 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:57 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:57.974 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:57 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:15:57.974 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:57 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:15:57.974 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:57 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:15:58.423 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-10T23:15:58.424 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":2,"fsid":"3f4e30d0-6fca-11ef-bcea-c7b262605968","modified":"2024-09-10T23:15:52.425354Z","created":"2024-09-10T23:14:07.737715Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:3300","nonce":0},{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T23:15:58.424 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 2 2024-09-10T23:15:58.682 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:58 smithi194 ceph-mon[33904]: Deploying daemon mon.b on smithi038 2024-09-10T23:15:58.682 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:58 smithi194 ceph-mon[33904]: from='client.? 172.21.15.194:0/3857287658' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:15:58.683 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:58 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:15:58.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:58 smithi003 ceph-mon[30348]: Deploying daemon mon.b on smithi038 2024-09-10T23:15:58.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:58 smithi003 ceph-mon[30348]: from='client.? 172.21.15.194:0/3857287658' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:15:58.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:58 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:15:59.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:15:59 smithi003 ceph-mon[30348]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:15:59.721 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:15:59 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T23:15:59.425+0000 7f9a61400640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-10T23:15:59.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:15:59 smithi194 ceph-mon[33904]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:00.000 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T23:16:00.000 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:16:00.358 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:16:01.107 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-10T23:16:01.107 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":2,"fsid":"3f4e30d0-6fca-11ef-bcea-c7b262605968","modified":"2024-09-10T23:15:52.425354Z","created":"2024-09-10T23:14:07.737715Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:3300","nonce":0},{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T23:16:01.108 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 2 2024-09-10T23:16:01.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:01 smithi194 ceph-mon[33904]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:01.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:01 smithi194 ceph-mon[33904]: from='client.? 172.21.15.194:0/3329924490' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:16:01.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:01 smithi003 ceph-mon[30348]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:01.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:01 smithi003 ceph-mon[30348]: from='client.? 172.21.15.194:0/3329924490' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:16:02.704 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T23:16:02.704 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:16:02.819 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 podman[34206]: 2024-09-10 23:16:02.782941277 +0000 UTC m=+0.349616583 container start 7a803f8f539b60e120fe5b1bce6e23d4616af50e9ce2d72f2729cbca9d78e4fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mon-b, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=) 2024-09-10T23:16:03.066 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:16:03.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T23:16:03.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev), process ceph-mon, pid 2 2024-09-10T23:16:03.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: pidfile_write: ignore empty --pid-file 2024-09-10T23:16:03.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: load: jerasure load: lrc 2024-09-10T23:16:03.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: RocksDB version: 7.9.2 2024-09-10T23:16:03.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Git sha 0 2024-09-10T23:16:03.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Compile date 2024-09-10 08:02:51 2024-09-10T23:16:03.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: DB SUMMARY 2024-09-10T23:16:03.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: DB Session ID: J35J4H5ZA67S4AELXQ0F 2024-09-10T23:16:03.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: CURRENT file: CURRENT 2024-09-10T23:16:03.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T23:16:03.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-10T23:16:03.099 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-10T23:16:03.099 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-10T23:16:03.099 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.error_if_exists: 0 2024-09-10T23:16:03.099 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.create_if_missing: 0 2024-09-10T23:16:03.099 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.paranoid_checks: 1 2024-09-10T23:16:03.099 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T23:16:03.099 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T23:16:03.099 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T23:16:03.099 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.env: 0x5651adeae180 2024-09-10T23:16:03.099 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T23:16:03.099 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.info_log: 0x5651e79fd6e0 2024-09-10T23:16:03.099 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T23:16:03.099 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.statistics: (nil) 2024-09-10T23:16:03.100 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.use_fsync: 0 2024-09-10T23:16:03.100 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.max_log_file_size: 0 2024-09-10T23:16:03.100 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T23:16:03.100 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T23:16:03.100 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T23:16:03.100 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T23:16:03.100 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.allow_fallocate: 1 2024-09-10T23:16:03.100 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T23:16:03.100 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T23:16:03.100 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.use_direct_reads: 0 2024-09-10T23:16:03.100 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T23:16:03.100 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T23:16:03.100 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.db_log_dir: 2024-09-10T23:16:03.101 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.wal_dir: 2024-09-10T23:16:03.101 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T23:16:03.102 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T23:16:03.102 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T23:16:03.102 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T23:16:03.103 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T23:16:03.103 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T23:16:03.103 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T23:16:03.103 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T23:16:03.103 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.write_buffer_manager: 0x5651e7a01b80 2024-09-10T23:16:03.103 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T23:16:03.103 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T23:16:03.103 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T23:16:03.103 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T23:16:03.103 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T23:16:03.103 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T23:16:03.103 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T23:16:03.103 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T23:16:03.104 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.unordered_write: 0 2024-09-10T23:16:03.104 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T23:16:03.104 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T23:16:03.104 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T23:16:03.104 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T23:16:03.104 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.row_cache: None 2024-09-10T23:16:03.104 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.wal_filter: None 2024-09-10T23:16:03.104 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T23:16:03.104 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T23:16:03.104 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.two_write_queues: 0 2024-09-10T23:16:03.104 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T23:16:03.104 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.wal_compression: 0 2024-09-10T23:16:03.105 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.atomic_flush: 0 2024-09-10T23:16:03.105 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T23:16:03.105 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T23:16:03.105 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T23:16:03.105 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.log_readahead_size: 0 2024-09-10T23:16:03.105 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T23:16:03.105 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T23:16:03.105 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T23:16:03.105 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T23:16:03.105 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T23:16:03.105 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T23:16:03.105 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T23:16:03.105 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.max_background_jobs: 2 2024-09-10T23:16:03.105 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.max_background_compactions: -1 2024-09-10T23:16:03.106 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.max_subcompactions: 1 2024-09-10T23:16:03.106 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T23:16:03.106 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T23:16:03.106 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T23:16:03.106 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T23:16:03.106 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T23:16:03.106 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T23:16:03.106 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T23:16:03.106 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T23:16:03.106 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.max_open_files: -1 2024-09-10T23:16:03.106 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T23:16:03.106 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T23:16:03.106 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T23:16:03.106 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T23:16:03.107 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.max_background_flushes: -1 2024-09-10T23:16:03.107 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Compression algorithms supported: 2024-09-10T23:16:03.107 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: kZSTD supported: 0 2024-09-10T23:16:03.107 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: kXpressCompression supported: 0 2024-09-10T23:16:03.107 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: kBZip2Compression supported: 0 2024-09-10T23:16:03.107 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T23:16:03.107 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: kLZ4Compression supported: 1 2024-09-10T23:16:03.107 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: kZlibCompression supported: 1 2024-09-10T23:16:03.107 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T23:16:03.107 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: kSnappyCompression supported: 1 2024-09-10T23:16:03.107 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T23:16:03.107 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T23:16:03.107 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-10T23:16:03.108 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T23:16:03.108 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T23:16:03.108 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.merge_operator: 2024-09-10T23:16:03.108 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.compaction_filter: None 2024-09-10T23:16:03.108 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T23:16:03.108 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T23:16:03.108 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T23:16:03.108 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T23:16:03.108 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5651e79fd300) 2024-09-10T23:16:03.108 INFO:journalctl@ceph.mon.b.smithi038.stdout: cache_index_and_filter_blocks: 1 2024-09-10T23:16:03.108 INFO:journalctl@ceph.mon.b.smithi038.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T23:16:03.108 INFO:journalctl@ceph.mon.b.smithi038.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T23:16:03.108 INFO:journalctl@ceph.mon.b.smithi038.stdout: pin_top_level_index_and_filter: 1 2024-09-10T23:16:03.109 INFO:journalctl@ceph.mon.b.smithi038.stdout: index_type: 0 2024-09-10T23:16:03.109 INFO:journalctl@ceph.mon.b.smithi038.stdout: data_block_index_type: 0 2024-09-10T23:16:03.109 INFO:journalctl@ceph.mon.b.smithi038.stdout: index_shortening: 1 2024-09-10T23:16:03.109 INFO:journalctl@ceph.mon.b.smithi038.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T23:16:03.109 INFO:journalctl@ceph.mon.b.smithi038.stdout: checksum: 4 2024-09-10T23:16:03.109 INFO:journalctl@ceph.mon.b.smithi038.stdout: no_block_cache: 0 2024-09-10T23:16:03.109 INFO:journalctl@ceph.mon.b.smithi038.stdout: block_cache: 0x5651e79f1610 2024-09-10T23:16:03.109 INFO:journalctl@ceph.mon.b.smithi038.stdout: block_cache_name: BinnedLRUCache 2024-09-10T23:16:03.109 INFO:journalctl@ceph.mon.b.smithi038.stdout: block_cache_options: 2024-09-10T23:16:03.109 INFO:journalctl@ceph.mon.b.smithi038.stdout: capacity : 536870912 2024-09-10T23:16:03.109 INFO:journalctl@ceph.mon.b.smithi038.stdout: num_shard_bits : 4 2024-09-10T23:16:03.109 INFO:journalctl@ceph.mon.b.smithi038.stdout: strict_capacity_limit : 0 2024-09-10T23:16:03.109 INFO:journalctl@ceph.mon.b.smithi038.stdout: high_pri_pool_ratio: 0.000 2024-09-10T23:16:03.110 INFO:journalctl@ceph.mon.b.smithi038.stdout: block_cache_compressed: (nil) 2024-09-10T23:16:03.110 INFO:journalctl@ceph.mon.b.smithi038.stdout: persistent_cache: (nil) 2024-09-10T23:16:03.110 INFO:journalctl@ceph.mon.b.smithi038.stdout: block_size: 4096 2024-09-10T23:16:03.110 INFO:journalctl@ceph.mon.b.smithi038.stdout: block_size_deviation: 10 2024-09-10T23:16:03.110 INFO:journalctl@ceph.mon.b.smithi038.stdout: block_restart_interval: 16 2024-09-10T23:16:03.110 INFO:journalctl@ceph.mon.b.smithi038.stdout: index_block_restart_interval: 1 2024-09-10T23:16:03.110 INFO:journalctl@ceph.mon.b.smithi038.stdout: metadata_block_size: 4096 2024-09-10T23:16:03.110 INFO:journalctl@ceph.mon.b.smithi038.stdout: partition_filters: 0 2024-09-10T23:16:03.110 INFO:journalctl@ceph.mon.b.smithi038.stdout: use_delta_encoding: 1 2024-09-10T23:16:03.110 INFO:journalctl@ceph.mon.b.smithi038.stdout: filter_policy: bloomfilter 2024-09-10T23:16:03.110 INFO:journalctl@ceph.mon.b.smithi038.stdout: whole_key_filtering: 1 2024-09-10T23:16:03.110 INFO:journalctl@ceph.mon.b.smithi038.stdout: verify_compression: 0 2024-09-10T23:16:03.110 INFO:journalctl@ceph.mon.b.smithi038.stdout: read_amp_bytes_per_bit: 0 2024-09-10T23:16:03.111 INFO:journalctl@ceph.mon.b.smithi038.stdout: format_version: 5 2024-09-10T23:16:03.111 INFO:journalctl@ceph.mon.b.smithi038.stdout: enable_index_compression: 1 2024-09-10T23:16:03.111 INFO:journalctl@ceph.mon.b.smithi038.stdout: block_align: 0 2024-09-10T23:16:03.111 INFO:journalctl@ceph.mon.b.smithi038.stdout: max_auto_readahead_size: 262144 2024-09-10T23:16:03.111 INFO:journalctl@ceph.mon.b.smithi038.stdout: prepopulate_block_cache: 0 2024-09-10T23:16:03.111 INFO:journalctl@ceph.mon.b.smithi038.stdout: initial_auto_readahead_size: 8192 2024-09-10T23:16:03.111 INFO:journalctl@ceph.mon.b.smithi038.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T23:16:03.111 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T23:16:03.111 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T23:16:03.111 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.compression: NoCompression 2024-09-10T23:16:03.111 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T23:16:03.111 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T23:16:03.111 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T23:16:03.111 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.num_levels: 7 2024-09-10T23:16:03.112 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T23:16:03.112 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T23:16:03.112 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T23:16:03.112 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T23:16:03.112 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T23:16:03.112 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T23:16:03.112 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T23:16:03.112 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T23:16:03.112 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T23:16:03.112 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T23:16:03.112 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T23:16:03.112 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T23:16:03.112 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T23:16:03.112 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T23:16:03.113 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T23:16:03.113 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T23:16:03.113 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T23:16:03.113 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T23:16:03.113 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T23:16:03.113 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T23:16:03.113 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T23:16:03.113 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T23:16:03.113 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T23:16:03.113 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T23:16:03.113 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T23:16:03.113 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T23:16:03.113 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T23:16:03.113 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T23:16:03.114 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T23:16:03.114 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T23:16:03.114 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T23:16:03.114 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T23:16:03.114 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T23:16:03.114 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T23:16:03.114 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T23:16:03.114 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T23:16:03.114 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T23:16:03.114 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T23:16:03.114 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T23:16:03.114 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T23:16:03.114 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T23:16:03.114 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T23:16:03.114 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T23:16:03.115 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T23:16:03.115 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T23:16:03.115 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T23:16:03.115 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T23:16:03.115 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T23:16:03.115 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T23:16:03.115 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T23:16:03.115 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T23:16:03.115 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T23:16:03.115 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T23:16:03.115 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T23:16:03.115 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.inplace_update_support: 0 2024-09-10T23:16:03.115 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T23:16:03.116 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T23:16:03.116 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T23:16:03.116 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T23:16:03.116 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.bloom_locality: 0 2024-09-10T23:16:03.116 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.max_successive_merges: 0 2024-09-10T23:16:03.116 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T23:16:03.116 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T23:16:03.116 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T23:16:03.116 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T23:16:03.116 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.ttl: 2592000 2024-09-10T23:16:03.116 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T23:16:03.116 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T23:16:03.116 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T23:16:03.116 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.enable_blob_files: false 2024-09-10T23:16:03.117 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.min_blob_size: 0 2024-09-10T23:16:03.117 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T23:16:03.117 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T23:16:03.117 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T23:16:03.117 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T23:16:03.117 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T23:16:03.117 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T23:16:03.117 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T23:16:03.117 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T23:16:03.117 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-10T23:16:03.117 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-10T23:16:03.117 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 158481a6-d0ca-4136-8fdf-087e3247de8b 2024-09-10T23:16:03.117 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726010162827261, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-10T23:16:03.118 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-10T23:16:03.118 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726010162828300, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726010162, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "158481a6-d0ca-4136-8fdf-087e3247de8b", "db_session_id": "J35J4H5ZA67S4AELXQ0F", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-10T23:16:03.118 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726010162828581, "job": 1, "event": "recovery_finished"} 2024-09-10T23:16:03.118 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-10T23:16:03.118 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T23:16:03.118 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5651e7a22e00 2024-09-10T23:16:03.118 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: DB pointer 0x5651e7b22000 2024-09-10T23:16:03.118 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T23:16:03.118 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T23:16:03.118 INFO:journalctl@ceph.mon.b.smithi038.stdout: ** DB Stats ** 2024-09-10T23:16:03.118 INFO:journalctl@ceph.mon.b.smithi038.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T23:16:03.118 INFO:journalctl@ceph.mon.b.smithi038.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T23:16:03.118 INFO:journalctl@ceph.mon.b.smithi038.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T23:16:03.118 INFO:journalctl@ceph.mon.b.smithi038.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T23:16:03.119 INFO:journalctl@ceph.mon.b.smithi038.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T23:16:03.119 INFO:journalctl@ceph.mon.b.smithi038.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T23:16:03.119 INFO:journalctl@ceph.mon.b.smithi038.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T23:16:03.119 INFO:journalctl@ceph.mon.b.smithi038.stdout: 2024-09-10T23:16:03.119 INFO:journalctl@ceph.mon.b.smithi038.stdout: ** Compaction Stats [default] ** 2024-09-10T23:16:03.119 INFO:journalctl@ceph.mon.b.smithi038.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T23:16:03.119 INFO:journalctl@ceph.mon.b.smithi038.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T23:16:03.119 INFO:journalctl@ceph.mon.b.smithi038.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:16:03.119 INFO:journalctl@ceph.mon.b.smithi038.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:16:03.119 INFO:journalctl@ceph.mon.b.smithi038.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:16:03.119 INFO:journalctl@ceph.mon.b.smithi038.stdout: 2024-09-10T23:16:03.119 INFO:journalctl@ceph.mon.b.smithi038.stdout: ** Compaction Stats [default] ** 2024-09-10T23:16:03.119 INFO:journalctl@ceph.mon.b.smithi038.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T23:16:03.120 INFO:journalctl@ceph.mon.b.smithi038.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T23:16:03.120 INFO:journalctl@ceph.mon.b.smithi038.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:16:03.120 INFO:journalctl@ceph.mon.b.smithi038.stdout: 2024-09-10T23:16:03.120 INFO:journalctl@ceph.mon.b.smithi038.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T23:16:03.120 INFO:journalctl@ceph.mon.b.smithi038.stdout: 2024-09-10T23:16:03.120 INFO:journalctl@ceph.mon.b.smithi038.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T23:16:03.120 INFO:journalctl@ceph.mon.b.smithi038.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T23:16:03.120 INFO:journalctl@ceph.mon.b.smithi038.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T23:16:03.120 INFO:journalctl@ceph.mon.b.smithi038.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T23:16:03.120 INFO:journalctl@ceph.mon.b.smithi038.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T23:16:03.120 INFO:journalctl@ceph.mon.b.smithi038.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T23:16:03.120 INFO:journalctl@ceph.mon.b.smithi038.stdout: Cumulative compaction: 0.00 GB write, 0.16 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T23:16:03.121 INFO:journalctl@ceph.mon.b.smithi038.stdout: Interval compaction: 0.00 GB write, 0.16 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T23:16:03.121 INFO:journalctl@ceph.mon.b.smithi038.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T23:16:03.121 INFO:journalctl@ceph.mon.b.smithi038.stdout: Block cache BinnedLRUCache@0x5651e79f1610#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-10T23:16:03.121 INFO:journalctl@ceph.mon.b.smithi038.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-10T23:16:03.121 INFO:journalctl@ceph.mon.b.smithi038.stdout: 2024-09-10T23:16:03.121 INFO:journalctl@ceph.mon.b.smithi038.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T23:16:03.121 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-10T23:16:03.121 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: using public_addr v2:172.21.15.38:0/0 -> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] 2024-09-10T23:16:03.121 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: starting mon.b rank -1 at public addrs [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] at bind addrs [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:16:03.122 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: mon.b@-1(???) e0 preinit fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:16:03.122 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: mon.b@-1(synchronizing).mds e1 new map 2024-09-10T23:16:03.122 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-10T23:16:03.122 INFO:journalctl@ceph.mon.b.smithi038.stdout: e1 2024-09-10T23:16:03.122 INFO:journalctl@ceph.mon.b.smithi038.stdout: btime 2024-09-10T23:14:12:377215+0000 2024-09-10T23:16:03.122 INFO:journalctl@ceph.mon.b.smithi038.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T23:16:03.122 INFO:journalctl@ceph.mon.b.smithi038.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T23:16:03.122 INFO:journalctl@ceph.mon.b.smithi038.stdout: legacy client fscid: -1 2024-09-10T23:16:03.122 INFO:journalctl@ceph.mon.b.smithi038.stdout: 2024-09-10T23:16:03.122 INFO:journalctl@ceph.mon.b.smithi038.stdout: No filesystems configured 2024-09-10T23:16:03.122 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-10T23:16:03.122 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-10T23:16:03.122 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-10T23:16:03.123 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-10T23:16:03.123 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-10T23:16:03.123 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-10T23:16:03.124 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T23:16:03.124 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:16:03.124 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:16:03.124 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:16:03.124 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:03.124 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:16:03.125 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:03.125 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:03.125 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi194", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:16:03.125 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:03.125 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: Deploying cephadm binary to smithi194 2024-09-10T23:16:03.125 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:03.125 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:03.125 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:03.125 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:03.125 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi038", "name": "osd_memory_target"} : dispatch 2024-09-10T23:16:03.125 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:03.125 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:16:03.125 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: Updating smithi038:/etc/ceph/ceph.conf 2024-09-10T23:16:03.126 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: Updating smithi038:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:16:03.126 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:03.126 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: Updating smithi038:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:16:03.126 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: Updating smithi038:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:16:03.126 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:03.126 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: Added host smithi194 2024-09-10T23:16:03.126 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:03.126 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:03.126 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:03.126 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:16:03.126 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:03.126 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:03.127 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:03.127 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:16:03.127 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:03.127 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:03.127 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/627502115' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-10T23:16:03.127 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/627502115' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T23:16:03.127 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:16:03.127 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:03.127 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:03.127 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi003:172.21.15.3=a;smithi038:172.21.15.38=b;smithi194:172.21.15.194=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:16:03.127 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: Saving service mon spec with placement smithi003:172.21.15.3=a;smithi038:172.21.15.38=b;smithi194:172.21.15.194=c;count:3 2024-09-10T23:16:03.128 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:03.128 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:03.128 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:03.128 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:03.128 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:03.128 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"} : dispatch 2024-09-10T23:16:03.128 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:03.128 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:16:03.128 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='client.? 172.21.15.194:0/2181157494' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:16:03.128 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: Updating smithi194:/etc/ceph/ceph.conf 2024-09-10T23:16:03.128 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: Updating smithi194:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:16:03.128 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:16:03.128 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:03.129 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:03.129 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:03.129 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:16:03.129 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:03.129 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:03.129 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: Updating smithi194:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:16:03.129 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: Deploying daemon mon.c on smithi194 2024-09-10T23:16:03.129 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:03.129 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:03.129 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='client.? 172.21.15.194:0/2164903489' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:16:03.129 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:03.129 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:16:03.129 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:16:03.130 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: mon.a calling monitor election 2024-09-10T23:16:03.130 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:16:03.130 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:03.130 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:16:03.130 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: mon.c calling monitor election 2024-09-10T23:16:03.130 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:16:03.130 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:03.130 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:16:03.130 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:16:03.130 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T23:16:03.130 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: monmap epoch 2 2024-09-10T23:16:03.130 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:16:03.130 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: last_changed 2024-09-10T23:15:52.425354+0000 2024-09-10T23:16:03.130 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: created 2024-09-10T23:14:07.737715+0000 2024-09-10T23:16:03.131 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: min_mon_release 19 (squid) 2024-09-10T23:16:03.131 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: election_strategy: 1 2024-09-10T23:16:03.131 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: 0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2024-09-10T23:16:03.131 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: 1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.c 2024-09-10T23:16:03.131 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: fsmap 2024-09-10T23:16:03.131 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:16:03.131 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: mgrmap e13: x(active, since 51s) 2024-09-10T23:16:03.131 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: overall HEALTH_OK 2024-09-10T23:16:03.131 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:03.131 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:03.131 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:03.131 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:16:03.131 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:03.132 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: Deploying daemon mon.b on smithi038 2024-09-10T23:16:03.132 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='client.? 172.21.15.194:0/3857287658' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:16:03.132 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:16:03.132 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:03.132 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:03.132 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: from='client.? 172.21.15.194:0/3329924490' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:16:03.132 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 ceph-mon[34225]: mon.b@-1(synchronizing).paxosservice(auth 1..4) refresh upgraded, format 0 -> 3 2024-09-10T23:16:03.132 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 bash[34206]: 7a803f8f539b60e120fe5b1bce6e23d4616af50e9ce2d72f2729cbca9d78e4fb 2024-09-10T23:16:03.132 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:02 smithi038 systemd[1]: Started Ceph mon.b for 3f4e30d0-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:16:08.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:07 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:16:08.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:07 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:16:08.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:07 smithi194 ceph-mon[33904]: mon.a calling monitor election 2024-09-10T23:16:08.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:07 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:16:08.199 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:07 smithi194 ceph-mon[33904]: mon.c calling monitor election 2024-09-10T23:16:08.199 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:07 smithi194 ceph-mon[33904]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:08.199 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:07 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:16:08.199 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:07 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:16:08.199 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:07 smithi194 ceph-mon[33904]: mon.b calling monitor election 2024-09-10T23:16:08.199 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:07 smithi194 ceph-mon[33904]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:08.199 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:07 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:16:08.199 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:07 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:16:08.199 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:07 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:16:08.199 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:07 smithi194 ceph-mon[33904]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T23:16:08.199 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:07 smithi194 ceph-mon[33904]: monmap epoch 3 2024-09-10T23:16:08.199 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:07 smithi194 ceph-mon[33904]: fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:16:08.200 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:07 smithi194 ceph-mon[33904]: last_changed 2024-09-10T23:16:02.874928+0000 2024-09-10T23:16:08.200 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:07 smithi194 ceph-mon[33904]: created 2024-09-10T23:14:07.737715+0000 2024-09-10T23:16:08.200 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:07 smithi194 ceph-mon[33904]: min_mon_release 19 (squid) 2024-09-10T23:16:08.200 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:07 smithi194 ceph-mon[33904]: election_strategy: 1 2024-09-10T23:16:08.200 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:07 smithi194 ceph-mon[33904]: 0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2024-09-10T23:16:08.200 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:07 smithi194 ceph-mon[33904]: 1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.c 2024-09-10T23:16:08.200 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:07 smithi194 ceph-mon[33904]: 2: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.b 2024-09-10T23:16:08.200 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:07 smithi194 ceph-mon[33904]: fsmap 2024-09-10T23:16:08.200 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:07 smithi194 ceph-mon[33904]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:16:08.200 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:07 smithi194 ceph-mon[33904]: mgrmap e13: x(active, since 62s) 2024-09-10T23:16:08.200 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:07 smithi194 ceph-mon[33904]: overall HEALTH_OK 2024-09-10T23:16:08.200 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:07 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:08.201 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:07 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:08.201 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:07 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:08.201 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:07 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:08.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:07 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:16:08.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:07 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:16:08.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:07 smithi003 ceph-mon[30348]: mon.a calling monitor election 2024-09-10T23:16:08.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:07 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:16:08.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:07 smithi003 ceph-mon[30348]: mon.c calling monitor election 2024-09-10T23:16:08.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:07 smithi003 ceph-mon[30348]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:08.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:07 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:16:08.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:07 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:16:08.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:07 smithi003 ceph-mon[30348]: mon.b calling monitor election 2024-09-10T23:16:08.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:07 smithi003 ceph-mon[30348]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:08.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:07 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:16:08.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:07 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:16:08.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:07 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:16:08.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:07 smithi003 ceph-mon[30348]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T23:16:08.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:07 smithi003 ceph-mon[30348]: monmap epoch 3 2024-09-10T23:16:08.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:07 smithi003 ceph-mon[30348]: fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:16:08.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:07 smithi003 ceph-mon[30348]: last_changed 2024-09-10T23:16:02.874928+0000 2024-09-10T23:16:08.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:07 smithi003 ceph-mon[30348]: created 2024-09-10T23:14:07.737715+0000 2024-09-10T23:16:08.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:07 smithi003 ceph-mon[30348]: min_mon_release 19 (squid) 2024-09-10T23:16:08.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:07 smithi003 ceph-mon[30348]: election_strategy: 1 2024-09-10T23:16:08.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:07 smithi003 ceph-mon[30348]: 0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2024-09-10T23:16:08.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:07 smithi003 ceph-mon[30348]: 1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.c 2024-09-10T23:16:08.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:07 smithi003 ceph-mon[30348]: 2: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.b 2024-09-10T23:16:08.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:07 smithi003 ceph-mon[30348]: fsmap 2024-09-10T23:16:08.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:07 smithi003 ceph-mon[30348]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:16:08.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:07 smithi003 ceph-mon[30348]: mgrmap e13: x(active, since 62s) 2024-09-10T23:16:08.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:07 smithi003 ceph-mon[30348]: overall HEALTH_OK 2024-09-10T23:16:08.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:07 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:08.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:07 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:08.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:07 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:08.224 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:07 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:08.252 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-10T23:16:08.252 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":3,"fsid":"3f4e30d0-6fca-11ef-bcea-c7b262605968","modified":"2024-09-10T23:16:02.874928Z","created":"2024-09-10T23:14:07.737715Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:3300","nonce":0},{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-10T23:16:08.252 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 3 2024-09-10T23:16:08.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:07 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:16:08.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:07 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:16:08.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:07 smithi038 ceph-mon[34225]: mon.a calling monitor election 2024-09-10T23:16:08.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:07 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:16:08.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:07 smithi038 ceph-mon[34225]: mon.c calling monitor election 2024-09-10T23:16:08.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:07 smithi038 ceph-mon[34225]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:08.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:07 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:16:08.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:07 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:16:08.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:07 smithi038 ceph-mon[34225]: mon.b calling monitor election 2024-09-10T23:16:08.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:07 smithi038 ceph-mon[34225]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:08.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:07 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:16:08.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:07 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:16:08.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:07 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:16:08.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:07 smithi038 ceph-mon[34225]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T23:16:08.349 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:07 smithi038 ceph-mon[34225]: monmap epoch 3 2024-09-10T23:16:08.349 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:07 smithi038 ceph-mon[34225]: fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:16:08.349 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:07 smithi038 ceph-mon[34225]: last_changed 2024-09-10T23:16:02.874928+0000 2024-09-10T23:16:08.349 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:07 smithi038 ceph-mon[34225]: created 2024-09-10T23:14:07.737715+0000 2024-09-10T23:16:08.349 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:07 smithi038 ceph-mon[34225]: min_mon_release 19 (squid) 2024-09-10T23:16:08.349 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:07 smithi038 ceph-mon[34225]: election_strategy: 1 2024-09-10T23:16:08.349 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:07 smithi038 ceph-mon[34225]: 0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2024-09-10T23:16:08.349 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:07 smithi038 ceph-mon[34225]: 1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.c 2024-09-10T23:16:08.349 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:07 smithi038 ceph-mon[34225]: 2: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.b 2024-09-10T23:16:08.349 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:07 smithi038 ceph-mon[34225]: fsmap 2024-09-10T23:16:08.349 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:07 smithi038 ceph-mon[34225]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:16:08.349 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:07 smithi038 ceph-mon[34225]: mgrmap e13: x(active, since 62s) 2024-09-10T23:16:08.350 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:07 smithi038 ceph-mon[34225]: overall HEALTH_OK 2024-09-10T23:16:08.350 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:07 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:08.350 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:07 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:08.350 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:07 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:08.350 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:07 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:08.882 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-10T23:16:08.882 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-10T23:16:09.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:08 smithi194 ceph-mon[33904]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:09.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:08 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:16:09.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:08 smithi194 ceph-mon[33904]: from='client.? 172.21.15.194:0/2596231264' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:16:09.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:08 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:16:09.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:08 smithi003 ceph-mon[30348]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:09.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:08 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:16:09.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:08 smithi003 ceph-mon[30348]: from='client.? 172.21.15.194:0/2596231264' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:16:09.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:08 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:16:09.264 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:09.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:08 smithi038 ceph-mon[34225]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:09.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:08 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:16:09.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:08 smithi038 ceph-mon[34225]: from='client.? 172.21.15.194:0/2596231264' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:16:09.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:08 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:16:09.965 INFO:teuthology.orchestra.run.smithi003.stdout:# minimal ceph.conf for 3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:16:09.965 INFO:teuthology.orchestra.run.smithi003.stdout:[global] 2024-09-10T23:16:09.965 INFO:teuthology.orchestra.run.smithi003.stdout: fsid = 3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:16:09.965 INFO:teuthology.orchestra.run.smithi003.stdout: mon_host = [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-10T23:16:10.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:10 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:10.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:10 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:10.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:10 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:10.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:10 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:10.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:10 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:10.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:10 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:16:10.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:10 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/1078510499' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:10.719 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:10 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:10.719 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:10 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:10.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:10 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:10.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:10 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:10.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:10 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:10.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:10 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:16:10.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:10 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1078510499' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:10.765 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-10T23:16:10.766 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-10T23:16:10.766 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T23:16:10.825 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-10T23:16:10.825 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:16:10.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:10 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:10.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:10 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:10.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:10 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:10.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:10 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:10.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:10 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:10.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:10 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:16:10.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:10 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/1078510499' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:10.921 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-10T23:16:10.922 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T23:16:10.979 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-10T23:16:10.979 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:16:11.075 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-10T23:16:11.075 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T23:16:11.132 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-10T23:16:11.133 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:16:11.228 INFO:tasks.cephadm:enabling module snap_schedule 2024-09-10T23:16:11.228 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2024-09-10T23:16:11.669 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:11 smithi003 ceph-mon[30348]: Updating smithi003:/etc/ceph/ceph.conf 2024-09-10T23:16:11.669 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:11 smithi003 ceph-mon[30348]: Updating smithi038:/etc/ceph/ceph.conf 2024-09-10T23:16:11.669 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:11 smithi003 ceph-mon[30348]: Updating smithi194:/etc/ceph/ceph.conf 2024-09-10T23:16:11.669 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:11 smithi003 ceph-mon[30348]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:11.669 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:11 smithi003 ceph-mon[30348]: Updating smithi194:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:16:11.669 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:11 smithi003 ceph-mon[30348]: Updating smithi038:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:16:11.669 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:11 smithi003 ceph-mon[30348]: Updating smithi003:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:16:11.669 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:11 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.669 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:11 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.669 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:11 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.669 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:11 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.669 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:11 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.670 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:11 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.670 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:11 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.670 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:11 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.670 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:11 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.670 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:11 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.670 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:11 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.670 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:11 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:16:11.670 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:11 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:16:11.670 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:11 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:11.670 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:11 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:11 smithi194 ceph-mon[33904]: Updating smithi003:/etc/ceph/ceph.conf 2024-09-10T23:16:11.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:11 smithi194 ceph-mon[33904]: Updating smithi038:/etc/ceph/ceph.conf 2024-09-10T23:16:11.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:11 smithi194 ceph-mon[33904]: Updating smithi194:/etc/ceph/ceph.conf 2024-09-10T23:16:11.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:11 smithi194 ceph-mon[33904]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:11.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:11 smithi194 ceph-mon[33904]: Updating smithi194:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:16:11.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:11 smithi194 ceph-mon[33904]: Updating smithi038:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:16:11.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:11 smithi194 ceph-mon[33904]: Updating smithi003:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:16:11.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:11 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:11 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:11 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:11 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:11 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:11 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:11 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:11 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:11 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:11 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:11 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:11 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:16:11.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:11 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:16:11.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:11 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:11.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:11 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:11 smithi038 ceph-mon[34225]: Updating smithi003:/etc/ceph/ceph.conf 2024-09-10T23:16:11.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:11 smithi038 ceph-mon[34225]: Updating smithi038:/etc/ceph/ceph.conf 2024-09-10T23:16:11.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:11 smithi038 ceph-mon[34225]: Updating smithi194:/etc/ceph/ceph.conf 2024-09-10T23:16:11.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:11 smithi038 ceph-mon[34225]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:11.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:11 smithi038 ceph-mon[34225]: Updating smithi194:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:16:11.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:11 smithi038 ceph-mon[34225]: Updating smithi038:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:16:11.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:11 smithi038 ceph-mon[34225]: Updating smithi003:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:16:11.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:11 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:11 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:11 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:11 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:11 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:11 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:11 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:11 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:11 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.849 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:11 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.849 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:11 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:11.849 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:11 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:16:11.849 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:11 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:16:11.849 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:11 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:11.849 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:11 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:12.567 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:12 smithi003 ceph-mon[30348]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T23:16:12.567 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:12 smithi003 ceph-mon[30348]: Reconfiguring daemon mon.a on smithi003 2024-09-10T23:16:12.653 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:12.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:12 smithi194 ceph-mon[33904]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T23:16:12.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:12 smithi194 ceph-mon[33904]: Reconfiguring daemon mon.a on smithi003 2024-09-10T23:16:12.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:12 smithi038 ceph-mon[34225]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T23:16:12.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:12 smithi038 ceph-mon[34225]: Reconfiguring daemon mon.a on smithi003 2024-09-10T23:16:13.466 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:13 smithi038 ceph-mon[34225]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:13.466 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:13 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:13.467 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:13 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:13.467 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:13 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:16:13.467 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:13 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:16:13.467 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:13 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:13.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:13 smithi003 ceph-mon[30348]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:13.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:13 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:13.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:13 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:13.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:13 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:16:13.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:13 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:16:13.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:13 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:13.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:13 smithi194 ceph-mon[33904]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:13.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:13 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:13.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:13 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:13.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:13 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:16:13.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:13 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:16:13.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:13 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:14.524 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:14 smithi038 ceph-mon[34225]: Reconfiguring mon.b (monmap changed)... 2024-09-10T23:16:14.524 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:14 smithi038 ceph-mon[34225]: Reconfiguring daemon mon.b on smithi038 2024-09-10T23:16:14.524 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:14 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3062108501' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-10T23:16:14.524 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:14 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:14.524 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:14 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:14.525 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:14 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:16:14.525 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:14 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:16:14.525 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:14 smithi038 ceph-mon[34225]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:14.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:14 smithi194 ceph-mon[33904]: Reconfiguring mon.b (monmap changed)... 2024-09-10T23:16:14.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:14 smithi194 ceph-mon[33904]: Reconfiguring daemon mon.b on smithi038 2024-09-10T23:16:14.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:14 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3062108501' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-10T23:16:14.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:14 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:14.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:14 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:14.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:14 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:16:14.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:14 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:16:14.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:14 smithi194 ceph-mon[33904]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:14.721 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:16:14 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: ignoring --setuser ceph since I am not root 2024-09-10T23:16:14.721 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:16:14 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: ignoring --setgroup ceph since I am not root 2024-09-10T23:16:14.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:14 smithi003 ceph-mon[30348]: Reconfiguring mon.b (monmap changed)... 2024-09-10T23:16:14.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:14 smithi003 ceph-mon[30348]: Reconfiguring daemon mon.b on smithi038 2024-09-10T23:16:14.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:14 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3062108501' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-10T23:16:14.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:14 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:14.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:14 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' 2024-09-10T23:16:14.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:14 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:16:14.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:14 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:16:14.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:14 smithi003 ceph-mon[30348]: from='mgr.14150 172.21.15.3:0/3603615954' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:15.221 INFO:tasks.cephadm:Adding mgr.x on smithi003 2024-09-10T23:16:15.221 INFO:tasks.cephadm:Adding mgr.y on smithi038 2024-09-10T23:16:15.222 INFO:tasks.cephadm:Adding mgr.z on smithi194 2024-09-10T23:16:15.222 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi003=x;smithi038=y;smithi194=z' 2024-09-10T23:16:15.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:15 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3062108501' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-10T23:16:15.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:15 smithi003 ceph-mon[30348]: mgrmap e14: x(active, since 68s) 2024-09-10T23:16:15.573 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:16:15.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:15 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3062108501' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-10T23:16:15.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:15 smithi194 ceph-mon[33904]: mgrmap e14: x(active, since 68s) 2024-09-10T23:16:15.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:15 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3062108501' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-10T23:16:15.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:15 smithi038 ceph-mon[34225]: mgrmap e14: x(active, since 68s) 2024-09-10T23:16:20.953 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:20 smithi194 ceph-mon[33904]: Active manager daemon x restarted 2024-09-10T23:16:20.953 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:20 smithi194 ceph-mon[33904]: Activating manager daemon x 2024-09-10T23:16:20.954 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:20 smithi194 ceph-mon[33904]: osdmap e5: 0 total, 0 up, 0 in 2024-09-10T23:16:20.954 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:20 smithi194 ceph-mon[33904]: mgrmap e15: x(active, starting, since 0.00704975s) 2024-09-10T23:16:20.954 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:20 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:16:20.954 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:20 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:16:20.954 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:20 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:16:20.954 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:20 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T23:16:20.954 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:20 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T23:16:20.954 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:20 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T23:16:20.954 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:20 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T23:16:20.954 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:20 smithi194 ceph-mon[33904]: Manager daemon x is now available 2024-09-10T23:16:20.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:20 smithi003 ceph-mon[30348]: Active manager daemon x restarted 2024-09-10T23:16:20.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:20 smithi003 ceph-mon[30348]: Activating manager daemon x 2024-09-10T23:16:20.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:20 smithi003 ceph-mon[30348]: osdmap e5: 0 total, 0 up, 0 in 2024-09-10T23:16:20.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:20 smithi003 ceph-mon[30348]: mgrmap e15: x(active, starting, since 0.00704975s) 2024-09-10T23:16:20.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:20 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:16:20.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:20 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:16:20.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:20 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:16:20.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:20 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T23:16:20.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:20 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T23:16:20.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:20 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T23:16:20.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:20 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T23:16:20.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:20 smithi003 ceph-mon[30348]: Manager daemon x is now available 2024-09-10T23:16:21.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:20 smithi038 ceph-mon[34225]: Active manager daemon x restarted 2024-09-10T23:16:21.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:20 smithi038 ceph-mon[34225]: Activating manager daemon x 2024-09-10T23:16:21.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:20 smithi038 ceph-mon[34225]: osdmap e5: 0 total, 0 up, 0 in 2024-09-10T23:16:21.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:20 smithi038 ceph-mon[34225]: mgrmap e15: x(active, starting, since 0.00704975s) 2024-09-10T23:16:21.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:20 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:16:21.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:20 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:16:21.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:20 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:16:21.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:20 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T23:16:21.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:20 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T23:16:21.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:20 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T23:16:21.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:20 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T23:16:21.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:20 smithi038 ceph-mon[34225]: Manager daemon x is now available 2024-09-10T23:16:21.672 INFO:teuthology.orchestra.run.smithi194.stdout:Scheduled mgr update... 2024-09-10T23:16:21.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:21 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:16:21.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:21 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T23:16:21.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:21 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T23:16:21.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:21 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T23:16:21.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:21 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T23:16:21.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:21 smithi194 ceph-mon[33904]: mgrmap e16: x(active, since 1.01133s) 2024-09-10T23:16:21.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:21 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:21.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:21 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:16:21.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:21 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T23:16:21.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:21 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T23:16:21.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:21 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T23:16:21.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:21 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T23:16:21.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:21 smithi003 ceph-mon[30348]: mgrmap e16: x(active, since 1.01133s) 2024-09-10T23:16:21.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:21 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:22.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:21 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:16:22.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:21 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T23:16:22.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:21 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T23:16:22.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:21 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T23:16:22.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:21 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T23:16:22.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:21 smithi038 ceph-mon[34225]: mgrmap e16: x(active, since 1.01133s) 2024-09-10T23:16:22.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:21 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:22.334 DEBUG:teuthology.orchestra.run.smithi038:mgr.y> sudo journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mgr.y.service 2024-09-10T23:16:22.338 DEBUG:teuthology.orchestra.run.smithi194:mgr.z> sudo journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mgr.z.service 2024-09-10T23:16:22.343 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-10T23:16:22.344 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-09-10T23:16:22.348 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-10T23:16:22.348 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph config set client debug_client 20 2024-09-10T23:16:22.394 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-10T23:16:22.394 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph config set client debug_ms 1 2024-09-10T23:16:22.440 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-10T23:16:22.440 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-09-10T23:16:22.487 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-10T23:16:22.488 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-09-10T23:16:22.534 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-10T23:16:22.534 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph config set mds debug_mds 20 2024-09-10T23:16:22.587 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-10T23:16:22.587 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-09-10T23:16:22.635 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-10T23:16:22.635 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph config set mds debug_ms 2 2024-09-10T23:16:22.687 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-10T23:16:22.688 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-10T23:16:22.746 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-10T23:16:22.747 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_merge_size 5 2024-09-10T23:16:22.801 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-10T23:16:22.802 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_split_bits 3 2024-09-10T23:16:22.859 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-10T23:16:22.859 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_split_size 100 2024-09-10T23:16:22.931 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-10T23:16:22.931 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-09-10T23:16:22.948 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:22 smithi003 ceph-mon[30348]: Saving service mgr spec with placement smithi003=x;smithi038=y;smithi194=z;count:3 2024-09-10T23:16:22.948 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:22 smithi003 ceph-mon[30348]: [10/Sep/2024:23:16:22] ENGINE Bus STARTING 2024-09-10T23:16:22.949 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:22 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:22.949 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:22 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:22.967 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-10T23:16:22.967 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-09-10T23:16:22.968 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:16:22 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T23:16:22.699+0000 7f7086e00640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:23:16:22] ENGINE Error in HTTPServer.serve 2024-09-10T23:16:22.968 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:16:22 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: Traceback (most recent call last): 2024-09-10T23:16:22.968 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:16:22 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T23:16:22.969 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:16:22 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: self._connections.run(self.expiration_interval) 2024-09-10T23:16:22.969 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:16:22 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T23:16:22.969 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:16:22 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: self._run(expiration_interval) 2024-09-10T23:16:22.969 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:16:22 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T23:16:22.969 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:16:22 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T23:16:22.969 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:16:22 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T23:16:22.970 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:16:22 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T23:16:22.970 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:16:22 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T23:16:22.970 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:16:22 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: s = self.context.wrap_socket( 2024-09-10T23:16:22.970 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:16:22 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T23:16:22.970 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:16:22 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: return self.sslsocket_class._create( 2024-09-10T23:16:22.970 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:16:22 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T23:16:22.971 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:16:22 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: self.do_handshake() 2024-09-10T23:16:22.971 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:16:22 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T23:16:22.971 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:16:22 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: self._sslobj.do_handshake() 2024-09-10T23:16:22.971 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:16:22 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T23:16:22.971 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:16:22 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T23:16:23.003 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:22 smithi194 ceph-mon[33904]: Saving service mgr spec with placement smithi003=x;smithi038=y;smithi194=z;count:3 2024-09-10T23:16:23.003 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:22 smithi194 ceph-mon[33904]: [10/Sep/2024:23:16:22] ENGINE Bus STARTING 2024-09-10T23:16:23.003 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:22 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:23.003 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:22 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:23.019 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-10T23:16:23.020 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-09-10T23:16:23.075 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-10T23:16:23.075 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-09-10T23:16:23.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:22 smithi038 ceph-mon[34225]: Saving service mgr spec with placement smithi003=x;smithi038=y;smithi194=z;count:3 2024-09-10T23:16:23.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:22 smithi038 ceph-mon[34225]: [10/Sep/2024:23:16:22] ENGINE Bus STARTING 2024-09-10T23:16:23.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:22 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:23.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:22 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:23.131 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-10T23:16:23.131 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-09-10T23:16:23.191 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-10T23:16:23.192 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-09-10T23:16:23.253 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-10T23:16:23.253 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-09-10T23:16:23.312 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2024-09-10T23:16:23.313 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph config set mgr debug_cephsqlite 20 2024-09-10T23:16:23.372 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2024-09-10T23:16:23.372 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-09-10T23:16:23.427 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2024-09-10T23:16:23.428 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2024-09-10T23:16:23.495 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/log_level = debug 2024-09-10T23:16:23.495 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/snap_schedule/log_level debug 2024-09-10T23:16:23.527 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:23.544 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-10T23:16:23.544 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-09-10T23:16:23.545 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:23.548 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:23.610 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-10T23:16:23.610 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-09-10T23:16:23.673 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-10T23:16:23.673 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-09-10T23:16:23.676 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:23.700 DEBUG:tasks.cephadm:set 26 configs 2024-09-10T23:16:23.700 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3f4e30d0-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi003') 2024-09-10T23:16:23.894 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:23 smithi003 ceph-mon[30348]: [10/Sep/2024:23:16:22] ENGINE Serving on http://172.21.15.3:8765 2024-09-10T23:16:23.895 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:23 smithi003 ceph-mon[30348]: [10/Sep/2024:23:16:22] ENGINE Serving on https://172.21.15.3:7150 2024-09-10T23:16:23.895 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:23 smithi003 ceph-mon[30348]: [10/Sep/2024:23:16:22] ENGINE Bus STARTED 2024-09-10T23:16:23.895 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:23 smithi003 ceph-mon[30348]: [10/Sep/2024:23:16:22] ENGINE Error in HTTPServer.serve 2024-09-10T23:16:23.895 INFO:journalctl@ceph.mon.a.smithi003.stdout: Traceback (most recent call last): 2024-09-10T23:16:23.895 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T23:16:23.895 INFO:journalctl@ceph.mon.a.smithi003.stdout: self._connections.run(self.expiration_interval) 2024-09-10T23:16:23.895 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T23:16:23.895 INFO:journalctl@ceph.mon.a.smithi003.stdout: self._run(expiration_interval) 2024-09-10T23:16:23.895 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T23:16:23.895 INFO:journalctl@ceph.mon.a.smithi003.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T23:16:23.895 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T23:16:23.896 INFO:journalctl@ceph.mon.a.smithi003.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T23:16:23.896 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T23:16:23.896 INFO:journalctl@ceph.mon.a.smithi003.stdout: s = self.context.wrap_socket( 2024-09-10T23:16:23.896 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T23:16:23.896 INFO:journalctl@ceph.mon.a.smithi003.stdout: return self.sslsocket_class._create( 2024-09-10T23:16:23.896 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T23:16:23.896 INFO:journalctl@ceph.mon.a.smithi003.stdout: self.do_handshake() 2024-09-10T23:16:23.896 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T23:16:23.896 INFO:journalctl@ceph.mon.a.smithi003.stdout: self._sslobj.do_handshake() 2024-09-10T23:16:23.896 INFO:journalctl@ceph.mon.a.smithi003.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T23:16:23.896 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:23 smithi003 ceph-mon[30348]: mgrmap e17: x(active, since 2s) 2024-09-10T23:16:23.896 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:23 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:23.896 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:23 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:23.896 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:23 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:23.897 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:23 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:24.004 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:24.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:23 smithi038 ceph-mon[34225]: [10/Sep/2024:23:16:22] ENGINE Serving on http://172.21.15.3:8765 2024-09-10T23:16:24.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:23 smithi038 ceph-mon[34225]: [10/Sep/2024:23:16:22] ENGINE Serving on https://172.21.15.3:7150 2024-09-10T23:16:24.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:23 smithi038 ceph-mon[34225]: [10/Sep/2024:23:16:22] ENGINE Bus STARTED 2024-09-10T23:16:24.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:23 smithi038 ceph-mon[34225]: [10/Sep/2024:23:16:22] ENGINE Error in HTTPServer.serve 2024-09-10T23:16:24.097 INFO:journalctl@ceph.mon.b.smithi038.stdout: Traceback (most recent call last): 2024-09-10T23:16:24.097 INFO:journalctl@ceph.mon.b.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T23:16:24.098 INFO:journalctl@ceph.mon.b.smithi038.stdout: self._connections.run(self.expiration_interval) 2024-09-10T23:16:24.098 INFO:journalctl@ceph.mon.b.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T23:16:24.098 INFO:journalctl@ceph.mon.b.smithi038.stdout: self._run(expiration_interval) 2024-09-10T23:16:24.098 INFO:journalctl@ceph.mon.b.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T23:16:24.098 INFO:journalctl@ceph.mon.b.smithi038.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T23:16:24.098 INFO:journalctl@ceph.mon.b.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T23:16:24.098 INFO:journalctl@ceph.mon.b.smithi038.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T23:16:24.098 INFO:journalctl@ceph.mon.b.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T23:16:24.098 INFO:journalctl@ceph.mon.b.smithi038.stdout: s = self.context.wrap_socket( 2024-09-10T23:16:24.098 INFO:journalctl@ceph.mon.b.smithi038.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T23:16:24.098 INFO:journalctl@ceph.mon.b.smithi038.stdout: return self.sslsocket_class._create( 2024-09-10T23:16:24.098 INFO:journalctl@ceph.mon.b.smithi038.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T23:16:24.098 INFO:journalctl@ceph.mon.b.smithi038.stdout: self.do_handshake() 2024-09-10T23:16:24.098 INFO:journalctl@ceph.mon.b.smithi038.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T23:16:24.099 INFO:journalctl@ceph.mon.b.smithi038.stdout: self._sslobj.do_handshake() 2024-09-10T23:16:24.099 INFO:journalctl@ceph.mon.b.smithi038.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T23:16:24.099 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:23 smithi038 ceph-mon[34225]: mgrmap e17: x(active, since 2s) 2024-09-10T23:16:24.099 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:23 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:24.099 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:23 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:24.099 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:23 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:24.099 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:23 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:24.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:23 smithi194 ceph-mon[33904]: [10/Sep/2024:23:16:22] ENGINE Serving on http://172.21.15.3:8765 2024-09-10T23:16:24.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:23 smithi194 ceph-mon[33904]: [10/Sep/2024:23:16:22] ENGINE Serving on https://172.21.15.3:7150 2024-09-10T23:16:24.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:23 smithi194 ceph-mon[33904]: [10/Sep/2024:23:16:22] ENGINE Bus STARTED 2024-09-10T23:16:24.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:23 smithi194 ceph-mon[33904]: [10/Sep/2024:23:16:22] ENGINE Error in HTTPServer.serve 2024-09-10T23:16:24.198 INFO:journalctl@ceph.mon.c.smithi194.stdout: Traceback (most recent call last): 2024-09-10T23:16:24.198 INFO:journalctl@ceph.mon.c.smithi194.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T23:16:24.198 INFO:journalctl@ceph.mon.c.smithi194.stdout: self._connections.run(self.expiration_interval) 2024-09-10T23:16:24.198 INFO:journalctl@ceph.mon.c.smithi194.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T23:16:24.198 INFO:journalctl@ceph.mon.c.smithi194.stdout: self._run(expiration_interval) 2024-09-10T23:16:24.198 INFO:journalctl@ceph.mon.c.smithi194.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T23:16:24.198 INFO:journalctl@ceph.mon.c.smithi194.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T23:16:24.198 INFO:journalctl@ceph.mon.c.smithi194.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T23:16:24.198 INFO:journalctl@ceph.mon.c.smithi194.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T23:16:24.198 INFO:journalctl@ceph.mon.c.smithi194.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T23:16:24.198 INFO:journalctl@ceph.mon.c.smithi194.stdout: s = self.context.wrap_socket( 2024-09-10T23:16:24.198 INFO:journalctl@ceph.mon.c.smithi194.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T23:16:24.199 INFO:journalctl@ceph.mon.c.smithi194.stdout: return self.sslsocket_class._create( 2024-09-10T23:16:24.199 INFO:journalctl@ceph.mon.c.smithi194.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T23:16:24.199 INFO:journalctl@ceph.mon.c.smithi194.stdout: self.do_handshake() 2024-09-10T23:16:24.199 INFO:journalctl@ceph.mon.c.smithi194.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T23:16:24.199 INFO:journalctl@ceph.mon.c.smithi194.stdout: self._sslobj.do_handshake() 2024-09-10T23:16:24.199 INFO:journalctl@ceph.mon.c.smithi194.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T23:16:24.199 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:23 smithi194 ceph-mon[33904]: mgrmap e17: x(active, since 2s) 2024-09-10T23:16:24.199 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:23 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:24.199 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:23 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:24.199 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:23 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:24.199 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:23 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:24.891 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:24 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:24.892 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:24 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:24.892 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:24 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi038", "name": "osd_memory_target"} : dispatch 2024-09-10T23:16:24.892 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:24 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi038", "name": "osd_memory_target"} : dispatch 2024-09-10T23:16:24.892 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:24 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:24.892 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:24 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:24.892 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:24 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"} : dispatch 2024-09-10T23:16:24.892 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:24 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"} : dispatch 2024-09-10T23:16:25.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:24 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:25.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:24 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:25.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:24 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi038", "name": "osd_memory_target"} : dispatch 2024-09-10T23:16:25.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:24 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi038", "name": "osd_memory_target"} : dispatch 2024-09-10T23:16:25.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:24 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:25.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:24 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:25.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:24 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"} : dispatch 2024-09-10T23:16:25.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:24 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"} : dispatch 2024-09-10T23:16:25.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:24 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:25.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:24 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:25.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:24 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi038", "name": "osd_memory_target"} : dispatch 2024-09-10T23:16:25.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:24 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi038", "name": "osd_memory_target"} : dispatch 2024-09-10T23:16:25.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:24 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:25.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:24 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:25.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:24 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"} : dispatch 2024-09-10T23:16:25.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:24 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"} : dispatch 2024-09-10T23:16:25.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.367+0000 7f14a0a00640 1 -- 172.21.15.3:0/2790853635 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f148003f610 msgr2=0x7f1480041ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:25.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.367+0000 7f14a0a00640 1 --2- 172.21.15.3:0/2790853635 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f148003f610 0x7f1480041ad0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f148c000c00 tx=0x7f148c005d50 comp rx=0 tx=0).stop 2024-09-10T23:16:25.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.367+0000 7f14a0a00640 1 -- 172.21.15.3:0/2790853635 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f149c10a820 msgr2=0x7f149c19f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:25.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.367+0000 7f14a0a00640 1 --2- 172.21.15.3:0/2790853635 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f149c10a820 0x7f149c19f6c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f149400ccb0 tx=0x7f149400a620 comp rx=0 tx=0).stop 2024-09-10T23:16:25.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.368+0000 7f14a0a00640 1 -- 172.21.15.3:0/2790853635 shutdown_connections 2024-09-10T23:16:25.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.368+0000 7f14a0a00640 1 --2- 172.21.15.3:0/2790853635 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f148003f610 0x7f1480041ad0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.368+0000 7f14a0a00640 1 --2- 172.21.15.3:0/2790853635 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f149c10a820 0x7f149c19f6c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.368+0000 7f14a0a00640 1 --2- 172.21.15.3:0/2790853635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f149c076f20 0x7f149c19ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.368+0000 7f14a0a00640 1 --2- 172.21.15.3:0/2790853635 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f149c075ac0 0x7f149c19e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.368+0000 7f14a0a00640 1 -- 172.21.15.3:0/2790853635 >> 172.21.15.3:0/2790853635 conn(0x7f149c0fe180 msgr2=0x7f149c100570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:25.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.368+0000 7f14a0a00640 1 -- 172.21.15.3:0/2790853635 shutdown_connections 2024-09-10T23:16:25.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.368+0000 7f14a0a00640 1 -- 172.21.15.3:0/2790853635 wait complete. 2024-09-10T23:16:25.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.520+0000 7f4f1bc00640 1 -- 172.21.15.3:0/3810905009 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4f14102a30 msgr2=0x7f4f14102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:25.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.520+0000 7f4f1bc00640 1 --2- 172.21.15.3:0/3810905009 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4f14102a30 0x7f4f14102e30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4f08009930 tx=0x7f4f0802a440 comp rx=0 tx=0).stop 2024-09-10T23:16:25.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.520+0000 7f4f1bc00640 1 -- 172.21.15.3:0/3810905009 shutdown_connections 2024-09-10T23:16:25.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.520+0000 7f4f1bc00640 1 --2- 172.21.15.3:0/3810905009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f14104550 0x7f4f1410aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.520+0000 7f4f1bc00640 1 --2- 172.21.15.3:0/3810905009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f14103b90 0x7f4f14104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.520+0000 7f4f1bc00640 1 --2- 172.21.15.3:0/3810905009 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4f14102a30 0x7f4f14102e30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.520+0000 7f4f1bc00640 1 -- 172.21.15.3:0/3810905009 >> 172.21.15.3:0/3810905009 conn(0x7f4f140fe320 msgr2=0x7f4f14100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:25.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.520+0000 7f4f1bc00640 1 -- 172.21.15.3:0/3810905009 shutdown_connections 2024-09-10T23:16:25.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.521+0000 7f4f1bc00640 1 -- 172.21.15.3:0/3810905009 wait complete. 2024-09-10T23:16:25.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.522+0000 7f4f1bc00640 1 Processor -- start 2024-09-10T23:16:25.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.522+0000 7f4f1bc00640 1 -- start start 2024-09-10T23:16:25.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.522+0000 7f4f1bc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f14102a30 0x7f4f1419ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:25.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.522+0000 7f4f1bc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4f14103b90 0x7f4f1419b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:25.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.522+0000 7f4f1bc00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f14104550 0x7f4f1419bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:25.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.522+0000 7f4f1bc00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1410e260 con 0x7f4f14103b90 2024-09-10T23:16:25.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.522+0000 7f4f1bc00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1410e0e0 con 0x7f4f14104550 2024-09-10T23:16:25.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.522+0000 7f4f1bc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1410e3e0 con 0x7f4f14102a30 2024-09-10T23:16:25.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.523+0000 7f4f13e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4f14103b90 0x7f4f1419b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:25.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.523+0000 7f4f13e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4f14103b90 0x7f4f1419b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38602/0 (socket says 172.21.15.3:38602) 2024-09-10T23:16:25.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.523+0000 7f4f13e00640 1 -- 172.21.15.3:0/1892484038 learned_addr learned my addr 172.21.15.3:0/1892484038 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:16:25.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.523+0000 7f4f19200640 1 --2- 172.21.15.3:0/1892484038 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f14102a30 0x7f4f1419ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:25.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.523+0000 7f4f19c00640 1 --2- 172.21.15.3:0/1892484038 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f14104550 0x7f4f1419bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:25.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.523+0000 7f4f13e00640 1 -- 172.21.15.3:0/1892484038 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f14102a30 msgr2=0x7f4f1419ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:25.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.523+0000 7f4f13e00640 1 --2- 172.21.15.3:0/1892484038 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f14102a30 0x7f4f1419ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.523+0000 7f4f13e00640 1 -- 172.21.15.3:0/1892484038 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f14104550 msgr2=0x7f4f1419bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:25.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.523+0000 7f4f13e00640 1 --2- 172.21.15.3:0/1892484038 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f14104550 0x7f4f1419bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.523+0000 7f4f13e00640 1 -- 172.21.15.3:0/1892484038 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f1419c810 con 0x7f4f14103b90 2024-09-10T23:16:25.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.523+0000 7f4f19c00640 1 --2- 172.21.15.3:0/1892484038 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f14104550 0x7f4f1419bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:25.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.524+0000 7f4f13e00640 1 --2- 172.21.15.3:0/1892484038 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4f14103b90 0x7f4f1419b330 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4f0000d950 tx=0x7f4f0000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:25.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.524+0000 7f4f11600640 1 -- 172.21.15.3:0/1892484038 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f00017030 con 0x7f4f14103b90 2024-09-10T23:16:25.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.524+0000 7f4f11600640 1 -- 172.21.15.3:0/1892484038 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(22 keys) ==== 976+0+0 (secure 0 0 0) 0x7f4f00004020 con 0x7f4f14103b90 2024-09-10T23:16:25.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.524+0000 7f4f11600640 1 -- 172.21.15.3:0/1892484038 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f000053c0 con 0x7f4f14103b90 2024-09-10T23:16:25.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.524+0000 7f4f1bc00640 1 -- 172.21.15.3:0/1892484038 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f1419cb00 con 0x7f4f14103b90 2024-09-10T23:16:25.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.524+0000 7f4f1bc00640 1 -- 172.21.15.3:0/1892484038 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f141a31e0 con 0x7f4f14103b90 2024-09-10T23:16:25.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.525+0000 7f4f11600640 1 -- 172.21.15.3:0/1892484038 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 51496+0+0 (secure 0 0 0) 0x7f4f00009a30 con 0x7f4f14103b90 2024-09-10T23:16:25.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.525+0000 7f4f1bc00640 1 -- 172.21.15.3:0/1892484038 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f141a3410 con 0x7f4f14103b90 2024-09-10T23:16:25.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.526+0000 7f4f11600640 1 --2- 172.21.15.3:0/1892484038 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f4efc03f560 0x7f4efc041a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:25.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.526+0000 7f4f11600640 1 -- 172.21.15.3:0/1892484038 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f4f000538c0 con 0x7f4f14103b90 2024-09-10T23:16:25.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.526+0000 7f4f19200640 1 --2- 172.21.15.3:0/1892484038 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f4efc03f560 0x7f4efc041a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:25.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.527+0000 7f4f19200640 1 --2- 172.21.15.3:0/1892484038 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f4efc03f560 0x7f4efc041a20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4f08000c00 tx=0x7f4f08005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:25.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.530+0000 7f4f11600640 1 -- 172.21.15.3:0/1892484038 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4f0000f3c0 con 0x7f4f14103b90 2024-09-10T23:16:25.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.744+0000 7f4f1bc00640 1 -- 172.21.15.3:0/1892484038 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f4f141a3680 con 0x7f4f14103b90 2024-09-10T23:16:25.749 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.748+0000 7f4f11600640 1 -- 172.21.15.3:0/1892484038 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v12)=0 v12) ==== 114+0+0 (secure 0 0 0) 0x7f4f000046c0 con 0x7f4f14103b90 2024-09-10T23:16:25.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.749+0000 7f4f11600640 1 -- 172.21.15.3:0/1892484038 <== mon.0 v2:172.21.15.3:3300/0 8 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7f4f000043b0 con 0x7f4f14103b90 2024-09-10T23:16:25.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.751+0000 7f4f1bc00640 1 -- 172.21.15.3:0/1892484038 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f4efc03f560 msgr2=0x7f4efc041a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:25.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.751+0000 7f4f1bc00640 1 --2- 172.21.15.3:0/1892484038 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f4efc03f560 0x7f4efc041a20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4f08000c00 tx=0x7f4f08005a20 comp rx=0 tx=0).stop 2024-09-10T23:16:25.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.751+0000 7f4f1bc00640 1 -- 172.21.15.3:0/1892484038 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4f14103b90 msgr2=0x7f4f1419b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:25.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.751+0000 7f4f1bc00640 1 --2- 172.21.15.3:0/1892484038 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4f14103b90 0x7f4f1419b330 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4f0000d950 tx=0x7f4f0000de10 comp rx=0 tx=0).stop 2024-09-10T23:16:25.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.751+0000 7f4f1bc00640 1 -- 172.21.15.3:0/1892484038 shutdown_connections 2024-09-10T23:16:25.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.751+0000 7f4f1bc00640 1 --2- 172.21.15.3:0/1892484038 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f14104550 0x7f4f1419bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.751+0000 7f4f1bc00640 1 --2- 172.21.15.3:0/1892484038 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f4efc03f560 0x7f4efc041a20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.751+0000 7f4f1bc00640 1 --2- 172.21.15.3:0/1892484038 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4f14103b90 0x7f4f1419b330 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.751+0000 7f4f1bc00640 1 --2- 172.21.15.3:0/1892484038 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f14102a30 0x7f4f1419ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.751+0000 7f4f1bc00640 1 -- 172.21.15.3:0/1892484038 >> 172.21.15.3:0/1892484038 conn(0x7f4f140fe320 msgr2=0x7f4f140ffc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:25.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.751+0000 7f4f1bc00640 1 -- 172.21.15.3:0/1892484038 shutdown_connections 2024-09-10T23:16:25.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:25.751+0000 7f4f1bc00640 1 -- 172.21.15.3:0/1892484038 wait complete. 2024-09-10T23:16:26.449 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:26 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/290862726' entity='client.admin' 2024-09-10T23:16:26.450 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:26 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2790853635' entity='client.admin' 2024-09-10T23:16:26.450 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:26 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1892484038' entity='client.admin' 2024-09-10T23:16:26.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.564+0000 7f8718c00640 1 -- 172.21.15.3:0/3243550591 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8714102a30 msgr2=0x7f8714102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:26.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.564+0000 7f8718c00640 1 --2- 172.21.15.3:0/3243550591 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8714102a30 0x7f8714102e30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8704009930 tx=0x7f870402a440 comp rx=0 tx=0).stop 2024-09-10T23:16:26.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.564+0000 7f8718c00640 1 -- 172.21.15.3:0/3243550591 shutdown_connections 2024-09-10T23:16:26.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.564+0000 7f8718c00640 1 --2- 172.21.15.3:0/3243550591 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8714104550 0x7f871410aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:26.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.564+0000 7f8718c00640 1 --2- 172.21.15.3:0/3243550591 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8714103b90 0x7f8714104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:26.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.564+0000 7f8718c00640 1 --2- 172.21.15.3:0/3243550591 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8714102a30 0x7f8714102e30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:26.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.564+0000 7f8718c00640 1 -- 172.21.15.3:0/3243550591 >> 172.21.15.3:0/3243550591 conn(0x7f87140fe320 msgr2=0x7f8714100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:26.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.564+0000 7f8718c00640 1 -- 172.21.15.3:0/3243550591 shutdown_connections 2024-09-10T23:16:26.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.564+0000 7f8718c00640 1 -- 172.21.15.3:0/3243550591 wait complete. 2024-09-10T23:16:26.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.565+0000 7f8718c00640 1 Processor -- start 2024-09-10T23:16:26.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.565+0000 7f8718c00640 1 -- start start 2024-09-10T23:16:26.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.566+0000 7f8718c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8714102a30 0x7f871419ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:26.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.566+0000 7f8718c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8714103b90 0x7f871419b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:26.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.566+0000 7f8718c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8714104550 0x7f871419c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:26.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.566+0000 7f8718c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f871410e390 con 0x7f8714104550 2024-09-10T23:16:26.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.566+0000 7f8718c00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f871410e210 con 0x7f8714103b90 2024-09-10T23:16:26.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.566+0000 7f8718c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f871410e510 con 0x7f8714102a30 2024-09-10T23:16:26.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.566+0000 7f8712800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8714104550 0x7f871419c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:26.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.566+0000 7f8712800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8714104550 0x7f871419c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38632/0 (socket says 172.21.15.3:38632) 2024-09-10T23:16:26.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.566+0000 7f8712800640 1 -- 172.21.15.3:0/1696449661 learned_addr learned my addr 172.21.15.3:0/1696449661 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:16:26.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.566+0000 7f8711e00640 1 --2- 172.21.15.3:0/1696449661 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8714102a30 0x7f871419ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:26.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.566+0000 7f870be00640 1 --2- 172.21.15.3:0/1696449661 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8714103b90 0x7f871419b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:26.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.566+0000 7f8712800640 1 -- 172.21.15.3:0/1696449661 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8714102a30 msgr2=0x7f871419ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:26.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.566+0000 7f8712800640 1 --2- 172.21.15.3:0/1696449661 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8714102a30 0x7f871419ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:26.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.566+0000 7f8712800640 1 -- 172.21.15.3:0/1696449661 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8714103b90 msgr2=0x7f871419b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:26.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.566+0000 7f8712800640 1 --2- 172.21.15.3:0/1696449661 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8714103b90 0x7f871419b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:26.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.566+0000 7f8712800640 1 -- 172.21.15.3:0/1696449661 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f871419c910 con 0x7f8714104550 2024-09-10T23:16:26.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.567+0000 7f8712800640 1 --2- 172.21.15.3:0/1696449661 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8714104550 0x7f871419c070 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f870c00b970 tx=0x7f870c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:26.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.567+0000 7f870aa00640 1 -- 172.21.15.3:0/1696449661 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870c019070 con 0x7f8714104550 2024-09-10T23:16:26.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.567+0000 7f870aa00640 1 -- 172.21.15.3:0/1696449661 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7f870c014440 con 0x7f8714104550 2024-09-10T23:16:26.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.567+0000 7f8718c00640 1 -- 172.21.15.3:0/1696449661 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f871419cc00 con 0x7f8714104550 2024-09-10T23:16:26.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.567+0000 7f870aa00640 1 -- 172.21.15.3:0/1696449661 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870c0075d0 con 0x7f8714104550 2024-09-10T23:16:26.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.567+0000 7f8718c00640 1 -- 172.21.15.3:0/1696449661 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87141a32e0 con 0x7f8714104550 2024-09-10T23:16:26.592 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.568+0000 7f8718c00640 1 -- 172.21.15.3:0/1696449661 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87141a3510 con 0x7f8714104550 2024-09-10T23:16:26.592 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.568+0000 7f870aa00640 1 -- 172.21.15.3:0/1696449661 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 51496+0+0 (secure 0 0 0) 0x7f870c00cb40 con 0x7f8714104550 2024-09-10T23:16:26.592 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.569+0000 7f870aa00640 1 --2- 172.21.15.3:0/1696449661 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f86f803f560 0x7f86f8041a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:26.592 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.569+0000 7f870aa00640 1 -- 172.21.15.3:0/1696449661 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f870c053860 con 0x7f8714104550 2024-09-10T23:16:26.592 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.569+0000 7f8711e00640 1 --2- 172.21.15.3:0/1696449661 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f86f803f560 0x7f86f8041a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:26.592 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.570+0000 7f8711e00640 1 --2- 172.21.15.3:0/1696449661 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f86f803f560 0x7f86f8041a20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8704005ab0 tx=0x7f8704005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:26.592 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.573+0000 7f870aa00640 1 -- 172.21.15.3:0/1696449661 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f870c01cc60 con 0x7f8714104550 2024-09-10T23:16:26.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:26 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/290862726' entity='client.admin' 2024-09-10T23:16:26.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:26 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2790853635' entity='client.admin' 2024-09-10T23:16:26.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:26 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/1892484038' entity='client.admin' 2024-09-10T23:16:26.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:26 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/290862726' entity='client.admin' 2024-09-10T23:16:26.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:26 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2790853635' entity='client.admin' 2024-09-10T23:16:26.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:26 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/1892484038' entity='client.admin' 2024-09-10T23:16:26.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.774+0000 7f8718c00640 1 -- 172.21.15.3:0/1696449661 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f87141a3890 con 0x7f8714104550 2024-09-10T23:16:26.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.779+0000 7f870aa00640 1 -- 172.21.15.3:0/1696449661 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v13)=0 v13) ==== 123+0+0 (secure 0 0 0) 0x7f870c01e440 con 0x7f8714104550 2024-09-10T23:16:26.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.780+0000 7f870aa00640 1 -- 172.21.15.3:0/1696449661 <== mon.0 v2:172.21.15.3:3300/0 8 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f870c014e50 con 0x7f8714104550 2024-09-10T23:16:26.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.782+0000 7f8718c00640 1 -- 172.21.15.3:0/1696449661 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f86f803f560 msgr2=0x7f86f8041a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:26.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.782+0000 7f8718c00640 1 --2- 172.21.15.3:0/1696449661 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f86f803f560 0x7f86f8041a20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8704005ab0 tx=0x7f8704005a20 comp rx=0 tx=0).stop 2024-09-10T23:16:26.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.782+0000 7f8718c00640 1 -- 172.21.15.3:0/1696449661 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8714104550 msgr2=0x7f871419c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:26.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.782+0000 7f8718c00640 1 --2- 172.21.15.3:0/1696449661 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8714104550 0x7f871419c070 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f870c00b970 tx=0x7f870c00be30 comp rx=0 tx=0).stop 2024-09-10T23:16:26.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.782+0000 7f8718c00640 1 -- 172.21.15.3:0/1696449661 shutdown_connections 2024-09-10T23:16:26.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.782+0000 7f8718c00640 1 --2- 172.21.15.3:0/1696449661 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f86f803f560 0x7f86f8041a20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:26.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.782+0000 7f8718c00640 1 --2- 172.21.15.3:0/1696449661 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8714104550 0x7f871419c070 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:26.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.782+0000 7f8718c00640 1 --2- 172.21.15.3:0/1696449661 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8714103b90 0x7f871419b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:26.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.782+0000 7f8718c00640 1 --2- 172.21.15.3:0/1696449661 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8714102a30 0x7f871419ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:26.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.782+0000 7f8718c00640 1 -- 172.21.15.3:0/1696449661 >> 172.21.15.3:0/1696449661 conn(0x7f87140fe320 msgr2=0x7f87140ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:26.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.783+0000 7f8718c00640 1 -- 172.21.15.3:0/1696449661 shutdown_connections 2024-09-10T23:16:26.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:26.783+0000 7f8718c00640 1 -- 172.21.15.3:0/1696449661 wait complete. 2024-09-10T23:16:27.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:27 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1696449661' entity='client.admin' 2024-09-10T23:16:28.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:27 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/1696449661' entity='client.admin' 2024-09-10T23:16:28.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:27 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/1696449661' entity='client.admin' 2024-09-10T23:16:28.381 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:28.381 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:28.428 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3f4e30d0-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi003') 2024-09-10T23:16:28.717 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:29.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:28 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:29.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:28 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:29.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:28 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi003", "name": "osd_memory_target"} : dispatch 2024-09-10T23:16:29.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:28 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi003", "name": "osd_memory_target"} : dispatch 2024-09-10T23:16:29.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:28 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:29.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:28 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:16:29.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:28 smithi038 ceph-mon[34225]: Updating smithi003:/etc/ceph/ceph.conf 2024-09-10T23:16:29.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:28 smithi038 ceph-mon[34225]: Updating smithi038:/etc/ceph/ceph.conf 2024-09-10T23:16:29.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:28 smithi038 ceph-mon[34225]: Updating smithi194:/etc/ceph/ceph.conf 2024-09-10T23:16:29.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:28 smithi038 ceph-mon[34225]: Updating smithi194:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:16:29.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:28 smithi038 ceph-mon[34225]: Updating smithi003:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:16:29.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:28 smithi038 ceph-mon[34225]: Updating smithi038:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:16:29.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:28 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:29.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:28 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:29.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:28 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi003", "name": "osd_memory_target"} : dispatch 2024-09-10T23:16:29.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:28 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi003", "name": "osd_memory_target"} : dispatch 2024-09-10T23:16:29.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:28 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:29.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:28 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:16:29.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:28 smithi003 ceph-mon[30348]: Updating smithi003:/etc/ceph/ceph.conf 2024-09-10T23:16:29.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:28 smithi003 ceph-mon[30348]: Updating smithi038:/etc/ceph/ceph.conf 2024-09-10T23:16:29.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:28 smithi003 ceph-mon[30348]: Updating smithi194:/etc/ceph/ceph.conf 2024-09-10T23:16:29.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:28 smithi003 ceph-mon[30348]: Updating smithi194:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:16:29.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:28 smithi003 ceph-mon[30348]: Updating smithi003:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:16:29.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:28 smithi003 ceph-mon[30348]: Updating smithi038:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:16:29.337 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3f4e30d0-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi003') 2024-09-10T23:16:29.337 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3f4e30d0-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi003') 2024-09-10T23:16:29.337 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3f4e30d0-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi003') 2024-09-10T23:16:29.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:28 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:29.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:28 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:29.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:28 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi003", "name": "osd_memory_target"} : dispatch 2024-09-10T23:16:29.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:28 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi003", "name": "osd_memory_target"} : dispatch 2024-09-10T23:16:29.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:28 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:29.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:28 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:16:29.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:28 smithi194 ceph-mon[33904]: Updating smithi003:/etc/ceph/ceph.conf 2024-09-10T23:16:29.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:28 smithi194 ceph-mon[33904]: Updating smithi038:/etc/ceph/ceph.conf 2024-09-10T23:16:29.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:28 smithi194 ceph-mon[33904]: Updating smithi194:/etc/ceph/ceph.conf 2024-09-10T23:16:29.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:28 smithi194 ceph-mon[33904]: Updating smithi194:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:16:29.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:28 smithi194 ceph-mon[33904]: Updating smithi003:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:16:29.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:28 smithi194 ceph-mon[33904]: Updating smithi038:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:16:29.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.591+0000 7fc610600640 1 -- 172.21.15.3:0/2010082152 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc608075ac0 msgr2=0x7fc608075f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:29.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.591+0000 7fc610600640 1 --2- 172.21.15.3:0/2010082152 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc608075ac0 0x7fc608075f40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4009900 tx=0x7fc5f402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:16:29.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.592+0000 7fc610600640 1 -- 172.21.15.3:0/2010082152 shutdown_connections 2024-09-10T23:16:29.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.592+0000 7fc610600640 1 --2- 172.21.15.3:0/2010082152 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc60810a9c0 0x7fc60810ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:29.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.592+0000 7fc610600640 1 --2- 172.21.15.3:0/2010082152 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc608075ac0 0x7fc608075f40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:29.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.592+0000 7fc610600640 1 --2- 172.21.15.3:0/2010082152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc608076f20 0x7fc608075580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:29.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.592+0000 7fc610600640 1 -- 172.21.15.3:0/2010082152 >> 172.21.15.3:0/2010082152 conn(0x7fc6080fe320 msgr2=0x7fc608100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:29.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.592+0000 7fc610600640 1 -- 172.21.15.3:0/2010082152 shutdown_connections 2024-09-10T23:16:29.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.592+0000 7fc610600640 1 -- 172.21.15.3:0/2010082152 wait complete. 2024-09-10T23:16:29.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.593+0000 7fc610600640 1 Processor -- start 2024-09-10T23:16:29.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.594+0000 7fc610600640 1 -- start start 2024-09-10T23:16:29.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.594+0000 7fc610600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc608075ac0 0x7fc60819af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:29.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.594+0000 7fc610600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc608076f20 0x7fc60819b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:29.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.594+0000 7fc610600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc60810a9c0 0x7fc60819c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:29.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.594+0000 7fc610600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc6081106f0 con 0x7fc608075ac0 2024-09-10T23:16:29.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.594+0000 7fc610600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fc608110570 con 0x7fc608076f20 2024-09-10T23:16:29.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.594+0000 7fc610600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc608110870 con 0x7fc60810a9c0 2024-09-10T23:16:29.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.594+0000 7fc60e600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc60810a9c0 0x7fc60819c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:29.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.595+0000 7fc60e600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc60810a9c0 0x7fc60819c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.3:51308/0 (socket says 172.21.15.3:51308) 2024-09-10T23:16:29.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.595+0000 7fc60e600640 1 -- 172.21.15.3:0/3841391291 learned_addr learned my addr 172.21.15.3:0/3841391291 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:16:29.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.595+0000 7fc60dc00640 1 --2- 172.21.15.3:0/3841391291 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc608075ac0 0x7fc60819af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:29.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.595+0000 7fc60d200640 1 --2- 172.21.15.3:0/3841391291 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc608076f20 0x7fc60819b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:29.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.595+0000 7fc60e600640 1 -- 172.21.15.3:0/3841391291 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc608076f20 msgr2=0x7fc60819b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:29.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.595+0000 7fc60e600640 1 --2- 172.21.15.3:0/3841391291 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc608076f20 0x7fc60819b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:29.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.595+0000 7fc60e600640 1 -- 172.21.15.3:0/3841391291 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc608075ac0 msgr2=0x7fc60819af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:29.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.595+0000 7fc60e600640 1 --2- 172.21.15.3:0/3841391291 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc608075ac0 0x7fc60819af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:29.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.595+0000 7fc60e600640 1 -- 172.21.15.3:0/3841391291 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc60819ca60 con 0x7fc60810a9c0 2024-09-10T23:16:29.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.595+0000 7fc60d200640 1 --2- 172.21.15.3:0/3841391291 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc608076f20 0x7fc60819b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:16:29.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.596+0000 7fc60e600640 1 --2- 172.21.15.3:0/3841391291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc60810a9c0 0x7fc60819c1c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc60000dac0 tx=0x7fc60000df80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:29.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.597+0000 7fc606000640 1 -- 172.21.15.3:0/3841391291 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc600017070 con 0x7fc60810a9c0 2024-09-10T23:16:29.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.597+0000 7fc606000640 1 -- 172.21.15.3:0/3841391291 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fc60000be30 con 0x7fc60810a9c0 2024-09-10T23:16:29.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.597+0000 7fc606000640 1 -- 172.21.15.3:0/3841391291 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc600010460 con 0x7fc60810a9c0 2024-09-10T23:16:29.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.597+0000 7fc610600640 1 -- 172.21.15.3:0/3841391291 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc60819cd50 con 0x7fc60810a9c0 2024-09-10T23:16:29.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.597+0000 7fc610600640 1 -- 172.21.15.3:0/3841391291 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6081a3430 con 0x7fc60810a9c0 2024-09-10T23:16:29.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.602+0000 7fc610600640 1 -- 172.21.15.3:0/3841391291 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6081090c0 con 0x7fc60810a9c0 2024-09-10T23:16:29.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.603+0000 7fc606000640 1 -- 172.21.15.3:0/3841391291 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 17) ==== 51496+0+0 (secure 0 0 0) 0x7fc600003970 con 0x7fc60810a9c0 2024-09-10T23:16:29.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.604+0000 7fc606000640 1 --2- 172.21.15.3:0/3841391291 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc5f003f5b0 0x7fc5f0041a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:29.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.604+0000 7fc606000640 1 -- 172.21.15.3:0/3841391291 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fc600053c70 con 0x7fc60810a9c0 2024-09-10T23:16:29.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.606+0000 7fc60dc00640 1 --2- 172.21.15.3:0/3841391291 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc5f003f5b0 0x7fc5f0041a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:29.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.608+0000 7fc60dc00640 1 --2- 172.21.15.3:0/3841391291 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc5f003f5b0 0x7fc5f0041a70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc009890 tx=0x7fc5fc008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:29.618 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:29.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.613+0000 7fc606000640 1 -- 172.21.15.3:0/3841391291 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc60000e350 con 0x7fc60810a9c0 2024-09-10T23:16:29.622 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:29.627 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:29.631 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:29.638 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:29.643 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:29.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.896+0000 7fc610600640 1 -- 172.21.15.3:0/3841391291 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fc608063d50 con 0x7fc60810a9c0 2024-09-10T23:16:29.904 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.902+0000 7fc606000640 1 -- 172.21.15.3:0/3841391291 <== mon.1 v2:172.21.15.194:3300/0 7 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc600019310 con 0x7fc60810a9c0 2024-09-10T23:16:29.904 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.902+0000 7fc606000640 1 -- 172.21.15.3:0/3841391291 <== mon.1 v2:172.21.15.194:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v14)=0 v14) ==== 123+0+0 (secure 0 0 0) 0x7fc600010600 con 0x7fc60810a9c0 2024-09-10T23:16:29.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.905+0000 7fc610600640 1 -- 172.21.15.3:0/3841391291 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc5f003f5b0 msgr2=0x7fc5f0041a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:29.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.905+0000 7fc610600640 1 --2- 172.21.15.3:0/3841391291 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc5f003f5b0 0x7fc5f0041a70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc009890 tx=0x7fc5fc008040 comp rx=0 tx=0).stop 2024-09-10T23:16:29.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.905+0000 7fc610600640 1 -- 172.21.15.3:0/3841391291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc60810a9c0 msgr2=0x7fc60819c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:29.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.905+0000 7fc610600640 1 --2- 172.21.15.3:0/3841391291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc60810a9c0 0x7fc60819c1c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc60000dac0 tx=0x7fc60000df80 comp rx=0 tx=0).stop 2024-09-10T23:16:29.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.905+0000 7fc610600640 1 -- 172.21.15.3:0/3841391291 shutdown_connections 2024-09-10T23:16:29.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.905+0000 7fc610600640 1 --2- 172.21.15.3:0/3841391291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc60810a9c0 0x7fc60819c1c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:29.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.905+0000 7fc610600640 1 --2- 172.21.15.3:0/3841391291 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc608076f20 0x7fc60819b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:29.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.905+0000 7fc610600640 1 --2- 172.21.15.3:0/3841391291 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc5f003f5b0 0x7fc5f0041a70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:29.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.905+0000 7fc610600640 1 --2- 172.21.15.3:0/3841391291 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc608075ac0 0x7fc60819af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:29.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.905+0000 7fc610600640 1 -- 172.21.15.3:0/3841391291 >> 172.21.15.3:0/3841391291 conn(0x7fc6080fe320 msgr2=0x7fc608100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:29.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.906+0000 7fc610600640 1 -- 172.21.15.3:0/3841391291 shutdown_connections 2024-09-10T23:16:29.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:29.907+0000 7fc610600640 1 -- 172.21.15.3:0/3841391291 wait complete. 2024-09-10T23:16:30.213 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:29 smithi003 ceph-mon[30348]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:16:30.213 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:29 smithi003 ceph-mon[30348]: Updating smithi038:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:16:30.213 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:29 smithi003 ceph-mon[30348]: Updating smithi003:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:16:30.213 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:29 smithi003 ceph-mon[30348]: Updating smithi194:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:16:30.213 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:29 smithi003 ceph-mon[30348]: Updating smithi038:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:16:30.213 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:29 smithi003 ceph-mon[30348]: from='client.? ' entity='client.admin' 2024-09-10T23:16:30.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:29 smithi038 ceph-mon[34225]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:16:30.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:29 smithi038 ceph-mon[34225]: Updating smithi038:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:16:30.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:29 smithi038 ceph-mon[34225]: Updating smithi003:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:16:30.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:29 smithi038 ceph-mon[34225]: Updating smithi194:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:16:30.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:29 smithi038 ceph-mon[34225]: Updating smithi038:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:16:30.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:29 smithi038 ceph-mon[34225]: from='client.? ' entity='client.admin' 2024-09-10T23:16:30.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:29 smithi194 ceph-mon[33904]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:16:30.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:29 smithi194 ceph-mon[33904]: Updating smithi038:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:16:30.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:29 smithi194 ceph-mon[33904]: Updating smithi003:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:16:30.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:29 smithi194 ceph-mon[33904]: Updating smithi194:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:16:30.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:29 smithi194 ceph-mon[33904]: Updating smithi038:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:16:30.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:29 smithi194 ceph-mon[33904]: from='client.? ' entity='client.admin' 2024-09-10T23:16:30.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.691+0000 7f3f99800640 1 -- 172.21.15.3:0/3525470526 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3f94102c10 msgr2=0x7f3f94102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:30.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.691+0000 7f3f99800640 1 --2- 172.21.15.3:0/3525470526 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3f94102c10 0x7f3f94102ff0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3f84009900 tx=0x7f3f8402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:16:30.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.691+0000 7f3f99800640 1 -- 172.21.15.3:0/3525470526 shutdown_connections 2024-09-10T23:16:30.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.691+0000 7f3f99800640 1 --2- 172.21.15.3:0/3525470526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f94108fa0 0x7f3f9410f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:30.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.691+0000 7f3f99800640 1 --2- 172.21.15.3:0/3525470526 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f94108620 0x7f3f94108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:30.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.691+0000 7f3f99800640 1 --2- 172.21.15.3:0/3525470526 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3f94102c10 0x7f3f94102ff0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:30.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.691+0000 7f3f99800640 1 -- 172.21.15.3:0/3525470526 >> 172.21.15.3:0/3525470526 conn(0x7f3f940fe660 msgr2=0x7f3f94100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:30.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.691+0000 7f3f99800640 1 -- 172.21.15.3:0/3525470526 shutdown_connections 2024-09-10T23:16:30.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.691+0000 7f3f99800640 1 -- 172.21.15.3:0/3525470526 wait complete. 2024-09-10T23:16:30.694 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.692+0000 7f3f99800640 1 Processor -- start 2024-09-10T23:16:30.694 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.692+0000 7f3f99800640 1 -- start start 2024-09-10T23:16:30.694 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.693+0000 7f3f99800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3f94102c10 0x7f3f940754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:30.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.693+0000 7f3f99800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f94108620 0x7f3f940759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:30.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.693+0000 7f3f99800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f94108fa0 0x7f3f94075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:30.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.693+0000 7f3f99800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f3f94112b60 con 0x7f3f94102c10 2024-09-10T23:16:30.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.693+0000 7f3f99800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3f941129e0 con 0x7f3f94108fa0 2024-09-10T23:16:30.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.693+0000 7f3f99800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3f94112ce0 con 0x7f3f94108620 2024-09-10T23:16:30.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.693+0000 7f3f93e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3f94102c10 0x7f3f940754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:30.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.693+0000 7f3f93e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3f94102c10 0x7f3f940754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38662/0 (socket says 172.21.15.3:38662) 2024-09-10T23:16:30.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.693+0000 7f3f93e00640 1 -- 172.21.15.3:0/2906068145 learned_addr learned my addr 172.21.15.3:0/2906068145 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:16:30.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.693+0000 7f3f93400640 1 --2- 172.21.15.3:0/2906068145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f94108620 0x7f3f940759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:30.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.693+0000 7f3f98e00640 1 --2- 172.21.15.3:0/2906068145 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f94108fa0 0x7f3f94075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:30.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.694+0000 7f3f93e00640 1 -- 172.21.15.3:0/2906068145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f94108620 msgr2=0x7f3f940759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:30.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.694+0000 7f3f93e00640 1 --2- 172.21.15.3:0/2906068145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f94108620 0x7f3f940759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:30.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.694+0000 7f3f93e00640 1 -- 172.21.15.3:0/2906068145 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f94108fa0 msgr2=0x7f3f94075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:30.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.694+0000 7f3f93e00640 1 --2- 172.21.15.3:0/2906068145 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f94108fa0 0x7f3f94075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:30.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.694+0000 7f3f93e00640 1 -- 172.21.15.3:0/2906068145 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f941a7370 con 0x7f3f94102c10 2024-09-10T23:16:30.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.694+0000 7f3f93e00640 1 --2- 172.21.15.3:0/2906068145 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3f94102c10 0x7f3f940754a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3f8402a910 tx=0x7f3f84003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:30.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.694+0000 7f3f90c00640 1 -- 172.21.15.3:0/2906068145 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f8403f070 con 0x7f3f94102c10 2024-09-10T23:16:30.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.694+0000 7f3f90c00640 1 -- 172.21.15.3:0/2906068145 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f84003e40 con 0x7f3f94102c10 2024-09-10T23:16:30.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.694+0000 7f3f90c00640 1 -- 172.21.15.3:0/2906068145 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f84035030 con 0x7f3f94102c10 2024-09-10T23:16:30.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.694+0000 7f3f99800640 1 -- 172.21.15.3:0/2906068145 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f941a7600 con 0x7f3f94102c10 2024-09-10T23:16:30.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.695+0000 7f3f99800640 1 -- 172.21.15.3:0/2906068145 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f941a7ae0 con 0x7f3f94102c10 2024-09-10T23:16:30.698 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.696+0000 7f3f99800640 1 -- 172.21.15.3:0/2906068145 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f94102ff0 con 0x7f3f94102c10 2024-09-10T23:16:30.698 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.696+0000 7f3f90c00640 1 -- 172.21.15.3:0/2906068145 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 51496+0+0 (secure 0 0 0) 0x7f3f84031400 con 0x7f3f94102c10 2024-09-10T23:16:30.698 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.696+0000 7f3f90c00640 1 --2- 172.21.15.3:0/2906068145 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f3f7803f610 0x7f3f78041ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:30.698 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.696+0000 7f3f90c00640 1 -- 172.21.15.3:0/2906068145 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f3f84074a30 con 0x7f3f94102c10 2024-09-10T23:16:30.698 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.697+0000 7f3f93400640 1 --2- 172.21.15.3:0/2906068145 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f3f7803f610 0x7f3f78041ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:30.698 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.697+0000 7f3f93400640 1 --2- 172.21.15.3:0/2906068145 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f3f7803f610 0x7f3f78041ad0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3f94076f90 tx=0x7f3f8000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:30.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.701+0000 7f3f90c00640 1 -- 172.21.15.3:0/2906068145 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3f8403bd90 con 0x7f3f94102c10 2024-09-10T23:16:30.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.911+0000 7f3f99800640 1 -- 172.21.15.3:0/2906068145 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f3f941a7da0 con 0x7f3f94102c10 2024-09-10T23:16:30.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.915+0000 7f3f90c00640 1 -- 172.21.15.3:0/2906068145 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v15)=0 v15) ==== 127+0+0 (secure 0 0 0) 0x7f3f84039d60 con 0x7f3f94102c10 2024-09-10T23:16:30.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.917+0000 7f3f99800640 1 -- 172.21.15.3:0/2906068145 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f3f7803f610 msgr2=0x7f3f78041ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:30.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.917+0000 7f3f99800640 1 --2- 172.21.15.3:0/2906068145 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f3f7803f610 0x7f3f78041ad0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3f94076f90 tx=0x7f3f8000b390 comp rx=0 tx=0).stop 2024-09-10T23:16:30.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.917+0000 7f3f99800640 1 -- 172.21.15.3:0/2906068145 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3f94102c10 msgr2=0x7f3f940754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:30.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.917+0000 7f3f99800640 1 --2- 172.21.15.3:0/2906068145 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3f94102c10 0x7f3f940754a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3f8402a910 tx=0x7f3f84003c20 comp rx=0 tx=0).stop 2024-09-10T23:16:30.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.917+0000 7f3f99800640 1 -- 172.21.15.3:0/2906068145 shutdown_connections 2024-09-10T23:16:30.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.917+0000 7f3f99800640 1 --2- 172.21.15.3:0/2906068145 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f94108fa0 0x7f3f94075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:30.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.917+0000 7f3f99800640 1 --2- 172.21.15.3:0/2906068145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f94108620 0x7f3f940759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:30.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.917+0000 7f3f99800640 1 --2- 172.21.15.3:0/2906068145 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f3f7803f610 0x7f3f78041ad0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:30.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.917+0000 7f3f99800640 1 --2- 172.21.15.3:0/2906068145 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3f94102c10 0x7f3f940754a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:30.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.917+0000 7f3f99800640 1 -- 172.21.15.3:0/2906068145 >> 172.21.15.3:0/2906068145 conn(0x7f3f940fe660 msgr2=0x7f3f940ffea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:30.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.918+0000 7f3f99800640 1 -- 172.21.15.3:0/2906068145 shutdown_connections 2024-09-10T23:16:30.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:30.918+0000 7f3f99800640 1 -- 172.21.15.3:0/2906068145 wait complete. 2024-09-10T23:16:31.155 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:30 smithi003 ceph-mon[30348]: Updating smithi003:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:16:31.155 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:30 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:31.156 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:30 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:31.156 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:30 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:31.156 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:30 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:31.156 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:30 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:31.156 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:30 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:31.156 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:30 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:31.156 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:30 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:16:31.156 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:30 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:16:31.156 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:30 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T23:16:31.156 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:30 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:16:31.156 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:30 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:31.156 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:30 smithi003 ceph-mon[30348]: Deploying daemon mgr.z on smithi194 2024-09-10T23:16:31.156 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:30 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2906068145' entity='client.admin' 2024-09-10T23:16:31.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:30 smithi194 ceph-mon[33904]: Updating smithi003:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:16:31.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:30 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:31.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:30 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:31.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:30 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:31.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:30 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:31.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:30 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:31.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:30 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:31.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:30 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:31.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:30 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:16:31.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:30 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:16:31.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:30 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T23:16:31.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:30 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:16:31.199 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:30 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:31.199 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:30 smithi194 ceph-mon[33904]: Deploying daemon mgr.z on smithi194 2024-09-10T23:16:31.199 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:30 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2906068145' entity='client.admin' 2024-09-10T23:16:31.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:30 smithi038 ceph-mon[34225]: Updating smithi003:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:16:31.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:30 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:31.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:30 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:31.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:30 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:31.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:30 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:31.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:30 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:31.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:30 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:31.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:30 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:31.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:30 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:16:31.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:30 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:16:31.349 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:30 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T23:16:31.349 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:30 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:16:31.349 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:30 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:31.349 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:30 smithi038 ceph-mon[34225]: Deploying daemon mgr.z on smithi194 2024-09-10T23:16:31.349 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:30 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2906068145' entity='client.admin' 2024-09-10T23:16:31.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.647+0000 7fd1fb200640 1 -- 172.21.15.3:0/1981552677 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd1f4102c10 msgr2=0x7fd1f4102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:31.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.647+0000 7fd1fb200640 1 --2- 172.21.15.3:0/1981552677 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd1f4102c10 0x7fd1f4102ff0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8009900 tx=0x7fd1e802a410 comp rx=0 tx=0).stop 2024-09-10T23:16:31.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.647+0000 7fd1fb200640 1 -- 172.21.15.3:0/1981552677 shutdown_connections 2024-09-10T23:16:31.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.647+0000 7fd1fb200640 1 --2- 172.21.15.3:0/1981552677 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1f4108fa0 0x7fd1f410f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:31.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.647+0000 7fd1fb200640 1 --2- 172.21.15.3:0/1981552677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1f4108620 0x7fd1f4108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:31.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.647+0000 7fd1fb200640 1 --2- 172.21.15.3:0/1981552677 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd1f4102c10 0x7fd1f4102ff0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:31.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.647+0000 7fd1fb200640 1 -- 172.21.15.3:0/1981552677 >> 172.21.15.3:0/1981552677 conn(0x7fd1f40fe660 msgr2=0x7fd1f4100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:31.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.647+0000 7fd1fb200640 1 -- 172.21.15.3:0/1981552677 shutdown_connections 2024-09-10T23:16:31.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.647+0000 7fd1fb200640 1 -- 172.21.15.3:0/1981552677 wait complete. 2024-09-10T23:16:31.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.648+0000 7fd1fb200640 1 Processor -- start 2024-09-10T23:16:31.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.648+0000 7fd1fb200640 1 -- start start 2024-09-10T23:16:31.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.648+0000 7fd1fb200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1f4102c10 0x7fd1f419b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:31.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.648+0000 7fd1fb200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd1f4108620 0x7fd1f419b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:31.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.648+0000 7fd1fb200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1f4108fa0 0x7fd1f41a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:31.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.648+0000 7fd1fb200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f4112b60 con 0x7fd1f4108620 2024-09-10T23:16:31.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.648+0000 7fd1fb200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f41129e0 con 0x7fd1f4102c10 2024-09-10T23:16:31.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.648+0000 7fd1fb200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f4112ce0 con 0x7fd1f4108fa0 2024-09-10T23:16:31.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.649+0000 7fd1f9400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd1f4108620 0x7fd1f419b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:31.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.649+0000 7fd1f9400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd1f4108620 0x7fd1f419b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36170/0 (socket says 172.21.15.3:36170) 2024-09-10T23:16:31.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.649+0000 7fd1f9400640 1 -- 172.21.15.3:0/4114546227 learned_addr learned my addr 172.21.15.3:0/4114546227 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:16:31.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.649+0000 7fd1fa800640 1 --2- 172.21.15.3:0/4114546227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1f4108fa0 0x7fd1f41a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:31.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.649+0000 7fd1f9e00640 1 --2- 172.21.15.3:0/4114546227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1f4102c10 0x7fd1f419b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:31.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.649+0000 7fd1f9400640 1 -- 172.21.15.3:0/4114546227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1f4108fa0 msgr2=0x7fd1f41a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:31.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.649+0000 7fd1f9400640 1 --2- 172.21.15.3:0/4114546227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1f4108fa0 0x7fd1f41a0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:31.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.649+0000 7fd1f9400640 1 -- 172.21.15.3:0/4114546227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1f4102c10 msgr2=0x7fd1f419b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:31.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.649+0000 7fd1f9400640 1 --2- 172.21.15.3:0/4114546227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1f4102c10 0x7fd1f419b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:31.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.649+0000 7fd1f9400640 1 -- 172.21.15.3:0/4114546227 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1f41a1240 con 0x7fd1f4108620 2024-09-10T23:16:31.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.650+0000 7fd1f9400640 1 --2- 172.21.15.3:0/4114546227 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd1f4108620 0x7fd1f419b6d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd1e400e9f0 tx=0x7fd1e400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:31.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.650+0000 7fd1eea00640 1 -- 172.21.15.3:0/4114546227 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e400cd80 con 0x7fd1f4108620 2024-09-10T23:16:31.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.650+0000 7fd1eea00640 1 -- 172.21.15.3:0/4114546227 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd1e40054b0 con 0x7fd1f4108620 2024-09-10T23:16:31.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.650+0000 7fd1fb200640 1 -- 172.21.15.3:0/4114546227 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1f41a1530 con 0x7fd1f4108620 2024-09-10T23:16:31.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.650+0000 7fd1eea00640 1 -- 172.21.15.3:0/4114546227 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e4010430 con 0x7fd1f4108620 2024-09-10T23:16:31.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.650+0000 7fd1fb200640 1 -- 172.21.15.3:0/4114546227 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1f41a7bf0 con 0x7fd1f4108620 2024-09-10T23:16:31.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.651+0000 7fd1fb200640 1 -- 172.21.15.3:0/4114546227 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1f4102ff0 con 0x7fd1f4108620 2024-09-10T23:16:31.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.652+0000 7fd1eea00640 1 -- 172.21.15.3:0/4114546227 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 51496+0+0 (secure 0 0 0) 0x7fd1e4005020 con 0x7fd1f4108620 2024-09-10T23:16:31.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.652+0000 7fd1eea00640 1 --2- 172.21.15.3:0/4114546227 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd1dc03f610 0x7fd1dc041ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:31.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.652+0000 7fd1eea00640 1 -- 172.21.15.3:0/4114546227 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fd1e4054340 con 0x7fd1f4108620 2024-09-10T23:16:31.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.652+0000 7fd1f9e00640 1 --2- 172.21.15.3:0/4114546227 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd1dc03f610 0x7fd1dc041ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:31.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.653+0000 7fd1f9e00640 1 --2- 172.21.15.3:0/4114546227 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd1dc03f610 0x7fd1dc041ad0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8006010 tx=0x7fd1e8005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:31.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.657+0000 7fd1eea00640 1 -- 172.21.15.3:0/4114546227 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd1e401b160 con 0x7fd1f4108620 2024-09-10T23:16:31.859 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.858+0000 7fd1fb200640 1 -- 172.21.15.3:0/4114546227 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fd1f419c2c0 con 0x7fd1f4108620 2024-09-10T23:16:31.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.861+0000 7fd1eea00640 1 -- 172.21.15.3:0/4114546227 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v16)=0 v16) ==== 120+0+0 (secure 0 0 0) 0x7fd1e400fa00 con 0x7fd1f4108620 2024-09-10T23:16:31.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.864+0000 7fd1fb200640 1 -- 172.21.15.3:0/4114546227 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd1dc03f610 msgr2=0x7fd1dc041ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:31.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.864+0000 7fd1fb200640 1 --2- 172.21.15.3:0/4114546227 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd1dc03f610 0x7fd1dc041ad0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8006010 tx=0x7fd1e8005e80 comp rx=0 tx=0).stop 2024-09-10T23:16:31.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.864+0000 7fd1fb200640 1 -- 172.21.15.3:0/4114546227 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd1f4108620 msgr2=0x7fd1f419b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:31.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.864+0000 7fd1fb200640 1 --2- 172.21.15.3:0/4114546227 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd1f4108620 0x7fd1f419b6d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd1e400e9f0 tx=0x7fd1e400edf0 comp rx=0 tx=0).stop 2024-09-10T23:16:31.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.865+0000 7fd1fb200640 1 -- 172.21.15.3:0/4114546227 shutdown_connections 2024-09-10T23:16:31.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.865+0000 7fd1fb200640 1 --2- 172.21.15.3:0/4114546227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1f4108fa0 0x7fd1f41a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:31.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.865+0000 7fd1fb200640 1 --2- 172.21.15.3:0/4114546227 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd1dc03f610 0x7fd1dc041ad0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:31.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.865+0000 7fd1fb200640 1 --2- 172.21.15.3:0/4114546227 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd1f4108620 0x7fd1f419b6d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:31.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.865+0000 7fd1fb200640 1 --2- 172.21.15.3:0/4114546227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1f4102c10 0x7fd1f419b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:31.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.865+0000 7fd1fb200640 1 -- 172.21.15.3:0/4114546227 >> 172.21.15.3:0/4114546227 conn(0x7fd1f40fe660 msgr2=0x7fd1f4075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:31.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.865+0000 7fd1fb200640 1 -- 172.21.15.3:0/4114546227 shutdown_connections 2024-09-10T23:16:31.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:31.865+0000 7fd1fb200640 1 -- 172.21.15.3:0/4114546227 wait complete. 2024-09-10T23:16:32.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.379+0000 7fc4eb200640 1 -- 172.21.15.3:0/113146994 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4ec10b1a0 msgr2=0x7fc4ec1119a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:32.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.379+0000 7fc4eb200640 1 --2- 172.21.15.3:0/113146994 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4ec10b1a0 0x7fc4ec1119a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4009900 tx=0x7fc4e402a410 comp rx=0 tx=0).stop 2024-09-10T23:16:32.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.379+0000 7fc4eb200640 1 -- 172.21.15.3:0/113146994 shutdown_connections 2024-09-10T23:16:32.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.379+0000 7fc4eb200640 1 --2- 172.21.15.3:0/113146994 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4ec10b1a0 0x7fc4ec1119a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:32.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.379+0000 7fc4eb200640 1 --2- 172.21.15.3:0/113146994 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4ec10a820 0x7fc4ec10ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:32.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.379+0000 7fc4eb200640 1 --2- 172.21.15.3:0/113146994 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4ec104e10 0x7fc4ec1051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:32.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.379+0000 7fc4eb200640 1 -- 172.21.15.3:0/113146994 >> 172.21.15.3:0/113146994 conn(0x7fc4ec100840 msgr2=0x7fc4ec102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:32.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.379+0000 7fc4eb200640 1 -- 172.21.15.3:0/113146994 shutdown_connections 2024-09-10T23:16:32.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.380+0000 7fc4eb200640 1 -- 172.21.15.3:0/113146994 wait complete. 2024-09-10T23:16:32.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.381+0000 7fc4eb200640 1 Processor -- start 2024-09-10T23:16:32.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.381+0000 7fc4eb200640 1 -- start start 2024-09-10T23:16:32.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.381+0000 7fc4eb200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4ec104e10 0x7fc4ec19b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:32.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.381+0000 7fc4eb200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4ec10a820 0x7fc4ec19b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:32.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.381+0000 7fc4eb200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4ec10b1a0 0x7fc4ec1a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:32.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.381+0000 7fc4eb200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec114d20 con 0x7fc4ec10b1a0 2024-09-10T23:16:32.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.381+0000 7fc4eb200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec114ba0 con 0x7fc4ec104e10 2024-09-10T23:16:32.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.381+0000 7fc4eb200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec114ea0 con 0x7fc4ec10a820 2024-09-10T23:16:32.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.381+0000 7fc4e1400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4ec10a820 0x7fc4ec19b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:32.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.381+0000 7fc4ea800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4ec10b1a0 0x7fc4ec1a0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:32.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.382+0000 7fc4e1400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4ec10a820 0x7fc4ec19b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.3:58394/0 (socket says 172.21.15.3:58394) 2024-09-10T23:16:32.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.382+0000 7fc4e1400640 1 -- 172.21.15.3:0/2316582701 learned_addr learned my addr 172.21.15.3:0/2316582701 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:16:32.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.382+0000 7fc4e9e00640 1 --2- 172.21.15.3:0/2316582701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4ec104e10 0x7fc4ec19b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:32.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.382+0000 7fc4e1400640 1 -- 172.21.15.3:0/2316582701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4ec104e10 msgr2=0x7fc4ec19b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:32.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.382+0000 7fc4e1400640 1 --2- 172.21.15.3:0/2316582701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4ec104e10 0x7fc4ec19b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:32.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.382+0000 7fc4e1400640 1 -- 172.21.15.3:0/2316582701 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4ec10b1a0 msgr2=0x7fc4ec1a0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:32.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.382+0000 7fc4e1400640 1 --2- 172.21.15.3:0/2316582701 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4ec10b1a0 0x7fc4ec1a0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:32.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.382+0000 7fc4e1400640 1 -- 172.21.15.3:0/2316582701 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4ec1a1260 con 0x7fc4ec10a820 2024-09-10T23:16:32.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.382+0000 7fc4e9e00640 1 --2- 172.21.15.3:0/2316582701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4ec104e10 0x7fc4ec19b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:16:32.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.382+0000 7fc4ea800640 1 --2- 172.21.15.3:0/2316582701 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4ec10b1a0 0x7fc4ec1a0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:16:32.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.382+0000 7fc4e1400640 1 --2- 172.21.15.3:0/2316582701 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4ec10a820 0x7fc4ec19b6f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc4d400d950 tx=0x7fc4d400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:32.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.383+0000 7fc4e3400640 1 -- 172.21.15.3:0/2316582701 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d4017070 con 0x7fc4ec10a820 2024-09-10T23:16:32.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.383+0000 7fc4e3400640 1 -- 172.21.15.3:0/2316582701 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc4d4009c30 con 0x7fc4ec10a820 2024-09-10T23:16:32.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.383+0000 7fc4eb200640 1 -- 172.21.15.3:0/2316582701 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4ec1a1550 con 0x7fc4ec10a820 2024-09-10T23:16:32.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.383+0000 7fc4e3400640 1 -- 172.21.15.3:0/2316582701 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d400f620 con 0x7fc4ec10a820 2024-09-10T23:16:32.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.383+0000 7fc4eb200640 1 -- 172.21.15.3:0/2316582701 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4ec1a7de0 con 0x7fc4ec10a820 2024-09-10T23:16:32.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.384+0000 7fc4eb200640 1 -- 172.21.15.3:0/2316582701 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4ec1060c0 con 0x7fc4ec10a820 2024-09-10T23:16:32.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.385+0000 7fc4e3400640 1 -- 172.21.15.3:0/2316582701 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 17) ==== 51496+0+0 (secure 0 0 0) 0x7fc4d400f7c0 con 0x7fc4ec10a820 2024-09-10T23:16:32.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.385+0000 7fc4e3400640 1 --2- 172.21.15.3:0/2316582701 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc4d003f610 0x7fc4d0041ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:32.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.385+0000 7fc4e3400640 1 -- 172.21.15.3:0/2316582701 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fc4d4053bb0 con 0x7fc4ec10a820 2024-09-10T23:16:32.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.385+0000 7fc4e9e00640 1 --2- 172.21.15.3:0/2316582701 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc4d003f610 0x7fc4d0041ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:32.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.386+0000 7fc4e9e00640 1 --2- 172.21.15.3:0/2316582701 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc4d003f610 0x7fc4d0041ad0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc005fd0 tx=0x7fc4dc009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:32.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.390+0000 7fc4e3400640 1 -- 172.21.15.3:0/2316582701 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc4d4019310 con 0x7fc4ec10a820 2024-09-10T23:16:32.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.590+0000 7fc4eb200640 1 -- 172.21.15.3:0/2316582701 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7fc4ec1a7fb0 con 0x7fc4ec10a820 2024-09-10T23:16:32.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.597+0000 7fc4e3400640 1 -- 172.21.15.3:0/2316582701 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v18)=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7fc4d401ae50 con 0x7fc4ec10a820 2024-09-10T23:16:32.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.599+0000 7fc4eb200640 1 -- 172.21.15.3:0/2316582701 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc4d003f610 msgr2=0x7fc4d0041ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:32.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.599+0000 7fc4eb200640 1 --2- 172.21.15.3:0/2316582701 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc4d003f610 0x7fc4d0041ad0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc005fd0 tx=0x7fc4dc009500 comp rx=0 tx=0).stop 2024-09-10T23:16:32.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.599+0000 7fc4eb200640 1 -- 172.21.15.3:0/2316582701 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4ec10a820 msgr2=0x7fc4ec19b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:32.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.599+0000 7fc4eb200640 1 --2- 172.21.15.3:0/2316582701 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4ec10a820 0x7fc4ec19b6f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc4d400d950 tx=0x7fc4d400de10 comp rx=0 tx=0).stop 2024-09-10T23:16:32.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.599+0000 7fc4eb200640 1 -- 172.21.15.3:0/2316582701 shutdown_connections 2024-09-10T23:16:32.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.599+0000 7fc4eb200640 1 --2- 172.21.15.3:0/2316582701 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc4d003f610 0x7fc4d0041ad0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:32.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.599+0000 7fc4eb200640 1 --2- 172.21.15.3:0/2316582701 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4ec10b1a0 0x7fc4ec1a0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:32.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.599+0000 7fc4eb200640 1 --2- 172.21.15.3:0/2316582701 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4ec10a820 0x7fc4ec19b6f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:32.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.599+0000 7fc4eb200640 1 --2- 172.21.15.3:0/2316582701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4ec104e10 0x7fc4ec19b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:32.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.599+0000 7fc4eb200640 1 -- 172.21.15.3:0/2316582701 >> 172.21.15.3:0/2316582701 conn(0x7fc4ec100840 msgr2=0x7fc4ec101040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:32.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.599+0000 7fc4eb200640 1 -- 172.21.15.3:0/2316582701 shutdown_connections 2024-09-10T23:16:32.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.599+0000 7fc4eb200640 1 -- 172.21.15.3:0/2316582701 wait complete. 2024-09-10T23:16:32.687 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 10 23:16:32 smithi194 systemd[1]: Starting Ceph mgr.z for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:16:32.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.041+0000 7fed7e000640 1 -- 172.21.15.3:0/1491181580 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed780754e0 msgr2=0x7fed780758c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:32.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.041+0000 7fed7e000640 1 --2- 172.21.15.3:0/1491181580 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed780754e0 0x7fed780758c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fed68009900 tx=0x7fed6802a3f0 comp rx=0 tx=0).stop 2024-09-10T23:16:32.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.041+0000 7fed7e000640 1 -- 172.21.15.3:0/1491181580 shutdown_connections 2024-09-10T23:16:32.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.041+0000 7fed7e000640 1 --2- 172.21.15.3:0/1491181580 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed7810f390 0x7fed78111780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:32.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.041+0000 7fed7e000640 1 --2- 172.21.15.3:0/1491181580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed78075e00 0x7fed7810ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:32.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.041+0000 7fed7e000640 1 --2- 172.21.15.3:0/1491181580 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed780754e0 0x7fed780758c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:32.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.041+0000 7fed7e000640 1 -- 172.21.15.3:0/1491181580 >> 172.21.15.3:0/1491181580 conn(0x7fed780fe810 msgr2=0x7fed78100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:32.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.041+0000 7fed7e000640 1 -- 172.21.15.3:0/1491181580 shutdown_connections 2024-09-10T23:16:32.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.041+0000 7fed7e000640 1 -- 172.21.15.3:0/1491181580 wait complete. 2024-09-10T23:16:32.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.042+0000 7fed7e000640 1 Processor -- start 2024-09-10T23:16:32.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.042+0000 7fed7e000640 1 -- start start 2024-09-10T23:16:32.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.043+0000 7fed7e000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed780754e0 0x7fed7819b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:32.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.043+0000 7fed7e000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed78075e00 0x7fed7819b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:32.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.043+0000 7fed7e000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed7810f390 0x7fed781a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:32.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.043+0000 7fed7e000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fed78114df0 con 0x7fed7810f390 2024-09-10T23:16:32.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.043+0000 7fed7e000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fed78114c70 con 0x7fed78075e00 2024-09-10T23:16:32.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.043+0000 7fed7e000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fed78114f70 con 0x7fed780754e0 2024-09-10T23:16:32.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.043+0000 7fed77e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed7810f390 0x7fed781a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:32.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.043+0000 7fed77400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed780754e0 0x7fed7819b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:32.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.043+0000 7fed77e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed7810f390 0x7fed781a0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36198/0 (socket says 172.21.15.3:36198) 2024-09-10T23:16:32.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.043+0000 7fed77e00640 1 -- 172.21.15.3:0/4070641532 learned_addr learned my addr 172.21.15.3:0/4070641532 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:16:32.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.043+0000 7fed76a00640 1 --2- 172.21.15.3:0/4070641532 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed78075e00 0x7fed7819b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:32.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.043+0000 7fed77e00640 1 -- 172.21.15.3:0/4070641532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed780754e0 msgr2=0x7fed7819b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:32.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.044+0000 7fed77e00640 1 --2- 172.21.15.3:0/4070641532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed780754e0 0x7fed7819b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:32.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.044+0000 7fed77e00640 1 -- 172.21.15.3:0/4070641532 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed78075e00 msgr2=0x7fed7819b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:32.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.044+0000 7fed77e00640 1 --2- 172.21.15.3:0/4070641532 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed78075e00 0x7fed7819b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:32.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.044+0000 7fed77e00640 1 -- 172.21.15.3:0/4070641532 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed781a1330 con 0x7fed7810f390 2024-09-10T23:16:32.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.044+0000 7fed77e00640 1 --2- 172.21.15.3:0/4070641532 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed7810f390 0x7fed781a0b60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fed7000ccb0 tx=0x7fed7000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:32.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.044+0000 7fed6fe00640 1 -- 172.21.15.3:0/4070641532 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed70003970 con 0x7fed7810f390 2024-09-10T23:16:32.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.044+0000 7fed6fe00640 1 -- 172.21.15.3:0/4070641532 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fed70004030 con 0x7fed7810f390 2024-09-10T23:16:32.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.044+0000 7fed6fe00640 1 -- 172.21.15.3:0/4070641532 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7000f6b0 con 0x7fed7810f390 2024-09-10T23:16:32.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.044+0000 7fed7e000640 1 -- 172.21.15.3:0/4070641532 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed781a1620 con 0x7fed7810f390 2024-09-10T23:16:32.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.044+0000 7fed7e000640 1 -- 172.21.15.3:0/4070641532 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed781a7ce0 con 0x7fed7810f390 2024-09-10T23:16:32.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.046+0000 7fed7e000640 1 -- 172.21.15.3:0/4070641532 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed780758c0 con 0x7fed7810f390 2024-09-10T23:16:32.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.046+0000 7fed6fe00640 1 -- 172.21.15.3:0/4070641532 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 51496+0+0 (secure 0 0 0) 0x7fed70003b10 con 0x7fed7810f390 2024-09-10T23:16:32.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.046+0000 7fed6fe00640 1 --2- 172.21.15.3:0/4070641532 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fed5c03f560 0x7fed5c041a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:32.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.046+0000 7fed6fe00640 1 -- 172.21.15.3:0/4070641532 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fed70053e90 con 0x7fed7810f390 2024-09-10T23:16:32.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.047+0000 7fed77400640 1 --2- 172.21.15.3:0/4070641532 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fed5c03f560 0x7fed5c041a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:32.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.047+0000 7fed77400640 1 --2- 172.21.15.3:0/4070641532 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fed5c03f560 0x7fed5c041a20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fed680057c0 tx=0x7fed680058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:32.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.051+0000 7fed6fe00640 1 -- 172.21.15.3:0/4070641532 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fed70014070 con 0x7fed7810f390 2024-09-10T23:16:32.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.250+0000 7fed7e000640 1 -- 172.21.15.3:0/4070641532 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7fed781a8070 con 0x7fed7810f390 2024-09-10T23:16:32.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.254+0000 7fed6fe00640 1 -- 172.21.15.3:0/4070641532 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v17)=0 v17) ==== 115+0+0 (secure 0 0 0) 0x7fed7001f300 con 0x7fed7810f390 2024-09-10T23:16:32.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.256+0000 7fed7e000640 1 -- 172.21.15.3:0/4070641532 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fed5c03f560 msgr2=0x7fed5c041a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:32.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.256+0000 7fed7e000640 1 --2- 172.21.15.3:0/4070641532 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fed5c03f560 0x7fed5c041a20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fed680057c0 tx=0x7fed680058d0 comp rx=0 tx=0).stop 2024-09-10T23:16:32.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.256+0000 7fed7e000640 1 -- 172.21.15.3:0/4070641532 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed7810f390 msgr2=0x7fed781a0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:32.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.256+0000 7fed7e000640 1 --2- 172.21.15.3:0/4070641532 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed7810f390 0x7fed781a0b60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fed7000ccb0 tx=0x7fed7000a620 comp rx=0 tx=0).stop 2024-09-10T23:16:32.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.256+0000 7fed7e000640 1 -- 172.21.15.3:0/4070641532 shutdown_connections 2024-09-10T23:16:32.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.256+0000 7fed7e000640 1 --2- 172.21.15.3:0/4070641532 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fed5c03f560 0x7fed5c041a20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:32.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.256+0000 7fed7e000640 1 --2- 172.21.15.3:0/4070641532 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed7810f390 0x7fed781a0b60 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:32.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.256+0000 7fed7e000640 1 --2- 172.21.15.3:0/4070641532 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed78075e00 0x7fed7819b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:32.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.256+0000 7fed7e000640 1 --2- 172.21.15.3:0/4070641532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed780754e0 0x7fed7819b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:32.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.256+0000 7fed7e000640 1 -- 172.21.15.3:0/4070641532 >> 172.21.15.3:0/4070641532 conn(0x7fed780fe810 msgr2=0x7fed781114e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:32.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.256+0000 7fed7e000640 1 -- 172.21.15.3:0/4070641532 shutdown_connections 2024-09-10T23:16:32.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:32.256+0000 7fed7e000640 1 -- 172.21.15.3:0/4070641532 wait complete. 2024-09-10T23:16:32.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:32 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/4114546227' entity='client.admin' 2024-09-10T23:16:32.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:32 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/4070641532' entity='client.admin' 2024-09-10T23:16:32.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:32 smithi194 ceph-mon[33904]: from='client.? ' entity='client.admin' 2024-09-10T23:16:32.948 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 10 23:16:32 smithi194 podman[36602]: 2024-09-10 23:16:32.590550593 +0000 UTC m=+0.026873951 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:16:32.948 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 10 23:16:32 smithi194 podman[36602]: 2024-09-10 23:16:32.690433913 +0000 UTC m=+0.126757256 container create dc5e48ebe4622c75cf2fdce70479fc237623c558325252102492ab8c3c75bb1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-10T23:16:32.948 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 10 23:16:32 smithi194 podman[36602]: 2024-09-10 23:16:32.876096495 +0000 UTC m=+0.312419849 container init dc5e48ebe4622c75cf2fdce70479fc237623c558325252102492ab8c3c75bb1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-z, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-10T23:16:32.948 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 10 23:16:32 smithi194 podman[36602]: 2024-09-10 23:16:32.882124396 +0000 UTC m=+0.318447739 container start dc5e48ebe4622c75cf2fdce70479fc237623c558325252102492ab8c3c75bb1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:16:32.948 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 10 23:16:32 smithi194 ceph-mgr[36621]: -- 172.21.15.194:0/1673070485 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fd42b390e0 con 0x55fd42b17000 2024-09-10T23:16:32.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:32 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/4114546227' entity='client.admin' 2024-09-10T23:16:32.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:32 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/4070641532' entity='client.admin' 2024-09-10T23:16:32.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:32 smithi003 ceph-mon[30348]: from='client.? ' entity='client.admin' 2024-09-10T23:16:33.340 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 10 23:16:32 smithi194 bash[36602]: dc5e48ebe4622c75cf2fdce70479fc237623c558325252102492ab8c3c75bb1c 2024-09-10T23:16:33.340 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 10 23:16:32 smithi194 systemd[1]: Started Ceph mgr.z for 3f4e30d0-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:16:33.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:32 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/4114546227' entity='client.admin' 2024-09-10T23:16:33.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:32 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/4070641532' entity='client.admin' 2024-09-10T23:16:33.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:32 smithi038 ceph-mon[34225]: from='client.? ' entity='client.admin' 2024-09-10T23:16:33.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.259+0000 7f09b4a00640 1 -- 172.21.15.3:0/3681264752 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09b010f2b0 msgr2=0x7f09b01116a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:33.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.259+0000 7f09b4a00640 1 --2- 172.21.15.3:0/3681264752 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09b010f2b0 0x7f09b01116a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f09a8009ca0 tx=0x7f09a802a950 comp rx=0 tx=0).stop 2024-09-10T23:16:33.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.259+0000 7f09b4a00640 1 -- 172.21.15.3:0/3681264752 shutdown_connections 2024-09-10T23:16:33.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.259+0000 7f09b4a00640 1 --2- 172.21.15.3:0/3681264752 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09b010f2b0 0x7f09b01116a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:33.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.259+0000 7f09b4a00640 1 --2- 172.21.15.3:0/3681264752 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09b0102020 0x7f09b010ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:33.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.259+0000 7f09b4a00640 1 --2- 172.21.15.3:0/3681264752 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09b0101700 0x7f09b0101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:33.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.259+0000 7f09b4a00640 1 -- 172.21.15.3:0/3681264752 >> 172.21.15.3:0/3681264752 conn(0x7f09b00fd5b0 msgr2=0x7f09b00ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:33.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.259+0000 7f09b4a00640 1 -- 172.21.15.3:0/3681264752 shutdown_connections 2024-09-10T23:16:33.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.259+0000 7f09b4a00640 1 -- 172.21.15.3:0/3681264752 wait complete. 2024-09-10T23:16:33.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.260+0000 7f09b4a00640 1 Processor -- start 2024-09-10T23:16:33.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.260+0000 7f09b4a00640 1 -- start start 2024-09-10T23:16:33.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.261+0000 7f09b4a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09b0101700 0x7f09b019b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:33.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.261+0000 7f09b4a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09b0102020 0x7f09b019b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:33.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.261+0000 7f09b4a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09b010f2b0 0x7f09b01a0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:33.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.261+0000 7f09b4a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f09b0114cf0 con 0x7f09b010f2b0 2024-09-10T23:16:33.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.261+0000 7f09b4a00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f09b0114b70 con 0x7f09b0101700 2024-09-10T23:16:33.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.261+0000 7f09b4a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f09b0114e70 con 0x7f09b0102020 2024-09-10T23:16:33.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.261+0000 7f09a7e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09b0102020 0x7f09b019b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:33.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.261+0000 7f09af200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09b010f2b0 0x7f09b01a0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:33.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.261+0000 7f09a7e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09b0102020 0x7f09b019b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.3:58424/0 (socket says 172.21.15.3:58424) 2024-09-10T23:16:33.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.261+0000 7f09a7e00640 1 -- 172.21.15.3:0/3620870590 learned_addr learned my addr 172.21.15.3:0/3620870590 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:16:33.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.262+0000 7f09af200640 1 -- 172.21.15.3:0/3620870590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09b0102020 msgr2=0x7f09b019b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:33.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.262+0000 7f09af200640 1 --2- 172.21.15.3:0/3620870590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09b0102020 0x7f09b019b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:33.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.262+0000 7f09af200640 1 -- 172.21.15.3:0/3620870590 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09b0101700 msgr2=0x7f09b019b140 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T23:16:33.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.262+0000 7f09af200640 1 --2- 172.21.15.3:0/3620870590 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09b0101700 0x7f09b019b140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:33.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.262+0000 7f09af200640 1 -- 172.21.15.3:0/3620870590 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09b01a11f0 con 0x7f09b010f2b0 2024-09-10T23:16:33.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.262+0000 7f09a7e00640 1 --2- 172.21.15.3:0/3620870590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09b0102020 0x7f09b019b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:16:33.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.262+0000 7f09af200640 1 --2- 172.21.15.3:0/3620870590 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09b010f2b0 0x7f09b01a0a20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f09a802af40 tx=0x7f09a8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:33.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.262+0000 7f09a7400640 1 -- 172.21.15.3:0/3620870590 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a8034040 con 0x7f09b010f2b0 2024-09-10T23:16:33.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.262+0000 7f09a7400640 1 -- 172.21.15.3:0/3620870590 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f09a802fcf0 con 0x7f09b010f2b0 2024-09-10T23:16:33.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.262+0000 7f09a7400640 1 -- 172.21.15.3:0/3620870590 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a80044d0 con 0x7f09b010f2b0 2024-09-10T23:16:33.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.262+0000 7f09b4a00640 1 -- 172.21.15.3:0/3620870590 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09b01a1480 con 0x7f09b010f2b0 2024-09-10T23:16:33.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.263+0000 7f09b4a00640 1 -- 172.21.15.3:0/3620870590 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09b01a7ba0 con 0x7f09b010f2b0 2024-09-10T23:16:33.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.264+0000 7f09a7400640 1 -- 172.21.15.3:0/3620870590 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 51496+0+0 (secure 0 0 0) 0x7f09a80306e0 con 0x7f09b010f2b0 2024-09-10T23:16:33.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.264+0000 7f09b4a00640 1 -- 172.21.15.3:0/3620870590 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09b0101ae0 con 0x7f09b010f2b0 2024-09-10T23:16:33.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.264+0000 7f09a7400640 1 --2- 172.21.15.3:0/3620870590 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f099403f610 0x7f0994041ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:33.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.264+0000 7f09a7400640 1 -- 172.21.15.3:0/3620870590 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f09a8074d50 con 0x7f09b010f2b0 2024-09-10T23:16:33.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.264+0000 7f09ae800640 1 --2- 172.21.15.3:0/3620870590 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f099403f610 0x7f0994041ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:33.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.265+0000 7f09ae800640 1 --2- 172.21.15.3:0/3620870590 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f099403f610 0x7f0994041ad0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f09a0009a60 tx=0x7f09a0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:33.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.272+0000 7f09a7400640 1 -- 172.21.15.3:0/3620870590 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f09a8004670 con 0x7f09b010f2b0 2024-09-10T23:16:33.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.470+0000 7f09b4a00640 1 -- 172.21.15.3:0/3620870590 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f09b01a7da0 con 0x7f09b010f2b0 2024-09-10T23:16:33.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.476+0000 7f09a7400640 1 -- 172.21.15.3:0/3620870590 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v19)=0 v19) ==== 118+0+0 (secure 0 0 0) 0x7f09a804ecd0 con 0x7f09b010f2b0 2024-09-10T23:16:33.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.479+0000 7f09b4a00640 1 -- 172.21.15.3:0/3620870590 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f099403f610 msgr2=0x7f0994041ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:33.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.479+0000 7f09b4a00640 1 --2- 172.21.15.3:0/3620870590 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f099403f610 0x7f0994041ad0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f09a0009a60 tx=0x7f09a0005f90 comp rx=0 tx=0).stop 2024-09-10T23:16:33.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.479+0000 7f09b4a00640 1 -- 172.21.15.3:0/3620870590 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09b010f2b0 msgr2=0x7f09b01a0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:33.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.479+0000 7f09b4a00640 1 --2- 172.21.15.3:0/3620870590 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09b010f2b0 0x7f09b01a0a20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f09a802af40 tx=0x7f09a8003c10 comp rx=0 tx=0).stop 2024-09-10T23:16:33.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.479+0000 7f09b4a00640 1 -- 172.21.15.3:0/3620870590 shutdown_connections 2024-09-10T23:16:33.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.479+0000 7f09b4a00640 1 --2- 172.21.15.3:0/3620870590 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f099403f610 0x7f0994041ad0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:33.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.479+0000 7f09b4a00640 1 --2- 172.21.15.3:0/3620870590 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09b010f2b0 0x7f09b01a0a20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:33.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.479+0000 7f09b4a00640 1 --2- 172.21.15.3:0/3620870590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09b0102020 0x7f09b019b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:33.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.479+0000 7f09b4a00640 1 --2- 172.21.15.3:0/3620870590 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09b0101700 0x7f09b019b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:33.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.479+0000 7f09b4a00640 1 -- 172.21.15.3:0/3620870590 >> 172.21.15.3:0/3620870590 conn(0x7f09b00fd5b0 msgr2=0x7f09b0111550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:33.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.479+0000 7f09b4a00640 1 -- 172.21.15.3:0/3620870590 shutdown_connections 2024-09-10T23:16:33.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.479+0000 7f09b4a00640 1 -- 172.21.15.3:0/3620870590 wait complete. 2024-09-10T23:16:33.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.889+0000 7f5ceca00640 1 -- 172.21.15.3:0/203120679 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ce8108610 msgr2=0x7f5ce8108a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:33.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.889+0000 7f5ceca00640 1 --2- 172.21.15.3:0/203120679 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ce8108610 0x7f5ce8108a50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0009900 tx=0x7f5cd002a410 comp rx=0 tx=0).stop 2024-09-10T23:16:33.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.889+0000 7f5ceca00640 1 -- 172.21.15.3:0/203120679 shutdown_connections 2024-09-10T23:16:33.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.889+0000 7f5ceca00640 1 --2- 172.21.15.3:0/203120679 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ce8108f90 0x7f5ce810f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:33.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.889+0000 7f5ceca00640 1 --2- 172.21.15.3:0/203120679 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ce8108610 0x7f5ce8108a50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:33.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.889+0000 7f5ceca00640 1 --2- 172.21.15.3:0/203120679 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ce8102c00 0x7f5ce8102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:33.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.889+0000 7f5ceca00640 1 -- 172.21.15.3:0/203120679 >> 172.21.15.3:0/203120679 conn(0x7f5ce80fe6d0 msgr2=0x7f5ce8100af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:33.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.889+0000 7f5ceca00640 1 -- 172.21.15.3:0/203120679 shutdown_connections 2024-09-10T23:16:33.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.889+0000 7f5ceca00640 1 -- 172.21.15.3:0/203120679 wait complete. 2024-09-10T23:16:33.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.890+0000 7f5ceca00640 1 Processor -- start 2024-09-10T23:16:33.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.890+0000 7f5ceca00640 1 -- start start 2024-09-10T23:16:33.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.891+0000 7f5ceca00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ce8102c00 0x7f5ce8198fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:33.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.891+0000 7f5ceca00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ce8108610 0x7f5ce8199510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:33.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.891+0000 7f5ceca00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ce8108f90 0x7f5ce819e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:33.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.891+0000 7f5ceca00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce8112b20 con 0x7f5ce8108610 2024-09-10T23:16:33.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.891+0000 7f5ceca00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce81129a0 con 0x7f5ce8108f90 2024-09-10T23:16:33.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.891+0000 7f5ceca00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce8112ca0 con 0x7f5ce8102c00 2024-09-10T23:16:33.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.891+0000 7f5cdde00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ce8108610 0x7f5ce8199510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:33.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.891+0000 7f5ce6800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ce8102c00 0x7f5ce8198fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:33.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.891+0000 7f5cdde00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ce8108610 0x7f5ce8199510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36296/0 (socket says 172.21.15.3:36296) 2024-09-10T23:16:33.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.891+0000 7f5cdde00640 1 -- 172.21.15.3:0/2791344387 learned_addr learned my addr 172.21.15.3:0/2791344387 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:16:33.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.891+0000 7f5ce7200640 1 --2- 172.21.15.3:0/2791344387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ce8108f90 0x7f5ce819e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:33.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.892+0000 7f5ce7200640 1 -- 172.21.15.3:0/2791344387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ce8102c00 msgr2=0x7f5ce8198fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:33.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.892+0000 7f5ce7200640 1 --2- 172.21.15.3:0/2791344387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ce8102c00 0x7f5ce8198fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:33.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.892+0000 7f5ce7200640 1 -- 172.21.15.3:0/2791344387 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ce8108610 msgr2=0x7f5ce8199510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:33.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.892+0000 7f5ce7200640 1 --2- 172.21.15.3:0/2791344387 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ce8108610 0x7f5ce8199510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:33.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.892+0000 7f5ce7200640 1 -- 172.21.15.3:0/2791344387 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce819f080 con 0x7f5ce8108f90 2024-09-10T23:16:33.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.892+0000 7f5cdde00640 1 --2- 172.21.15.3:0/2791344387 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ce8108610 0x7f5ce8199510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:16:33.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.892+0000 7f5ce7200640 1 --2- 172.21.15.3:0/2791344387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ce8108f90 0x7f5ce819e8b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0009fd0 tx=0x7f5ce000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:33.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.892+0000 7f5cdfe00640 1 -- 172.21.15.3:0/2791344387 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce000ce20 con 0x7f5ce8108f90 2024-09-10T23:16:33.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.892+0000 7f5cdfe00640 1 -- 172.21.15.3:0/2791344387 <== mon.2 v2:172.21.15.38:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ce0005020 con 0x7f5ce8108f90 2024-09-10T23:16:33.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.892+0000 7f5ceca00640 1 -- 172.21.15.3:0/2791344387 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ce819f370 con 0x7f5ce8108f90 2024-09-10T23:16:33.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.892+0000 7f5cdfe00640 1 -- 172.21.15.3:0/2791344387 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce0010690 con 0x7f5ce8108f90 2024-09-10T23:16:33.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.892+0000 7f5ceca00640 1 -- 172.21.15.3:0/2791344387 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ce81a5a30 con 0x7f5ce8108f90 2024-09-10T23:16:33.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.893+0000 7f5ceca00640 1 -- 172.21.15.3:0/2791344387 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ce8102fe0 con 0x7f5ce8108f90 2024-09-10T23:16:33.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.894+0000 7f5cdfe00640 1 -- 172.21.15.3:0/2791344387 <== mon.2 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 17) ==== 51496+0+0 (secure 0 0 0) 0x7f5ce0004a40 con 0x7f5ce8108f90 2024-09-10T23:16:33.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.894+0000 7f5cdfe00640 1 --2- 172.21.15.3:0/2791344387 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5ccc03f610 0x7f5ccc041ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:33.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.894+0000 7f5cdfe00640 1 -- 172.21.15.3:0/2791344387 <== mon.2 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f5ce00544f0 con 0x7f5ce8108f90 2024-09-10T23:16:33.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.894+0000 7f5ce6800640 1 --2- 172.21.15.3:0/2791344387 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5ccc03f610 0x7f5ccc041ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:33.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.895+0000 7f5ce6800640 1 --2- 172.21.15.3:0/2791344387 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5ccc03f610 0x7f5ccc041ad0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80095f0 tx=0x7f5cd8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:33.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.900+0000 7f5cdfe00640 1 -- 172.21.15.3:0/2791344387 <== mon.2 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5ce000b2c0 con 0x7f5ce8108f90 2024-09-10T23:16:34.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.101+0000 7f5ceca00640 1 -- 172.21.15.3:0/2791344387 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f5ce819a100 con 0x7f5ce8108f90 2024-09-10T23:16:34.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.107+0000 7f5cdfe00640 1 -- 172.21.15.3:0/2791344387 <== mon.2 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v21)=0 v21) ==== 108+0+0 (secure 0 0 0) 0x7f5ce0004d60 con 0x7f5ce8108f90 2024-09-10T23:16:34.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.109+0000 7f5ceca00640 1 -- 172.21.15.3:0/2791344387 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5ccc03f610 msgr2=0x7f5ccc041ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:34.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.109+0000 7f5ceca00640 1 --2- 172.21.15.3:0/2791344387 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5ccc03f610 0x7f5ccc041ad0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80095f0 tx=0x7f5cd8005f90 comp rx=0 tx=0).stop 2024-09-10T23:16:34.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.109+0000 7f5ceca00640 1 -- 172.21.15.3:0/2791344387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ce8108f90 msgr2=0x7f5ce819e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:34.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.109+0000 7f5ceca00640 1 --2- 172.21.15.3:0/2791344387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ce8108f90 0x7f5ce819e8b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0009fd0 tx=0x7f5ce000ef10 comp rx=0 tx=0).stop 2024-09-10T23:16:34.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.109+0000 7f5ceca00640 1 -- 172.21.15.3:0/2791344387 shutdown_connections 2024-09-10T23:16:34.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.109+0000 7f5ceca00640 1 --2- 172.21.15.3:0/2791344387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ce8108f90 0x7f5ce819e8b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:34.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.109+0000 7f5ceca00640 1 --2- 172.21.15.3:0/2791344387 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5ccc03f610 0x7f5ccc041ad0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:34.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.109+0000 7f5ceca00640 1 --2- 172.21.15.3:0/2791344387 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ce8108610 0x7f5ce8199510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:34.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.109+0000 7f5ceca00640 1 --2- 172.21.15.3:0/2791344387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ce8102c00 0x7f5ce8198fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:34.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.109+0000 7f5ceca00640 1 -- 172.21.15.3:0/2791344387 >> 172.21.15.3:0/2791344387 conn(0x7f5ce80fe6d0 msgr2=0x7f5ce8100ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:34.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.110+0000 7f5ceca00640 1 -- 172.21.15.3:0/2791344387 shutdown_connections 2024-09-10T23:16:34.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.110+0000 7f5ceca00640 1 -- 172.21.15.3:0/2791344387 wait complete. 2024-09-10T23:16:34.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:34 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:34.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:34 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:34.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:34 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:34.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:34 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:16:34.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:34 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:16:34.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:34 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T23:16:34.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:34 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:16:34.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:34 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:34.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:34 smithi038 ceph-mon[34225]: Deploying daemon mgr.y on smithi038 2024-09-10T23:16:34.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:34 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3620870590' entity='client.admin' 2024-09-10T23:16:34.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:34 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2326610639' entity='client.admin' 2024-09-10T23:16:34.409 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:34 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:34.409 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:34 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:34.409 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:34 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:34.409 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:34 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:16:34.409 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:34 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:16:34.409 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:34 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T23:16:34.409 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:34 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:16:34.409 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:34 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:34.410 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:34 smithi003 ceph-mon[30348]: Deploying daemon mgr.y on smithi038 2024-09-10T23:16:34.410 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:34 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3620870590' entity='client.admin' 2024-09-10T23:16:34.410 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:34 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2326610639' entity='client.admin' 2024-09-10T23:16:34.449 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:34 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:34.449 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:34 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:34.449 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:34 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:34.449 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:34 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:16:34.449 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:34 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:16:34.449 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:34 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T23:16:34.449 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:34 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:16:34.449 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:34 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:34.449 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:34 smithi194 ceph-mon[33904]: Deploying daemon mgr.y on smithi038 2024-09-10T23:16:34.449 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:34 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3620870590' entity='client.admin' 2024-09-10T23:16:34.449 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:34 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2326610639' entity='client.admin' 2024-09-10T23:16:35.383 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:35 smithi003 ceph-mon[30348]: from='client.? ' entity='client.admin' 2024-09-10T23:16:35.383 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:35 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2827310867' entity='client.admin' 2024-09-10T23:16:35.409 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:35 smithi038 ceph-mon[34225]: from='client.? ' entity='client.admin' 2024-09-10T23:16:35.409 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:35 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2827310867' entity='client.admin' 2024-09-10T23:16:35.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:35 smithi194 ceph-mon[33904]: from='client.? ' entity='client.admin' 2024-09-10T23:16:35.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:35 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2827310867' entity='client.admin' 2024-09-10T23:16:35.721 INFO:journalctl@ceph.mgr.y.smithi038.stdout:Sep 10 23:16:35 smithi038 systemd[1]: Starting Ceph mgr.y for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:16:35.981 INFO:journalctl@ceph.mgr.y.smithi038.stdout:Sep 10 23:16:35 smithi038 podman[36545]: 2024-09-10 23:16:35.62558193 +0000 UTC m=+0.027453062 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:16:35.981 INFO:journalctl@ceph.mgr.y.smithi038.stdout:Sep 10 23:16:35 smithi038 podman[36545]: 2024-09-10 23:16:35.723784861 +0000 UTC m=+0.125655992 container create 812af8ed3c9629ed2a85a6314595271b5d4a7bc2e08b78769a7ffd6b2f723ed1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True) 2024-09-10T23:16:35.981 INFO:journalctl@ceph.mgr.y.smithi038.stdout:Sep 10 23:16:35 smithi038 podman[36545]: 2024-09-10 23:16:35.934693211 +0000 UTC m=+0.336564367 container init 812af8ed3c9629ed2a85a6314595271b5d4a7bc2e08b78769a7ffd6b2f723ed1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-10T23:16:35.982 INFO:journalctl@ceph.mgr.y.smithi038.stdout:Sep 10 23:16:35 smithi038 podman[36545]: 2024-09-10 23:16:35.941105518 +0000 UTC m=+0.342976648 container start 812af8ed3c9629ed2a85a6314595271b5d4a7bc2e08b78769a7ffd6b2f723ed1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-y, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-10T23:16:36.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.500+0000 7f976ee00640 1 -- 172.21.15.3:0/3500106445 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9768102de0 msgr2=0x7f97681031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:36.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.500+0000 7f976ee00640 1 --2- 172.21.15.3:0/3500106445 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9768102de0 0x7f97681031c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9758009900 tx=0x7f975802a3f0 comp rx=0 tx=0).stop 2024-09-10T23:16:36.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.500+0000 7f976ee00640 1 -- 172.21.15.3:0/3500106445 shutdown_connections 2024-09-10T23:16:36.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.500+0000 7f976ee00640 1 --2- 172.21.15.3:0/3500106445 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9768109170 0x7f976810f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:36.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.500+0000 7f976ee00640 1 --2- 172.21.15.3:0/3500106445 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97681087f0 0x7f9768108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:36.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.500+0000 7f976ee00640 1 --2- 172.21.15.3:0/3500106445 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9768102de0 0x7f97681031c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:36.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.500+0000 7f976ee00640 1 -- 172.21.15.3:0/3500106445 >> 172.21.15.3:0/3500106445 conn(0x7f97680fe830 msgr2=0x7f9768100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:36.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.500+0000 7f976ee00640 1 -- 172.21.15.3:0/3500106445 shutdown_connections 2024-09-10T23:16:36.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.500+0000 7f976ee00640 1 -- 172.21.15.3:0/3500106445 wait complete. 2024-09-10T23:16:36.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.501+0000 7f976ee00640 1 Processor -- start 2024-09-10T23:16:36.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.501+0000 7f976ee00640 1 -- start start 2024-09-10T23:16:36.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.501+0000 7f976ee00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9768102de0 0x7f97680754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:36.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.501+0000 7f976ee00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97681087f0 0x7f97680759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:36.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.501+0000 7f976ee00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9768109170 0x7f9768075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:36.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.501+0000 7f976ee00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9768112ca0 con 0x7f9768109170 2024-09-10T23:16:36.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.501+0000 7f976ee00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9768112b20 con 0x7f97681087f0 2024-09-10T23:16:36.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.501+0000 7f976ee00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9768112e20 con 0x7f9768102de0 2024-09-10T23:16:36.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.502+0000 7f976ce00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9768109170 0x7f9768075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:36.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.502+0000 7f9767e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9768102de0 0x7f97680754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:36.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.502+0000 7f976ce00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9768109170 0x7f9768075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36330/0 (socket says 172.21.15.3:36330) 2024-09-10T23:16:36.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.502+0000 7f976ce00640 1 -- 172.21.15.3:0/2198751556 learned_addr learned my addr 172.21.15.3:0/2198751556 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:16:36.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.502+0000 7f975f400640 1 --2- 172.21.15.3:0/2198751556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97681087f0 0x7f97680759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:36.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.502+0000 7f976ce00640 1 -- 172.21.15.3:0/2198751556 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9768102de0 msgr2=0x7f97680754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:36.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.502+0000 7f976ce00640 1 --2- 172.21.15.3:0/2198751556 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9768102de0 0x7f97680754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:36.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.502+0000 7f976ce00640 1 -- 172.21.15.3:0/2198751556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97681087f0 msgr2=0x7f97680759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:36.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.502+0000 7f976ce00640 1 --2- 172.21.15.3:0/2198751556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97681087f0 0x7f97680759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:36.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.502+0000 7f976ce00640 1 -- 172.21.15.3:0/2198751556 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97681a75f0 con 0x7f9768109170 2024-09-10T23:16:36.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.502+0000 7f975f400640 1 --2- 172.21.15.3:0/2198751556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97681087f0 0x7f97680759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:16:36.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.502+0000 7f976ce00640 1 --2- 172.21.15.3:0/2198751556 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9768109170 0x7f9768075f20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f976000eaa0 tx=0x7f976000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:36.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.503+0000 7f9765600640 1 -- 172.21.15.3:0/2198751556 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976000cdb0 con 0x7f9768109170 2024-09-10T23:16:36.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.503+0000 7f9765600640 1 -- 172.21.15.3:0/2198751556 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9760005020 con 0x7f9768109170 2024-09-10T23:16:36.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.503+0000 7f976ee00640 1 -- 172.21.15.3:0/2198751556 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97681a78e0 con 0x7f9768109170 2024-09-10T23:16:36.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.503+0000 7f9765600640 1 -- 172.21.15.3:0/2198751556 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97600116d0 con 0x7f9768109170 2024-09-10T23:16:36.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.503+0000 7f976ee00640 1 -- 172.21.15.3:0/2198751556 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97681a7dd0 con 0x7f9768109170 2024-09-10T23:16:36.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.504+0000 7f976ee00640 1 -- 172.21.15.3:0/2198751556 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97681031c0 con 0x7f9768109170 2024-09-10T23:16:36.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.505+0000 7f9765600640 1 -- 172.21.15.3:0/2198751556 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 51496+0+0 (secure 0 0 0) 0x7f976000f040 con 0x7f9768109170 2024-09-10T23:16:36.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.505+0000 7f9765600640 1 --2- 172.21.15.3:0/2198751556 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f974c03f560 0x7f974c041a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:36.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.505+0000 7f9765600640 1 -- 172.21.15.3:0/2198751556 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f9760053ea0 con 0x7f9768109170 2024-09-10T23:16:36.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.505+0000 7f9767e00640 1 --2- 172.21.15.3:0/2198751556 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f974c03f560 0x7f974c041a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:36.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.506+0000 7f9767e00640 1 --2- 172.21.15.3:0/2198751556 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f974c03f560 0x7f974c041a20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f97580057c0 tx=0x7f97580058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:36.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.510+0000 7f9765600640 1 -- 172.21.15.3:0/2198751556 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9760016030 con 0x7f9768109170 2024-09-10T23:16:36.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.706+0000 7f976ee00640 1 -- 172.21.15.3:0/2198751556 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f976802e5c0 con 0x7f9768109170 2024-09-10T23:16:36.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.710+0000 7f9765600640 1 -- 172.21.15.3:0/2198751556 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v23)=0 v23) ==== 116+0+0 (secure 0 0 0) 0x7f97600054f0 con 0x7f9768109170 2024-09-10T23:16:36.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.712+0000 7f976ee00640 1 -- 172.21.15.3:0/2198751556 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f974c03f560 msgr2=0x7f974c041a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:36.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.712+0000 7f976ee00640 1 --2- 172.21.15.3:0/2198751556 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f974c03f560 0x7f974c041a20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f97580057c0 tx=0x7f97580058d0 comp rx=0 tx=0).stop 2024-09-10T23:16:36.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.712+0000 7f976ee00640 1 -- 172.21.15.3:0/2198751556 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9768109170 msgr2=0x7f9768075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:36.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.712+0000 7f976ee00640 1 --2- 172.21.15.3:0/2198751556 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9768109170 0x7f9768075f20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f976000eaa0 tx=0x7f976000ef60 comp rx=0 tx=0).stop 2024-09-10T23:16:36.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.712+0000 7f976ee00640 1 -- 172.21.15.3:0/2198751556 shutdown_connections 2024-09-10T23:16:36.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.712+0000 7f976ee00640 1 --2- 172.21.15.3:0/2198751556 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f974c03f560 0x7f974c041a20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:36.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.712+0000 7f976ee00640 1 --2- 172.21.15.3:0/2198751556 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9768109170 0x7f9768075f20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:36.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.712+0000 7f976ee00640 1 --2- 172.21.15.3:0/2198751556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97681087f0 0x7f97680759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:36.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.712+0000 7f976ee00640 1 --2- 172.21.15.3:0/2198751556 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9768102de0 0x7f97680754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:36.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.712+0000 7f976ee00640 1 -- 172.21.15.3:0/2198751556 >> 172.21.15.3:0/2198751556 conn(0x7f97680fe830 msgr2=0x7f9768100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:36.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.712+0000 7f976ee00640 1 -- 172.21.15.3:0/2198751556 shutdown_connections 2024-09-10T23:16:36.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:35.712+0000 7f976ee00640 1 -- 172.21.15.3:0/2198751556 wait complete. 2024-09-10T23:16:36.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.524+0000 7fbb8d400640 1 -- 172.21.15.3:0/3094550148 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb88102c10 msgr2=0x7fbb88102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:36.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.524+0000 7fbb8d400640 1 --2- 172.21.15.3:0/3094550148 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb88102c10 0x7fbb88102ff0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbb78009ca0 tx=0x7fbb7802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:16:36.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.524+0000 7fbb8d400640 1 -- 172.21.15.3:0/3094550148 shutdown_connections 2024-09-10T23:16:36.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.524+0000 7fbb8d400640 1 --2- 172.21.15.3:0/3094550148 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb88108fa0 0x7fbb8810f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:36.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.524+0000 7fbb8d400640 1 --2- 172.21.15.3:0/3094550148 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb88108620 0x7fbb88108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:36.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.524+0000 7fbb8d400640 1 --2- 172.21.15.3:0/3094550148 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb88102c10 0x7fbb88102ff0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:36.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.524+0000 7fbb8d400640 1 -- 172.21.15.3:0/3094550148 >> 172.21.15.3:0/3094550148 conn(0x7fbb880fe6c0 msgr2=0x7fbb88100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:36.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.524+0000 7fbb8d400640 1 -- 172.21.15.3:0/3094550148 shutdown_connections 2024-09-10T23:16:36.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.524+0000 7fbb8d400640 1 -- 172.21.15.3:0/3094550148 wait complete. 2024-09-10T23:16:36.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.525+0000 7fbb8d400640 1 Processor -- start 2024-09-10T23:16:36.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.526+0000 7fbb8d400640 1 -- start start 2024-09-10T23:16:36.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.526+0000 7fbb8d400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb88102c10 0x7fbb880754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:36.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.526+0000 7fbb8d400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb88108620 0x7fbb880759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:36.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.526+0000 7fbb8d400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb88108fa0 0x7fbb88075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:36.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.526+0000 7fbb8d400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fbb88112b20 con 0x7fbb88102c10 2024-09-10T23:16:36.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.526+0000 7fbb8d400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fbb881129a0 con 0x7fbb88108fa0 2024-09-10T23:16:36.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.526+0000 7fbb8d400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fbb88112ca0 con 0x7fbb88108620 2024-09-10T23:16:36.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.526+0000 7fbb87e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb88102c10 0x7fbb880754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:36.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.526+0000 7fbb87e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb88102c10 0x7fbb880754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36306/0 (socket says 172.21.15.3:36306) 2024-09-10T23:16:36.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.526+0000 7fbb87e00640 1 -- 172.21.15.3:0/2827310867 learned_addr learned my addr 172.21.15.3:0/2827310867 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:16:36.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.526+0000 7fbb7f400640 1 --2- 172.21.15.3:0/2827310867 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb88108620 0x7fbb880759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:36.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.527+0000 7fbb8ca00640 1 --2- 172.21.15.3:0/2827310867 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb88108fa0 0x7fbb88075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:36.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.527+0000 7fbb87e00640 1 -- 172.21.15.3:0/2827310867 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb88108620 msgr2=0x7fbb880759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:36.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.527+0000 7fbb87e00640 1 --2- 172.21.15.3:0/2827310867 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb88108620 0x7fbb880759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:36.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.527+0000 7fbb87e00640 1 -- 172.21.15.3:0/2827310867 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb88108fa0 msgr2=0x7fbb88075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:36.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.527+0000 7fbb87e00640 1 --2- 172.21.15.3:0/2827310867 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb88108fa0 0x7fbb88075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:36.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.527+0000 7fbb87e00640 1 -- 172.21.15.3:0/2827310867 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb881a73d0 con 0x7fbb88102c10 2024-09-10T23:16:36.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.527+0000 7fbb87e00640 1 --2- 172.21.15.3:0/2827310867 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb88102c10 0x7fbb880754a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbb78031040 tx=0x7fbb78032990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:36.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.527+0000 7fbb85600640 1 -- 172.21.15.3:0/2827310867 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb78032d80 con 0x7fbb88102c10 2024-09-10T23:16:36.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.527+0000 7fbb85600640 1 -- 172.21.15.3:0/2827310867 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb780044d0 con 0x7fbb88102c10 2024-09-10T23:16:36.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.527+0000 7fbb85600640 1 -- 172.21.15.3:0/2827310867 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb78030c30 con 0x7fbb88102c10 2024-09-10T23:16:36.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.527+0000 7fbb8d400640 1 -- 172.21.15.3:0/2827310867 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb881a7660 con 0x7fbb88102c10 2024-09-10T23:16:36.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.528+0000 7fbb8d400640 1 -- 172.21.15.3:0/2827310867 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb881a7b50 con 0x7fbb88102c10 2024-09-10T23:16:36.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.529+0000 7fbb85600640 1 -- 172.21.15.3:0/2827310867 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 51496+0+0 (secure 0 0 0) 0x7fbb78004040 con 0x7fbb88102c10 2024-09-10T23:16:36.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.529+0000 7fbb8d400640 1 -- 172.21.15.3:0/2827310867 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb88102ff0 con 0x7fbb88102c10 2024-09-10T23:16:36.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.529+0000 7fbb85600640 1 --2- 172.21.15.3:0/2827310867 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fbb6c03f610 0x7fbb6c041ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:36.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.529+0000 7fbb85600640 1 -- 172.21.15.3:0/2827310867 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fbb780751c0 con 0x7fbb88102c10 2024-09-10T23:16:36.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.530+0000 7fbb7f400640 1 --2- 172.21.15.3:0/2827310867 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fbb6c03f610 0x7fbb6c041ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:36.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.530+0000 7fbb7f400640 1 --2- 172.21.15.3:0/2827310867 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fbb6c03f610 0x7fbb6c041ad0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbb88076f90 tx=0x7fbb70005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:36.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.534+0000 7fbb85600640 1 -- 172.21.15.3:0/2827310867 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fbb78030dd0 con 0x7fbb88102c10 2024-09-10T23:16:36.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.740+0000 7fbb8d400640 1 -- 172.21.15.3:0/2827310867 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7fbb8802e5c0 con 0x7fbb88102c10 2024-09-10T23:16:36.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.745+0000 7fbb85600640 1 -- 172.21.15.3:0/2827310867 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v22)=0 v22) ==== 133+0+0 (secure 0 0 0) 0x7fbb7804e440 con 0x7fbb88102c10 2024-09-10T23:16:36.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.747+0000 7fbb8d400640 1 -- 172.21.15.3:0/2827310867 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fbb6c03f610 msgr2=0x7fbb6c041ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:36.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.747+0000 7fbb8d400640 1 --2- 172.21.15.3:0/2827310867 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fbb6c03f610 0x7fbb6c041ad0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbb88076f90 tx=0x7fbb70005f90 comp rx=0 tx=0).stop 2024-09-10T23:16:36.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.747+0000 7fbb8d400640 1 -- 172.21.15.3:0/2827310867 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb88102c10 msgr2=0x7fbb880754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:36.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.747+0000 7fbb8d400640 1 --2- 172.21.15.3:0/2827310867 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb88102c10 0x7fbb880754a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbb78031040 tx=0x7fbb78032990 comp rx=0 tx=0).stop 2024-09-10T23:16:36.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.748+0000 7fbb8d400640 1 -- 172.21.15.3:0/2827310867 shutdown_connections 2024-09-10T23:16:36.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.748+0000 7fbb8d400640 1 --2- 172.21.15.3:0/2827310867 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb88108fa0 0x7fbb88075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:36.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.748+0000 7fbb8d400640 1 --2- 172.21.15.3:0/2827310867 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb88108620 0x7fbb880759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:36.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.748+0000 7fbb8d400640 1 --2- 172.21.15.3:0/2827310867 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fbb6c03f610 0x7fbb6c041ad0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:36.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.748+0000 7fbb8d400640 1 --2- 172.21.15.3:0/2827310867 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb88102c10 0x7fbb880754a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:36.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.748+0000 7fbb8d400640 1 -- 172.21.15.3:0/2827310867 >> 172.21.15.3:0/2827310867 conn(0x7fbb880fe6c0 msgr2=0x7fbb88100ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:36.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.748+0000 7fbb8d400640 1 -- 172.21.15.3:0/2827310867 shutdown_connections 2024-09-10T23:16:36.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:34.748+0000 7fbb8d400640 1 -- 172.21.15.3:0/2827310867 wait complete. 2024-09-10T23:16:36.350 INFO:journalctl@ceph.mgr.y.smithi038.stdout:Sep 10 23:16:35 smithi038 ceph-mgr[36564]: -- 172.21.15.38:0/3483894455 <== mon.2 v2:172.21.15.38:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560cd98810e0 con 0x560cd985f000 2024-09-10T23:16:36.350 INFO:journalctl@ceph.mgr.y.smithi038.stdout:Sep 10 23:16:36 smithi038 bash[36545]: 812af8ed3c9629ed2a85a6314595271b5d4a7bc2e08b78769a7ffd6b2f723ed1 2024-09-10T23:16:36.350 INFO:journalctl@ceph.mgr.y.smithi038.stdout:Sep 10 23:16:36 smithi038 systemd[1]: Started Ceph mgr.y for 3f4e30d0-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:16:36.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:36 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2198751556' entity='client.admin' 2024-09-10T23:16:36.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:36 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:36.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:36 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:36.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:36 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:36.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:36 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:36.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:36 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:16:37.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:36 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2198751556' entity='client.admin' 2024-09-10T23:16:37.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:36 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:37.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:36 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:37.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:36 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:37.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:36 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:37.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:36 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:16:37.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:36 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2198751556' entity='client.admin' 2024-09-10T23:16:37.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:36 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:37.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:36 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:37.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:36 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:37.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:36 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:37.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:36 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:16:38.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.606+0000 7ff654a00640 1 -- 172.21.15.3:0/3606126895 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff650102dc0 msgr2=0x7ff6501031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:38.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.606+0000 7ff654a00640 1 --2- 172.21.15.3:0/3606126895 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff650102dc0 0x7ff6501031a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff640009900 tx=0x7ff64002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:16:38.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.606+0000 7ff654a00640 1 -- 172.21.15.3:0/3606126895 shutdown_connections 2024-09-10T23:16:38.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.606+0000 7ff654a00640 1 --2- 172.21.15.3:0/3606126895 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff650109150 0x7ff65010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:38.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.606+0000 7ff654a00640 1 --2- 172.21.15.3:0/3606126895 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6501087d0 0x7ff650108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:38.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.606+0000 7ff654a00640 1 --2- 172.21.15.3:0/3606126895 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff650102dc0 0x7ff6501031a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:38.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.606+0000 7ff654a00640 1 -- 172.21.15.3:0/3606126895 >> 172.21.15.3:0/3606126895 conn(0x7ff6500fe830 msgr2=0x7ff650100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:38.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.606+0000 7ff654a00640 1 -- 172.21.15.3:0/3606126895 shutdown_connections 2024-09-10T23:16:38.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.607+0000 7ff654a00640 1 -- 172.21.15.3:0/3606126895 wait complete. 2024-09-10T23:16:38.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.607+0000 7ff654a00640 1 Processor -- start 2024-09-10T23:16:38.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.607+0000 7ff654a00640 1 -- start start 2024-09-10T23:16:38.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.608+0000 7ff654a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff650102dc0 0x7ff650199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:38.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.608+0000 7ff654a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff6501087d0 0x7ff650199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:38.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.608+0000 7ff654a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff650109150 0x7ff65019eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:38.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.608+0000 7ff654a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff650112d10 con 0x7ff6501087d0 2024-09-10T23:16:38.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.608+0000 7ff654a00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff650112b90 con 0x7ff650109150 2024-09-10T23:16:38.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.608+0000 7ff654a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff650112e90 con 0x7ff650102dc0 2024-09-10T23:16:38.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.608+0000 7ff64d400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff6501087d0 0x7ff650199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:38.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.608+0000 7ff64d400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff6501087d0 0x7ff650199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36278/0 (socket says 172.21.15.3:36278) 2024-09-10T23:16:38.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.608+0000 7ff64d400640 1 -- 172.21.15.3:0/2326610639 learned_addr learned my addr 172.21.15.3:0/2326610639 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:16:38.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.608+0000 7ff64de00640 1 --2- 172.21.15.3:0/2326610639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff650102dc0 0x7ff650199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:38.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.608+0000 7ff64e800640 1 --2- 172.21.15.3:0/2326610639 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff650109150 0x7ff65019eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:38.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.608+0000 7ff64d400640 1 -- 172.21.15.3:0/2326610639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff650102dc0 msgr2=0x7ff650199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:38.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.608+0000 7ff64d400640 1 --2- 172.21.15.3:0/2326610639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff650102dc0 0x7ff650199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:38.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.608+0000 7ff64d400640 1 -- 172.21.15.3:0/2326610639 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff650109150 msgr2=0x7ff65019eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:38.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.608+0000 7ff64d400640 1 --2- 172.21.15.3:0/2326610639 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff650109150 0x7ff65019eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:38.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.609+0000 7ff64d400640 1 -- 172.21.15.3:0/2326610639 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff65019f2b0 con 0x7ff6501087d0 2024-09-10T23:16:38.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.609+0000 7ff64d400640 1 --2- 172.21.15.3:0/2326610639 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff6501087d0 0x7ff650199740 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff63c00d950 tx=0x7ff63c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:38.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.609+0000 7ff646a00640 1 -- 172.21.15.3:0/2326610639 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff63c017030 con 0x7ff6501087d0 2024-09-10T23:16:38.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.609+0000 7ff654a00640 1 -- 172.21.15.3:0/2326610639 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff65019f5a0 con 0x7ff6501087d0 2024-09-10T23:16:38.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.609+0000 7ff646a00640 1 -- 172.21.15.3:0/2326610639 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff63c004020 con 0x7ff6501087d0 2024-09-10T23:16:38.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.609+0000 7ff646a00640 1 -- 172.21.15.3:0/2326610639 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff63c0055d0 con 0x7ff6501087d0 2024-09-10T23:16:38.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.609+0000 7ff654a00640 1 -- 172.21.15.3:0/2326610639 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6501a5c60 con 0x7ff6501087d0 2024-09-10T23:16:38.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.611+0000 7ff654a00640 1 -- 172.21.15.3:0/2326610639 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6501031a0 con 0x7ff6501087d0 2024-09-10T23:16:38.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.611+0000 7ff646a00640 1 -- 172.21.15.3:0/2326610639 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 51496+0+0 (secure 0 0 0) 0x7ff63c009a30 con 0x7ff6501087d0 2024-09-10T23:16:38.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.611+0000 7ff646a00640 1 --2- 172.21.15.3:0/2326610639 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff63403f560 0x7ff634041a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:38.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.611+0000 7ff646a00640 1 -- 172.21.15.3:0/2326610639 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7ff63c053890 con 0x7ff6501087d0 2024-09-10T23:16:38.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.612+0000 7ff64de00640 1 --2- 172.21.15.3:0/2326610639 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff63403f560 0x7ff634041a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:38.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.612+0000 7ff64de00640 1 --2- 172.21.15.3:0/2326610639 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff63403f560 0x7ff634041a20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff640006010 tx=0x7ff640005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:38.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.616+0000 7ff646a00640 1 -- 172.21.15.3:0/2326610639 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff63c0041d0 con 0x7ff6501087d0 2024-09-10T23:16:38.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.818+0000 7ff654a00640 1 -- 172.21.15.3:0/2326610639 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7ff65002e5c0 con 0x7ff6501087d0 2024-09-10T23:16:38.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.822+0000 7ff646a00640 1 -- 172.21.15.3:0/2326610639 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v20)=0 v20) ==== 117+0+0 (secure 0 0 0) 0x7ff63c01ad10 con 0x7ff6501087d0 2024-09-10T23:16:38.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.824+0000 7ff654a00640 1 -- 172.21.15.3:0/2326610639 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff63403f560 msgr2=0x7ff634041a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:38.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.824+0000 7ff654a00640 1 --2- 172.21.15.3:0/2326610639 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff63403f560 0x7ff634041a20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff640006010 tx=0x7ff640005e80 comp rx=0 tx=0).stop 2024-09-10T23:16:38.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.825+0000 7ff654a00640 1 -- 172.21.15.3:0/2326610639 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff6501087d0 msgr2=0x7ff650199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:38.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.825+0000 7ff654a00640 1 --2- 172.21.15.3:0/2326610639 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff6501087d0 0x7ff650199740 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff63c00d950 tx=0x7ff63c00de10 comp rx=0 tx=0).stop 2024-09-10T23:16:38.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.825+0000 7ff654a00640 1 -- 172.21.15.3:0/2326610639 shutdown_connections 2024-09-10T23:16:38.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.825+0000 7ff654a00640 1 --2- 172.21.15.3:0/2326610639 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff650109150 0x7ff65019eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:38.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.825+0000 7ff654a00640 1 --2- 172.21.15.3:0/2326610639 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff63403f560 0x7ff634041a20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:38.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.825+0000 7ff654a00640 1 --2- 172.21.15.3:0/2326610639 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff6501087d0 0x7ff650199740 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:38.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.825+0000 7ff654a00640 1 --2- 172.21.15.3:0/2326610639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff650102dc0 0x7ff650199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:38.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.825+0000 7ff654a00640 1 -- 172.21.15.3:0/2326610639 >> 172.21.15.3:0/2326610639 conn(0x7ff6500fe830 msgr2=0x7ff6501000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:38.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.825+0000 7ff654a00640 1 -- 172.21.15.3:0/2326610639 shutdown_connections 2024-09-10T23:16:38.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:33.825+0000 7ff654a00640 1 -- 172.21.15.3:0/2326610639 wait complete. 2024-09-10T23:16:38.941 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:38 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:38.941 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:38 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:38.941 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:38 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:38.941 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:38 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:38.941 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:38 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:38.942 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:38 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:16:38.942 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:38 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:38.942 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:38 smithi003 ceph-mon[30348]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T23:16:38.942 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:38 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:16:38.942 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:38 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:16:38.942 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:38 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:16:38.942 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:38 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:38.942 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:38 smithi003 ceph-mon[30348]: Reconfiguring daemon mgr.x on smithi003 2024-09-10T23:16:38.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:38 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:38.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:38 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:38.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:38 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:38.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:38 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:38.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:38 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:38.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:38 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:16:38.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:38 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:38.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:38 smithi194 ceph-mon[33904]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T23:16:38.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:38 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:16:38.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:38 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:16:38.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:38 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:16:38.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:38 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:38.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:38 smithi194 ceph-mon[33904]: Reconfiguring daemon mgr.x on smithi003 2024-09-10T23:16:39.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:38 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:39.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:38 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:39.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:38 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:39.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:38 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:39.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:38 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:39.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:38 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:16:39.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:38 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:39.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:38 smithi038 ceph-mon[34225]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T23:16:39.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:38 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:16:39.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:38 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:16:39.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:38 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:16:39.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:38 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:39.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:38 smithi038 ceph-mon[34225]: Reconfiguring daemon mgr.x on smithi003 2024-09-10T23:16:39.687 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:39.688 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:39.688 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:39.690 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:39.691 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:39.693 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:39.714 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:39.717 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:39.746 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:39.754 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:39.759 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:39.776 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:39.902 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:39 smithi003 ceph-mon[30348]: Standby manager daemon z started 2024-09-10T23:16:39.902 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:39 smithi003 ceph-mon[30348]: from='mgr.? 172.21.15.194:0/1254534717' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-10T23:16:39.902 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:39 smithi003 ceph-mon[30348]: from='mgr.? 172.21.15.194:0/1254534717' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T23:16:39.902 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:39 smithi003 ceph-mon[30348]: from='mgr.? 172.21.15.194:0/1254534717' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-10T23:16:39.902 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:39 smithi003 ceph-mon[30348]: from='mgr.? 172.21.15.194:0/1254534717' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T23:16:39.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:39 smithi194 ceph-mon[33904]: Standby manager daemon z started 2024-09-10T23:16:39.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:39 smithi194 ceph-mon[33904]: from='mgr.? 172.21.15.194:0/1254534717' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-10T23:16:39.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:39 smithi194 ceph-mon[33904]: from='mgr.? 172.21.15.194:0/1254534717' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T23:16:39.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:39 smithi194 ceph-mon[33904]: from='mgr.? 172.21.15.194:0/1254534717' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-10T23:16:39.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:39 smithi194 ceph-mon[33904]: from='mgr.? 172.21.15.194:0/1254534717' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T23:16:40.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:39 smithi038 ceph-mon[34225]: Standby manager daemon z started 2024-09-10T23:16:40.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:39 smithi038 ceph-mon[34225]: from='mgr.? 172.21.15.194:0/1254534717' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-10T23:16:40.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:39 smithi038 ceph-mon[34225]: from='mgr.? 172.21.15.194:0/1254534717' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T23:16:40.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:39 smithi038 ceph-mon[34225]: from='mgr.? 172.21.15.194:0/1254534717' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-10T23:16:40.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:39 smithi038 ceph-mon[34225]: from='mgr.? 172.21.15.194:0/1254534717' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T23:16:40.355 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3f4e30d0-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi003') 2024-09-10T23:16:40.355 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3f4e30d0-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi003') 2024-09-10T23:16:40.356 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3f4e30d0-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi003') 2024-09-10T23:16:40.899 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:40 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-10T23:16:40.899 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:40 smithi003 ceph-mon[30348]: mgrmap e18: x(active, since 19s), standbys: z 2024-09-10T23:16:41.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:40 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-10T23:16:41.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:40 smithi038 ceph-mon[34225]: mgrmap e18: x(active, since 19s), standbys: z 2024-09-10T23:16:41.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:40 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-10T23:16:41.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:40 smithi194 ceph-mon[33904]: mgrmap e18: x(active, since 19s), standbys: z 2024-09-10T23:16:41.832 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:41 smithi003 ceph-mon[30348]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:41.832 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:41 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:41.832 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:41 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:41.833 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:41 smithi003 ceph-mon[30348]: Reconfiguring mon.c (monmap changed)... 2024-09-10T23:16:41.833 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:41 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:16:41.833 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:41 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:16:41.833 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:41 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:41.833 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:41 smithi003 ceph-mon[30348]: Reconfiguring daemon mon.c on smithi194 2024-09-10T23:16:41.833 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:41 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:41.833 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:41 smithi003 ceph-mon[30348]: from='client.? ' entity='client.admin' 2024-09-10T23:16:41.847 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:41 smithi194 ceph-mon[33904]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:41.847 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:41 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:41.847 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:41 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:41.848 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:41 smithi194 ceph-mon[33904]: Reconfiguring mon.c (monmap changed)... 2024-09-10T23:16:41.848 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:41 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:16:41.848 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:41 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:16:41.848 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:41 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:41.848 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:41 smithi194 ceph-mon[33904]: Reconfiguring daemon mon.c on smithi194 2024-09-10T23:16:41.848 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:41 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:41.848 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:41 smithi194 ceph-mon[33904]: from='client.? ' entity='client.admin' 2024-09-10T23:16:42.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:41 smithi038 ceph-mon[34225]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:42.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:41 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:42.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:41 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:42.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:41 smithi038 ceph-mon[34225]: Reconfiguring mon.c (monmap changed)... 2024-09-10T23:16:42.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:41 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:16:42.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:41 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:16:42.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:41 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:42.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:41 smithi038 ceph-mon[34225]: Reconfiguring daemon mon.c on smithi194 2024-09-10T23:16:42.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:41 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:42.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:41 smithi038 ceph-mon[34225]: from='client.? ' entity='client.admin' 2024-09-10T23:16:42.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.426+0000 7ffb67200640 1 -- 172.21.15.3:0/3464830783 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb60101a90 msgr2=0x7ffb60101e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:42.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.426+0000 7ffb67200640 1 --2- 172.21.15.3:0/3464830783 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb60101a90 0x7ffb60101e70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ffb50009900 tx=0x7ffb5002a410 comp rx=0 tx=0).stop 2024-09-10T23:16:42.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.426+0000 7ffb67200640 1 -- 172.21.15.3:0/3464830783 shutdown_connections 2024-09-10T23:16:42.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.426+0000 7ffb67200640 1 --2- 172.21.15.3:0/3464830783 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb60106ed0 0x7ffb60107320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.426+0000 7ffb67200640 1 --2- 172.21.15.3:0/3464830783 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb601023b0 0x7ffb60106880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.426+0000 7ffb67200640 1 --2- 172.21.15.3:0/3464830783 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb60101a90 0x7ffb60101e70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.426+0000 7ffb67200640 1 -- 172.21.15.3:0/3464830783 >> 172.21.15.3:0/3464830783 conn(0x7ffb600fd700 msgr2=0x7ffb600ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:42.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.427+0000 7ffb67200640 1 -- 172.21.15.3:0/3464830783 shutdown_connections 2024-09-10T23:16:42.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.427+0000 7ffb67200640 1 -- 172.21.15.3:0/3464830783 wait complete. 2024-09-10T23:16:42.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.427+0000 7ffb67200640 1 Processor -- start 2024-09-10T23:16:42.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.428+0000 7ffb67200640 1 -- start start 2024-09-10T23:16:42.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.428+0000 7ffb67200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb60101a90 0x7ffb6019f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:42.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.428+0000 7ffb67200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb601023b0 0x7ffb6019fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:42.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.428+0000 7ffb67200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb60106ed0 0x7ffb601a50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:42.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.428+0000 7ffb67200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ffb60119260 con 0x7ffb60106ed0 2024-09-10T23:16:42.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.428+0000 7ffb67200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ffb601190e0 con 0x7ffb60101a90 2024-09-10T23:16:42.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.428+0000 7ffb67200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ffb601193e0 con 0x7ffb601023b0 2024-09-10T23:16:42.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.428+0000 7ffb5fe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb60101a90 0x7ffb6019f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:42.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.428+0000 7ffb5fe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb60101a90 0x7ffb6019f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.3:43990/0 (socket says 172.21.15.3:43990) 2024-09-10T23:16:42.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.428+0000 7ffb5fe00640 1 -- 172.21.15.3:0/3497764709 learned_addr learned my addr 172.21.15.3:0/3497764709 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:16:42.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.428+0000 7ffb57e00640 1 --2- 172.21.15.3:0/3497764709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb601023b0 0x7ffb6019fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:42.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.428+0000 7ffb65200640 1 --2- 172.21.15.3:0/3497764709 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb60106ed0 0x7ffb601a50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:42.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.429+0000 7ffb5fe00640 1 -- 172.21.15.3:0/3497764709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb601023b0 msgr2=0x7ffb6019fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:42.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.429+0000 7ffb5fe00640 1 --2- 172.21.15.3:0/3497764709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb601023b0 0x7ffb6019fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.429+0000 7ffb5fe00640 1 -- 172.21.15.3:0/3497764709 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb60106ed0 msgr2=0x7ffb601a50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:42.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.429+0000 7ffb5fe00640 1 --2- 172.21.15.3:0/3497764709 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb60106ed0 0x7ffb601a50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.429+0000 7ffb5fe00640 1 -- 172.21.15.3:0/3497764709 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb601a5880 con 0x7ffb60101a90 2024-09-10T23:16:42.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.429+0000 7ffb5fe00640 1 --2- 172.21.15.3:0/3497764709 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb60101a90 0x7ffb6019f7d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ffb5002a930 tx=0x7ffb50003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:42.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.429+0000 7ffb5d600640 1 -- 172.21.15.3:0/3497764709 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5003f070 con 0x7ffb60101a90 2024-09-10T23:16:42.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.429+0000 7ffb5d600640 1 -- 172.21.15.3:0/3497764709 <== mon.2 v2:172.21.15.38:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffb5003baf0 con 0x7ffb60101a90 2024-09-10T23:16:42.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.429+0000 7ffb5d600640 1 -- 172.21.15.3:0/3497764709 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb50035030 con 0x7ffb60101a90 2024-09-10T23:16:42.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.429+0000 7ffb67200640 1 -- 172.21.15.3:0/3497764709 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb601a5b10 con 0x7ffb60101a90 2024-09-10T23:16:42.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.429+0000 7ffb67200640 1 -- 172.21.15.3:0/3497764709 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb601ac230 con 0x7ffb60101a90 2024-09-10T23:16:42.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.431+0000 7ffb67200640 1 -- 172.21.15.3:0/3497764709 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb60106880 con 0x7ffb60101a90 2024-09-10T23:16:42.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.431+0000 7ffb5d600640 1 -- 172.21.15.3:0/3497764709 <== mon.2 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 102353+0+0 (secure 0 0 0) 0x7ffb5003b660 con 0x7ffb60101a90 2024-09-10T23:16:42.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.432+0000 7ffb5d600640 1 --2- 172.21.15.3:0/3497764709 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ffb4407a400 0x7ffb4407c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:42.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.433+0000 7ffb5d600640 1 -- 172.21.15.3:0/3497764709 <== mon.2 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7ffb500bc960 con 0x7ffb60101a90 2024-09-10T23:16:42.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.433+0000 7ffb57e00640 1 --2- 172.21.15.3:0/3497764709 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ffb4407a400 0x7ffb4407c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:42.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.433+0000 7ffb57e00640 1 --2- 172.21.15.3:0/3497764709 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ffb4407a400 0x7ffb4407c8c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffb480095f0 tx=0x7ffb48005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:42.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.437+0000 7ffb5d600640 1 -- 172.21.15.3:0/3497764709 <== mon.2 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ffb50084e50 con 0x7ffb60101a90 2024-09-10T23:16:42.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.642+0000 7ffb67200640 1 -- 172.21.15.3:0/3497764709 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7ffb601ac520 con 0x7ffb60101a90 2024-09-10T23:16:42.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.648+0000 7ffb5d600640 1 -- 172.21.15.3:0/3497764709 <== mon.2 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v24)=0 v24) ==== 120+0+0 (secure 0 0 0) 0x7ffb50089880 con 0x7ffb60101a90 2024-09-10T23:16:42.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.650+0000 7ffb67200640 1 -- 172.21.15.3:0/3497764709 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ffb4407a400 msgr2=0x7ffb4407c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:42.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.650+0000 7ffb67200640 1 --2- 172.21.15.3:0/3497764709 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ffb4407a400 0x7ffb4407c8c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffb480095f0 tx=0x7ffb48005f90 comp rx=0 tx=0).stop 2024-09-10T23:16:42.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.650+0000 7ffb67200640 1 -- 172.21.15.3:0/3497764709 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb60101a90 msgr2=0x7ffb6019f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:42.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.650+0000 7ffb67200640 1 --2- 172.21.15.3:0/3497764709 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb60101a90 0x7ffb6019f7d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ffb5002a930 tx=0x7ffb50003b90 comp rx=0 tx=0).stop 2024-09-10T23:16:42.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.651+0000 7ffb67200640 1 -- 172.21.15.3:0/3497764709 shutdown_connections 2024-09-10T23:16:42.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.651+0000 7ffb67200640 1 --2- 172.21.15.3:0/3497764709 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ffb4407a400 0x7ffb4407c8c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.651+0000 7ffb67200640 1 --2- 172.21.15.3:0/3497764709 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb60106ed0 0x7ffb601a50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.651+0000 7ffb67200640 1 --2- 172.21.15.3:0/3497764709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb601023b0 0x7ffb6019fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.651+0000 7ffb67200640 1 --2- 172.21.15.3:0/3497764709 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb60101a90 0x7ffb6019f7d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.651+0000 7ffb67200640 1 -- 172.21.15.3:0/3497764709 >> 172.21.15.3:0/3497764709 conn(0x7ffb600fd700 msgr2=0x7ffb60104800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:42.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.651+0000 7ffb67200640 1 -- 172.21.15.3:0/3497764709 shutdown_connections 2024-09-10T23:16:42.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:41.651+0000 7ffb67200640 1 -- 172.21.15.3:0/3497764709 wait complete. 2024-09-10T23:16:42.963 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:42 smithi003 ceph-mon[30348]: Standby manager daemon y started 2024-09-10T23:16:42.963 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:42 smithi003 ceph-mon[30348]: from='mgr.? 172.21.15.38:0/4073666367' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-10T23:16:42.963 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:42 smithi003 ceph-mon[30348]: from='mgr.? 172.21.15.38:0/4073666367' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T23:16:42.963 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:42 smithi003 ceph-mon[30348]: from='mgr.? 172.21.15.38:0/4073666367' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-10T23:16:42.963 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:42 smithi003 ceph-mon[30348]: from='mgr.? 172.21.15.38:0/4073666367' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T23:16:42.963 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:42 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:42.963 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:42 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:42.963 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:42 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:16:42.963 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:42 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:42.963 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:42 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:16:42.963 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:42 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:43.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:42 smithi038 ceph-mon[34225]: Standby manager daemon y started 2024-09-10T23:16:43.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:42 smithi038 ceph-mon[34225]: from='mgr.? 172.21.15.38:0/4073666367' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-10T23:16:43.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:42 smithi038 ceph-mon[34225]: from='mgr.? 172.21.15.38:0/4073666367' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T23:16:43.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:42 smithi038 ceph-mon[34225]: from='mgr.? 172.21.15.38:0/4073666367' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-10T23:16:43.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:42 smithi038 ceph-mon[34225]: from='mgr.? 172.21.15.38:0/4073666367' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T23:16:43.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:42 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:43.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:42 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:43.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:42 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:16:43.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:42 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:43.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:42 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:16:43.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:42 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:43.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:42 smithi194 ceph-mon[33904]: Standby manager daemon y started 2024-09-10T23:16:43.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:42 smithi194 ceph-mon[33904]: from='mgr.? 172.21.15.38:0/4073666367' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-10T23:16:43.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:42 smithi194 ceph-mon[33904]: from='mgr.? 172.21.15.38:0/4073666367' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T23:16:43.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:42 smithi194 ceph-mon[33904]: from='mgr.? 172.21.15.38:0/4073666367' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-10T23:16:43.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:42 smithi194 ceph-mon[33904]: from='mgr.? 172.21.15.38:0/4073666367' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T23:16:43.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:42 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:43.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:42 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:43.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:42 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:16:43.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:42 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:43.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:42 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:16:43.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:42 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:43.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.646+0000 7f166e200640 1 -- 172.21.15.3:0/2832054190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1668075540 msgr2=0x7f1668075920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:43.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.646+0000 7f166e200640 1 --2- 172.21.15.3:0/2832054190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1668075540 0x7f1668075920 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1658009860 tx=0x7f165802a340 comp rx=0 tx=0).stop 2024-09-10T23:16:43.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.646+0000 7f166e200640 1 -- 172.21.15.3:0/2832054190 shutdown_connections 2024-09-10T23:16:43.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.646+0000 7f166e200640 1 --2- 172.21.15.3:0/2832054190 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f166810f3c0 0x7f16681117b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:43.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.646+0000 7f166e200640 1 --2- 172.21.15.3:0/2832054190 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1668075f40 0x7f166810edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:43.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.646+0000 7f166e200640 1 --2- 172.21.15.3:0/2832054190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1668075540 0x7f1668075920 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:43.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.646+0000 7f166e200640 1 -- 172.21.15.3:0/2832054190 >> 172.21.15.3:0/2832054190 conn(0x7f16680fe810 msgr2=0x7f1668100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:43.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.646+0000 7f166e200640 1 -- 172.21.15.3:0/2832054190 shutdown_connections 2024-09-10T23:16:43.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.647+0000 7f166e200640 1 -- 172.21.15.3:0/2832054190 wait complete. 2024-09-10T23:16:43.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.648+0000 7f166e200640 1 Processor -- start 2024-09-10T23:16:43.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.648+0000 7f166e200640 1 -- start start 2024-09-10T23:16:43.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.649+0000 7f166e200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1668075540 0x7f166819b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:43.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.649+0000 7f166e200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1668075f40 0x7f166819b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:43.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.649+0000 7f166e200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f166810f3c0 0x7f16681a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:43.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.649+0000 7f166e200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1668114e00 con 0x7f1668075f40 2024-09-10T23:16:43.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.649+0000 7f166e200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f1668114c80 con 0x7f1668075540 2024-09-10T23:16:43.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.649+0000 7f166e200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1668114f80 con 0x7f166810f3c0 2024-09-10T23:16:43.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.649+0000 7f1667400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1668075540 0x7f166819b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:43.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.649+0000 7f165ea00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1668075f40 0x7f166819b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:43.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.649+0000 7f1667400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1668075540 0x7f166819b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.3:44022/0 (socket says 172.21.15.3:44022) 2024-09-10T23:16:43.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.649+0000 7f1667400640 1 -- 172.21.15.3:0/2023625656 learned_addr learned my addr 172.21.15.3:0/2023625656 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:16:43.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.649+0000 7f1667400640 1 -- 172.21.15.3:0/2023625656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f166810f3c0 msgr2=0x7f16681a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:43.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.649+0000 7f1667400640 1 --2- 172.21.15.3:0/2023625656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f166810f3c0 0x7f16681a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:43.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.649+0000 7f1667400640 1 -- 172.21.15.3:0/2023625656 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1668075f40 msgr2=0x7f166819b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:43.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.649+0000 7f1667400640 1 --2- 172.21.15.3:0/2023625656 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1668075f40 0x7f166819b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:43.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.649+0000 7f1667400640 1 -- 172.21.15.3:0/2023625656 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16681a14c0 con 0x7f1668075540 2024-09-10T23:16:43.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.650+0000 7f1667400640 1 --2- 172.21.15.3:0/2023625656 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1668075540 0x7f166819b410 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f16580057c0 tx=0x7f165802ae60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:43.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.650+0000 7f1664c00640 1 -- 172.21.15.3:0/2023625656 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1658037040 con 0x7f1668075540 2024-09-10T23:16:43.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.650+0000 7f1664c00640 1 -- 172.21.15.3:0/2023625656 <== mon.2 v2:172.21.15.38:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1658030c70 con 0x7f1668075540 2024-09-10T23:16:43.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.650+0000 7f1664c00640 1 -- 172.21.15.3:0/2023625656 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16580035f0 con 0x7f1668075540 2024-09-10T23:16:43.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.650+0000 7f166e200640 1 -- 172.21.15.3:0/2023625656 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16681a1750 con 0x7f1668075540 2024-09-10T23:16:43.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.650+0000 7f166e200640 1 -- 172.21.15.3:0/2023625656 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16681a7e70 con 0x7f1668075540 2024-09-10T23:16:43.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.652+0000 7f166e200640 1 -- 172.21.15.3:0/2023625656 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1668076a50 con 0x7f1668075540 2024-09-10T23:16:43.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.653+0000 7f1664c00640 1 -- 172.21.15.3:0/2023625656 <== mon.2 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 102353+0+0 (secure 0 0 0) 0x7f1658004050 con 0x7f1668075540 2024-09-10T23:16:43.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.654+0000 7f1664c00640 1 --2- 172.21.15.3:0/2023625656 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f164c07a400 0x7f164c07c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:43.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.655+0000 7f1664c00640 1 -- 172.21.15.3:0/2023625656 <== mon.2 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f16580bb3d0 con 0x7f1668075540 2024-09-10T23:16:43.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.655+0000 7f165ea00640 1 --2- 172.21.15.3:0/2023625656 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f164c07a400 0x7f164c07c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:43.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.656+0000 7f165ea00640 1 --2- 172.21.15.3:0/2023625656 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f164c07a400 0x7f164c07c8c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1668111af0 tx=0x7f1650009260 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:43.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.659+0000 7f1664c00640 1 -- 172.21.15.3:0/2023625656 <== mon.2 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f165804a060 con 0x7f1668075540 2024-09-10T23:16:43.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.743+0000 7f1664c00640 1 -- 172.21.15.3:0/2023625656 <== mon.2 v2:172.21.15.38:3300/0 7 ==== mgrmap(e 19) ==== 153210+0+0 (secure 0 0 0) 0x7f165807fb00 con 0x7f1668075540 2024-09-10T23:16:43.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.894+0000 7f166e200640 1 -- 172.21.15.3:0/2023625656 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) -- 0x7f1668075920 con 0x7f1668075540 2024-09-10T23:16:43.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.903+0000 7f1664c00640 1 -- 172.21.15.3:0/2023625656 <== mon.2 v2:172.21.15.38:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v26)=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7f1658004370 con 0x7f1668075540 2024-09-10T23:16:43.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.906+0000 7f166e200640 1 -- 172.21.15.3:0/2023625656 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f164c07a400 msgr2=0x7f164c07c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:43.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.906+0000 7f166e200640 1 --2- 172.21.15.3:0/2023625656 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f164c07a400 0x7f164c07c8c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1668111af0 tx=0x7f1650009260 comp rx=0 tx=0).stop 2024-09-10T23:16:43.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.906+0000 7f166e200640 1 -- 172.21.15.3:0/2023625656 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1668075540 msgr2=0x7f166819b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:43.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.906+0000 7f166e200640 1 --2- 172.21.15.3:0/2023625656 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1668075540 0x7f166819b410 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f16580057c0 tx=0x7f165802ae60 comp rx=0 tx=0).stop 2024-09-10T23:16:43.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.906+0000 7f166e200640 1 -- 172.21.15.3:0/2023625656 shutdown_connections 2024-09-10T23:16:43.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.906+0000 7f166e200640 1 --2- 172.21.15.3:0/2023625656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f166810f3c0 0x7f16681a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:43.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.906+0000 7f166e200640 1 --2- 172.21.15.3:0/2023625656 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f164c07a400 0x7f164c07c8c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:43.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.906+0000 7f166e200640 1 --2- 172.21.15.3:0/2023625656 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1668075f40 0x7f166819b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:43.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.906+0000 7f166e200640 1 --2- 172.21.15.3:0/2023625656 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1668075540 0x7f166819b410 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:43.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.906+0000 7f166e200640 1 -- 172.21.15.3:0/2023625656 >> 172.21.15.3:0/2023625656 conn(0x7f16680fe810 msgr2=0x7f16680ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:43.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.906+0000 7f166e200640 1 -- 172.21.15.3:0/2023625656 shutdown_connections 2024-09-10T23:16:43.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.906+0000 7f166e200640 1 -- 172.21.15.3:0/2023625656 wait complete. 2024-09-10T23:16:43.890 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:43 smithi003 ceph-mon[30348]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:43.890 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:43 smithi003 ceph-mon[30348]: mgrmap e19: x(active, since 22s), standbys: z, y 2024-09-10T23:16:43.890 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:43 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-10T23:16:43.890 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:43 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/903747466' entity='client.admin' 2024-09-10T23:16:43.890 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:43 smithi003 ceph-mon[30348]: from='client.? ' entity='client.admin' 2024-09-10T23:16:43.890 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:43 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:16:43.890 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:43 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:43.890 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:43 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:16:43.891 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:43 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:43.891 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:43 smithi003 ceph-mon[30348]: from='client.? ' entity='client.admin' 2024-09-10T23:16:44.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:43 smithi038 ceph-mon[34225]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:44.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:43 smithi038 ceph-mon[34225]: mgrmap e19: x(active, since 22s), standbys: z, y 2024-09-10T23:16:44.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:43 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-10T23:16:44.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:43 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/903747466' entity='client.admin' 2024-09-10T23:16:44.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:43 smithi038 ceph-mon[34225]: from='client.? ' entity='client.admin' 2024-09-10T23:16:44.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:43 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:16:44.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:43 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:44.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:43 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:16:44.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:43 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:44.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:43 smithi038 ceph-mon[34225]: from='client.? ' entity='client.admin' 2024-09-10T23:16:44.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:43 smithi194 ceph-mon[33904]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:44.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:43 smithi194 ceph-mon[33904]: mgrmap e19: x(active, since 22s), standbys: z, y 2024-09-10T23:16:44.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:43 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-10T23:16:44.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:43 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/903747466' entity='client.admin' 2024-09-10T23:16:44.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:43 smithi194 ceph-mon[33904]: from='client.? ' entity='client.admin' 2024-09-10T23:16:44.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:43 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:16:44.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:43 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:44.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:43 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:16:44.199 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:43 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:44.199 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:43 smithi194 ceph-mon[33904]: from='client.? ' entity='client.admin' 2024-09-10T23:16:44.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.961+0000 7fb539200640 1 -- 172.21.15.3:0/533147547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb53410f3e0 msgr2=0x7fb5341117d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:44.201 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.961+0000 7fb539200640 1 --2- 172.21.15.3:0/533147547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb53410f3e0 0x7fb5341117d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb52c009be0 tx=0x7fb52c02a6c0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.201 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.961+0000 7fb539200640 1 -- 172.21.15.3:0/533147547 shutdown_connections 2024-09-10T23:16:44.201 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.961+0000 7fb539200640 1 --2- 172.21.15.3:0/533147547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb53410f3e0 0x7fb5341117d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.201 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.961+0000 7fb539200640 1 --2- 172.21.15.3:0/533147547 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb534075f40 0x7fb53410ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.201 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.961+0000 7fb539200640 1 --2- 172.21.15.3:0/533147547 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb534075540 0x7fb534075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.201 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.961+0000 7fb539200640 1 -- 172.21.15.3:0/533147547 >> 172.21.15.3:0/533147547 conn(0x7fb5340fe830 msgr2=0x7fb534100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:44.201 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.961+0000 7fb539200640 1 -- 172.21.15.3:0/533147547 shutdown_connections 2024-09-10T23:16:44.201 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.961+0000 7fb539200640 1 -- 172.21.15.3:0/533147547 wait complete. 2024-09-10T23:16:44.201 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.963+0000 7fb539200640 1 Processor -- start 2024-09-10T23:16:44.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.963+0000 7fb539200640 1 -- start start 2024-09-10T23:16:44.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.963+0000 7fb539200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb534075540 0x7fb53410ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:44.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.963+0000 7fb539200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb534075f40 0x7fb53410be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:44.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.963+0000 7fb539200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb53410f3e0 0x7fb53410c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:44.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.963+0000 7fb539200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb534114e30 con 0x7fb534075f40 2024-09-10T23:16:44.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.963+0000 7fb539200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb534114cb0 con 0x7fb53410f3e0 2024-09-10T23:16:44.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.963+0000 7fb539200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb534114fb0 con 0x7fb534075540 2024-09-10T23:16:44.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.964+0000 7fb531400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb534075f40 0x7fb53410be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:44.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.964+0000 7fb531400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb534075f40 0x7fb53410be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34750/0 (socket says 172.21.15.3:34750) 2024-09-10T23:16:44.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.964+0000 7fb531400640 1 -- 172.21.15.3:0/2685213584 learned_addr learned my addr 172.21.15.3:0/2685213584 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:16:44.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.964+0000 7fb531e00640 1 --2- 172.21.15.3:0/2685213584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb534075540 0x7fb53410ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:44.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.964+0000 7fb532800640 1 --2- 172.21.15.3:0/2685213584 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb53410f3e0 0x7fb53410c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:44.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.964+0000 7fb531e00640 1 -- 172.21.15.3:0/2685213584 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb53410f3e0 msgr2=0x7fb53410c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:44.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.964+0000 7fb531e00640 1 --2- 172.21.15.3:0/2685213584 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb53410f3e0 0x7fb53410c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.964+0000 7fb531e00640 1 -- 172.21.15.3:0/2685213584 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb534075f40 msgr2=0x7fb53410be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:44.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.964+0000 7fb531e00640 1 --2- 172.21.15.3:0/2685213584 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb534075f40 0x7fb53410be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.964+0000 7fb531e00640 1 -- 172.21.15.3:0/2685213584 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5341abb70 con 0x7fb534075540 2024-09-10T23:16:44.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.964+0000 7fb531400640 1 --2- 172.21.15.3:0/2685213584 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb534075f40 0x7fb53410be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:16:44.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.965+0000 7fb531e00640 1 --2- 172.21.15.3:0/2685213584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb534075540 0x7fb53410ebe0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb524005fd0 tx=0x7fb52400ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:44.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.965+0000 7fb52aa00640 1 -- 172.21.15.3:0/2685213584 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb52400cd00 con 0x7fb534075540 2024-09-10T23:16:44.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.965+0000 7fb52aa00640 1 -- 172.21.15.3:0/2685213584 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5240035f0 con 0x7fb534075540 2024-09-10T23:16:44.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.965+0000 7fb52aa00640 1 -- 172.21.15.3:0/2685213584 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb524010690 con 0x7fb534075540 2024-09-10T23:16:44.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.965+0000 7fb539200640 1 -- 172.21.15.3:0/2685213584 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5341abd40 con 0x7fb534075540 2024-09-10T23:16:44.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.965+0000 7fb539200640 1 -- 172.21.15.3:0/2685213584 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5341ac1a0 con 0x7fb534075540 2024-09-10T23:16:44.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.967+0000 7fb539200640 1 -- 172.21.15.3:0/2685213584 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb534075920 con 0x7fb534075540 2024-09-10T23:16:44.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.970+0000 7fb52aa00640 1 -- 172.21.15.3:0/2685213584 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 19) ==== 153210+0+0 (secure 0 0 0) 0x7fb524003a80 con 0x7fb534075540 2024-09-10T23:16:44.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.971+0000 7fb52aa00640 1 --2- 172.21.15.3:0/2685213584 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb5180b5320 0x7fb5180b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:44.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.971+0000 7fb52aa00640 1 -- 172.21.15.3:0/2685213584 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fb5240e41f0 con 0x7fb534075540 2024-09-10T23:16:44.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.972+0000 7fb531400640 1 --2- 172.21.15.3:0/2685213584 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb5180b5320 0x7fb5180b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:44.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.972+0000 7fb531400640 1 --2- 172.21.15.3:0/2685213584 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb5180b5320 0x7fb5180b77e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb53410e930 tx=0x7fb520005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:44.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.975+0000 7fb52aa00640 1 -- 172.21.15.3:0/2685213584 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb524009510 con 0x7fb534075540 2024-09-10T23:16:44.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.180+0000 7fb539200640 1 -- 172.21.15.3:0/2685213584 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7fb534105b30 con 0x7fb534075540 2024-09-10T23:16:44.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.186+0000 7fb52aa00640 1 -- 172.21.15.3:0/2685213584 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v27)=0 v27) ==== 121+0+0 (secure 0 0 0) 0x7fb5240acc10 con 0x7fb534075540 2024-09-10T23:16:44.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.189+0000 7fb539200640 1 -- 172.21.15.3:0/2685213584 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb5180b5320 msgr2=0x7fb5180b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:44.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.189+0000 7fb539200640 1 --2- 172.21.15.3:0/2685213584 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb5180b5320 0x7fb5180b77e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb53410e930 tx=0x7fb520005f90 comp rx=0 tx=0).stop 2024-09-10T23:16:44.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.189+0000 7fb539200640 1 -- 172.21.15.3:0/2685213584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb534075540 msgr2=0x7fb53410ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:44.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.189+0000 7fb539200640 1 --2- 172.21.15.3:0/2685213584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb534075540 0x7fb53410ebe0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb524005fd0 tx=0x7fb52400ee50 comp rx=0 tx=0).stop 2024-09-10T23:16:44.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.189+0000 7fb539200640 1 -- 172.21.15.3:0/2685213584 shutdown_connections 2024-09-10T23:16:44.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.189+0000 7fb539200640 1 --2- 172.21.15.3:0/2685213584 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb53410f3e0 0x7fb53410c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.189+0000 7fb539200640 1 --2- 172.21.15.3:0/2685213584 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb5180b5320 0x7fb5180b77e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.189+0000 7fb539200640 1 --2- 172.21.15.3:0/2685213584 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb534075f40 0x7fb53410be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.189+0000 7fb539200640 1 --2- 172.21.15.3:0/2685213584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb534075540 0x7fb53410ebe0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.189+0000 7fb539200640 1 -- 172.21.15.3:0/2685213584 >> 172.21.15.3:0/2685213584 conn(0x7fb5340fe830 msgr2=0x7fb5340ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:44.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.189+0000 7fb539200640 1 -- 172.21.15.3:0/2685213584 shutdown_connections 2024-09-10T23:16:44.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.189+0000 7fb539200640 1 -- 172.21.15.3:0/2685213584 wait complete. 2024-09-10T23:16:44.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.572+0000 7f1bae000640 1 -- 172.21.15.3:0/4278594327 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ba810f390 msgr2=0x7f1ba8111780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:44.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.572+0000 7f1bae000640 1 --2- 172.21.15.3:0/4278594327 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ba810f390 0x7f1ba8111780 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0009ca0 tx=0x7f1ba002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.572+0000 7f1bae000640 1 -- 172.21.15.3:0/4278594327 shutdown_connections 2024-09-10T23:16:44.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.572+0000 7f1bae000640 1 --2- 172.21.15.3:0/4278594327 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ba810f390 0x7f1ba8111780 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.572+0000 7f1bae000640 1 --2- 172.21.15.3:0/4278594327 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ba8075e00 0x7f1ba810ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.572+0000 7f1bae000640 1 --2- 172.21.15.3:0/4278594327 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ba80754e0 0x7f1ba80758c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.572+0000 7f1bae000640 1 -- 172.21.15.3:0/4278594327 >> 172.21.15.3:0/4278594327 conn(0x7f1ba80fe810 msgr2=0x7f1ba8100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:44.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.572+0000 7f1bae000640 1 -- 172.21.15.3:0/4278594327 shutdown_connections 2024-09-10T23:16:44.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.572+0000 7f1bae000640 1 -- 172.21.15.3:0/4278594327 wait complete. 2024-09-10T23:16:44.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.573+0000 7f1bae000640 1 Processor -- start 2024-09-10T23:16:44.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.573+0000 7f1bae000640 1 -- start start 2024-09-10T23:16:44.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.574+0000 7f1bae000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ba80754e0 0x7f1ba819b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:44.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.574+0000 7f1bae000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ba8075e00 0x7f1ba819b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:44.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.574+0000 7f1bae000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ba810f390 0x7f1ba81a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:44.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.574+0000 7f1bae000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1ba8114e50 con 0x7f1ba8075e00 2024-09-10T23:16:44.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.574+0000 7f1bae000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f1ba8114cd0 con 0x7f1ba80754e0 2024-09-10T23:16:44.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.574+0000 7f1bae000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1ba8114fd0 con 0x7f1ba810f390 2024-09-10T23:16:44.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.574+0000 7f1ba6a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ba8075e00 0x7f1ba819b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:44.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.574+0000 7f1ba6a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ba8075e00 0x7f1ba819b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34804/0 (socket says 172.21.15.3:34804) 2024-09-10T23:16:44.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.574+0000 7f1ba6a00640 1 -- 172.21.15.3:0/4023952125 learned_addr learned my addr 172.21.15.3:0/4023952125 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:16:44.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.574+0000 7f1ba7400640 1 --2- 172.21.15.3:0/4023952125 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ba80754e0 0x7f1ba819b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:44.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.574+0000 7f1ba7e00640 1 --2- 172.21.15.3:0/4023952125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ba810f390 0x7f1ba81a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:44.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.574+0000 7f1ba6a00640 1 -- 172.21.15.3:0/4023952125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ba810f390 msgr2=0x7f1ba81a0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:44.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.574+0000 7f1ba6a00640 1 --2- 172.21.15.3:0/4023952125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ba810f390 0x7f1ba81a0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.574+0000 7f1ba6a00640 1 -- 172.21.15.3:0/4023952125 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ba80754e0 msgr2=0x7f1ba819b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:44.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.574+0000 7f1ba6a00640 1 --2- 172.21.15.3:0/4023952125 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ba80754e0 0x7f1ba819b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.575+0000 7f1ba6a00640 1 -- 172.21.15.3:0/4023952125 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ba81a1410 con 0x7f1ba8075e00 2024-09-10T23:16:44.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.575+0000 7f1ba6a00640 1 --2- 172.21.15.3:0/4023952125 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ba8075e00 0x7f1ba819b8a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1b9400d950 tx=0x7f1b9400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:44.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.575+0000 7f1b9fe00640 1 -- 172.21.15.3:0/4023952125 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b94017030 con 0x7f1ba8075e00 2024-09-10T23:16:44.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.575+0000 7f1b9fe00640 1 -- 172.21.15.3:0/4023952125 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b94004020 con 0x7f1ba8075e00 2024-09-10T23:16:44.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.575+0000 7f1bae000640 1 -- 172.21.15.3:0/4023952125 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ba81a1700 con 0x7f1ba8075e00 2024-09-10T23:16:44.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.575+0000 7f1b9fe00640 1 -- 172.21.15.3:0/4023952125 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b940055d0 con 0x7f1ba8075e00 2024-09-10T23:16:44.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.575+0000 7f1bae000640 1 -- 172.21.15.3:0/4023952125 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ba81a7dc0 con 0x7f1ba8075e00 2024-09-10T23:16:44.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.576+0000 7f1bae000640 1 -- 172.21.15.3:0/4023952125 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ba80758c0 con 0x7f1ba8075e00 2024-09-10T23:16:44.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.579+0000 7f1b9fe00640 1 -- 172.21.15.3:0/4023952125 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 153210+0+0 (secure 0 0 0) 0x7f1b94009a30 con 0x7f1ba8075e00 2024-09-10T23:16:44.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.580+0000 7f1b9fe00640 1 --2- 172.21.15.3:0/4023952125 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f1b8c0b5320 0x7f1b8c0b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:44.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.580+0000 7f1b9fe00640 1 -- 172.21.15.3:0/4023952125 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f1b940e3aa0 con 0x7f1ba8075e00 2024-09-10T23:16:44.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.580+0000 7f1ba7400640 1 --2- 172.21.15.3:0/4023952125 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f1b8c0b5320 0x7f1b8c0b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:44.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.581+0000 7f1ba7400640 1 --2- 172.21.15.3:0/4023952125 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f1b8c0b5320 0x7f1b8c0b77e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1b98005fd0 tx=0x7f1b9800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:44.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.584+0000 7f1b9fe00640 1 -- 172.21.15.3:0/4023952125 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1b940ac4c0 con 0x7f1ba8075e00 2024-09-10T23:16:44.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.784+0000 7f1bae000640 1 -- 172.21.15.3:0/4023952125 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f1ba81a8190 con 0x7f1ba8075e00 2024-09-10T23:16:44.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.789+0000 7f1b9fe00640 1 -- 172.21.15.3:0/4023952125 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v30)=0 v30) ==== 106+0+0 (secure 0 0 0) 0x7f1b940abdc0 con 0x7f1ba8075e00 2024-09-10T23:16:44.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.791+0000 7f1bae000640 1 -- 172.21.15.3:0/4023952125 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f1b8c0b5320 msgr2=0x7f1b8c0b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:44.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.791+0000 7f1bae000640 1 --2- 172.21.15.3:0/4023952125 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f1b8c0b5320 0x7f1b8c0b77e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1b98005fd0 tx=0x7f1b9800b390 comp rx=0 tx=0).stop 2024-09-10T23:16:44.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.791+0000 7f1bae000640 1 -- 172.21.15.3:0/4023952125 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ba8075e00 msgr2=0x7f1ba819b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:44.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.791+0000 7f1bae000640 1 --2- 172.21.15.3:0/4023952125 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ba8075e00 0x7f1ba819b8a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1b9400d950 tx=0x7f1b9400de10 comp rx=0 tx=0).stop 2024-09-10T23:16:44.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.791+0000 7f1bae000640 1 -- 172.21.15.3:0/4023952125 shutdown_connections 2024-09-10T23:16:44.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.791+0000 7f1bae000640 1 --2- 172.21.15.3:0/4023952125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ba810f390 0x7f1ba81a0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.791+0000 7f1bae000640 1 --2- 172.21.15.3:0/4023952125 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f1b8c0b5320 0x7f1b8c0b77e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.791+0000 7f1bae000640 1 --2- 172.21.15.3:0/4023952125 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ba8075e00 0x7f1ba819b8a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.791+0000 7f1bae000640 1 --2- 172.21.15.3:0/4023952125 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ba80754e0 0x7f1ba819b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.791+0000 7f1bae000640 1 -- 172.21.15.3:0/4023952125 >> 172.21.15.3:0/4023952125 conn(0x7f1ba80fe810 msgr2=0x7f1ba8111560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:44.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.792+0000 7f1bae000640 1 -- 172.21.15.3:0/4023952125 shutdown_connections 2024-09-10T23:16:44.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.792+0000 7f1bae000640 1 -- 172.21.15.3:0/4023952125 wait complete. 2024-09-10T23:16:45.072 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:44 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1060093822' entity='client.admin' 2024-09-10T23:16:45.072 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:44 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/420577111' entity='client.admin' 2024-09-10T23:16:45.072 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:44 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/4023952125' entity='client.admin' 2024-09-10T23:16:45.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:44 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/1060093822' entity='client.admin' 2024-09-10T23:16:45.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:44 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/420577111' entity='client.admin' 2024-09-10T23:16:45.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:44 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/4023952125' entity='client.admin' 2024-09-10T23:16:45.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.295+0000 7f6b1b200640 1 -- 172.21.15.3:0/3876933389 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b141087d0 msgr2=0x7f6b14108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:45.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.295+0000 7f6b1b200640 1 --2- 172.21.15.3:0/3876933389 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b141087d0 0x7f6b14108c10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6afc009900 tx=0x7f6afc02a3f0 comp rx=0 tx=0).stop 2024-09-10T23:16:45.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.295+0000 7f6b1b200640 1 -- 172.21.15.3:0/3876933389 shutdown_connections 2024-09-10T23:16:45.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.295+0000 7f6b1b200640 1 --2- 172.21.15.3:0/3876933389 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b14109150 0x7f6b1410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:45.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.295+0000 7f6b1b200640 1 --2- 172.21.15.3:0/3876933389 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b141087d0 0x7f6b14108c10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:45.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.295+0000 7f6b1b200640 1 --2- 172.21.15.3:0/3876933389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b14102dc0 0x7f6b141031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:45.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.295+0000 7f6b1b200640 1 -- 172.21.15.3:0/3876933389 >> 172.21.15.3:0/3876933389 conn(0x7f6b140fe830 msgr2=0x7f6b14100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:45.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.295+0000 7f6b1b200640 1 -- 172.21.15.3:0/3876933389 shutdown_connections 2024-09-10T23:16:45.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.296+0000 7f6b1b200640 1 -- 172.21.15.3:0/3876933389 wait complete. 2024-09-10T23:16:45.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.297+0000 7f6b1b200640 1 Processor -- start 2024-09-10T23:16:45.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.297+0000 7f6b1b200640 1 -- start start 2024-09-10T23:16:45.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.297+0000 7f6b1b200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b14102dc0 0x7f6b140754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:45.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.297+0000 7f6b1b200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b141087d0 0x7f6b140759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:45.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.297+0000 7f6b1b200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b14109150 0x7f6b14075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:45.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.297+0000 7f6b1b200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6b14112d10 con 0x7f6b14102dc0 2024-09-10T23:16:45.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.297+0000 7f6b1b200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6b14112b90 con 0x7f6b14109150 2024-09-10T23:16:45.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.297+0000 7f6b1b200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6b14112e90 con 0x7f6b141087d0 2024-09-10T23:16:45.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.298+0000 7f6b13e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b14102dc0 0x7f6b140754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:45.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.298+0000 7f6b13e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b14102dc0 0x7f6b140754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34822/0 (socket says 172.21.15.3:34822) 2024-09-10T23:16:45.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.298+0000 7f6b13e00640 1 -- 172.21.15.3:0/2547889669 learned_addr learned my addr 172.21.15.3:0/2547889669 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:16:45.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.298+0000 7f6b0b400640 1 --2- 172.21.15.3:0/2547889669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b141087d0 0x7f6b140759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:45.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.298+0000 7f6b13e00640 1 -- 172.21.15.3:0/2547889669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b141087d0 msgr2=0x7f6b140759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:45.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.298+0000 7f6b13e00640 1 --2- 172.21.15.3:0/2547889669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b141087d0 0x7f6b140759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:45.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.298+0000 7f6b19200640 1 --2- 172.21.15.3:0/2547889669 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b14109150 0x7f6b14075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:45.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.298+0000 7f6b13e00640 1 -- 172.21.15.3:0/2547889669 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b14109150 msgr2=0x7f6b14075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:45.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.298+0000 7f6b13e00640 1 --2- 172.21.15.3:0/2547889669 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b14109150 0x7f6b14075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:45.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.298+0000 7f6b13e00640 1 -- 172.21.15.3:0/2547889669 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b141a7560 con 0x7f6b14102dc0 2024-09-10T23:16:45.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.298+0000 7f6b19200640 1 --2- 172.21.15.3:0/2547889669 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b14109150 0x7f6b14075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:16:45.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.299+0000 7f6b13e00640 1 --2- 172.21.15.3:0/2547889669 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b14102dc0 0x7f6b140754a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6b0400cce0 tx=0x7f6b0400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:45.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.299+0000 7f6b11600640 1 -- 172.21.15.3:0/2547889669 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b04004b20 con 0x7f6b14102dc0 2024-09-10T23:16:45.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.299+0000 7f6b11600640 1 -- 172.21.15.3:0/2547889669 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b04004cc0 con 0x7f6b14102dc0 2024-09-10T23:16:45.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.299+0000 7f6b11600640 1 -- 172.21.15.3:0/2547889669 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0400f6b0 con 0x7f6b14102dc0 2024-09-10T23:16:45.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.299+0000 7f6b1b200640 1 -- 172.21.15.3:0/2547889669 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b141a7850 con 0x7f6b14102dc0 2024-09-10T23:16:45.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.299+0000 7f6b1b200640 1 -- 172.21.15.3:0/2547889669 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b141a7d10 con 0x7f6b14102dc0 2024-09-10T23:16:45.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.300+0000 7f6b1b200640 1 -- 172.21.15.3:0/2547889669 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b14104070 con 0x7f6b14102dc0 2024-09-10T23:16:45.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.303+0000 7f6b11600640 1 -- 172.21.15.3:0/2547889669 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 153210+0+0 (secure 0 0 0) 0x7f6b0400f850 con 0x7f6b14102dc0 2024-09-10T23:16:45.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.305+0000 7f6b11600640 1 --2- 172.21.15.3:0/2547889669 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f6af80b5320 0x7f6af80b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:45.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.305+0000 7f6b11600640 1 -- 172.21.15.3:0/2547889669 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f6b040e4460 con 0x7f6b14102dc0 2024-09-10T23:16:45.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.305+0000 7f6b0b400640 1 --2- 172.21.15.3:0/2547889669 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f6af80b5320 0x7f6af80b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:45.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.306+0000 7f6b0b400640 1 --2- 172.21.15.3:0/2547889669 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f6af80b5320 0x7f6af80b77e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6afc006010 tx=0x7f6afc005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:45.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.308+0000 7f6b11600640 1 -- 172.21.15.3:0/2547889669 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6b04014030 con 0x7f6b14102dc0 2024-09-10T23:16:45.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:44 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/1060093822' entity='client.admin' 2024-09-10T23:16:45.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:44 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/420577111' entity='client.admin' 2024-09-10T23:16:45.349 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:44 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/4023952125' entity='client.admin' 2024-09-10T23:16:45.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.507+0000 7f6b1b200640 1 -- 172.21.15.3:0/2547889669 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f6b140767a0 con 0x7f6b14102dc0 2024-09-10T23:16:45.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.511+0000 7f6b11600640 1 -- 172.21.15.3:0/2547889669 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v31)=0 v31) ==== 129+0+0 (secure 0 0 0) 0x7f6b040acf00 con 0x7f6b14102dc0 2024-09-10T23:16:45.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.514+0000 7f6b1b200640 1 -- 172.21.15.3:0/2547889669 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f6af80b5320 msgr2=0x7f6af80b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:45.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.514+0000 7f6b1b200640 1 --2- 172.21.15.3:0/2547889669 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f6af80b5320 0x7f6af80b77e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6afc006010 tx=0x7f6afc005e80 comp rx=0 tx=0).stop 2024-09-10T23:16:45.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.514+0000 7f6b1b200640 1 -- 172.21.15.3:0/2547889669 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b14102dc0 msgr2=0x7f6b140754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:45.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.514+0000 7f6b1b200640 1 --2- 172.21.15.3:0/2547889669 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b14102dc0 0x7f6b140754a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6b0400cce0 tx=0x7f6b0400a620 comp rx=0 tx=0).stop 2024-09-10T23:16:45.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.514+0000 7f6b1b200640 1 -- 172.21.15.3:0/2547889669 shutdown_connections 2024-09-10T23:16:45.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.514+0000 7f6b1b200640 1 --2- 172.21.15.3:0/2547889669 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b14109150 0x7f6b14075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:45.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.514+0000 7f6b1b200640 1 --2- 172.21.15.3:0/2547889669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b141087d0 0x7f6b140759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:45.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.514+0000 7f6b1b200640 1 --2- 172.21.15.3:0/2547889669 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f6af80b5320 0x7f6af80b77e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:45.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.514+0000 7f6b1b200640 1 --2- 172.21.15.3:0/2547889669 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b14102dc0 0x7f6b140754a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:45.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.514+0000 7f6b1b200640 1 -- 172.21.15.3:0/2547889669 >> 172.21.15.3:0/2547889669 conn(0x7f6b140fe830 msgr2=0x7f6b14100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:45.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.514+0000 7f6b1b200640 1 -- 172.21.15.3:0/2547889669 shutdown_connections 2024-09-10T23:16:45.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:45.514+0000 7f6b1b200640 1 -- 172.21.15.3:0/2547889669 wait complete. 2024-09-10T23:16:45.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.888+0000 7f042a800640 1 -- 172.21.15.3:0/3359590961 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f042410b340 msgr2=0x7f0424111b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:45.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.888+0000 7f042a800640 1 --2- 172.21.15.3:0/3359590961 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f042410b340 0x7f0424111b40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f041c009ca0 tx=0x7f041c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:16:45.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.888+0000 7f042a800640 1 -- 172.21.15.3:0/3359590961 shutdown_connections 2024-09-10T23:16:45.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.888+0000 7f042a800640 1 --2- 172.21.15.3:0/3359590961 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f042410b340 0x7f0424111b40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:45.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.888+0000 7f042a800640 1 --2- 172.21.15.3:0/3359590961 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f042410a9c0 0x7f042410ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:45.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.888+0000 7f042a800640 1 --2- 172.21.15.3:0/3359590961 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0424104fb0 0x7f0424105390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:45.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.888+0000 7f042a800640 1 -- 172.21.15.3:0/3359590961 >> 172.21.15.3:0/3359590961 conn(0x7f0424100a20 msgr2=0x7f0424102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:45.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.888+0000 7f042a800640 1 -- 172.21.15.3:0/3359590961 shutdown_connections 2024-09-10T23:16:45.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.888+0000 7f042a800640 1 -- 172.21.15.3:0/3359590961 wait complete. 2024-09-10T23:16:45.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.889+0000 7f042a800640 1 Processor -- start 2024-09-10T23:16:45.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.890+0000 7f042a800640 1 -- start start 2024-09-10T23:16:45.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.890+0000 7f042a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0424104fb0 0x7f042419b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:45.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.890+0000 7f042a800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f042410a9c0 0x7f042419b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:45.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.890+0000 7f042a800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f042410b340 0x7f04241a0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:45.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.890+0000 7f042a800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0424114e70 con 0x7f042410a9c0 2024-09-10T23:16:45.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.890+0000 7f042a800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0424114cf0 con 0x7f042410b340 2024-09-10T23:16:45.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.890+0000 7f042a800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0424114ff0 con 0x7f0424104fb0 2024-09-10T23:16:45.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.890+0000 7f0422a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f042410a9c0 0x7f042419b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:45.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.890+0000 7f0422a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f042410a9c0 0x7f042419b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34796/0 (socket says 172.21.15.3:34796) 2024-09-10T23:16:45.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.890+0000 7f0422a00640 1 -- 172.21.15.3:0/420577111 learned_addr learned my addr 172.21.15.3:0/420577111 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:16:45.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.891+0000 7f0423400640 1 --2- 172.21.15.3:0/420577111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0424104fb0 0x7f042419b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:45.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.891+0000 7f0422a00640 1 -- 172.21.15.3:0/420577111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0424104fb0 msgr2=0x7f042419b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:45.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.891+0000 7f0422a00640 1 --2- 172.21.15.3:0/420577111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0424104fb0 0x7f042419b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:45.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.891+0000 7f0422a00640 1 -- 172.21.15.3:0/420577111 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f042410b340 msgr2=0x7f04241a0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:45.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.891+0000 7f0422a00640 1 --2- 172.21.15.3:0/420577111 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f042410b340 0x7f04241a0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:45.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.891+0000 7f0422a00640 1 -- 172.21.15.3:0/420577111 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04241a1470 con 0x7f042410a9c0 2024-09-10T23:16:45.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.891+0000 7f0422a00640 1 --2- 172.21.15.3:0/420577111 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f042410a9c0 0x7f042419b900 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f041000d770 tx=0x7f041000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:45.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.891+0000 7f041be00640 1 -- 172.21.15.3:0/420577111 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0410017070 con 0x7f042410a9c0 2024-09-10T23:16:45.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.891+0000 7f041be00640 1 -- 172.21.15.3:0/420577111 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04100054b0 con 0x7f042410a9c0 2024-09-10T23:16:45.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.891+0000 7f041be00640 1 -- 172.21.15.3:0/420577111 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0410004c60 con 0x7f042410a9c0 2024-09-10T23:16:45.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.892+0000 7f042a800640 1 -- 172.21.15.3:0/420577111 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04241a1760 con 0x7f042410a9c0 2024-09-10T23:16:45.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.892+0000 7f042a800640 1 -- 172.21.15.3:0/420577111 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04241a7e20 con 0x7f042410a9c0 2024-09-10T23:16:45.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.893+0000 7f042a800640 1 -- 172.21.15.3:0/420577111 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0424105390 con 0x7f042410a9c0 2024-09-10T23:16:45.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.895+0000 7f041be00640 1 -- 172.21.15.3:0/420577111 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 153210+0+0 (secure 0 0 0) 0x7f0410004e00 con 0x7f042410a9c0 2024-09-10T23:16:45.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.897+0000 7f041be00640 1 --2- 172.21.15.3:0/420577111 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f04080b5320 0x7f04080b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:45.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.897+0000 7f041be00640 1 -- 172.21.15.3:0/420577111 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f04100e3b00 con 0x7f042410a9c0 2024-09-10T23:16:45.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.897+0000 7f0423400640 1 --2- 172.21.15.3:0/420577111 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f04080b5320 0x7f04080b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:45.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.898+0000 7f0423400640 1 --2- 172.21.15.3:0/420577111 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f04080b5320 0x7f04080b77e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0414009bd0 tx=0x7f0414005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:45.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.901+0000 7f041be00640 1 -- 172.21.15.3:0/420577111 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f04100ac520 con 0x7f042410a9c0 2024-09-10T23:16:45.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.102+0000 7f042a800640 1 -- 172.21.15.3:0/420577111 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f042402e5c0 con 0x7f042410a9c0 2024-09-10T23:16:45.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.106+0000 7f041be00640 1 -- 172.21.15.3:0/420577111 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v29)=0 v29) ==== 125+0+0 (secure 0 0 0) 0x7f04100abe20 con 0x7f042410a9c0 2024-09-10T23:16:45.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.109+0000 7f042a800640 1 -- 172.21.15.3:0/420577111 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f04080b5320 msgr2=0x7f04080b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:45.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.109+0000 7f042a800640 1 --2- 172.21.15.3:0/420577111 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f04080b5320 0x7f04080b77e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0414009bd0 tx=0x7f0414005f90 comp rx=0 tx=0).stop 2024-09-10T23:16:45.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.109+0000 7f042a800640 1 -- 172.21.15.3:0/420577111 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f042410a9c0 msgr2=0x7f042419b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:45.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.109+0000 7f042a800640 1 --2- 172.21.15.3:0/420577111 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f042410a9c0 0x7f042419b900 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f041000d770 tx=0x7f041000dc30 comp rx=0 tx=0).stop 2024-09-10T23:16:45.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.109+0000 7f042a800640 1 -- 172.21.15.3:0/420577111 shutdown_connections 2024-09-10T23:16:45.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.109+0000 7f042a800640 1 --2- 172.21.15.3:0/420577111 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f042410b340 0x7f04241a0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:45.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.109+0000 7f042a800640 1 --2- 172.21.15.3:0/420577111 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f04080b5320 0x7f04080b77e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:45.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.109+0000 7f042a800640 1 --2- 172.21.15.3:0/420577111 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f042410a9c0 0x7f042419b900 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:45.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.109+0000 7f042a800640 1 --2- 172.21.15.3:0/420577111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0424104fb0 0x7f042419b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:45.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.109+0000 7f042a800640 1 -- 172.21.15.3:0/420577111 >> 172.21.15.3:0/420577111 conn(0x7f0424100a20 msgr2=0x7f0424102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:45.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.109+0000 7f042a800640 1 -- 172.21.15.3:0/420577111 shutdown_connections 2024-09-10T23:16:45.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:44.109+0000 7f042a800640 1 -- 172.21.15.3:0/420577111 wait complete. 2024-09-10T23:16:46.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.636+0000 7f0f4e000640 1 -- 172.21.15.3:0/4134016654 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f481087d0 msgr2=0x7f0f48108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:46.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.636+0000 7f0f4e000640 1 --2- 172.21.15.3:0/4134016654 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f481087d0 0x7f0f48108c10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0f30009900 tx=0x7f0f3002a410 comp rx=0 tx=0).stop 2024-09-10T23:16:46.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.636+0000 7f0f4e000640 1 -- 172.21.15.3:0/4134016654 shutdown_connections 2024-09-10T23:16:46.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.636+0000 7f0f4e000640 1 --2- 172.21.15.3:0/4134016654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f48109150 0x7f0f4810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:46.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.636+0000 7f0f4e000640 1 --2- 172.21.15.3:0/4134016654 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f481087d0 0x7f0f48108c10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:46.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.636+0000 7f0f4e000640 1 --2- 172.21.15.3:0/4134016654 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f48102dc0 0x7f0f481031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:46.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.636+0000 7f0f4e000640 1 -- 172.21.15.3:0/4134016654 >> 172.21.15.3:0/4134016654 conn(0x7f0f480fe830 msgr2=0x7f0f48100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:46.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.636+0000 7f0f4e000640 1 -- 172.21.15.3:0/4134016654 shutdown_connections 2024-09-10T23:16:46.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.636+0000 7f0f4e000640 1 -- 172.21.15.3:0/4134016654 wait complete. 2024-09-10T23:16:46.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.637+0000 7f0f4e000640 1 Processor -- start 2024-09-10T23:16:46.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.637+0000 7f0f4e000640 1 -- start start 2024-09-10T23:16:46.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.637+0000 7f0f4e000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f48102dc0 0x7f0f480754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:46.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.637+0000 7f0f4e000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f481087d0 0x7f0f480759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:46.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.637+0000 7f0f4e000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f48109150 0x7f0f48075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:46.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.637+0000 7f0f4e000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0f48112cd0 con 0x7f0f481087d0 2024-09-10T23:16:46.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.637+0000 7f0f4e000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0f48112b50 con 0x7f0f48109150 2024-09-10T23:16:46.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.637+0000 7f0f4e000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0f48112e50 con 0x7f0f48102dc0 2024-09-10T23:16:46.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.637+0000 7f0f3ea00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f481087d0 0x7f0f480759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:46.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.638+0000 7f0f3ea00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f481087d0 0x7f0f480759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34768/0 (socket says 172.21.15.3:34768) 2024-09-10T23:16:46.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.638+0000 7f0f3ea00640 1 -- 172.21.15.3:0/1060093822 learned_addr learned my addr 172.21.15.3:0/1060093822 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:16:46.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.638+0000 7f0f47e00640 1 --2- 172.21.15.3:0/1060093822 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f48109150 0x7f0f48075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:46.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.638+0000 7f0f47400640 1 --2- 172.21.15.3:0/1060093822 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f48102dc0 0x7f0f480754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:46.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.638+0000 7f0f3ea00640 1 -- 172.21.15.3:0/1060093822 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f48102dc0 msgr2=0x7f0f480754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:46.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.638+0000 7f0f3ea00640 1 --2- 172.21.15.3:0/1060093822 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f48102dc0 0x7f0f480754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:46.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.638+0000 7f0f3ea00640 1 -- 172.21.15.3:0/1060093822 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f48109150 msgr2=0x7f0f48075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:46.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.638+0000 7f0f3ea00640 1 --2- 172.21.15.3:0/1060093822 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f48109150 0x7f0f48075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:46.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.638+0000 7f0f3ea00640 1 -- 172.21.15.3:0/1060093822 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f481a7590 con 0x7f0f481087d0 2024-09-10T23:16:46.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.638+0000 7f0f47400640 1 --2- 172.21.15.3:0/1060093822 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f48102dc0 0x7f0f480754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:46.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.638+0000 7f0f3ea00640 1 --2- 172.21.15.3:0/1060093822 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f481087d0 0x7f0f480759e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0f3002a930 tx=0x7f0f30003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:46.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.639+0000 7f0f44c00640 1 -- 172.21.15.3:0/1060093822 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3003f070 con 0x7f0f481087d0 2024-09-10T23:16:46.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.639+0000 7f0f44c00640 1 -- 172.21.15.3:0/1060093822 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0f3003baf0 con 0x7f0f481087d0 2024-09-10T23:16:46.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.639+0000 7f0f4e000640 1 -- 172.21.15.3:0/1060093822 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f481a7820 con 0x7f0f481087d0 2024-09-10T23:16:46.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.639+0000 7f0f44c00640 1 -- 172.21.15.3:0/1060093822 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f30035030 con 0x7f0f481087d0 2024-09-10T23:16:46.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.639+0000 7f0f4e000640 1 -- 172.21.15.3:0/1060093822 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f481a7d50 con 0x7f0f481087d0 2024-09-10T23:16:46.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.640+0000 7f0f4e000640 1 -- 172.21.15.3:0/1060093822 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f481031a0 con 0x7f0f481087d0 2024-09-10T23:16:46.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.644+0000 7f0f44c00640 1 -- 172.21.15.3:0/1060093822 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 153210+0+0 (secure 0 0 0) 0x7f0f3003b660 con 0x7f0f481087d0 2024-09-10T23:16:46.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.646+0000 7f0f44c00640 1 --2- 172.21.15.3:0/1060093822 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0f2c0b5320 0x7f0f2c0b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:46.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.646+0000 7f0f44c00640 1 -- 172.21.15.3:0/1060093822 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f0f30104e10 con 0x7f0f481087d0 2024-09-10T23:16:46.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.646+0000 7f0f47400640 1 --2- 172.21.15.3:0/1060093822 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0f2c0b5320 0x7f0f2c0b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:46.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.647+0000 7f0f47400640 1 --2- 172.21.15.3:0/1060093822 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0f2c0b5320 0x7f0f2c0b77e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0f380058c0 tx=0x7f0f38005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:46.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.647+0000 7f0f44c00640 1 -- 172.21.15.3:0/1060093822 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0f300cd830 con 0x7f0f481087d0 2024-09-10T23:16:46.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.847+0000 7f0f4e000640 1 -- 172.21.15.3:0/1060093822 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f0f480767a0 con 0x7f0f481087d0 2024-09-10T23:16:46.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.853+0000 7f0f44c00640 1 -- 172.21.15.3:0/1060093822 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v28)=0 v28) ==== 119+0+0 (secure 0 0 0) 0x7f0f480767a0 con 0x7f0f481087d0 2024-09-10T23:16:46.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.855+0000 7f0f4e000640 1 -- 172.21.15.3:0/1060093822 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0f2c0b5320 msgr2=0x7f0f2c0b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:46.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.855+0000 7f0f4e000640 1 --2- 172.21.15.3:0/1060093822 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0f2c0b5320 0x7f0f2c0b77e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0f380058c0 tx=0x7f0f38005850 comp rx=0 tx=0).stop 2024-09-10T23:16:46.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.855+0000 7f0f4e000640 1 -- 172.21.15.3:0/1060093822 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f481087d0 msgr2=0x7f0f480759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:46.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.855+0000 7f0f4e000640 1 --2- 172.21.15.3:0/1060093822 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f481087d0 0x7f0f480759e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0f3002a930 tx=0x7f0f30003b90 comp rx=0 tx=0).stop 2024-09-10T23:16:46.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.856+0000 7f0f4e000640 1 -- 172.21.15.3:0/1060093822 shutdown_connections 2024-09-10T23:16:46.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.856+0000 7f0f4e000640 1 --2- 172.21.15.3:0/1060093822 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f48109150 0x7f0f48075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:46.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.856+0000 7f0f4e000640 1 --2- 172.21.15.3:0/1060093822 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0f2c0b5320 0x7f0f2c0b77e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:46.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.856+0000 7f0f4e000640 1 --2- 172.21.15.3:0/1060093822 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f481087d0 0x7f0f480759e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:46.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.856+0000 7f0f4e000640 1 --2- 172.21.15.3:0/1060093822 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f48102dc0 0x7f0f480754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:46.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.856+0000 7f0f4e000640 1 -- 172.21.15.3:0/1060093822 >> 172.21.15.3:0/1060093822 conn(0x7f0f480fe830 msgr2=0x7f0f48100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:46.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.856+0000 7f0f4e000640 1 -- 172.21.15.3:0/1060093822 shutdown_connections 2024-09-10T23:16:46.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:43.856+0000 7f0f4e000640 1 -- 172.21.15.3:0/1060093822 wait complete. 2024-09-10T23:16:46.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.526+0000 7f5bc7e00640 1 -- 172.21.15.3:0/901725860 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bc010a9b0 msgr2=0x7f5bc010adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:46.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.526+0000 7f5bc7e00640 1 --2- 172.21.15.3:0/901725860 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bc010a9b0 0x7f5bc010adf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5bac009900 tx=0x7f5bac02a410 comp rx=0 tx=0).stop 2024-09-10T23:16:46.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.527+0000 7f5bc7e00640 1 -- 172.21.15.3:0/901725860 shutdown_connections 2024-09-10T23:16:46.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.527+0000 7f5bc7e00640 1 --2- 172.21.15.3:0/901725860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5bc010b330 0x7f5bc0111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:46.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.527+0000 7f5bc7e00640 1 --2- 172.21.15.3:0/901725860 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bc010a9b0 0x7f5bc010adf0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:46.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.527+0000 7f5bc7e00640 1 --2- 172.21.15.3:0/901725860 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bc0104fa0 0x7f5bc0105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:46.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.527+0000 7f5bc7e00640 1 -- 172.21.15.3:0/901725860 >> 172.21.15.3:0/901725860 conn(0x7f5bc0100a50 msgr2=0x7f5bc0102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:46.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.527+0000 7f5bc7e00640 1 -- 172.21.15.3:0/901725860 shutdown_connections 2024-09-10T23:16:46.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.527+0000 7f5bc7e00640 1 -- 172.21.15.3:0/901725860 wait complete. 2024-09-10T23:16:46.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.528+0000 7f5bc7e00640 1 Processor -- start 2024-09-10T23:16:46.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.528+0000 7f5bc7e00640 1 -- start start 2024-09-10T23:16:46.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.528+0000 7f5bc7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bc0104fa0 0x7f5bc00776b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:46.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.528+0000 7f5bc7e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5bc010a9b0 0x7f5bc0077bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:46.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.528+0000 7f5bc7e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bc010b330 0x7f5bc0078130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:46.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.528+0000 7f5bc7e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc0114e30 con 0x7f5bc0104fa0 2024-09-10T23:16:46.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.528+0000 7f5bc7e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc0114cb0 con 0x7f5bc010b330 2024-09-10T23:16:46.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.528+0000 7f5bc7e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc0114fb0 con 0x7f5bc010a9b0 2024-09-10T23:16:46.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.529+0000 7f5bc4a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5bc010a9b0 0x7f5bc0077bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:46.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.529+0000 7f5bc5400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bc0104fa0 0x7f5bc00776b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:46.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.529+0000 7f5bc4a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5bc010a9b0 0x7f5bc0077bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.3:59392/0 (socket says 172.21.15.3:59392) 2024-09-10T23:16:46.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.529+0000 7f5bc4a00640 1 -- 172.21.15.3:0/903747466 learned_addr learned my addr 172.21.15.3:0/903747466 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:16:46.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.529+0000 7f5bc5e00640 1 --2- 172.21.15.3:0/903747466 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bc010b330 0x7f5bc0078130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:46.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.529+0000 7f5bc5400640 1 -- 172.21.15.3:0/903747466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5bc010a9b0 msgr2=0x7f5bc0077bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:46.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.529+0000 7f5bc5400640 1 --2- 172.21.15.3:0/903747466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5bc010a9b0 0x7f5bc0077bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:46.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.529+0000 7f5bc5400640 1 -- 172.21.15.3:0/903747466 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bc010b330 msgr2=0x7f5bc0078130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:46.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.529+0000 7f5bc5400640 1 --2- 172.21.15.3:0/903747466 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bc010b330 0x7f5bc0078130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:46.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.529+0000 7f5bc5400640 1 -- 172.21.15.3:0/903747466 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bc01ab970 con 0x7f5bc0104fa0 2024-09-10T23:16:46.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.529+0000 7f5bc4a00640 1 --2- 172.21.15.3:0/903747466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5bc010a9b0 0x7f5bc0077bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:16:46.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.530+0000 7f5bc5400640 1 --2- 172.21.15.3:0/903747466 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bc0104fa0 0x7f5bc00776b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5bb400e9f0 tx=0x7f5bb400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:46.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.530+0000 7f5bbe000640 1 -- 172.21.15.3:0/903747466 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb400ccc0 con 0x7f5bc0104fa0 2024-09-10T23:16:46.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.530+0000 7f5bbe000640 1 -- 172.21.15.3:0/903747466 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5bb40108c0 con 0x7f5bc0104fa0 2024-09-10T23:16:46.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.530+0000 7f5bbe000640 1 -- 172.21.15.3:0/903747466 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb40187e0 con 0x7f5bc0104fa0 2024-09-10T23:16:46.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.530+0000 7f5bc7e00640 1 -- 172.21.15.3:0/903747466 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bc01abc60 con 0x7f5bc0104fa0 2024-09-10T23:16:46.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.530+0000 7f5bc7e00640 1 -- 172.21.15.3:0/903747466 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bc01ac1a0 con 0x7f5bc0104fa0 2024-09-10T23:16:46.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.531+0000 7f5bc7e00640 1 -- 172.21.15.3:0/903747466 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bc0105380 con 0x7f5bc0104fa0 2024-09-10T23:16:46.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.534+0000 7f5bbe000640 1 -- 172.21.15.3:0/903747466 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 18) ==== 102353+0+0 (secure 0 0 0) 0x7f5bb4010430 con 0x7f5bc0104fa0 2024-09-10T23:16:46.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.535+0000 7f5bbe000640 1 --2- 172.21.15.3:0/903747466 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5ba807a400 0x7f5ba807c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:46.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.535+0000 7f5bbe000640 1 -- 172.21.15.3:0/903747466 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f5bb409c730 con 0x7f5bc0104fa0 2024-09-10T23:16:46.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.536+0000 7f5bc4a00640 1 --2- 172.21.15.3:0/903747466 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5ba807a400 0x7f5ba807c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:46.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.537+0000 7f5bc4a00640 1 --2- 172.21.15.3:0/903747466 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5ba807a400 0x7f5ba807c8c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5bac0096c0 tx=0x7f5bac005e60 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:46.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.537+0000 7f5bbe000640 1 -- 172.21.15.3:0/903747466 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5bb4064ca0 con 0x7f5bc0104fa0 2024-09-10T23:16:46.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.739+0000 7f5bc7e00640 1 -- 172.21.15.3:0/903747466 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f5bc002e5c0 con 0x7f5bc0104fa0 2024-09-10T23:16:46.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.744+0000 7f5bbe000640 1 -- 172.21.15.3:0/903747466 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mgrmap(e 19) ==== 153210+0+0 (secure 0 0 0) 0x7f5bb4060f10 con 0x7f5bc0104fa0 2024-09-10T23:16:46.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.749+0000 7f5bbe000640 1 -- 172.21.15.3:0/903747466 <== mon.0 v2:172.21.15.3:3300/0 8 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v25)=0 v25) ==== 121+0+0 (secure 0 0 0) 0x7f5bb40b0560 con 0x7f5bc0104fa0 2024-09-10T23:16:46.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.752+0000 7f5bc7e00640 1 -- 172.21.15.3:0/903747466 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5ba807a400 msgr2=0x7f5ba807c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:46.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.752+0000 7f5bc7e00640 1 --2- 172.21.15.3:0/903747466 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5ba807a400 0x7f5ba807c8c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5bac0096c0 tx=0x7f5bac005e60 comp rx=0 tx=0).stop 2024-09-10T23:16:46.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.752+0000 7f5bc7e00640 1 -- 172.21.15.3:0/903747466 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bc0104fa0 msgr2=0x7f5bc00776b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:46.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.752+0000 7f5bc7e00640 1 --2- 172.21.15.3:0/903747466 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bc0104fa0 0x7f5bc00776b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5bb400e9f0 tx=0x7f5bb400eeb0 comp rx=0 tx=0).stop 2024-09-10T23:16:46.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.752+0000 7f5bc7e00640 1 -- 172.21.15.3:0/903747466 shutdown_connections 2024-09-10T23:16:46.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.752+0000 7f5bc7e00640 1 --2- 172.21.15.3:0/903747466 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bc010b330 0x7f5bc0078130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:46.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.752+0000 7f5bc7e00640 1 --2- 172.21.15.3:0/903747466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5bc010a9b0 0x7f5bc0077bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:46.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.752+0000 7f5bc7e00640 1 --2- 172.21.15.3:0/903747466 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5ba807a400 0x7f5ba807c8c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:46.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.752+0000 7f5bc7e00640 1 --2- 172.21.15.3:0/903747466 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bc0104fa0 0x7f5bc00776b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:46.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.752+0000 7f5bc7e00640 1 -- 172.21.15.3:0/903747466 >> 172.21.15.3:0/903747466 conn(0x7f5bc0100a50 msgr2=0x7f5bc0102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:46.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.752+0000 7f5bc7e00640 1 -- 172.21.15.3:0/903747466 shutdown_connections 2024-09-10T23:16:46.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:42.752+0000 7f5bc7e00640 1 -- 172.21.15.3:0/903747466 wait complete. 2024-09-10T23:16:46.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:46 smithi003 ceph-mon[30348]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:46.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:46 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2547889669' entity='client.admin' 2024-09-10T23:16:46.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:46 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:16:46.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:46 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:46.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:46 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:16:46.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:46 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:46.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:46 smithi038 ceph-mon[34225]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:46.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:46 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2547889669' entity='client.admin' 2024-09-10T23:16:46.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:46 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:16:46.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:46 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:46.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:46 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:16:46.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:46 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:46.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:46 smithi194 ceph-mon[33904]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:46.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:46 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2547889669' entity='client.admin' 2024-09-10T23:16:46.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:46 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:16:46.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:46 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:46.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:46 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:16:46.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:46 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:47.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.536+0000 7f76f2600640 1 -- 172.21.15.3:0/196655764 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76ec10a9c0 msgr2=0x7f76ec10ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:47.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.536+0000 7f76f2600640 1 --2- 172.21.15.3:0/196655764 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76ec10a9c0 0x7f76ec10ae00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f76d4009900 tx=0x7f76d402a410 comp rx=0 tx=0).stop 2024-09-10T23:16:47.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.536+0000 7f76f2600640 1 -- 172.21.15.3:0/196655764 shutdown_connections 2024-09-10T23:16:47.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.536+0000 7f76f2600640 1 --2- 172.21.15.3:0/196655764 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76ec10b340 0x7f76ec111b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:47.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.536+0000 7f76f2600640 1 --2- 172.21.15.3:0/196655764 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76ec10a9c0 0x7f76ec10ae00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:47.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.536+0000 7f76f2600640 1 --2- 172.21.15.3:0/196655764 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76ec104fb0 0x7f76ec105390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:47.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.536+0000 7f76f2600640 1 -- 172.21.15.3:0/196655764 >> 172.21.15.3:0/196655764 conn(0x7f76ec100a20 msgr2=0x7f76ec102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:47.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.536+0000 7f76f2600640 1 -- 172.21.15.3:0/196655764 shutdown_connections 2024-09-10T23:16:47.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.536+0000 7f76f2600640 1 -- 172.21.15.3:0/196655764 wait complete. 2024-09-10T23:16:47.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.537+0000 7f76f2600640 1 Processor -- start 2024-09-10T23:16:47.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.537+0000 7f76f2600640 1 -- start start 2024-09-10T23:16:47.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.537+0000 7f76f2600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76ec104fb0 0x7f76ec19b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:47.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.537+0000 7f76f2600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76ec10a9c0 0x7f76ec19b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:47.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.537+0000 7f76f2600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76ec10b340 0x7f76ec1a0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:47.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.537+0000 7f76f2600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec114e20 con 0x7f76ec104fb0 2024-09-10T23:16:47.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.537+0000 7f76f2600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec114ca0 con 0x7f76ec10b340 2024-09-10T23:16:47.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.537+0000 7f76f2600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec114fa0 con 0x7f76ec10a9c0 2024-09-10T23:16:47.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.538+0000 7f76eb400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76ec104fb0 0x7f76ec19b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:47.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.538+0000 7f76eb400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76ec104fb0 0x7f76ec19b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34852/0 (socket says 172.21.15.3:34852) 2024-09-10T23:16:47.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.538+0000 7f76eb400640 1 -- 172.21.15.3:0/90033365 learned_addr learned my addr 172.21.15.3:0/90033365 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:16:47.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.538+0000 7f76e2a00640 1 --2- 172.21.15.3:0/90033365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76ec10a9c0 0x7f76ec19b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:47.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.538+0000 7f76ebe00640 1 --2- 172.21.15.3:0/90033365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76ec10b340 0x7f76ec1a0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:47.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.538+0000 7f76eb400640 1 -- 172.21.15.3:0/90033365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76ec10a9c0 msgr2=0x7f76ec19b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:47.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.538+0000 7f76eb400640 1 --2- 172.21.15.3:0/90033365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76ec10a9c0 0x7f76ec19b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:47.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.538+0000 7f76eb400640 1 -- 172.21.15.3:0/90033365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76ec10b340 msgr2=0x7f76ec1a0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:47.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.538+0000 7f76eb400640 1 --2- 172.21.15.3:0/90033365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76ec10b340 0x7f76ec1a0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:47.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.538+0000 7f76eb400640 1 -- 172.21.15.3:0/90033365 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76ec1a1420 con 0x7f76ec104fb0 2024-09-10T23:16:47.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.538+0000 7f76e2a00640 1 --2- 172.21.15.3:0/90033365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76ec10a9c0 0x7f76ec19b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:47.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.538+0000 7f76ebe00640 1 --2- 172.21.15.3:0/90033365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76ec10b340 0x7f76ec1a0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:47.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.538+0000 7f76eb400640 1 --2- 172.21.15.3:0/90033365 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76ec104fb0 0x7f76ec19b370 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f76dc00e9f0 tx=0x7f76dc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:47.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.539+0000 7f76e8c00640 1 -- 172.21.15.3:0/90033365 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76dc00cd80 con 0x7f76ec104fb0 2024-09-10T23:16:47.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.539+0000 7f76e8c00640 1 -- 172.21.15.3:0/90033365 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f76dc0108c0 con 0x7f76ec104fb0 2024-09-10T23:16:47.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.539+0000 7f76e8c00640 1 -- 172.21.15.3:0/90033365 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76dc0187c0 con 0x7f76ec104fb0 2024-09-10T23:16:47.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.539+0000 7f76f2600640 1 -- 172.21.15.3:0/90033365 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76ec1a1710 con 0x7f76ec104fb0 2024-09-10T23:16:47.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.539+0000 7f76f2600640 1 -- 172.21.15.3:0/90033365 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76ec1a7fa0 con 0x7f76ec104fb0 2024-09-10T23:16:47.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.540+0000 7f76f2600640 1 -- 172.21.15.3:0/90033365 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76ec106260 con 0x7f76ec104fb0 2024-09-10T23:16:47.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.542+0000 7f76e8c00640 1 -- 172.21.15.3:0/90033365 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 153210+0+0 (secure 0 0 0) 0x7f76dc010430 con 0x7f76ec104fb0 2024-09-10T23:16:47.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.543+0000 7f76e8c00640 1 --2- 172.21.15.3:0/90033365 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f76d00b5320 0x7f76d00b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:47.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.544+0000 7f76e8c00640 1 -- 172.21.15.3:0/90033365 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f76dc0e44d0 con 0x7f76ec104fb0 2024-09-10T23:16:47.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.544+0000 7f76e2a00640 1 --2- 172.21.15.3:0/90033365 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f76d00b5320 0x7f76d00b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:47.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.545+0000 7f76e2a00640 1 --2- 172.21.15.3:0/90033365 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f76d00b5320 0x7f76d00b77e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f76d4000c00 tx=0x7f76d4005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:47.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.547+0000 7f76e8c00640 1 -- 172.21.15.3:0/90033365 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f76dc0acef0 con 0x7f76ec104fb0 2024-09-10T23:16:47.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.745+0000 7f76f2600640 1 -- 172.21.15.3:0/90033365 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f76ec105390 con 0x7f76ec104fb0 2024-09-10T23:16:47.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.750+0000 7f76e8c00640 1 -- 172.21.15.3:0/90033365 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v32)=0 v32) ==== 138+0+0 (secure 0 0 0) 0x7f76dc0ac7f0 con 0x7f76ec104fb0 2024-09-10T23:16:47.754 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.752+0000 7f76f2600640 1 -- 172.21.15.3:0/90033365 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f76d00b5320 msgr2=0x7f76d00b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:47.754 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.752+0000 7f76f2600640 1 --2- 172.21.15.3:0/90033365 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f76d00b5320 0x7f76d00b77e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f76d4000c00 tx=0x7f76d4005a20 comp rx=0 tx=0).stop 2024-09-10T23:16:47.754 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.752+0000 7f76f2600640 1 -- 172.21.15.3:0/90033365 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76ec104fb0 msgr2=0x7f76ec19b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:47.754 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.752+0000 7f76f2600640 1 --2- 172.21.15.3:0/90033365 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76ec104fb0 0x7f76ec19b370 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f76dc00e9f0 tx=0x7f76dc00eeb0 comp rx=0 tx=0).stop 2024-09-10T23:16:47.754 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.752+0000 7f76f2600640 1 -- 172.21.15.3:0/90033365 shutdown_connections 2024-09-10T23:16:47.755 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.753+0000 7f76f2600640 1 --2- 172.21.15.3:0/90033365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76ec10b340 0x7f76ec1a0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:47.755 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.753+0000 7f76f2600640 1 --2- 172.21.15.3:0/90033365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76ec10a9c0 0x7f76ec19b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:47.755 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.753+0000 7f76f2600640 1 --2- 172.21.15.3:0/90033365 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f76d00b5320 0x7f76d00b77e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:47.755 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.753+0000 7f76f2600640 1 --2- 172.21.15.3:0/90033365 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76ec104fb0 0x7f76ec19b370 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:47.755 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.753+0000 7f76f2600640 1 -- 172.21.15.3:0/90033365 >> 172.21.15.3:0/90033365 conn(0x7f76ec100a20 msgr2=0x7f76ec102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:47.755 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.753+0000 7f76f2600640 1 -- 172.21.15.3:0/90033365 shutdown_connections 2024-09-10T23:16:47.755 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:47.753+0000 7f76f2600640 1 -- 172.21.15.3:0/90033365 wait complete. 2024-09-10T23:16:48.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.095+0000 7f80ab000640 1 -- 172.21.15.3:0/1143301622 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80a4075e60 msgr2=0x7f80a41135c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:48.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.095+0000 7f80ab000640 1 --2- 172.21.15.3:0/1143301622 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80a4075e60 0x7f80a41135c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8090009900 tx=0x7f809002a410 comp rx=0 tx=0).stop 2024-09-10T23:16:48.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.095+0000 7f80ab000640 1 -- 172.21.15.3:0/1143301622 shutdown_connections 2024-09-10T23:16:48.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.095+0000 7f80ab000640 1 --2- 172.21.15.3:0/1143301622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80a4113b00 0x7f80a4115ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.095+0000 7f80ab000640 1 --2- 172.21.15.3:0/1143301622 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80a4075e60 0x7f80a41135c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.095+0000 7f80ab000640 1 --2- 172.21.15.3:0/1143301622 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80a4075540 0x7f80a4075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.095+0000 7f80ab000640 1 -- 172.21.15.3:0/1143301622 >> 172.21.15.3:0/1143301622 conn(0x7f80a40fe810 msgr2=0x7f80a4100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:48.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.095+0000 7f80ab000640 1 -- 172.21.15.3:0/1143301622 shutdown_connections 2024-09-10T23:16:48.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.095+0000 7f80ab000640 1 -- 172.21.15.3:0/1143301622 wait complete. 2024-09-10T23:16:48.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.096+0000 7f80ab000640 1 Processor -- start 2024-09-10T23:16:48.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.097+0000 7f80ab000640 1 -- start start 2024-09-10T23:16:48.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.097+0000 7f80ab000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80a4075540 0x7f80a419f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:48.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.097+0000 7f80ab000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80a4075e60 0x7f80a419fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:48.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.097+0000 7f80ab000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80a4113b00 0x7f80a41a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:48.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.097+0000 7f80ab000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f80a4119290 con 0x7f80a4113b00 2024-09-10T23:16:48.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.097+0000 7f80ab000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f80a4119110 con 0x7f80a4075540 2024-09-10T23:16:48.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.097+0000 7f80ab000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f80a4119410 con 0x7f80a4075e60 2024-09-10T23:16:48.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.097+0000 7f80a9000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80a4113b00 0x7f80a41a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:48.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.097+0000 7f80a3400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80a4075e60 0x7f80a419fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:48.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.097+0000 7f80a9000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80a4113b00 0x7f80a41a50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34860/0 (socket says 172.21.15.3:34860) 2024-09-10T23:16:48.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.097+0000 7f80a9000640 1 -- 172.21.15.3:0/2031956429 learned_addr learned my addr 172.21.15.3:0/2031956429 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:16:48.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.097+0000 7f80a3e00640 1 --2- 172.21.15.3:0/2031956429 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80a4075540 0x7f80a419f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:48.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.098+0000 7f80a9000640 1 -- 172.21.15.3:0/2031956429 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80a4075e60 msgr2=0x7f80a419fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:48.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.098+0000 7f80a9000640 1 --2- 172.21.15.3:0/2031956429 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80a4075e60 0x7f80a419fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.098+0000 7f80a9000640 1 -- 172.21.15.3:0/2031956429 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80a4075540 msgr2=0x7f80a419f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:48.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.098+0000 7f80a9000640 1 --2- 172.21.15.3:0/2031956429 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80a4075540 0x7f80a419f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.098+0000 7f80a9000640 1 -- 172.21.15.3:0/2031956429 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80a41a5890 con 0x7f80a4113b00 2024-09-10T23:16:48.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.098+0000 7f80a9000640 1 --2- 172.21.15.3:0/2031956429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80a4113b00 0x7f80a41a50c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f809c00e9d0 tx=0x7f809c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:48.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.098+0000 7f80a0c00640 1 -- 172.21.15.3:0/2031956429 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809c00cd80 con 0x7f80a4113b00 2024-09-10T23:16:48.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.098+0000 7f80a0c00640 1 -- 172.21.15.3:0/2031956429 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f809c005020 con 0x7f80a4113b00 2024-09-10T23:16:48.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.098+0000 7f80a0c00640 1 -- 172.21.15.3:0/2031956429 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809c0116d0 con 0x7f80a4113b00 2024-09-10T23:16:48.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.098+0000 7f80ab000640 1 -- 172.21.15.3:0/2031956429 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80a41a5b80 con 0x7f80a4113b00 2024-09-10T23:16:48.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.098+0000 7f80ab000640 1 -- 172.21.15.3:0/2031956429 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80a41ac240 con 0x7f80a4113b00 2024-09-10T23:16:48.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.099+0000 7f80ab000640 1 -- 172.21.15.3:0/2031956429 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80a4075920 con 0x7f80a4113b00 2024-09-10T23:16:48.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.102+0000 7f80a0c00640 1 -- 172.21.15.3:0/2031956429 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 153210+0+0 (secure 0 0 0) 0x7f809c00f040 con 0x7f80a4113b00 2024-09-10T23:16:48.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.103+0000 7f80a0c00640 1 --2- 172.21.15.3:0/2031956429 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f80880b5320 0x7f80880b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:48.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.103+0000 7f80a0c00640 1 -- 172.21.15.3:0/2031956429 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f809c0e40a0 con 0x7f80a4113b00 2024-09-10T23:16:48.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.103+0000 7f80a3e00640 1 --2- 172.21.15.3:0/2031956429 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f80880b5320 0x7f80880b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:48.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.104+0000 7f80a3e00640 1 --2- 172.21.15.3:0/2031956429 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f80880b5320 0x7f80880b77e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8094005d00 tx=0x7f809400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:48.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.107+0000 7f80a0c00640 1 -- 172.21.15.3:0/2031956429 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f809c016030 con 0x7f80a4113b00 2024-09-10T23:16:48.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.303+0000 7f80ab000640 1 -- 172.21.15.3:0/2031956429 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f80a41ac620 con 0x7f80a4113b00 2024-09-10T23:16:48.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.308+0000 7f80a0c00640 1 -- 172.21.15.3:0/2031956429 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v33)=0 v33) ==== 121+0+0 (secure 0 0 0) 0x7f809c0ac470 con 0x7f80a4113b00 2024-09-10T23:16:48.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.310+0000 7f80ab000640 1 -- 172.21.15.3:0/2031956429 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f80880b5320 msgr2=0x7f80880b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:48.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.310+0000 7f80ab000640 1 --2- 172.21.15.3:0/2031956429 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f80880b5320 0x7f80880b77e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8094005d00 tx=0x7f809400b410 comp rx=0 tx=0).stop 2024-09-10T23:16:48.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.310+0000 7f80ab000640 1 -- 172.21.15.3:0/2031956429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80a4113b00 msgr2=0x7f80a41a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:48.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.310+0000 7f80ab000640 1 --2- 172.21.15.3:0/2031956429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80a4113b00 0x7f80a41a50c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f809c00e9d0 tx=0x7f809c00ee90 comp rx=0 tx=0).stop 2024-09-10T23:16:48.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.310+0000 7f80ab000640 1 -- 172.21.15.3:0/2031956429 shutdown_connections 2024-09-10T23:16:48.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.310+0000 7f80ab000640 1 --2- 172.21.15.3:0/2031956429 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f80880b5320 0x7f80880b77e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.310+0000 7f80ab000640 1 --2- 172.21.15.3:0/2031956429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80a4113b00 0x7f80a41a50c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.310+0000 7f80ab000640 1 --2- 172.21.15.3:0/2031956429 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80a4075e60 0x7f80a419fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.310+0000 7f80ab000640 1 --2- 172.21.15.3:0/2031956429 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80a4075540 0x7f80a419f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.310+0000 7f80ab000640 1 -- 172.21.15.3:0/2031956429 >> 172.21.15.3:0/2031956429 conn(0x7f80a40fe810 msgr2=0x7f80a40ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:48.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.311+0000 7f80ab000640 1 -- 172.21.15.3:0/2031956429 shutdown_connections 2024-09-10T23:16:48.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:48.311+0000 7f80ab000640 1 -- 172.21.15.3:0/2031956429 wait complete. 2024-09-10T23:16:48.702 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:48 smithi003 ceph-mon[30348]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:48.703 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:48 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/90033365' entity='client.admin' 2024-09-10T23:16:48.703 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:48 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:16:48.703 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:48 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:48.703 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:48 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:16:48.703 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:48 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:48.703 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:48 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2031956429' entity='client.admin' 2024-09-10T23:16:48.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:48 smithi038 ceph-mon[34225]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:48.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:48 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/90033365' entity='client.admin' 2024-09-10T23:16:48.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:48 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:16:48.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:48 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:48.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:48 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:16:48.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:48 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:48.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:48 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2031956429' entity='client.admin' 2024-09-10T23:16:48.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:48 smithi194 ceph-mon[33904]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:48.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:48 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/90033365' entity='client.admin' 2024-09-10T23:16:48.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:48 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:16:48.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:48 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:16:48.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:48 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:16:48.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:48 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:16:48.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:48 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2031956429' entity='client.admin' 2024-09-10T23:16:49.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.390+0000 7fbf28200640 1 -- 172.21.15.3:0/2787965208 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf200754c0 msgr2=0x7fbf200758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:49.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.390+0000 7fbf28200640 1 --2- 172.21.15.3:0/2787965208 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf200754c0 0x7fbf200758a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbf14009900 tx=0x7fbf1402a410 comp rx=0 tx=0).stop 2024-09-10T23:16:49.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.390+0000 7fbf28200640 1 -- 172.21.15.3:0/2787965208 shutdown_connections 2024-09-10T23:16:49.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.391+0000 7fbf28200640 1 --2- 172.21.15.3:0/2787965208 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf2010f3f0 0x7fbf201117e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:49.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.391+0000 7fbf28200640 1 --2- 172.21.15.3:0/2787965208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf20075de0 0x7fbf2010eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:49.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.391+0000 7fbf28200640 1 --2- 172.21.15.3:0/2787965208 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf200754c0 0x7fbf200758a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:49.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.391+0000 7fbf28200640 1 -- 172.21.15.3:0/2787965208 >> 172.21.15.3:0/2787965208 conn(0x7fbf200fe830 msgr2=0x7fbf20100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:49.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.391+0000 7fbf28200640 1 -- 172.21.15.3:0/2787965208 shutdown_connections 2024-09-10T23:16:49.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.391+0000 7fbf28200640 1 -- 172.21.15.3:0/2787965208 wait complete. 2024-09-10T23:16:49.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.392+0000 7fbf28200640 1 Processor -- start 2024-09-10T23:16:49.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.392+0000 7fbf28200640 1 -- start start 2024-09-10T23:16:49.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.392+0000 7fbf28200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf200754c0 0x7fbf2019b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:49.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.392+0000 7fbf28200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf20075de0 0x7fbf2019b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:49.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.392+0000 7fbf28200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf2010f3f0 0x7fbf201a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:49.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.392+0000 7fbf28200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fbf20114ef0 con 0x7fbf20075de0 2024-09-10T23:16:49.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.392+0000 7fbf28200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fbf20114d70 con 0x7fbf2010f3f0 2024-09-10T23:16:49.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.392+0000 7fbf28200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fbf20115070 con 0x7fbf200754c0 2024-09-10T23:16:49.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.393+0000 7fbf24e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf20075de0 0x7fbf2019b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:49.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.393+0000 7fbf24e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf20075de0 0x7fbf2019b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34874/0 (socket says 172.21.15.3:34874) 2024-09-10T23:16:49.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.393+0000 7fbf24e00640 1 -- 172.21.15.3:0/1510388833 learned_addr learned my addr 172.21.15.3:0/1510388833 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:16:49.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.393+0000 7fbf25800640 1 --2- 172.21.15.3:0/1510388833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf200754c0 0x7fbf2019b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:49.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.393+0000 7fbf26200640 1 --2- 172.21.15.3:0/1510388833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf2010f3f0 0x7fbf201a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:49.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.393+0000 7fbf24e00640 1 -- 172.21.15.3:0/1510388833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf200754c0 msgr2=0x7fbf2019b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:49.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.393+0000 7fbf24e00640 1 --2- 172.21.15.3:0/1510388833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf200754c0 0x7fbf2019b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:49.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.393+0000 7fbf24e00640 1 -- 172.21.15.3:0/1510388833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf2010f3f0 msgr2=0x7fbf201a0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:49.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.393+0000 7fbf24e00640 1 --2- 172.21.15.3:0/1510388833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf2010f3f0 0x7fbf201a0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:49.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.393+0000 7fbf24e00640 1 -- 172.21.15.3:0/1510388833 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf201a1530 con 0x7fbf20075de0 2024-09-10T23:16:49.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.394+0000 7fbf24e00640 1 --2- 172.21.15.3:0/1510388833 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf20075de0 0x7fbf2019b9c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00d770 tx=0x7fbf0c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:49.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.394+0000 7fbf1e000640 1 -- 172.21.15.3:0/1510388833 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c017070 con 0x7fbf20075de0 2024-09-10T23:16:49.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.394+0000 7fbf1e000640 1 -- 172.21.15.3:0/1510388833 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf0c0054b0 con 0x7fbf20075de0 2024-09-10T23:16:49.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.394+0000 7fbf28200640 1 -- 172.21.15.3:0/1510388833 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf201a1820 con 0x7fbf20075de0 2024-09-10T23:16:49.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.394+0000 7fbf1e000640 1 -- 172.21.15.3:0/1510388833 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c004c60 con 0x7fbf20075de0 2024-09-10T23:16:49.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.394+0000 7fbf28200640 1 -- 172.21.15.3:0/1510388833 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf201a7ee0 con 0x7fbf20075de0 2024-09-10T23:16:49.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.395+0000 7fbf28200640 1 -- 172.21.15.3:0/1510388833 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf200758a0 con 0x7fbf20075de0 2024-09-10T23:16:49.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.398+0000 7fbf1e000640 1 -- 172.21.15.3:0/1510388833 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 153210+0+0 (secure 0 0 0) 0x7fbf0c004e00 con 0x7fbf20075de0 2024-09-10T23:16:49.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.400+0000 7fbf1e000640 1 --2- 172.21.15.3:0/1510388833 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fbf080b52a0 0x7fbf080b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:49.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.400+0000 7fbf1e000640 1 -- 172.21.15.3:0/1510388833 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fbf0c0e3e70 con 0x7fbf20075de0 2024-09-10T23:16:49.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.400+0000 7fbf25800640 1 --2- 172.21.15.3:0/1510388833 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fbf080b52a0 0x7fbf080b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:49.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.401+0000 7fbf25800640 1 --2- 172.21.15.3:0/1510388833 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fbf080b52a0 0x7fbf080b7760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbf14006010 tx=0x7fbf14005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:49.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.401+0000 7fbf1e000640 1 -- 172.21.15.3:0/1510388833 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fbf0c0ac240 con 0x7fbf20075de0 2024-09-10T23:16:49.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.605+0000 7fbf28200640 1 -- 172.21.15.3:0/1510388833 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7fbf2010a5d0 con 0x7fbf20075de0 2024-09-10T23:16:49.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.610+0000 7fbf1e000640 1 -- 172.21.15.3:0/1510388833 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v34)=0 v34) ==== 116+0+0 (secure 0 0 0) 0x7fbf0c0b0c70 con 0x7fbf20075de0 2024-09-10T23:16:49.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.612+0000 7fbf28200640 1 -- 172.21.15.3:0/1510388833 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fbf080b52a0 msgr2=0x7fbf080b7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:49.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.612+0000 7fbf28200640 1 --2- 172.21.15.3:0/1510388833 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fbf080b52a0 0x7fbf080b7760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbf14006010 tx=0x7fbf14005e80 comp rx=0 tx=0).stop 2024-09-10T23:16:49.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.612+0000 7fbf28200640 1 -- 172.21.15.3:0/1510388833 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf20075de0 msgr2=0x7fbf2019b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:49.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.612+0000 7fbf28200640 1 --2- 172.21.15.3:0/1510388833 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf20075de0 0x7fbf2019b9c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00d770 tx=0x7fbf0c00dc30 comp rx=0 tx=0).stop 2024-09-10T23:16:49.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.612+0000 7fbf28200640 1 -- 172.21.15.3:0/1510388833 shutdown_connections 2024-09-10T23:16:49.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.612+0000 7fbf28200640 1 --2- 172.21.15.3:0/1510388833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf2010f3f0 0x7fbf201a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:49.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.612+0000 7fbf28200640 1 --2- 172.21.15.3:0/1510388833 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fbf080b52a0 0x7fbf080b7760 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:49.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.612+0000 7fbf28200640 1 --2- 172.21.15.3:0/1510388833 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf20075de0 0x7fbf2019b9c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:49.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.612+0000 7fbf28200640 1 --2- 172.21.15.3:0/1510388833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf200754c0 0x7fbf2019b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:49.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.613+0000 7fbf28200640 1 -- 172.21.15.3:0/1510388833 >> 172.21.15.3:0/1510388833 conn(0x7fbf200fe830 msgr2=0x7fbf200ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:49.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.613+0000 7fbf28200640 1 -- 172.21.15.3:0/1510388833 shutdown_connections 2024-09-10T23:16:49.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:49.613+0000 7fbf28200640 1 -- 172.21.15.3:0/1510388833 wait complete. 2024-09-10T23:16:50.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:50 smithi003 ceph-mon[30348]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:50.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:50 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1510388833' entity='client.admin' 2024-09-10T23:16:50.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:50 smithi038 ceph-mon[34225]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:50.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:50 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/1510388833' entity='client.admin' 2024-09-10T23:16:50.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:50 smithi194 ceph-mon[33904]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:50.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:50 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/1510388833' entity='client.admin' 2024-09-10T23:16:51.247 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3f4e30d0-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi003') 2024-09-10T23:16:51.248 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3f4e30d0-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi003') 2024-09-10T23:16:51.248 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3f4e30d0-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi003') 2024-09-10T23:16:51.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.581+0000 7ffaf6000640 1 -- 172.21.15.3:0/24998970 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffaf0102dc0 msgr2=0x7ffaf01031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.581+0000 7ffaf6000640 1 --2- 172.21.15.3:0/24998970 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffaf0102dc0 0x7ffaf01031a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009900 tx=0x7ffae002a410 comp rx=0 tx=0).stop 2024-09-10T23:16:51.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.582+0000 7ffaf6000640 1 -- 172.21.15.3:0/24998970 shutdown_connections 2024-09-10T23:16:51.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.582+0000 7ffaf6000640 1 --2- 172.21.15.3:0/24998970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffaf0109150 0x7ffaf010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.582+0000 7ffaf6000640 1 --2- 172.21.15.3:0/24998970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffaf01087d0 0x7ffaf0108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.582+0000 7ffaf6000640 1 --2- 172.21.15.3:0/24998970 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffaf0102dc0 0x7ffaf01031a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.582+0000 7ffaf6000640 1 -- 172.21.15.3:0/24998970 >> 172.21.15.3:0/24998970 conn(0x7ffaf00fe830 msgr2=0x7ffaf0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:51.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.582+0000 7ffaf6000640 1 -- 172.21.15.3:0/24998970 shutdown_connections 2024-09-10T23:16:51.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.582+0000 7ffaf6000640 1 -- 172.21.15.3:0/24998970 wait complete. 2024-09-10T23:16:51.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.583+0000 7ffaf6000640 1 Processor -- start 2024-09-10T23:16:51.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.583+0000 7ffaf6000640 1 -- start start 2024-09-10T23:16:51.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.583+0000 7ffaf6000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffaf0102dc0 0x7ffaf0199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:51.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.583+0000 7ffaf6000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffaf01087d0 0x7ffaf0199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:51.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.583+0000 7ffaf6000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffaf0109150 0x7ffaf019eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:51.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.583+0000 7ffaf6000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf0112d10 con 0x7ffaf01087d0 2024-09-10T23:16:51.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.583+0000 7ffaf6000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf0112b90 con 0x7ffaf0109150 2024-09-10T23:16:51.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.583+0000 7ffaf6000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf0112e90 con 0x7ffaf0102dc0 2024-09-10T23:16:51.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.583+0000 7ffae6a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffaf01087d0 0x7ffaf0199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:51.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.584+0000 7ffae6a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffaf01087d0 0x7ffaf0199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35082/0 (socket says 172.21.15.3:35082) 2024-09-10T23:16:51.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.584+0000 7ffaef400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffaf0102dc0 0x7ffaf0199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:51.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.584+0000 7ffae6a00640 1 -- 172.21.15.3:0/4254049294 learned_addr learned my addr 172.21.15.3:0/4254049294 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:16:51.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.584+0000 7ffaefe00640 1 --2- 172.21.15.3:0/4254049294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffaf0109150 0x7ffaf019eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:51.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.584+0000 7ffae6a00640 1 -- 172.21.15.3:0/4254049294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffaf0102dc0 msgr2=0x7ffaf0199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.584+0000 7ffae6a00640 1 --2- 172.21.15.3:0/4254049294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffaf0102dc0 0x7ffaf0199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.584+0000 7ffae6a00640 1 -- 172.21.15.3:0/4254049294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffaf0109150 msgr2=0x7ffaf019eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.584+0000 7ffae6a00640 1 --2- 172.21.15.3:0/4254049294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffaf0109150 0x7ffaf019eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.584+0000 7ffae6a00640 1 -- 172.21.15.3:0/4254049294 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaf019f2b0 con 0x7ffaf01087d0 2024-09-10T23:16:51.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.584+0000 7ffae6a00640 1 --2- 172.21.15.3:0/4254049294 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffaf01087d0 0x7ffaf0199740 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ffad800d950 tx=0x7ffad800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:51.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.585+0000 7ffaecc00640 1 -- 172.21.15.3:0/4254049294 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad8017070 con 0x7ffaf01087d0 2024-09-10T23:16:51.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.585+0000 7ffaecc00640 1 -- 172.21.15.3:0/4254049294 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffad8009c30 con 0x7ffaf01087d0 2024-09-10T23:16:51.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.585+0000 7ffaecc00640 1 -- 172.21.15.3:0/4254049294 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad800f620 con 0x7ffaf01087d0 2024-09-10T23:16:51.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.585+0000 7ffaf6000640 1 -- 172.21.15.3:0/4254049294 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaf019f5a0 con 0x7ffaf01087d0 2024-09-10T23:16:51.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.585+0000 7ffaf6000640 1 -- 172.21.15.3:0/4254049294 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaf01a5c60 con 0x7ffaf01087d0 2024-09-10T23:16:51.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.586+0000 7ffaf6000640 1 -- 172.21.15.3:0/4254049294 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaf01031a0 con 0x7ffaf01087d0 2024-09-10T23:16:51.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.588+0000 7ffaecc00640 1 -- 172.21.15.3:0/4254049294 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 153210+0+0 (secure 0 0 0) 0x7ffad8010460 con 0x7ffaf01087d0 2024-09-10T23:16:51.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.589+0000 7ffaecc00640 1 --2- 172.21.15.3:0/4254049294 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ffad40b53a0 0x7ffad40b7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:51.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.590+0000 7ffaecc00640 1 -- 172.21.15.3:0/4254049294 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7ffad80e3ba0 con 0x7ffaf01087d0 2024-09-10T23:16:51.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.590+0000 7ffaef400640 1 --2- 172.21.15.3:0/4254049294 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ffad40b53a0 0x7ffad40b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:51.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.591+0000 7ffaef400640 1 --2- 172.21.15.3:0/4254049294 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ffad40b53a0 0x7ffad40b7860 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ffae0006010 tx=0x7ffae0005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:51.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.593+0000 7ffaecc00640 1 -- 172.21.15.3:0/4254049294 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ffad8009de0 con 0x7ffaf01087d0 2024-09-10T23:16:51.792 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.791+0000 7ffaf6000640 1 -- 172.21.15.3:0/4254049294 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7ffaf002e5c0 con 0x7ffaf01087d0 2024-09-10T23:16:51.796 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.795+0000 7ffaecc00640 1 -- 172.21.15.3:0/4254049294 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v35)=0 v35) ==== 122+0+0 (secure 0 0 0) 0x7ffad80abf70 con 0x7ffaf01087d0 2024-09-10T23:16:51.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.797+0000 7ffaf6000640 1 -- 172.21.15.3:0/4254049294 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ffad40b53a0 msgr2=0x7ffad40b7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.797+0000 7ffaf6000640 1 --2- 172.21.15.3:0/4254049294 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ffad40b53a0 0x7ffad40b7860 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ffae0006010 tx=0x7ffae0005e80 comp rx=0 tx=0).stop 2024-09-10T23:16:51.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.798+0000 7ffaf6000640 1 -- 172.21.15.3:0/4254049294 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffaf01087d0 msgr2=0x7ffaf0199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.798+0000 7ffaf6000640 1 --2- 172.21.15.3:0/4254049294 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffaf01087d0 0x7ffaf0199740 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ffad800d950 tx=0x7ffad800de10 comp rx=0 tx=0).stop 2024-09-10T23:16:51.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.798+0000 7ffaf6000640 1 -- 172.21.15.3:0/4254049294 shutdown_connections 2024-09-10T23:16:51.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.798+0000 7ffaf6000640 1 --2- 172.21.15.3:0/4254049294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffaf0109150 0x7ffaf019eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.798+0000 7ffaf6000640 1 --2- 172.21.15.3:0/4254049294 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ffad40b53a0 0x7ffad40b7860 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.798+0000 7ffaf6000640 1 --2- 172.21.15.3:0/4254049294 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffaf01087d0 0x7ffaf0199740 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.798+0000 7ffaf6000640 1 --2- 172.21.15.3:0/4254049294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffaf0102dc0 0x7ffaf0199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.798+0000 7ffaf6000640 1 -- 172.21.15.3:0/4254049294 >> 172.21.15.3:0/4254049294 conn(0x7ffaf00fe830 msgr2=0x7ffaf0106a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:51.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.798+0000 7ffaf6000640 1 -- 172.21.15.3:0/4254049294 shutdown_connections 2024-09-10T23:16:51.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:16:51.798+0000 7ffaf6000640 1 -- 172.21.15.3:0/4254049294 wait complete. 2024-09-10T23:16:52.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:52 smithi194 ceph-mon[33904]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:52.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:52 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/4254049294' entity='client.admin' 2024-09-10T23:16:52.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:52 smithi003 ceph-mon[30348]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:52.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:52 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/4254049294' entity='client.admin' 2024-09-10T23:16:52.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:52 smithi038 ceph-mon[34225]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:52.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:52 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/4254049294' entity='client.admin' 2024-09-10T23:16:53.389 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3f4e30d0-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi003') 2024-09-10T23:16:53.389 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3f4e30d0-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi003') 2024-09-10T23:16:53.389 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3f4e30d0-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi003') 2024-09-10T23:16:53.389 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3f4e30d0-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi003') 2024-09-10T23:16:53.389 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3f4e30d0-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi003') 2024-09-10T23:16:53.389 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3f4e30d0-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi003') 2024-09-10T23:16:53.389 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3f4e30d0-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi003') 2024-09-10T23:16:53.390 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3f4e30d0-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi003') 2024-09-10T23:16:53.390 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3f4e30d0-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='smithi003') 2024-09-10T23:16:53.390 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3f4e30d0-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='smithi003') 2024-09-10T23:16:53.390 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3f4e30d0-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='smithi003') 2024-09-10T23:16:53.390 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3f4e30d0-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/log_level', 'debug'], check_status=True, hostname='smithi003') 2024-09-10T23:16:53.390 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3f4e30d0-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi003') 2024-09-10T23:16:53.390 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3f4e30d0-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi003') 2024-09-10T23:16:53.390 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3f4e30d0-6fca-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi003') 2024-09-10T23:16:53.391 INFO:tasks.cephadm:Deploying OSDs... 2024-09-10T23:16:53.391 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-10T23:16:53.391 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T23:16:53.427 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T23:16:53.427 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_1 2024-09-10T23:16:53.502 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T23:16:53.502 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:16:53.503 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-09-10T23:16:53.503 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:16:53.503 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:16:53.503 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2024-09-10 23:15:21.788280651 +0000 2024-09-10T23:16:53.503 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2024-09-10 23:10:38.596245503 +0000 2024-09-10T23:16:53.503 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2024-09-10 23:10:38.596245503 +0000 2024-09-10T23:16:53.503 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: 2024-09-10 23:10:38.596245503 +0000 2024-09-10T23:16:53.504 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T23:16:53.598 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2024-09-10T23:16:53.599 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2024-09-10T23:16:53.599 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000281031 s, 1.8 MB/s 2024-09-10T23:16:53.601 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T23:16:53.638 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_2 2024-09-10T23:16:53.715 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T23:16:53.715 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:16:53.715 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-09-10T23:16:53.715 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:16:53.716 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:16:53.716 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2024-09-10 23:15:21.843279969 +0000 2024-09-10T23:16:53.716 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2024-09-10 23:10:39.059239531 +0000 2024-09-10T23:16:53.716 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2024-09-10 23:10:39.059239531 +0000 2024-09-10T23:16:53.716 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: 2024-09-10 23:10:39.059239531 +0000 2024-09-10T23:16:53.716 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T23:16:53.808 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2024-09-10T23:16:53.808 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2024-09-10T23:16:53.808 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000281713 s, 1.8 MB/s 2024-09-10T23:16:53.811 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T23:16:53.847 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_3 2024-09-10T23:16:53.921 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T23:16:53.922 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:16:53.922 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-09-10T23:16:53.922 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:16:53.922 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:16:53.922 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2024-09-10 23:15:21.911279126 +0000 2024-09-10T23:16:53.922 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2024-09-10 23:10:39.524233533 +0000 2024-09-10T23:16:53.922 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2024-09-10 23:10:39.524233533 +0000 2024-09-10T23:16:53.922 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: 2024-09-10 23:10:39.524233533 +0000 2024-09-10T23:16:53.922 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T23:16:54.015 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2024-09-10T23:16:54.015 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2024-09-10T23:16:54.015 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000313514 s, 1.6 MB/s 2024-09-10T23:16:54.017 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T23:16:54.054 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_4 2024-09-10T23:16:54.129 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T23:16:54.129 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:16:54.129 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-09-10T23:16:54.129 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:16:54.129 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:16:54.129 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2024-09-10 23:15:21.978278296 +0000 2024-09-10T23:16:54.129 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2024-09-10 23:10:40.016227187 +0000 2024-09-10T23:16:54.129 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2024-09-10 23:10:40.016227187 +0000 2024-09-10T23:16:54.129 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: 2024-09-10 23:10:40.016227187 +0000 2024-09-10T23:16:54.130 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T23:16:54.221 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2024-09-10T23:16:54.222 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2024-09-10T23:16:54.222 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000257257 s, 2.0 MB/s 2024-09-10T23:16:54.224 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T23:16:54.261 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-10T23:16:54.261 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T23:16:54.302 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T23:16:54.302 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_1 2024-09-10T23:16:54.381 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T23:16:54.381 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:16:54.381 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-09-10T23:16:54.382 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:16:54.382 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:16:54.382 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2024-09-10 23:16:35.292765240 +0000 2024-09-10T23:16:54.382 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2024-09-10 23:10:44.180655216 +0000 2024-09-10T23:16:54.382 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2024-09-10 23:10:44.180655216 +0000 2024-09-10T23:16:54.382 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2024-09-10 23:10:44.180655216 +0000 2024-09-10T23:16:54.382 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T23:16:54.481 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2024-09-10T23:16:54.481 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2024-09-10T23:16:54.481 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000437893 s, 1.2 MB/s 2024-09-10T23:16:54.483 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T23:16:54.521 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_2 2024-09-10T23:16:54.597 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T23:16:54.597 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:16:54.597 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-09-10T23:16:54.598 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:16:54.598 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:16:54.599 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2024-09-10 23:16:35.292765240 +0000 2024-09-10T23:16:54.599 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2024-09-10 23:10:44.637646367 +0000 2024-09-10T23:16:54.599 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2024-09-10 23:10:44.637646367 +0000 2024-09-10T23:16:54.599 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2024-09-10 23:10:44.637646367 +0000 2024-09-10T23:16:54.599 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T23:16:54.691 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2024-09-10T23:16:54.691 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2024-09-10T23:16:54.691 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000352891 s, 1.5 MB/s 2024-09-10T23:16:54.694 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T23:16:54.730 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_3 2024-09-10T23:16:54.805 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T23:16:54.805 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:16:54.805 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-09-10T23:16:54.805 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:16:54.805 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:16:54.806 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2024-09-10 23:16:35.293765221 +0000 2024-09-10T23:16:54.806 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2024-09-10 23:10:45.127636878 +0000 2024-09-10T23:16:54.806 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2024-09-10 23:10:45.127636878 +0000 2024-09-10T23:16:54.806 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2024-09-10 23:10:45.127636878 +0000 2024-09-10T23:16:54.806 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T23:16:54.849 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:54 smithi038 ceph-mon[34225]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:54.898 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2024-09-10T23:16:54.898 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2024-09-10T23:16:54.898 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000375785 s, 1.4 MB/s 2024-09-10T23:16:54.901 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T23:16:54.938 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_4 2024-09-10T23:16:54.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:54 smithi194 ceph-mon[33904]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:54.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:54 smithi003 ceph-mon[30348]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:55.013 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T23:16:55.013 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:16:55.013 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-09-10T23:16:55.013 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:16:55.014 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:16:55.014 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2024-09-10 23:16:35.294765202 +0000 2024-09-10T23:16:55.014 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2024-09-10 23:10:45.619627352 +0000 2024-09-10T23:16:55.014 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2024-09-10 23:10:45.619627352 +0000 2024-09-10T23:16:55.014 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2024-09-10 23:10:45.619627352 +0000 2024-09-10T23:16:55.014 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T23:16:55.106 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2024-09-10T23:16:55.106 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2024-09-10T23:16:55.106 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000353374 s, 1.4 MB/s 2024-09-10T23:16:55.108 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T23:16:55.145 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-10T23:16:55.145 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T23:16:55.187 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T23:16:55.187 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_1 2024-09-10T23:16:55.266 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T23:16:55.266 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:16:55.266 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-09-10T23:16:55.266 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:16:55.266 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:16:55.267 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-10 23:16:32.266504991 +0000 2024-09-10T23:16:55.267 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-10 23:10:37.883492804 +0000 2024-09-10T23:16:55.267 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-10 23:10:37.883492804 +0000 2024-09-10T23:16:55.267 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-09-10 23:10:37.883492804 +0000 2024-09-10T23:16:55.267 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T23:16:55.364 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-10T23:16:55.365 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-10T23:16:55.365 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000367125 s, 1.4 MB/s 2024-09-10T23:16:55.367 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T23:16:55.405 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_2 2024-09-10T23:16:55.480 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T23:16:55.480 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:16:55.480 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-09-10T23:16:55.481 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:16:55.481 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:16:55.481 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-10 23:16:32.266504991 +0000 2024-09-10T23:16:55.481 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-10 23:10:38.422481719 +0000 2024-09-10T23:16:55.481 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-10 23:10:38.422481719 +0000 2024-09-10T23:16:55.481 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-09-10 23:10:38.422481719 +0000 2024-09-10T23:16:55.481 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T23:16:55.574 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-10T23:16:55.614 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-10T23:16:55.614 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000363437 s, 1.4 MB/s 2024-09-10T23:16:55.615 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T23:16:55.652 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_3 2024-09-10T23:16:55.727 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T23:16:55.727 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:16:55.727 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-09-10T23:16:55.727 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:16:55.728 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:16:55.728 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-10 23:16:32.268504951 +0000 2024-09-10T23:16:55.728 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-10 23:10:38.877472361 +0000 2024-09-10T23:16:55.728 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-10 23:10:38.877472361 +0000 2024-09-10T23:16:55.728 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-09-10 23:10:38.877472361 +0000 2024-09-10T23:16:55.728 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T23:16:55.820 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-10T23:16:55.820 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-10T23:16:55.820 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000300295 s, 1.7 MB/s 2024-09-10T23:16:55.822 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T23:16:55.859 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_4 2024-09-10T23:16:55.935 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T23:16:55.936 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:16:55.936 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-09-10T23:16:55.936 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:16:55.936 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:16:55.936 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-10 23:16:32.268504951 +0000 2024-09-10T23:16:55.936 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-10 23:10:39.345462737 +0000 2024-09-10T23:16:55.936 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-10 23:10:39.345462737 +0000 2024-09-10T23:16:55.936 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-09-10 23:10:39.345462737 +0000 2024-09-10T23:16:55.936 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T23:16:56.028 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-10T23:16:56.028 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-10T23:16:56.028 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000263708 s, 1.9 MB/s 2024-09-10T23:16:56.031 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T23:16:56.067 INFO:tasks.cephadm:Deploying osd.0 on smithi003 with /dev/vg_nvme/lv_4... 2024-09-10T23:16:56.068 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T23:16:56.446 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:16:56.814 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:56 smithi003 ceph-mon[30348]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:56.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:56 smithi038 ceph-mon[34225]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:56.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:56 smithi194 ceph-mon[33904]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:58.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:16:58 smithi003 ceph-mon[30348]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:58.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:16:58 smithi038 ceph-mon[34225]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:58.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:16:58 smithi194 ceph-mon[33904]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:16:59.221 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:16:59.253 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi003:vg_nvme/lv_4 2024-09-10T23:16:59.620 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:17:00.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.142+0000 7f531c800640 1 -- 172.21.15.3:0/834420010 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f531410a9b0 msgr2=0x7f531410adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:00.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.142+0000 7f531c800640 1 --2- 172.21.15.3:0/834420010 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f531410a9b0 0x7f531410adf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5304009900 tx=0x7f530402a410 comp rx=0 tx=0).stop 2024-09-10T23:17:00.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.143+0000 7f531c800640 1 -- 172.21.15.3:0/834420010 shutdown_connections 2024-09-10T23:17:00.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.143+0000 7f531c800640 1 --2- 172.21.15.3:0/834420010 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f531410b330 0x7f5314111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:00.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.143+0000 7f531c800640 1 --2- 172.21.15.3:0/834420010 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f531410a9b0 0x7f531410adf0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:00.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.143+0000 7f531c800640 1 --2- 172.21.15.3:0/834420010 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5314104fa0 0x7f5314105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:00.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.143+0000 7f531c800640 1 -- 172.21.15.3:0/834420010 >> 172.21.15.3:0/834420010 conn(0x7f5314100a50 msgr2=0x7f5314102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:00.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.143+0000 7f531c800640 1 -- 172.21.15.3:0/834420010 shutdown_connections 2024-09-10T23:17:00.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.143+0000 7f531c800640 1 -- 172.21.15.3:0/834420010 wait complete. 2024-09-10T23:17:00.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.144+0000 7f531c800640 1 Processor -- start 2024-09-10T23:17:00.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.144+0000 7f531c800640 1 -- start start 2024-09-10T23:17:00.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.144+0000 7f531c800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5314104fa0 0x7f531419b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:00.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.144+0000 7f531c800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f531410a9b0 0x7f531419b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:00.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.144+0000 7f531c800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f531410b330 0x7f53141a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:00.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.144+0000 7f531c800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f5314114e10 con 0x7f531410a9b0 2024-09-10T23:17:00.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.144+0000 7f531c800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5314114c90 con 0x7f5314104fa0 2024-09-10T23:17:00.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.144+0000 7f531c800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5314114f90 con 0x7f531410b330 2024-09-10T23:17:00.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.144+0000 7f5319400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f531410a9b0 0x7f531419b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:00.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.144+0000 7f5319e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5314104fa0 0x7f531419b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:00.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.144+0000 7f5319400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f531410a9b0 0x7f531419b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35110/0 (socket says 172.21.15.3:35110) 2024-09-10T23:17:00.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.144+0000 7f5319e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5314104fa0 0x7f531419b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.3:39486/0 (socket says 172.21.15.3:39486) 2024-09-10T23:17:00.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.144+0000 7f5319400640 1 -- 172.21.15.3:0/2652608062 learned_addr learned my addr 172.21.15.3:0/2652608062 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:17:00.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.145+0000 7f531a800640 1 --2- 172.21.15.3:0/2652608062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f531410b330 0x7f53141a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:00.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.145+0000 7f5319e00640 1 -- 172.21.15.3:0/2652608062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f531410b330 msgr2=0x7f53141a0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:00.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.145+0000 7f5319e00640 1 --2- 172.21.15.3:0/2652608062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f531410b330 0x7f53141a0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:00.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.145+0000 7f5319e00640 1 -- 172.21.15.3:0/2652608062 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f531410a9b0 msgr2=0x7f531419b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:00.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.145+0000 7f5319e00640 1 --2- 172.21.15.3:0/2652608062 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f531410a9b0 0x7f531419b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:00.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.145+0000 7f5319e00640 1 -- 172.21.15.3:0/2652608062 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53141a1410 con 0x7f5314104fa0 2024-09-10T23:17:00.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.145+0000 7f5319e00640 1 --2- 172.21.15.3:0/2652608062 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5314104fa0 0x7f531419b360 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f530800e9f0 tx=0x7f530800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:00.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.145+0000 7f530ea00640 1 -- 172.21.15.3:0/2652608062 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530800cd80 con 0x7f5314104fa0 2024-09-10T23:17:00.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.145+0000 7f530ea00640 1 -- 172.21.15.3:0/2652608062 <== mon.2 v2:172.21.15.38:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f53080035f0 con 0x7f5314104fa0 2024-09-10T23:17:00.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.145+0000 7f530ea00640 1 -- 172.21.15.3:0/2652608062 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5308010670 con 0x7f5314104fa0 2024-09-10T23:17:00.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.145+0000 7f531c800640 1 -- 172.21.15.3:0/2652608062 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53141a1700 con 0x7f5314104fa0 2024-09-10T23:17:00.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.146+0000 7f531c800640 1 -- 172.21.15.3:0/2652608062 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53141a7dc0 con 0x7f5314104fa0 2024-09-10T23:17:00.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.147+0000 7f531c800640 1 -- 172.21.15.3:0/2652608062 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5314105380 con 0x7f5314104fa0 2024-09-10T23:17:00.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.149+0000 7f530ea00640 1 -- 172.21.15.3:0/2652608062 <== mon.2 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) ==== 153210+0+0 (secure 0 0 0) 0x7f5308004000 con 0x7f5314104fa0 2024-09-10T23:17:00.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.150+0000 7f530ea00640 1 --2- 172.21.15.3:0/2652608062 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f52fc0b5320 0x7f52fc0b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:00.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.150+0000 7f530ea00640 1 -- 172.21.15.3:0/2652608062 <== mon.2 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f53080e43c0 con 0x7f5314104fa0 2024-09-10T23:17:00.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.151+0000 7f5319400640 1 --2- 172.21.15.3:0/2652608062 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f52fc0b5320 0x7f52fc0b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:00.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.151+0000 7f5319400640 1 --2- 172.21.15.3:0/2652608062 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f52fc0b5320 0x7f52fc0b77e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5314107690 tx=0x7f5304009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:00.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.152+0000 7f530ea00640 1 -- 172.21.15.3:0/2652608062 <== mon.2 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f53080acde0 con 0x7f5314104fa0 2024-09-10T23:17:00.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:00.359+0000 7f531c800640 1 -- 172.21.15.3:0/2652608062 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f5314063590 con 0x7f52fc0b5320 2024-09-10T23:17:00.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:00 smithi003 ceph-mon[30348]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:00.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:00 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:17:00.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:00 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:17:00.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:00 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:00.849 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:00 smithi038 ceph-mon[34225]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:00.850 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:00 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:17:00.850 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:00 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:17:00.850 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:00 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:00.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:00 smithi194 ceph-mon[33904]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:00.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:00 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:17:00.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:00 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:17:00.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:00 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:01.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:01 smithi038 ceph-mon[34225]: from='client.34271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:17:01.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:01 smithi194 ceph-mon[33904]: from='client.34271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:17:01.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:01 smithi003 ceph-mon[30348]: from='client.34271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:17:02.842 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:02 smithi003 ceph-mon[30348]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:02.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:02 smithi038 ceph-mon[34225]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:02.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:02 smithi194 ceph-mon[33904]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:03.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:03 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/339648507' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a38330ed-a85b-4e61-b373-dd8f1d5f7ba4"} : dispatch 2024-09-10T23:17:03.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:03 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/339648507' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a38330ed-a85b-4e61-b373-dd8f1d5f7ba4"}]': finished 2024-09-10T23:17:03.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:03 smithi038 ceph-mon[34225]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T23:17:03.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:03 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:17:03.920 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:03 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/339648507' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a38330ed-a85b-4e61-b373-dd8f1d5f7ba4"} : dispatch 2024-09-10T23:17:03.920 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:03 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/339648507' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a38330ed-a85b-4e61-b373-dd8f1d5f7ba4"}]': finished 2024-09-10T23:17:03.920 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:03 smithi003 ceph-mon[30348]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T23:17:03.920 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:03 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:17:03.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:03 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/339648507' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a38330ed-a85b-4e61-b373-dd8f1d5f7ba4"} : dispatch 2024-09-10T23:17:03.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:03 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/339648507' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a38330ed-a85b-4e61-b373-dd8f1d5f7ba4"}]': finished 2024-09-10T23:17:03.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:03 smithi194 ceph-mon[33904]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T23:17:03.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:03 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:17:04.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:04 smithi038 ceph-mon[34225]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:04.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:04 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/391626337' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:17:04.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:04 smithi194 ceph-mon[33904]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:04.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:04 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/391626337' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:17:04.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:04 smithi003 ceph-mon[30348]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:04.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:04 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/391626337' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:17:06.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:06 smithi038 ceph-mon[34225]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:06.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:06 smithi194 ceph-mon[33904]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:06.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:06 smithi003 ceph-mon[30348]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:07.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:07 smithi194 ceph-mon[33904]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:07.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:07 smithi003 ceph-mon[30348]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:08.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:07 smithi038 ceph-mon[34225]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:10.007 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:09 smithi003 ceph-mon[30348]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:10.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:09 smithi038 ceph-mon[34225]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:10.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:09 smithi194 ceph-mon[33904]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:11.809 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:11 smithi003 ceph-mon[30348]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:12.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:11 smithi038 ceph-mon[34225]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:12.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:11 smithi194 ceph-mon[33904]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:12.959 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:12 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T23:17:12.959 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:12 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:12.959 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:12 smithi003 ceph-mon[30348]: Deploying daemon osd.0 on smithi003 2024-09-10T23:17:13.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:12 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T23:17:13.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:12 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:13.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:12 smithi038 ceph-mon[34225]: Deploying daemon osd.0 on smithi003 2024-09-10T23:17:13.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:12 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T23:17:13.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:12 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:13.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:12 smithi194 ceph-mon[33904]: Deploying daemon osd.0 on smithi003 2024-09-10T23:17:13.968 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:13 smithi003 ceph-mon[30348]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:14.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:13 smithi038 ceph-mon[34225]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:14.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:13 smithi194 ceph-mon[33904]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:15.814 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:15 smithi003 ceph-mon[30348]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:16.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:15 smithi038 ceph-mon[34225]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:16.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:15 smithi194 ceph-mon[33904]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:18.006 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:17 smithi003 ceph-mon[30348]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:18.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:17 smithi038 ceph-mon[34225]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:18.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:17 smithi194 ceph-mon[33904]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:19.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:19 smithi003 ceph-mon[30348]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:20.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:19 smithi038 ceph-mon[34225]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:20.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:19 smithi194 ceph-mon[33904]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:21.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:20 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:17:21.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:20 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:21.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:20 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:21.098 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:20 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:17:21.099 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:20 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:21.099 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:20 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:21.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:20 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:17:21.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:20 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:21.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:20 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:22.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:21 smithi038 ceph-mon[34225]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:22.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:21 smithi194 ceph-mon[33904]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:22.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:21 smithi003 ceph-mon[30348]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:23.974 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:23 smithi003 ceph-mon[30348]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:23.974 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:23 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:23.974 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:23 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:23.974 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:23 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:23.974 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:23 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:17:23.974 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:23 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:24.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:23 smithi038 ceph-mon[34225]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:24.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:23 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:24.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:23 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:24.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:23 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:24.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:23 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:17:24.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:23 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:24.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:23 smithi194 ceph-mon[33904]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:24.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:23 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:24.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:23 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:24.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:23 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:24.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:23 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:17:24.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:23 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:24.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:24.643+0000 7f530ea00640 1 -- 172.21.15.3:0/2652608062 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5314063590 con 0x7f52fc0b5320 2024-09-10T23:17:24.644 INFO:teuthology.orchestra.run.smithi003.stdout:Created osd(s) 0 on host 'smithi003' 2024-09-10T23:17:24.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:24.645+0000 7f531c800640 1 -- 172.21.15.3:0/2652608062 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f52fc0b5320 msgr2=0x7f52fc0b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:24.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:24.645+0000 7f531c800640 1 --2- 172.21.15.3:0/2652608062 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f52fc0b5320 0x7f52fc0b77e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5314107690 tx=0x7f5304009560 comp rx=0 tx=0).stop 2024-09-10T23:17:24.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:24.645+0000 7f531c800640 1 -- 172.21.15.3:0/2652608062 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5314104fa0 msgr2=0x7f531419b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:24.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:24.645+0000 7f531c800640 1 --2- 172.21.15.3:0/2652608062 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5314104fa0 0x7f531419b360 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f530800e9f0 tx=0x7f530800eeb0 comp rx=0 tx=0).stop 2024-09-10T23:17:24.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:24.645+0000 7f531c800640 1 -- 172.21.15.3:0/2652608062 shutdown_connections 2024-09-10T23:17:24.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:24.645+0000 7f531c800640 1 --2- 172.21.15.3:0/2652608062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f531410b330 0x7f53141a0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:24.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:24.645+0000 7f531c800640 1 --2- 172.21.15.3:0/2652608062 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f52fc0b5320 0x7f52fc0b77e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:24.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:24.645+0000 7f531c800640 1 --2- 172.21.15.3:0/2652608062 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f531410a9b0 0x7f531419b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:24.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:24.645+0000 7f531c800640 1 --2- 172.21.15.3:0/2652608062 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5314104fa0 0x7f531419b360 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:24.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:24.645+0000 7f531c800640 1 -- 172.21.15.3:0/2652608062 >> 172.21.15.3:0/2652608062 conn(0x7f5314100a50 msgr2=0x7f5314102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:24.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:24.645+0000 7f531c800640 1 -- 172.21.15.3:0/2652608062 shutdown_connections 2024-09-10T23:17:24.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:17:24.645+0000 7f531c800640 1 -- 172.21.15.3:0/2652608062 wait complete. 2024-09-10T23:17:24.968 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:24 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:17:24.968 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:24 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:24.968 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:24 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:25.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:24 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:17:25.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:24 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:25.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:24 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:25.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:24 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:17:25.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:24 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:25.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:24 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:25.353 DEBUG:teuthology.orchestra.run.smithi003:osd.0> sudo journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.0.service 2024-09-10T23:17:25.357 INFO:tasks.cephadm:Deploying osd.1 on smithi038 with /dev/vg_nvme/lv_4... 2024-09-10T23:17:25.357 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T23:17:25.726 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:17:25.862 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:25 smithi003 ceph-mon[30348]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:25.990 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:25 smithi038 ceph-mon[34225]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:26.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:25 smithi194 ceph-mon[33904]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:26.221 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 10 23:17:26 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-0[48724]: 2024-09-10T23:17:26.026+0000 7ff454c11640 -1 osd.0 0 log_to_monitors true 2024-09-10T23:17:26.808 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:26 smithi038 ceph-mon[34225]: from='osd.0 [v2:172.21.15.3:6802/824467747,v1:172.21.15.3:6803/824467747]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T23:17:26.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:26 smithi003 ceph-mon[30348]: from='osd.0 [v2:172.21.15.3:6802/824467747,v1:172.21.15.3:6803/824467747]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T23:17:27.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:26 smithi194 ceph-mon[33904]: from='osd.0 [v2:172.21.15.3:6802/824467747,v1:172.21.15.3:6803/824467747]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T23:17:28.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:27 smithi038 ceph-mon[34225]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:28.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:27 smithi038 ceph-mon[34225]: from='osd.0 [v2:172.21.15.3:6802/824467747,v1:172.21.15.3:6803/824467747]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T23:17:28.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:27 smithi038 ceph-mon[34225]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T23:17:28.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:27 smithi038 ceph-mon[34225]: from='osd.0 [v2:172.21.15.3:6802/824467747,v1:172.21.15.3:6803/824467747]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi003", "root=default"]} : dispatch 2024-09-10T23:17:28.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:27 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:17:28.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:27 smithi194 ceph-mon[33904]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:28.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:27 smithi194 ceph-mon[33904]: from='osd.0 [v2:172.21.15.3:6802/824467747,v1:172.21.15.3:6803/824467747]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T23:17:28.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:27 smithi194 ceph-mon[33904]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T23:17:28.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:27 smithi194 ceph-mon[33904]: from='osd.0 [v2:172.21.15.3:6802/824467747,v1:172.21.15.3:6803/824467747]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi003", "root=default"]} : dispatch 2024-09-10T23:17:28.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:27 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:17:28.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:27 smithi003 ceph-mon[30348]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:28.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:27 smithi003 ceph-mon[30348]: from='osd.0 [v2:172.21.15.3:6802/824467747,v1:172.21.15.3:6803/824467747]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T23:17:28.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:27 smithi003 ceph-mon[30348]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T23:17:28.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:27 smithi003 ceph-mon[30348]: from='osd.0 [v2:172.21.15.3:6802/824467747,v1:172.21.15.3:6803/824467747]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi003", "root=default"]} : dispatch 2024-09-10T23:17:28.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:27 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:17:28.540 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T23:17:28.572 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi038:vg_nvme/lv_4 2024-09-10T23:17:28.673 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 10 23:17:28 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-0[48724]: 2024-09-10T23:17:28.283+0000 7ff44f800640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T23:17:28.673 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 10 23:17:28 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-0[48724]: 2024-09-10T23:17:28.299+0000 7ff445800640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:17:28.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:28 smithi038 ceph-mon[34225]: from='osd.0 [v2:172.21.15.3:6802/824467747,v1:172.21.15.3:6803/824467747]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]': finished 2024-09-10T23:17:28.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:28 smithi038 ceph-mon[34225]: osdmap e8: 1 total, 0 up, 1 in 2024-09-10T23:17:28.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:28 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:17:28.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:28 smithi038 ceph-mon[34225]: from='osd.0 [v2:172.21.15.3:6802/824467747,v1:172.21.15.3:6803/824467747]' entity='osd.0' 2024-09-10T23:17:28.948 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:17:28.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:28 smithi003 ceph-mon[30348]: from='osd.0 [v2:172.21.15.3:6802/824467747,v1:172.21.15.3:6803/824467747]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]': finished 2024-09-10T23:17:28.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:28 smithi003 ceph-mon[30348]: osdmap e8: 1 total, 0 up, 1 in 2024-09-10T23:17:28.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:28 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:17:28.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:28 smithi003 ceph-mon[30348]: from='osd.0 [v2:172.21.15.3:6802/824467747,v1:172.21.15.3:6803/824467747]' entity='osd.0' 2024-09-10T23:17:29.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:28 smithi194 ceph-mon[33904]: from='osd.0 [v2:172.21.15.3:6802/824467747,v1:172.21.15.3:6803/824467747]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]': finished 2024-09-10T23:17:29.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:28 smithi194 ceph-mon[33904]: osdmap e8: 1 total, 0 up, 1 in 2024-09-10T23:17:29.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:28 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:17:29.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:28 smithi194 ceph-mon[33904]: from='osd.0 [v2:172.21.15.3:6802/824467747,v1:172.21.15.3:6803/824467747]' entity='osd.0' 2024-09-10T23:17:29.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.462+0000 7fd612200640 1 -- 172.21.15.38:0/1562499482 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd60c104fa0 msgr2=0x7fd60c105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:29.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.462+0000 7fd612200640 1 --2- 172.21.15.38:0/1562499482 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd60c104fa0 0x7fd60c105380 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc009900 tx=0x7fd5fc02a410 comp rx=0 tx=0).stop 2024-09-10T23:17:29.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.462+0000 7fd612200640 1 -- 172.21.15.38:0/1562499482 shutdown_connections 2024-09-10T23:17:29.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.462+0000 7fd612200640 1 --2- 172.21.15.38:0/1562499482 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd60c10b330 0x7fd60c111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:29.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.462+0000 7fd612200640 1 --2- 172.21.15.38:0/1562499482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd60c10a9b0 0x7fd60c10adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:29.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.462+0000 7fd612200640 1 --2- 172.21.15.38:0/1562499482 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd60c104fa0 0x7fd60c105380 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:29.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.462+0000 7fd612200640 1 -- 172.21.15.38:0/1562499482 >> 172.21.15.38:0/1562499482 conn(0x7fd60c100a50 msgr2=0x7fd60c102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:29.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.462+0000 7fd612200640 1 -- 172.21.15.38:0/1562499482 shutdown_connections 2024-09-10T23:17:29.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.462+0000 7fd612200640 1 -- 172.21.15.38:0/1562499482 wait complete. 2024-09-10T23:17:29.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.463+0000 7fd612200640 1 Processor -- start 2024-09-10T23:17:29.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.464+0000 7fd612200640 1 -- start start 2024-09-10T23:17:29.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.464+0000 7fd612200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd60c104fa0 0x7fd60c111940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:29.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.464+0000 7fd612200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd60c10a9b0 0x7fd60c10eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:29.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.464+0000 7fd612200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd60c10b330 0x7fd60c10f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:29.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.464+0000 7fd612200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c114e10 con 0x7fd60c10a9b0 2024-09-10T23:17:29.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.464+0000 7fd612200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c114c90 con 0x7fd60c10b330 2024-09-10T23:17:29.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.464+0000 7fd612200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c114f90 con 0x7fd60c104fa0 2024-09-10T23:17:29.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.464+0000 7fd60be00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd60c10b330 0x7fd60c10f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:29.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.464+0000 7fd60b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd60c104fa0 0x7fd60c111940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:29.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.464+0000 7fd60aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd60c10a9b0 0x7fd60c10eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:29.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.464+0000 7fd60be00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd60c10b330 0x7fd60c10f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47712/0 (socket says 172.21.15.38:47712) 2024-09-10T23:17:29.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.464+0000 7fd60aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd60c10a9b0 0x7fd60c10eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.38:55060/0 (socket says 172.21.15.38:55060) 2024-09-10T23:17:29.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.464+0000 7fd60be00640 1 -- 172.21.15.38:0/2542095957 learned_addr learned my addr 172.21.15.38:0/2542095957 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-10T23:17:29.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.464+0000 7fd60b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd60c104fa0 0x7fd60c111940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.38:40552/0 (socket says 172.21.15.38:40552) 2024-09-10T23:17:29.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.465+0000 7fd60aa00640 1 -- 172.21.15.38:0/2542095957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd60c104fa0 msgr2=0x7fd60c111940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:29.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.465+0000 7fd60aa00640 1 --2- 172.21.15.38:0/2542095957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd60c104fa0 0x7fd60c111940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:29.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.465+0000 7fd60aa00640 1 -- 172.21.15.38:0/2542095957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd60c10b330 msgr2=0x7fd60c10f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:29.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.465+0000 7fd60aa00640 1 --2- 172.21.15.38:0/2542095957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd60c10b330 0x7fd60c10f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:29.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.465+0000 7fd60aa00640 1 -- 172.21.15.38:0/2542095957 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd60c1abb50 con 0x7fd60c10a9b0 2024-09-10T23:17:29.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.465+0000 7fd60be00640 1 --2- 172.21.15.38:0/2542095957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd60c10b330 0x7fd60c10f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:17:29.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.465+0000 7fd60aa00640 1 --2- 172.21.15.38:0/2542095957 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd60c10a9b0 0x7fd60c10eb90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd5f800e9f0 tx=0x7fd5f800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:29.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.466+0000 7fd603e00640 1 -- 172.21.15.38:0/2542095957 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f800ccc0 con 0x7fd60c10a9b0 2024-09-10T23:17:29.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.466+0000 7fd603e00640 1 -- 172.21.15.38:0/2542095957 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd5f8005020 con 0x7fd60c10a9b0 2024-09-10T23:17:29.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.466+0000 7fd612200640 1 -- 172.21.15.38:0/2542095957 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd60c1abd20 con 0x7fd60c10a9b0 2024-09-10T23:17:29.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.466+0000 7fd603e00640 1 -- 172.21.15.38:0/2542095957 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f800ce60 con 0x7fd60c10a9b0 2024-09-10T23:17:29.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.466+0000 7fd612200640 1 -- 172.21.15.38:0/2542095957 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd60c1ac180 con 0x7fd60c10a9b0 2024-09-10T23:17:29.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.467+0000 7fd612200640 1 -- 172.21.15.38:0/2542095957 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd60c105380 con 0x7fd60c10a9b0 2024-09-10T23:17:29.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.469+0000 7fd603e00640 1 -- 172.21.15.38:0/2542095957 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 153210+0+0 (secure 0 0 0) 0x7fd5f8004a40 con 0x7fd60c10a9b0 2024-09-10T23:17:29.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.470+0000 7fd603e00640 1 --2- 172.21.15.38:0/2542095957 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd5f00b5320 0x7fd5f00b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:29.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.471+0000 7fd603e00640 1 -- 172.21.15.38:0/2542095957 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1982+0+0 (secure 0 0 0) 0x7fd5f80e41d0 con 0x7fd60c10a9b0 2024-09-10T23:17:29.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.471+0000 7fd60b400640 1 --2- 172.21.15.38:0/2542095957 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd5f00b5320 0x7fd5f00b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:29.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.471+0000 7fd60b400640 1 --2- 172.21.15.38:0/2542095957 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd5f00b5320 0x7fd5f00b77e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc0057c0 tx=0x7fd5fc0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:29.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.473+0000 7fd603e00640 1 -- 172.21.15.38:0/2542095957 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd5f80ac990 con 0x7fd60c10a9b0 2024-09-10T23:17:29.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:29.682+0000 7fd612200640 1 -- 172.21.15.38:0/2542095957 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fd60c02e620 con 0x7fd5f00b5320 2024-09-10T23:17:30.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:29 smithi038 ceph-mon[34225]: purged_snaps scrub starts 2024-09-10T23:17:30.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:29 smithi038 ceph-mon[34225]: purged_snaps scrub ok 2024-09-10T23:17:30.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:29 smithi038 ceph-mon[34225]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:30.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:29 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:17:30.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:29 smithi038 ceph-mon[34225]: Detected new or changed devices on smithi003 2024-09-10T23:17:30.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:29 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:30.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:29 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:30.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:29 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:17:30.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:29 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:17:30.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:29 smithi038 ceph-mon[34225]: Adjusting osd_memory_target on smithi003 to 17094M 2024-09-10T23:17:30.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:29 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:30.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:29 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:30.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:29 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:17:30.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:29 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:30.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:29 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:17:30.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:29 smithi038 ceph-mon[34225]: osd.0 [v2:172.21.15.3:6802/824467747,v1:172.21.15.3:6803/824467747] boot 2024-09-10T23:17:30.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:29 smithi038 ceph-mon[34225]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T23:17:30.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:29 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:17:30.099 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:29 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:17:30.099 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:29 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:30.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:29 smithi194 ceph-mon[33904]: purged_snaps scrub starts 2024-09-10T23:17:30.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:29 smithi194 ceph-mon[33904]: purged_snaps scrub ok 2024-09-10T23:17:30.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:29 smithi194 ceph-mon[33904]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:30.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:29 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:17:30.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:29 smithi194 ceph-mon[33904]: Detected new or changed devices on smithi003 2024-09-10T23:17:30.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:29 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:30.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:29 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:30.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:29 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:17:30.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:29 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:17:30.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:29 smithi194 ceph-mon[33904]: Adjusting osd_memory_target on smithi003 to 17094M 2024-09-10T23:17:30.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:29 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:30.199 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:29 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:30.199 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:29 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:17:30.199 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:29 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:30.199 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:29 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:17:30.199 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:29 smithi194 ceph-mon[33904]: osd.0 [v2:172.21.15.3:6802/824467747,v1:172.21.15.3:6803/824467747] boot 2024-09-10T23:17:30.199 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:29 smithi194 ceph-mon[33904]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T23:17:30.199 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:29 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:17:30.199 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:29 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:17:30.199 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:29 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:30.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:29 smithi003 ceph-mon[30348]: purged_snaps scrub starts 2024-09-10T23:17:30.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:29 smithi003 ceph-mon[30348]: purged_snaps scrub ok 2024-09-10T23:17:30.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:29 smithi003 ceph-mon[30348]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:17:30.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:29 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:17:30.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:29 smithi003 ceph-mon[30348]: Detected new or changed devices on smithi003 2024-09-10T23:17:30.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:29 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:30.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:29 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:30.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:29 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:17:30.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:29 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:17:30.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:29 smithi003 ceph-mon[30348]: Adjusting osd_memory_target on smithi003 to 17094M 2024-09-10T23:17:30.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:29 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:30.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:29 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:30.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:29 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:17:30.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:29 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:30.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:29 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:17:30.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:29 smithi003 ceph-mon[30348]: osd.0 [v2:172.21.15.3:6802/824467747,v1:172.21.15.3:6803/824467747] boot 2024-09-10T23:17:30.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:29 smithi003 ceph-mon[30348]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T23:17:30.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:29 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:17:30.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:29 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:17:30.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:29 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:31.071 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:30 smithi038 ceph-mon[34225]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:17:31.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:30 smithi194 ceph-mon[33904]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:17:31.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:30 smithi003 ceph-mon[30348]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:17:31.977 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:31 smithi038 ceph-mon[34225]: pgmap v32: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:31.977 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:31 smithi038 ceph-mon[34225]: osdmap e10: 1 total, 1 up, 1 in 2024-09-10T23:17:32.050 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:31 smithi194 ceph-mon[33904]: pgmap v32: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:32.050 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:31 smithi194 ceph-mon[33904]: osdmap e10: 1 total, 1 up, 1 in 2024-09-10T23:17:32.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:31 smithi003 ceph-mon[30348]: pgmap v32: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:32.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:31 smithi003 ceph-mon[30348]: osdmap e10: 1 total, 1 up, 1 in 2024-09-10T23:17:32.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:32 smithi194 ceph-mon[33904]: from='client.? 172.21.15.38:0/4104370259' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "49bb1212-a83e-4f85-ad71-d863880d8268"} : dispatch 2024-09-10T23:17:32.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:32 smithi194 ceph-mon[33904]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "49bb1212-a83e-4f85-ad71-d863880d8268"} : dispatch 2024-09-10T23:17:32.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:32 smithi194 ceph-mon[33904]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "49bb1212-a83e-4f85-ad71-d863880d8268"}]': finished 2024-09-10T23:17:32.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:32 smithi194 ceph-mon[33904]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T23:17:32.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:32 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:17:33.018 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:32 smithi038 ceph-mon[34225]: from='client.? 172.21.15.38:0/4104370259' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "49bb1212-a83e-4f85-ad71-d863880d8268"} : dispatch 2024-09-10T23:17:33.019 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:32 smithi038 ceph-mon[34225]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "49bb1212-a83e-4f85-ad71-d863880d8268"} : dispatch 2024-09-10T23:17:33.019 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:32 smithi038 ceph-mon[34225]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "49bb1212-a83e-4f85-ad71-d863880d8268"}]': finished 2024-09-10T23:17:33.019 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:32 smithi038 ceph-mon[34225]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T23:17:33.019 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:32 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:17:33.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:32 smithi003 ceph-mon[30348]: from='client.? 172.21.15.38:0/4104370259' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "49bb1212-a83e-4f85-ad71-d863880d8268"} : dispatch 2024-09-10T23:17:33.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:32 smithi003 ceph-mon[30348]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "49bb1212-a83e-4f85-ad71-d863880d8268"} : dispatch 2024-09-10T23:17:33.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:32 smithi003 ceph-mon[30348]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "49bb1212-a83e-4f85-ad71-d863880d8268"}]': finished 2024-09-10T23:17:33.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:32 smithi003 ceph-mon[30348]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T23:17:33.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:32 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:17:34.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:33 smithi038 ceph-mon[34225]: pgmap v34: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:34.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:33 smithi038 ceph-mon[34225]: from='client.? 172.21.15.38:0/2564517774' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:17:34.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:33 smithi194 ceph-mon[33904]: pgmap v34: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:34.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:33 smithi194 ceph-mon[33904]: from='client.? 172.21.15.38:0/2564517774' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:17:34.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:33 smithi003 ceph-mon[30348]: pgmap v34: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:34.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:33 smithi003 ceph-mon[30348]: from='client.? 172.21.15.38:0/2564517774' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:17:36.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:35 smithi038 ceph-mon[34225]: pgmap v36: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:36.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:35 smithi194 ceph-mon[33904]: pgmap v36: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:36.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:35 smithi003 ceph-mon[30348]: pgmap v36: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:38.073 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:37 smithi038 ceph-mon[34225]: pgmap v37: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:38.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:37 smithi194 ceph-mon[33904]: pgmap v37: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:38.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:37 smithi003 ceph-mon[30348]: pgmap v37: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:40.038 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:39 smithi038 ceph-mon[34225]: pgmap v38: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:40.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:39 smithi194 ceph-mon[33904]: pgmap v38: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:40.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:39 smithi003 ceph-mon[30348]: pgmap v38: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:42.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:41 smithi038 ceph-mon[34225]: pgmap v39: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:42.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:41 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T23:17:42.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:41 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:42.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:41 smithi038 ceph-mon[34225]: Deploying daemon osd.1 on smithi038 2024-09-10T23:17:42.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:41 smithi194 ceph-mon[33904]: pgmap v39: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:42.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:41 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T23:17:42.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:41 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:42.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:41 smithi194 ceph-mon[33904]: Deploying daemon osd.1 on smithi038 2024-09-10T23:17:42.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:41 smithi003 ceph-mon[30348]: pgmap v39: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:42.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:41 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T23:17:42.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:41 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:42.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:41 smithi003 ceph-mon[30348]: Deploying daemon osd.1 on smithi038 2024-09-10T23:17:44.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:43 smithi038 ceph-mon[34225]: pgmap v40: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:44.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:43 smithi194 ceph-mon[33904]: pgmap v40: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:44.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:43 smithi003 ceph-mon[30348]: pgmap v40: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:45.956 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:45 smithi038 ceph-mon[34225]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:46.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:45 smithi194 ceph-mon[33904]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:46.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:45 smithi003 ceph-mon[30348]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:48.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:47 smithi038 ceph-mon[34225]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:48.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:47 smithi194 ceph-mon[33904]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:48.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:47 smithi003 ceph-mon[30348]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:50.061 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:49 smithi038 ceph-mon[34225]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:50.061 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:49 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:17:50.061 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:49 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:50.061 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:49 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:50.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:49 smithi194 ceph-mon[33904]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:50.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:49 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:17:50.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:49 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:50.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:49 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:50.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:49 smithi003 ceph-mon[30348]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:50.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:49 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:17:50.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:49 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:50.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:49 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:52.054 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:51 smithi038 ceph-mon[34225]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:52.125 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:51 smithi003 ceph-mon[30348]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:52.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:51 smithi194 ceph-mon[33904]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:53.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:53 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:53.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:53 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:53.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:53 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:53.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:53 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:17:53.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:53 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:53.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:53 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:53.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:53 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:53.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:53 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:53.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:53 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:17:53.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:53 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:53.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:53 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:53.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:53 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:53.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:53 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:53.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:53 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:17:53.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:53 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:54.213 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:54 smithi038 ceph-mon[34225]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:54.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:54.268+0000 7fd603e00640 1 -- 172.21.15.38:0/2542095957 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd60c02e620 con 0x7fd5f00b5320 2024-09-10T23:17:54.269 INFO:teuthology.orchestra.run.smithi038.stdout:Created osd(s) 1 on host 'smithi038' 2024-09-10T23:17:54.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:54.270+0000 7fd612200640 1 -- 172.21.15.38:0/2542095957 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd5f00b5320 msgr2=0x7fd5f00b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:54.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:54.270+0000 7fd612200640 1 --2- 172.21.15.38:0/2542095957 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd5f00b5320 0x7fd5f00b77e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc0057c0 tx=0x7fd5fc0058d0 comp rx=0 tx=0).stop 2024-09-10T23:17:54.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:54.270+0000 7fd612200640 1 -- 172.21.15.38:0/2542095957 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd60c10a9b0 msgr2=0x7fd60c10eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:54.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:54.270+0000 7fd612200640 1 --2- 172.21.15.38:0/2542095957 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd60c10a9b0 0x7fd60c10eb90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd5f800e9f0 tx=0x7fd5f800eeb0 comp rx=0 tx=0).stop 2024-09-10T23:17:54.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:54.270+0000 7fd612200640 1 -- 172.21.15.38:0/2542095957 shutdown_connections 2024-09-10T23:17:54.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:54.270+0000 7fd612200640 1 --2- 172.21.15.38:0/2542095957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd60c10b330 0x7fd60c10f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:54.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:54.270+0000 7fd612200640 1 --2- 172.21.15.38:0/2542095957 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd5f00b5320 0x7fd5f00b77e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:54.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:54.270+0000 7fd612200640 1 --2- 172.21.15.38:0/2542095957 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd60c10a9b0 0x7fd60c10eb90 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:54.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:54.270+0000 7fd612200640 1 --2- 172.21.15.38:0/2542095957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd60c104fa0 0x7fd60c111940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:54.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:54.270+0000 7fd612200640 1 -- 172.21.15.38:0/2542095957 >> 172.21.15.38:0/2542095957 conn(0x7fd60c100a50 msgr2=0x7fd60c102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:54.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:54.271+0000 7fd612200640 1 -- 172.21.15.38:0/2542095957 shutdown_connections 2024-09-10T23:17:54.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:17:54.271+0000 7fd612200640 1 -- 172.21.15.38:0/2542095957 wait complete. 2024-09-10T23:17:54.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:54 smithi194 ceph-mon[33904]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:54.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:54 smithi003 ceph-mon[30348]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:55.049 DEBUG:teuthology.orchestra.run.smithi038:osd.1> sudo journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.1.service 2024-09-10T23:17:55.053 INFO:tasks.cephadm:Deploying osd.2 on smithi194 with /dev/vg_nvme/lv_4... 2024-09-10T23:17:55.053 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T23:17:55.325 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:55 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:17:55.325 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:55 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:55.325 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:55 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:55.423 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:17:55.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:55 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:17:55.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:55 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:55.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:55 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:55.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:55 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:17:55.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:55 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:55.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:55 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:55.847 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 10 23:17:55 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-1[39981]: 2024-09-10T23:17:55.577+0000 7f8c22021640 -1 osd.1 0 log_to_monitors true 2024-09-10T23:17:56.516 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:56 smithi038 ceph-mon[34225]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:56.516 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:56 smithi038 ceph-mon[34225]: from='osd.1 [v2:172.21.15.38:6800/1447444485,v1:172.21.15.38:6801/1447444485]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T23:17:56.516 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:56 smithi038 ceph-mon[34225]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T23:17:56.542 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:56 smithi194 ceph-mon[33904]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:56.542 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:56 smithi194 ceph-mon[33904]: from='osd.1 [v2:172.21.15.38:6800/1447444485,v1:172.21.15.38:6801/1447444485]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T23:17:56.542 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:56 smithi194 ceph-mon[33904]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T23:17:56.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:56 smithi003 ceph-mon[30348]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:56.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:56 smithi003 ceph-mon[30348]: from='osd.1 [v2:172.21.15.38:6800/1447444485,v1:172.21.15.38:6801/1447444485]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T23:17:56.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:56 smithi003 ceph-mon[30348]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T23:17:57.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:57 smithi038 ceph-mon[34225]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T23:17:57.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:57 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:17:57.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:57 smithi038 ceph-mon[34225]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T23:17:57.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:57 smithi038 ceph-mon[34225]: from='osd.1 [v2:172.21.15.38:6800/1447444485,v1:172.21.15.38:6801/1447444485]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-10T23:17:57.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:57 smithi038 ceph-mon[34225]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-10T23:17:57.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:57 smithi038 ceph-mon[34225]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-10T23:17:57.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:57 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:17:57.599 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:57 smithi038 ceph-mon[34225]: osdmap e13: 2 total, 1 up, 2 in 2024-09-10T23:17:57.623 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:57 smithi194 ceph-mon[33904]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T23:17:57.623 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:57 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:17:57.624 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:57 smithi194 ceph-mon[33904]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T23:17:57.624 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:57 smithi194 ceph-mon[33904]: from='osd.1 [v2:172.21.15.38:6800/1447444485,v1:172.21.15.38:6801/1447444485]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-10T23:17:57.624 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:57 smithi194 ceph-mon[33904]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-10T23:17:57.624 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:57 smithi194 ceph-mon[33904]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-10T23:17:57.624 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:57 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:17:57.624 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:57 smithi194 ceph-mon[33904]: osdmap e13: 2 total, 1 up, 2 in 2024-09-10T23:17:57.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:57 smithi003 ceph-mon[30348]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T23:17:57.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:57 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:17:57.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:57 smithi003 ceph-mon[30348]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T23:17:57.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:57 smithi003 ceph-mon[30348]: from='osd.1 [v2:172.21.15.38:6800/1447444485,v1:172.21.15.38:6801/1447444485]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-10T23:17:57.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:57 smithi003 ceph-mon[30348]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-10T23:17:57.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:57 smithi003 ceph-mon[30348]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-10T23:17:57.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:57 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:17:57.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:57 smithi003 ceph-mon[30348]: osdmap e13: 2 total, 1 up, 2 in 2024-09-10T23:17:58.043 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 10 23:17:57 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-1[39981]: 2024-09-10T23:17:57.815+0000 7f8c1cc00640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T23:17:58.043 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 10 23:17:57 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-1[39981]: 2024-09-10T23:17:57.839+0000 7f8c12c00640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:17:58.254 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-10T23:17:58.288 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi194:vg_nvme/lv_4 2024-09-10T23:17:58.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:58 smithi038 ceph-mon[34225]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:58.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:58 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:17:58.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:58 smithi038 ceph-mon[34225]: from='osd.1 ' entity='osd.1' 2024-09-10T23:17:58.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:58 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:17:58.645 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:17:58.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:58 smithi194 ceph-mon[33904]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:58.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:58 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:17:58.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:58 smithi194 ceph-mon[33904]: from='osd.1 ' entity='osd.1' 2024-09-10T23:17:58.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:58 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:17:58.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:58 smithi003 ceph-mon[30348]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:17:58.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:58 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:17:58.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:58 smithi003 ceph-mon[30348]: from='osd.1 ' entity='osd.1' 2024-09-10T23:17:58.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:58 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:17:59.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.164+0000 7fbf17a00640 1 -- 172.21.15.194:0/1984604888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf10109150 msgr2=0x7fbf1010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:59.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.164+0000 7fbf17a00640 1 --2- 172.21.15.194:0/1984604888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf10109150 0x7fbf1010f950 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbf08009900 tx=0x7fbf0802a3f0 comp rx=0 tx=0).stop 2024-09-10T23:17:59.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.164+0000 7fbf17a00640 1 -- 172.21.15.194:0/1984604888 shutdown_connections 2024-09-10T23:17:59.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.164+0000 7fbf17a00640 1 --2- 172.21.15.194:0/1984604888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf10109150 0x7fbf1010f950 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:59.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.164+0000 7fbf17a00640 1 --2- 172.21.15.194:0/1984604888 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf101087d0 0x7fbf10108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:59.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.164+0000 7fbf17a00640 1 --2- 172.21.15.194:0/1984604888 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf10102dc0 0x7fbf101031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:59.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.164+0000 7fbf17a00640 1 -- 172.21.15.194:0/1984604888 >> 172.21.15.194:0/1984604888 conn(0x7fbf100fe830 msgr2=0x7fbf10100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:59.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.164+0000 7fbf17a00640 1 -- 172.21.15.194:0/1984604888 shutdown_connections 2024-09-10T23:17:59.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.165+0000 7fbf17a00640 1 -- 172.21.15.194:0/1984604888 wait complete. 2024-09-10T23:17:59.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.165+0000 7fbf17a00640 1 Processor -- start 2024-09-10T23:17:59.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.166+0000 7fbf17a00640 1 -- start start 2024-09-10T23:17:59.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.166+0000 7fbf17a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf10102dc0 0x7fbf1019b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:59.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.166+0000 7fbf17a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf101087d0 0x7fbf1019b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:59.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.166+0000 7fbf17a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf10109150 0x7fbf101a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:59.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.166+0000 7fbf17a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fbf10112d10 con 0x7fbf10102dc0 2024-09-10T23:17:59.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.166+0000 7fbf17a00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fbf10112b90 con 0x7fbf10109150 2024-09-10T23:17:59.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.166+0000 7fbf17a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fbf10112e90 con 0x7fbf101087d0 2024-09-10T23:17:59.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.166+0000 7fbf0fe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf101087d0 0x7fbf1019b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:59.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.166+0000 7fbf0fe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf101087d0 0x7fbf1019b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:46414/0 (socket says 172.21.15.194:46414) 2024-09-10T23:17:59.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.166+0000 7fbf0fe00640 1 -- 172.21.15.194:0/3206188799 learned_addr learned my addr 172.21.15.194:0/3206188799 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-10T23:17:59.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.166+0000 7fbf15000640 1 --2- 172.21.15.194:0/3206188799 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf10102dc0 0x7fbf1019b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:59.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.166+0000 7fbf15a00640 1 --2- 172.21.15.194:0/3206188799 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf10109150 0x7fbf101a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:59.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.167+0000 7fbf0fe00640 1 -- 172.21.15.194:0/3206188799 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf10109150 msgr2=0x7fbf101a0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:59.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.167+0000 7fbf0fe00640 1 --2- 172.21.15.194:0/3206188799 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf10109150 0x7fbf101a0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:59.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.167+0000 7fbf0fe00640 1 -- 172.21.15.194:0/3206188799 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf10102dc0 msgr2=0x7fbf1019b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:59.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.167+0000 7fbf0fe00640 1 --2- 172.21.15.194:0/3206188799 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf10102dc0 0x7fbf1019b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:59.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.167+0000 7fbf0fe00640 1 -- 172.21.15.194:0/3206188799 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf101a1410 con 0x7fbf101087d0 2024-09-10T23:17:59.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.167+0000 7fbf0fe00640 1 --2- 172.21.15.194:0/3206188799 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf101087d0 0x7fbf1019b8a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbefc00d770 tx=0x7fbefc00dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:59.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.167+0000 7fbf0d600640 1 -- 172.21.15.194:0/3206188799 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc017070 con 0x7fbf101087d0 2024-09-10T23:17:59.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.167+0000 7fbf0d600640 1 -- 172.21.15.194:0/3206188799 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbefc0054b0 con 0x7fbf101087d0 2024-09-10T23:17:59.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.167+0000 7fbf0d600640 1 -- 172.21.15.194:0/3206188799 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc004c60 con 0x7fbf101087d0 2024-09-10T23:17:59.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.167+0000 7fbf17a00640 1 -- 172.21.15.194:0/3206188799 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf101a1700 con 0x7fbf101087d0 2024-09-10T23:17:59.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.168+0000 7fbf17a00640 1 -- 172.21.15.194:0/3206188799 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf101a7dc0 con 0x7fbf101087d0 2024-09-10T23:17:59.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.169+0000 7fbf17a00640 1 -- 172.21.15.194:0/3206188799 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf101031a0 con 0x7fbf101087d0 2024-09-10T23:17:59.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.171+0000 7fbf0d600640 1 -- 172.21.15.194:0/3206188799 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 19) ==== 153210+0+0 (secure 0 0 0) 0x7fbefc004e00 con 0x7fbf101087d0 2024-09-10T23:17:59.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.172+0000 7fbf0d600640 1 --2- 172.21.15.194:0/3206188799 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fbef40b5320 0x7fbef40b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:59.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.172+0000 7fbf0d600640 1 -- 172.21.15.194:0/3206188799 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2524+0+0 (secure 0 0 0) 0x7fbefc0e3df0 con 0x7fbf101087d0 2024-09-10T23:17:59.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.172+0000 7fbf15000640 1 --2- 172.21.15.194:0/3206188799 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fbef40b5320 0x7fbef40b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:59.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.173+0000 7fbf15000640 1 --2- 172.21.15.194:0/3206188799 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fbef40b5320 0x7fbef40b77e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbf00005fd0 tx=0x7fbf00009760 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:59.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.176+0000 7fbf0d600640 1 -- 172.21.15.194:0/3206188799 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fbefc0abd40 con 0x7fbf101087d0 2024-09-10T23:17:59.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:17:59.380+0000 7fbf17a00640 1 -- 172.21.15.194:0/3206188799 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fbf10063590 con 0x7fbef40b5320 2024-09-10T23:17:59.382 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:59 smithi194 ceph-mon[33904]: purged_snaps scrub starts 2024-09-10T23:17:59.382 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:59 smithi194 ceph-mon[33904]: purged_snaps scrub ok 2024-09-10T23:17:59.383 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:59 smithi194 ceph-mon[33904]: osd.1 [v2:172.21.15.38:6800/1447444485,v1:172.21.15.38:6801/1447444485] boot 2024-09-10T23:17:59.383 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:59 smithi194 ceph-mon[33904]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T23:17:59.383 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:59 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:17:59.383 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:59 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:59.383 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:59 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:59.383 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:59 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:17:59.383 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:59 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:17:59.383 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:59 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:59.383 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:59 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:59.383 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:59 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:17:59.383 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:17:59 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:59.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:59 smithi038 ceph-mon[34225]: purged_snaps scrub starts 2024-09-10T23:17:59.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:59 smithi038 ceph-mon[34225]: purged_snaps scrub ok 2024-09-10T23:17:59.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:59 smithi038 ceph-mon[34225]: osd.1 [v2:172.21.15.38:6800/1447444485,v1:172.21.15.38:6801/1447444485] boot 2024-09-10T23:17:59.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:59 smithi038 ceph-mon[34225]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T23:17:59.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:59 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:17:59.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:59 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:59.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:59 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:59.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:59 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:17:59.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:59 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:17:59.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:59 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:59.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:59 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:59.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:59 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:17:59.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:17:59 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:59.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:59 smithi003 ceph-mon[30348]: purged_snaps scrub starts 2024-09-10T23:17:59.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:59 smithi003 ceph-mon[30348]: purged_snaps scrub ok 2024-09-10T23:17:59.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:59 smithi003 ceph-mon[30348]: osd.1 [v2:172.21.15.38:6800/1447444485,v1:172.21.15.38:6801/1447444485] boot 2024-09-10T23:17:59.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:59 smithi003 ceph-mon[30348]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T23:17:59.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:59 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:17:59.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:59 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:59.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:59 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:59.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:59 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:17:59.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:59 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:17:59.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:59 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:17:59.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:59 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:17:59.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:59 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:17:59.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:17:59 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:00.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:00 smithi038 ceph-mon[34225]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:18:00.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:00 smithi038 ceph-mon[34225]: Detected new or changed devices on smithi038 2024-09-10T23:18:00.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:00 smithi038 ceph-mon[34225]: Adjusting osd_memory_target on smithi038 to 17094M 2024-09-10T23:18:00.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:00 smithi038 ceph-mon[34225]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:18:00.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:00 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:18:00.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:00 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:18:00.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:00 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:00.686 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:00 smithi194 ceph-mon[33904]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:18:00.687 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:00 smithi194 ceph-mon[33904]: Detected new or changed devices on smithi038 2024-09-10T23:18:00.687 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:00 smithi194 ceph-mon[33904]: Adjusting osd_memory_target on smithi038 to 17094M 2024-09-10T23:18:00.687 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:00 smithi194 ceph-mon[33904]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:18:00.687 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:00 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:18:00.687 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:00 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:18:00.687 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:00 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:00.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:00 smithi003 ceph-mon[30348]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:18:00.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:00 smithi003 ceph-mon[30348]: Detected new or changed devices on smithi038 2024-09-10T23:18:00.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:00 smithi003 ceph-mon[30348]: Adjusting osd_memory_target on smithi038 to 17094M 2024-09-10T23:18:00.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:00 smithi003 ceph-mon[30348]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:18:00.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:00 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:18:00.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:00 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:18:00.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:00 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:01.568 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:01 smithi194 ceph-mon[33904]: osdmap e15: 2 total, 2 up, 2 in 2024-09-10T23:18:01.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:01 smithi038 ceph-mon[34225]: osdmap e15: 2 total, 2 up, 2 in 2024-09-10T23:18:01.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:01 smithi003 ceph-mon[30348]: osdmap e15: 2 total, 2 up, 2 in 2024-09-10T23:18:02.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:02 smithi038 ceph-mon[34225]: pgmap v53: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:02.659 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:02 smithi194 ceph-mon[33904]: pgmap v53: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:02.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:02 smithi003 ceph-mon[30348]: pgmap v53: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:03.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:03 smithi003 ceph-mon[30348]: from='client.? 172.21.15.194:0/1218212162' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ea53eb27-e7fa-4783-9a53-8b44b4e293ab"} : dispatch 2024-09-10T23:18:03.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:03 smithi003 ceph-mon[30348]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ea53eb27-e7fa-4783-9a53-8b44b4e293ab"} : dispatch 2024-09-10T23:18:03.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:03 smithi003 ceph-mon[30348]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea53eb27-e7fa-4783-9a53-8b44b4e293ab"}]': finished 2024-09-10T23:18:03.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:03 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:18:03.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:03 smithi003 ceph-mon[30348]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T23:18:03.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:03 smithi003 ceph-mon[30348]: from='client.? 172.21.15.194:0/1896658163' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:18:03.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:03 smithi038 ceph-mon[34225]: from='client.? 172.21.15.194:0/1218212162' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ea53eb27-e7fa-4783-9a53-8b44b4e293ab"} : dispatch 2024-09-10T23:18:03.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:03 smithi038 ceph-mon[34225]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ea53eb27-e7fa-4783-9a53-8b44b4e293ab"} : dispatch 2024-09-10T23:18:03.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:03 smithi038 ceph-mon[34225]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea53eb27-e7fa-4783-9a53-8b44b4e293ab"}]': finished 2024-09-10T23:18:03.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:03 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:18:03.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:03 smithi038 ceph-mon[34225]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T23:18:03.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:03 smithi038 ceph-mon[34225]: from='client.? 172.21.15.194:0/1896658163' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:18:03.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:03 smithi194 ceph-mon[33904]: from='client.? 172.21.15.194:0/1218212162' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ea53eb27-e7fa-4783-9a53-8b44b4e293ab"} : dispatch 2024-09-10T23:18:03.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:03 smithi194 ceph-mon[33904]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ea53eb27-e7fa-4783-9a53-8b44b4e293ab"} : dispatch 2024-09-10T23:18:03.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:03 smithi194 ceph-mon[33904]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea53eb27-e7fa-4783-9a53-8b44b4e293ab"}]': finished 2024-09-10T23:18:03.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:03 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:18:03.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:03 smithi194 ceph-mon[33904]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T23:18:03.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:03 smithi194 ceph-mon[33904]: from='client.? 172.21.15.194:0/1896658163' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:18:04.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:04 smithi194 ceph-mon[33904]: pgmap v55: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:04.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:04 smithi003 ceph-mon[30348]: pgmap v55: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:04.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:04 smithi038 ceph-mon[34225]: pgmap v55: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:06.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:06 smithi194 ceph-mon[33904]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:06.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:06 smithi003 ceph-mon[30348]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:06.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:06 smithi038 ceph-mon[34225]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:08.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:08 smithi194 ceph-mon[33904]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:08.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:08 smithi003 ceph-mon[30348]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:08.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:08 smithi038 ceph-mon[34225]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:10.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:10 smithi194 ceph-mon[33904]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:10.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:10 smithi003 ceph-mon[30348]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:10.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:10 smithi038 ceph-mon[34225]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:11.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:11 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T23:18:11.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:11 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:11.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:11 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T23:18:11.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:11 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:11.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:11 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T23:18:11.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:11 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:12.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:12 smithi194 ceph-mon[33904]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:12.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:12 smithi194 ceph-mon[33904]: Deploying daemon osd.2 on smithi194 2024-09-10T23:18:12.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:12 smithi003 ceph-mon[30348]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:12.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:12 smithi003 ceph-mon[30348]: Deploying daemon osd.2 on smithi194 2024-09-10T23:18:12.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:12 smithi038 ceph-mon[34225]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:12.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:12 smithi038 ceph-mon[34225]: Deploying daemon osd.2 on smithi194 2024-09-10T23:18:14.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:14 smithi194 ceph-mon[33904]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:14.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:14 smithi003 ceph-mon[30348]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:14.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:14 smithi038 ceph-mon[34225]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:16.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:16 smithi194 ceph-mon[33904]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:16.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:16 smithi003 ceph-mon[30348]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:16.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:16 smithi038 ceph-mon[34225]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:18.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:18 smithi194 ceph-mon[33904]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:18.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:18 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:18:18.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:18 smithi003 ceph-mon[30348]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:18.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:18 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:18:18.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:18 smithi038 ceph-mon[34225]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:18.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:18 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:18:19.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:19 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:19.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:19 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:19.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:19 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:19.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:19 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:19.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:19 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:19.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:19 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:20.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:20 smithi194 ceph-mon[33904]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:20.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:20 smithi003 ceph-mon[30348]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:20.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:20 smithi038 ceph-mon[34225]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:21.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:21 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:21.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:21 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:21.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:21 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:21.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:21 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:18:21.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:21 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:21.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:21 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:21.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:21 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:21.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:21 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:21.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:21 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:18:21.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:21 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:21.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:21 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:21.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:21 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:21.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:21 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:21.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:21 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:18:21.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:21 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:22.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:22 smithi038 ceph-mon[34225]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:22.849 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:22 smithi194 ceph-mon[33904]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:22.872 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:22 smithi003 ceph-mon[30348]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:23.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:18:23.310+0000 7fbf0d600640 1 -- 172.21.15.194:0/3206188799 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbf10063590 con 0x7fbef40b5320 2024-09-10T23:18:23.312 INFO:teuthology.orchestra.run.smithi194.stdout:Created osd(s) 2 on host 'smithi194' 2024-09-10T23:18:23.313 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:18:23.313+0000 7fbf17a00640 1 -- 172.21.15.194:0/3206188799 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fbef40b5320 msgr2=0x7fbef40b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:23.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:18:23.313+0000 7fbf17a00640 1 --2- 172.21.15.194:0/3206188799 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fbef40b5320 0x7fbef40b77e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbf00005fd0 tx=0x7fbf00009760 comp rx=0 tx=0).stop 2024-09-10T23:18:23.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:18:23.313+0000 7fbf17a00640 1 -- 172.21.15.194:0/3206188799 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf101087d0 msgr2=0x7fbf1019b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:23.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:18:23.313+0000 7fbf17a00640 1 --2- 172.21.15.194:0/3206188799 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf101087d0 0x7fbf1019b8a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbefc00d770 tx=0x7fbefc00dc30 comp rx=0 tx=0).stop 2024-09-10T23:18:23.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:18:23.313+0000 7fbf17a00640 1 -- 172.21.15.194:0/3206188799 shutdown_connections 2024-09-10T23:18:23.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:18:23.313+0000 7fbf17a00640 1 --2- 172.21.15.194:0/3206188799 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf10109150 0x7fbf101a0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:23.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:18:23.313+0000 7fbf17a00640 1 --2- 172.21.15.194:0/3206188799 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf101087d0 0x7fbf1019b8a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:23.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:18:23.313+0000 7fbf17a00640 1 --2- 172.21.15.194:0/3206188799 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fbef40b5320 0x7fbef40b77e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:23.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:18:23.313+0000 7fbf17a00640 1 --2- 172.21.15.194:0/3206188799 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf10102dc0 0x7fbf1019b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:23.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:18:23.313+0000 7fbf17a00640 1 -- 172.21.15.194:0/3206188799 >> 172.21.15.194:0/3206188799 conn(0x7fbf100fe830 msgr2=0x7fbf10104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:23.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:18:23.313+0000 7fbf17a00640 1 -- 172.21.15.194:0/3206188799 shutdown_connections 2024-09-10T23:18:23.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:18:23.313+0000 7fbf17a00640 1 -- 172.21.15.194:0/3206188799 wait complete. 2024-09-10T23:18:23.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:23 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:18:23.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:23 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:23.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:23 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:23.902 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:23 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:18:23.902 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:23 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:23.902 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:23 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:23.921 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:23 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:18:23.921 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:23 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:23.921 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:23 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:24.136 DEBUG:teuthology.orchestra.run.smithi194:osd.2> sudo journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.2.service 2024-09-10T23:18:24.140 INFO:tasks.cephadm:Deploying osd.3 on smithi003 with /dev/vg_nvme/lv_3... 2024-09-10T23:18:24.141 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T23:18:24.524 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:18:24.801 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:24 smithi194 ceph-mon[33904]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:24.801 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:24 smithi194 ceph-mon[33904]: from='osd.2 [v2:172.21.15.194:6800/3191263316,v1:172.21.15.194:6801/3191263316]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T23:18:24.801 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:24 smithi194 ceph-mon[33904]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T23:18:24.813 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:24 smithi003 ceph-mon[30348]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:24.813 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:24 smithi003 ceph-mon[30348]: from='osd.2 [v2:172.21.15.194:6800/3191263316,v1:172.21.15.194:6801/3191263316]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T23:18:24.813 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:24 smithi003 ceph-mon[30348]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T23:18:24.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:24 smithi038 ceph-mon[34225]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:24.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:24 smithi038 ceph-mon[34225]: from='osd.2 [v2:172.21.15.194:6800/3191263316,v1:172.21.15.194:6801/3191263316]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T23:18:24.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:24 smithi038 ceph-mon[34225]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T23:18:25.670 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:25 smithi194 ceph-mon[33904]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T23:18:25.670 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:25 smithi194 ceph-mon[33904]: from='osd.2 [v2:172.21.15.194:6800/3191263316,v1:172.21.15.194:6801/3191263316]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]} : dispatch 2024-09-10T23:18:25.670 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:25 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:18:25.671 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:25 smithi194 ceph-mon[33904]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T23:18:25.671 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:25 smithi194 ceph-mon[33904]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]} : dispatch 2024-09-10T23:18:25.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:25 smithi003 ceph-mon[30348]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T23:18:25.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:25 smithi003 ceph-mon[30348]: from='osd.2 [v2:172.21.15.194:6800/3191263316,v1:172.21.15.194:6801/3191263316]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]} : dispatch 2024-09-10T23:18:25.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:25 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:18:25.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:25 smithi003 ceph-mon[30348]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T23:18:25.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:25 smithi003 ceph-mon[30348]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]} : dispatch 2024-09-10T23:18:25.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:25 smithi038 ceph-mon[34225]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T23:18:25.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:25 smithi038 ceph-mon[34225]: from='osd.2 [v2:172.21.15.194:6800/3191263316,v1:172.21.15.194:6801/3191263316]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]} : dispatch 2024-09-10T23:18:25.849 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:25 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:18:25.849 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:25 smithi038 ceph-mon[34225]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T23:18:25.849 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:25 smithi038 ceph-mon[34225]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]} : dispatch 2024-09-10T23:18:26.198 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 10 23:18:26 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-2[40205]: 2024-09-10T23:18:26.017+0000 7efc1b200640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T23:18:26.198 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 10 23:18:26 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-2[40205]: 2024-09-10T23:18:26.040+0000 7efc11200640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:18:26.821 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:26 smithi003 ceph-mon[30348]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:26.821 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:26 smithi003 ceph-mon[30348]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-10T23:18:26.821 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:26 smithi003 ceph-mon[30348]: osdmap e18: 3 total, 2 up, 3 in 2024-09-10T23:18:26.821 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:26 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:18:26.821 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:26 smithi003 ceph-mon[30348]: from='osd.2 ' entity='osd.2' 2024-09-10T23:18:26.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:26 smithi038 ceph-mon[34225]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:26.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:26 smithi038 ceph-mon[34225]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-10T23:18:26.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:26 smithi038 ceph-mon[34225]: osdmap e18: 3 total, 2 up, 3 in 2024-09-10T23:18:26.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:26 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:18:26.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:26 smithi038 ceph-mon[34225]: from='osd.2 ' entity='osd.2' 2024-09-10T23:18:26.901 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:26 smithi194 ceph-mon[33904]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:26.901 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:26 smithi194 ceph-mon[33904]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-10T23:18:26.901 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:26 smithi194 ceph-mon[33904]: osdmap e18: 3 total, 2 up, 3 in 2024-09-10T23:18:26.901 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:26 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:18:26.901 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:26 smithi194 ceph-mon[33904]: from='osd.2 ' entity='osd.2' 2024-09-10T23:18:27.573 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:18:27.607 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi003:vg_nvme/lv_3 2024-09-10T23:18:27.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:27 smithi038 ceph-mon[34225]: purged_snaps scrub starts 2024-09-10T23:18:27.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:27 smithi038 ceph-mon[34225]: purged_snaps scrub ok 2024-09-10T23:18:27.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:27 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:18:27.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:27 smithi038 ceph-mon[34225]: osd.2 [v2:172.21.15.194:6800/3191263316,v1:172.21.15.194:6801/3191263316] boot 2024-09-10T23:18:27.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:27 smithi038 ceph-mon[34225]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T23:18:27.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:27 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:18:27.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:27 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:18:27.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:27 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:18:27.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:27 smithi194 ceph-mon[33904]: purged_snaps scrub starts 2024-09-10T23:18:27.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:27 smithi194 ceph-mon[33904]: purged_snaps scrub ok 2024-09-10T23:18:27.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:27 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:18:27.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:27 smithi194 ceph-mon[33904]: osd.2 [v2:172.21.15.194:6800/3191263316,v1:172.21.15.194:6801/3191263316] boot 2024-09-10T23:18:27.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:27 smithi194 ceph-mon[33904]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T23:18:27.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:27 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:18:27.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:27 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:18:27.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:27 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:18:27.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:27 smithi003 ceph-mon[30348]: purged_snaps scrub starts 2024-09-10T23:18:27.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:27 smithi003 ceph-mon[30348]: purged_snaps scrub ok 2024-09-10T23:18:27.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:27 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:18:27.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:27 smithi003 ceph-mon[30348]: osd.2 [v2:172.21.15.194:6800/3191263316,v1:172.21.15.194:6801/3191263316] boot 2024-09-10T23:18:27.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:27 smithi003 ceph-mon[30348]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T23:18:27.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:27 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:18:27.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:27 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:18:27.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:27 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:18:27.978 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:18:28.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.501+0000 7f3513600640 1 -- 172.21.15.3:0/810428012 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f350c10a9b0 msgr2=0x7f350c10adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:28.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.501+0000 7f3513600640 1 --2- 172.21.15.3:0/810428012 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f350c10a9b0 0x7f350c10adf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f34f4009900 tx=0x7f34f402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.501+0000 7f3513600640 1 -- 172.21.15.3:0/810428012 shutdown_connections 2024-09-10T23:18:28.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.501+0000 7f3513600640 1 --2- 172.21.15.3:0/810428012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f350c10b330 0x7f350c111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.501+0000 7f3513600640 1 --2- 172.21.15.3:0/810428012 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f350c10a9b0 0x7f350c10adf0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.501+0000 7f3513600640 1 --2- 172.21.15.3:0/810428012 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f350c104fa0 0x7f350c105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.501+0000 7f3513600640 1 -- 172.21.15.3:0/810428012 >> 172.21.15.3:0/810428012 conn(0x7f350c1009f0 msgr2=0x7f350c102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:28.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.501+0000 7f3513600640 1 -- 172.21.15.3:0/810428012 shutdown_connections 2024-09-10T23:18:28.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.501+0000 7f3513600640 1 -- 172.21.15.3:0/810428012 wait complete. 2024-09-10T23:18:28.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.502+0000 7f3513600640 1 Processor -- start 2024-09-10T23:18:28.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.502+0000 7f3513600640 1 -- start start 2024-09-10T23:18:28.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.503+0000 7f3513600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f350c104fa0 0x7f350c19b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:28.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.503+0000 7f3513600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f350c10a9b0 0x7f350c19b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:28.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.503+0000 7f3513600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f350c10b330 0x7f350c1a0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:28.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.503+0000 7f3513600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f350c114e60 con 0x7f350c104fa0 2024-09-10T23:18:28.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.503+0000 7f3513600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f350c114ce0 con 0x7f350c10a9b0 2024-09-10T23:18:28.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.503+0000 7f3513600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f350c114fe0 con 0x7f350c10b330 2024-09-10T23:18:28.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.503+0000 7f3510c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f350c104fa0 0x7f350c19b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:28.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.503+0000 7f3510c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f350c104fa0 0x7f350c19b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56724/0 (socket says 172.21.15.3:56724) 2024-09-10T23:18:28.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.503+0000 7f3510c00640 1 -- 172.21.15.3:0/3317144436 learned_addr learned my addr 172.21.15.3:0/3317144436 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:18:28.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.503+0000 7f3503e00640 1 --2- 172.21.15.3:0/3317144436 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f350c10a9b0 0x7f350c19b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:28.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.503+0000 7f3510c00640 1 -- 172.21.15.3:0/3317144436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f350c10b330 msgr2=0x7f350c1a0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:28.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.503+0000 7f3510c00640 1 --2- 172.21.15.3:0/3317144436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f350c10b330 0x7f350c1a0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.503+0000 7f3510c00640 1 -- 172.21.15.3:0/3317144436 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f350c10a9b0 msgr2=0x7f350c19b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:28.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.503+0000 7f3510c00640 1 --2- 172.21.15.3:0/3317144436 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f350c10a9b0 0x7f350c19b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.503+0000 7f3510c00640 1 -- 172.21.15.3:0/3317144436 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f350c1a1440 con 0x7f350c104fa0 2024-09-10T23:18:28.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.504+0000 7f3510c00640 1 --2- 172.21.15.3:0/3317144436 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f350c104fa0 0x7f350c19b390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f34fc00d950 tx=0x7f34fc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:28.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.504+0000 7f350a000640 1 -- 172.21.15.3:0/3317144436 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc017070 con 0x7f350c104fa0 2024-09-10T23:18:28.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.504+0000 7f350a000640 1 -- 172.21.15.3:0/3317144436 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f34fc009c30 con 0x7f350c104fa0 2024-09-10T23:18:28.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.504+0000 7f3513600640 1 -- 172.21.15.3:0/3317144436 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f350c1a1730 con 0x7f350c104fa0 2024-09-10T23:18:28.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.504+0000 7f350a000640 1 -- 172.21.15.3:0/3317144436 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc00f620 con 0x7f350c104fa0 2024-09-10T23:18:28.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.504+0000 7f3513600640 1 -- 172.21.15.3:0/3317144436 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f350c1a7fc0 con 0x7f350c104fa0 2024-09-10T23:18:28.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.506+0000 7f3513600640 1 -- 172.21.15.3:0/3317144436 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f350c105380 con 0x7f350c104fa0 2024-09-10T23:18:28.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.508+0000 7f350a000640 1 -- 172.21.15.3:0/3317144436 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 153210+0+0 (secure 0 0 0) 0x7f34fc010460 con 0x7f350c104fa0 2024-09-10T23:18:28.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.509+0000 7f350a000640 1 --2- 172.21.15.3:0/3317144436 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f34f00b5320 0x7f34f00b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:28.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.509+0000 7f350a000640 1 -- 172.21.15.3:0/3317144436 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3441+0+0 (secure 0 0 0) 0x7f34fc0e4470 con 0x7f350c104fa0 2024-09-10T23:18:28.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.510+0000 7f3503e00640 1 --2- 172.21.15.3:0/3317144436 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f34f00b5320 0x7f34f00b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:28.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.510+0000 7f3503e00640 1 --2- 172.21.15.3:0/3317144436 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f34f00b5320 0x7f34f00b77e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f34f4006010 tx=0x7f34f4005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:28.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.512+0000 7f350a000640 1 -- 172.21.15.3:0/3317144436 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f34fc0ac6f0 con 0x7f350c104fa0 2024-09-10T23:18:28.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:28 smithi003 ceph-mon[30348]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:28.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:28 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:28.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:28 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:28.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:28 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:18:28.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:28 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:18:28.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:28 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:28.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:28 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:28.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:28 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:18:28.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:28 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:28.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:28 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T23:18:28.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:28 smithi003 ceph-mon[30348]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T23:18:28.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:28 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:18:28.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:28 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:18:28.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:28.722+0000 7f3513600640 1 -- 172.21.15.3:0/3317144436 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f350c10d140 con 0x7f34f00b5320 2024-09-10T23:18:28.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:28 smithi038 ceph-mon[34225]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:28.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:28 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:28.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:28 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:28.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:28 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:18:28.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:28 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:18:28.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:28 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:28.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:28 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:28.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:28 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:18:28.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:28 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:28.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:28 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T23:18:28.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:28 smithi038 ceph-mon[34225]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T23:18:28.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:28 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:18:28.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:28 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:18:28.935 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:28 smithi194 ceph-mon[33904]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:18:28.936 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:28 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:28.936 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:28 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:28.936 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:28 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:18:28.936 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:28 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:18:28.936 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:28 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:28.936 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:28 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:28.937 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:28 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:18:28.937 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:28 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:28.937 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:28 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T23:18:28.937 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:28 smithi194 ceph-mon[33904]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T23:18:28.937 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:28 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:18:28.937 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:28 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:18:29.430 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 10 23:18:29 smithi003 sudo[53430]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T23:18:29.430 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 10 23:18:29 smithi003 sudo[53430]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:18:29.430 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 10 23:18:29 smithi003 sudo[53430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:18:29.431 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 10 23:18:29 smithi003 sudo[53430]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:18:29.431 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 10 23:18:29 smithi003 sudo[53452]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T23:18:29.431 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 10 23:18:29 smithi003 sudo[53452]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:18:29.431 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 10 23:18:29 smithi003 sudo[53452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:18:29.431 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 10 23:18:29 smithi003 sudo[53452]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:18:29.597 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 10 23:18:29 smithi038 sudo[43845]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T23:18:29.598 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 10 23:18:29 smithi038 sudo[43845]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:18:29.598 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 10 23:18:29 smithi038 sudo[43845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:18:29.598 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 10 23:18:29 smithi038 sudo[43845]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:18:29.598 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 10 23:18:29 smithi038 sudo[43848]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T23:18:29.598 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 10 23:18:29 smithi038 sudo[43848]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:18:29.598 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 10 23:18:29 smithi038 sudo[43848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:18:29.598 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 10 23:18:29 smithi038 sudo[43848]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:18:29.681 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:29 smithi003 sudo[53479]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T23:18:29.681 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:29 smithi003 sudo[53479]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:18:29.681 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:29 smithi003 sudo[53479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:18:29.681 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:29 smithi003 sudo[53479]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:18:29.681 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:29 smithi003 sudo[53482]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T23:18:29.682 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:29 smithi003 sudo[53482]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:18:29.682 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:29 smithi003 sudo[53482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:18:29.682 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:29 smithi003 sudo[53482]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:18:29.682 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:29 smithi003 ceph-mon[30348]: Detected new or changed devices on smithi194 2024-09-10T23:18:29.682 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:29 smithi003 ceph-mon[30348]: Adjusting osd_memory_target on smithi194 to 17089M 2024-09-10T23:18:29.682 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:29 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:18:29.682 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:29 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:18:29.682 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:29 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:29.682 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:29 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T23:18:29.682 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:29 smithi003 ceph-mon[30348]: osdmap e21: 3 total, 3 up, 3 in 2024-09-10T23:18:29.682 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:29 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:29.682 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:29 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:29.682 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:29 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:29.683 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:29 smithi003 ceph-mon[30348]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:18:29.683 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:29 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:18:29.683 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:29 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:18:29.683 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:29 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:18:29.683 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:29 smithi003 ceph-mon[30348]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:18:29.683 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:29 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:18:29.683 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:29 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:18:29.683 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:29 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:18:29.697 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 10 23:18:29 smithi194 sudo[44105]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T23:18:29.697 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 10 23:18:29 smithi194 sudo[44105]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:18:29.697 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 10 23:18:29 smithi194 sudo[44105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:18:29.697 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 10 23:18:29 smithi194 sudo[44105]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:18:29.697 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 10 23:18:29 smithi194 sudo[44108]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T23:18:29.697 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 10 23:18:29 smithi194 sudo[44108]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:18:29.698 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 10 23:18:29 smithi194 sudo[44108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:18:29.698 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 10 23:18:29 smithi194 sudo[44108]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:18:29.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:29 smithi194 sudo[44111]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T23:18:29.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:29 smithi194 sudo[44111]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:18:29.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:29 smithi194 sudo[44111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:18:29.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:29 smithi194 sudo[44111]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:18:29.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:29 smithi194 sudo[44114]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T23:18:29.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:29 smithi194 sudo[44114]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:18:29.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:29 smithi194 sudo[44114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:18:29.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:29 smithi194 sudo[44114]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:18:29.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:29 smithi194 ceph-mon[33904]: Detected new or changed devices on smithi194 2024-09-10T23:18:29.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:29 smithi194 ceph-mon[33904]: Adjusting osd_memory_target on smithi194 to 17089M 2024-09-10T23:18:29.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:29 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:18:29.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:29 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:18:29.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:29 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:29.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:29 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T23:18:29.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:29 smithi194 ceph-mon[33904]: osdmap e21: 3 total, 3 up, 3 in 2024-09-10T23:18:29.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:29 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:29.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:29 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:29.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:29 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:29.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:29 smithi194 ceph-mon[33904]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:18:29.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:29 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:18:29.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:29 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:18:29.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:29 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:18:29.700 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:29 smithi194 ceph-mon[33904]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:18:29.700 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:29 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:18:29.700 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:29 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:18:29.700 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:29 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:18:30.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:29 smithi038 ceph-mon[34225]: Detected new or changed devices on smithi194 2024-09-10T23:18:30.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:29 smithi038 ceph-mon[34225]: Adjusting osd_memory_target on smithi194 to 17089M 2024-09-10T23:18:30.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:29 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:18:30.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:29 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:18:30.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:29 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:30.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:29 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T23:18:30.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:29 smithi038 ceph-mon[34225]: osdmap e21: 3 total, 3 up, 3 in 2024-09-10T23:18:30.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:29 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:30.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:29 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:30.099 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:29 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:30.099 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:29 smithi038 ceph-mon[34225]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:18:30.099 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:29 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:18:30.099 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:29 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:18:30.099 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:29 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:18:30.099 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:29 smithi038 ceph-mon[34225]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:18:30.099 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:29 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:18:30.099 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:29 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:18:30.100 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:29 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:18:30.100 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:29 smithi038 sudo[43851]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T23:18:30.100 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:29 smithi038 sudo[43851]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:18:30.100 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:29 smithi038 sudo[43851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:18:30.100 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:29 smithi038 sudo[43851]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:18:30.100 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:29 smithi038 sudo[43854]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T23:18:30.100 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:29 smithi038 sudo[43854]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:18:30.100 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:29 smithi038 sudo[43854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:18:30.100 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:29 smithi038 sudo[43854]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:18:30.879 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:30 smithi003 ceph-mon[30348]: pgmap v72: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:18:30.879 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:30 smithi003 ceph-mon[30348]: from='client.14496 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:18:30.880 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:30 smithi003 ceph-mon[30348]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:18:30.880 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:30 smithi003 ceph-mon[30348]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T23:18:30.880 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:30 smithi003 ceph-mon[30348]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:18:30.880 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:30 smithi003 ceph-mon[30348]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:18:30.880 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:30 smithi003 ceph-mon[30348]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:18:30.880 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:30 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:18:30.880 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:30 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:18:30.880 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:30 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:18:30.880 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:30 smithi003 ceph-mon[30348]: osdmap e22: 3 total, 3 up, 3 in 2024-09-10T23:18:30.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:30 smithi194 ceph-mon[33904]: pgmap v72: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:18:30.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:30 smithi194 ceph-mon[33904]: from='client.14496 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:18:30.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:30 smithi194 ceph-mon[33904]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:18:30.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:30 smithi194 ceph-mon[33904]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T23:18:30.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:30 smithi194 ceph-mon[33904]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:18:30.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:30 smithi194 ceph-mon[33904]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:18:30.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:30 smithi194 ceph-mon[33904]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:18:30.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:30 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:18:30.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:30 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:18:30.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:30 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:18:30.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:30 smithi194 ceph-mon[33904]: osdmap e22: 3 total, 3 up, 3 in 2024-09-10T23:18:31.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:30 smithi038 ceph-mon[34225]: pgmap v72: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:18:31.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:30 smithi038 ceph-mon[34225]: from='client.14496 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:18:31.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:30 smithi038 ceph-mon[34225]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:18:31.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:30 smithi038 ceph-mon[34225]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T23:18:31.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:30 smithi038 ceph-mon[34225]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:18:31.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:30 smithi038 ceph-mon[34225]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:18:31.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:30 smithi038 ceph-mon[34225]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:18:31.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:30 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:18:31.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:30 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:18:31.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:30 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:18:31.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:30 smithi038 ceph-mon[34225]: osdmap e22: 3 total, 3 up, 3 in 2024-09-10T23:18:31.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:31.620+0000 7f350a000640 1 -- 172.21.15.3:0/3317144436 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7f34fc0a8260 con 0x7f350c104fa0 2024-09-10T23:18:31.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:31 smithi194 ceph-mon[33904]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:18:31.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:31 smithi003 ceph-mon[30348]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:18:32.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:31 smithi038 ceph-mon[34225]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:18:32.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:32 smithi003 ceph-mon[30348]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T23:18:32.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:32 smithi003 ceph-mon[30348]: Cluster is now healthy 2024-09-10T23:18:32.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:32 smithi003 ceph-mon[30348]: mgrmap e20: x(active, since 2m), standbys: z, y 2024-09-10T23:18:32.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:32 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1252984209' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "75067769-7be5-4a99-9e02-f7735b2e69c6"} : dispatch 2024-09-10T23:18:32.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:32 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1252984209' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "75067769-7be5-4a99-9e02-f7735b2e69c6"}]': finished 2024-09-10T23:18:32.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:32 smithi003 ceph-mon[30348]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T23:18:32.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:32 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:18:32.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:32 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1148222720' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:18:32.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:32 smithi194 ceph-mon[33904]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T23:18:32.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:32 smithi194 ceph-mon[33904]: Cluster is now healthy 2024-09-10T23:18:32.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:32 smithi194 ceph-mon[33904]: mgrmap e20: x(active, since 2m), standbys: z, y 2024-09-10T23:18:32.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:32 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/1252984209' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "75067769-7be5-4a99-9e02-f7735b2e69c6"} : dispatch 2024-09-10T23:18:32.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:32 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/1252984209' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "75067769-7be5-4a99-9e02-f7735b2e69c6"}]': finished 2024-09-10T23:18:32.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:32 smithi194 ceph-mon[33904]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T23:18:32.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:32 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:18:32.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:32 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/1148222720' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:18:33.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:32 smithi038 ceph-mon[34225]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T23:18:33.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:32 smithi038 ceph-mon[34225]: Cluster is now healthy 2024-09-10T23:18:33.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:32 smithi038 ceph-mon[34225]: mgrmap e20: x(active, since 2m), standbys: z, y 2024-09-10T23:18:33.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:32 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/1252984209' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "75067769-7be5-4a99-9e02-f7735b2e69c6"} : dispatch 2024-09-10T23:18:33.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:32 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/1252984209' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "75067769-7be5-4a99-9e02-f7735b2e69c6"}]': finished 2024-09-10T23:18:33.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:32 smithi038 ceph-mon[34225]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T23:18:33.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:32 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:18:33.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:32 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/1148222720' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:18:33.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:33 smithi194 ceph-mon[33904]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:18:33.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:33 smithi003 ceph-mon[30348]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:18:34.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:33 smithi038 ceph-mon[34225]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:18:35.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:35 smithi003 ceph-mon[30348]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 281 KiB/s wr, 19 op/s 2024-09-10T23:18:36.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:35 smithi038 ceph-mon[34225]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 281 KiB/s wr, 19 op/s 2024-09-10T23:18:36.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:35 smithi194 ceph-mon[33904]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 281 KiB/s wr, 19 op/s 2024-09-10T23:18:38.002 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:37 smithi003 ceph-mon[30348]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-09-10T23:18:38.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:37 smithi038 ceph-mon[34225]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-09-10T23:18:38.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:37 smithi194 ceph-mon[33904]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-09-10T23:18:39.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:39 smithi003 ceph-mon[30348]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 3.5 KiB/s rd, 151 KiB/s wr, 10 op/s 2024-09-10T23:18:40.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:39 smithi038 ceph-mon[34225]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 3.5 KiB/s rd, 151 KiB/s wr, 10 op/s 2024-09-10T23:18:40.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:39 smithi194 ceph-mon[33904]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 3.5 KiB/s rd, 151 KiB/s wr, 10 op/s 2024-09-10T23:18:40.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:40 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T23:18:40.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:40 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:41.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:40 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T23:18:41.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:40 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:41.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:40 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T23:18:41.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:40 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:41.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:41 smithi003 ceph-mon[30348]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-10T23:18:41.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:41 smithi003 ceph-mon[30348]: Deploying daemon osd.3 on smithi003 2024-09-10T23:18:42.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:41 smithi038 ceph-mon[34225]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-10T23:18:42.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:41 smithi038 ceph-mon[34225]: Deploying daemon osd.3 on smithi003 2024-09-10T23:18:42.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:41 smithi194 ceph-mon[33904]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-10T23:18:42.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:41 smithi194 ceph-mon[33904]: Deploying daemon osd.3 on smithi003 2024-09-10T23:18:44.065 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:43 smithi003 ceph-mon[30348]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 119 KiB/s wr, 8 op/s 2024-09-10T23:18:44.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:43 smithi038 ceph-mon[34225]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 119 KiB/s wr, 8 op/s 2024-09-10T23:18:44.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:43 smithi194 ceph-mon[33904]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 119 KiB/s wr, 8 op/s 2024-09-10T23:18:46.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:45 smithi038 ceph-mon[34225]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-10T23:18:46.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:45 smithi194 ceph-mon[33904]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-10T23:18:46.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:45 smithi003 ceph-mon[30348]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-10T23:18:47.813 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:47 smithi003 ceph-mon[30348]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:18:48.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:47 smithi038 ceph-mon[34225]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:18:48.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:47 smithi194 ceph-mon[33904]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:18:49.030 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:48 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:18:49.031 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:48 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:49.031 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:48 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:49.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:48 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:18:49.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:48 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:49.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:48 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:49.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:48 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:18:49.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:48 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:49.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:48 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:50.365 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:50 smithi003 ceph-mon[30348]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:18:50.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:50 smithi038 ceph-mon[34225]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:18:50.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:50 smithi194 ceph-mon[33904]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:18:52.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:52 smithi003 ceph-mon[30348]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:18:52.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:52 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:52.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:52 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:52.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:52 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:52.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:52 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:18:52.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:52 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:52.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:52 smithi038 ceph-mon[34225]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:18:52.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:52 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:52.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:52 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:52.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:52 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:52.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:52 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:18:52.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:52 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:52.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:52 smithi194 ceph-mon[33904]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:18:52.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:52 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:52.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:52 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:52.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:52 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:52.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:52 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:18:52.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:52 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:52.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:52.992+0000 7f350a000640 1 -- 172.21.15.3:0/3317144436 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f350c10d140 con 0x7f34f00b5320 2024-09-10T23:18:52.994 INFO:teuthology.orchestra.run.smithi003.stdout:Created osd(s) 3 on host 'smithi003' 2024-09-10T23:18:52.996 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:52.994+0000 7f3513600640 1 -- 172.21.15.3:0/3317144436 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f34f00b5320 msgr2=0x7f34f00b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:52.996 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:52.994+0000 7f3513600640 1 --2- 172.21.15.3:0/3317144436 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f34f00b5320 0x7f34f00b77e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f34f4006010 tx=0x7f34f4005e80 comp rx=0 tx=0).stop 2024-09-10T23:18:52.996 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:52.994+0000 7f3513600640 1 -- 172.21.15.3:0/3317144436 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f350c104fa0 msgr2=0x7f350c19b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:52.996 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:52.994+0000 7f3513600640 1 --2- 172.21.15.3:0/3317144436 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f350c104fa0 0x7f350c19b390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f34fc00d950 tx=0x7f34fc00de10 comp rx=0 tx=0).stop 2024-09-10T23:18:52.996 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:52.995+0000 7f3513600640 1 -- 172.21.15.3:0/3317144436 shutdown_connections 2024-09-10T23:18:52.996 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:52.995+0000 7f3513600640 1 --2- 172.21.15.3:0/3317144436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f350c10b330 0x7f350c1a0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:52.996 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:52.995+0000 7f3513600640 1 --2- 172.21.15.3:0/3317144436 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f350c10a9b0 0x7f350c19b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:52.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:52.995+0000 7f3513600640 1 --2- 172.21.15.3:0/3317144436 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f34f00b5320 0x7f34f00b77e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:52.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:52.995+0000 7f3513600640 1 --2- 172.21.15.3:0/3317144436 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f350c104fa0 0x7f350c19b390 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:52.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:52.995+0000 7f3513600640 1 -- 172.21.15.3:0/3317144436 >> 172.21.15.3:0/3317144436 conn(0x7f350c1009f0 msgr2=0x7f350c102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:52.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:52.995+0000 7f3513600640 1 -- 172.21.15.3:0/3317144436 shutdown_connections 2024-09-10T23:18:52.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:18:52.995+0000 7f3513600640 1 -- 172.21.15.3:0/3317144436 wait complete. 2024-09-10T23:18:53.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:53 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:18:53.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:53 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:53.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:53 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:53.652 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:53 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:18:53.652 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:53 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:53.653 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:53 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:53.690 DEBUG:teuthology.orchestra.run.smithi003:osd.3> sudo journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.3.service 2024-09-10T23:18:53.694 INFO:tasks.cephadm:Deploying osd.4 on smithi038 with /dev/vg_nvme/lv_3... 2024-09-10T23:18:53.694 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T23:18:53.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:53 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:18:53.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:53 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:53.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:53 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:54.073 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:18:54.515 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:54 smithi038 ceph-mon[34225]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:18:54.516 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:54 smithi038 ceph-mon[34225]: from='osd.3 [v2:172.21.15.3:6810/2061990952,v1:172.21.15.3:6811/2061990952]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T23:18:54.516 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:54 smithi038 ceph-mon[34225]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T23:18:54.625 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:54 smithi003 ceph-mon[30348]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:18:54.625 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:54 smithi003 ceph-mon[30348]: from='osd.3 [v2:172.21.15.3:6810/2061990952,v1:172.21.15.3:6811/2061990952]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T23:18:54.625 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:54 smithi003 ceph-mon[30348]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T23:18:54.626 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 10 23:18:54 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-3[55616]: 2024-09-10T23:18:54.226+0000 7f061043c640 -1 osd.3 0 log_to_monitors true 2024-09-10T23:18:54.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:54 smithi194 ceph-mon[33904]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:18:54.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:54 smithi194 ceph-mon[33904]: from='osd.3 [v2:172.21.15.3:6810/2061990952,v1:172.21.15.3:6811/2061990952]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T23:18:54.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:54 smithi194 ceph-mon[33904]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T23:18:55.555 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:55 smithi003 ceph-mon[30348]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T23:18:55.556 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:55 smithi003 ceph-mon[30348]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T23:18:55.556 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:55 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:18:55.556 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:55 smithi003 ceph-mon[30348]: from='osd.3 [v2:172.21.15.3:6810/2061990952,v1:172.21.15.3:6811/2061990952]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi003", "root=default"]} : dispatch 2024-09-10T23:18:55.556 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:55 smithi003 ceph-mon[30348]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi003", "root=default"]} : dispatch 2024-09-10T23:18:55.578 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:55 smithi038 ceph-mon[34225]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T23:18:55.579 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:55 smithi038 ceph-mon[34225]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T23:18:55.579 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:55 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:18:55.579 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:55 smithi038 ceph-mon[34225]: from='osd.3 [v2:172.21.15.3:6810/2061990952,v1:172.21.15.3:6811/2061990952]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi003", "root=default"]} : dispatch 2024-09-10T23:18:55.579 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:55 smithi038 ceph-mon[34225]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi003", "root=default"]} : dispatch 2024-09-10T23:18:55.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:55 smithi194 ceph-mon[33904]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T23:18:55.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:55 smithi194 ceph-mon[33904]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T23:18:55.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:55 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:18:55.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:55 smithi194 ceph-mon[33904]: from='osd.3 [v2:172.21.15.3:6810/2061990952,v1:172.21.15.3:6811/2061990952]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi003", "root=default"]} : dispatch 2024-09-10T23:18:55.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:55 smithi194 ceph-mon[33904]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi003", "root=default"]} : dispatch 2024-09-10T23:18:56.220 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 10 23:18:55 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-3[55616]: 2024-09-10T23:18:55.903+0000 7f060b000640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T23:18:56.220 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 10 23:18:55 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-3[55616]: 2024-09-10T23:18:55.922+0000 7f0601000640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:18:56.517 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:56 smithi038 ceph-mon[34225]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:18:56.517 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:56 smithi038 ceph-mon[34225]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]': finished 2024-09-10T23:18:56.517 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:56 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:18:56.517 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:56 smithi038 ceph-mon[34225]: osdmap e25: 4 total, 3 up, 4 in 2024-09-10T23:18:56.517 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:56 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:18:56.517 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:56 smithi038 ceph-mon[34225]: from='osd.3 ' entity='osd.3' 2024-09-10T23:18:56.640 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:56 smithi003 ceph-mon[30348]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:18:56.641 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:56 smithi003 ceph-mon[30348]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]': finished 2024-09-10T23:18:56.641 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:56 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:18:56.641 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:56 smithi003 ceph-mon[30348]: osdmap e25: 4 total, 3 up, 4 in 2024-09-10T23:18:56.641 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:56 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:18:56.641 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:56 smithi003 ceph-mon[30348]: from='osd.3 ' entity='osd.3' 2024-09-10T23:18:56.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:56 smithi194 ceph-mon[33904]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:18:56.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:56 smithi194 ceph-mon[33904]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]': finished 2024-09-10T23:18:56.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:56 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:18:56.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:56 smithi194 ceph-mon[33904]: osdmap e25: 4 total, 3 up, 4 in 2024-09-10T23:18:56.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:56 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:18:56.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:56 smithi194 ceph-mon[33904]: from='osd.3 ' entity='osd.3' 2024-09-10T23:18:57.309 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T23:18:57.343 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi038:vg_nvme/lv_3 2024-09-10T23:18:57.396 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:57 smithi038 ceph-mon[34225]: purged_snaps scrub starts 2024-09-10T23:18:57.396 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:57 smithi038 ceph-mon[34225]: purged_snaps scrub ok 2024-09-10T23:18:57.397 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:57 smithi038 ceph-mon[34225]: osd.3 [v2:172.21.15.3:6810/2061990952,v1:172.21.15.3:6811/2061990952] boot 2024-09-10T23:18:57.397 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:57 smithi038 ceph-mon[34225]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T23:18:57.397 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:57 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:18:57.594 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:57 smithi003 ceph-mon[30348]: purged_snaps scrub starts 2024-09-10T23:18:57.594 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:57 smithi003 ceph-mon[30348]: purged_snaps scrub ok 2024-09-10T23:18:57.594 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:57 smithi003 ceph-mon[30348]: osd.3 [v2:172.21.15.3:6810/2061990952,v1:172.21.15.3:6811/2061990952] boot 2024-09-10T23:18:57.594 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:57 smithi003 ceph-mon[30348]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T23:18:57.594 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:57 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:18:57.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:57 smithi194 ceph-mon[33904]: purged_snaps scrub starts 2024-09-10T23:18:57.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:57 smithi194 ceph-mon[33904]: purged_snaps scrub ok 2024-09-10T23:18:57.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:57 smithi194 ceph-mon[33904]: osd.3 [v2:172.21.15.3:6810/2061990952,v1:172.21.15.3:6811/2061990952] boot 2024-09-10T23:18:57.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:57 smithi194 ceph-mon[33904]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T23:18:57.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:57 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:18:57.724 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:18:58.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.272+0000 7f5557000640 1 -- 172.21.15.38:0/2602350769 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5550075f40 msgr2=0x7f555010edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:58.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.272+0000 7f5557000640 1 --2- 172.21.15.38:0/2602350769 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5550075f40 0x7f555010edf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5538009900 tx=0x7f553802a3f0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.273+0000 7f5557000640 1 -- 172.21.15.38:0/2602350769 shutdown_connections 2024-09-10T23:18:58.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.273+0000 7f5557000640 1 --2- 172.21.15.38:0/2602350769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f555010f3c0 0x7f55501117b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.273+0000 7f5557000640 1 --2- 172.21.15.38:0/2602350769 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5550075f40 0x7f555010edf0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.273+0000 7f5557000640 1 --2- 172.21.15.38:0/2602350769 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5550075540 0x7f5550075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.273+0000 7f5557000640 1 -- 172.21.15.38:0/2602350769 >> 172.21.15.38:0/2602350769 conn(0x7f55500fe810 msgr2=0x7f5550100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:58.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.273+0000 7f5557000640 1 -- 172.21.15.38:0/2602350769 shutdown_connections 2024-09-10T23:18:58.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.273+0000 7f5557000640 1 -- 172.21.15.38:0/2602350769 wait complete. 2024-09-10T23:18:58.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.273+0000 7f5557000640 1 Processor -- start 2024-09-10T23:18:58.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.274+0000 7f5557000640 1 -- start start 2024-09-10T23:18:58.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.274+0000 7f5557000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5550075540 0x7f555019b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:58.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.274+0000 7f5557000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5550075f40 0x7f555019b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:58.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.274+0000 7f5557000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f555010f3c0 0x7f55501a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:58.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.274+0000 7f5557000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f5550114e60 con 0x7f5550075f40 2024-09-10T23:18:58.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.274+0000 7f5557000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5550114ce0 con 0x7f5550075540 2024-09-10T23:18:58.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.274+0000 7f5557000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5550114fe0 con 0x7f555010f3c0 2024-09-10T23:18:58.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.274+0000 7f554fe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5550075540 0x7f555019b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:58.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.274+0000 7f554fe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5550075540 0x7f555019b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48564/0 (socket says 172.21.15.38:48564) 2024-09-10T23:18:58.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.274+0000 7f554fe00640 1 -- 172.21.15.38:0/1591512072 learned_addr learned my addr 172.21.15.38:0/1591512072 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-10T23:18:58.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.274+0000 7f5547400640 1 --2- 172.21.15.38:0/1591512072 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5550075f40 0x7f555019b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:58.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.274+0000 7f5555000640 1 --2- 172.21.15.38:0/1591512072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f555010f3c0 0x7f55501a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:58.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.275+0000 7f554fe00640 1 -- 172.21.15.38:0/1591512072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f555010f3c0 msgr2=0x7f55501a0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:58.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.275+0000 7f554fe00640 1 --2- 172.21.15.38:0/1591512072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f555010f3c0 0x7f55501a0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.275+0000 7f554fe00640 1 -- 172.21.15.38:0/1591512072 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5550075f40 msgr2=0x7f555019b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:58.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.275+0000 7f554fe00640 1 --2- 172.21.15.38:0/1591512072 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5550075f40 0x7f555019b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.275+0000 7f554fe00640 1 -- 172.21.15.38:0/1591512072 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55501a13c0 con 0x7f5550075540 2024-09-10T23:18:58.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.275+0000 7f554fe00640 1 --2- 172.21.15.38:0/1591512072 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5550075540 0x7f555019b310 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f554000e9f0 tx=0x7f554000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:58.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.275+0000 7f554d600640 1 -- 172.21.15.38:0/1591512072 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554000cd80 con 0x7f5550075540 2024-09-10T23:18:58.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.275+0000 7f5557000640 1 -- 172.21.15.38:0/1591512072 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55501a16b0 con 0x7f5550075540 2024-09-10T23:18:58.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.275+0000 7f554d600640 1 -- 172.21.15.38:0/1591512072 <== mon.2 v2:172.21.15.38:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f55400108c0 con 0x7f5550075540 2024-09-10T23:18:58.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.275+0000 7f554d600640 1 -- 172.21.15.38:0/1591512072 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55400187c0 con 0x7f5550075540 2024-09-10T23:18:58.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.276+0000 7f5557000640 1 -- 172.21.15.38:0/1591512072 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55501a7f40 con 0x7f5550075540 2024-09-10T23:18:58.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.277+0000 7f5557000640 1 -- 172.21.15.38:0/1591512072 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5550076a50 con 0x7f5550075540 2024-09-10T23:18:58.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.279+0000 7f554d600640 1 -- 172.21.15.38:0/1591512072 <== mon.2 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7f5540010430 con 0x7f5550075540 2024-09-10T23:18:58.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.280+0000 7f554d600640 1 --2- 172.21.15.38:0/1591512072 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f55340b53b0 0x7f55340b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:58.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.280+0000 7f554d600640 1 -- 172.21.15.38:0/1591512072 <== mon.2 v2:172.21.15.38:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3884+0+0 (secure 0 0 0) 0x7f55400e5380 con 0x7f5550075540 2024-09-10T23:18:58.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.281+0000 7f5547400640 1 --2- 172.21.15.38:0/1591512072 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f55340b53b0 0x7f55340b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:58.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.282+0000 7f5547400640 1 --2- 172.21.15.38:0/1591512072 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f55340b53b0 0x7f55340b7870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5538006010 tx=0x7f5538005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:58.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.283+0000 7f554d600640 1 -- 172.21.15.38:0/1591512072 <== mon.2 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f55400acca0 con 0x7f5550075540 2024-09-10T23:18:58.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:18:58.492+0000 7f5557000640 1 -- 172.21.15.38:0/1591512072 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f5550100420 con 0x7f55340b53b0 2024-09-10T23:18:58.493 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:58 smithi038 ceph-mon[34225]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:18:58.493 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:58 smithi038 ceph-mon[34225]: osdmap e27: 4 total, 4 up, 4 in 2024-09-10T23:18:58.493 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:58 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:58.493 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:58 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:58.493 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:58 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:18:58.494 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:58 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:18:58.494 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:58 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:18:58.494 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:58 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:18:58.494 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:58 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:58.494 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:58 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:58.494 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:58 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:18:58.494 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:58 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:58.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:58 smithi194 ceph-mon[33904]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:18:58.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:58 smithi194 ceph-mon[33904]: osdmap e27: 4 total, 4 up, 4 in 2024-09-10T23:18:58.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:58 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:58.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:58 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:58.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:58 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:18:58.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:58 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:18:58.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:58 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:18:58.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:58 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:18:58.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:58 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:58.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:58 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:58.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:58 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:18:58.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:58 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:58.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:58 smithi003 ceph-mon[30348]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:18:58.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:58 smithi003 ceph-mon[30348]: osdmap e27: 4 total, 4 up, 4 in 2024-09-10T23:18:58.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:58 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:58.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:58 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:58.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:58 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:18:58.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:58 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:18:58.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:58 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:18:58.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:58 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:18:58.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:58 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:58.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:58 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:58.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:58 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:18:58.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:58 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:18:59.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:59 smithi194 ceph-mon[33904]: Detected new or changed devices on smithi003 2024-09-10T23:18:59.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:59 smithi194 ceph-mon[33904]: Adjusting osd_memory_target on smithi003 to 8547M 2024-09-10T23:18:59.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:59 smithi194 ceph-mon[33904]: osdmap e28: 4 total, 4 up, 4 in 2024-09-10T23:18:59.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:59 smithi194 ceph-mon[33904]: from='client.34379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:18:59.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:59 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:18:59.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:59 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:18:59.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:18:59 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:59.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:59 smithi003 ceph-mon[30348]: Detected new or changed devices on smithi003 2024-09-10T23:18:59.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:59 smithi003 ceph-mon[30348]: Adjusting osd_memory_target on smithi003 to 8547M 2024-09-10T23:18:59.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:59 smithi003 ceph-mon[30348]: osdmap e28: 4 total, 4 up, 4 in 2024-09-10T23:18:59.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:59 smithi003 ceph-mon[30348]: from='client.34379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:18:59.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:59 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:18:59.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:59 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:18:59.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:18:59 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:18:59.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:59 smithi038 ceph-mon[34225]: Detected new or changed devices on smithi003 2024-09-10T23:18:59.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:59 smithi038 ceph-mon[34225]: Adjusting osd_memory_target on smithi003 to 8547M 2024-09-10T23:18:59.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:59 smithi038 ceph-mon[34225]: osdmap e28: 4 total, 4 up, 4 in 2024-09-10T23:18:59.849 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:59 smithi038 ceph-mon[34225]: from='client.34379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:18:59.849 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:59 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:18:59.849 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:59 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:18:59.849 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:18:59 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:00.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:00 smithi194 ceph-mon[33904]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:19:00.701 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:00 smithi038 ceph-mon[34225]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:19:00.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:00 smithi003 ceph-mon[30348]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:19:02.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:02 smithi038 ceph-mon[34225]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-10T23:19:02.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:02 smithi038 ceph-mon[34225]: from='client.? 172.21.15.38:0/2555264119' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "872e90ca-b711-4206-b586-e7fa41122199"} : dispatch 2024-09-10T23:19:02.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:02 smithi038 ceph-mon[34225]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "872e90ca-b711-4206-b586-e7fa41122199"} : dispatch 2024-09-10T23:19:02.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:02 smithi038 ceph-mon[34225]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "872e90ca-b711-4206-b586-e7fa41122199"}]': finished 2024-09-10T23:19:02.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:02 smithi038 ceph-mon[34225]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T23:19:02.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:02 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:19:02.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:02 smithi038 ceph-mon[34225]: from='client.? 172.21.15.38:0/2121813401' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:19:02.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:02 smithi194 ceph-mon[33904]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-10T23:19:02.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:02 smithi194 ceph-mon[33904]: from='client.? 172.21.15.38:0/2555264119' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "872e90ca-b711-4206-b586-e7fa41122199"} : dispatch 2024-09-10T23:19:02.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:02 smithi194 ceph-mon[33904]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "872e90ca-b711-4206-b586-e7fa41122199"} : dispatch 2024-09-10T23:19:02.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:02 smithi194 ceph-mon[33904]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "872e90ca-b711-4206-b586-e7fa41122199"}]': finished 2024-09-10T23:19:02.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:02 smithi194 ceph-mon[33904]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T23:19:02.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:02 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:19:02.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:02 smithi194 ceph-mon[33904]: from='client.? 172.21.15.38:0/2121813401' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:19:02.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:02 smithi003 ceph-mon[30348]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-10T23:19:02.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:02 smithi003 ceph-mon[30348]: from='client.? 172.21.15.38:0/2555264119' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "872e90ca-b711-4206-b586-e7fa41122199"} : dispatch 2024-09-10T23:19:02.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:02 smithi003 ceph-mon[30348]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "872e90ca-b711-4206-b586-e7fa41122199"} : dispatch 2024-09-10T23:19:02.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:02 smithi003 ceph-mon[30348]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "872e90ca-b711-4206-b586-e7fa41122199"}]': finished 2024-09-10T23:19:02.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:02 smithi003 ceph-mon[30348]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T23:19:02.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:02 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:19:02.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:02 smithi003 ceph-mon[30348]: from='client.? 172.21.15.38:0/2121813401' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:19:04.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:04 smithi194 ceph-mon[33904]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:19:04.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:04 smithi003 ceph-mon[30348]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:19:04.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:04 smithi038 ceph-mon[34225]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:19:06.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:06 smithi194 ceph-mon[33904]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-10T23:19:06.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:06 smithi003 ceph-mon[30348]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-10T23:19:06.801 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:06 smithi038 ceph-mon[34225]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-10T23:19:08.468 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:08 smithi038 ceph-mon[34225]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-10T23:19:08.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:08 smithi194 ceph-mon[33904]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-10T23:19:08.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:08 smithi003 ceph-mon[30348]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-10T23:19:10.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:10 smithi194 ceph-mon[33904]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:19:10.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:10 smithi003 ceph-mon[30348]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:19:10.754 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:10 smithi038 ceph-mon[34225]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:19:11.666 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:11 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T23:19:11.666 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:11 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:11.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:11 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T23:19:11.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:11 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:11.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:11 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T23:19:11.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:11 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:12.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:12 smithi194 ceph-mon[33904]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:19:12.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:12 smithi194 ceph-mon[33904]: Deploying daemon osd.4 on smithi038 2024-09-10T23:19:12.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:12 smithi003 ceph-mon[30348]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:19:12.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:12 smithi003 ceph-mon[30348]: Deploying daemon osd.4 on smithi038 2024-09-10T23:19:12.762 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:12 smithi038 ceph-mon[34225]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:19:12.762 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:12 smithi038 ceph-mon[34225]: Deploying daemon osd.4 on smithi038 2024-09-10T23:19:14.514 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:14 smithi038 ceph-mon[34225]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:19:14.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:14 smithi194 ceph-mon[33904]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:19:14.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:14 smithi003 ceph-mon[30348]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:19:16.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:16 smithi194 ceph-mon[33904]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:19:16.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:16 smithi003 ceph-mon[30348]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:19:16.749 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:16 smithi038 ceph-mon[34225]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:19:18.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:18 smithi194 ceph-mon[33904]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:19:18.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:18 smithi003 ceph-mon[30348]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:19:18.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:18 smithi038 ceph-mon[34225]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:19:19.427 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:19 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:19:19.427 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:19 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:19.427 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:19 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:19.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:19 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:19:19.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:19 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:19.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:19 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:19.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:19 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:19:19.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:19 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:19.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:19 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:20.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:20 smithi038 ceph-mon[34225]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:19:20.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:20 smithi194 ceph-mon[33904]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:19:20.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:20 smithi003 ceph-mon[30348]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:19:22.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:22 smithi038 ceph-mon[34225]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:19:22.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:22 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:22.349 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:22 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:22.349 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:22 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:22.349 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:22 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:19:22.349 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:22 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:22.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:22 smithi194 ceph-mon[33904]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:19:22.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:22 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:22.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:22 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:22.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:22 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:22.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:22 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:19:22.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:22 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:22.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:22 smithi003 ceph-mon[30348]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:19:22.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:22 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:22.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:22 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:22.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:22 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:22.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:22 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:19:22.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:22 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:23.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:19:23.211+0000 7f554d600640 1 -- 172.21.15.38:0/1591512072 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5550100420 con 0x7f55340b53b0 2024-09-10T23:19:23.213 INFO:teuthology.orchestra.run.smithi038.stdout:Created osd(s) 4 on host 'smithi038' 2024-09-10T23:19:23.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:19:23.214+0000 7f5557000640 1 -- 172.21.15.38:0/1591512072 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f55340b53b0 msgr2=0x7f55340b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:19:23.214+0000 7f5557000640 1 --2- 172.21.15.38:0/1591512072 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f55340b53b0 0x7f55340b7870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5538006010 tx=0x7f5538005e80 comp rx=0 tx=0).stop 2024-09-10T23:19:23.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:19:23.214+0000 7f5557000640 1 -- 172.21.15.38:0/1591512072 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5550075540 msgr2=0x7f555019b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:19:23.214+0000 7f5557000640 1 --2- 172.21.15.38:0/1591512072 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5550075540 0x7f555019b310 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f554000e9f0 tx=0x7f554000eeb0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:19:23.214+0000 7f5557000640 1 -- 172.21.15.38:0/1591512072 shutdown_connections 2024-09-10T23:19:23.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:19:23.214+0000 7f5557000640 1 --2- 172.21.15.38:0/1591512072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f555010f3c0 0x7f55501a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:19:23.214+0000 7f5557000640 1 --2- 172.21.15.38:0/1591512072 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f55340b53b0 0x7f55340b7870 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:19:23.214+0000 7f5557000640 1 --2- 172.21.15.38:0/1591512072 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5550075f40 0x7f555019b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:19:23.214+0000 7f5557000640 1 --2- 172.21.15.38:0/1591512072 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5550075540 0x7f555019b310 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:19:23.214+0000 7f5557000640 1 -- 172.21.15.38:0/1591512072 >> 172.21.15.38:0/1591512072 conn(0x7f55500fe810 msgr2=0x7f55501115b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:23.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:19:23.215+0000 7f5557000640 1 -- 172.21.15.38:0/1591512072 shutdown_connections 2024-09-10T23:19:23.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:19:23.215+0000 7f5557000640 1 -- 172.21.15.38:0/1591512072 wait complete. 2024-09-10T23:19:23.970 DEBUG:teuthology.orchestra.run.smithi038:osd.4> sudo journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.4.service 2024-09-10T23:19:23.974 INFO:tasks.cephadm:Deploying osd.5 on smithi194 with /dev/vg_nvme/lv_3... 2024-09-10T23:19:23.974 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T23:19:24.215 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:24 smithi038 ceph-mon[34225]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:19:24.215 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:24 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:19:24.215 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:24 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:24.215 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:24 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:24.344 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:19:24.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:24 smithi194 ceph-mon[33904]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:19:24.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:24 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:19:24.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:24 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:24.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:24 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:24.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:24 smithi003 ceph-mon[30348]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:19:24.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:24 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:19:24.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:24 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:24.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:24 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:24.543 INFO:journalctl@ceph.osd.4.smithi038.stdout:Sep 10 23:19:24 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-4[46621]: 2024-09-10T23:19:24.233+0000 7f1d2c430640 -1 osd.4 0 log_to_monitors true 2024-09-10T23:19:25.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:25 smithi038 ceph-mon[34225]: from='osd.4 [v2:172.21.15.38:6808/413294160,v1:172.21.15.38:6809/413294160]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T23:19:25.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:25 smithi038 ceph-mon[34225]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T23:19:25.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:25 smithi194 ceph-mon[33904]: from='osd.4 [v2:172.21.15.38:6808/413294160,v1:172.21.15.38:6809/413294160]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T23:19:25.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:25 smithi194 ceph-mon[33904]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T23:19:25.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:25 smithi003 ceph-mon[30348]: from='osd.4 [v2:172.21.15.38:6808/413294160,v1:172.21.15.38:6809/413294160]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T23:19:25.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:25 smithi003 ceph-mon[30348]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T23:19:26.172 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:26 smithi194 ceph-mon[33904]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:19:26.172 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:26 smithi194 ceph-mon[33904]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T23:19:26.172 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:26 smithi194 ceph-mon[33904]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T23:19:26.172 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:26 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:19:26.172 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:26 smithi194 ceph-mon[33904]: from='osd.4 [v2:172.21.15.38:6808/413294160,v1:172.21.15.38:6809/413294160]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-10T23:19:26.172 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:26 smithi194 ceph-mon[33904]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-10T23:19:26.347 INFO:journalctl@ceph.osd.4.smithi038.stdout:Sep 10 23:19:26 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-4[46621]: 2024-09-10T23:19:26.076+0000 7f1d26c00640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T23:19:26.347 INFO:journalctl@ceph.osd.4.smithi038.stdout:Sep 10 23:19:26 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-4[46621]: 2024-09-10T23:19:26.083+0000 7f1d21c00640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:19:26.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:26 smithi038 ceph-mon[34225]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:19:26.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:26 smithi038 ceph-mon[34225]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T23:19:26.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:26 smithi038 ceph-mon[34225]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T23:19:26.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:26 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:19:26.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:26 smithi038 ceph-mon[34225]: from='osd.4 [v2:172.21.15.38:6808/413294160,v1:172.21.15.38:6809/413294160]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-10T23:19:26.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:26 smithi038 ceph-mon[34225]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-10T23:19:26.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:26 smithi003 ceph-mon[30348]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:19:26.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:26 smithi003 ceph-mon[30348]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T23:19:26.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:26 smithi003 ceph-mon[30348]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T23:19:26.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:26 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:19:26.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:26 smithi003 ceph-mon[30348]: from='osd.4 [v2:172.21.15.38:6808/413294160,v1:172.21.15.38:6809/413294160]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-10T23:19:26.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:26 smithi003 ceph-mon[30348]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-10T23:19:27.243 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:27 smithi038 ceph-mon[34225]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-10T23:19:27.243 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:27 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:19:27.243 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:27 smithi038 ceph-mon[34225]: osdmap e31: 5 total, 4 up, 5 in 2024-09-10T23:19:27.243 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:27 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:19:27.434 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:27 smithi194 ceph-mon[33904]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-10T23:19:27.434 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:27 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:19:27.434 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:27 smithi194 ceph-mon[33904]: osdmap e31: 5 total, 4 up, 5 in 2024-09-10T23:19:27.434 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:27 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:19:27.440 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-10T23:19:27.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:27 smithi003 ceph-mon[30348]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-10T23:19:27.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:27 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:19:27.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:27 smithi003 ceph-mon[30348]: osdmap e31: 5 total, 4 up, 5 in 2024-09-10T23:19:27.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:27 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:19:27.472 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi194:vg_nvme/lv_3 2024-09-10T23:19:27.833 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:19:28.301 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:28 smithi194 ceph-mon[33904]: purged_snaps scrub starts 2024-09-10T23:19:28.301 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:28 smithi194 ceph-mon[33904]: purged_snaps scrub ok 2024-09-10T23:19:28.301 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:28 smithi194 ceph-mon[33904]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:19:28.301 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:28 smithi194 ceph-mon[33904]: osd.4 [v2:172.21.15.38:6808/413294160,v1:172.21.15.38:6809/413294160] boot 2024-09-10T23:19:28.301 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:28 smithi194 ceph-mon[33904]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T23:19:28.301 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:28 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:19:28.302 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:28 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:28.302 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:28 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:28.302 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:28 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:28.302 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:28 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:28.302 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:28 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:28.302 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:28 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:28.302 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:28 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:28.302 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:28 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:28.302 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:28 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:19:28.302 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:28 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:28.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:28 smithi038 ceph-mon[34225]: purged_snaps scrub starts 2024-09-10T23:19:28.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:28 smithi038 ceph-mon[34225]: purged_snaps scrub ok 2024-09-10T23:19:28.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:28 smithi038 ceph-mon[34225]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:19:28.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:28 smithi038 ceph-mon[34225]: osd.4 [v2:172.21.15.38:6808/413294160,v1:172.21.15.38:6809/413294160] boot 2024-09-10T23:19:28.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:28 smithi038 ceph-mon[34225]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T23:19:28.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:28 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:19:28.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:28 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:28.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:28 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:28.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:28 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:28.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:28 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:28.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:28 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:28.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:28 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:28.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:28 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:28.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:28 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:28.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:28 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:19:28.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:28 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:28.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.299+0000 7f61d3200640 1 -- 172.21.15.194:0/1279831799 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61cc108f90 msgr2=0x7f61cc10f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:28.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.299+0000 7f61d3200640 1 --2- 172.21.15.194:0/1279831799 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61cc108f90 0x7f61cc10f790 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f61c8009ca0 tx=0x7f61c802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:19:28.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.299+0000 7f61d3200640 1 -- 172.21.15.194:0/1279831799 shutdown_connections 2024-09-10T23:19:28.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.299+0000 7f61d3200640 1 --2- 172.21.15.194:0/1279831799 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61cc108f90 0x7f61cc10f790 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:28.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.299+0000 7f61d3200640 1 --2- 172.21.15.194:0/1279831799 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61cc108610 0x7f61cc108a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:28.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.299+0000 7f61d3200640 1 --2- 172.21.15.194:0/1279831799 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f61cc102c00 0x7f61cc102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:28.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.299+0000 7f61d3200640 1 -- 172.21.15.194:0/1279831799 >> 172.21.15.194:0/1279831799 conn(0x7f61cc0fe6d0 msgr2=0x7f61cc100af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:28.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.299+0000 7f61d3200640 1 -- 172.21.15.194:0/1279831799 shutdown_connections 2024-09-10T23:19:28.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.299+0000 7f61d3200640 1 -- 172.21.15.194:0/1279831799 wait complete. 2024-09-10T23:19:28.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.300+0000 7f61d3200640 1 Processor -- start 2024-09-10T23:19:28.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.300+0000 7f61d3200640 1 -- start start 2024-09-10T23:19:28.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.301+0000 7f61d3200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f61cc102c00 0x7f61cc198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:28.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.301+0000 7f61d3200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61cc108610 0x7f61cc199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:28.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.301+0000 7f61d3200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61cc108f90 0x7f61cc19e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:28.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.301+0000 7f61d3200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f61cc112b50 con 0x7f61cc108610 2024-09-10T23:19:28.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.301+0000 7f61d3200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f61cc1129d0 con 0x7f61cc102c00 2024-09-10T23:19:28.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.301+0000 7f61d3200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f61cc112cd0 con 0x7f61cc108f90 2024-09-10T23:19:28.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.301+0000 7f61d2800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61cc108f90 0x7f61cc19e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:28.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.301+0000 7f61d1e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f61cc102c00 0x7f61cc198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:28.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.301+0000 7f61d2800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61cc108f90 0x7f61cc19e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:55850/0 (socket says 172.21.15.194:55850) 2024-09-10T23:19:28.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.301+0000 7f61d2800640 1 -- 172.21.15.194:0/703587287 learned_addr learned my addr 172.21.15.194:0/703587287 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-10T23:19:28.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.301+0000 7f61d1400640 1 --2- 172.21.15.194:0/703587287 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61cc108610 0x7f61cc199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:28.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.301+0000 7f61d1e00640 1 -- 172.21.15.194:0/703587287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61cc108f90 msgr2=0x7f61cc19e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:28.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.302+0000 7f61d1e00640 1 --2- 172.21.15.194:0/703587287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61cc108f90 0x7f61cc19e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:28.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.302+0000 7f61d1e00640 1 -- 172.21.15.194:0/703587287 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61cc108610 msgr2=0x7f61cc199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:28.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.302+0000 7f61d1e00640 1 --2- 172.21.15.194:0/703587287 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61cc108610 0x7f61cc199400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:28.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.302+0000 7f61d1e00640 1 -- 172.21.15.194:0/703587287 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61cc19ef70 con 0x7f61cc102c00 2024-09-10T23:19:28.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.302+0000 7f61d2800640 1 --2- 172.21.15.194:0/703587287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61cc108f90 0x7f61cc19e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:19:28.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.302+0000 7f61d1e00640 1 --2- 172.21.15.194:0/703587287 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f61cc102c00 0x7f61cc198ec0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f61c000e9f0 tx=0x7f61c000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:28.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.302+0000 7f61c6a00640 1 -- 172.21.15.194:0/703587287 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c000ccc0 con 0x7f61cc102c00 2024-09-10T23:19:28.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.302+0000 7f61d3200640 1 -- 172.21.15.194:0/703587287 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61cc19f260 con 0x7f61cc102c00 2024-09-10T23:19:28.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.302+0000 7f61c6a00640 1 -- 172.21.15.194:0/703587287 <== mon.2 v2:172.21.15.38:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f61c0005020 con 0x7f61cc102c00 2024-09-10T23:19:28.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.302+0000 7f61c6a00640 1 -- 172.21.15.194:0/703587287 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c000ce60 con 0x7f61cc102c00 2024-09-10T23:19:28.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.302+0000 7f61d3200640 1 -- 172.21.15.194:0/703587287 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61cc1a5920 con 0x7f61cc102c00 2024-09-10T23:19:28.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.303+0000 7f61d3200640 1 -- 172.21.15.194:0/703587287 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61cc102fe0 con 0x7f61cc102c00 2024-09-10T23:19:28.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.305+0000 7f61c6a00640 1 -- 172.21.15.194:0/703587287 <== mon.2 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7f61c0004a40 con 0x7f61cc102c00 2024-09-10T23:19:28.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.307+0000 7f61c6a00640 1 --2- 172.21.15.194:0/703587287 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f61b40b53e0 0x7f61b40b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:28.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.307+0000 7f61c6a00640 1 -- 172.21.15.194:0/703587287 <== mon.2 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4316+0+0 (secure 0 0 0) 0x7f61c00e4c80 con 0x7f61cc102c00 2024-09-10T23:19:28.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.307+0000 7f61d1400640 1 --2- 172.21.15.194:0/703587287 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f61b40b53e0 0x7f61b40b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:28.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.308+0000 7f61d1400640 1 --2- 172.21.15.194:0/703587287 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f61b40b53e0 0x7f61b40b78a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f61cc1081a0 tx=0x7f61bc00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:28.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.309+0000 7f61c6a00640 1 -- 172.21.15.194:0/703587287 <== mon.2 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f61c00aca40 con 0x7f61cc102c00 2024-09-10T23:19:28.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:28 smithi003 ceph-mon[30348]: purged_snaps scrub starts 2024-09-10T23:19:28.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:28 smithi003 ceph-mon[30348]: purged_snaps scrub ok 2024-09-10T23:19:28.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:28 smithi003 ceph-mon[30348]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:19:28.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:28 smithi003 ceph-mon[30348]: osd.4 [v2:172.21.15.38:6808/413294160,v1:172.21.15.38:6809/413294160] boot 2024-09-10T23:19:28.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:28 smithi003 ceph-mon[30348]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T23:19:28.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:28 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:19:28.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:28 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:28.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:28 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:28.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:28 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:28.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:28 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:28.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:28 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:28.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:28 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:28.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:28 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:28.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:28 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:28.472 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:28 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:19:28.472 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:28 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:28.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:28.503+0000 7f61d3200640 1 -- 172.21.15.194:0/703587287 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f61cc105bd0 con 0x7f61b40b53e0 2024-09-10T23:19:29.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:29 smithi038 ceph-mon[34225]: Detected new or changed devices on smithi038 2024-09-10T23:19:29.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:29 smithi038 ceph-mon[34225]: Adjusting osd_memory_target on smithi038 to 8547M 2024-09-10T23:19:29.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:29 smithi038 ceph-mon[34225]: osdmap e33: 5 total, 5 up, 5 in 2024-09-10T23:19:29.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:29 smithi038 ceph-mon[34225]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:19:29.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:29 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:19:29.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:29 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:19:29.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:29 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:29.398 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:29 smithi194 ceph-mon[33904]: Detected new or changed devices on smithi038 2024-09-10T23:19:29.398 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:29 smithi194 ceph-mon[33904]: Adjusting osd_memory_target on smithi038 to 8547M 2024-09-10T23:19:29.398 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:29 smithi194 ceph-mon[33904]: osdmap e33: 5 total, 5 up, 5 in 2024-09-10T23:19:29.398 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:29 smithi194 ceph-mon[33904]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:19:29.399 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:29 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:19:29.399 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:29 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:19:29.399 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:29 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:29.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:29 smithi003 ceph-mon[30348]: Detected new or changed devices on smithi038 2024-09-10T23:19:29.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:29 smithi003 ceph-mon[30348]: Adjusting osd_memory_target on smithi038 to 8547M 2024-09-10T23:19:29.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:29 smithi003 ceph-mon[30348]: osdmap e33: 5 total, 5 up, 5 in 2024-09-10T23:19:29.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:29 smithi003 ceph-mon[30348]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:19:29.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:29 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:19:29.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:29 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:19:29.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:29 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:30.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:30 smithi194 ceph-mon[33904]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:30.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:30 smithi038 ceph-mon[34225]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:30.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:30 smithi003 ceph-mon[30348]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:32.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:32 smithi194 ceph-mon[33904]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:32.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:32 smithi194 ceph-mon[33904]: from='client.? 172.21.15.194:0/3565301202' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2cfa107c-6dae-4c26-9e29-8175b1237b31"} : dispatch 2024-09-10T23:19:32.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:32 smithi194 ceph-mon[33904]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2cfa107c-6dae-4c26-9e29-8175b1237b31"} : dispatch 2024-09-10T23:19:32.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:32 smithi194 ceph-mon[33904]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2cfa107c-6dae-4c26-9e29-8175b1237b31"}]': finished 2024-09-10T23:19:32.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:32 smithi194 ceph-mon[33904]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T23:19:32.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:32 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:19:32.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:32 smithi038 ceph-mon[34225]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:32.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:32 smithi038 ceph-mon[34225]: from='client.? 172.21.15.194:0/3565301202' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2cfa107c-6dae-4c26-9e29-8175b1237b31"} : dispatch 2024-09-10T23:19:32.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:32 smithi038 ceph-mon[34225]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2cfa107c-6dae-4c26-9e29-8175b1237b31"} : dispatch 2024-09-10T23:19:32.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:32 smithi038 ceph-mon[34225]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2cfa107c-6dae-4c26-9e29-8175b1237b31"}]': finished 2024-09-10T23:19:32.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:32 smithi038 ceph-mon[34225]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T23:19:32.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:32 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:19:32.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:32 smithi003 ceph-mon[30348]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:32.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:32 smithi003 ceph-mon[30348]: from='client.? 172.21.15.194:0/3565301202' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2cfa107c-6dae-4c26-9e29-8175b1237b31"} : dispatch 2024-09-10T23:19:32.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:32 smithi003 ceph-mon[30348]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2cfa107c-6dae-4c26-9e29-8175b1237b31"} : dispatch 2024-09-10T23:19:32.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:32 smithi003 ceph-mon[30348]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2cfa107c-6dae-4c26-9e29-8175b1237b31"}]': finished 2024-09-10T23:19:32.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:32 smithi003 ceph-mon[30348]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T23:19:32.472 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:32 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:19:33.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:33 smithi194 ceph-mon[33904]: from='client.? 172.21.15.194:0/3661584415' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:19:33.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:33 smithi003 ceph-mon[30348]: from='client.? 172.21.15.194:0/3661584415' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:19:33.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:33 smithi038 ceph-mon[34225]: from='client.? 172.21.15.194:0/3661584415' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:19:34.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:34 smithi194 ceph-mon[33904]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:34.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:34 smithi003 ceph-mon[30348]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:34.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:34 smithi038 ceph-mon[34225]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:36.409 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:36 smithi194 ceph-mon[33904]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:36.472 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:36 smithi003 ceph-mon[30348]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:36.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:36 smithi038 ceph-mon[34225]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:38.366 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:38 smithi194 ceph-mon[33904]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:38.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:38 smithi003 ceph-mon[30348]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:38.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:38 smithi038 ceph-mon[34225]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:40.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:40 smithi194 ceph-mon[33904]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:40.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:40 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T23:19:40.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:40 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:40.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:40 smithi003 ceph-mon[30348]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:40.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:40 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T23:19:40.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:40 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:40.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:40 smithi038 ceph-mon[34225]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:40.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:40 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T23:19:40.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:40 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:41.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:41 smithi194 ceph-mon[33904]: Deploying daemon osd.5 on smithi194 2024-09-10T23:19:41.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:41 smithi003 ceph-mon[30348]: Deploying daemon osd.5 on smithi194 2024-09-10T23:19:41.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:41 smithi038 ceph-mon[34225]: Deploying daemon osd.5 on smithi194 2024-09-10T23:19:42.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:42 smithi194 ceph-mon[33904]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:42.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:42 smithi003 ceph-mon[30348]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:42.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:42 smithi038 ceph-mon[34225]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:44.231 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:44 smithi194 ceph-mon[33904]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:44.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:44 smithi003 ceph-mon[30348]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:44.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:44 smithi038 ceph-mon[34225]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:46.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:46 smithi194 ceph-mon[33904]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:46.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:46 smithi003 ceph-mon[30348]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:46.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:46 smithi038 ceph-mon[34225]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:48.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:48 smithi194 ceph-mon[33904]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:48.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:48 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:19:48.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:48 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:48.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:48 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:48.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:48 smithi003 ceph-mon[30348]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:48.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:48 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:19:48.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:48 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:48.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:48 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:48.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:48 smithi038 ceph-mon[34225]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:48.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:48 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:19:48.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:48 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:48.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:48 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:50.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:50 smithi194 ceph-mon[33904]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:50.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:50 smithi003 ceph-mon[30348]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:50.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:50 smithi038 ceph-mon[34225]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:51.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:51 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:51.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:51 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:51.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:51 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:51.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:51 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:19:51.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:51 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:51.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:51 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:51.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:51 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:51.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:51 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:51.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:51 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:19:51.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:51 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:51.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:51 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:51.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:51 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:51.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:51 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:51.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:51 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:19:51.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:51 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:51.912 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:51.911+0000 7f61c6a00640 1 -- 172.21.15.194:0/703587287 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f61cc105bd0 con 0x7f61b40b53e0 2024-09-10T23:19:51.912 INFO:teuthology.orchestra.run.smithi194.stdout:Created osd(s) 5 on host 'smithi194' 2024-09-10T23:19:51.915 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:51.914+0000 7f61d3200640 1 -- 172.21.15.194:0/703587287 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f61b40b53e0 msgr2=0x7f61b40b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:51.915 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:51.914+0000 7f61d3200640 1 --2- 172.21.15.194:0/703587287 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f61b40b53e0 0x7f61b40b78a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f61cc1081a0 tx=0x7f61bc00b390 comp rx=0 tx=0).stop 2024-09-10T23:19:51.915 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:51.914+0000 7f61d3200640 1 -- 172.21.15.194:0/703587287 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f61cc102c00 msgr2=0x7f61cc198ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:51.915 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:51.914+0000 7f61d3200640 1 --2- 172.21.15.194:0/703587287 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f61cc102c00 0x7f61cc198ec0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f61c000e9f0 tx=0x7f61c000eeb0 comp rx=0 tx=0).stop 2024-09-10T23:19:51.915 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:51.914+0000 7f61d3200640 1 -- 172.21.15.194:0/703587287 shutdown_connections 2024-09-10T23:19:51.915 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:51.914+0000 7f61d3200640 1 --2- 172.21.15.194:0/703587287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61cc108f90 0x7f61cc19e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:51.915 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:51.914+0000 7f61d3200640 1 --2- 172.21.15.194:0/703587287 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f61b40b53e0 0x7f61b40b78a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:51.915 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:51.914+0000 7f61d3200640 1 --2- 172.21.15.194:0/703587287 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61cc108610 0x7f61cc199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:51.915 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:51.914+0000 7f61d3200640 1 --2- 172.21.15.194:0/703587287 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f61cc102c00 0x7f61cc198ec0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:51.915 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:51.914+0000 7f61d3200640 1 -- 172.21.15.194:0/703587287 >> 172.21.15.194:0/703587287 conn(0x7f61cc0fe6d0 msgr2=0x7f61cc101bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:51.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:51.914+0000 7f61d3200640 1 -- 172.21.15.194:0/703587287 shutdown_connections 2024-09-10T23:19:51.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:19:51.914+0000 7f61d3200640 1 -- 172.21.15.194:0/703587287 wait complete. 2024-09-10T23:19:52.453 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:52 smithi194 ceph-mon[33904]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:52.453 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:52 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:19:52.453 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:52 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:52.453 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:52 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:52.612 DEBUG:teuthology.orchestra.run.smithi194:osd.5> sudo journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.5.service 2024-09-10T23:19:52.616 INFO:tasks.cephadm:Deploying osd.6 on smithi003 with /dev/vg_nvme/lv_2... 2024-09-10T23:19:52.617 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T23:19:52.670 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:52 smithi003 ceph-mon[30348]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:52.671 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:52 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:19:52.671 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:52 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:52.671 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:52 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:52.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:52 smithi038 ceph-mon[34225]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:52.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:52 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:19:52.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:52 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:52.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:52 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:52.998 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:19:53.788 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 10 23:19:53 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-5[46899]: 2024-09-10T23:19:53.635+0000 7fd4ce83c640 -1 osd.5 0 log_to_monitors true 2024-09-10T23:19:54.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:54 smithi194 ceph-mon[33904]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:54.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:54 smithi194 ceph-mon[33904]: from='osd.5 [v2:172.21.15.194:6808/4117812658,v1:172.21.15.194:6809/4117812658]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T23:19:54.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:54 smithi194 ceph-mon[33904]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T23:19:54.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:54 smithi003 ceph-mon[30348]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:54.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:54 smithi003 ceph-mon[30348]: from='osd.5 [v2:172.21.15.194:6808/4117812658,v1:172.21.15.194:6809/4117812658]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T23:19:54.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:54 smithi003 ceph-mon[30348]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T23:19:54.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:54 smithi038 ceph-mon[34225]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:54.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:54 smithi038 ceph-mon[34225]: from='osd.5 [v2:172.21.15.194:6808/4117812658,v1:172.21.15.194:6809/4117812658]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T23:19:54.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:54 smithi038 ceph-mon[34225]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T23:19:55.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:55 smithi194 ceph-mon[33904]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T23:19:55.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:55 smithi194 ceph-mon[33904]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T23:19:55.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:55 smithi194 ceph-mon[33904]: from='osd.5 [v2:172.21.15.194:6808/4117812658,v1:172.21.15.194:6809/4117812658]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]} : dispatch 2024-09-10T23:19:55.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:55 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:19:55.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:55 smithi194 ceph-mon[33904]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]} : dispatch 2024-09-10T23:19:55.699 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:55 smithi003 ceph-mon[30348]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T23:19:55.700 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:55 smithi003 ceph-mon[30348]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T23:19:55.700 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:55 smithi003 ceph-mon[30348]: from='osd.5 [v2:172.21.15.194:6808/4117812658,v1:172.21.15.194:6809/4117812658]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]} : dispatch 2024-09-10T23:19:55.700 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:55 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:19:55.700 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:55 smithi003 ceph-mon[30348]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]} : dispatch 2024-09-10T23:19:55.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:55 smithi038 ceph-mon[34225]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T23:19:55.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:55 smithi038 ceph-mon[34225]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T23:19:55.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:55 smithi038 ceph-mon[34225]: from='osd.5 [v2:172.21.15.194:6808/4117812658,v1:172.21.15.194:6809/4117812658]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]} : dispatch 2024-09-10T23:19:55.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:55 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:19:55.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:55 smithi038 ceph-mon[34225]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]} : dispatch 2024-09-10T23:19:56.197 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 10 23:19:55 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-5[46899]: 2024-09-10T23:19:55.939+0000 7fd4c9400640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T23:19:56.197 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 10 23:19:55 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-5[46899]: 2024-09-10T23:19:55.965+0000 7fd4bf400640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:19:56.505 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:19:56.547 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi003:vg_nvme/lv_2 2024-09-10T23:19:56.598 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:56 smithi003 ceph-mon[30348]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:56.598 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:56 smithi003 ceph-mon[30348]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-10T23:19:56.598 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:56 smithi003 ceph-mon[30348]: osdmap e36: 6 total, 5 up, 6 in 2024-09-10T23:19:56.598 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:56 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:19:56.598 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:56 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:19:56.598 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:56 smithi003 ceph-mon[30348]: from='osd.5 ' entity='osd.5' 2024-09-10T23:19:56.598 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:56 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:56.598 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:56 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:56.598 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:56 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:56.598 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:56 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:56.598 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:56 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:56.598 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:56 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:56.599 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:56 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:56.599 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:56 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:56.599 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:56 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:19:56.599 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:56 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:56.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:56 smithi038 ceph-mon[34225]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:56.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:56 smithi038 ceph-mon[34225]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-10T23:19:56.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:56 smithi038 ceph-mon[34225]: osdmap e36: 6 total, 5 up, 6 in 2024-09-10T23:19:56.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:56 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:19:56.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:56 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:19:56.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:56 smithi038 ceph-mon[34225]: from='osd.5 ' entity='osd.5' 2024-09-10T23:19:56.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:56 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:56.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:56 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:56.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:56 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:56.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:56 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:56.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:56 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:56.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:56 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:56.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:56 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:56.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:56 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:56.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:56 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:19:56.849 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:56 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:56.931 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:19:56.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:56 smithi194 ceph-mon[33904]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:56.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:56 smithi194 ceph-mon[33904]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-10T23:19:56.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:56 smithi194 ceph-mon[33904]: osdmap e36: 6 total, 5 up, 6 in 2024-09-10T23:19:56.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:56 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:19:56.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:56 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:19:56.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:56 smithi194 ceph-mon[33904]: from='osd.5 ' entity='osd.5' 2024-09-10T23:19:56.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:56 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:56.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:56 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:56.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:56 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:56.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:56 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:56.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:56 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:56.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:56 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:19:56.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:56 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:56.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:56 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:56.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:56 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:19:56.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:56 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:19:57.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.476+0000 7f2532800640 1 -- 172.21.15.3:0/225268506 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f252c10a9b0 msgr2=0x7f252c10adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:57.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.476+0000 7f2532800640 1 --2- 172.21.15.3:0/225268506 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f252c10a9b0 0x7f252c10adf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2514009900 tx=0x7f251402a410 comp rx=0 tx=0).stop 2024-09-10T23:19:57.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.476+0000 7f2532800640 1 -- 172.21.15.3:0/225268506 shutdown_connections 2024-09-10T23:19:57.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.476+0000 7f2532800640 1 --2- 172.21.15.3:0/225268506 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f252c10b330 0x7f252c111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:57.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.476+0000 7f2532800640 1 --2- 172.21.15.3:0/225268506 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f252c10a9b0 0x7f252c10adf0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:57.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.476+0000 7f2532800640 1 --2- 172.21.15.3:0/225268506 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f252c104fa0 0x7f252c105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:57.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.476+0000 7f2532800640 1 -- 172.21.15.3:0/225268506 >> 172.21.15.3:0/225268506 conn(0x7f252c100a50 msgr2=0x7f252c102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:57.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.476+0000 7f2532800640 1 -- 172.21.15.3:0/225268506 shutdown_connections 2024-09-10T23:19:57.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.476+0000 7f2532800640 1 -- 172.21.15.3:0/225268506 wait complete. 2024-09-10T23:19:57.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.477+0000 7f2532800640 1 Processor -- start 2024-09-10T23:19:57.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.477+0000 7f2532800640 1 -- start start 2024-09-10T23:19:57.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.477+0000 7f2532800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f252c104fa0 0x7f252c19b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:57.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.477+0000 7f2532800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f252c10a9b0 0x7f252c19b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:57.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.477+0000 7f2532800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f252c10b330 0x7f252c1a0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:57.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.477+0000 7f2532800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f252c114e00 con 0x7f252c104fa0 2024-09-10T23:19:57.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.477+0000 7f2532800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f252c114c80 con 0x7f252c10a9b0 2024-09-10T23:19:57.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.477+0000 7f2532800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f252c114f80 con 0x7f252c10b330 2024-09-10T23:19:57.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.477+0000 7f252b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f252c104fa0 0x7f252c19b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:57.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.477+0000 7f252b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f252c104fa0 0x7f252c19b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59994/0 (socket says 172.21.15.3:59994) 2024-09-10T23:19:57.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.478+0000 7f252b400640 1 -- 172.21.15.3:0/646217471 learned_addr learned my addr 172.21.15.3:0/646217471 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:19:57.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.478+0000 7f2523e00640 1 --2- 172.21.15.3:0/646217471 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f252c10a9b0 0x7f252c19b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:57.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.478+0000 7f252be00640 1 --2- 172.21.15.3:0/646217471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f252c10b330 0x7f252c1a0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:57.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.478+0000 7f252b400640 1 -- 172.21.15.3:0/646217471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f252c10b330 msgr2=0x7f252c1a0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:57.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.478+0000 7f252b400640 1 --2- 172.21.15.3:0/646217471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f252c10b330 0x7f252c1a0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:57.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.478+0000 7f252b400640 1 -- 172.21.15.3:0/646217471 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f252c10a9b0 msgr2=0x7f252c19b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:57.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.478+0000 7f252b400640 1 --2- 172.21.15.3:0/646217471 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f252c10a9b0 0x7f252c19b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:57.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.478+0000 7f252b400640 1 -- 172.21.15.3:0/646217471 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f252c1a1480 con 0x7f252c104fa0 2024-09-10T23:19:57.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.478+0000 7f252b400640 1 --2- 172.21.15.3:0/646217471 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f252c104fa0 0x7f252c19b3d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f251c00e9f0 tx=0x7f251c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:57.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.479+0000 7f2528c00640 1 -- 172.21.15.3:0/646217471 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251c00cd80 con 0x7f252c104fa0 2024-09-10T23:19:57.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.479+0000 7f2528c00640 1 -- 172.21.15.3:0/646217471 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f251c0054b0 con 0x7f252c104fa0 2024-09-10T23:19:57.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.479+0000 7f2528c00640 1 -- 172.21.15.3:0/646217471 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251c010430 con 0x7f252c104fa0 2024-09-10T23:19:57.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.479+0000 7f2532800640 1 -- 172.21.15.3:0/646217471 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f252c1a1770 con 0x7f252c104fa0 2024-09-10T23:19:57.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.479+0000 7f2532800640 1 -- 172.21.15.3:0/646217471 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f252c1a7e30 con 0x7f252c104fa0 2024-09-10T23:19:57.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.480+0000 7f2532800640 1 -- 172.21.15.3:0/646217471 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f252c105380 con 0x7f252c104fa0 2024-09-10T23:19:57.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.482+0000 7f2528c00640 1 -- 172.21.15.3:0/646217471 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7f251c005020 con 0x7f252c104fa0 2024-09-10T23:19:57.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.483+0000 7f2528c00640 1 --2- 172.21.15.3:0/646217471 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f25100b53b0 0x7f25100b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:57.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.484+0000 7f2528c00640 1 -- 172.21.15.3:0/646217471 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4748+0+0 (secure 0 0 0) 0x7f251c0e5280 con 0x7f252c104fa0 2024-09-10T23:19:57.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.484+0000 7f2523e00640 1 --2- 172.21.15.3:0/646217471 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f25100b53b0 0x7f25100b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:57.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.484+0000 7f2523e00640 1 --2- 172.21.15.3:0/646217471 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f25100b53b0 0x7f25100b7870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f25140057c0 tx=0x7f25140058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:57.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.488+0000 7f2528c00640 1 -- 172.21.15.3:0/646217471 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f251c0ace90 con 0x7f252c104fa0 2024-09-10T23:19:57.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:19:57.696+0000 7f2532800640 1 -- 172.21.15.3:0/646217471 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f252c063590 con 0x7f25100b53b0 2024-09-10T23:19:57.698 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:57 smithi003 ceph-mon[30348]: purged_snaps scrub starts 2024-09-10T23:19:57.698 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:57 smithi003 ceph-mon[30348]: purged_snaps scrub ok 2024-09-10T23:19:57.698 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:57 smithi003 ceph-mon[30348]: Detected new or changed devices on smithi194 2024-09-10T23:19:57.698 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:57 smithi003 ceph-mon[30348]: Adjusting osd_memory_target on smithi194 to 8544M 2024-09-10T23:19:57.698 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:57 smithi003 ceph-mon[30348]: osd.5 [v2:172.21.15.194:6808/4117812658,v1:172.21.15.194:6809/4117812658] boot 2024-09-10T23:19:57.698 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:57 smithi003 ceph-mon[30348]: osdmap e37: 6 total, 6 up, 6 in 2024-09-10T23:19:57.698 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:57 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:19:57.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:57 smithi038 ceph-mon[34225]: purged_snaps scrub starts 2024-09-10T23:19:57.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:57 smithi038 ceph-mon[34225]: purged_snaps scrub ok 2024-09-10T23:19:57.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:57 smithi038 ceph-mon[34225]: Detected new or changed devices on smithi194 2024-09-10T23:19:57.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:57 smithi038 ceph-mon[34225]: Adjusting osd_memory_target on smithi194 to 8544M 2024-09-10T23:19:57.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:57 smithi038 ceph-mon[34225]: osd.5 [v2:172.21.15.194:6808/4117812658,v1:172.21.15.194:6809/4117812658] boot 2024-09-10T23:19:57.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:57 smithi038 ceph-mon[34225]: osdmap e37: 6 total, 6 up, 6 in 2024-09-10T23:19:57.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:57 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:19:57.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:57 smithi194 ceph-mon[33904]: purged_snaps scrub starts 2024-09-10T23:19:57.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:57 smithi194 ceph-mon[33904]: purged_snaps scrub ok 2024-09-10T23:19:57.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:57 smithi194 ceph-mon[33904]: Detected new or changed devices on smithi194 2024-09-10T23:19:57.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:57 smithi194 ceph-mon[33904]: Adjusting osd_memory_target on smithi194 to 8544M 2024-09-10T23:19:57.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:57 smithi194 ceph-mon[33904]: osd.5 [v2:172.21.15.194:6808/4117812658,v1:172.21.15.194:6809/4117812658] boot 2024-09-10T23:19:57.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:57 smithi194 ceph-mon[33904]: osdmap e37: 6 total, 6 up, 6 in 2024-09-10T23:19:57.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:57 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:19:58.604 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:58 smithi003 ceph-mon[30348]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:58.604 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:58 smithi003 ceph-mon[30348]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T23:19:58.604 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:58 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:19:58.604 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:58 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:19:58.604 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:58 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:58.749 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:58 smithi038 ceph-mon[34225]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:58.749 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:58 smithi038 ceph-mon[34225]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T23:19:58.749 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:58 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:19:58.749 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:58 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:19:58.749 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:58 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:58.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:58 smithi194 ceph-mon[33904]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:19:58.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:58 smithi194 ceph-mon[33904]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T23:19:58.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:58 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:19:58.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:58 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:19:58.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:58 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:19:59.750 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:59 smithi003 ceph-mon[30348]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:19:59.750 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:19:59 smithi003 ceph-mon[30348]: osdmap e39: 6 total, 6 up, 6 in 2024-09-10T23:19:59.777 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:59 smithi038 ceph-mon[34225]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:19:59.777 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:19:59 smithi038 ceph-mon[34225]: osdmap e39: 6 total, 6 up, 6 in 2024-09-10T23:19:59.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:59 smithi194 ceph-mon[33904]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:19:59.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:19:59 smithi194 ceph-mon[33904]: osdmap e39: 6 total, 6 up, 6 in 2024-09-10T23:20:00.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:00 smithi003 ceph-mon[30348]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:20:00.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:00 smithi003 ceph-mon[30348]: overall HEALTH_OK 2024-09-10T23:20:00.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:00 smithi038 ceph-mon[34225]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:20:00.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:00 smithi038 ceph-mon[34225]: overall HEALTH_OK 2024-09-10T23:20:00.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:00 smithi194 ceph-mon[33904]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:20:00.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:00 smithi194 ceph-mon[33904]: overall HEALTH_OK 2024-09-10T23:20:01.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:01 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3011276573' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d2e4e309-c587-4725-a5b3-cbc7b1226750"} : dispatch 2024-09-10T23:20:01.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:01 smithi038 ceph-mon[34225]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d2e4e309-c587-4725-a5b3-cbc7b1226750"} : dispatch 2024-09-10T23:20:01.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:01 smithi038 ceph-mon[34225]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d2e4e309-c587-4725-a5b3-cbc7b1226750"}]': finished 2024-09-10T23:20:01.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:01 smithi038 ceph-mon[34225]: osdmap e40: 7 total, 6 up, 7 in 2024-09-10T23:20:01.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:01 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:20:01.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:01 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3011276573' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d2e4e309-c587-4725-a5b3-cbc7b1226750"} : dispatch 2024-09-10T23:20:01.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:01 smithi194 ceph-mon[33904]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d2e4e309-c587-4725-a5b3-cbc7b1226750"} : dispatch 2024-09-10T23:20:01.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:01 smithi194 ceph-mon[33904]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d2e4e309-c587-4725-a5b3-cbc7b1226750"}]': finished 2024-09-10T23:20:01.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:01 smithi194 ceph-mon[33904]: osdmap e40: 7 total, 6 up, 7 in 2024-09-10T23:20:01.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:01 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:20:01.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:01 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3011276573' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d2e4e309-c587-4725-a5b3-cbc7b1226750"} : dispatch 2024-09-10T23:20:01.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:01 smithi003 ceph-mon[30348]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d2e4e309-c587-4725-a5b3-cbc7b1226750"} : dispatch 2024-09-10T23:20:01.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:01 smithi003 ceph-mon[30348]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d2e4e309-c587-4725-a5b3-cbc7b1226750"}]': finished 2024-09-10T23:20:01.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:01 smithi003 ceph-mon[30348]: osdmap e40: 7 total, 6 up, 7 in 2024-09-10T23:20:01.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:01 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:20:02.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:02 smithi038 ceph-mon[34225]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-10T23:20:02.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:02 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/719092040' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:20:02.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:02 smithi194 ceph-mon[33904]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-10T23:20:02.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:02 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/719092040' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:20:02.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:02 smithi003 ceph-mon[30348]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-10T23:20:02.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:02 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/719092040' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:20:04.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:04 smithi038 ceph-mon[34225]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:20:04.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:04 smithi194 ceph-mon[33904]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:20:04.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:04 smithi003 ceph-mon[30348]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:20:06.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:06 smithi003 ceph-mon[30348]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-10T23:20:06.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:06 smithi038 ceph-mon[34225]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-10T23:20:06.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:06 smithi194 ceph-mon[33904]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-10T23:20:08.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:08 smithi038 ceph-mon[34225]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-10T23:20:08.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:08 smithi194 ceph-mon[33904]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-10T23:20:08.968 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:08 smithi003 ceph-mon[30348]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-10T23:20:10.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:10 smithi003 ceph-mon[30348]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:20:10.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:10 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T23:20:10.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:10 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:10.775 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:10 smithi038 ceph-mon[34225]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:20:10.776 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:10 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T23:20:10.776 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:10 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:10.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:10 smithi194 ceph-mon[33904]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:20:10.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:10 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T23:20:10.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:10 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:11.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:11 smithi003 ceph-mon[30348]: Deploying daemon osd.6 on smithi003 2024-09-10T23:20:11.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:11 smithi038 ceph-mon[34225]: Deploying daemon osd.6 on smithi003 2024-09-10T23:20:11.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:11 smithi194 ceph-mon[33904]: Deploying daemon osd.6 on smithi003 2024-09-10T23:20:12.636 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:12 smithi003 ceph-mon[30348]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:20:12.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:12 smithi038 ceph-mon[34225]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:20:12.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:12 smithi194 ceph-mon[33904]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:20:14.757 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:14 smithi003 ceph-mon[30348]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:20:14.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:14 smithi038 ceph-mon[34225]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:20:14.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:14 smithi194 ceph-mon[33904]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:20:16.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:16 smithi003 ceph-mon[30348]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:20:16.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:16 smithi038 ceph-mon[34225]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:20:16.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:16 smithi194 ceph-mon[33904]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:20:18.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:18 smithi038 ceph-mon[34225]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:20:18.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:18 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:20:18.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:18 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:18.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:18 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:18.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:18 smithi194 ceph-mon[33904]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:20:18.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:18 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:20:18.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:18 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:18.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:18 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:18.967 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:18 smithi003 ceph-mon[30348]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:20:18.968 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:18 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:20:18.968 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:18 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:18.968 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:18 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:20.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:20 smithi038 ceph-mon[34225]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:20:20.873 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:20 smithi003 ceph-mon[30348]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:20:20.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:20 smithi194 ceph-mon[33904]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:20:22.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:22 smithi038 ceph-mon[34225]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:20:22.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:22 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:22.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:22 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:22.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:22 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:22.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:22 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:20:22.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:22 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:22.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:22 smithi194 ceph-mon[33904]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:20:22.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:22 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:22.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:22 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:22.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:22 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:22.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:22 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:20:22.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:22 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:22.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:22 smithi003 ceph-mon[30348]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:20:22.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:22 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:22.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:22 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:22.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:22 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:22.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:22 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:20:22.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:22 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:23.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:20:23.119+0000 7f2528c00640 1 -- 172.21.15.3:0/646217471 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f252c063590 con 0x7f25100b53b0 2024-09-10T23:20:23.121 INFO:teuthology.orchestra.run.smithi003.stdout:Created osd(s) 6 on host 'smithi003' 2024-09-10T23:20:23.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:20:23.122+0000 7f2532800640 1 -- 172.21.15.3:0/646217471 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f25100b53b0 msgr2=0x7f25100b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:23.124 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:20:23.122+0000 7f2532800640 1 --2- 172.21.15.3:0/646217471 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f25100b53b0 0x7f25100b7870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f25140057c0 tx=0x7f25140058d0 comp rx=0 tx=0).stop 2024-09-10T23:20:23.124 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:20:23.122+0000 7f2532800640 1 -- 172.21.15.3:0/646217471 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f252c104fa0 msgr2=0x7f252c19b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:23.124 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:20:23.122+0000 7f2532800640 1 --2- 172.21.15.3:0/646217471 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f252c104fa0 0x7f252c19b3d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f251c00e9f0 tx=0x7f251c00edf0 comp rx=0 tx=0).stop 2024-09-10T23:20:23.124 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:20:23.122+0000 7f2532800640 1 -- 172.21.15.3:0/646217471 shutdown_connections 2024-09-10T23:20:23.124 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:20:23.122+0000 7f2532800640 1 --2- 172.21.15.3:0/646217471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f252c10b330 0x7f252c1a0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:23.124 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:20:23.122+0000 7f2532800640 1 --2- 172.21.15.3:0/646217471 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f252c10a9b0 0x7f252c19b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:23.124 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:20:23.122+0000 7f2532800640 1 --2- 172.21.15.3:0/646217471 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f25100b53b0 0x7f25100b7870 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:23.124 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:20:23.122+0000 7f2532800640 1 --2- 172.21.15.3:0/646217471 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f252c104fa0 0x7f252c19b3d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:23.124 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:20:23.122+0000 7f2532800640 1 -- 172.21.15.3:0/646217471 >> 172.21.15.3:0/646217471 conn(0x7f252c100a50 msgr2=0x7f252c102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:23.124 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:20:23.123+0000 7f2532800640 1 -- 172.21.15.3:0/646217471 shutdown_connections 2024-09-10T23:20:23.124 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:20:23.123+0000 7f2532800640 1 -- 172.21.15.3:0/646217471 wait complete. 2024-09-10T23:20:23.829 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:23 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:20:23.829 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:23 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:23.829 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:23 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:23.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:23 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:20:23.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:23 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:23.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:23 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:23.866 DEBUG:teuthology.orchestra.run.smithi003:osd.6> sudo journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.6.service 2024-09-10T23:20:23.869 INFO:tasks.cephadm:Deploying osd.7 on smithi038 with /dev/vg_nvme/lv_2... 2024-09-10T23:20:23.870 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T23:20:23.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:23 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:20:23.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:23 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:23.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:23 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:24.281 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:20:24.708 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:24 smithi038 ceph-mon[34225]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:20:24.708 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:24 smithi038 ceph-mon[34225]: from='osd.6 [v2:172.21.15.3:6818/3470543721,v1:172.21.15.3:6819/3470543721]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T23:20:24.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:24 smithi003 ceph-mon[30348]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:20:24.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:24 smithi003 ceph-mon[30348]: from='osd.6 [v2:172.21.15.3:6818/3470543721,v1:172.21.15.3:6819/3470543721]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T23:20:24.721 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:20:24 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:20:24.420+0000 7f68df22e640 -1 osd.6 0 log_to_monitors true 2024-09-10T23:20:24.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:24 smithi194 ceph-mon[33904]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:20:24.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:24 smithi194 ceph-mon[33904]: from='osd.6 [v2:172.21.15.3:6818/3470543721,v1:172.21.15.3:6819/3470543721]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T23:20:25.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:25 smithi003 ceph-mon[30348]: from='osd.6 [v2:172.21.15.3:6818/3470543721,v1:172.21.15.3:6819/3470543721]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T23:20:25.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:25 smithi003 ceph-mon[30348]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T23:20:25.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:25 smithi003 ceph-mon[30348]: from='osd.6 [v2:172.21.15.3:6818/3470543721,v1:172.21.15.3:6819/3470543721]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi003", "root=default"]} : dispatch 2024-09-10T23:20:25.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:25 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:20:25.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:25 smithi003 ceph-mon[30348]: from='osd.6 [v2:172.21.15.3:6818/3470543721,v1:172.21.15.3:6819/3470543721]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]': finished 2024-09-10T23:20:25.721 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:20:25 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:20:25.559+0000 7f68d9a00640 -1 osd.6 0 waiting for initial osdmap 2024-09-10T23:20:25.721 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:20:25 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:20:25.573+0000 7f68d4a00640 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:20:25.820 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:25 smithi038 ceph-mon[34225]: from='osd.6 [v2:172.21.15.3:6818/3470543721,v1:172.21.15.3:6819/3470543721]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T23:20:25.820 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:25 smithi038 ceph-mon[34225]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T23:20:25.820 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:25 smithi038 ceph-mon[34225]: from='osd.6 [v2:172.21.15.3:6818/3470543721,v1:172.21.15.3:6819/3470543721]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi003", "root=default"]} : dispatch 2024-09-10T23:20:25.821 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:25 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:20:25.821 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:25 smithi038 ceph-mon[34225]: from='osd.6 [v2:172.21.15.3:6818/3470543721,v1:172.21.15.3:6819/3470543721]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]': finished 2024-09-10T23:20:25.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:25 smithi194 ceph-mon[33904]: from='osd.6 [v2:172.21.15.3:6818/3470543721,v1:172.21.15.3:6819/3470543721]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T23:20:25.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:25 smithi194 ceph-mon[33904]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T23:20:25.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:25 smithi194 ceph-mon[33904]: from='osd.6 [v2:172.21.15.3:6818/3470543721,v1:172.21.15.3:6819/3470543721]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi003", "root=default"]} : dispatch 2024-09-10T23:20:25.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:25 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:20:25.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:25 smithi194 ceph-mon[33904]: from='osd.6 [v2:172.21.15.3:6818/3470543721,v1:172.21.15.3:6819/3470543721]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]': finished 2024-09-10T23:20:26.829 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:26 smithi003 ceph-mon[30348]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:20:26.829 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:26 smithi003 ceph-mon[30348]: osdmap e42: 7 total, 6 up, 7 in 2024-09-10T23:20:26.829 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:26 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:20:26.829 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:26 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:20:26.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:26 smithi038 ceph-mon[34225]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:20:26.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:26 smithi038 ceph-mon[34225]: osdmap e42: 7 total, 6 up, 7 in 2024-09-10T23:20:26.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:26 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:20:26.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:26 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:20:26.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:26 smithi194 ceph-mon[33904]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:20:26.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:26 smithi194 ceph-mon[33904]: osdmap e42: 7 total, 6 up, 7 in 2024-09-10T23:20:26.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:26 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:20:26.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:26 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:20:27.362 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T23:20:27.398 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi038:vg_nvme/lv_2 2024-09-10T23:20:27.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:27 smithi038 ceph-mon[34225]: purged_snaps scrub starts 2024-09-10T23:20:27.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:27 smithi038 ceph-mon[34225]: purged_snaps scrub ok 2024-09-10T23:20:27.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:27 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:20:27.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:27 smithi038 ceph-mon[34225]: osd.6 [v2:172.21.15.3:6818/3470543721,v1:172.21.15.3:6819/3470543721] boot 2024-09-10T23:20:27.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:27 smithi038 ceph-mon[34225]: osdmap e43: 7 total, 7 up, 7 in 2024-09-10T23:20:27.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:27 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:27.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:27 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:27.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:27 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:27.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:27 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:27.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:27 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:27.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:27 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:27.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:27 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:27.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:27 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:27.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:27 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:27.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:27 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:27.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:27 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:20:27.599 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:27 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:27.791 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:20:27.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:27 smithi194 ceph-mon[33904]: purged_snaps scrub starts 2024-09-10T23:20:27.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:27 smithi194 ceph-mon[33904]: purged_snaps scrub ok 2024-09-10T23:20:27.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:27 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:20:27.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:27 smithi194 ceph-mon[33904]: osd.6 [v2:172.21.15.3:6818/3470543721,v1:172.21.15.3:6819/3470543721] boot 2024-09-10T23:20:27.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:27 smithi194 ceph-mon[33904]: osdmap e43: 7 total, 7 up, 7 in 2024-09-10T23:20:27.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:27 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:27.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:27 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:27.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:27 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:27.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:27 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:27.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:27 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:27.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:27 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:27.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:27 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:27.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:27 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:27.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:27 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:27.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:27 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:27.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:27 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:20:27.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:27 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:27.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:27 smithi003 ceph-mon[30348]: purged_snaps scrub starts 2024-09-10T23:20:27.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:27 smithi003 ceph-mon[30348]: purged_snaps scrub ok 2024-09-10T23:20:27.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:27 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:20:27.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:27 smithi003 ceph-mon[30348]: osd.6 [v2:172.21.15.3:6818/3470543721,v1:172.21.15.3:6819/3470543721] boot 2024-09-10T23:20:27.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:27 smithi003 ceph-mon[30348]: osdmap e43: 7 total, 7 up, 7 in 2024-09-10T23:20:27.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:27 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:27.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:27 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:27.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:27 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:27.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:27 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:27.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:27 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:27.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:27 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:27.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:27 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:27.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:27 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:27.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:27 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:27.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:27 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:27.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:27 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:20:27.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:27 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:28.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.358+0000 7fcab2c00640 1 -- 172.21.15.38:0/737179707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcaac113990 msgr2=0x7fcaac115d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:28.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.358+0000 7fcab2c00640 1 --2- 172.21.15.38:0/737179707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcaac113990 0x7fcaac115d80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4009ca0 tx=0x7fcaa402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:20:28.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.359+0000 7fcab2c00640 1 -- 172.21.15.38:0/737179707 shutdown_connections 2024-09-10T23:20:28.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.359+0000 7fcab2c00640 1 --2- 172.21.15.38:0/737179707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcaac113990 0x7fcaac115d80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:28.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.359+0000 7fcab2c00640 1 --2- 172.21.15.38:0/737179707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcaac077ff0 0x7fcaac113450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:28.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.359+0000 7fcab2c00640 1 --2- 172.21.15.38:0/737179707 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcaac0776d0 0x7fcaac077ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:28.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.359+0000 7fcab2c00640 1 -- 172.21.15.38:0/737179707 >> 172.21.15.38:0/737179707 conn(0x7fcaac100a50 msgr2=0x7fcaac102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:28.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.359+0000 7fcab2c00640 1 -- 172.21.15.38:0/737179707 shutdown_connections 2024-09-10T23:20:28.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.359+0000 7fcab2c00640 1 -- 172.21.15.38:0/737179707 wait complete. 2024-09-10T23:20:28.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.359+0000 7fcab2c00640 1 Processor -- start 2024-09-10T23:20:28.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.360+0000 7fcab2c00640 1 -- start start 2024-09-10T23:20:28.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.360+0000 7fcab2c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcaac0776d0 0x7fcaac19f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:28.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.360+0000 7fcab2c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcaac077ff0 0x7fcaac19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:28.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.360+0000 7fcab2c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcaac113990 0x7fcaac1a5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:28.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.360+0000 7fcab2c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fcaac119270 con 0x7fcaac077ff0 2024-09-10T23:20:28.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.360+0000 7fcab2c00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fcaac1190f0 con 0x7fcaac0776d0 2024-09-10T23:20:28.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.360+0000 7fcab2c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcaac1193f0 con 0x7fcaac113990 2024-09-10T23:20:28.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.360+0000 7fcaabe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcaac0776d0 0x7fcaac19f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:28.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.360+0000 7fcaabe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcaac0776d0 0x7fcaac19f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51214/0 (socket says 172.21.15.38:51214) 2024-09-10T23:20:28.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.360+0000 7fcaabe00640 1 -- 172.21.15.38:0/3627734168 learned_addr learned my addr 172.21.15.38:0/3627734168 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-10T23:20:28.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.361+0000 7fcaa3e00640 1 --2- 172.21.15.38:0/3627734168 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcaac077ff0 0x7fcaac19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:28.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.361+0000 7fcab0c00640 1 --2- 172.21.15.38:0/3627734168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcaac113990 0x7fcaac1a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:28.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.361+0000 7fcaabe00640 1 -- 172.21.15.38:0/3627734168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcaac113990 msgr2=0x7fcaac1a5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:28.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.361+0000 7fcaabe00640 1 --2- 172.21.15.38:0/3627734168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcaac113990 0x7fcaac1a5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:28.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.361+0000 7fcaabe00640 1 -- 172.21.15.38:0/3627734168 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcaac077ff0 msgr2=0x7fcaac19fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:28.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.361+0000 7fcaabe00640 1 --2- 172.21.15.38:0/3627734168 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcaac077ff0 0x7fcaac19fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:28.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.361+0000 7fcaabe00640 1 -- 172.21.15.38:0/3627734168 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaac1a5830 con 0x7fcaac0776d0 2024-09-10T23:20:28.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.361+0000 7fcaabe00640 1 --2- 172.21.15.38:0/3627734168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcaac0776d0 0x7fcaac19f780 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00d950 tx=0x7fca9c00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:28.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.361+0000 7fcaa9600640 1 -- 172.21.15.38:0/3627734168 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9c017030 con 0x7fcaac0776d0 2024-09-10T23:20:28.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.361+0000 7fcaa9600640 1 -- 172.21.15.38:0/3627734168 <== mon.2 v2:172.21.15.38:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fca9c004020 con 0x7fcaac0776d0 2024-09-10T23:20:28.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.361+0000 7fcaa9600640 1 -- 172.21.15.38:0/3627734168 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9c0055d0 con 0x7fcaac0776d0 2024-09-10T23:20:28.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.361+0000 7fcab2c00640 1 -- 172.21.15.38:0/3627734168 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaac1a5b20 con 0x7fcaac0776d0 2024-09-10T23:20:28.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.362+0000 7fcab2c00640 1 -- 172.21.15.38:0/3627734168 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaac1ac3b0 con 0x7fcaac0776d0 2024-09-10T23:20:28.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.363+0000 7fcab2c00640 1 -- 172.21.15.38:0/3627734168 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaac077ab0 con 0x7fcaac0776d0 2024-09-10T23:20:28.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.365+0000 7fcaa9600640 1 -- 172.21.15.38:0/3627734168 <== mon.2 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7fca9c009a30 con 0x7fcaac0776d0 2024-09-10T23:20:28.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.367+0000 7fcaa9600640 1 --2- 172.21.15.38:0/3627734168 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fca900b53b0 0x7fca900b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:28.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.367+0000 7fcaa9600640 1 -- 172.21.15.38:0/3627734168 <== mon.2 v2:172.21.15.38:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5180+0+0 (secure 0 0 0) 0x7fca9c0e4b40 con 0x7fcaac0776d0 2024-09-10T23:20:28.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.367+0000 7fcaa3e00640 1 --2- 172.21.15.38:0/3627734168 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fca900b53b0 0x7fca900b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:28.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.368+0000 7fcaa3e00640 1 --2- 172.21.15.38:0/3627734168 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fca900b53b0 0x7fca900b7870 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fca94005d70 tx=0x7fca94005d00 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:28.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.371+0000 7fcaa9600640 1 -- 172.21.15.38:0/3627734168 <== mon.2 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fca9c0ac5a0 con 0x7fcaac0776d0 2024-09-10T23:20:28.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:28.578+0000 7fcab2c00640 1 -- 172.21.15.38:0/3627734168 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fcaac115a80 con 0x7fca900b53b0 2024-09-10T23:20:28.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:28 smithi038 ceph-mon[34225]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:20:28.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:28 smithi038 ceph-mon[34225]: Detected new or changed devices on smithi003 2024-09-10T23:20:28.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:28 smithi038 ceph-mon[34225]: Adjusting osd_memory_target on smithi003 to 5698M 2024-09-10T23:20:28.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:28 smithi038 ceph-mon[34225]: osdmap e44: 7 total, 7 up, 7 in 2024-09-10T23:20:28.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:28 smithi194 ceph-mon[33904]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:20:28.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:28 smithi194 ceph-mon[33904]: Detected new or changed devices on smithi003 2024-09-10T23:20:28.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:28 smithi194 ceph-mon[33904]: Adjusting osd_memory_target on smithi003 to 5698M 2024-09-10T23:20:28.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:28 smithi194 ceph-mon[33904]: osdmap e44: 7 total, 7 up, 7 in 2024-09-10T23:20:28.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:28 smithi003 ceph-mon[30348]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:20:28.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:28 smithi003 ceph-mon[30348]: Detected new or changed devices on smithi003 2024-09-10T23:20:28.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:28 smithi003 ceph-mon[30348]: Adjusting osd_memory_target on smithi003 to 5698M 2024-09-10T23:20:28.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:28 smithi003 ceph-mon[30348]: osdmap e44: 7 total, 7 up, 7 in 2024-09-10T23:20:29.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:29 smithi038 ceph-mon[34225]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:20:29.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:29 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:20:29.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:29 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:20:29.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:29 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:29.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:29 smithi194 ceph-mon[33904]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:20:29.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:29 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:20:29.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:29 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:20:29.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:29 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:29.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:29 smithi003 ceph-mon[30348]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:20:29.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:29 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:20:29.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:29 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:20:29.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:29 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:30.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:30 smithi038 ceph-mon[34225]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:30.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:30 smithi194 ceph-mon[33904]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:30.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:30 smithi003 ceph-mon[30348]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:32.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:32 smithi038 ceph-mon[34225]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:32.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:32 smithi038 ceph-mon[34225]: from='client.? 172.21.15.38:0/1918243795' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "46ecaec5-29da-4e1d-ac2f-42bbbd77e949"} : dispatch 2024-09-10T23:20:32.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:32 smithi038 ceph-mon[34225]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "46ecaec5-29da-4e1d-ac2f-42bbbd77e949"} : dispatch 2024-09-10T23:20:32.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:32 smithi038 ceph-mon[34225]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46ecaec5-29da-4e1d-ac2f-42bbbd77e949"}]': finished 2024-09-10T23:20:32.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:32 smithi038 ceph-mon[34225]: osdmap e45: 8 total, 7 up, 8 in 2024-09-10T23:20:32.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:32 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:20:32.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:32 smithi038 ceph-mon[34225]: from='client.? 172.21.15.38:0/3758507170' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:20:32.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:32 smithi194 ceph-mon[33904]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:32.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:32 smithi194 ceph-mon[33904]: from='client.? 172.21.15.38:0/1918243795' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "46ecaec5-29da-4e1d-ac2f-42bbbd77e949"} : dispatch 2024-09-10T23:20:32.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:32 smithi194 ceph-mon[33904]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "46ecaec5-29da-4e1d-ac2f-42bbbd77e949"} : dispatch 2024-09-10T23:20:32.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:32 smithi194 ceph-mon[33904]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46ecaec5-29da-4e1d-ac2f-42bbbd77e949"}]': finished 2024-09-10T23:20:32.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:32 smithi194 ceph-mon[33904]: osdmap e45: 8 total, 7 up, 8 in 2024-09-10T23:20:32.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:32 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:20:32.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:32 smithi194 ceph-mon[33904]: from='client.? 172.21.15.38:0/3758507170' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:20:32.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:32 smithi003 ceph-mon[30348]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:32.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:32 smithi003 ceph-mon[30348]: from='client.? 172.21.15.38:0/1918243795' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "46ecaec5-29da-4e1d-ac2f-42bbbd77e949"} : dispatch 2024-09-10T23:20:32.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:32 smithi003 ceph-mon[30348]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "46ecaec5-29da-4e1d-ac2f-42bbbd77e949"} : dispatch 2024-09-10T23:20:32.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:32 smithi003 ceph-mon[30348]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46ecaec5-29da-4e1d-ac2f-42bbbd77e949"}]': finished 2024-09-10T23:20:32.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:32 smithi003 ceph-mon[30348]: osdmap e45: 8 total, 7 up, 8 in 2024-09-10T23:20:32.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:32 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:20:32.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:32 smithi003 ceph-mon[30348]: from='client.? 172.21.15.38:0/3758507170' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:20:34.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:34 smithi038 ceph-mon[34225]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:34.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:34 smithi194 ceph-mon[33904]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:34.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:34 smithi003 ceph-mon[30348]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:35.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:35 smithi194 ceph-mon[33904]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:35.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:35 smithi003 ceph-mon[30348]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:36.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:35 smithi038 ceph-mon[34225]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:38.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:37 smithi038 ceph-mon[34225]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:38.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:37 smithi194 ceph-mon[33904]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:38.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:37 smithi003 ceph-mon[30348]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:39.878 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:39 smithi038 ceph-mon[34225]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:40.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:39 smithi194 ceph-mon[33904]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:40.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:39 smithi003 ceph-mon[30348]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:42.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:41 smithi038 ceph-mon[34225]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:42.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:41 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T23:20:42.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:41 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:42.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:41 smithi038 ceph-mon[34225]: Deploying daemon osd.7 on smithi038 2024-09-10T23:20:42.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:41 smithi194 ceph-mon[33904]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:42.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:41 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T23:20:42.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:41 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:42.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:41 smithi194 ceph-mon[33904]: Deploying daemon osd.7 on smithi038 2024-09-10T23:20:42.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:41 smithi003 ceph-mon[30348]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:42.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:41 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T23:20:42.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:41 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:42.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:41 smithi003 ceph-mon[30348]: Deploying daemon osd.7 on smithi038 2024-09-10T23:20:44.016 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:43 smithi038 ceph-mon[34225]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:44.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:43 smithi194 ceph-mon[33904]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:44.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:43 smithi003 ceph-mon[30348]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:46.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:45 smithi038 ceph-mon[34225]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:46.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:45 smithi194 ceph-mon[33904]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:46.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:45 smithi003 ceph-mon[30348]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:47.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:47 smithi038 ceph-mon[34225]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:48.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:47 smithi194 ceph-mon[33904]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:48.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:47 smithi003 ceph-mon[30348]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:49.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:48 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:20:49.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:48 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:49.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:48 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:49.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:48 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:20:49.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:48 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:49.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:48 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:49.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:48 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:20:49.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:48 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:49.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:48 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:50.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:50 smithi038 ceph-mon[34225]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:50.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:50 smithi194 ceph-mon[33904]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:50.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:50 smithi003 ceph-mon[30348]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:52.584 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:52 smithi038 ceph-mon[34225]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:52.584 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:52 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:52.584 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:52 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:52.585 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:52 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:52.585 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:52 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:20:52.585 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:52 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:52.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:52.640+0000 7fcaa9600640 1 -- 172.21.15.38:0/3627734168 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcaac115a80 con 0x7fca900b53b0 2024-09-10T23:20:52.642 INFO:teuthology.orchestra.run.smithi038.stdout:Created osd(s) 7 on host 'smithi038' 2024-09-10T23:20:52.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:52.642+0000 7fcab2c00640 1 -- 172.21.15.38:0/3627734168 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fca900b53b0 msgr2=0x7fca900b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:52.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:52.642+0000 7fcab2c00640 1 --2- 172.21.15.38:0/3627734168 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fca900b53b0 0x7fca900b7870 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fca94005d70 tx=0x7fca94005d00 comp rx=0 tx=0).stop 2024-09-10T23:20:52.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:52.642+0000 7fcab2c00640 1 -- 172.21.15.38:0/3627734168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcaac0776d0 msgr2=0x7fcaac19f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:52.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:52.642+0000 7fcab2c00640 1 --2- 172.21.15.38:0/3627734168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcaac0776d0 0x7fcaac19f780 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00d950 tx=0x7fca9c00de10 comp rx=0 tx=0).stop 2024-09-10T23:20:52.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:52.642+0000 7fcab2c00640 1 -- 172.21.15.38:0/3627734168 shutdown_connections 2024-09-10T23:20:52.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:52.642+0000 7fcab2c00640 1 --2- 172.21.15.38:0/3627734168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcaac113990 0x7fcaac1a5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:52.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:52.642+0000 7fcab2c00640 1 --2- 172.21.15.38:0/3627734168 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fca900b53b0 0x7fca900b7870 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:52.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:52.642+0000 7fcab2c00640 1 --2- 172.21.15.38:0/3627734168 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcaac077ff0 0x7fcaac19fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:52.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:52.642+0000 7fcab2c00640 1 --2- 172.21.15.38:0/3627734168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcaac0776d0 0x7fcaac19f780 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:52.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:52.642+0000 7fcab2c00640 1 -- 172.21.15.38:0/3627734168 >> 172.21.15.38:0/3627734168 conn(0x7fcaac100a50 msgr2=0x7fcaac102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:52.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:52.643+0000 7fcab2c00640 1 -- 172.21.15.38:0/3627734168 shutdown_connections 2024-09-10T23:20:52.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:20:52.643+0000 7fcab2c00640 1 -- 172.21.15.38:0/3627734168 wait complete. 2024-09-10T23:20:52.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:52 smithi194 ceph-mon[33904]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:52.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:52 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:52.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:52 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:52.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:52 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:52.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:52 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:20:52.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:52 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:52.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:52 smithi003 ceph-mon[30348]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:52.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:52 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:52.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:52 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:52.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:52 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:52.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:52 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:20:52.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:52 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:53.417 DEBUG:teuthology.orchestra.run.smithi038:osd.7> sudo journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.7.service 2024-09-10T23:20:53.421 INFO:tasks.cephadm:Deploying osd.8 on smithi194 with /dev/vg_nvme/lv_2... 2024-09-10T23:20:53.421 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T23:20:53.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:53 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:20:53.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:53 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:53.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:53 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:53.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:53 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:20:53.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:53 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:53.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:53 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:53.780 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:20:53.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:53 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:20:53.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:53 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:53.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:53 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:54.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:54 smithi003 ceph-mon[30348]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:54.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:54 smithi003 ceph-mon[30348]: from='osd.7 [v2:172.21.15.38:6816/2054203924,v1:172.21.15.38:6817/2054203924]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T23:20:54.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:54 smithi003 ceph-mon[30348]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T23:20:54.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:54 smithi038 ceph-mon[34225]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:54.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:54 smithi038 ceph-mon[34225]: from='osd.7 [v2:172.21.15.38:6816/2054203924,v1:172.21.15.38:6817/2054203924]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T23:20:54.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:54 smithi038 ceph-mon[34225]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T23:20:54.598 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:20:54 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:20:54.303+0000 7fb3f2097640 -1 osd.7 0 log_to_monitors true 2024-09-10T23:20:54.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:54 smithi194 ceph-mon[33904]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:54.646 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:54 smithi194 ceph-mon[33904]: from='osd.7 [v2:172.21.15.38:6816/2054203924,v1:172.21.15.38:6817/2054203924]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T23:20:54.646 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:54 smithi194 ceph-mon[33904]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T23:20:55.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:55 smithi038 ceph-mon[34225]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T23:20:55.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:55 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:20:55.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:55 smithi038 ceph-mon[34225]: from='osd.7 [v2:172.21.15.38:6816/2054203924,v1:172.21.15.38:6817/2054203924]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-10T23:20:55.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:55 smithi038 ceph-mon[34225]: osdmap e46: 8 total, 7 up, 8 in 2024-09-10T23:20:55.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:55 smithi038 ceph-mon[34225]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-10T23:20:55.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:55 smithi038 ceph-mon[34225]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:55.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:55 smithi194 ceph-mon[33904]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T23:20:55.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:55 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:20:55.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:55 smithi194 ceph-mon[33904]: from='osd.7 [v2:172.21.15.38:6816/2054203924,v1:172.21.15.38:6817/2054203924]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-10T23:20:55.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:55 smithi194 ceph-mon[33904]: osdmap e46: 8 total, 7 up, 8 in 2024-09-10T23:20:55.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:55 smithi194 ceph-mon[33904]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-10T23:20:55.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:55 smithi194 ceph-mon[33904]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:55.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:55 smithi003 ceph-mon[30348]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T23:20:55.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:55 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:20:55.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:55 smithi003 ceph-mon[30348]: from='osd.7 [v2:172.21.15.38:6816/2054203924,v1:172.21.15.38:6817/2054203924]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-10T23:20:55.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:55 smithi003 ceph-mon[30348]: osdmap e46: 8 total, 7 up, 8 in 2024-09-10T23:20:55.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:55 smithi003 ceph-mon[30348]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-10T23:20:55.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:55 smithi003 ceph-mon[30348]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:20:56.476 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:20:56 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:20:56.142+0000 7fb3eda00640 -1 osd.7 0 waiting for initial osdmap 2024-09-10T23:20:56.476 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:20:56 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:20:56.166+0000 7fb3e3000640 -1 osd.7 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:20:56.800 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:56 smithi038 ceph-mon[34225]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-10T23:20:56.801 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:56 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:20:56.801 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:56 smithi038 ceph-mon[34225]: osdmap e47: 8 total, 7 up, 8 in 2024-09-10T23:20:56.801 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:56 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:20:56.801 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:56 smithi038 ceph-mon[34225]: from='osd.7 ' entity='osd.7' 2024-09-10T23:20:56.801 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:56 smithi038 ceph-mon[34225]: osd.7 [v2:172.21.15.38:6816/2054203924,v1:172.21.15.38:6817/2054203924] boot 2024-09-10T23:20:56.801 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:56 smithi038 ceph-mon[34225]: osdmap e48: 8 total, 8 up, 8 in 2024-09-10T23:20:56.801 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:56 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:20:56.808 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:56 smithi194 ceph-mon[33904]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-10T23:20:56.808 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:56 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:20:56.808 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:56 smithi194 ceph-mon[33904]: osdmap e47: 8 total, 7 up, 8 in 2024-09-10T23:20:56.808 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:56 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:20:56.808 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:56 smithi194 ceph-mon[33904]: from='osd.7 ' entity='osd.7' 2024-09-10T23:20:56.808 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:56 smithi194 ceph-mon[33904]: osd.7 [v2:172.21.15.38:6816/2054203924,v1:172.21.15.38:6817/2054203924] boot 2024-09-10T23:20:56.808 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:56 smithi194 ceph-mon[33904]: osdmap e48: 8 total, 8 up, 8 in 2024-09-10T23:20:56.808 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:56 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:20:56.817 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-10T23:20:56.852 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi194:vg_nvme/lv_2 2024-09-10T23:20:56.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:56 smithi003 ceph-mon[30348]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-10T23:20:56.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:56 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:20:56.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:56 smithi003 ceph-mon[30348]: osdmap e47: 8 total, 7 up, 8 in 2024-09-10T23:20:56.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:56 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:20:56.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:56 smithi003 ceph-mon[30348]: from='osd.7 ' entity='osd.7' 2024-09-10T23:20:56.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:56 smithi003 ceph-mon[30348]: osd.7 [v2:172.21.15.38:6816/2054203924,v1:172.21.15.38:6817/2054203924] boot 2024-09-10T23:20:56.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:56 smithi003 ceph-mon[30348]: osdmap e48: 8 total, 8 up, 8 in 2024-09-10T23:20:56.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:56 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:20:57.235 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:20:57.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.779+0000 7ff882000640 1 -- 172.21.15.194:0/3139475990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff87c10a820 msgr2=0x7ff87c10ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:57.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.779+0000 7ff882000640 1 --2- 172.21.15.194:0/3139475990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff87c10a820 0x7ff87c10ac60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff868009900 tx=0x7ff86802a410 comp rx=0 tx=0).stop 2024-09-10T23:20:57.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.779+0000 7ff882000640 1 -- 172.21.15.194:0/3139475990 shutdown_connections 2024-09-10T23:20:57.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.779+0000 7ff882000640 1 --2- 172.21.15.194:0/3139475990 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff87c10b1a0 0x7ff87c1119a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:57.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.779+0000 7ff882000640 1 --2- 172.21.15.194:0/3139475990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff87c10a820 0x7ff87c10ac60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:57.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.779+0000 7ff882000640 1 --2- 172.21.15.194:0/3139475990 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff87c104e10 0x7ff87c1051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:57.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.779+0000 7ff882000640 1 -- 172.21.15.194:0/3139475990 >> 172.21.15.194:0/3139475990 conn(0x7ff87c100840 msgr2=0x7ff87c102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:57.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.779+0000 7ff882000640 1 -- 172.21.15.194:0/3139475990 shutdown_connections 2024-09-10T23:20:57.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.779+0000 7ff882000640 1 -- 172.21.15.194:0/3139475990 wait complete. 2024-09-10T23:20:57.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.780+0000 7ff882000640 1 Processor -- start 2024-09-10T23:20:57.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.780+0000 7ff882000640 1 -- start start 2024-09-10T23:20:57.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.780+0000 7ff882000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff87c104e10 0x7ff87c19b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:57.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.780+0000 7ff882000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff87c10a820 0x7ff87c19b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:57.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.780+0000 7ff882000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff87c10b1a0 0x7ff87c1a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:57.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.780+0000 7ff882000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff87c114d20 con 0x7ff87c10b1a0 2024-09-10T23:20:57.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.780+0000 7ff882000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff87c114ba0 con 0x7ff87c10a820 2024-09-10T23:20:57.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.780+0000 7ff882000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff87c114ea0 con 0x7ff87c104e10 2024-09-10T23:20:57.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.781+0000 7ff880c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff87c104e10 0x7ff87c19b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:57.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.781+0000 7ff880c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff87c104e10 0x7ff87c19b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:52890/0 (socket says 172.21.15.194:52890) 2024-09-10T23:20:57.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.781+0000 7ff880c00640 1 -- 172.21.15.194:0/3512987691 learned_addr learned my addr 172.21.15.194:0/3512987691 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-10T23:20:57.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.781+0000 7ff87be00640 1 --2- 172.21.15.194:0/3512987691 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff87c10a820 0x7ff87c19b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:57.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.781+0000 7ff881600640 1 --2- 172.21.15.194:0/3512987691 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff87c10b1a0 0x7ff87c1a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:57.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.781+0000 7ff880c00640 1 -- 172.21.15.194:0/3512987691 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff87c10a820 msgr2=0x7ff87c19b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:57.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.781+0000 7ff880c00640 1 --2- 172.21.15.194:0/3512987691 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff87c10a820 0x7ff87c19b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:57.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.781+0000 7ff880c00640 1 -- 172.21.15.194:0/3512987691 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff87c10b1a0 msgr2=0x7ff87c1a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:57.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.781+0000 7ff880c00640 1 --2- 172.21.15.194:0/3512987691 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff87c10b1a0 0x7ff87c1a0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:57.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.781+0000 7ff880c00640 1 -- 172.21.15.194:0/3512987691 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff87c1a1240 con 0x7ff87c104e10 2024-09-10T23:20:57.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.781+0000 7ff881600640 1 --2- 172.21.15.194:0/3512987691 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff87c10b1a0 0x7ff87c1a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:20:57.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.782+0000 7ff880c00640 1 --2- 172.21.15.194:0/3512987691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff87c104e10 0x7ff87c19b190 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff87000e9f0 tx=0x7ff87000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:57.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.782+0000 7ff879600640 1 -- 172.21.15.194:0/3512987691 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87000cd80 con 0x7ff87c104e10 2024-09-10T23:20:57.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.782+0000 7ff882000640 1 -- 172.21.15.194:0/3512987691 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff87c1a1530 con 0x7ff87c104e10 2024-09-10T23:20:57.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.782+0000 7ff879600640 1 -- 172.21.15.194:0/3512987691 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff8700054b0 con 0x7ff87c104e10 2024-09-10T23:20:57.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.782+0000 7ff879600640 1 -- 172.21.15.194:0/3512987691 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff870010430 con 0x7ff87c104e10 2024-09-10T23:20:57.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.782+0000 7ff882000640 1 -- 172.21.15.194:0/3512987691 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff87c1a7bf0 con 0x7ff87c104e10 2024-09-10T23:20:57.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.783+0000 7ff882000640 1 -- 172.21.15.194:0/3512987691 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff87c1051f0 con 0x7ff87c104e10 2024-09-10T23:20:57.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.785+0000 7ff879600640 1 -- 172.21.15.194:0/3512987691 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7ff870005020 con 0x7ff87c104e10 2024-09-10T23:20:57.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.786+0000 7ff879600640 1 --2- 172.21.15.194:0/3512987691 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff8640b53e0 0x7ff8640b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:57.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.787+0000 7ff879600640 1 -- 172.21.15.194:0/3512987691 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5612+0+0 (secure 0 0 0) 0x7ff8700e56b0 con 0x7ff87c104e10 2024-09-10T23:20:57.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.787+0000 7ff87be00640 1 --2- 172.21.15.194:0/3512987691 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff8640b53e0 0x7ff8640b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:57.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.787+0000 7ff87be00640 1 --2- 172.21.15.194:0/3512987691 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff8640b53e0 0x7ff8640b78a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff868006010 tx=0x7ff868005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:57.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.790+0000 7ff879600640 1 -- 172.21.15.194:0/3512987691 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff8700acf60 con 0x7ff87c104e10 2024-09-10T23:20:57.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:57 smithi194 ceph-mon[33904]: purged_snaps scrub starts 2024-09-10T23:20:57.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:57 smithi194 ceph-mon[33904]: purged_snaps scrub ok 2024-09-10T23:20:57.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:57 smithi194 ceph-mon[33904]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:20:57.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:57 smithi194 ceph-mon[33904]: Detected new or changed devices on smithi038 2024-09-10T23:20:57.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:57 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:57.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:57 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:57.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:57 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:57.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:57 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:57.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:57 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:57.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:57 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:57.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:57 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:57.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:57 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:57.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:57 smithi194 ceph-mon[33904]: Adjusting osd_memory_target on smithi038 to 5698M 2024-09-10T23:20:57.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:57 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:57.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:57 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:57.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:57 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:20:57.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:57 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:57.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:57 smithi194 ceph-mon[33904]: osdmap e49: 8 total, 8 up, 8 in 2024-09-10T23:20:57.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:57 smithi003 ceph-mon[30348]: purged_snaps scrub starts 2024-09-10T23:20:57.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:57 smithi003 ceph-mon[30348]: purged_snaps scrub ok 2024-09-10T23:20:57.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:57 smithi003 ceph-mon[30348]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:20:57.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:57 smithi003 ceph-mon[30348]: Detected new or changed devices on smithi038 2024-09-10T23:20:57.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:57 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:57.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:57 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:57.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:57 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:57.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:57 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:57.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:57 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:57.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:57 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:57.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:57 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:57.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:57 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:57.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:57 smithi003 ceph-mon[30348]: Adjusting osd_memory_target on smithi038 to 5698M 2024-09-10T23:20:57.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:57 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:57.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:57 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:57.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:57 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:20:57.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:57 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:57.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:57 smithi003 ceph-mon[30348]: osdmap e49: 8 total, 8 up, 8 in 2024-09-10T23:20:57.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:20:57.987+0000 7ff882000640 1 -- 172.21.15.194:0/3512987691 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7ff87c063590 con 0x7ff8640b53e0 2024-09-10T23:20:57.996 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:57 smithi038 ceph-mon[34225]: purged_snaps scrub starts 2024-09-10T23:20:57.996 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:57 smithi038 ceph-mon[34225]: purged_snaps scrub ok 2024-09-10T23:20:57.996 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:57 smithi038 ceph-mon[34225]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:20:57.996 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:57 smithi038 ceph-mon[34225]: Detected new or changed devices on smithi038 2024-09-10T23:20:57.996 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:57 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:57.997 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:57 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:57.997 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:57 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:57.997 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:57 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:57.997 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:57 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:57.997 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:57 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:57.997 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:57 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:57.997 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:57 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:20:57.997 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:57 smithi038 ceph-mon[34225]: Adjusting osd_memory_target on smithi038 to 5698M 2024-09-10T23:20:57.997 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:57 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:57.997 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:57 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:57.997 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:57 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:20:57.997 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:57 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:20:57.997 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:57 smithi038 ceph-mon[34225]: osdmap e49: 8 total, 8 up, 8 in 2024-09-10T23:20:58.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:58 smithi194 ceph-mon[33904]: from='client.24460 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:20:58.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:58 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:20:58.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:58 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:20:58.893 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:58 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:58.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:58 smithi003 ceph-mon[30348]: from='client.24460 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:20:58.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:58 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:20:58.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:58 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:20:58.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:58 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:59.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:58 smithi038 ceph-mon[34225]: from='client.24460 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:20:59.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:58 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:20:59.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:58 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:20:59.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:58 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:20:59.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:59 smithi194 ceph-mon[33904]: osdmap e50: 8 total, 8 up, 8 in 2024-09-10T23:20:59.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:20:59 smithi194 ceph-mon[33904]: pgmap v177: 1 pgs: 1 remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:20:59.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:59 smithi003 ceph-mon[30348]: osdmap e50: 8 total, 8 up, 8 in 2024-09-10T23:20:59.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:20:59 smithi003 ceph-mon[30348]: pgmap v177: 1 pgs: 1 remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:21:00.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:59 smithi038 ceph-mon[34225]: osdmap e50: 8 total, 8 up, 8 in 2024-09-10T23:21:00.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:20:59 smithi038 ceph-mon[34225]: pgmap v177: 1 pgs: 1 remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:21:00.880 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:00 smithi194 ceph-mon[33904]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-09-10T23:21:00.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:00 smithi003 ceph-mon[30348]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-09-10T23:21:01.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:00 smithi038 ceph-mon[34225]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-09-10T23:21:01.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:01 smithi194 ceph-mon[33904]: pgmap v178: 1 pgs: 1 remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:21:01.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:01 smithi194 ceph-mon[33904]: from='client.? 172.21.15.194:0/1688116748' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "57fd8e43-9612-4f74-8eb2-8bdbbf7c0417"} : dispatch 2024-09-10T23:21:01.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:01 smithi194 ceph-mon[33904]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "57fd8e43-9612-4f74-8eb2-8bdbbf7c0417"} : dispatch 2024-09-10T23:21:01.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:01 smithi194 ceph-mon[33904]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "57fd8e43-9612-4f74-8eb2-8bdbbf7c0417"}]': finished 2024-09-10T23:21:01.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:01 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:21:01.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:01 smithi194 ceph-mon[33904]: osdmap e51: 9 total, 8 up, 9 in 2024-09-10T23:21:01.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:01 smithi003 ceph-mon[30348]: pgmap v178: 1 pgs: 1 remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:21:01.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:01 smithi003 ceph-mon[30348]: from='client.? 172.21.15.194:0/1688116748' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "57fd8e43-9612-4f74-8eb2-8bdbbf7c0417"} : dispatch 2024-09-10T23:21:01.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:01 smithi003 ceph-mon[30348]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "57fd8e43-9612-4f74-8eb2-8bdbbf7c0417"} : dispatch 2024-09-10T23:21:01.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:01 smithi003 ceph-mon[30348]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "57fd8e43-9612-4f74-8eb2-8bdbbf7c0417"}]': finished 2024-09-10T23:21:01.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:01 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:21:01.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:01 smithi003 ceph-mon[30348]: osdmap e51: 9 total, 8 up, 9 in 2024-09-10T23:21:02.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:01 smithi038 ceph-mon[34225]: pgmap v178: 1 pgs: 1 remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:21:02.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:01 smithi038 ceph-mon[34225]: from='client.? 172.21.15.194:0/1688116748' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "57fd8e43-9612-4f74-8eb2-8bdbbf7c0417"} : dispatch 2024-09-10T23:21:02.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:01 smithi038 ceph-mon[34225]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "57fd8e43-9612-4f74-8eb2-8bdbbf7c0417"} : dispatch 2024-09-10T23:21:02.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:01 smithi038 ceph-mon[34225]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "57fd8e43-9612-4f74-8eb2-8bdbbf7c0417"}]': finished 2024-09-10T23:21:02.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:01 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:21:02.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:01 smithi038 ceph-mon[34225]: osdmap e51: 9 total, 8 up, 9 in 2024-09-10T23:21:02.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:02 smithi194 ceph-mon[33904]: from='client.? 172.21.15.194:0/174635570' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:21:02.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:02 smithi003 ceph-mon[30348]: from='client.? 172.21.15.194:0/174635570' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:21:03.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:02 smithi038 ceph-mon[34225]: from='client.? 172.21.15.194:0/174635570' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:21:03.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:03 smithi003 ceph-mon[30348]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:21:04.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:03 smithi038 ceph-mon[34225]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:21:04.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:03 smithi194 ceph-mon[33904]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:21:04.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:04 smithi003 ceph-mon[30348]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-09-10T23:21:04.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:04 smithi003 ceph-mon[30348]: Cluster is now healthy 2024-09-10T23:21:05.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:04 smithi038 ceph-mon[34225]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-09-10T23:21:05.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:04 smithi038 ceph-mon[34225]: Cluster is now healthy 2024-09-10T23:21:05.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:04 smithi194 ceph-mon[33904]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-09-10T23:21:05.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:04 smithi194 ceph-mon[33904]: Cluster is now healthy 2024-09-10T23:21:06.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:05 smithi038 ceph-mon[34225]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 163 KiB/s, 0 objects/s recovering 2024-09-10T23:21:06.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:05 smithi194 ceph-mon[33904]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 163 KiB/s, 0 objects/s recovering 2024-09-10T23:21:06.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:05 smithi003 ceph-mon[30348]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 163 KiB/s, 0 objects/s recovering 2024-09-10T23:21:07.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:07 smithi194 ceph-mon[33904]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 143 KiB/s, 0 objects/s recovering 2024-09-10T23:21:08.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:07 smithi038 ceph-mon[34225]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 143 KiB/s, 0 objects/s recovering 2024-09-10T23:21:08.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:07 smithi003 ceph-mon[30348]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 143 KiB/s, 0 objects/s recovering 2024-09-10T23:21:09.925 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:09 smithi194 ceph-mon[33904]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-10T23:21:10.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:09 smithi038 ceph-mon[34225]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-10T23:21:10.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:09 smithi003 ceph-mon[30348]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-10T23:21:11.051 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:10 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-10T23:21:11.052 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:10 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:11.052 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:10 smithi194 ceph-mon[33904]: Deploying daemon osd.8 on smithi194 2024-09-10T23:21:11.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:10 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-10T23:21:11.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:10 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:11.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:10 smithi038 ceph-mon[34225]: Deploying daemon osd.8 on smithi194 2024-09-10T23:21:11.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:10 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-10T23:21:11.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:10 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:11.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:10 smithi003 ceph-mon[30348]: Deploying daemon osd.8 on smithi194 2024-09-10T23:21:12.076 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:11 smithi194 ceph-mon[33904]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-10T23:21:12.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:11 smithi038 ceph-mon[34225]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-10T23:21:12.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:11 smithi003 ceph-mon[30348]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-10T23:21:13.820 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:13 smithi194 ceph-mon[33904]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-09-10T23:21:14.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:13 smithi038 ceph-mon[34225]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-09-10T23:21:14.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:13 smithi003 ceph-mon[30348]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-09-10T23:21:16.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:15 smithi038 ceph-mon[34225]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:21:16.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:15 smithi194 ceph-mon[33904]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:21:16.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:15 smithi003 ceph-mon[30348]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:21:18.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:17 smithi038 ceph-mon[34225]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:21:18.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:17 smithi194 ceph-mon[33904]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:21:18.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:17 smithi003 ceph-mon[30348]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:21:19.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:18 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:21:19.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:18 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:19.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:18 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:19.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:18 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:21:19.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:18 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:19.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:18 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:19.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:18 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:21:19.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:18 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:19.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:18 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:20.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:19 smithi194 ceph-mon[33904]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:21:20.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:19 smithi003 ceph-mon[30348]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:21:20.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:19 smithi038 ceph-mon[34225]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:21:21.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:21 smithi194 ceph-mon[33904]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:21:21.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:21 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:21.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:21 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:21.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:21 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:21.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:21 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:21:21.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:21 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:21.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:21 smithi003 ceph-mon[30348]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:21:21.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:21 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:21.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:21 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:21.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:21 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:21.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:21 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:21:21.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:21 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:22.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:21 smithi038 ceph-mon[34225]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:21:22.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:21 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:22.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:21 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:22.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:21 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:22.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:21 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:21:22.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:21 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:22.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:21:22.343+0000 7ff879600640 1 -- 172.21.15.194:0/3512987691 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff87c063590 con 0x7ff8640b53e0 2024-09-10T23:21:22.345 INFO:teuthology.orchestra.run.smithi194.stdout:Created osd(s) 8 on host 'smithi194' 2024-09-10T23:21:22.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:21:22.346+0000 7ff882000640 1 -- 172.21.15.194:0/3512987691 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff8640b53e0 msgr2=0x7ff8640b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:22.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:21:22.346+0000 7ff882000640 1 --2- 172.21.15.194:0/3512987691 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff8640b53e0 0x7ff8640b78a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff868006010 tx=0x7ff868005e80 comp rx=0 tx=0).stop 2024-09-10T23:21:22.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:21:22.346+0000 7ff882000640 1 -- 172.21.15.194:0/3512987691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff87c104e10 msgr2=0x7ff87c19b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:22.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:21:22.346+0000 7ff882000640 1 --2- 172.21.15.194:0/3512987691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff87c104e10 0x7ff87c19b190 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff87000e9f0 tx=0x7ff87000edf0 comp rx=0 tx=0).stop 2024-09-10T23:21:22.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:21:22.346+0000 7ff882000640 1 -- 172.21.15.194:0/3512987691 shutdown_connections 2024-09-10T23:21:22.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:21:22.346+0000 7ff882000640 1 --2- 172.21.15.194:0/3512987691 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff8640b53e0 0x7ff8640b78a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:22.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:21:22.346+0000 7ff882000640 1 --2- 172.21.15.194:0/3512987691 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff87c10b1a0 0x7ff87c1a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:22.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:21:22.346+0000 7ff882000640 1 --2- 172.21.15.194:0/3512987691 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff87c10a820 0x7ff87c19b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:22.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:21:22.346+0000 7ff882000640 1 --2- 172.21.15.194:0/3512987691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff87c104e10 0x7ff87c19b190 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:22.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:21:22.346+0000 7ff882000640 1 -- 172.21.15.194:0/3512987691 >> 172.21.15.194:0/3512987691 conn(0x7ff87c100840 msgr2=0x7ff87c102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:22.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:21:22.346+0000 7ff882000640 1 -- 172.21.15.194:0/3512987691 shutdown_connections 2024-09-10T23:21:22.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:21:22.346+0000 7ff882000640 1 -- 172.21.15.194:0/3512987691 wait complete. 2024-09-10T23:21:22.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:22 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:21:22.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:22 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:22.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:22 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:23.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:22 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:21:23.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:22 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:23.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:22 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:23.117 DEBUG:teuthology.orchestra.run.smithi194:osd.8> sudo journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.8.service 2024-09-10T23:21:23.121 INFO:tasks.cephadm:Deploying osd.9 on smithi003 with /dev/vg_nvme/lv_1... 2024-09-10T23:21:23.122 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T23:21:23.146 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:22 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:21:23.146 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:22 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:23.146 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:22 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:23.515 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:21:24.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:24 smithi194 ceph-mon[33904]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:21:24.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:24 smithi194 ceph-mon[33904]: from='osd.8 [v2:172.21.15.194:6816/170051722,v1:172.21.15.194:6817/170051722]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T23:21:24.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:24 smithi194 ceph-mon[33904]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T23:21:24.407 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:21:24 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:21:24.105+0000 7f04fe724640 -1 osd.8 0 log_to_monitors true 2024-09-10T23:21:24.693 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:24 smithi003 ceph-mon[30348]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:21:24.693 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:24 smithi003 ceph-mon[30348]: from='osd.8 [v2:172.21.15.194:6816/170051722,v1:172.21.15.194:6817/170051722]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T23:21:24.693 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:24 smithi003 ceph-mon[30348]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T23:21:24.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:24 smithi038 ceph-mon[34225]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:21:24.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:24 smithi038 ceph-mon[34225]: from='osd.8 [v2:172.21.15.194:6816/170051722,v1:172.21.15.194:6817/170051722]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T23:21:24.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:24 smithi038 ceph-mon[34225]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T23:21:25.428 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:25 smithi003 ceph-mon[30348]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T23:21:25.428 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:25 smithi003 ceph-mon[30348]: osdmap e52: 9 total, 8 up, 9 in 2024-09-10T23:21:25.428 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:25 smithi003 ceph-mon[30348]: from='osd.8 [v2:172.21.15.194:6816/170051722,v1:172.21.15.194:6817/170051722]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]} : dispatch 2024-09-10T23:21:25.429 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:25 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:21:25.429 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:25 smithi003 ceph-mon[30348]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]} : dispatch 2024-09-10T23:21:25.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:25 smithi194 ceph-mon[33904]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T23:21:25.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:25 smithi194 ceph-mon[33904]: osdmap e52: 9 total, 8 up, 9 in 2024-09-10T23:21:25.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:25 smithi194 ceph-mon[33904]: from='osd.8 [v2:172.21.15.194:6816/170051722,v1:172.21.15.194:6817/170051722]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]} : dispatch 2024-09-10T23:21:25.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:25 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:21:25.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:25 smithi194 ceph-mon[33904]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]} : dispatch 2024-09-10T23:21:25.698 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:21:25 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:21:25.394+0000 7f04f8800640 -1 osd.8 0 waiting for initial osdmap 2024-09-10T23:21:25.698 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:21:25 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:21:25.407+0000 7f04f3800640 -1 osd.8 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:21:25.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:25 smithi038 ceph-mon[34225]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T23:21:25.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:25 smithi038 ceph-mon[34225]: osdmap e52: 9 total, 8 up, 9 in 2024-09-10T23:21:25.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:25 smithi038 ceph-mon[34225]: from='osd.8 [v2:172.21.15.194:6816/170051722,v1:172.21.15.194:6817/170051722]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]} : dispatch 2024-09-10T23:21:25.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:25 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:21:25.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:25 smithi038 ceph-mon[34225]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]} : dispatch 2024-09-10T23:21:26.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:26 smithi194 ceph-mon[33904]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:21:26.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:26 smithi194 ceph-mon[33904]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-10T23:21:26.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:26 smithi194 ceph-mon[33904]: osdmap e53: 9 total, 8 up, 9 in 2024-09-10T23:21:26.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:26 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:21:26.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:26 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:21:26.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:26 smithi003 ceph-mon[30348]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:21:26.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:26 smithi003 ceph-mon[30348]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-10T23:21:26.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:26 smithi003 ceph-mon[30348]: osdmap e53: 9 total, 8 up, 9 in 2024-09-10T23:21:26.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:26 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:21:26.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:26 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:21:26.806 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:21:26.845 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi003:vg_nvme/lv_1 2024-09-10T23:21:26.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:26 smithi038 ceph-mon[34225]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:21:26.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:26 smithi038 ceph-mon[34225]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-10T23:21:26.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:26 smithi038 ceph-mon[34225]: osdmap e53: 9 total, 8 up, 9 in 2024-09-10T23:21:26.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:26 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:21:26.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:26 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:21:27.261 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:21:27.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:27 smithi194 ceph-mon[33904]: purged_snaps scrub starts 2024-09-10T23:21:27.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:27 smithi194 ceph-mon[33904]: purged_snaps scrub ok 2024-09-10T23:21:27.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:27 smithi194 ceph-mon[33904]: osd.8 [v2:172.21.15.194:6816/170051722,v1:172.21.15.194:6817/170051722] boot 2024-09-10T23:21:27.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:27 smithi194 ceph-mon[33904]: osdmap e54: 9 total, 9 up, 9 in 2024-09-10T23:21:27.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:27 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:21:27.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:27 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:27.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:27 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:27.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:27 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:27.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:27 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:27.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:27 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:27.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:27 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:27.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:27 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:27.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:27 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:27.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:27 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:27.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:27 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:27.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:27 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:21:27.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:27 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:27.703 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:27 smithi003 ceph-mon[30348]: purged_snaps scrub starts 2024-09-10T23:21:27.703 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:27 smithi003 ceph-mon[30348]: purged_snaps scrub ok 2024-09-10T23:21:27.703 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:27 smithi003 ceph-mon[30348]: osd.8 [v2:172.21.15.194:6816/170051722,v1:172.21.15.194:6817/170051722] boot 2024-09-10T23:21:27.703 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:27 smithi003 ceph-mon[30348]: osdmap e54: 9 total, 9 up, 9 in 2024-09-10T23:21:27.703 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:27 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:21:27.703 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:27 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:27.703 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:27 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:27.704 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:27 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:27.704 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:27 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:27.704 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:27 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:27.704 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:27 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:27.704 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:27 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:27.704 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:27 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:27.704 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:27 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:27.704 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:27 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:27.704 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:27 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:21:27.704 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:27 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:27.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.819+0000 7f82d6000640 1 -- 172.21.15.3:0/2186512897 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82d0075de0 msgr2=0x7f82d010ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:27.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.819+0000 7f82d6000640 1 --2- 172.21.15.3:0/2186512897 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82d0075de0 0x7f82d010ee70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f82b8009900 tx=0x7f82b802a410 comp rx=0 tx=0).stop 2024-09-10T23:21:27.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.819+0000 7f82d6000640 1 -- 172.21.15.3:0/2186512897 shutdown_connections 2024-09-10T23:21:27.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.819+0000 7f82d6000640 1 --2- 172.21.15.3:0/2186512897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82d010f3b0 0x7f82d01117a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:27.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.819+0000 7f82d6000640 1 --2- 172.21.15.3:0/2186512897 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82d0075de0 0x7f82d010ee70 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:27.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.819+0000 7f82d6000640 1 --2- 172.21.15.3:0/2186512897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82d00754c0 0x7f82d00758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:27.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.819+0000 7f82d6000640 1 -- 172.21.15.3:0/2186512897 >> 172.21.15.3:0/2186512897 conn(0x7f82d00fe810 msgr2=0x7f82d0100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:27.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.819+0000 7f82d6000640 1 -- 172.21.15.3:0/2186512897 shutdown_connections 2024-09-10T23:21:27.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.819+0000 7f82d6000640 1 -- 172.21.15.3:0/2186512897 wait complete. 2024-09-10T23:21:27.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.820+0000 7f82d6000640 1 Processor -- start 2024-09-10T23:21:27.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.820+0000 7f82d6000640 1 -- start start 2024-09-10T23:21:27.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.821+0000 7f82d6000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82d00754c0 0x7f82d019b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:27.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.821+0000 7f82d6000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82d0075de0 0x7f82d019b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:27.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.821+0000 7f82d6000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82d010f3b0 0x7f82d01a0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:27.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.821+0000 7f82d6000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f82d0114e90 con 0x7f82d0075de0 2024-09-10T23:21:27.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.821+0000 7f82d6000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f82d0114d10 con 0x7f82d00754c0 2024-09-10T23:21:27.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.821+0000 7f82d6000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f82d0115010 con 0x7f82d010f3b0 2024-09-10T23:21:27.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.821+0000 7f82c6a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82d0075de0 0x7f82d019b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:27.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.821+0000 7f82c6a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82d0075de0 0x7f82d019b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42604/0 (socket says 172.21.15.3:42604) 2024-09-10T23:21:27.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.821+0000 7f82c6a00640 1 -- 172.21.15.3:0/3671385205 learned_addr learned my addr 172.21.15.3:0/3671385205 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:21:27.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.821+0000 7f82cf400640 1 --2- 172.21.15.3:0/3671385205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82d00754c0 0x7f82d019b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:27.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.821+0000 7f82cfe00640 1 --2- 172.21.15.3:0/3671385205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82d010f3b0 0x7f82d01a0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:27.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.821+0000 7f82c6a00640 1 -- 172.21.15.3:0/3671385205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82d010f3b0 msgr2=0x7f82d01a0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:27.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.822+0000 7f82c6a00640 1 --2- 172.21.15.3:0/3671385205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82d010f3b0 0x7f82d01a0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:27.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.822+0000 7f82c6a00640 1 -- 172.21.15.3:0/3671385205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82d00754c0 msgr2=0x7f82d019b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:27.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.822+0000 7f82c6a00640 1 --2- 172.21.15.3:0/3671385205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82d00754c0 0x7f82d019b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:27.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.822+0000 7f82c6a00640 1 -- 172.21.15.3:0/3671385205 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d01a1490 con 0x7f82d0075de0 2024-09-10T23:21:27.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.822+0000 7f82cf400640 1 --2- 172.21.15.3:0/3671385205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82d00754c0 0x7f82d019b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:21:27.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.822+0000 7f82c6a00640 1 --2- 172.21.15.3:0/3671385205 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82d0075de0 0x7f82d019b920 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f82b802a930 tx=0x7f82b8003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:27.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.822+0000 7f82ccc00640 1 -- 172.21.15.3:0/3671385205 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b803f070 con 0x7f82d0075de0 2024-09-10T23:21:27.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.822+0000 7f82d6000640 1 -- 172.21.15.3:0/3671385205 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82d01a1720 con 0x7f82d0075de0 2024-09-10T23:21:27.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.822+0000 7f82ccc00640 1 -- 172.21.15.3:0/3671385205 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f82b8003e40 con 0x7f82d0075de0 2024-09-10T23:21:27.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.822+0000 7f82ccc00640 1 -- 172.21.15.3:0/3671385205 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b8035030 con 0x7f82d0075de0 2024-09-10T23:21:27.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.823+0000 7f82d6000640 1 -- 172.21.15.3:0/3671385205 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82d01a7e40 con 0x7f82d0075de0 2024-09-10T23:21:27.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.824+0000 7f82d6000640 1 -- 172.21.15.3:0/3671385205 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82d00758a0 con 0x7f82d0075de0 2024-09-10T23:21:27.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.826+0000 7f82ccc00640 1 -- 172.21.15.3:0/3671385205 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7f82b8031400 con 0x7f82d0075de0 2024-09-10T23:21:27.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.828+0000 7f82ccc00640 1 --2- 172.21.15.3:0/3671385205 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f82b40b5330 0x7f82b40b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:27.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.829+0000 7f82ccc00640 1 -- 172.21.15.3:0/3671385205 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6044+0+0 (secure 0 0 0) 0x7f82b8106360 con 0x7f82d0075de0 2024-09-10T23:21:27.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.829+0000 7f82cf400640 1 --2- 172.21.15.3:0/3671385205 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f82b40b5330 0x7f82b40b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:27.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.829+0000 7f82cf400640 1 --2- 172.21.15.3:0/3671385205 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f82b40b5330 0x7f82b40b77f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f82c0005fd0 tx=0x7f82c0009520 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:27.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:27.830+0000 7f82ccc00640 1 -- 172.21.15.3:0/3671385205 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f82b80cda60 con 0x7f82d0075de0 2024-09-10T23:21:27.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:27 smithi038 ceph-mon[34225]: purged_snaps scrub starts 2024-09-10T23:21:27.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:27 smithi038 ceph-mon[34225]: purged_snaps scrub ok 2024-09-10T23:21:27.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:27 smithi038 ceph-mon[34225]: osd.8 [v2:172.21.15.194:6816/170051722,v1:172.21.15.194:6817/170051722] boot 2024-09-10T23:21:27.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:27 smithi038 ceph-mon[34225]: osdmap e54: 9 total, 9 up, 9 in 2024-09-10T23:21:27.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:27 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:21:27.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:27 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:27.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:27 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:27.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:27 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:27.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:27 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:27.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:27 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:27.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:27 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:27.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:27 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:27.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:27 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:27.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:27 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:27.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:27 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:27.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:27 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:21:27.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:27 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:28.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:28.038+0000 7f82d6000640 1 -- 172.21.15.3:0/3671385205 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f82d0100b30 con 0x7f82b40b5330 2024-09-10T23:21:28.687 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:28 smithi003 ceph-mon[30348]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:21:28.688 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:28 smithi003 ceph-mon[30348]: Detected new or changed devices on smithi194 2024-09-10T23:21:28.688 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:28 smithi003 ceph-mon[30348]: Adjusting osd_memory_target on smithi194 to 5696M 2024-09-10T23:21:28.688 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:28 smithi003 ceph-mon[30348]: osdmap e55: 9 total, 9 up, 9 in 2024-09-10T23:21:28.688 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:28 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:21:28.688 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:28 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:21:28.688 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:28 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:28.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:28 smithi194 ceph-mon[33904]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:21:28.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:28 smithi194 ceph-mon[33904]: Detected new or changed devices on smithi194 2024-09-10T23:21:28.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:28 smithi194 ceph-mon[33904]: Adjusting osd_memory_target on smithi194 to 5696M 2024-09-10T23:21:28.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:28 smithi194 ceph-mon[33904]: osdmap e55: 9 total, 9 up, 9 in 2024-09-10T23:21:28.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:28 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:21:28.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:28 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:21:28.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:28 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:28.749 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:28 smithi038 ceph-mon[34225]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:21:28.749 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:28 smithi038 ceph-mon[34225]: Detected new or changed devices on smithi194 2024-09-10T23:21:28.749 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:28 smithi038 ceph-mon[34225]: Adjusting osd_memory_target on smithi194 to 5696M 2024-09-10T23:21:28.749 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:28 smithi038 ceph-mon[34225]: osdmap e55: 9 total, 9 up, 9 in 2024-09-10T23:21:28.749 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:28 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:21:28.749 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:28 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:21:28.749 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:28 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:29.692 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:29 smithi003 ceph-mon[30348]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:21:29.692 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:29 smithi003 ceph-mon[30348]: osdmap e56: 9 total, 9 up, 9 in 2024-09-10T23:21:29.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:29 smithi194 ceph-mon[33904]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:21:29.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:29 smithi194 ceph-mon[33904]: osdmap e56: 9 total, 9 up, 9 in 2024-09-10T23:21:29.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:29 smithi038 ceph-mon[34225]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:21:29.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:29 smithi038 ceph-mon[34225]: osdmap e56: 9 total, 9 up, 9 in 2024-09-10T23:21:30.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:30 smithi194 ceph-mon[33904]: pgmap v198: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:21:30.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:30 smithi003 ceph-mon[30348]: pgmap v198: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:21:30.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:30 smithi038 ceph-mon[34225]: pgmap v198: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:21:31.687 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:31 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3371628028' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "aeaaf23b-d2e2-4e30-9a49-de4aaba53900"} : dispatch 2024-09-10T23:21:31.687 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:31 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3371628028' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aeaaf23b-d2e2-4e30-9a49-de4aaba53900"}]': finished 2024-09-10T23:21:31.687 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:31 smithi003 ceph-mon[30348]: osdmap e57: 10 total, 9 up, 10 in 2024-09-10T23:21:31.687 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:31 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:21:31.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:31 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3371628028' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "aeaaf23b-d2e2-4e30-9a49-de4aaba53900"} : dispatch 2024-09-10T23:21:31.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:31 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3371628028' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aeaaf23b-d2e2-4e30-9a49-de4aaba53900"}]': finished 2024-09-10T23:21:31.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:31 smithi194 ceph-mon[33904]: osdmap e57: 10 total, 9 up, 10 in 2024-09-10T23:21:31.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:31 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:21:31.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:31 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3371628028' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "aeaaf23b-d2e2-4e30-9a49-de4aaba53900"} : dispatch 2024-09-10T23:21:31.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:31 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3371628028' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aeaaf23b-d2e2-4e30-9a49-de4aaba53900"}]': finished 2024-09-10T23:21:31.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:31 smithi038 ceph-mon[34225]: osdmap e57: 10 total, 9 up, 10 in 2024-09-10T23:21:31.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:31 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:21:32.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:32 smithi194 ceph-mon[33904]: pgmap v199: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:21:32.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:32 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2270305047' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:21:32.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:32 smithi003 ceph-mon[30348]: pgmap v199: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:21:32.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:32 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2270305047' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:21:32.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:32 smithi038 ceph-mon[34225]: pgmap v199: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:21:32.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:32 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2270305047' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:21:34.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:34 smithi194 ceph-mon[33904]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:21:34.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:34 smithi003 ceph-mon[30348]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:21:34.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:34 smithi038 ceph-mon[34225]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:21:36.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:36 smithi194 ceph-mon[33904]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-10T23:21:36.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:36 smithi003 ceph-mon[30348]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-10T23:21:36.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:36 smithi038 ceph-mon[34225]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-10T23:21:38.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:38 smithi194 ceph-mon[33904]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-10T23:21:38.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:38 smithi003 ceph-mon[30348]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-10T23:21:38.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:38 smithi038 ceph-mon[34225]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-10T23:21:40.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:40 smithi194 ceph-mon[33904]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:21:40.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:40 smithi003 ceph-mon[30348]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:21:40.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:40 smithi038 ceph-mon[34225]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:21:41.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:41 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-10T23:21:41.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:41 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:41.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:41 smithi003 ceph-mon[30348]: Deploying daemon osd.9 on smithi003 2024-09-10T23:21:41.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:41 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-10T23:21:41.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:41 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:41.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:41 smithi038 ceph-mon[34225]: Deploying daemon osd.9 on smithi003 2024-09-10T23:21:41.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:41 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-10T23:21:41.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:41 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:41.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:41 smithi194 ceph-mon[33904]: Deploying daemon osd.9 on smithi003 2024-09-10T23:21:42.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:42 smithi003 ceph-mon[30348]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:21:42.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:42 smithi038 ceph-mon[34225]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:21:42.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:42 smithi194 ceph-mon[33904]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:21:44.605 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:44 smithi003 ceph-mon[30348]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-10T23:21:44.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:44 smithi038 ceph-mon[34225]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-10T23:21:44.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:44 smithi194 ceph-mon[33904]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-10T23:21:46.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:46 smithi003 ceph-mon[30348]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:21:46.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:46 smithi038 ceph-mon[34225]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:21:46.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:46 smithi194 ceph-mon[33904]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:21:48.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:48 smithi003 ceph-mon[30348]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:21:48.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:48 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:21:48.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:48 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:48.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:48 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:48.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:48 smithi038 ceph-mon[34225]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:21:48.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:48 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:21:48.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:48 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:48.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:48 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:48.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:48 smithi194 ceph-mon[33904]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:21:48.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:48 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:21:48.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:48 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:48.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:48 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:50.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:50 smithi003 ceph-mon[30348]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:21:50.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:50 smithi038 ceph-mon[34225]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:21:50.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:50 smithi194 ceph-mon[33904]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:21:52.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:52.424+0000 7f82ccc00640 1 -- 172.21.15.3:0/3671385205 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f82d0100b30 con 0x7f82b40b5330 2024-09-10T23:21:52.426 INFO:teuthology.orchestra.run.smithi003.stdout:Created osd(s) 9 on host 'smithi003' 2024-09-10T23:21:52.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:52.426+0000 7f82d6000640 1 -- 172.21.15.3:0/3671385205 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f82b40b5330 msgr2=0x7f82b40b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:52.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:52.426+0000 7f82d6000640 1 --2- 172.21.15.3:0/3671385205 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f82b40b5330 0x7f82b40b77f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f82c0005fd0 tx=0x7f82c0009520 comp rx=0 tx=0).stop 2024-09-10T23:21:52.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:52.426+0000 7f82d6000640 1 -- 172.21.15.3:0/3671385205 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82d0075de0 msgr2=0x7f82d019b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:52.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:52.426+0000 7f82d6000640 1 --2- 172.21.15.3:0/3671385205 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82d0075de0 0x7f82d019b920 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f82b802a930 tx=0x7f82b8003c20 comp rx=0 tx=0).stop 2024-09-10T23:21:52.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:52.426+0000 7f82d6000640 1 -- 172.21.15.3:0/3671385205 shutdown_connections 2024-09-10T23:21:52.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:52.426+0000 7f82d6000640 1 --2- 172.21.15.3:0/3671385205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82d010f3b0 0x7f82d01a0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:52.426+0000 7f82d6000640 1 --2- 172.21.15.3:0/3671385205 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f82b40b5330 0x7f82b40b77f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:52.426+0000 7f82d6000640 1 --2- 172.21.15.3:0/3671385205 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82d0075de0 0x7f82d019b920 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:52.426+0000 7f82d6000640 1 --2- 172.21.15.3:0/3671385205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82d00754c0 0x7f82d019b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:52.426+0000 7f82d6000640 1 -- 172.21.15.3:0/3671385205 >> 172.21.15.3:0/3671385205 conn(0x7f82d00fe810 msgr2=0x7f82d00ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:52.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:52.427+0000 7f82d6000640 1 -- 172.21.15.3:0/3671385205 shutdown_connections 2024-09-10T23:21:52.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:21:52.427+0000 7f82d6000640 1 -- 172.21.15.3:0/3671385205 wait complete. 2024-09-10T23:21:52.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:52 smithi038 ceph-mon[34225]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:21:52.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:52 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:52.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:52 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:52.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:52 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:52.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:52 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:21:52.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:52 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:52.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:52 smithi194 ceph-mon[33904]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:21:52.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:52 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:52.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:52 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:52.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:52 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:52.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:52 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:21:52.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:52 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:52.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:52 smithi003 ceph-mon[30348]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:21:52.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:52 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:52.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:52 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:52.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:52 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:52.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:52 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:21:52.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:52 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:53.159 DEBUG:teuthology.orchestra.run.smithi003:osd.9> sudo journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.9.service 2024-09-10T23:21:53.163 INFO:tasks.cephadm:Deploying osd.10 on smithi038 with /dev/vg_nvme/lv_1... 2024-09-10T23:21:53.163 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T23:21:53.552 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:21:53.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:53 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:53.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:53 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:53.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:53 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:21:53.673 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:53 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:53.673 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:53 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:53.673 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:53 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:21:53.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:53 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:53.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:53 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:53.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:53 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:21:53.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:21:53 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:21:53.671+0000 7ff28e835640 -1 osd.9 0 log_to_monitors true 2024-09-10T23:21:54.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:54 smithi003 ceph-mon[30348]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:21:54.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:54 smithi003 ceph-mon[30348]: from='osd.9 [v2:172.21.15.3:6826/3967749600,v1:172.21.15.3:6827/3967749600]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-10T23:21:54.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:54 smithi003 ceph-mon[30348]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-10T23:21:54.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:54 smithi194 ceph-mon[33904]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:21:54.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:54 smithi194 ceph-mon[33904]: from='osd.9 [v2:172.21.15.3:6826/3967749600,v1:172.21.15.3:6827/3967749600]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-10T23:21:54.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:54 smithi194 ceph-mon[33904]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-10T23:21:54.727 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:54 smithi038 ceph-mon[34225]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:21:54.727 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:54 smithi038 ceph-mon[34225]: from='osd.9 [v2:172.21.15.3:6826/3967749600,v1:172.21.15.3:6827/3967749600]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-10T23:21:54.727 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:54 smithi038 ceph-mon[34225]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-10T23:21:55.543 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:55 smithi038 ceph-mon[34225]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T23:21:55.543 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:55 smithi038 ceph-mon[34225]: osdmap e58: 10 total, 9 up, 10 in 2024-09-10T23:21:55.544 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:55 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:21:55.544 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:55 smithi038 ceph-mon[34225]: from='osd.9 [v2:172.21.15.3:6826/3967749600,v1:172.21.15.3:6827/3967749600]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi003", "root=default"]} : dispatch 2024-09-10T23:21:55.544 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:55 smithi038 ceph-mon[34225]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi003", "root=default"]} : dispatch 2024-09-10T23:21:55.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:55 smithi194 ceph-mon[33904]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T23:21:55.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:55 smithi194 ceph-mon[33904]: osdmap e58: 10 total, 9 up, 10 in 2024-09-10T23:21:55.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:55 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:21:55.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:55 smithi194 ceph-mon[33904]: from='osd.9 [v2:172.21.15.3:6826/3967749600,v1:172.21.15.3:6827/3967749600]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi003", "root=default"]} : dispatch 2024-09-10T23:21:55.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:55 smithi194 ceph-mon[33904]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi003", "root=default"]} : dispatch 2024-09-10T23:21:55.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:55 smithi003 ceph-mon[30348]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T23:21:55.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:55 smithi003 ceph-mon[30348]: osdmap e58: 10 total, 9 up, 10 in 2024-09-10T23:21:55.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:55 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:21:55.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:55 smithi003 ceph-mon[30348]: from='osd.9 [v2:172.21.15.3:6826/3967749600,v1:172.21.15.3:6827/3967749600]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi003", "root=default"]} : dispatch 2024-09-10T23:21:55.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:55 smithi003 ceph-mon[30348]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi003", "root=default"]} : dispatch 2024-09-10T23:21:55.721 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:21:55 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:21:55.451+0000 7ff289400640 -1 osd.9 0 waiting for initial osdmap 2024-09-10T23:21:55.721 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:21:55 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:21:55.486+0000 7ff284400640 -1 osd.9 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:21:56.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:56 smithi003 ceph-mon[30348]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:21:56.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:56 smithi003 ceph-mon[30348]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]': finished 2024-09-10T23:21:56.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:56 smithi003 ceph-mon[30348]: osdmap e59: 10 total, 9 up, 10 in 2024-09-10T23:21:56.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:56 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:21:56.798 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:56 smithi038 ceph-mon[34225]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:21:56.798 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:56 smithi038 ceph-mon[34225]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]': finished 2024-09-10T23:21:56.798 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:56 smithi038 ceph-mon[34225]: osdmap e59: 10 total, 9 up, 10 in 2024-09-10T23:21:56.798 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:56 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:21:56.804 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-10T23:21:56.837 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi038:vg_nvme/lv_1 2024-09-10T23:21:56.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:56 smithi194 ceph-mon[33904]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:21:56.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:56 smithi194 ceph-mon[33904]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]': finished 2024-09-10T23:21:56.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:56 smithi194 ceph-mon[33904]: osdmap e59: 10 total, 9 up, 10 in 2024-09-10T23:21:56.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:56 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:21:57.214 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:21:57.644 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:57 smithi038 ceph-mon[34225]: purged_snaps scrub starts 2024-09-10T23:21:57.644 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:57 smithi038 ceph-mon[34225]: purged_snaps scrub ok 2024-09-10T23:21:57.644 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:57 smithi038 ceph-mon[34225]: osd.9 [v2:172.21.15.3:6826/3967749600,v1:172.21.15.3:6827/3967749600] boot 2024-09-10T23:21:57.644 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:57 smithi038 ceph-mon[34225]: osdmap e60: 10 total, 10 up, 10 in 2024-09-10T23:21:57.644 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:57 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:21:57.644 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:57 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:57.645 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:57 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:57.645 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:57 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:57.645 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:57 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:57.645 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:57 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:57.645 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:57 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:57.645 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:57 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:57.645 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:57 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:57.645 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:57 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:57.645 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:57 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:57.646 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:57 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:57.646 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:57 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:57.646 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:57 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:21:57.646 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:57 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:57.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:57 smithi003 ceph-mon[30348]: purged_snaps scrub starts 2024-09-10T23:21:57.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:57 smithi003 ceph-mon[30348]: purged_snaps scrub ok 2024-09-10T23:21:57.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:57 smithi003 ceph-mon[30348]: osd.9 [v2:172.21.15.3:6826/3967749600,v1:172.21.15.3:6827/3967749600] boot 2024-09-10T23:21:57.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:57 smithi003 ceph-mon[30348]: osdmap e60: 10 total, 10 up, 10 in 2024-09-10T23:21:57.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:57 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:21:57.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:57 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:57.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:57 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:57.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:57 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:57.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:57 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:57.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:57 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:57.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:57 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:57.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:57 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:57.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:57 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:57.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:57 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:57.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:57 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:57.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:57 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:57.723 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:57 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:57.723 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:57 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:21:57.723 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:57 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:57.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.758+0000 7fc6ed200640 1 -- 172.21.15.38:0/1950701372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e8103cc0 msgr2=0x7fc6e81040a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:57.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.758+0000 7fc6ed200640 1 --2- 172.21.15.38:0/1950701372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e8103cc0 0x7fc6e81040a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8009900 tx=0x7fc6d802a410 comp rx=0 tx=0).stop 2024-09-10T23:21:57.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.758+0000 7fc6ed200640 1 -- 172.21.15.38:0/1950701372 shutdown_connections 2024-09-10T23:21:57.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.758+0000 7fc6ed200640 1 --2- 172.21.15.38:0/1950701372 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc6e810d120 0x7fc6e810f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:57.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.758+0000 7fc6ed200640 1 --2- 172.21.15.38:0/1950701372 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6e81045e0 0x7fc6e810cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:57.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.758+0000 7fc6ed200640 1 --2- 172.21.15.38:0/1950701372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e8103cc0 0x7fc6e81040a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:57.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.758+0000 7fc6ed200640 1 -- 172.21.15.38:0/1950701372 >> 172.21.15.38:0/1950701372 conn(0x7fc6e80fd700 msgr2=0x7fc6e80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:57.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.758+0000 7fc6ed200640 1 -- 172.21.15.38:0/1950701372 shutdown_connections 2024-09-10T23:21:57.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.759+0000 7fc6ed200640 1 -- 172.21.15.38:0/1950701372 wait complete. 2024-09-10T23:21:57.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.759+0000 7fc6ed200640 1 Processor -- start 2024-09-10T23:21:57.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.760+0000 7fc6ed200640 1 -- start start 2024-09-10T23:21:57.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.760+0000 7fc6ed200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6e8103cc0 0x7fc6e819b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:57.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.760+0000 7fc6ed200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e81045e0 0x7fc6e819b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:57.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.760+0000 7fc6ed200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc6e810d120 0x7fc6e81a0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:57.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.760+0000 7fc6ed200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e8112c90 con 0x7fc6e810d120 2024-09-10T23:21:57.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.760+0000 7fc6ed200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e8112b10 con 0x7fc6e81045e0 2024-09-10T23:21:57.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.760+0000 7fc6ed200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e8112e10 con 0x7fc6e8103cc0 2024-09-10T23:21:57.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.760+0000 7fc6dd400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e81045e0 0x7fc6e819b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:57.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.760+0000 7fc6dd400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e81045e0 0x7fc6e819b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46852/0 (socket says 172.21.15.38:46852) 2024-09-10T23:21:57.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.760+0000 7fc6dd400640 1 -- 172.21.15.38:0/826125853 learned_addr learned my addr 172.21.15.38:0/826125853 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-10T23:21:57.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.760+0000 7fc6e5e00640 1 --2- 172.21.15.38:0/826125853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6e8103cc0 0x7fc6e819b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:57.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.760+0000 7fc6e6800640 1 --2- 172.21.15.38:0/826125853 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc6e810d120 0x7fc6e81a0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:57.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.761+0000 7fc6dd400640 1 -- 172.21.15.38:0/826125853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6e8103cc0 msgr2=0x7fc6e819b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:57.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.761+0000 7fc6dd400640 1 --2- 172.21.15.38:0/826125853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6e8103cc0 0x7fc6e819b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:57.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.761+0000 7fc6dd400640 1 -- 172.21.15.38:0/826125853 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc6e810d120 msgr2=0x7fc6e81a0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:57.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.761+0000 7fc6dd400640 1 --2- 172.21.15.38:0/826125853 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc6e810d120 0x7fc6e81a0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:57.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.761+0000 7fc6dd400640 1 -- 172.21.15.38:0/826125853 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e81a1450 con 0x7fc6e81045e0 2024-09-10T23:21:57.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.761+0000 7fc6dd400640 1 --2- 172.21.15.38:0/826125853 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e81045e0 0x7fc6e819b8e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000d6b0 tx=0x7fc6d000db70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:57.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.761+0000 7fc6df400640 1 -- 172.21.15.38:0/826125853 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0017070 con 0x7fc6e81045e0 2024-09-10T23:21:57.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.761+0000 7fc6ed200640 1 -- 172.21.15.38:0/826125853 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6e81a1740 con 0x7fc6e81045e0 2024-09-10T23:21:57.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.761+0000 7fc6df400640 1 -- 172.21.15.38:0/826125853 <== mon.2 v2:172.21.15.38:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc6d0010460 con 0x7fc6e81045e0 2024-09-10T23:21:57.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.761+0000 7fc6df400640 1 -- 172.21.15.38:0/826125853 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d000f620 con 0x7fc6e81045e0 2024-09-10T23:21:57.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.761+0000 7fc6ed200640 1 -- 172.21.15.38:0/826125853 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6e81a7e00 con 0x7fc6e81045e0 2024-09-10T23:21:57.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.762+0000 7fc6ed200640 1 -- 172.21.15.38:0/826125853 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6e81040a0 con 0x7fc6e81045e0 2024-09-10T23:21:57.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.765+0000 7fc6df400640 1 -- 172.21.15.38:0/826125853 <== mon.2 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7fc6d0010930 con 0x7fc6e81045e0 2024-09-10T23:21:57.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.766+0000 7fc6df400640 1 --2- 172.21.15.38:0/826125853 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc6cc0b5330 0x7fc6cc0b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:57.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.766+0000 7fc6df400640 1 -- 172.21.15.38:0/826125853 <== mon.2 v2:172.21.15.38:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6476+0+0 (secure 0 0 0) 0x7fc6d00e5200 con 0x7fc6e81045e0 2024-09-10T23:21:57.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.767+0000 7fc6e5e00640 1 --2- 172.21.15.38:0/826125853 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc6cc0b5330 0x7fc6cc0b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:57.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.767+0000 7fc6e5e00640 1 --2- 172.21.15.38:0/826125853 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc6cc0b5330 0x7fc6cc0b77f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8006010 tx=0x7fc6d8005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:57.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.768+0000 7fc6df400640 1 -- 172.21.15.38:0/826125853 <== mon.2 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc6d00ac750 con 0x7fc6e81045e0 2024-09-10T23:21:57.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:57 smithi194 ceph-mon[33904]: purged_snaps scrub starts 2024-09-10T23:21:57.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:57 smithi194 ceph-mon[33904]: purged_snaps scrub ok 2024-09-10T23:21:57.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:57 smithi194 ceph-mon[33904]: osd.9 [v2:172.21.15.3:6826/3967749600,v1:172.21.15.3:6827/3967749600] boot 2024-09-10T23:21:57.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:57 smithi194 ceph-mon[33904]: osdmap e60: 10 total, 10 up, 10 in 2024-09-10T23:21:57.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:57 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:21:57.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:57 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:57.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:57 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:57.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:57 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:57.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:57 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:57.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:57 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:57.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:57 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:57.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:57 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:57.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:57 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:57.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:57 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:57.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:57 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T23:21:57.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:57 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:57.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:57 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:57.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:57 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:21:57.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:57 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:21:57.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:21:57.972+0000 7fc6ed200640 1 -- 172.21.15.38:0/826125853 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fc6e8103080 con 0x7fc6cc0b5330 2024-09-10T23:21:58.718 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:58 smithi038 ceph-mon[34225]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:21:58.719 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:58 smithi038 ceph-mon[34225]: Detected new or changed devices on smithi003 2024-09-10T23:21:58.719 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:58 smithi038 ceph-mon[34225]: Adjusting osd_memory_target on smithi003 to 4273M 2024-09-10T23:21:58.719 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:58 smithi038 ceph-mon[34225]: osdmap e61: 10 total, 10 up, 10 in 2024-09-10T23:21:58.719 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:58 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:21:58.719 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:58 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:21:58.719 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:58 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:58.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:58 smithi003 ceph-mon[30348]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:21:58.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:58 smithi003 ceph-mon[30348]: Detected new or changed devices on smithi003 2024-09-10T23:21:58.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:58 smithi003 ceph-mon[30348]: Adjusting osd_memory_target on smithi003 to 4273M 2024-09-10T23:21:58.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:58 smithi003 ceph-mon[30348]: osdmap e61: 10 total, 10 up, 10 in 2024-09-10T23:21:58.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:58 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:21:58.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:58 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:21:58.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:58 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:58.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:58 smithi194 ceph-mon[33904]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:21:58.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:58 smithi194 ceph-mon[33904]: Detected new or changed devices on smithi003 2024-09-10T23:21:58.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:58 smithi194 ceph-mon[33904]: Adjusting osd_memory_target on smithi003 to 4273M 2024-09-10T23:21:58.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:58 smithi194 ceph-mon[33904]: osdmap e61: 10 total, 10 up, 10 in 2024-09-10T23:21:58.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:58 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:21:58.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:58 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:21:58.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:58 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:21:59.686 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:21:59 smithi038 ceph-mon[34225]: from='client.34523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:21:59.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:21:59 smithi194 ceph-mon[33904]: from='client.34523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:21:59.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:21:59 smithi003 ceph-mon[30348]: from='client.34523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:22:00.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:00 smithi038 ceph-mon[34225]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:00.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:00 smithi194 ceph-mon[33904]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:00.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:00 smithi003 ceph-mon[30348]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:01.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:01 smithi038 ceph-mon[34225]: from='client.? 172.21.15.38:0/2193633877' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b0ece81b-1c5b-40da-b579-fb99bacb005d"} : dispatch 2024-09-10T23:22:01.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:01 smithi038 ceph-mon[34225]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b0ece81b-1c5b-40da-b579-fb99bacb005d"} : dispatch 2024-09-10T23:22:01.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:01 smithi038 ceph-mon[34225]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b0ece81b-1c5b-40da-b579-fb99bacb005d"}]': finished 2024-09-10T23:22:01.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:01 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:22:01.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:01 smithi038 ceph-mon[34225]: osdmap e62: 11 total, 10 up, 11 in 2024-09-10T23:22:01.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:01 smithi194 ceph-mon[33904]: from='client.? 172.21.15.38:0/2193633877' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b0ece81b-1c5b-40da-b579-fb99bacb005d"} : dispatch 2024-09-10T23:22:01.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:01 smithi194 ceph-mon[33904]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b0ece81b-1c5b-40da-b579-fb99bacb005d"} : dispatch 2024-09-10T23:22:01.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:01 smithi194 ceph-mon[33904]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b0ece81b-1c5b-40da-b579-fb99bacb005d"}]': finished 2024-09-10T23:22:01.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:01 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:22:01.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:01 smithi194 ceph-mon[33904]: osdmap e62: 11 total, 10 up, 11 in 2024-09-10T23:22:01.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:01 smithi003 ceph-mon[30348]: from='client.? 172.21.15.38:0/2193633877' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b0ece81b-1c5b-40da-b579-fb99bacb005d"} : dispatch 2024-09-10T23:22:01.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:01 smithi003 ceph-mon[30348]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b0ece81b-1c5b-40da-b579-fb99bacb005d"} : dispatch 2024-09-10T23:22:01.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:01 smithi003 ceph-mon[30348]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b0ece81b-1c5b-40da-b579-fb99bacb005d"}]': finished 2024-09-10T23:22:01.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:01 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:22:01.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:01 smithi003 ceph-mon[30348]: osdmap e62: 11 total, 10 up, 11 in 2024-09-10T23:22:02.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:02 smithi038 ceph-mon[34225]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:02.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:02 smithi038 ceph-mon[34225]: from='client.? 172.21.15.38:0/3837030890' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:22:02.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:02 smithi194 ceph-mon[33904]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:02.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:02 smithi194 ceph-mon[33904]: from='client.? 172.21.15.38:0/3837030890' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:22:02.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:02 smithi003 ceph-mon[30348]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:02.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:02 smithi003 ceph-mon[30348]: from='client.? 172.21.15.38:0/3837030890' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:22:04.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:04 smithi194 ceph-mon[33904]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:04.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:04 smithi038 ceph-mon[34225]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:04.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:04 smithi003 ceph-mon[30348]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:06.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:06 smithi038 ceph-mon[34225]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:06.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:06 smithi194 ceph-mon[33904]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:06.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:06 smithi003 ceph-mon[30348]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:08.722 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:08 smithi038 ceph-mon[34225]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:08.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:08 smithi194 ceph-mon[33904]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:08.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:08 smithi003 ceph-mon[30348]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:09.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:09 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-10T23:22:09.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:09 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:09.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:09 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-10T23:22:09.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:09 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:09.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:09 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-10T23:22:09.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:09 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:10.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:10 smithi038 ceph-mon[34225]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:10.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:10 smithi038 ceph-mon[34225]: Deploying daemon osd.10 on smithi038 2024-09-10T23:22:10.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:10 smithi194 ceph-mon[33904]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:10.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:10 smithi194 ceph-mon[33904]: Deploying daemon osd.10 on smithi038 2024-09-10T23:22:10.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:10 smithi003 ceph-mon[30348]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:10.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:10 smithi003 ceph-mon[30348]: Deploying daemon osd.10 on smithi038 2024-09-10T23:22:12.822 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:12 smithi038 ceph-mon[34225]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:12.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:12 smithi194 ceph-mon[33904]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:12.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:12 smithi003 ceph-mon[30348]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:14.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:14 smithi038 ceph-mon[34225]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:14.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:14 smithi194 ceph-mon[33904]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:14.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:14 smithi003 ceph-mon[30348]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:16.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:16 smithi038 ceph-mon[34225]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:16.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:16 smithi194 ceph-mon[33904]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:16.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:16 smithi003 ceph-mon[30348]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:17.733 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:17 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:22:17.733 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:17 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:17.733 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:17 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:17.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:17 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:22:17.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:17 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:17.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:17 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:17.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:17 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:22:17.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:17 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:17.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:17 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:18.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:18 smithi038 ceph-mon[34225]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:18.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:18 smithi194 ceph-mon[33904]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:18.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:18 smithi003 ceph-mon[30348]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:20.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:20 smithi038 ceph-mon[34225]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:20.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:20 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:20.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:20 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:20.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:20 smithi194 ceph-mon[33904]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:20.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:20 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:20.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:20 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:20.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:22:20.964+0000 7fc6df400640 1 -- 172.21.15.38:0/826125853 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fc6e8103080 con 0x7fc6cc0b5330 2024-09-10T23:22:20.965 INFO:teuthology.orchestra.run.smithi038.stdout:Created osd(s) 10 on host 'smithi038' 2024-09-10T23:22:20.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:22:20.967+0000 7fc6ed200640 1 -- 172.21.15.38:0/826125853 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc6cc0b5330 msgr2=0x7fc6cc0b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:20.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:22:20.967+0000 7fc6ed200640 1 --2- 172.21.15.38:0/826125853 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc6cc0b5330 0x7fc6cc0b77f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8006010 tx=0x7fc6d8005e80 comp rx=0 tx=0).stop 2024-09-10T23:22:20.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:22:20.967+0000 7fc6ed200640 1 -- 172.21.15.38:0/826125853 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e81045e0 msgr2=0x7fc6e819b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:20.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:22:20.967+0000 7fc6ed200640 1 --2- 172.21.15.38:0/826125853 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e81045e0 0x7fc6e819b8e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000d6b0 tx=0x7fc6d000db70 comp rx=0 tx=0).stop 2024-09-10T23:22:20.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:22:20.967+0000 7fc6ed200640 1 -- 172.21.15.38:0/826125853 shutdown_connections 2024-09-10T23:22:20.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:22:20.967+0000 7fc6ed200640 1 --2- 172.21.15.38:0/826125853 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc6cc0b5330 0x7fc6cc0b77f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:20.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:22:20.967+0000 7fc6ed200640 1 --2- 172.21.15.38:0/826125853 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc6e810d120 0x7fc6e81a0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:20.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:22:20.967+0000 7fc6ed200640 1 --2- 172.21.15.38:0/826125853 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e81045e0 0x7fc6e819b8e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:20.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:22:20.967+0000 7fc6ed200640 1 --2- 172.21.15.38:0/826125853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6e8103cc0 0x7fc6e819b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:20.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:22:20.967+0000 7fc6ed200640 1 -- 172.21.15.38:0/826125853 >> 172.21.15.38:0/826125853 conn(0x7fc6e80fd700 msgr2=0x7fc6e80ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:20.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:22:20.967+0000 7fc6ed200640 1 -- 172.21.15.38:0/826125853 shutdown_connections 2024-09-10T23:22:20.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-10T23:22:20.967+0000 7fc6ed200640 1 -- 172.21.15.38:0/826125853 wait complete. 2024-09-10T23:22:20.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:20 smithi003 ceph-mon[30348]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:20.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:20 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:20.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:20 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:21.731 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:21 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:21.731 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:21 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:22:21.731 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:21 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:21.731 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:21 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:21.731 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:21 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:21.731 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:21 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:22:21.770 DEBUG:teuthology.orchestra.run.smithi038:osd.10> sudo journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.10.service 2024-09-10T23:22:21.774 INFO:tasks.cephadm:Deploying osd.11 on smithi194 with /dev/vg_nvme/lv_1... 2024-09-10T23:22:21.774 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T23:22:21.832 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:21 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:21.833 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:21 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:22:21.833 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:21 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:21.833 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:21 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:21.833 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:21 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:21.833 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:21 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:22:21.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:21 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:21.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:21 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:22:21.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:21 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:21.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:21 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:21.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:21 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:21.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:21 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:22:22.150 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:22:22.838 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:22 smithi194 ceph-mon[33904]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:22.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:22 smithi038 ceph-mon[34225]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:22.872 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:22 smithi003 ceph-mon[30348]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:23.249 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:22:23 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:22:23.076+0000 7f251d21b640 -1 osd.10 0 log_to_monitors true 2024-09-10T23:22:23.832 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:23 smithi194 ceph-mon[33904]: from='osd.10 [v2:172.21.15.38:6824/1671957178,v1:172.21.15.38:6825/1671957178]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T23:22:23.832 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:23 smithi194 ceph-mon[33904]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T23:22:23.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:23 smithi038 ceph-mon[34225]: from='osd.10 [v2:172.21.15.38:6824/1671957178,v1:172.21.15.38:6825/1671957178]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T23:22:23.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:23 smithi038 ceph-mon[34225]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T23:22:23.891 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:23 smithi003 ceph-mon[30348]: from='osd.10 [v2:172.21.15.38:6824/1671957178,v1:172.21.15.38:6825/1671957178]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T23:22:23.891 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:23 smithi003 ceph-mon[30348]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T23:22:24.847 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:22:24 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:22:24.562+0000 7f2517e00640 -1 osd.10 0 waiting for initial osdmap 2024-09-10T23:22:24.848 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:22:24 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:22:24.588+0000 7f2512e00640 -1 osd.10 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:22:24.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:24 smithi038 ceph-mon[34225]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:24.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:24 smithi038 ceph-mon[34225]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T23:22:24.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:24 smithi038 ceph-mon[34225]: osdmap e63: 11 total, 10 up, 11 in 2024-09-10T23:22:24.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:24 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:22:24.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:24 smithi038 ceph-mon[34225]: from='osd.10 [v2:172.21.15.38:6824/1671957178,v1:172.21.15.38:6825/1671957178]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-10T23:22:24.849 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:24 smithi038 ceph-mon[34225]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-10T23:22:24.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:24 smithi194 ceph-mon[33904]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:24.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:24 smithi194 ceph-mon[33904]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T23:22:24.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:24 smithi194 ceph-mon[33904]: osdmap e63: 11 total, 10 up, 11 in 2024-09-10T23:22:24.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:24 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:22:24.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:24 smithi194 ceph-mon[33904]: from='osd.10 [v2:172.21.15.38:6824/1671957178,v1:172.21.15.38:6825/1671957178]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-10T23:22:24.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:24 smithi194 ceph-mon[33904]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-10T23:22:24.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:24 smithi003 ceph-mon[30348]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:24.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:24 smithi003 ceph-mon[30348]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T23:22:24.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:24 smithi003 ceph-mon[30348]: osdmap e63: 11 total, 10 up, 11 in 2024-09-10T23:22:24.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:24 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:22:24.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:24 smithi003 ceph-mon[30348]: from='osd.10 [v2:172.21.15.38:6824/1671957178,v1:172.21.15.38:6825/1671957178]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-10T23:22:24.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:24 smithi003 ceph-mon[30348]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-10T23:22:25.394 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-10T23:22:25.426 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi194:vg_nvme/lv_1 2024-09-10T23:22:25.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:25 smithi194 ceph-mon[33904]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-10T23:22:25.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:25 smithi194 ceph-mon[33904]: osdmap e64: 11 total, 10 up, 11 in 2024-09-10T23:22:25.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:25 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:22:25.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:25 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:25.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:25 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:25.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:25 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:25.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:25 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:25.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:25 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:25.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:25 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:25.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:25 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:25.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:25 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:25.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:25 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:25.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:25 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:25.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:25 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:25.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:25 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:25.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:25 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:22:25.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:25 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:25.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:25 smithi003 ceph-mon[30348]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-10T23:22:25.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:25 smithi003 ceph-mon[30348]: osdmap e64: 11 total, 10 up, 11 in 2024-09-10T23:22:25.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:25 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:22:25.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:25 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:25.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:25 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:25.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:25 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:25.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:25 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:25.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:25 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:25.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:25 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:25.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:25 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:25.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:25 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:25.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:25 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:25.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:25 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:25.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:25 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:25.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:25 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:25.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:25 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:22:25.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:25 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:25.804 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:22:25.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:25 smithi038 ceph-mon[34225]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-10T23:22:25.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:25 smithi038 ceph-mon[34225]: osdmap e64: 11 total, 10 up, 11 in 2024-09-10T23:22:25.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:25 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:22:25.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:25 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:25.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:25 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:25.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:25 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:25.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:25 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:25.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:25 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:25.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:25 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:25.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:25 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:25.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:25 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:25.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:25 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:25.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:25 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:25.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:25 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:25.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:25 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:25.849 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:25 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:22:25.849 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:25 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:26.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.320+0000 7fc417200640 1 -- 172.21.15.194:0/3439655921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc41010d120 msgr2=0x7fc41010f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:26.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.320+0000 7fc417200640 1 --2- 172.21.15.194:0/3439655921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc41010d120 0x7fc41010f580 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc408009ca0 tx=0x7fc40802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:22:26.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.320+0000 7fc417200640 1 -- 172.21.15.194:0/3439655921 shutdown_connections 2024-09-10T23:22:26.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.320+0000 7fc417200640 1 --2- 172.21.15.194:0/3439655921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc41010d120 0x7fc41010f580 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:26.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.320+0000 7fc417200640 1 --2- 172.21.15.194:0/3439655921 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4101045e0 0x7fc41010cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:26.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.320+0000 7fc417200640 1 --2- 172.21.15.194:0/3439655921 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc410103cc0 0x7fc4101040a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:26.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.320+0000 7fc417200640 1 -- 172.21.15.194:0/3439655921 >> 172.21.15.194:0/3439655921 conn(0x7fc4100fd700 msgr2=0x7fc4100ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:26.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.320+0000 7fc417200640 1 -- 172.21.15.194:0/3439655921 shutdown_connections 2024-09-10T23:22:26.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.320+0000 7fc417200640 1 -- 172.21.15.194:0/3439655921 wait complete. 2024-09-10T23:22:26.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.321+0000 7fc417200640 1 Processor -- start 2024-09-10T23:22:26.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.321+0000 7fc417200640 1 -- start start 2024-09-10T23:22:26.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.321+0000 7fc417200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc410103cc0 0x7fc41019b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:26.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.321+0000 7fc417200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4101045e0 0x7fc41019b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:26.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.321+0000 7fc417200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc41010d120 0x7fc4101a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:26.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.321+0000 7fc417200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc410112c90 con 0x7fc410103cc0 2024-09-10T23:22:26.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.321+0000 7fc417200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fc410112b10 con 0x7fc4101045e0 2024-09-10T23:22:26.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.321+0000 7fc417200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc410112e10 con 0x7fc41010d120 2024-09-10T23:22:26.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.322+0000 7fc415200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc41010d120 0x7fc4101a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:26.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.322+0000 7fc415200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc41010d120 0x7fc4101a0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:47452/0 (socket says 172.21.15.194:47452) 2024-09-10T23:22:26.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.322+0000 7fc415200640 1 -- 172.21.15.194:0/1822750302 learned_addr learned my addr 172.21.15.194:0/1822750302 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-10T23:22:26.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.322+0000 7fc40fe00640 1 --2- 172.21.15.194:0/1822750302 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc410103cc0 0x7fc41019b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:26.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.322+0000 7fc407e00640 1 --2- 172.21.15.194:0/1822750302 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4101045e0 0x7fc41019b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:26.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.322+0000 7fc415200640 1 -- 172.21.15.194:0/1822750302 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4101045e0 msgr2=0x7fc41019b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:26.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.322+0000 7fc415200640 1 --2- 172.21.15.194:0/1822750302 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4101045e0 0x7fc41019b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:26.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.322+0000 7fc415200640 1 -- 172.21.15.194:0/1822750302 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc410103cc0 msgr2=0x7fc41019b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:26.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.322+0000 7fc415200640 1 --2- 172.21.15.194:0/1822750302 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc410103cc0 0x7fc41019b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:26.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.322+0000 7fc415200640 1 -- 172.21.15.194:0/1822750302 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4101a14f0 con 0x7fc41010d120 2024-09-10T23:22:26.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.322+0000 7fc415200640 1 --2- 172.21.15.194:0/1822750302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc41010d120 0x7fc4101a0d20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc408031040 tx=0x7fc408003f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:26.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.323+0000 7fc40d600640 1 -- 172.21.15.194:0/1822750302 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc408032c90 con 0x7fc41010d120 2024-09-10T23:22:26.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.323+0000 7fc40d600640 1 -- 172.21.15.194:0/1822750302 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc408032e30 con 0x7fc41010d120 2024-09-10T23:22:26.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.323+0000 7fc40d600640 1 -- 172.21.15.194:0/1822750302 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc408030af0 con 0x7fc41010d120 2024-09-10T23:22:26.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.323+0000 7fc417200640 1 -- 172.21.15.194:0/1822750302 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4101a1780 con 0x7fc41010d120 2024-09-10T23:22:26.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.323+0000 7fc417200640 1 -- 172.21.15.194:0/1822750302 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4101a7ea0 con 0x7fc41010d120 2024-09-10T23:22:26.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.324+0000 7fc417200640 1 -- 172.21.15.194:0/1822750302 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4101040a0 con 0x7fc41010d120 2024-09-10T23:22:26.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.326+0000 7fc40d600640 1 -- 172.21.15.194:0/1822750302 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7fc408030c90 con 0x7fc41010d120 2024-09-10T23:22:26.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.327+0000 7fc40d600640 1 --2- 172.21.15.194:0/1822750302 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc3f40b5330 0x7fc3f40b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:26.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.328+0000 7fc40d600640 1 -- 172.21.15.194:0/1822750302 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6942+0+0 (secure 0 0 0) 0x7fc408106970 con 0x7fc41010d120 2024-09-10T23:22:26.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.328+0000 7fc40fe00640 1 --2- 172.21.15.194:0/1822750302 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc3f40b5330 0x7fc3f40b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:26.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.329+0000 7fc40fe00640 1 --2- 172.21.15.194:0/1822750302 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc3f40b5330 0x7fc3f40b77f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc400009bd0 tx=0x7fc400005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:26.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.329+0000 7fc40d600640 1 -- 172.21.15.194:0/1822750302 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc4080cdcf0 con 0x7fc41010d120 2024-09-10T23:22:26.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:26.524+0000 7fc417200640 1 -- 172.21.15.194:0/1822750302 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fc410103080 con 0x7fc3f40b5330 2024-09-10T23:22:26.830 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:26 smithi038 ceph-mon[34225]: purged_snaps scrub starts 2024-09-10T23:22:26.831 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:26 smithi038 ceph-mon[34225]: purged_snaps scrub ok 2024-09-10T23:22:26.831 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:26 smithi038 ceph-mon[34225]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:26.831 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:26 smithi038 ceph-mon[34225]: Detected new or changed devices on smithi038 2024-09-10T23:22:26.831 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:26 smithi038 ceph-mon[34225]: Adjusting osd_memory_target on smithi038 to 4273M 2024-09-10T23:22:26.831 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:26 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:22:26.831 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:26 smithi038 ceph-mon[34225]: osd.10 [v2:172.21.15.38:6824/1671957178,v1:172.21.15.38:6825/1671957178] boot 2024-09-10T23:22:26.831 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:26 smithi038 ceph-mon[34225]: osdmap e65: 11 total, 11 up, 11 in 2024-09-10T23:22:26.831 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:26 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:22:26.831 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:26 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:22:26.831 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:26 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:26.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:26 smithi194 ceph-mon[33904]: purged_snaps scrub starts 2024-09-10T23:22:26.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:26 smithi194 ceph-mon[33904]: purged_snaps scrub ok 2024-09-10T23:22:26.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:26 smithi194 ceph-mon[33904]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:26.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:26 smithi194 ceph-mon[33904]: Detected new or changed devices on smithi038 2024-09-10T23:22:26.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:26 smithi194 ceph-mon[33904]: Adjusting osd_memory_target on smithi038 to 4273M 2024-09-10T23:22:26.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:26 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:22:26.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:26 smithi194 ceph-mon[33904]: osd.10 [v2:172.21.15.38:6824/1671957178,v1:172.21.15.38:6825/1671957178] boot 2024-09-10T23:22:26.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:26 smithi194 ceph-mon[33904]: osdmap e65: 11 total, 11 up, 11 in 2024-09-10T23:22:26.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:26 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:22:26.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:26 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:22:26.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:26 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:26.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:26 smithi003 ceph-mon[30348]: purged_snaps scrub starts 2024-09-10T23:22:26.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:26 smithi003 ceph-mon[30348]: purged_snaps scrub ok 2024-09-10T23:22:26.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:26 smithi003 ceph-mon[30348]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:22:26.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:26 smithi003 ceph-mon[30348]: Detected new or changed devices on smithi038 2024-09-10T23:22:26.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:26 smithi003 ceph-mon[30348]: Adjusting osd_memory_target on smithi038 to 4273M 2024-09-10T23:22:26.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:26 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:22:26.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:26 smithi003 ceph-mon[30348]: osd.10 [v2:172.21.15.38:6824/1671957178,v1:172.21.15.38:6825/1671957178] boot 2024-09-10T23:22:26.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:26 smithi003 ceph-mon[30348]: osdmap e65: 11 total, 11 up, 11 in 2024-09-10T23:22:26.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:26 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:22:26.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:26 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:22:26.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:26 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:27.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:27 smithi194 ceph-mon[33904]: from='client.24532 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:22:27.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:27 smithi194 ceph-mon[33904]: osdmap e66: 11 total, 11 up, 11 in 2024-09-10T23:22:27.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:27 smithi038 ceph-mon[34225]: from='client.24532 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:22:27.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:27 smithi038 ceph-mon[34225]: osdmap e66: 11 total, 11 up, 11 in 2024-09-10T23:22:27.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:27 smithi003 ceph-mon[30348]: from='client.24532 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:22:27.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:27 smithi003 ceph-mon[30348]: osdmap e66: 11 total, 11 up, 11 in 2024-09-10T23:22:28.632 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:28 smithi194 ceph-mon[33904]: pgmap v237: 1 pgs: 1 peering; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:22:28.632 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:28 smithi194 ceph-mon[33904]: osdmap e67: 11 total, 11 up, 11 in 2024-09-10T23:22:28.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:28 smithi038 ceph-mon[34225]: pgmap v237: 1 pgs: 1 peering; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:22:28.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:28 smithi038 ceph-mon[34225]: osdmap e67: 11 total, 11 up, 11 in 2024-09-10T23:22:28.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:28 smithi003 ceph-mon[30348]: pgmap v237: 1 pgs: 1 peering; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:22:28.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:28 smithi003 ceph-mon[30348]: osdmap e67: 11 total, 11 up, 11 in 2024-09-10T23:22:30.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:30 smithi194 ceph-mon[33904]: pgmap v239: 1 pgs: 1 peering; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:22:30.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:30 smithi194 ceph-mon[33904]: from='client.? 172.21.15.194:0/3675333451' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a0036526-54bf-4e8b-95cc-e7b75725961c"} : dispatch 2024-09-10T23:22:30.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:30 smithi194 ceph-mon[33904]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a0036526-54bf-4e8b-95cc-e7b75725961c"} : dispatch 2024-09-10T23:22:30.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:30 smithi194 ceph-mon[33904]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a0036526-54bf-4e8b-95cc-e7b75725961c"}]': finished 2024-09-10T23:22:30.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:30 smithi194 ceph-mon[33904]: osdmap e68: 12 total, 11 up, 12 in 2024-09-10T23:22:30.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:30 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:22:30.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:30 smithi194 ceph-mon[33904]: from='client.? 172.21.15.194:0/1465997707' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:22:30.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:30 smithi038 ceph-mon[34225]: pgmap v239: 1 pgs: 1 peering; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:22:30.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:30 smithi038 ceph-mon[34225]: from='client.? 172.21.15.194:0/3675333451' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a0036526-54bf-4e8b-95cc-e7b75725961c"} : dispatch 2024-09-10T23:22:30.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:30 smithi038 ceph-mon[34225]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a0036526-54bf-4e8b-95cc-e7b75725961c"} : dispatch 2024-09-10T23:22:30.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:30 smithi038 ceph-mon[34225]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a0036526-54bf-4e8b-95cc-e7b75725961c"}]': finished 2024-09-10T23:22:30.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:30 smithi038 ceph-mon[34225]: osdmap e68: 12 total, 11 up, 12 in 2024-09-10T23:22:30.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:30 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:22:30.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:30 smithi038 ceph-mon[34225]: from='client.? 172.21.15.194:0/1465997707' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:22:30.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:30 smithi003 ceph-mon[30348]: pgmap v239: 1 pgs: 1 peering; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:22:30.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:30 smithi003 ceph-mon[30348]: from='client.? 172.21.15.194:0/3675333451' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a0036526-54bf-4e8b-95cc-e7b75725961c"} : dispatch 2024-09-10T23:22:30.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:30 smithi003 ceph-mon[30348]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a0036526-54bf-4e8b-95cc-e7b75725961c"} : dispatch 2024-09-10T23:22:30.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:30 smithi003 ceph-mon[30348]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a0036526-54bf-4e8b-95cc-e7b75725961c"}]': finished 2024-09-10T23:22:30.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:30 smithi003 ceph-mon[30348]: osdmap e68: 12 total, 11 up, 12 in 2024-09-10T23:22:30.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:30 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:22:30.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:30 smithi003 ceph-mon[30348]: from='client.? 172.21.15.194:0/1465997707' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:22:32.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:32 smithi038 ceph-mon[34225]: pgmap v241: 1 pgs: 1 peering; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:22:32.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:32 smithi194 ceph-mon[33904]: pgmap v241: 1 pgs: 1 peering; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:22:32.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:32 smithi003 ceph-mon[30348]: pgmap v241: 1 pgs: 1 peering; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:22:34.875 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:34 smithi003 ceph-mon[30348]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-10T23:22:34.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:34 smithi194 ceph-mon[33904]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-10T23:22:35.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:34 smithi038 ceph-mon[34225]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-10T23:22:36.944 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:36 smithi194 ceph-mon[33904]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:22:36.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:36 smithi003 ceph-mon[30348]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:22:37.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:36 smithi038 ceph-mon[34225]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:22:38.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:38 smithi194 ceph-mon[33904]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-10T23:22:38.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:38 smithi003 ceph-mon[30348]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-10T23:22:39.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:38 smithi038 ceph-mon[34225]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-10T23:22:39.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:39 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-10T23:22:39.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:39 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:39.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:39 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-10T23:22:39.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:39 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:40.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:39 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-10T23:22:40.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:39 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:40.687 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:40 smithi194 ceph-mon[33904]: Deploying daemon osd.11 on smithi194 2024-09-10T23:22:40.687 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:40 smithi194 ceph-mon[33904]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:22:40.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:40 smithi003 ceph-mon[30348]: Deploying daemon osd.11 on smithi194 2024-09-10T23:22:40.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:40 smithi003 ceph-mon[30348]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:22:41.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:40 smithi038 ceph-mon[34225]: Deploying daemon osd.11 on smithi194 2024-09-10T23:22:41.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:40 smithi038 ceph-mon[34225]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:22:42.648 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:42 smithi194 ceph-mon[33904]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-10T23:22:42.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:42 smithi003 ceph-mon[30348]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-10T23:22:43.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:42 smithi038 ceph-mon[34225]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-10T23:22:43.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:43 smithi194 ceph-mon[33904]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:22:43.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:43 smithi003 ceph-mon[30348]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:22:44.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:43 smithi038 ceph-mon[34225]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:22:45.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:45 smithi194 ceph-mon[33904]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:22:46.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:45 smithi038 ceph-mon[34225]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:22:46.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:45 smithi003 ceph-mon[30348]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:22:47.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:46 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:22:47.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:46 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:47.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:46 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:47.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:46 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:22:47.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:46 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:47.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:46 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:47.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:46 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:22:47.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:46 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:47.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:46 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:48.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:47 smithi038 ceph-mon[34225]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:22:48.097 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:47 smithi194 ceph-mon[33904]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:22:48.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:47 smithi003 ceph-mon[30348]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:22:49.936 INFO:teuthology.orchestra.run.smithi194.stdout:Created osd(s) 11 on host 'smithi194' 2024-09-10T23:22:49.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:49.934+0000 7fc40d600640 1 -- 172.21.15.194:0/1822750302 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fc410103080 con 0x7fc3f40b5330 2024-09-10T23:22:49.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:49.936+0000 7fc417200640 1 -- 172.21.15.194:0/1822750302 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc3f40b5330 msgr2=0x7fc3f40b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:49.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:49.936+0000 7fc417200640 1 --2- 172.21.15.194:0/1822750302 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc3f40b5330 0x7fc3f40b77f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc400009bd0 tx=0x7fc400005f90 comp rx=0 tx=0).stop 2024-09-10T23:22:49.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:49.936+0000 7fc417200640 1 -- 172.21.15.194:0/1822750302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc41010d120 msgr2=0x7fc4101a0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:49.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:49.936+0000 7fc417200640 1 --2- 172.21.15.194:0/1822750302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc41010d120 0x7fc4101a0d20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc408031040 tx=0x7fc408003f80 comp rx=0 tx=0).stop 2024-09-10T23:22:49.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:49.936+0000 7fc417200640 1 -- 172.21.15.194:0/1822750302 shutdown_connections 2024-09-10T23:22:49.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:49.936+0000 7fc417200640 1 --2- 172.21.15.194:0/1822750302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc41010d120 0x7fc4101a0d20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:49.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:49.936+0000 7fc417200640 1 --2- 172.21.15.194:0/1822750302 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4101045e0 0x7fc41019b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:49.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:49.936+0000 7fc417200640 1 --2- 172.21.15.194:0/1822750302 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc3f40b5330 0x7fc3f40b77f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:49.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:49.936+0000 7fc417200640 1 --2- 172.21.15.194:0/1822750302 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc410103cc0 0x7fc41019b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:49.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:49.936+0000 7fc417200640 1 -- 172.21.15.194:0/1822750302 >> 172.21.15.194:0/1822750302 conn(0x7fc4100fd700 msgr2=0x7fc41010f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:49.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:49.937+0000 7fc417200640 1 -- 172.21.15.194:0/1822750302 shutdown_connections 2024-09-10T23:22:49.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:22:49.937+0000 7fc417200640 1 -- 172.21.15.194:0/1822750302 wait complete. 2024-09-10T23:22:50.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:50 smithi038 ceph-mon[34225]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:22:50.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:50 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:50.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:50 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:50.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:50 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:50.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:50 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:22:50.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:50 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:50.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:50 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:22:50.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:50 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:50.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:50 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:50.658 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:50 smithi194 ceph-mon[33904]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:22:50.658 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:50 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:50.658 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:50 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:50.658 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:50 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:50.658 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:50 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:22:50.658 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:50 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:50.658 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:50 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:22:50.658 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:50 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:50.658 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:50 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:50.695 DEBUG:teuthology.orchestra.run.smithi194:osd.11> sudo journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.11.service 2024-09-10T23:22:50.698 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-10T23:22:50.699 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T23:22:50.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:50 smithi003 ceph-mon[30348]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:22:50.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:50 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:50.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:50 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:50.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:50 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:50.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:50 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:22:50.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:50 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:50.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:50 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:22:50.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:50 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:50.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:50 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:51.090 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:51.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.652+0000 7f0356a00640 1 -- 172.21.15.3:0/933725079 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0350075540 msgr2=0x7f0350075920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:51.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.652+0000 7f0356a00640 1 --2- 172.21.15.3:0/933725079 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0350075540 0x7f0350075920 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0340009ca0 tx=0x7f034002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:22:51.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.652+0000 7f0356a00640 1 -- 172.21.15.3:0/933725079 shutdown_connections 2024-09-10T23:22:51.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.652+0000 7f0356a00640 1 --2- 172.21.15.3:0/933725079 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f035010f3c0 0x7f03501117b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:51.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.652+0000 7f0356a00640 1 --2- 172.21.15.3:0/933725079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0350075f40 0x7f035010edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:51.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.652+0000 7f0356a00640 1 --2- 172.21.15.3:0/933725079 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0350075540 0x7f0350075920 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:51.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.653+0000 7f0356a00640 1 -- 172.21.15.3:0/933725079 >> 172.21.15.3:0/933725079 conn(0x7f03500fe810 msgr2=0x7f0350100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:51.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.653+0000 7f0356a00640 1 -- 172.21.15.3:0/933725079 shutdown_connections 2024-09-10T23:22:51.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.653+0000 7f0356a00640 1 -- 172.21.15.3:0/933725079 wait complete. 2024-09-10T23:22:51.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.654+0000 7f0356a00640 1 Processor -- start 2024-09-10T23:22:51.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.654+0000 7f0356a00640 1 -- start start 2024-09-10T23:22:51.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.654+0000 7f0356a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0350075540 0x7f035019b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:51.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.654+0000 7f0356a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0350075f40 0x7f035019b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:51.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.654+0000 7f0356a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f035010f3c0 0x7f03501a0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:51.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.654+0000 7f0356a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0350114e60 con 0x7f035010f3c0 2024-09-10T23:22:51.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.654+0000 7f0356a00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0350114ce0 con 0x7f0350075540 2024-09-10T23:22:51.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.654+0000 7f0356a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0350114fe0 con 0x7f0350075f40 2024-09-10T23:22:51.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.654+0000 7f034f400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0350075f40 0x7f035019b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:51.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.655+0000 7f0354a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f035010f3c0 0x7f03501a0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:51.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.655+0000 7f034f400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0350075f40 0x7f035019b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.3:39504/0 (socket says 172.21.15.3:39504) 2024-09-10T23:22:51.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.655+0000 7f034f400640 1 -- 172.21.15.3:0/3491262790 learned_addr learned my addr 172.21.15.3:0/3491262790 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:22:51.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.655+0000 7f034fe00640 1 --2- 172.21.15.3:0/3491262790 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0350075540 0x7f035019b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:51.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.655+0000 7f034f400640 1 -- 172.21.15.3:0/3491262790 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0350075540 msgr2=0x7f035019b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:51.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.655+0000 7f034f400640 1 --2- 172.21.15.3:0/3491262790 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0350075540 0x7f035019b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:51.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.655+0000 7f034f400640 1 -- 172.21.15.3:0/3491262790 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f035010f3c0 msgr2=0x7f03501a0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:51.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.655+0000 7f034f400640 1 --2- 172.21.15.3:0/3491262790 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f035010f3c0 0x7f03501a0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:51.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.655+0000 7f034f400640 1 -- 172.21.15.3:0/3491262790 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03501a1480 con 0x7f0350075f40 2024-09-10T23:22:51.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.655+0000 7f0354a00640 1 --2- 172.21.15.3:0/3491262790 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f035010f3c0 0x7f03501a0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:22:51.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.655+0000 7f034f400640 1 --2- 172.21.15.3:0/3491262790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0350075f40 0x7f035019b910 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f033c00d950 tx=0x7f033c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:51.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.656+0000 7f034cc00640 1 -- 172.21.15.3:0/3491262790 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c017070 con 0x7f0350075f40 2024-09-10T23:22:51.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.656+0000 7f0356a00640 1 -- 172.21.15.3:0/3491262790 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03501a1770 con 0x7f0350075f40 2024-09-10T23:22:51.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.656+0000 7f034cc00640 1 -- 172.21.15.3:0/3491262790 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f033c009c30 con 0x7f0350075f40 2024-09-10T23:22:51.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.656+0000 7f034cc00640 1 -- 172.21.15.3:0/3491262790 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c00f620 con 0x7f0350075f40 2024-09-10T23:22:51.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.656+0000 7f0356a00640 1 -- 172.21.15.3:0/3491262790 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03501a7e30 con 0x7f0350075f40 2024-09-10T23:22:51.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.657+0000 7f0356a00640 1 -- 172.21.15.3:0/3491262790 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0350075920 con 0x7f0350075f40 2024-09-10T23:22:51.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.660+0000 7f034cc00640 1 -- 172.21.15.3:0/3491262790 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7f033c010460 con 0x7f0350075f40 2024-09-10T23:22:51.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.661+0000 7f034cc00640 1 --2- 172.21.15.3:0/3491262790 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f03340b5330 0x7f03340b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:51.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.661+0000 7f034cc00640 1 -- 172.21.15.3:0/3491262790 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7024+0+0 (secure 0 0 0) 0x7f033c0e5330 con 0x7f0350075f40 2024-09-10T23:22:51.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.661+0000 7f034fe00640 1 --2- 172.21.15.3:0/3491262790 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f03340b5330 0x7f03340b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:51.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.662+0000 7f034cc00640 1 -- 172.21.15.3:0/3491262790 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f033c009de0 con 0x7f0350075f40 2024-09-10T23:22:51.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.662+0000 7f034fe00640 1 --2- 172.21.15.3:0/3491262790 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f03340b5330 0x7f03340b77f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0340006010 tx=0x7f0340031000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:51.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.860+0000 7f0356a00640 1 -- 172.21.15.3:0/3491262790 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f035019c500 con 0x7f0350075f40 2024-09-10T23:22:51.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.861+0000 7f034cc00640 1 -- 172.21.15.3:0/3491262790 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7f035019c500 con 0x7f0350075f40 2024-09-10T23:22:51.862 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:22:51.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.864+0000 7f0356a00640 1 -- 172.21.15.3:0/3491262790 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f03340b5330 msgr2=0x7f03340b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:51.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.864+0000 7f0356a00640 1 --2- 172.21.15.3:0/3491262790 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f03340b5330 0x7f03340b77f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0340006010 tx=0x7f0340031000 comp rx=0 tx=0).stop 2024-09-10T23:22:51.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.864+0000 7f0356a00640 1 -- 172.21.15.3:0/3491262790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0350075f40 msgr2=0x7f035019b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:51.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.864+0000 7f0356a00640 1 --2- 172.21.15.3:0/3491262790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0350075f40 0x7f035019b910 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f033c00d950 tx=0x7f033c00de10 comp rx=0 tx=0).stop 2024-09-10T23:22:51.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.864+0000 7f0356a00640 1 -- 172.21.15.3:0/3491262790 shutdown_connections 2024-09-10T23:22:51.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.864+0000 7f0356a00640 1 --2- 172.21.15.3:0/3491262790 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f03340b5330 0x7f03340b77f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:51.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.864+0000 7f0356a00640 1 --2- 172.21.15.3:0/3491262790 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f035010f3c0 0x7f03501a0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:51.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.864+0000 7f0356a00640 1 --2- 172.21.15.3:0/3491262790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0350075f40 0x7f035019b910 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:51.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.864+0000 7f0356a00640 1 --2- 172.21.15.3:0/3491262790 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0350075540 0x7f035019b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:51.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.864+0000 7f0356a00640 1 -- 172.21.15.3:0/3491262790 >> 172.21.15.3:0/3491262790 conn(0x7f03500fe810 msgr2=0x7f03500ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:51.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.864+0000 7f0356a00640 1 -- 172.21.15.3:0/3491262790 shutdown_connections 2024-09-10T23:22:51.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:51.864+0000 7f0356a00640 1 -- 172.21.15.3:0/3491262790 wait complete. 2024-09-10T23:22:52.156 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:22:51 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:22:51.833+0000 7f66ab811640 -1 osd.11 0 log_to_monitors true 2024-09-10T23:22:52.431 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:52 smithi194 ceph-mon[33904]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:22:52.431 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:52 smithi194 ceph-mon[33904]: from='osd.11 [v2:172.21.15.194:6824/1048859686,v1:172.21.15.194:6825/1048859686]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T23:22:52.431 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:52 smithi194 ceph-mon[33904]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T23:22:52.432 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:52 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3491262790' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:22:52.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:52 smithi038 ceph-mon[34225]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:22:52.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:52 smithi038 ceph-mon[34225]: from='osd.11 [v2:172.21.15.194:6824/1048859686,v1:172.21.15.194:6825/1048859686]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T23:22:52.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:52 smithi038 ceph-mon[34225]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T23:22:52.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:52 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3491262790' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:22:52.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:52 smithi003 ceph-mon[30348]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:22:52.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:52 smithi003 ceph-mon[30348]: from='osd.11 [v2:172.21.15.194:6824/1048859686,v1:172.21.15.194:6825/1048859686]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T23:22:52.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:52 smithi003 ceph-mon[30348]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T23:22:52.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:52 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3491262790' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:22:52.759 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":68,"num_osds":12,"num_up_osds":11,"osd_up_since":1726010545,"num_in_osds":12,"osd_in_since":1726010549,"num_remapped_pgs":0} 2024-09-10T23:22:53.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:53 smithi038 ceph-mon[34225]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T23:22:53.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:53 smithi038 ceph-mon[34225]: from='osd.11 [v2:172.21.15.194:6824/1048859686,v1:172.21.15.194:6825/1048859686]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]} : dispatch 2024-09-10T23:22:53.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:53 smithi038 ceph-mon[34225]: osdmap e69: 12 total, 11 up, 12 in 2024-09-10T23:22:53.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:53 smithi038 ceph-mon[34225]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]} : dispatch 2024-09-10T23:22:53.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:53 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:22:53.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:53 smithi038 ceph-mon[34225]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-10T23:22:53.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:53 smithi038 ceph-mon[34225]: osdmap e70: 12 total, 11 up, 12 in 2024-09-10T23:22:53.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:53 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:22:53.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:53 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:22:53.604 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:53 smithi194 ceph-mon[33904]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T23:22:53.605 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:53 smithi194 ceph-mon[33904]: from='osd.11 [v2:172.21.15.194:6824/1048859686,v1:172.21.15.194:6825/1048859686]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]} : dispatch 2024-09-10T23:22:53.605 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:53 smithi194 ceph-mon[33904]: osdmap e69: 12 total, 11 up, 12 in 2024-09-10T23:22:53.605 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:53 smithi194 ceph-mon[33904]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]} : dispatch 2024-09-10T23:22:53.605 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:53 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:22:53.605 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:53 smithi194 ceph-mon[33904]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-10T23:22:53.605 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:53 smithi194 ceph-mon[33904]: osdmap e70: 12 total, 11 up, 12 in 2024-09-10T23:22:53.605 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:53 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:22:53.605 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:53 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:22:53.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:53 smithi003 ceph-mon[30348]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T23:22:53.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:53 smithi003 ceph-mon[30348]: from='osd.11 [v2:172.21.15.194:6824/1048859686,v1:172.21.15.194:6825/1048859686]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]} : dispatch 2024-09-10T23:22:53.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:53 smithi003 ceph-mon[30348]: osdmap e69: 12 total, 11 up, 12 in 2024-09-10T23:22:53.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:53 smithi003 ceph-mon[30348]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]} : dispatch 2024-09-10T23:22:53.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:53 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:22:53.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:53 smithi003 ceph-mon[30348]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-10T23:22:53.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:53 smithi003 ceph-mon[30348]: osdmap e70: 12 total, 11 up, 12 in 2024-09-10T23:22:53.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:53 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:22:53.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:53 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:22:53.761 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T23:22:54.163 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:54.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:22:53 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:22:53.891+0000 7f66a6e00640 -1 osd.11 0 waiting for initial osdmap 2024-09-10T23:22:54.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:22:53 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:22:53.924+0000 7f669c400640 -1 osd.11 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:22:54.460 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:54 smithi003 ceph-mon[30348]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:22:54.460 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:54 smithi003 ceph-mon[30348]: from='osd.11 ' entity='osd.11' 2024-09-10T23:22:54.460 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:54 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:22:54.539 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:54 smithi194 ceph-mon[33904]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:22:54.539 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:54 smithi194 ceph-mon[33904]: from='osd.11 ' entity='osd.11' 2024-09-10T23:22:54.540 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:54 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:22:54.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:54 smithi038 ceph-mon[34225]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:22:54.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:54 smithi038 ceph-mon[34225]: from='osd.11 ' entity='osd.11' 2024-09-10T23:22:54.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:54 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:22:54.741 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.713+0000 7f7502400640 1 -- 172.21.15.3:0/2863486749 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f74fc10b350 msgr2=0x7f74fc111b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:54.741 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.713+0000 7f7502400640 1 --2- 172.21.15.3:0/2863486749 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f74fc10b350 0x7f74fc111b50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f74f4009ca0 tx=0x7f74f402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:22:54.741 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.713+0000 7f7502400640 1 -- 172.21.15.3:0/2863486749 shutdown_connections 2024-09-10T23:22:54.741 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.713+0000 7f7502400640 1 --2- 172.21.15.3:0/2863486749 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f74fc10b350 0x7f74fc111b50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:54.741 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.713+0000 7f7502400640 1 --2- 172.21.15.3:0/2863486749 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74fc10a9d0 0x7f74fc10ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:54.741 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.713+0000 7f7502400640 1 --2- 172.21.15.3:0/2863486749 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74fc104fc0 0x7f74fc1053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:54.741 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.713+0000 7f7502400640 1 -- 172.21.15.3:0/2863486749 >> 172.21.15.3:0/2863486749 conn(0x7f74fc1009f0 msgr2=0x7f74fc102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:54.741 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.713+0000 7f7502400640 1 -- 172.21.15.3:0/2863486749 shutdown_connections 2024-09-10T23:22:54.741 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.714+0000 7f7502400640 1 -- 172.21.15.3:0/2863486749 wait complete. 2024-09-10T23:22:54.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.715+0000 7f7502400640 1 Processor -- start 2024-09-10T23:22:54.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.715+0000 7f7502400640 1 -- start start 2024-09-10T23:22:54.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.716+0000 7f7502400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74fc104fc0 0x7f74fc19b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:54.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.716+0000 7f7502400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f74fc10a9d0 0x7f74fc19b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:54.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.716+0000 7f7502400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74fc10b350 0x7f74fc1a0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:54.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.716+0000 7f7502400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f74fc114e80 con 0x7f74fc10a9d0 2024-09-10T23:22:54.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.716+0000 7f7502400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f74fc114d00 con 0x7f74fc10b350 2024-09-10T23:22:54.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.716+0000 7f7502400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f74fc115000 con 0x7f74fc104fc0 2024-09-10T23:22:54.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.716+0000 7f74faa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f74fc10a9d0 0x7f74fc19b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:54.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.716+0000 7f74fb400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74fc104fc0 0x7f74fc19b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:54.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.716+0000 7f74faa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f74fc10a9d0 0x7f74fc19b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56304/0 (socket says 172.21.15.3:56304) 2024-09-10T23:22:54.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.716+0000 7f74faa00640 1 -- 172.21.15.3:0/2818652344 learned_addr learned my addr 172.21.15.3:0/2818652344 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:22:54.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.716+0000 7f74fbe00640 1 --2- 172.21.15.3:0/2818652344 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74fc10b350 0x7f74fc1a0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:54.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.716+0000 7f74faa00640 1 -- 172.21.15.3:0/2818652344 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74fc104fc0 msgr2=0x7f74fc19b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:54.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.716+0000 7f74faa00640 1 --2- 172.21.15.3:0/2818652344 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74fc104fc0 0x7f74fc19b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:54.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.716+0000 7f74faa00640 1 -- 172.21.15.3:0/2818652344 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74fc10b350 msgr2=0x7f74fc1a0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:54.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.716+0000 7f74faa00640 1 --2- 172.21.15.3:0/2818652344 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74fc10b350 0x7f74fc1a0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:54.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.716+0000 7f74faa00640 1 -- 172.21.15.3:0/2818652344 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74fc1a1420 con 0x7f74fc10a9d0 2024-09-10T23:22:54.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.716+0000 7f74fb400640 1 --2- 172.21.15.3:0/2818652344 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74fc104fc0 0x7f74fc19b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:22:54.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.717+0000 7f74faa00640 1 --2- 172.21.15.3:0/2818652344 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f74fc10a9d0 0x7f74fc19b8b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f74e800e9f0 tx=0x7f74e800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:54.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.717+0000 7f74f3e00640 1 -- 172.21.15.3:0/2818652344 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e800cd80 con 0x7f74fc10a9d0 2024-09-10T23:22:54.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.717+0000 7f7502400640 1 -- 172.21.15.3:0/2818652344 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74fc1a1710 con 0x7f74fc10a9d0 2024-09-10T23:22:54.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.717+0000 7f74f3e00640 1 -- 172.21.15.3:0/2818652344 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f74e80108c0 con 0x7f74fc10a9d0 2024-09-10T23:22:54.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.717+0000 7f74f3e00640 1 -- 172.21.15.3:0/2818652344 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e80187c0 con 0x7f74fc10a9d0 2024-09-10T23:22:54.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.717+0000 7f7502400640 1 -- 172.21.15.3:0/2818652344 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74fc1a7fa0 con 0x7f74fc10a9d0 2024-09-10T23:22:54.744 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.719+0000 7f7502400640 1 -- 172.21.15.3:0/2818652344 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74fc1053a0 con 0x7f74fc10a9d0 2024-09-10T23:22:54.744 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.721+0000 7f74f3e00640 1 -- 172.21.15.3:0/2818652344 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7f74e8010430 con 0x7f74fc10a9d0 2024-09-10T23:22:54.744 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.723+0000 7f74f3e00640 1 --2- 172.21.15.3:0/2818652344 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f74e00b53b0 0x7f74e00b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:54.744 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.723+0000 7f74f3e00640 1 -- 172.21.15.3:0/2818652344 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7062+0+0 (secure 0 0 0) 0x7f74e80e5ae0 con 0x7f74fc10a9d0 2024-09-10T23:22:54.744 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.723+0000 7f74fb400640 1 --2- 172.21.15.3:0/2818652344 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f74e00b53b0 0x7f74e00b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:54.744 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.724+0000 7f74fb400640 1 --2- 172.21.15.3:0/2818652344 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f74e00b53b0 0x7f74e00b7870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f74ec009fc0 tx=0x7f74ec005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:54.744 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.726+0000 7f74f3e00640 1 -- 172.21.15.3:0/2818652344 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f74e80ac790 con 0x7f74fc10a9d0 2024-09-10T23:22:54.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.956+0000 7f7502400640 1 -- 172.21.15.3:0/2818652344 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f74fc10d130 con 0x7f74fc10a9d0 2024-09-10T23:22:54.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.956+0000 7f74f3e00640 1 -- 172.21.15.3:0/2818652344 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7f74e80b11c0 con 0x7f74fc10a9d0 2024-09-10T23:22:54.958 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:22:54.961 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.959+0000 7f7502400640 1 -- 172.21.15.3:0/2818652344 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f74e00b53b0 msgr2=0x7f74e00b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:54.961 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.959+0000 7f7502400640 1 --2- 172.21.15.3:0/2818652344 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f74e00b53b0 0x7f74e00b7870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f74ec009fc0 tx=0x7f74ec005f90 comp rx=0 tx=0).stop 2024-09-10T23:22:54.961 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.959+0000 7f7502400640 1 -- 172.21.15.3:0/2818652344 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f74fc10a9d0 msgr2=0x7f74fc19b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:54.961 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.959+0000 7f7502400640 1 --2- 172.21.15.3:0/2818652344 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f74fc10a9d0 0x7f74fc19b8b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f74e800e9f0 tx=0x7f74e800eeb0 comp rx=0 tx=0).stop 2024-09-10T23:22:54.961 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.959+0000 7f7502400640 1 -- 172.21.15.3:0/2818652344 shutdown_connections 2024-09-10T23:22:54.961 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.959+0000 7f7502400640 1 --2- 172.21.15.3:0/2818652344 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74fc10b350 0x7f74fc1a0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:54.961 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.959+0000 7f7502400640 1 --2- 172.21.15.3:0/2818652344 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f74e00b53b0 0x7f74e00b7870 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:54.961 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.959+0000 7f7502400640 1 --2- 172.21.15.3:0/2818652344 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f74fc10a9d0 0x7f74fc19b8b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:54.961 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.959+0000 7f7502400640 1 --2- 172.21.15.3:0/2818652344 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74fc104fc0 0x7f74fc19b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:54.961 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.959+0000 7f7502400640 1 -- 172.21.15.3:0/2818652344 >> 172.21.15.3:0/2818652344 conn(0x7f74fc1009f0 msgr2=0x7f74fc102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:54.962 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.959+0000 7f7502400640 1 -- 172.21.15.3:0/2818652344 shutdown_connections 2024-09-10T23:22:54.962 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:54.959+0000 7f7502400640 1 -- 172.21.15.3:0/2818652344 wait complete. 2024-09-10T23:22:55.748 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":71,"num_osds":12,"num_up_osds":12,"osd_up_since":1726010574,"num_in_osds":12,"osd_in_since":1726010549,"num_remapped_pgs":0} 2024-09-10T23:22:55.749 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:22:55.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:55 smithi038 ceph-mon[34225]: purged_snaps scrub starts 2024-09-10T23:22:55.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:55 smithi038 ceph-mon[34225]: purged_snaps scrub ok 2024-09-10T23:22:55.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:55 smithi038 ceph-mon[34225]: Detected new or changed devices on smithi194 2024-09-10T23:22:55.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:55 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:55.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:55 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:55.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:55 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:55.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:55 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:55.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:55 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:55.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:55 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:55.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:55 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:55.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:55 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:55.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:55 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:55.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:55 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:55.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:55 smithi038 ceph-mon[34225]: Adjusting osd_memory_target on smithi194 to 4272M 2024-09-10T23:22:55.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:55 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:55.849 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:55 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:55.849 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:55 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:22:55.849 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:55 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:55.849 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:55 smithi038 ceph-mon[34225]: osd.11 [v2:172.21.15.194:6824/1048859686,v1:172.21.15.194:6825/1048859686] boot 2024-09-10T23:22:55.849 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:55 smithi038 ceph-mon[34225]: osdmap e71: 12 total, 12 up, 12 in 2024-09-10T23:22:55.849 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:55 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:22:55.849 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:55 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2818652344' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:22:55.866 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:55 smithi194 ceph-mon[33904]: purged_snaps scrub starts 2024-09-10T23:22:55.866 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:55 smithi194 ceph-mon[33904]: purged_snaps scrub ok 2024-09-10T23:22:55.866 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:55 smithi194 ceph-mon[33904]: Detected new or changed devices on smithi194 2024-09-10T23:22:55.866 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:55 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:55.866 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:55 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:55.866 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:55 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:55.866 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:55 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:55.867 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:55 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:55.867 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:55 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:55.867 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:55 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:55.867 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:55 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:55.867 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:55 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:55.867 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:55 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:55.867 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:55 smithi194 ceph-mon[33904]: Adjusting osd_memory_target on smithi194 to 4272M 2024-09-10T23:22:55.867 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:55 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:55.867 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:55 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:55.867 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:55 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:22:55.867 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:55 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:55.867 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:55 smithi194 ceph-mon[33904]: osd.11 [v2:172.21.15.194:6824/1048859686,v1:172.21.15.194:6825/1048859686] boot 2024-09-10T23:22:55.867 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:55 smithi194 ceph-mon[33904]: osdmap e71: 12 total, 12 up, 12 in 2024-09-10T23:22:55.867 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:55 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:22:55.868 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:55 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2818652344' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:22:55.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:55 smithi003 ceph-mon[30348]: purged_snaps scrub starts 2024-09-10T23:22:55.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:55 smithi003 ceph-mon[30348]: purged_snaps scrub ok 2024-09-10T23:22:55.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:55 smithi003 ceph-mon[30348]: Detected new or changed devices on smithi194 2024-09-10T23:22:55.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:55 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:55.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:55 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:55.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:55 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:55.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:55 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:55.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:55 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:55.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:55 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:55.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:55 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:55.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:55 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:55.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:55 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:55.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:55 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T23:22:55.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:55 smithi003 ceph-mon[30348]: Adjusting osd_memory_target on smithi194 to 4272M 2024-09-10T23:22:55.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:55 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:55.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:55 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:22:55.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:55 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:22:55.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:55 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:22:55.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:55 smithi003 ceph-mon[30348]: osd.11 [v2:172.21.15.194:6824/1048859686,v1:172.21.15.194:6825/1048859686] boot 2024-09-10T23:22:55.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:55 smithi003 ceph-mon[30348]: osdmap e71: 12 total, 12 up, 12 in 2024-09-10T23:22:55.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:55 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:22:55.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:55 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2818652344' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:22:56.123 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:56.765 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:56 smithi003 ceph-mon[30348]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:22:56.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.877+0000 7fd435000640 1 -- 172.21.15.3:0/1504875820 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd430075e00 msgr2=0x7fd43010ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:56.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.877+0000 7fd435000640 1 --2- 172.21.15.3:0/1504875820 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd430075e00 0x7fd43010ecc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd418009900 tx=0x7fd41802a410 comp rx=0 tx=0).stop 2024-09-10T23:22:56.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.877+0000 7fd435000640 1 -- 172.21.15.3:0/1504875820 shutdown_connections 2024-09-10T23:22:56.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.877+0000 7fd435000640 1 --2- 172.21.15.3:0/1504875820 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd43010f200 0x7fd4301115f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:56.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.877+0000 7fd435000640 1 --2- 172.21.15.3:0/1504875820 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd430075e00 0x7fd43010ecc0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:56.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.877+0000 7fd435000640 1 --2- 172.21.15.3:0/1504875820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4300754e0 0x7fd4300758c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:56.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.877+0000 7fd435000640 1 -- 172.21.15.3:0/1504875820 >> 172.21.15.3:0/1504875820 conn(0x7fd4300fe6c0 msgr2=0x7fd430100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:56.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.877+0000 7fd435000640 1 -- 172.21.15.3:0/1504875820 shutdown_connections 2024-09-10T23:22:56.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.877+0000 7fd435000640 1 -- 172.21.15.3:0/1504875820 wait complete. 2024-09-10T23:22:56.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.878+0000 7fd435000640 1 Processor -- start 2024-09-10T23:22:56.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.878+0000 7fd435000640 1 -- start start 2024-09-10T23:22:56.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.878+0000 7fd435000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4300754e0 0x7fd43019b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:56.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.879+0000 7fd435000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd430075e00 0x7fd43019b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:56.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.879+0000 7fd435000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd43010f200 0x7fd4301a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:56.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.879+0000 7fd435000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd430114c90 con 0x7fd4300754e0 2024-09-10T23:22:56.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.879+0000 7fd435000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd430114b10 con 0x7fd430075e00 2024-09-10T23:22:56.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.879+0000 7fd435000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd430114e10 con 0x7fd43010f200 2024-09-10T23:22:56.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.879+0000 7fd42f400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4300754e0 0x7fd43019b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:56.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.879+0000 7fd42f400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4300754e0 0x7fd43019b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56324/0 (socket says 172.21.15.3:56324) 2024-09-10T23:22:56.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.879+0000 7fd42f400640 1 -- 172.21.15.3:0/2793839503 learned_addr learned my addr 172.21.15.3:0/2793839503 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:22:56.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.879+0000 7fd426a00640 1 --2- 172.21.15.3:0/2793839503 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd430075e00 0x7fd43019b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:56.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.879+0000 7fd42fe00640 1 --2- 172.21.15.3:0/2793839503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd43010f200 0x7fd4301a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:56.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.879+0000 7fd42f400640 1 -- 172.21.15.3:0/2793839503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd43010f200 msgr2=0x7fd4301a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:56.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.879+0000 7fd42f400640 1 --2- 172.21.15.3:0/2793839503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd43010f200 0x7fd4301a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:56.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.879+0000 7fd42f400640 1 -- 172.21.15.3:0/2793839503 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd430075e00 msgr2=0x7fd43019b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:56.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.879+0000 7fd42f400640 1 --2- 172.21.15.3:0/2793839503 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd430075e00 0x7fd43019b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:56.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.879+0000 7fd42f400640 1 -- 172.21.15.3:0/2793839503 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4301a1290 con 0x7fd4300754e0 2024-09-10T23:22:56.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.879+0000 7fd426a00640 1 --2- 172.21.15.3:0/2793839503 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd430075e00 0x7fd43019b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:22:56.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.879+0000 7fd42f400640 1 --2- 172.21.15.3:0/2793839503 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4300754e0 0x7fd43019b1e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd42000d770 tx=0x7fd42000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:56.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.880+0000 7fd42cc00640 1 -- 172.21.15.3:0/2793839503 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd420017070 con 0x7fd4300754e0 2024-09-10T23:22:56.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.880+0000 7fd435000640 1 -- 172.21.15.3:0/2793839503 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4301a1580 con 0x7fd4300754e0 2024-09-10T23:22:56.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.880+0000 7fd42cc00640 1 -- 172.21.15.3:0/2793839503 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4200054b0 con 0x7fd4300754e0 2024-09-10T23:22:56.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.880+0000 7fd42cc00640 1 -- 172.21.15.3:0/2793839503 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd420004c60 con 0x7fd4300754e0 2024-09-10T23:22:56.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.880+0000 7fd435000640 1 -- 172.21.15.3:0/2793839503 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4301a7c40 con 0x7fd4300754e0 2024-09-10T23:22:56.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.881+0000 7fd435000640 1 -- 172.21.15.3:0/2793839503 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4300758c0 con 0x7fd4300754e0 2024-09-10T23:22:56.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.883+0000 7fd42cc00640 1 -- 172.21.15.3:0/2793839503 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7fd420004e00 con 0x7fd4300754e0 2024-09-10T23:22:56.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.885+0000 7fd42cc00640 1 --2- 172.21.15.3:0/2793839503 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd4140b53e0 0x7fd4140b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:56.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.885+0000 7fd42cc00640 1 -- 172.21.15.3:0/2793839503 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7fd4200e5400 con 0x7fd4300754e0 2024-09-10T23:22:56.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.885+0000 7fd426a00640 1 --2- 172.21.15.3:0/2793839503 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd4140b53e0 0x7fd4140b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:56.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.886+0000 7fd426a00640 1 --2- 172.21.15.3:0/2793839503 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd4140b53e0 0x7fd4140b78a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd418000c00 tx=0x7fd418005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:56.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:56.889+0000 7fd42cc00640 1 -- 172.21.15.3:0/2793839503 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd4200ac5f0 con 0x7fd4300754e0 2024-09-10T23:22:56.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:56 smithi194 ceph-mon[33904]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:22:57.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:57.087+0000 7fd435000640 1 -- 172.21.15.3:0/2793839503 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd43002e5c0 con 0x7fd4300754e0 2024-09-10T23:22:57.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:57.088+0000 7fd42cc00640 1 -- 172.21.15.3:0/2793839503 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+18683 (secure 0 0 0) 0x7fd4200abef0 con 0x7fd4300754e0 2024-09-10T23:22:57.090 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:22:57.090 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":72,"fsid":"3f4e30d0-6fca-11ef-bcea-c7b262605968","created":"2024-09-10T23:14:12.377466+0000","modified":"2024-09-10T23:22:56.619437+0000","last_up_change":"2024-09-10T23:22:54.895554+0000","last_in_change":"2024-09-10T23:22:29.701108+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:18:27.131879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a38330ed-a85b-4e61-b373-dd8f1d5f7ba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6803","nonce":824467747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6805","nonce":824467747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6809","nonce":824467747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6807","nonce":824467747}]},"public_addr":"172.21.15.3:6803/824467747","cluster_addr":"172.21.15.3:6805/824467747","heartbeat_back_addr":"172.21.15.3:6809/824467747","heartbeat_front_addr":"172.21.15.3:6807/824467747","state":["exists","up"]},{"osd":1,"uuid":"49bb1212-a83e-4f85-ad71-d863880d8268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6801","nonce":1447444485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6803","nonce":1447444485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6807","nonce":1447444485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6805","nonce":1447444485}]},"public_addr":"172.21.15.38:6801/1447444485","cluster_addr":"172.21.15.38:6803/1447444485","heartbeat_back_addr":"172.21.15.38:6807/1447444485","heartbeat_front_addr":"172.21.15.38:6805/1447444485","state":["exists","up"]},{"osd":2,"uuid":"ea53eb27-e7fa-4783-9a53-8b44b4e293ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6801","nonce":3191263316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6803","nonce":3191263316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6807","nonce":3191263316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6805","nonce":3191263316}]},"public_addr":"172.21.15.194:6801/3191263316","cluster_addr":"172.21.15.194:6803/3191263316","heartbeat_back_addr":"172.21.15.194:6807/3191263316","heartbeat_front_addr":"172.21.15.194:6805/3191263316","state":["exists","up"]},{"osd":3,"uuid":"75067769-7be5-4a99-9e02-f7735b2e69c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6811","nonce":2061990952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6813","nonce":2061990952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6817","nonce":2061990952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6815","nonce":2061990952}]},"public_addr":"172.21.15.3:6811/2061990952","cluster_addr":"172.21.15.3:6813/2061990952","heartbeat_back_addr":"172.21.15.3:6817/2061990952","heartbeat_front_addr":"172.21.15.3:6815/2061990952","state":["exists","up"]},{"osd":4,"uuid":"872e90ca-b711-4206-b586-e7fa41122199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6809","nonce":413294160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6811","nonce":413294160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6815","nonce":413294160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6813","nonce":413294160}]},"public_addr":"172.21.15.38:6809/413294160","cluster_addr":"172.21.15.38:6811/413294160","heartbeat_back_addr":"172.21.15.38:6815/413294160","heartbeat_front_addr":"172.21.15.38:6813/413294160","state":["exists","up"]},{"osd":5,"uuid":"2cfa107c-6dae-4c26-9e29-8175b1237b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6809","nonce":4117812658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6811","nonce":4117812658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6815","nonce":4117812658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6813","nonce":4117812658}]},"public_addr":"172.21.15.194:6809/4117812658","cluster_addr":"172.21.15.194:6811/4117812658","heartbeat_back_addr":"172.21.15.194:6815/4117812658","heartbeat_front_addr":"172.21.15.194:6813/4117812658","state":["exists","up"]},{"osd":6,"uuid":"d2e4e309-c587-4725-a5b3-cbc7b1226750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6819","nonce":3470543721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6821","nonce":3470543721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6825","nonce":3470543721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6823","nonce":3470543721}]},"public_addr":"172.21.15.3:6819/3470543721","cluster_addr":"172.21.15.3:6821/3470543721","heartbeat_back_addr":"172.21.15.3:6825/3470543721","heartbeat_front_addr":"172.21.15.3:6823/3470543721","state":["exists","up"]},{"osd":7,"uuid":"46ecaec5-29da-4e1d-ac2f-42bbbd77e949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6817","nonce":2054203924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6819","nonce":2054203924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6823","nonce":2054203924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6821","nonce":2054203924}]},"public_addr":"172.21.15.38:6817/2054203924","cluster_addr":"172.21.15.38:6819/2054203924","heartbeat_back_addr":"172.21.15.38:6823/2054203924","heartbeat_front_addr":"172.21.15.38:6821/2054203924","state":["exists","up"]},{"osd":8,"uuid":"57fd8e43-9612-4f74-8eb2-8bdbbf7c0417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6817","nonce":170051722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6819","nonce":170051722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6823","nonce":170051722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6821","nonce":170051722}]},"public_addr":"172.21.15.194:6817/170051722","cluster_addr":"172.21.15.194:6819/170051722","heartbeat_back_addr":"172.21.15.194:6823/170051722","heartbeat_front_addr":"172.21.15.194:6821/170051722","state":["exists","up"]},{"osd":9,"uuid":"aeaaf23b-d2e2-4e30-9a49-de4aaba53900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6827","nonce":3967749600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6829","nonce":3967749600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6833","nonce":3967749600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6831","nonce":3967749600}]},"public_addr":"172.21.15.3:6827/3967749600","cluster_addr":"172.21.15.3:6829/3967749600","heartbeat_back_addr":"172.21.15.3:6833/3967749600","heartbeat_front_addr":"172.21.15.3:6831/3967749600","state":["exists","up"]},{"osd":10,"uuid":"b0ece81b-1c5b-40da-b579-fb99bacb005d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6825","nonce":1671957178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6827","nonce":1671957178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6831","nonce":1671957178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6829","nonce":1671957178}]},"public_addr":"172.21.15.38:6825/1671957178","cluster_addr":"172.21.15.38:6827/1671957178","heartbeat_back_addr":"172.21.15.38:6831/1671957178","heartbeat_front_addr":"172.21.15.38:6829/1671957178","state":["exists","up"]},{"osd":11,"uuid":"a0036526-54bf-4e8b-95cc-e7b75725961c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6825","nonce":1048859686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6827","nonce":1048859686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6831","nonce":1048859686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6829","nonce":1048859686}]},"public_addr":"172.21.15.194:6825/1048859686","cluster_addr":"172.21.15.194:6827/1048859686","heartbeat_back_addr":"172.21.15.194:6831/1048859686","heartbeat_front_addr":"172.21.15.194:6829/1048859686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:27.013354+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:56.609046+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:24.878988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:55.218204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:25.224770+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:54.614336+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:25.385483+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:55.317137+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:25.064825+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:54.655361+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:22:24.080027+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:22:52.886412+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.3:0/776988825":"2024-09-11T23:16:20.647314+0000","172.21.15.3:0/2965090335":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/2364823868":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/3186881356":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/911991463":"2024-09-11T23:16:20.647314+0000","172.21.15.3:6800/2582365069":"2024-09-11T23:14:37.169991+0000","172.21.15.3:6801/2582365069":"2024-09-11T23:14:37.169991+0000","172.21.15.3:6801/1528153492":"2024-09-11T23:15:05.835734+0000","172.21.15.3:6800/1924113958":"2024-09-11T23:16:20.647314+0000","172.21.15.3:0/554479543":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/4238683346":"2024-09-11T23:15:05.835734+0000","172.21.15.3:6800/1528153492":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/285471483":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/1249510760":"2024-09-11T23:16:20.647314+0000","172.21.15.3:6801/1924113958":"2024-09-11T23:16:20.647314+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:22:57.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:57.091+0000 7fd435000640 1 -- 172.21.15.3:0/2793839503 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd4140b53e0 msgr2=0x7fd4140b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:57.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:57.091+0000 7fd435000640 1 --2- 172.21.15.3:0/2793839503 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd4140b53e0 0x7fd4140b78a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd418000c00 tx=0x7fd418005a20 comp rx=0 tx=0).stop 2024-09-10T23:22:57.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:57.091+0000 7fd435000640 1 -- 172.21.15.3:0/2793839503 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4300754e0 msgr2=0x7fd43019b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:57.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:57.091+0000 7fd435000640 1 --2- 172.21.15.3:0/2793839503 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4300754e0 0x7fd43019b1e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd42000d770 tx=0x7fd42000dc30 comp rx=0 tx=0).stop 2024-09-10T23:22:57.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:57.091+0000 7fd435000640 1 -- 172.21.15.3:0/2793839503 shutdown_connections 2024-09-10T23:22:57.093 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:57.091+0000 7fd435000640 1 --2- 172.21.15.3:0/2793839503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd43010f200 0x7fd4301a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:57.093 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:57.091+0000 7fd435000640 1 --2- 172.21.15.3:0/2793839503 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd430075e00 0x7fd43019b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:57.093 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:57.091+0000 7fd435000640 1 --2- 172.21.15.3:0/2793839503 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd4140b53e0 0x7fd4140b78a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:57.093 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:57.091+0000 7fd435000640 1 --2- 172.21.15.3:0/2793839503 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4300754e0 0x7fd43019b1e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:57.093 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:57.091+0000 7fd435000640 1 -- 172.21.15.3:0/2793839503 >> 172.21.15.3:0/2793839503 conn(0x7fd4300fe6c0 msgr2=0x7fd4300ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:57.093 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:57.091+0000 7fd435000640 1 -- 172.21.15.3:0/2793839503 shutdown_connections 2024-09-10T23:22:57.093 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:57.091+0000 7fd435000640 1 -- 172.21.15.3:0/2793839503 wait complete. 2024-09-10T23:22:57.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:56 smithi038 ceph-mon[34225]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:22:57.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:57 smithi003 ceph-mon[30348]: osdmap e72: 12 total, 12 up, 12 in 2024-09-10T23:22:57.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:57 smithi003 ceph-mon[30348]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:22:57.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:57 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2793839503' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:22:57.790 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:18:27.131879+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T23:22:57.790 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-10T23:22:57.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:57 smithi194 ceph-mon[33904]: osdmap e72: 12 total, 12 up, 12 in 2024-09-10T23:22:57.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:57 smithi194 ceph-mon[33904]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:22:57.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:57 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2793839503' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:22:58.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:57 smithi038 ceph-mon[34225]: osdmap e72: 12 total, 12 up, 12 in 2024-09-10T23:22:58.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:57 smithi038 ceph-mon[34225]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:22:58.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:57 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2793839503' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:22:58.162 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:22:58.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.669+0000 7f9a55600640 1 -- 172.21.15.3:0/1781893697 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a5010a9d0 msgr2=0x7f9a5010ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:58.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.669+0000 7f9a55600640 1 --2- 172.21.15.3:0/1781893697 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a5010a9d0 0x7f9a5010ae10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9a38009900 tx=0x7f9a3802a3f0 comp rx=0 tx=0).stop 2024-09-10T23:22:58.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.669+0000 7f9a55600640 1 -- 172.21.15.3:0/1781893697 shutdown_connections 2024-09-10T23:22:58.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.669+0000 7f9a55600640 1 --2- 172.21.15.3:0/1781893697 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a5010b350 0x7f9a50111b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:58.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.669+0000 7f9a55600640 1 --2- 172.21.15.3:0/1781893697 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a5010a9d0 0x7f9a5010ae10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:58.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.669+0000 7f9a55600640 1 --2- 172.21.15.3:0/1781893697 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a50104fc0 0x7f9a501053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:58.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.669+0000 7f9a55600640 1 -- 172.21.15.3:0/1781893697 >> 172.21.15.3:0/1781893697 conn(0x7f9a501009f0 msgr2=0x7f9a50102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:58.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.669+0000 7f9a55600640 1 -- 172.21.15.3:0/1781893697 shutdown_connections 2024-09-10T23:22:58.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.669+0000 7f9a55600640 1 -- 172.21.15.3:0/1781893697 wait complete. 2024-09-10T23:22:58.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.670+0000 7f9a55600640 1 Processor -- start 2024-09-10T23:22:58.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.670+0000 7f9a55600640 1 -- start start 2024-09-10T23:22:58.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.671+0000 7f9a55600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a50104fc0 0x7f9a5019b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:58.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.671+0000 7f9a55600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a5010a9d0 0x7f9a5019b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:58.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.671+0000 7f9a55600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a5010b350 0x7f9a501a0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:58.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.671+0000 7f9a55600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9a50114e80 con 0x7f9a5010a9d0 2024-09-10T23:22:58.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.671+0000 7f9a55600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9a50114d00 con 0x7f9a5010b350 2024-09-10T23:22:58.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.671+0000 7f9a55600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9a50115000 con 0x7f9a50104fc0 2024-09-10T23:22:58.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.671+0000 7f9a4e000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a5010a9d0 0x7f9a5019b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:58.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.671+0000 7f9a4e000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a5010a9d0 0x7f9a5019b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56354/0 (socket says 172.21.15.3:56354) 2024-09-10T23:22:58.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.671+0000 7f9a4e000640 1 -- 172.21.15.3:0/2397114675 learned_addr learned my addr 172.21.15.3:0/2397114675 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:22:58.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.671+0000 7f9a4ea00640 1 --2- 172.21.15.3:0/2397114675 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a50104fc0 0x7f9a5019b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:58.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.671+0000 7f9a4f400640 1 --2- 172.21.15.3:0/2397114675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a5010b350 0x7f9a501a0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:58.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.672+0000 7f9a4e000640 1 -- 172.21.15.3:0/2397114675 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a50104fc0 msgr2=0x7f9a5019b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:58.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.672+0000 7f9a4e000640 1 --2- 172.21.15.3:0/2397114675 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a50104fc0 0x7f9a5019b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:58.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.672+0000 7f9a4e000640 1 -- 172.21.15.3:0/2397114675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a5010b350 msgr2=0x7f9a501a0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:58.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.672+0000 7f9a4e000640 1 --2- 172.21.15.3:0/2397114675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a5010b350 0x7f9a501a0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:58.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.672+0000 7f9a4e000640 1 -- 172.21.15.3:0/2397114675 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a501a14e0 con 0x7f9a5010a9d0 2024-09-10T23:22:58.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.672+0000 7f9a4e000640 1 --2- 172.21.15.3:0/2397114675 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a5010a9d0 0x7f9a5019b970 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9a38009a20 tx=0x7f9a38004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:58.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.672+0000 7f9a47400640 1 -- 172.21.15.3:0/2397114675 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a3803f030 con 0x7f9a5010a9d0 2024-09-10T23:22:58.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.672+0000 7f9a47400640 1 -- 172.21.15.3:0/2397114675 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a380035f0 con 0x7f9a5010a9d0 2024-09-10T23:22:58.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.672+0000 7f9a47400640 1 -- 172.21.15.3:0/2397114675 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a38035070 con 0x7f9a5010a9d0 2024-09-10T23:22:58.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.673+0000 7f9a55600640 1 -- 172.21.15.3:0/2397114675 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a501a1770 con 0x7f9a5010a9d0 2024-09-10T23:22:58.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.673+0000 7f9a55600640 1 -- 172.21.15.3:0/2397114675 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a501a7e90 con 0x7f9a5010a9d0 2024-09-10T23:22:58.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.674+0000 7f9a55600640 1 -- 172.21.15.3:0/2397114675 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a501053a0 con 0x7f9a5010a9d0 2024-09-10T23:22:58.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.676+0000 7f9a47400640 1 -- 172.21.15.3:0/2397114675 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7f9a38031c80 con 0x7f9a5010a9d0 2024-09-10T23:22:58.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.677+0000 7f9a47400640 1 --2- 172.21.15.3:0/2397114675 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f9a340b5330 0x7f9a340b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:58.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.677+0000 7f9a47400640 1 -- 172.21.15.3:0/2397114675 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f9a381067e0 con 0x7f9a5010a9d0 2024-09-10T23:22:58.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.678+0000 7f9a4ea00640 1 --2- 172.21.15.3:0/2397114675 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f9a340b5330 0x7f9a340b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:58.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.678+0000 7f9a4ea00640 1 --2- 172.21.15.3:0/2397114675 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f9a340b5330 0x7f9a340b77f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000abe0 tx=0x7f9a4000a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:58.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.679+0000 7f9a47400640 1 -- 172.21.15.3:0/2397114675 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9a380cd9d0 con 0x7f9a5010a9d0 2024-09-10T23:22:58.873 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.872+0000 7f9a55600640 1 -- 172.21.15.3:0/2397114675 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9a5010d130 con 0x7f9a5010a9d0 2024-09-10T23:22:58.874 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.873+0000 7f9a47400640 1 -- 172.21.15.3:0/2397114675 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) ==== 93+0+10 (secure 0 0 0) 0x7f9a380cd2d0 con 0x7f9a5010a9d0 2024-09-10T23:22:58.874 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2024-09-10T23:22:58.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.875+0000 7f9a55600640 1 -- 172.21.15.3:0/2397114675 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f9a340b5330 msgr2=0x7f9a340b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:58.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.875+0000 7f9a55600640 1 --2- 172.21.15.3:0/2397114675 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f9a340b5330 0x7f9a340b77f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000abe0 tx=0x7f9a4000a2d0 comp rx=0 tx=0).stop 2024-09-10T23:22:58.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.875+0000 7f9a55600640 1 -- 172.21.15.3:0/2397114675 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a5010a9d0 msgr2=0x7f9a5019b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:58.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.875+0000 7f9a55600640 1 --2- 172.21.15.3:0/2397114675 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a5010a9d0 0x7f9a5019b970 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9a38009a20 tx=0x7f9a38004270 comp rx=0 tx=0).stop 2024-09-10T23:22:58.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.875+0000 7f9a55600640 1 -- 172.21.15.3:0/2397114675 shutdown_connections 2024-09-10T23:22:58.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.875+0000 7f9a55600640 1 --2- 172.21.15.3:0/2397114675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a5010b350 0x7f9a501a0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:58.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.876+0000 7f9a55600640 1 --2- 172.21.15.3:0/2397114675 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f9a340b5330 0x7f9a340b77f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:58.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.876+0000 7f9a55600640 1 --2- 172.21.15.3:0/2397114675 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a5010a9d0 0x7f9a5019b970 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:58.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.876+0000 7f9a55600640 1 --2- 172.21.15.3:0/2397114675 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a50104fc0 0x7f9a5019b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:58.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.876+0000 7f9a55600640 1 -- 172.21.15.3:0/2397114675 >> 172.21.15.3:0/2397114675 conn(0x7f9a501009f0 msgr2=0x7f9a50102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:58.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.876+0000 7f9a55600640 1 -- 172.21.15.3:0/2397114675 shutdown_connections 2024-09-10T23:22:58.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:22:58.876+0000 7f9a55600640 1 -- 172.21.15.3:0/2397114675 wait complete. 2024-09-10T23:22:59.572 INFO:tasks.cephadm:Adding mds.a on smithi003 2024-09-10T23:22:59.572 INFO:tasks.cephadm:Adding mds.d on smithi003 2024-09-10T23:22:59.573 INFO:tasks.cephadm:Adding mds.g on smithi003 2024-09-10T23:22:59.573 INFO:tasks.cephadm:Adding mds.j on smithi003 2024-09-10T23:22:59.573 INFO:tasks.cephadm:Adding mds.b on smithi038 2024-09-10T23:22:59.573 INFO:tasks.cephadm:Adding mds.e on smithi038 2024-09-10T23:22:59.573 INFO:tasks.cephadm:Adding mds.h on smithi038 2024-09-10T23:22:59.573 INFO:tasks.cephadm:Adding mds.k on smithi038 2024-09-10T23:22:59.573 INFO:tasks.cephadm:Adding mds.c on smithi194 2024-09-10T23:22:59.573 INFO:tasks.cephadm:Adding mds.f on smithi194 2024-09-10T23:22:59.573 INFO:tasks.cephadm:Adding mds.i on smithi194 2024-09-10T23:22:59.573 INFO:tasks.cephadm:Adding mds.l on smithi194 2024-09-10T23:22:59.573 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi003=a;smithi003=d;smithi003=g;smithi003=j;smithi038=b;smithi038=e;smithi038=h;smithi038=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l' 2024-09-10T23:22:59.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:59 smithi194 ceph-mon[33904]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:22:59.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:22:59 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2397114675' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T23:22:59.957 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:23:00.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:59 smithi038 ceph-mon[34225]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:00.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:22:59 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2397114675' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T23:23:00.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:59 smithi003 ceph-mon[30348]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:00.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:22:59 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2397114675' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T23:23:00.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.497+0000 7f0f4e800640 1 -- 172.21.15.194:0/2013656004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f48075540 msgr2=0x7f0f48075920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:00.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.497+0000 7f0f4e800640 1 --2- 172.21.15.194:0/2013656004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f48075540 0x7f0f48075920 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0f38009900 tx=0x7f0f3802a410 comp rx=0 tx=0).stop 2024-09-10T23:23:00.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.497+0000 7f0f4e800640 1 -- 172.21.15.194:0/2013656004 shutdown_connections 2024-09-10T23:23:00.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.497+0000 7f0f4e800640 1 --2- 172.21.15.194:0/2013656004 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f48113b20 0x7f0f48115f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:00.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.497+0000 7f0f4e800640 1 --2- 172.21.15.194:0/2013656004 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f48075e60 0x7f0f481135e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:00.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.497+0000 7f0f4e800640 1 --2- 172.21.15.194:0/2013656004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f48075540 0x7f0f48075920 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:00.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.497+0000 7f0f4e800640 1 -- 172.21.15.194:0/2013656004 >> 172.21.15.194:0/2013656004 conn(0x7f0f480fe830 msgr2=0x7f0f48100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:00.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.497+0000 7f0f4e800640 1 -- 172.21.15.194:0/2013656004 shutdown_connections 2024-09-10T23:23:00.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.497+0000 7f0f4e800640 1 -- 172.21.15.194:0/2013656004 wait complete. 2024-09-10T23:23:00.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.498+0000 7f0f4e800640 1 Processor -- start 2024-09-10T23:23:00.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.498+0000 7f0f4e800640 1 -- start start 2024-09-10T23:23:00.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.498+0000 7f0f4e800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f48075540 0x7f0f4819f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:00.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.498+0000 7f0f4e800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f48075e60 0x7f0f4819fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:00.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.498+0000 7f0f4e800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f48113b20 0x7f0f481a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:00.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.498+0000 7f0f4e800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0f48119270 con 0x7f0f48113b20 2024-09-10T23:23:00.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.498+0000 7f0f4e800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0f481190f0 con 0x7f0f48075540 2024-09-10T23:23:00.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.499+0000 7f0f4e800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0f481193f0 con 0x7f0f48075e60 2024-09-10T23:23:00.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.499+0000 7f0f46a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f48075e60 0x7f0f4819fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:00.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.499+0000 7f0f46a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f48075e60 0x7f0f4819fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:36978/0 (socket says 172.21.15.194:36978) 2024-09-10T23:23:00.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.499+0000 7f0f46a00640 1 -- 172.21.15.194:0/2916934105 learned_addr learned my addr 172.21.15.194:0/2916934105 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-10T23:23:00.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.499+0000 7f0f47400640 1 --2- 172.21.15.194:0/2916934105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f48075540 0x7f0f4819f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:00.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.499+0000 7f0f47e00640 1 --2- 172.21.15.194:0/2916934105 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f48113b20 0x7f0f481a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:00.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.499+0000 7f0f46a00640 1 -- 172.21.15.194:0/2916934105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f48075540 msgr2=0x7f0f4819f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:00.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.499+0000 7f0f46a00640 1 --2- 172.21.15.194:0/2916934105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f48075540 0x7f0f4819f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:00.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.499+0000 7f0f46a00640 1 -- 172.21.15.194:0/2916934105 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f48113b20 msgr2=0x7f0f481a51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:00.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.499+0000 7f0f46a00640 1 --2- 172.21.15.194:0/2916934105 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f48113b20 0x7f0f481a51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:00.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.499+0000 7f0f46a00640 1 -- 172.21.15.194:0/2916934105 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f481a5970 con 0x7f0f48075e60 2024-09-10T23:23:00.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.500+0000 7f0f46a00640 1 --2- 172.21.15.194:0/2916934105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f48075e60 0x7f0f4819fe00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0f3400d770 tx=0x7f0f3400dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:00.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.500+0000 7f0f3fe00640 1 -- 172.21.15.194:0/2916934105 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f34017070 con 0x7f0f48075e60 2024-09-10T23:23:00.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.500+0000 7f0f4e800640 1 -- 172.21.15.194:0/2916934105 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f481a5c60 con 0x7f0f48075e60 2024-09-10T23:23:00.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.500+0000 7f0f3fe00640 1 -- 172.21.15.194:0/2916934105 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0f340054b0 con 0x7f0f48075e60 2024-09-10T23:23:00.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.500+0000 7f0f3fe00640 1 -- 172.21.15.194:0/2916934105 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f34020060 con 0x7f0f48075e60 2024-09-10T23:23:00.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.500+0000 7f0f4e800640 1 -- 172.21.15.194:0/2916934105 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f481ac320 con 0x7f0f48075e60 2024-09-10T23:23:00.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.501+0000 7f0f4e800640 1 -- 172.21.15.194:0/2916934105 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f48075920 con 0x7f0f48075e60 2024-09-10T23:23:00.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.503+0000 7f0f3fe00640 1 -- 172.21.15.194:0/2916934105 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7f0f34004c00 con 0x7f0f48075e60 2024-09-10T23:23:00.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.505+0000 7f0f3fe00640 1 --2- 172.21.15.194:0/2916934105 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0f2c0b5330 0x7f0f2c0b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:00.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.505+0000 7f0f3fe00640 1 -- 172.21.15.194:0/2916934105 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f0f340e5930 con 0x7f0f48075e60 2024-09-10T23:23:00.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.505+0000 7f0f47400640 1 --2- 172.21.15.194:0/2916934105 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0f2c0b5330 0x7f0f2c0b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:00.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.506+0000 7f0f47400640 1 --2- 172.21.15.194:0/2916934105 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0f2c0b5330 0x7f0f2c0b77f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0f380057c0 tx=0x7f0f380058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:00.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.506+0000 7f0f3fe00640 1 -- 172.21.15.194:0/2916934105 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0f340ac4d0 con 0x7f0f48075e60 2024-09-10T23:23:00.700 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.700+0000 7f0f4e800640 1 -- 172.21.15.194:0/2916934105 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi003=a;smithi003=d;smithi003=g;smithi003=j;smithi038=b;smithi038=e;smithi038=h;smithi038=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l", "target": ["mon-mgr", ""]}) -- 0x7f0f48063590 con 0x7f0f2c0b5330 2024-09-10T23:23:00.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.710+0000 7f0f3fe00640 1 -- 172.21.15.194:0/2916934105 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f0f48063590 con 0x7f0f2c0b5330 2024-09-10T23:23:00.711 INFO:teuthology.orchestra.run.smithi194.stdout:Scheduled mds.all update... 2024-09-10T23:23:00.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.713+0000 7f0f4e800640 1 -- 172.21.15.194:0/2916934105 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0f2c0b5330 msgr2=0x7f0f2c0b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:00.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.713+0000 7f0f4e800640 1 --2- 172.21.15.194:0/2916934105 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0f2c0b5330 0x7f0f2c0b77f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0f380057c0 tx=0x7f0f380058d0 comp rx=0 tx=0).stop 2024-09-10T23:23:00.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.713+0000 7f0f4e800640 1 -- 172.21.15.194:0/2916934105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f48075e60 msgr2=0x7f0f4819fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:00.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.713+0000 7f0f4e800640 1 --2- 172.21.15.194:0/2916934105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f48075e60 0x7f0f4819fe00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0f3400d770 tx=0x7f0f3400dc30 comp rx=0 tx=0).stop 2024-09-10T23:23:00.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.713+0000 7f0f4e800640 1 -- 172.21.15.194:0/2916934105 shutdown_connections 2024-09-10T23:23:00.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.713+0000 7f0f4e800640 1 --2- 172.21.15.194:0/2916934105 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0f2c0b5330 0x7f0f2c0b77f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:00.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.713+0000 7f0f4e800640 1 --2- 172.21.15.194:0/2916934105 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f48113b20 0x7f0f481a51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:00.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.713+0000 7f0f4e800640 1 --2- 172.21.15.194:0/2916934105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f48075e60 0x7f0f4819fe00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:00.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.713+0000 7f0f4e800640 1 --2- 172.21.15.194:0/2916934105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f48075540 0x7f0f4819f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:00.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.713+0000 7f0f4e800640 1 -- 172.21.15.194:0/2916934105 >> 172.21.15.194:0/2916934105 conn(0x7f0f480fe830 msgr2=0x7f0f480ff490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:00.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.713+0000 7f0f4e800640 1 -- 172.21.15.194:0/2916934105 shutdown_connections 2024-09-10T23:23:00.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-10T23:23:00.713+0000 7f0f4e800640 1 -- 172.21.15.194:0/2916934105 wait complete. 2024-09-10T23:23:01.507 DEBUG:teuthology.orchestra.run.smithi003:mds.a> sudo journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.a.service 2024-09-10T23:23:01.513 DEBUG:teuthology.orchestra.run.smithi003:mds.d> sudo journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.d.service 2024-09-10T23:23:01.561 DEBUG:teuthology.orchestra.run.smithi003:mds.g> sudo journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.g.service 2024-09-10T23:23:01.606 DEBUG:teuthology.orchestra.run.smithi003:mds.j> sudo journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.j.service 2024-09-10T23:23:01.652 DEBUG:teuthology.orchestra.run.smithi038:mds.b> sudo journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.b.service 2024-09-10T23:23:01.657 DEBUG:teuthology.orchestra.run.smithi038:mds.e> sudo journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.e.service 2024-09-10T23:23:01.703 DEBUG:teuthology.orchestra.run.smithi038:mds.h> sudo journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.h.service 2024-09-10T23:23:01.750 DEBUG:teuthology.orchestra.run.smithi038:mds.k> sudo journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.k.service 2024-09-10T23:23:01.794 DEBUG:teuthology.orchestra.run.smithi194:mds.c> sudo journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.c.service 2024-09-10T23:23:01.799 DEBUG:teuthology.orchestra.run.smithi194:mds.f> sudo journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.f.service 2024-09-10T23:23:01.843 DEBUG:teuthology.orchestra.run.smithi194:mds.i> sudo journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.i.service 2024-09-10T23:23:01.888 DEBUG:teuthology.orchestra.run.smithi194:mds.l> sudo journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.l.service 2024-09-10T23:23:01.933 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-10T23:23:01.933 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:23:01.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:01 smithi003 ceph-mon[30348]: from='client.24580 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi003=a;smithi003=d;smithi003=g;smithi003=j;smithi038=b;smithi038=e;smithi038=h;smithi038=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:23:01.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:01 smithi003 ceph-mon[30348]: Saving service mds.all spec with placement smithi003=a;smithi003=d;smithi003=g;smithi003=j;smithi038=b;smithi038=e;smithi038=h;smithi038=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l;count:12 2024-09-10T23:23:01.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:01 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:01.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:01 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:23:01.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:01 smithi003 ceph-mon[30348]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:01.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:01 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:01.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:01 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:23:01.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:01 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:01.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:01 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:01.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:01 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:01.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:01 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:01.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:01 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:01.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:01 smithi003 ceph-mon[30348]: Deploying daemon mds.l on smithi194 2024-09-10T23:23:01.981 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:01 smithi194 ceph-mon[33904]: from='client.24580 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi003=a;smithi003=d;smithi003=g;smithi003=j;smithi038=b;smithi038=e;smithi038=h;smithi038=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:23:01.982 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:01 smithi194 ceph-mon[33904]: Saving service mds.all spec with placement smithi003=a;smithi003=d;smithi003=g;smithi003=j;smithi038=b;smithi038=e;smithi038=h;smithi038=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l;count:12 2024-09-10T23:23:01.982 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:01 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:01.982 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:01 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:23:01.982 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:01 smithi194 ceph-mon[33904]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:01.982 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:01 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:01.982 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:01 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:23:01.982 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:01 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:01.982 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:01 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:01.982 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:01 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:01.983 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:01 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:01.983 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:01 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:01.983 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:01 smithi194 ceph-mon[33904]: Deploying daemon mds.l on smithi194 2024-09-10T23:23:02.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:01 smithi038 ceph-mon[34225]: from='client.24580 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi003=a;smithi003=d;smithi003=g;smithi003=j;smithi038=b;smithi038=e;smithi038=h;smithi038=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:23:02.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:01 smithi038 ceph-mon[34225]: Saving service mds.all spec with placement smithi003=a;smithi003=d;smithi003=g;smithi003=j;smithi038=b;smithi038=e;smithi038=h;smithi038=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l;count:12 2024-09-10T23:23:02.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:01 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:02.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:01 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:23:02.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:01 smithi038 ceph-mon[34225]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:02.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:01 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:02.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:01 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:23:02.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:01 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:02.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:01 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:02.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:01 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:02.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:01 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:02.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:01 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:02.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:01 smithi038 ceph-mon[34225]: Deploying daemon mds.l on smithi194 2024-09-10T23:23:02.306 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:02.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.884+0000 7f2916200640 1 -- 172.21.15.3:0/760698827 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2910102c10 msgr2=0x7f2910102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:02.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.884+0000 7f2916200640 1 --2- 172.21.15.3:0/760698827 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2910102c10 0x7f2910102ff0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2900009900 tx=0x7f290002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:23:02.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.884+0000 7f2916200640 1 -- 172.21.15.3:0/760698827 shutdown_connections 2024-09-10T23:23:02.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.884+0000 7f2916200640 1 --2- 172.21.15.3:0/760698827 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2910108fa0 0x7f291010f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:02.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.884+0000 7f2916200640 1 --2- 172.21.15.3:0/760698827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2910108620 0x7f2910108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:02.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.884+0000 7f2916200640 1 --2- 172.21.15.3:0/760698827 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2910102c10 0x7f2910102ff0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:02.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.884+0000 7f2916200640 1 -- 172.21.15.3:0/760698827 >> 172.21.15.3:0/760698827 conn(0x7f29100fe660 msgr2=0x7f2910100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:02.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.884+0000 7f2916200640 1 -- 172.21.15.3:0/760698827 shutdown_connections 2024-09-10T23:23:02.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.884+0000 7f2916200640 1 -- 172.21.15.3:0/760698827 wait complete. 2024-09-10T23:23:02.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.885+0000 7f2916200640 1 Processor -- start 2024-09-10T23:23:02.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.885+0000 7f2916200640 1 -- start start 2024-09-10T23:23:02.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.886+0000 7f2916200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2910102c10 0x7f2910198f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:02.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.886+0000 7f2916200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2910108620 0x7f29101994d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:02.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.886+0000 7f2916200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2910108fa0 0x7f291019e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:02.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.886+0000 7f2916200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2910112b60 con 0x7f2910108fa0 2024-09-10T23:23:02.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.886+0000 7f2916200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f29101129e0 con 0x7f2910102c10 2024-09-10T23:23:02.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.886+0000 7f2916200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2910112ce0 con 0x7f2910108620 2024-09-10T23:23:02.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.886+0000 7f2914e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2910102c10 0x7f2910198f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:02.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.886+0000 7f2915800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2910108fa0 0x7f291019e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:02.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.886+0000 7f2914e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2910102c10 0x7f2910198f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.3:34168/0 (socket says 172.21.15.3:34168) 2024-09-10T23:23:02.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.886+0000 7f2914e00640 1 -- 172.21.15.3:0/3201237198 learned_addr learned my addr 172.21.15.3:0/3201237198 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:23:02.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.886+0000 7f2907e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2910108620 0x7f29101994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:02.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.887+0000 7f2914e00640 1 -- 172.21.15.3:0/3201237198 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2910108620 msgr2=0x7f29101994d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:02.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.887+0000 7f2914e00640 1 --2- 172.21.15.3:0/3201237198 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2910108620 0x7f29101994d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:02.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.887+0000 7f2914e00640 1 -- 172.21.15.3:0/3201237198 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2910108fa0 msgr2=0x7f291019e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:02.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.887+0000 7f2914e00640 1 --2- 172.21.15.3:0/3201237198 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2910108fa0 0x7f291019e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:02.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.887+0000 7f2914e00640 1 -- 172.21.15.3:0/3201237198 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f291019f040 con 0x7f2910102c10 2024-09-10T23:23:02.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.887+0000 7f2915800640 1 --2- 172.21.15.3:0/3201237198 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2910108fa0 0x7f291019e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:23:02.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.887+0000 7f2907e00640 1 --2- 172.21.15.3:0/3201237198 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2910108620 0x7f29101994d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:23:02.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.887+0000 7f2914e00640 1 --2- 172.21.15.3:0/3201237198 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2910102c10 0x7f2910198f90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f290002a910 tx=0x7f2900003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:02.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.887+0000 7f290e000640 1 -- 172.21.15.3:0/3201237198 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290003f070 con 0x7f2910102c10 2024-09-10T23:23:02.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.887+0000 7f2916200640 1 -- 172.21.15.3:0/3201237198 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f291019f2d0 con 0x7f2910102c10 2024-09-10T23:23:02.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.887+0000 7f290e000640 1 -- 172.21.15.3:0/3201237198 <== mon.2 v2:172.21.15.38:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f290003baf0 con 0x7f2910102c10 2024-09-10T23:23:02.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.887+0000 7f290e000640 1 -- 172.21.15.3:0/3201237198 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2900035030 con 0x7f2910102c10 2024-09-10T23:23:02.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.888+0000 7f2916200640 1 -- 172.21.15.3:0/3201237198 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29101a59f0 con 0x7f2910102c10 2024-09-10T23:23:02.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.889+0000 7f2916200640 1 -- 172.21.15.3:0/3201237198 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2910102ff0 con 0x7f2910102c10 2024-09-10T23:23:02.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.891+0000 7f290e000640 1 -- 172.21.15.3:0/3201237198 <== mon.2 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7f290003b660 con 0x7f2910102c10 2024-09-10T23:23:02.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.893+0000 7f290e000640 1 --2- 172.21.15.3:0/3201237198 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f28f40b53e0 0x7f28f40b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:02.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.893+0000 7f290e000640 1 -- 172.21.15.3:0/3201237198 <== mon.2 v2:172.21.15.38:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f2900106260 con 0x7f2910102c10 2024-09-10T23:23:02.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.893+0000 7f2907e00640 1 --2- 172.21.15.3:0/3201237198 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f28f40b53e0 0x7f28f40b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:02.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.893+0000 7f2907e00640 1 --2- 172.21.15.3:0/3201237198 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f28f40b53e0 0x7f28f40b78a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2910101ea0 tx=0x7f28f800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:02.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:02.897+0000 7f290e000640 1 -- 172.21.15.3:0/3201237198 <== mon.2 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f29000cce00 con 0x7f2910102c10 2024-09-10T23:23:03.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:03.132+0000 7f2916200640 1 -- 172.21.15.3:0/3201237198 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f291010a7f0 con 0x7f2910102c10 2024-09-10T23:23:03.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:03.132+0000 7f290e000640 1 -- 172.21.15.3:0/3201237198 <== mon.2 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f29000d1830 con 0x7f2910102c10 2024-09-10T23:23:03.134 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:23:03.134 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":1,"btime":"2024-09-10T23:14:12:377215+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-10T23:23:03.134 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 1 2024-09-10T23:23:03.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:03.135+0000 7f2916200640 1 -- 172.21.15.3:0/3201237198 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f28f40b53e0 msgr2=0x7f28f40b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:03.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:03.135+0000 7f2916200640 1 --2- 172.21.15.3:0/3201237198 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f28f40b53e0 0x7f28f40b78a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2910101ea0 tx=0x7f28f800b390 comp rx=0 tx=0).stop 2024-09-10T23:23:03.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:03.135+0000 7f2916200640 1 -- 172.21.15.3:0/3201237198 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2910102c10 msgr2=0x7f2910198f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:03.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:03.135+0000 7f2916200640 1 --2- 172.21.15.3:0/3201237198 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2910102c10 0x7f2910198f90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f290002a910 tx=0x7f2900003b90 comp rx=0 tx=0).stop 2024-09-10T23:23:03.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:03.135+0000 7f2916200640 1 -- 172.21.15.3:0/3201237198 shutdown_connections 2024-09-10T23:23:03.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:03.135+0000 7f2916200640 1 --2- 172.21.15.3:0/3201237198 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f28f40b53e0 0x7f28f40b78a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:03.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:03.135+0000 7f2916200640 1 --2- 172.21.15.3:0/3201237198 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2910108fa0 0x7f291019e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:03.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:03.135+0000 7f2916200640 1 --2- 172.21.15.3:0/3201237198 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2910108620 0x7f29101994d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:03.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:03.135+0000 7f2916200640 1 --2- 172.21.15.3:0/3201237198 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2910102c10 0x7f2910198f90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:03.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:03.135+0000 7f2916200640 1 -- 172.21.15.3:0/3201237198 >> 172.21.15.3:0/3201237198 conn(0x7f29100fe660 msgr2=0x7f2910100a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:03.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:03.135+0000 7f2916200640 1 -- 172.21.15.3:0/3201237198 shutdown_connections 2024-09-10T23:23:03.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:03.136+0000 7f2916200640 1 -- 172.21.15.3:0/3201237198 wait complete. 2024-09-10T23:23:03.841 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:03 smithi194 ceph-mon[33904]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:03.841 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:03 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3201237198' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:04.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:03 smithi038 ceph-mon[34225]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:04.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:03 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3201237198' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:04.152 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 10 23:23:03 smithi194 systemd[1]: Starting Ceph mds.l for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:23:04.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:03 smithi003 ceph-mon[30348]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:04.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:03 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3201237198' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:04.447 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 10 23:23:04 smithi194 podman[65427]: 2024-09-10 23:23:04.056335684 +0000 UTC m=+0.026658448 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:23:04.448 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 10 23:23:04 smithi194 podman[65427]: 2024-09-10 23:23:04.158259376 +0000 UTC m=+0.128582132 container create 8e7fa99ead2b245ab7655699ffcae8f24727a6cb345ceb2422a7b0ede11ea232 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-l, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-10T23:23:04.947 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 10 23:23:04 smithi194 podman[65427]: 2024-09-10 23:23:04.502793486 +0000 UTC m=+0.473116265 container init 8e7fa99ead2b245ab7655699ffcae8f24727a6cb345ceb2422a7b0ede11ea232 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-l, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-10T23:23:04.948 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 10 23:23:04 smithi194 podman[65427]: 2024-09-10 23:23:04.508870717 +0000 UTC m=+0.479193473 container start 8e7fa99ead2b245ab7655699ffcae8f24727a6cb345ceb2422a7b0ede11ea232 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-l, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-10T23:23:04.948 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 10 23:23:04 smithi194 ceph-mds[65446]: -- 172.21.15.194:0/4042801674 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557255355860 con 0x557255333400 2024-09-10T23:23:04.948 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 10 23:23:04 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-l[65442]: starting mds.l at 2024-09-10T23:23:04.948 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 10 23:23:04 smithi194 bash[65427]: 8e7fa99ead2b245ab7655699ffcae8f24727a6cb345ceb2422a7b0ede11ea232 2024-09-10T23:23:04.948 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 10 23:23:04 smithi194 systemd[1]: Started Ceph mds.l for 3f4e30d0-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:23:05.576 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:05 smithi038 ceph-mon[34225]: mds.? [v2:172.21.15.194:6832/352514665,v1:172.21.15.194:6833/352514665] up:boot 2024-09-10T23:23:05.576 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:05 smithi038 ceph-mon[34225]: fsmap 1 up:standby 2024-09-10T23:23:05.576 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:05 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T23:23:05.576 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:05 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:05.576 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:05 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:05.576 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:05 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:05.577 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:05 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:05.577 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:05 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:05.577 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:05 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:05.577 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:05 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:05.782 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:23:05.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:05 smithi003 ceph-mon[30348]: mds.? [v2:172.21.15.194:6832/352514665,v1:172.21.15.194:6833/352514665] up:boot 2024-09-10T23:23:05.836 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:05 smithi003 ceph-mon[30348]: fsmap 1 up:standby 2024-09-10T23:23:05.836 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:05 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T23:23:05.836 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:05 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:05.836 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:05 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:05.836 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:05 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:05.836 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:05 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:05.836 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:05 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:05.836 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:05 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:05.836 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:05 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:05.917 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:05 smithi194 ceph-mon[33904]: mds.? [v2:172.21.15.194:6832/352514665,v1:172.21.15.194:6833/352514665] up:boot 2024-09-10T23:23:05.917 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:05 smithi194 ceph-mon[33904]: fsmap 1 up:standby 2024-09-10T23:23:05.917 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:05 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T23:23:05.917 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:05 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:05.917 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:05 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:05.917 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:05 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:05.917 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:05 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:05.917 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:05 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:05.917 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:05 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:05.917 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:05 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:06.165 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:06.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.751+0000 7f7912a00640 1 -- 172.21.15.3:0/1558230239 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f790c104fa0 msgr2=0x7f790c105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:06.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.751+0000 7f7912a00640 1 --2- 172.21.15.3:0/1558230239 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f790c104fa0 0x7f790c105380 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f78fc009900 tx=0x7f78fc02a410 comp rx=0 tx=0).stop 2024-09-10T23:23:06.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.752+0000 7f7912a00640 1 -- 172.21.15.3:0/1558230239 shutdown_connections 2024-09-10T23:23:06.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.752+0000 7f7912a00640 1 --2- 172.21.15.3:0/1558230239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f790c10b330 0x7f790c111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:06.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.752+0000 7f7912a00640 1 --2- 172.21.15.3:0/1558230239 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f790c10a9b0 0x7f790c10adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:06.754 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.752+0000 7f7912a00640 1 --2- 172.21.15.3:0/1558230239 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f790c104fa0 0x7f790c105380 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:06.754 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.752+0000 7f7912a00640 1 -- 172.21.15.3:0/1558230239 >> 172.21.15.3:0/1558230239 conn(0x7f790c100a50 msgr2=0x7f790c102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:06.754 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.752+0000 7f7912a00640 1 -- 172.21.15.3:0/1558230239 shutdown_connections 2024-09-10T23:23:06.754 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.752+0000 7f7912a00640 1 -- 172.21.15.3:0/1558230239 wait complete. 2024-09-10T23:23:06.755 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.753+0000 7f7912a00640 1 Processor -- start 2024-09-10T23:23:06.755 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.753+0000 7f7912a00640 1 -- start start 2024-09-10T23:23:06.755 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.753+0000 7f7912a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f790c104fa0 0x7f790c19b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:06.755 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.753+0000 7f7912a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f790c10a9b0 0x7f790c19b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:06.756 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.753+0000 7f7912a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f790c10b330 0x7f790c1a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:06.756 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.753+0000 7f7912a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f790c114e60 con 0x7f790c10b330 2024-09-10T23:23:06.756 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.753+0000 7f7912a00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f790c114ce0 con 0x7f790c10a9b0 2024-09-10T23:23:06.756 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.753+0000 7f7912a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f790c114fe0 con 0x7f790c104fa0 2024-09-10T23:23:06.756 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.754+0000 7f7910a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f790c10b330 0x7f790c1a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:06.756 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.754+0000 7f7903e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f790c10a9b0 0x7f790c19b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:06.756 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.754+0000 7f7910a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f790c10b330 0x7f790c1a0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34660/0 (socket says 172.21.15.3:34660) 2024-09-10T23:23:06.756 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.754+0000 7f7910a00640 1 -- 172.21.15.3:0/1035044366 learned_addr learned my addr 172.21.15.3:0/1035044366 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:23:06.756 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.754+0000 7f790be00640 1 --2- 172.21.15.3:0/1035044366 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f790c104fa0 0x7f790c19b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:06.756 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.754+0000 7f7903e00640 1 -- 172.21.15.3:0/1035044366 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f790c104fa0 msgr2=0x7f790c19b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:06.756 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.754+0000 7f7903e00640 1 --2- 172.21.15.3:0/1035044366 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f790c104fa0 0x7f790c19b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:06.756 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.754+0000 7f7903e00640 1 -- 172.21.15.3:0/1035044366 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f790c10b330 msgr2=0x7f790c1a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:06.757 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.754+0000 7f7903e00640 1 --2- 172.21.15.3:0/1035044366 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f790c10b330 0x7f790c1a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:06.757 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.754+0000 7f7903e00640 1 -- 172.21.15.3:0/1035044366 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f790c1a1520 con 0x7f790c10a9b0 2024-09-10T23:23:06.757 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.754+0000 7f7910a00640 1 --2- 172.21.15.3:0/1035044366 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f790c10b330 0x7f790c1a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:23:06.757 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.754+0000 7f7903e00640 1 --2- 172.21.15.3:0/1035044366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f790c10a9b0 0x7f790c19b9b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f78f4005fd0 tx=0x7f78f400dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:06.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.755+0000 7f7909600640 1 -- 172.21.15.3:0/1035044366 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f4009c30 con 0x7f790c10a9b0 2024-09-10T23:23:06.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.755+0000 7f7909600640 1 -- 172.21.15.3:0/1035044366 <== mon.2 v2:172.21.15.38:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f78f40044c0 con 0x7f790c10a9b0 2024-09-10T23:23:06.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.755+0000 7f7912a00640 1 -- 172.21.15.3:0/1035044366 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f790c1a1810 con 0x7f790c10a9b0 2024-09-10T23:23:06.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.755+0000 7f7909600640 1 -- 172.21.15.3:0/1035044366 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f4003db0 con 0x7f790c10a9b0 2024-09-10T23:23:06.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.755+0000 7f7912a00640 1 -- 172.21.15.3:0/1035044366 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f790c1a7ed0 con 0x7f790c10a9b0 2024-09-10T23:23:06.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.756+0000 7f7912a00640 1 -- 172.21.15.3:0/1035044366 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f790c105380 con 0x7f790c10a9b0 2024-09-10T23:23:06.759 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.758+0000 7f7909600640 1 -- 172.21.15.3:0/1035044366 <== mon.2 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7f78f4003f50 con 0x7f790c10a9b0 2024-09-10T23:23:06.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.760+0000 7f7909600640 1 --2- 172.21.15.3:0/1035044366 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f78f00b5330 0x7f78f00b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:06.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.760+0000 7f7909600640 1 -- 172.21.15.3:0/1035044366 <== mon.2 v2:172.21.15.38:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f78f40e57a0 con 0x7f790c10a9b0 2024-09-10T23:23:06.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.760+0000 7f790be00640 1 --2- 172.21.15.3:0/1035044366 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f78f00b5330 0x7f78f00b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:06.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.761+0000 7f790be00640 1 --2- 172.21.15.3:0/1035044366 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f78f00b5330 0x7f78f00b77f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f78fc006010 tx=0x7f78fc005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:06.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.761+0000 7f7909600640 1 -- 172.21.15.3:0/1035044366 <== mon.2 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f78f4017020 con 0x7f790c10a9b0 2024-09-10T23:23:06.822 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:06 smithi038 ceph-mon[34225]: Deploying daemon mds.k on smithi038 2024-09-10T23:23:06.823 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:06 smithi038 ceph-mon[34225]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:06.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:06 smithi194 ceph-mon[33904]: Deploying daemon mds.k on smithi038 2024-09-10T23:23:06.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:06 smithi194 ceph-mon[33904]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:06.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:06 smithi003 ceph-mon[30348]: Deploying daemon mds.k on smithi038 2024-09-10T23:23:06.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:06 smithi003 ceph-mon[30348]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:06.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.996+0000 7f7912a00640 1 -- 172.21.15.3:0/1035044366 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f790c19c5a0 con 0x7f790c10a9b0 2024-09-10T23:23:06.998 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.997+0000 7f7909600640 1 -- 172.21.15.3:0/1035044366 <== mon.2 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1435 (secure 0 0 0) 0x7f790c19c5a0 con 0x7f790c10a9b0 2024-09-10T23:23:06.998 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:23:06.998 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":2,"btime":"2024-09-10T23:23:04:554599+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/352514665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":352514665},{"type":"v1","addr":"172.21.15.194:6833","nonce":352514665}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T23:23:06.999 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 2 2024-09-10T23:23:07.000 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.999+0000 7f7912a00640 1 -- 172.21.15.3:0/1035044366 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f78f00b5330 msgr2=0x7f78f00b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:07.000 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.999+0000 7f7912a00640 1 --2- 172.21.15.3:0/1035044366 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f78f00b5330 0x7f78f00b77f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f78fc006010 tx=0x7f78fc005a20 comp rx=0 tx=0).stop 2024-09-10T23:23:07.000 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.999+0000 7f7912a00640 1 -- 172.21.15.3:0/1035044366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f790c10a9b0 msgr2=0x7f790c19b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:07.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.999+0000 7f7912a00640 1 --2- 172.21.15.3:0/1035044366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f790c10a9b0 0x7f790c19b9b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f78f4005fd0 tx=0x7f78f400dde0 comp rx=0 tx=0).stop 2024-09-10T23:23:07.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.999+0000 7f7912a00640 1 -- 172.21.15.3:0/1035044366 shutdown_connections 2024-09-10T23:23:07.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.999+0000 7f7912a00640 1 --2- 172.21.15.3:0/1035044366 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f78f00b5330 0x7f78f00b77f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:07.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.999+0000 7f7912a00640 1 --2- 172.21.15.3:0/1035044366 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f790c10b330 0x7f790c1a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:07.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.999+0000 7f7912a00640 1 --2- 172.21.15.3:0/1035044366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f790c10a9b0 0x7f790c19b9b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:07.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.999+0000 7f7912a00640 1 --2- 172.21.15.3:0/1035044366 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f790c104fa0 0x7f790c19b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:07.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.999+0000 7f7912a00640 1 -- 172.21.15.3:0/1035044366 >> 172.21.15.3:0/1035044366 conn(0x7f790c100a50 msgr2=0x7f790c1014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:07.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.999+0000 7f7912a00640 1 -- 172.21.15.3:0/1035044366 shutdown_connections 2024-09-10T23:23:07.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:06.999+0000 7f7912a00640 1 -- 172.21.15.3:0/1035044366 wait complete. 2024-09-10T23:23:07.746 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:07 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/1035044366' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:07.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:07 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/1035044366' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:07.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:07 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1035044366' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:07.998 INFO:journalctl@ceph.mds.k.smithi038.stdout:Sep 10 23:23:07 smithi038 podman[64717]: 2024-09-10 23:23:07.769546092 +0000 UTC m=+0.148225629 container create 3eb8d873169e2acf43c940df9c349e9ef96d4f1227041554e12c1b32c3a9de9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-k, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-10T23:23:07.999 INFO:journalctl@ceph.mds.k.smithi038.stdout:Sep 10 23:23:07 smithi038 podman[64717]: 2024-09-10 23:23:07.998067996 +0000 UTC m=+0.376747538 container init 3eb8d873169e2acf43c940df9c349e9ef96d4f1227041554e12c1b32c3a9de9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-k, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:23:08.347 INFO:journalctl@ceph.mds.k.smithi038.stdout:Sep 10 23:23:08 smithi038 podman[64717]: 2024-09-10 23:23:08.004851013 +0000 UTC m=+0.383530545 container start 3eb8d873169e2acf43c940df9c349e9ef96d4f1227041554e12c1b32c3a9de9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-k, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-10T23:23:08.347 INFO:journalctl@ceph.mds.k.smithi038.stdout:Sep 10 23:23:08 smithi038 ceph-mds[64740]: -- 172.21.15.38:0/3141665953 <== mon.2 v2:172.21.15.38:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564a9a8eb860 con 0x564a9a8c8800 2024-09-10T23:23:08.347 INFO:journalctl@ceph.mds.k.smithi038.stdout:Sep 10 23:23:08 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-k[64736]: starting mds.k at 2024-09-10T23:23:08.347 INFO:journalctl@ceph.mds.k.smithi038.stdout:Sep 10 23:23:08 smithi038 bash[64717]: 3eb8d873169e2acf43c940df9c349e9ef96d4f1227041554e12c1b32c3a9de9b 2024-09-10T23:23:08.347 INFO:journalctl@ceph.mds.k.smithi038.stdout:Sep 10 23:23:08 smithi038 systemd[1]: Started Ceph mds.k for 3f4e30d0-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:23:08.839 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:08 smithi003 ceph-mon[30348]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:08.840 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:08 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:08.840 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:08 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:08.840 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:08 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:08.840 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:08 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:08.840 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:08 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:08.840 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:08 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:08.840 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:08 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:08.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:08 smithi038 ceph-mon[34225]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:08.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:08 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:08.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:08 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:08.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:08 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:08.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:08 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:08.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:08 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:08.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:08 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:08.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:08 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:08.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:08 smithi194 ceph-mon[33904]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:08.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:08 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:08.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:08 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:08.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:08 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:08.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:08 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:08.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:08 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:08.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:08 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:08.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:08 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:09.673 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:23:09.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:09 smithi038 ceph-mon[34225]: Deploying daemon mds.j on smithi003 2024-09-10T23:23:09.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:09 smithi038 ceph-mon[34225]: mds.? [v2:172.21.15.38:6832/1194099617,v1:172.21.15.38:6833/1194099617] up:boot 2024-09-10T23:23:09.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:09 smithi038 ceph-mon[34225]: fsmap 2 up:standby 2024-09-10T23:23:09.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:09 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T23:23:09.878 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:09 smithi003 ceph-mon[30348]: Deploying daemon mds.j on smithi003 2024-09-10T23:23:09.878 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:09 smithi003 ceph-mon[30348]: mds.? [v2:172.21.15.38:6832/1194099617,v1:172.21.15.38:6833/1194099617] up:boot 2024-09-10T23:23:09.878 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:09 smithi003 ceph-mon[30348]: fsmap 2 up:standby 2024-09-10T23:23:09.878 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:09 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T23:23:09.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:09 smithi194 ceph-mon[33904]: Deploying daemon mds.j on smithi003 2024-09-10T23:23:09.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:09 smithi194 ceph-mon[33904]: mds.? [v2:172.21.15.38:6832/1194099617,v1:172.21.15.38:6833/1194099617] up:boot 2024-09-10T23:23:09.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:09 smithi194 ceph-mon[33904]: fsmap 2 up:standby 2024-09-10T23:23:09.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:09 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T23:23:10.131 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:10.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:10 smithi038 ceph-mon[34225]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:10.848 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:10 smithi003 ceph-mon[30348]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:10.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:10 smithi194 ceph-mon[33904]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:10.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.953+0000 7f4ed0e00640 1 -- 172.21.15.3:0/182580994 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4ecc075540 msgr2=0x7f4ecc075920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:10.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.953+0000 7f4ed0e00640 1 --2- 172.21.15.3:0/182580994 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4ecc075540 0x7f4ecc075920 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc009900 tx=0x7f4ebc02a410 comp rx=0 tx=0).stop 2024-09-10T23:23:10.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.954+0000 7f4ed0e00640 1 -- 172.21.15.3:0/182580994 shutdown_connections 2024-09-10T23:23:10.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.954+0000 7f4ed0e00640 1 --2- 172.21.15.3:0/182580994 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ecc113b20 0x7f4ecc115f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:10.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.954+0000 7f4ed0e00640 1 --2- 172.21.15.3:0/182580994 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ecc075e60 0x7f4ecc1135e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:10.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.954+0000 7f4ed0e00640 1 --2- 172.21.15.3:0/182580994 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4ecc075540 0x7f4ecc075920 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:10.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.954+0000 7f4ed0e00640 1 -- 172.21.15.3:0/182580994 >> 172.21.15.3:0/182580994 conn(0x7f4ecc0fe830 msgr2=0x7f4ecc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:10.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.954+0000 7f4ed0e00640 1 -- 172.21.15.3:0/182580994 shutdown_connections 2024-09-10T23:23:10.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.954+0000 7f4ed0e00640 1 -- 172.21.15.3:0/182580994 wait complete. 2024-09-10T23:23:10.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.955+0000 7f4ed0e00640 1 Processor -- start 2024-09-10T23:23:10.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.955+0000 7f4ed0e00640 1 -- start start 2024-09-10T23:23:10.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.955+0000 7f4ed0e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ecc075540 0x7f4ecc19f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:10.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.955+0000 7f4ed0e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4ecc075e60 0x7f4ecc19fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:10.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.955+0000 7f4ed0e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ecc113b20 0x7f4ecc1a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:10.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.955+0000 7f4ed0e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f4ecc119270 con 0x7f4ecc075e60 2024-09-10T23:23:10.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.955+0000 7f4ed0e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4ecc1190f0 con 0x7f4ecc113b20 2024-09-10T23:23:10.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.955+0000 7f4ed0e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4ecc1193f0 con 0x7f4ecc075540 2024-09-10T23:23:10.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.956+0000 7f4ec1400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4ecc075e60 0x7f4ecc19fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:10.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.956+0000 7f4eca800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ecc113b20 0x7f4ecc1a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:10.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.956+0000 7f4ec1400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4ecc075e60 0x7f4ecc19fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:46148/0 (socket says 172.21.15.3:46148) 2024-09-10T23:23:10.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.956+0000 7f4ec1400640 1 -- 172.21.15.3:0/2109779659 learned_addr learned my addr 172.21.15.3:0/2109779659 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:23:10.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.956+0000 7f4ec9e00640 1 --2- 172.21.15.3:0/2109779659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ecc075540 0x7f4ecc19f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:10.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.956+0000 7f4ec1400640 1 -- 172.21.15.3:0/2109779659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ecc075540 msgr2=0x7f4ecc19f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:10.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.956+0000 7f4ec1400640 1 --2- 172.21.15.3:0/2109779659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ecc075540 0x7f4ecc19f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:10.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.956+0000 7f4ec1400640 1 -- 172.21.15.3:0/2109779659 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ecc113b20 msgr2=0x7f4ecc1a5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:10.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.956+0000 7f4ec1400640 1 --2- 172.21.15.3:0/2109779659 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ecc113b20 0x7f4ecc1a5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:10.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.956+0000 7f4ec1400640 1 -- 172.21.15.3:0/2109779659 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ecc1a5930 con 0x7f4ecc075e60 2024-09-10T23:23:10.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.956+0000 7f4ec1400640 1 --2- 172.21.15.3:0/2109779659 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4ecc075e60 0x7f4ecc19fdc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4eb400d770 tx=0x7f4eb400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:10.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.957+0000 7f4ec3400640 1 -- 172.21.15.3:0/2109779659 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb4017070 con 0x7f4ecc075e60 2024-09-10T23:23:10.960 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.957+0000 7f4ed0e00640 1 -- 172.21.15.3:0/2109779659 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ecc1a5c20 con 0x7f4ecc075e60 2024-09-10T23:23:10.960 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.957+0000 7f4ec3400640 1 -- 172.21.15.3:0/2109779659 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4eb40054b0 con 0x7f4ecc075e60 2024-09-10T23:23:10.960 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.957+0000 7f4ec3400640 1 -- 172.21.15.3:0/2109779659 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb4004c60 con 0x7f4ecc075e60 2024-09-10T23:23:10.960 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.957+0000 7f4ed0e00640 1 -- 172.21.15.3:0/2109779659 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ecc1ac2e0 con 0x7f4ecc075e60 2024-09-10T23:23:10.960 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.958+0000 7f4ed0e00640 1 -- 172.21.15.3:0/2109779659 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ecc075920 con 0x7f4ecc075e60 2024-09-10T23:23:10.961 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.960+0000 7f4ec3400640 1 -- 172.21.15.3:0/2109779659 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7f4eb4004e00 con 0x7f4ecc075e60 2024-09-10T23:23:10.963 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.962+0000 7f4ec3400640 1 --2- 172.21.15.3:0/2109779659 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f4eb00b5330 0x7f4eb00b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:10.963 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.962+0000 7f4ec3400640 1 -- 172.21.15.3:0/2109779659 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f4eb40e5370 con 0x7f4ecc075e60 2024-09-10T23:23:10.963 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.962+0000 7f4ec9e00640 1 --2- 172.21.15.3:0/2109779659 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f4eb00b5330 0x7f4eb00b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:10.964 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.963+0000 7f4ec9e00640 1 --2- 172.21.15.3:0/2109779659 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f4eb00b5330 0x7f4eb00b77f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc000c00 tx=0x7f4ebc005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:10.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:10.966+0000 7f4ec3400640 1 -- 172.21.15.3:0/2109779659 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4eb40ac560 con 0x7f4ecc075e60 2024-09-10T23:23:11.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:11.207+0000 7f4ed0e00640 1 -- 172.21.15.3:0/2109779659 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ecc02e5c0 con 0x7f4ecc075e60 2024-09-10T23:23:11.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:11.208+0000 7f4ec3400640 1 -- 172.21.15.3:0/2109779659 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2260 (secure 0 0 0) 0x7f4eb40abe60 con 0x7f4ecc075e60 2024-09-10T23:23:11.209 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:23:11.209 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":3,"btime":"2024-09-10T23:23:08:568027+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/352514665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":352514665},{"type":"v1","addr":"172.21.15.194:6833","nonce":352514665}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34619,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/1194099617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1194099617},{"type":"v1","addr":"172.21.15.38:6833","nonce":1194099617}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T23:23:11.210 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 3 2024-09-10T23:23:11.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:11.210+0000 7f4ed0e00640 1 -- 172.21.15.3:0/2109779659 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f4eb00b5330 msgr2=0x7f4eb00b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:11.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:11.210+0000 7f4ed0e00640 1 --2- 172.21.15.3:0/2109779659 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f4eb00b5330 0x7f4eb00b77f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc000c00 tx=0x7f4ebc005a20 comp rx=0 tx=0).stop 2024-09-10T23:23:11.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:11.210+0000 7f4ed0e00640 1 -- 172.21.15.3:0/2109779659 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4ecc075e60 msgr2=0x7f4ecc19fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:11.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:11.210+0000 7f4ed0e00640 1 --2- 172.21.15.3:0/2109779659 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4ecc075e60 0x7f4ecc19fdc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4eb400d770 tx=0x7f4eb400dc30 comp rx=0 tx=0).stop 2024-09-10T23:23:11.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:11.210+0000 7f4ed0e00640 1 -- 172.21.15.3:0/2109779659 shutdown_connections 2024-09-10T23:23:11.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:11.210+0000 7f4ed0e00640 1 --2- 172.21.15.3:0/2109779659 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ecc113b20 0x7f4ecc1a5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:11.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:11.210+0000 7f4ed0e00640 1 --2- 172.21.15.3:0/2109779659 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f4eb00b5330 0x7f4eb00b77f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:11.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:11.210+0000 7f4ed0e00640 1 --2- 172.21.15.3:0/2109779659 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4ecc075e60 0x7f4ecc19fdc0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:11.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:11.210+0000 7f4ed0e00640 1 --2- 172.21.15.3:0/2109779659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ecc075540 0x7f4ecc19f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:11.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:11.210+0000 7f4ed0e00640 1 -- 172.21.15.3:0/2109779659 >> 172.21.15.3:0/2109779659 conn(0x7f4ecc0fe830 msgr2=0x7f4ecc0ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:11.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:11.210+0000 7f4ed0e00640 1 -- 172.21.15.3:0/2109779659 shutdown_connections 2024-09-10T23:23:11.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:11.210+0000 7f4ed0e00640 1 -- 172.21.15.3:0/2109779659 wait complete. 2024-09-10T23:23:11.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:11 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2109779659' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:11.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:11 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2109779659' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:12.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:11 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2109779659' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:12.422 INFO:journalctl@ceph.mds.j.smithi003.stdout:Sep 10 23:23:12 smithi003 ceph-mds[74722]: -- 172.21.15.3:0/922984357 <== mon.0 v2:172.21.15.3:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b542595860 con 0x55b542573000 2024-09-10T23:23:12.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:12 smithi003 ceph-mon[30348]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:12.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:12 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:12.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:12 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:12.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:12 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:12.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:12 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:12.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:12 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:12.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:12 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:12.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:12 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:12.721 INFO:journalctl@ceph.mds.j.smithi003.stdout:Sep 10 23:23:12 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-j[74718]: starting mds.j at 2024-09-10T23:23:12.722 INFO:journalctl@ceph.mds.j.smithi003.stdout:Sep 10 23:23:12 smithi003 bash[74690]: be87cbba1f889059870f8e88642152d2d0d496c1fa0274f25b738a156e81fe46 2024-09-10T23:23:12.722 INFO:journalctl@ceph.mds.j.smithi003.stdout:Sep 10 23:23:12 smithi003 systemd[1]: Started Ceph mds.j for 3f4e30d0-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:23:12.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:12 smithi194 ceph-mon[33904]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:13.362 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:12 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:13.362 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:12 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:13.362 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:12 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:13.362 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:12 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:13.362 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:12 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:13.363 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:12 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:13.363 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:12 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:13.363 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:12 smithi038 ceph-mon[34225]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:13.363 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:12 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:13.363 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:12 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:13.363 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:12 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:13.364 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:12 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:13.364 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:12 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:13.364 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:12 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:13.364 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:12 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:13.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:13 smithi194 ceph-mon[33904]: Deploying daemon mds.d on smithi003 2024-09-10T23:23:13.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:13 smithi194 ceph-mon[33904]: mds.? [v2:172.21.15.3:6834/1495411512,v1:172.21.15.3:6835/1495411512] up:boot 2024-09-10T23:23:13.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:13 smithi194 ceph-mon[33904]: fsmap 3 up:standby 2024-09-10T23:23:13.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:13 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-10T23:23:13.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:13 smithi003 ceph-mon[30348]: Deploying daemon mds.d on smithi003 2024-09-10T23:23:13.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:13 smithi003 ceph-mon[30348]: mds.? [v2:172.21.15.3:6834/1495411512,v1:172.21.15.3:6835/1495411512] up:boot 2024-09-10T23:23:13.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:13 smithi003 ceph-mon[30348]: fsmap 3 up:standby 2024-09-10T23:23:13.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:13 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-10T23:23:14.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:13 smithi038 ceph-mon[34225]: Deploying daemon mds.d on smithi003 2024-09-10T23:23:14.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:13 smithi038 ceph-mon[34225]: mds.? [v2:172.21.15.3:6834/1495411512,v1:172.21.15.3:6835/1495411512] up:boot 2024-09-10T23:23:14.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:13 smithi038 ceph-mon[34225]: fsmap 3 up:standby 2024-09-10T23:23:14.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:13 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-10T23:23:14.212 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:23:14.622 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:14.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:14 smithi194 ceph-mon[33904]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:14.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:14 smithi003 ceph-mon[30348]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:15.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:14 smithi038 ceph-mon[34225]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:15.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.359+0000 7ff85f200640 1 -- 172.21.15.3:0/1405262216 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff860108620 msgr2=0x7ff860108a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:15.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.359+0000 7ff85f200640 1 --2- 172.21.15.3:0/1405262216 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff860108620 0x7ff860108a60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff848009900 tx=0x7ff84802a3f0 comp rx=0 tx=0).stop 2024-09-10T23:23:15.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.359+0000 7ff85f200640 1 -- 172.21.15.3:0/1405262216 shutdown_connections 2024-09-10T23:23:15.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.359+0000 7ff85f200640 1 --2- 172.21.15.3:0/1405262216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff860108fa0 0x7ff86010f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:15.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.359+0000 7ff85f200640 1 --2- 172.21.15.3:0/1405262216 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff860108620 0x7ff860108a60 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:15.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.359+0000 7ff85f200640 1 --2- 172.21.15.3:0/1405262216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff860102c10 0x7ff860102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:15.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.359+0000 7ff85f200640 1 -- 172.21.15.3:0/1405262216 >> 172.21.15.3:0/1405262216 conn(0x7ff8600fe660 msgr2=0x7ff860100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:15.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.359+0000 7ff85f200640 1 -- 172.21.15.3:0/1405262216 shutdown_connections 2024-09-10T23:23:15.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.360+0000 7ff85f200640 1 -- 172.21.15.3:0/1405262216 wait complete. 2024-09-10T23:23:15.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.361+0000 7ff85f200640 1 Processor -- start 2024-09-10T23:23:15.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.361+0000 7ff85f200640 1 -- start start 2024-09-10T23:23:15.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.361+0000 7ff85f200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff860102c10 0x7ff86019b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:15.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.361+0000 7ff85f200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff860108620 0x7ff86019b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:15.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.361+0000 7ff85f200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff860108fa0 0x7ff8601a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:15.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.361+0000 7ff85f200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff860112ae0 con 0x7ff860108620 2024-09-10T23:23:15.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.361+0000 7ff85f200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff860112960 con 0x7ff860108fa0 2024-09-10T23:23:15.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.361+0000 7ff85f200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff860112c60 con 0x7ff860102c10 2024-09-10T23:23:15.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.361+0000 7ff857e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff860108620 0x7ff86019b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:15.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.362+0000 7ff857e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff860108620 0x7ff86019b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:46198/0 (socket says 172.21.15.3:46198) 2024-09-10T23:23:15.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.362+0000 7ff857e00640 1 -- 172.21.15.3:0/3860280995 learned_addr learned my addr 172.21.15.3:0/3860280995 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:23:15.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.362+0000 7ff85de00640 1 --2- 172.21.15.3:0/3860280995 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff860102c10 0x7ff86019b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:15.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.362+0000 7ff85e800640 1 --2- 172.21.15.3:0/3860280995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff860108fa0 0x7ff8601a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:15.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.362+0000 7ff857e00640 1 -- 172.21.15.3:0/3860280995 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff860102c10 msgr2=0x7ff86019b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:15.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.362+0000 7ff857e00640 1 --2- 172.21.15.3:0/3860280995 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff860102c10 0x7ff86019b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:15.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.362+0000 7ff857e00640 1 -- 172.21.15.3:0/3860280995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff860108fa0 msgr2=0x7ff8601a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:15.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.362+0000 7ff857e00640 1 --2- 172.21.15.3:0/3860280995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff860108fa0 0x7ff8601a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:15.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.362+0000 7ff857e00640 1 -- 172.21.15.3:0/3860280995 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8601a12a0 con 0x7ff860108620 2024-09-10T23:23:15.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.362+0000 7ff85e800640 1 --2- 172.21.15.3:0/3860280995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff860108fa0 0x7ff8601a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:23:15.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.362+0000 7ff857e00640 1 --2- 172.21.15.3:0/3860280995 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff860108620 0x7ff86019b730 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff848009230 tx=0x7ff848004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:15.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.363+0000 7ff856a00640 1 -- 172.21.15.3:0/3860280995 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84803f030 con 0x7ff860108620 2024-09-10T23:23:15.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.363+0000 7ff856a00640 1 -- 172.21.15.3:0/3860280995 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff848003a80 con 0x7ff860108620 2024-09-10T23:23:15.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.363+0000 7ff85f200640 1 -- 172.21.15.3:0/3860280995 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8601a1530 con 0x7ff860108620 2024-09-10T23:23:15.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.363+0000 7ff856a00640 1 -- 172.21.15.3:0/3860280995 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff848035070 con 0x7ff860108620 2024-09-10T23:23:15.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.363+0000 7ff85f200640 1 -- 172.21.15.3:0/3860280995 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8601a7c50 con 0x7ff860108620 2024-09-10T23:23:15.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.364+0000 7ff85f200640 1 -- 172.21.15.3:0/3860280995 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff860102ff0 con 0x7ff860108620 2024-09-10T23:23:15.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.366+0000 7ff856a00640 1 -- 172.21.15.3:0/3860280995 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7ff84803bc30 con 0x7ff860108620 2024-09-10T23:23:15.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.368+0000 7ff856a00640 1 --2- 172.21.15.3:0/3860280995 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff8440b53e0 0x7ff8440b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:15.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.368+0000 7ff856a00640 1 -- 172.21.15.3:0/3860280995 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7ff848106340 con 0x7ff860108620 2024-09-10T23:23:15.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.368+0000 7ff85de00640 1 --2- 172.21.15.3:0/3860280995 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff8440b53e0 0x7ff8440b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:15.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.369+0000 7ff85de00640 1 --2- 172.21.15.3:0/3860280995 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff8440b53e0 0x7ff8440b78a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff85000bbe0 tx=0x7ff85000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:15.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.372+0000 7ff856a00640 1 -- 172.21.15.3:0/3860280995 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff8480cd530 con 0x7ff860108620 2024-09-10T23:23:15.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.612+0000 7ff85f200640 1 -- 172.21.15.3:0/3860280995 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff86019c320 con 0x7ff860108620 2024-09-10T23:23:15.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.613+0000 7ff856a00640 1 -- 172.21.15.3:0/3860280995 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3082 (secure 0 0 0) 0x7ff8480cce30 con 0x7ff860108620 2024-09-10T23:23:15.614 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:23:15.614 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":4,"btime":"2024-09-10T23:23:12:601947+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/1495411512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":1495411512},{"type":"v1","addr":"172.21.15.3:6835","nonce":1495411512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/352514665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":352514665},{"type":"v1","addr":"172.21.15.194:6833","nonce":352514665}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34619,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/1194099617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1194099617},{"type":"v1","addr":"172.21.15.38:6833","nonce":1194099617}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T23:23:15.615 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 4 2024-09-10T23:23:15.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.615+0000 7ff85f200640 1 -- 172.21.15.3:0/3860280995 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff8440b53e0 msgr2=0x7ff8440b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:15.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.615+0000 7ff85f200640 1 --2- 172.21.15.3:0/3860280995 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff8440b53e0 0x7ff8440b78a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff85000bbe0 tx=0x7ff85000b390 comp rx=0 tx=0).stop 2024-09-10T23:23:15.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.615+0000 7ff85f200640 1 -- 172.21.15.3:0/3860280995 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff860108620 msgr2=0x7ff86019b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:15.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.615+0000 7ff85f200640 1 --2- 172.21.15.3:0/3860280995 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff860108620 0x7ff86019b730 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff848009230 tx=0x7ff848004270 comp rx=0 tx=0).stop 2024-09-10T23:23:15.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.615+0000 7ff85f200640 1 -- 172.21.15.3:0/3860280995 shutdown_connections 2024-09-10T23:23:15.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.615+0000 7ff85f200640 1 --2- 172.21.15.3:0/3860280995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff860108fa0 0x7ff8601a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:15.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.615+0000 7ff85f200640 1 --2- 172.21.15.3:0/3860280995 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff8440b53e0 0x7ff8440b78a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:15.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.615+0000 7ff85f200640 1 --2- 172.21.15.3:0/3860280995 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff860108620 0x7ff86019b730 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:15.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.615+0000 7ff85f200640 1 --2- 172.21.15.3:0/3860280995 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff860102c10 0x7ff86019b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:15.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.615+0000 7ff85f200640 1 -- 172.21.15.3:0/3860280995 >> 172.21.15.3:0/3860280995 conn(0x7ff8600fe660 msgr2=0x7ff860105c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:15.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.616+0000 7ff85f200640 1 -- 172.21.15.3:0/3860280995 shutdown_connections 2024-09-10T23:23:15.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:15.616+0000 7ff85f200640 1 -- 172.21.15.3:0/3860280995 wait complete. 2024-09-10T23:23:15.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:15 smithi194 ceph-mon[33904]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:15.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:15 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3860280995' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:15.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:15 smithi003 ceph-mon[30348]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:15.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:15 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3860280995' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:16.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:15 smithi038 ceph-mon[34225]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:16.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:15 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3860280995' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:16.705 INFO:journalctl@ceph.mds.d.smithi003.stdout:Sep 10 23:23:16 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-d[75129]: starting mds.d at 2024-09-10T23:23:16.970 INFO:journalctl@ceph.mds.d.smithi003.stdout:Sep 10 23:23:16 smithi003 bash[75100]: c1747fac5bd3c4b4ec35b89d83b5107e987ac970dd4f5ad77a26bcfeae78e2da 2024-09-10T23:23:16.970 INFO:journalctl@ceph.mds.d.smithi003.stdout:Sep 10 23:23:16 smithi003 systemd[1]: Started Ceph mds.d for 3f4e30d0-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:23:17.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:17 smithi003 ceph-mon[30348]: mds.? [v2:172.21.15.3:6836/1857372777,v1:172.21.15.3:6837/1857372777] up:boot 2024-09-10T23:23:17.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:17 smithi003 ceph-mon[30348]: fsmap 4 up:standby 2024-09-10T23:23:17.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:17 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-10T23:23:17.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:17 smithi003 ceph-mon[30348]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:17.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:17 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:17.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:17 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:17.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:17 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:17.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:17 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:17.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:17 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:17.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:17 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:17.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:17 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:17.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:17 smithi003 ceph-mon[30348]: Deploying daemon mds.e on smithi038 2024-09-10T23:23:18.095 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:17 smithi038 ceph-mon[34225]: mds.? [v2:172.21.15.3:6836/1857372777,v1:172.21.15.3:6837/1857372777] up:boot 2024-09-10T23:23:18.095 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:17 smithi038 ceph-mon[34225]: fsmap 4 up:standby 2024-09-10T23:23:18.095 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:17 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-10T23:23:18.095 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:17 smithi038 ceph-mon[34225]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:18.095 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:17 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:18.095 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:17 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:18.096 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:17 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:18.096 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:17 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:18.096 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:17 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:18.096 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:17 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:18.096 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:17 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:18.096 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:17 smithi038 ceph-mon[34225]: Deploying daemon mds.e on smithi038 2024-09-10T23:23:18.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:17 smithi194 ceph-mon[33904]: mds.? [v2:172.21.15.3:6836/1857372777,v1:172.21.15.3:6837/1857372777] up:boot 2024-09-10T23:23:18.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:17 smithi194 ceph-mon[33904]: fsmap 4 up:standby 2024-09-10T23:23:18.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:17 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-10T23:23:18.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:17 smithi194 ceph-mon[33904]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:18.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:17 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:18.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:17 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:18.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:17 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:18.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:17 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:18.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:17 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:18.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:17 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:18.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:17 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:18.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:17 smithi194 ceph-mon[33904]: Deploying daemon mds.e on smithi038 2024-09-10T23:23:18.484 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:23:18.878 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:19.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.429+0000 7f3e59e00640 1 -- 172.21.15.3:0/1372489666 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e54113990 msgr2=0x7f3e54115d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:19.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.429+0000 7f3e59e00640 1 --2- 172.21.15.3:0/1372489666 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e54113990 0x7f3e54115d80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c009ca0 tx=0x7f3e4c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:23:19.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.430+0000 7f3e59e00640 1 -- 172.21.15.3:0/1372489666 shutdown_connections 2024-09-10T23:23:19.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.430+0000 7f3e59e00640 1 --2- 172.21.15.3:0/1372489666 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e54113990 0x7f3e54115d80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:19.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.430+0000 7f3e59e00640 1 --2- 172.21.15.3:0/1372489666 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e54077ff0 0x7f3e54113450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:19.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.430+0000 7f3e59e00640 1 --2- 172.21.15.3:0/1372489666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e540776d0 0x7f3e54077ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:19.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.430+0000 7f3e59e00640 1 -- 172.21.15.3:0/1372489666 >> 172.21.15.3:0/1372489666 conn(0x7f3e54100a50 msgr2=0x7f3e54102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:19.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.430+0000 7f3e59e00640 1 -- 172.21.15.3:0/1372489666 shutdown_connections 2024-09-10T23:23:19.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.430+0000 7f3e59e00640 1 -- 172.21.15.3:0/1372489666 wait complete. 2024-09-10T23:23:19.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.431+0000 7f3e59e00640 1 Processor -- start 2024-09-10T23:23:19.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.431+0000 7f3e59e00640 1 -- start start 2024-09-10T23:23:19.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.431+0000 7f3e59e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e540776d0 0x7f3e5419f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:19.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.431+0000 7f3e59e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e54077ff0 0x7f3e5419fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:19.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.431+0000 7f3e59e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e54113990 0x7f3e541a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:19.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.431+0000 7f3e59e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f3e54119260 con 0x7f3e540776d0 2024-09-10T23:23:19.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.431+0000 7f3e59e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3e541190e0 con 0x7f3e54077ff0 2024-09-10T23:23:19.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.431+0000 7f3e59e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3e541193e0 con 0x7f3e54113990 2024-09-10T23:23:19.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.431+0000 7f3e52a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e540776d0 0x7f3e5419f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:19.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.432+0000 7f3e52a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e540776d0 0x7f3e5419f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:46238/0 (socket says 172.21.15.3:46238) 2024-09-10T23:23:19.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.432+0000 7f3e4be00640 1 --2- 172.21.15.3:0/1430302208 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e54077ff0 0x7f3e5419fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:19.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.432+0000 7f3e52a00640 1 -- 172.21.15.3:0/1430302208 learned_addr learned my addr 172.21.15.3:0/1430302208 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:23:19.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.432+0000 7f3e53400640 1 --2- 172.21.15.3:0/1430302208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e54113990 0x7f3e541a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:19.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.432+0000 7f3e52a00640 1 -- 172.21.15.3:0/1430302208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e54113990 msgr2=0x7f3e541a5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:19.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.432+0000 7f3e52a00640 1 --2- 172.21.15.3:0/1430302208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e54113990 0x7f3e541a5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:19.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.432+0000 7f3e52a00640 1 -- 172.21.15.3:0/1430302208 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e54077ff0 msgr2=0x7f3e5419fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:19.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.432+0000 7f3e52a00640 1 --2- 172.21.15.3:0/1430302208 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e54077ff0 0x7f3e5419fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:19.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.432+0000 7f3e52a00640 1 -- 172.21.15.3:0/1430302208 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e541a5820 con 0x7f3e540776d0 2024-09-10T23:23:19.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.432+0000 7f3e4be00640 1 --2- 172.21.15.3:0/1430302208 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e54077ff0 0x7f3e5419fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:23:19.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.432+0000 7f3e53400640 1 --2- 172.21.15.3:0/1430302208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e54113990 0x7f3e541a5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:23:19.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.432+0000 7f3e52a00640 1 --2- 172.21.15.3:0/1430302208 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e540776d0 0x7f3e5419f770 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3e4400d950 tx=0x7f3e4400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:19.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.433+0000 7f3e58a00640 1 -- 172.21.15.3:0/1430302208 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e44017070 con 0x7f3e540776d0 2024-09-10T23:23:19.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.433+0000 7f3e58a00640 1 -- 172.21.15.3:0/1430302208 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e44009c30 con 0x7f3e540776d0 2024-09-10T23:23:19.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.433+0000 7f3e59e00640 1 -- 172.21.15.3:0/1430302208 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e541a5b10 con 0x7f3e540776d0 2024-09-10T23:23:19.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.433+0000 7f3e58a00640 1 -- 172.21.15.3:0/1430302208 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4400f620 con 0x7f3e540776d0 2024-09-10T23:23:19.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.433+0000 7f3e59e00640 1 -- 172.21.15.3:0/1430302208 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e541ac1d0 con 0x7f3e540776d0 2024-09-10T23:23:19.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.434+0000 7f3e59e00640 1 -- 172.21.15.3:0/1430302208 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e54077ab0 con 0x7f3e540776d0 2024-09-10T23:23:19.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.436+0000 7f3e58a00640 1 -- 172.21.15.3:0/1430302208 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7f3e44010460 con 0x7f3e540776d0 2024-09-10T23:23:19.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.438+0000 7f3e58a00640 1 --2- 172.21.15.3:0/1430302208 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f3e380b5330 0x7f3e380b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:19.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.438+0000 7f3e58a00640 1 -- 172.21.15.3:0/1430302208 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f3e440e54a0 con 0x7f3e540776d0 2024-09-10T23:23:19.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.438+0000 7f3e4be00640 1 --2- 172.21.15.3:0/1430302208 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f3e380b5330 0x7f3e380b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:19.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.438+0000 7f3e4be00640 1 --2- 172.21.15.3:0/1430302208 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f3e380b5330 0x7f3e380b77f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3e54079d70 tx=0x7f3e3c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:19.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.439+0000 7f3e58a00640 1 -- 172.21.15.3:0/1430302208 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3e440ac730 con 0x7f3e540776d0 2024-09-10T23:23:19.597 INFO:journalctl@ceph.mds.e.smithi038.stdout:Sep 10 23:23:19 smithi038 systemd[1]: Starting Ceph mds.e for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:23:19.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.675+0000 7f3e59e00640 1 -- 172.21.15.3:0/1430302208 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e541a08a0 con 0x7f3e540776d0 2024-09-10T23:23:19.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.676+0000 7f3e58a00640 1 -- 172.21.15.3:0/1430302208 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3904 (secure 0 0 0) 0x7f3e44009de0 con 0x7f3e540776d0 2024-09-10T23:23:19.677 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:23:19.677 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":5,"btime":"2024-09-10T23:23:16:698456+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/1495411512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":1495411512},{"type":"v1","addr":"172.21.15.3:6835","nonce":1495411512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/1857372777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1857372777},{"type":"v1","addr":"172.21.15.3:6837","nonce":1857372777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/352514665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":352514665},{"type":"v1","addr":"172.21.15.194:6833","nonce":352514665}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34619,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/1194099617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1194099617},{"type":"v1","addr":"172.21.15.38:6833","nonce":1194099617}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T23:23:19.678 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 5 2024-09-10T23:23:19.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.678+0000 7f3e59e00640 1 -- 172.21.15.3:0/1430302208 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f3e380b5330 msgr2=0x7f3e380b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:19.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.678+0000 7f3e59e00640 1 --2- 172.21.15.3:0/1430302208 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f3e380b5330 0x7f3e380b77f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3e54079d70 tx=0x7f3e3c005f90 comp rx=0 tx=0).stop 2024-09-10T23:23:19.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.678+0000 7f3e59e00640 1 -- 172.21.15.3:0/1430302208 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e540776d0 msgr2=0x7f3e5419f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:19.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.678+0000 7f3e59e00640 1 --2- 172.21.15.3:0/1430302208 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e540776d0 0x7f3e5419f770 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3e4400d950 tx=0x7f3e4400de10 comp rx=0 tx=0).stop 2024-09-10T23:23:19.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.679+0000 7f3e59e00640 1 -- 172.21.15.3:0/1430302208 shutdown_connections 2024-09-10T23:23:19.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.679+0000 7f3e59e00640 1 --2- 172.21.15.3:0/1430302208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e54113990 0x7f3e541a5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:19.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.679+0000 7f3e59e00640 1 --2- 172.21.15.3:0/1430302208 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e54077ff0 0x7f3e5419fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:19.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.679+0000 7f3e59e00640 1 --2- 172.21.15.3:0/1430302208 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f3e380b5330 0x7f3e380b77f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:19.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.679+0000 7f3e59e00640 1 --2- 172.21.15.3:0/1430302208 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e540776d0 0x7f3e5419f770 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:19.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.679+0000 7f3e59e00640 1 -- 172.21.15.3:0/1430302208 >> 172.21.15.3:0/1430302208 conn(0x7f3e54100a50 msgr2=0x7f3e54102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:19.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.679+0000 7f3e59e00640 1 -- 172.21.15.3:0/1430302208 shutdown_connections 2024-09-10T23:23:19.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:19.679+0000 7f3e59e00640 1 -- 172.21.15.3:0/1430302208 wait complete. 2024-09-10T23:23:19.947 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:19 smithi038 ceph-mon[34225]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:19.947 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:19 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/1430302208' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:19.947 INFO:journalctl@ceph.mds.e.smithi038.stdout:Sep 10 23:23:19 smithi038 podman[65027]: 2024-09-10 23:23:19.560706046 +0000 UTC m=+0.027114789 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:23:19.947 INFO:journalctl@ceph.mds.e.smithi038.stdout:Sep 10 23:23:19 smithi038 podman[65027]: 2024-09-10 23:23:19.668480862 +0000 UTC m=+0.134889591 container create 2b69464e30fbedf5f88868e3c513bc4d8607107847a8f75595461bd945e75f21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-10T23:23:19.947 INFO:journalctl@ceph.mds.e.smithi038.stdout:Sep 10 23:23:19 smithi038 podman[65027]: 2024-09-10 23:23:19.946872635 +0000 UTC m=+0.413281394 container init 2b69464e30fbedf5f88868e3c513bc4d8607107847a8f75595461bd945e75f21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-e, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-10T23:23:19.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:19 smithi003 ceph-mon[30348]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:19.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:19 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1430302208' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:20.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:19 smithi194 ceph-mon[33904]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:20.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:19 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/1430302208' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:20.347 INFO:journalctl@ceph.mds.e.smithi038.stdout:Sep 10 23:23:19 smithi038 podman[65027]: 2024-09-10 23:23:19.953495109 +0000 UTC m=+0.419903851 container start 2b69464e30fbedf5f88868e3c513bc4d8607107847a8f75595461bd945e75f21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-e, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-10T23:23:20.347 INFO:journalctl@ceph.mds.e.smithi038.stdout:Sep 10 23:23:19 smithi038 ceph-mds[65045]: -- 172.21.15.38:0/2091461564 <== mon.2 v2:172.21.15.38:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555648e1f860 con 0x555648dfd000 2024-09-10T23:23:20.347 INFO:journalctl@ceph.mds.e.smithi038.stdout:Sep 10 23:23:19 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-e[65041]: starting mds.e at 2024-09-10T23:23:20.347 INFO:journalctl@ceph.mds.e.smithi038.stdout:Sep 10 23:23:20 smithi038 bash[65027]: 2b69464e30fbedf5f88868e3c513bc4d8607107847a8f75595461bd945e75f21 2024-09-10T23:23:20.348 INFO:journalctl@ceph.mds.e.smithi038.stdout:Sep 10 23:23:20 smithi038 systemd[1]: Started Ceph mds.e for 3f4e30d0-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:23:21.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:21 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:21.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:21 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:21.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:21 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:21.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:21 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:21.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:21 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:21.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:21 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:21.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:21 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:21.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:21 smithi194 ceph-mon[33904]: Deploying daemon mds.f on smithi194 2024-09-10T23:23:21.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:21 smithi194 ceph-mon[33904]: mds.? [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] up:boot 2024-09-10T23:23:21.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:21 smithi194 ceph-mon[33904]: fsmap 5 up:standby 2024-09-10T23:23:21.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:21 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T23:23:21.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:21 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:21.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:21 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:21.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:21 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:21.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:21 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:21.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:21 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:21.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:21 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:21.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:21 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:21.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:21 smithi003 ceph-mon[30348]: Deploying daemon mds.f on smithi194 2024-09-10T23:23:21.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:21 smithi003 ceph-mon[30348]: mds.? [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] up:boot 2024-09-10T23:23:21.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:21 smithi003 ceph-mon[30348]: fsmap 5 up:standby 2024-09-10T23:23:21.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:21 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T23:23:21.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:21 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:21.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:21 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:21.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:21 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:21.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:21 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:21.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:21 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:21.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:21 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:21.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:21 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:21.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:21 smithi038 ceph-mon[34225]: Deploying daemon mds.f on smithi194 2024-09-10T23:23:21.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:21 smithi038 ceph-mon[34225]: mds.? [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] up:boot 2024-09-10T23:23:21.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:21 smithi038 ceph-mon[34225]: fsmap 5 up:standby 2024-09-10T23:23:21.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:21 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T23:23:22.392 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:22 smithi003 ceph-mon[30348]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:22.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:22 smithi194 ceph-mon[33904]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:22.460 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:23:22.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:22 smithi038 ceph-mon[34225]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:22.851 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:22.947 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 10 23:23:22 smithi194 systemd[1]: Starting Ceph mds.f for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:23:23.242 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 10 23:23:22 smithi194 podman[65724]: 2024-09-10 23:23:22.894930789 +0000 UTC m=+0.027481696 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:23:23.243 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 10 23:23:23 smithi194 podman[65724]: 2024-09-10 23:23:23.006359555 +0000 UTC m=+0.138910489 container create ca0eeceaff69b56486304de381b84d6d352b5cc473698a0d1ddbb4a9a9413458 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-f, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-10T23:23:23.243 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 10 23:23:23 smithi194 podman[65724]: 2024-09-10 23:23:23.24248121 +0000 UTC m=+0.375032129 container init ca0eeceaff69b56486304de381b84d6d352b5cc473698a0d1ddbb4a9a9413458 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-f, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:23:23.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.448+0000 7fb1ac600640 1 -- 172.21.15.3:0/1405780912 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1a410b330 msgr2=0x7fb1a4111b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:23.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.448+0000 7fb1ac600640 1 --2- 172.21.15.3:0/1405780912 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1a410b330 0x7fb1a4111b30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb19c009ca0 tx=0x7fb19c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:23:23.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.448+0000 7fb1ac600640 1 -- 172.21.15.3:0/1405780912 shutdown_connections 2024-09-10T23:23:23.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.448+0000 7fb1ac600640 1 --2- 172.21.15.3:0/1405780912 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1a410b330 0x7fb1a4111b30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:23.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.448+0000 7fb1ac600640 1 --2- 172.21.15.3:0/1405780912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1a410a9b0 0x7fb1a410adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:23.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.448+0000 7fb1ac600640 1 --2- 172.21.15.3:0/1405780912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1a4104fa0 0x7fb1a4105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:23.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.448+0000 7fb1ac600640 1 -- 172.21.15.3:0/1405780912 >> 172.21.15.3:0/1405780912 conn(0x7fb1a4100a50 msgr2=0x7fb1a4102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:23.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.448+0000 7fb1ac600640 1 -- 172.21.15.3:0/1405780912 shutdown_connections 2024-09-10T23:23:23.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.448+0000 7fb1ac600640 1 -- 172.21.15.3:0/1405780912 wait complete. 2024-09-10T23:23:23.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.449+0000 7fb1ac600640 1 Processor -- start 2024-09-10T23:23:23.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.449+0000 7fb1ac600640 1 -- start start 2024-09-10T23:23:23.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.450+0000 7fb1ac600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1a4104fa0 0x7fb1a419b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:23.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.450+0000 7fb1ac600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1a410a9b0 0x7fb1a419b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:23.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.450+0000 7fb1ac600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1a410b330 0x7fb1a41a0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:23.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.450+0000 7fb1ac600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a4114e60 con 0x7fb1a410b330 2024-09-10T23:23:23.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.450+0000 7fb1ac600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a4114ce0 con 0x7fb1a410a9b0 2024-09-10T23:23:23.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.450+0000 7fb1ac600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a4114fe0 con 0x7fb1a4104fa0 2024-09-10T23:23:23.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.450+0000 7fb1a9c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1a4104fa0 0x7fb1a419b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:23.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.450+0000 7fb1a9c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1a4104fa0 0x7fb1a419b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.3:47516/0 (socket says 172.21.15.3:47516) 2024-09-10T23:23:23.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.450+0000 7fb1a9200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1a410a9b0 0x7fb1a419b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:23.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.450+0000 7fb1a9c00640 1 -- 172.21.15.3:0/363700079 learned_addr learned my addr 172.21.15.3:0/363700079 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:23:23.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.450+0000 7fb1aa600640 1 --2- 172.21.15.3:0/363700079 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1a410b330 0x7fb1a41a0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:23.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.451+0000 7fb1a9200640 1 -- 172.21.15.3:0/363700079 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1a4104fa0 msgr2=0x7fb1a419b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:23.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.451+0000 7fb1a9200640 1 --2- 172.21.15.3:0/363700079 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1a4104fa0 0x7fb1a419b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:23.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.451+0000 7fb1a9200640 1 -- 172.21.15.3:0/363700079 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1a410b330 msgr2=0x7fb1a41a0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:23.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.451+0000 7fb1a9200640 1 --2- 172.21.15.3:0/363700079 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1a410b330 0x7fb1a41a0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:23.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.451+0000 7fb1a9200640 1 -- 172.21.15.3:0/363700079 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1a41a1440 con 0x7fb1a410a9b0 2024-09-10T23:23:23.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.451+0000 7fb1a9200640 1 --2- 172.21.15.3:0/363700079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1a410a9b0 0x7fb1a419b8d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb19000e9f0 tx=0x7fb19000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:23.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.453+0000 7fb1a2000640 1 -- 172.21.15.3:0/363700079 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19000ccc0 con 0x7fb1a410a9b0 2024-09-10T23:23:23.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.453+0000 7fb1a2000640 1 -- 172.21.15.3:0/363700079 <== mon.2 v2:172.21.15.38:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb190005020 con 0x7fb1a410a9b0 2024-09-10T23:23:23.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.453+0000 7fb1a2000640 1 -- 172.21.15.3:0/363700079 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19000ce60 con 0x7fb1a410a9b0 2024-09-10T23:23:23.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.453+0000 7fb1ac600640 1 -- 172.21.15.3:0/363700079 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1a41a1730 con 0x7fb1a410a9b0 2024-09-10T23:23:23.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.453+0000 7fb1ac600640 1 -- 172.21.15.3:0/363700079 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1a41a7df0 con 0x7fb1a410a9b0 2024-09-10T23:23:23.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.454+0000 7fb1ac600640 1 -- 172.21.15.3:0/363700079 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1a4105380 con 0x7fb1a410a9b0 2024-09-10T23:23:23.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.457+0000 7fb1a2000640 1 -- 172.21.15.3:0/363700079 <== mon.2 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7fb190004a20 con 0x7fb1a410a9b0 2024-09-10T23:23:23.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.458+0000 7fb1a2000640 1 --2- 172.21.15.3:0/363700079 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb18c0b53b0 0x7fb18c0b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:23.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.458+0000 7fb1a2000640 1 -- 172.21.15.3:0/363700079 <== mon.2 v2:172.21.15.38:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7fb1900e5910 con 0x7fb1a410a9b0 2024-09-10T23:23:23.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.458+0000 7fb1a9c00640 1 --2- 172.21.15.3:0/363700079 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb18c0b53b0 0x7fb18c0b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:23.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.459+0000 7fb1a9c00640 1 --2- 172.21.15.3:0/363700079 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb18c0b53b0 0x7fb18c0b7870 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb198009c20 tx=0x7fb198005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:23.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.460+0000 7fb1a2000640 1 -- 172.21.15.3:0/363700079 <== mon.2 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb1900acb90 con 0x7fb1a410a9b0 2024-09-10T23:23:23.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.692+0000 7fb1ac600640 1 -- 172.21.15.3:0/363700079 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1a419c4c0 con 0x7fb1a410a9b0 2024-09-10T23:23:23.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.693+0000 7fb1a2000640 1 -- 172.21.15.3:0/363700079 <== mon.2 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4726 (secure 0 0 0) 0x7fb1900ac490 con 0x7fb1a410a9b0 2024-09-10T23:23:23.694 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:23:23.694 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":6,"btime":"2024-09-10T23:23:20:799232+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/1495411512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":1495411512},{"type":"v1","addr":"172.21.15.3:6835","nonce":1495411512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/1857372777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1857372777},{"type":"v1","addr":"172.21.15.3:6837","nonce":1857372777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/352514665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":352514665},{"type":"v1","addr":"172.21.15.194:6833","nonce":352514665}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34619,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/1194099617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1194099617},{"type":"v1","addr":"172.21.15.38:6833","nonce":1194099617}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34652,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/218783320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":218783320},{"type":"v1","addr":"172.21.15.38:6835","nonce":218783320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-10T23:23:23.694 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 6 2024-09-10T23:23:23.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.695+0000 7fb1ac600640 1 -- 172.21.15.3:0/363700079 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb18c0b53b0 msgr2=0x7fb18c0b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:23.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.695+0000 7fb1ac600640 1 --2- 172.21.15.3:0/363700079 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb18c0b53b0 0x7fb18c0b7870 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb198009c20 tx=0x7fb198005f90 comp rx=0 tx=0).stop 2024-09-10T23:23:23.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.695+0000 7fb1ac600640 1 -- 172.21.15.3:0/363700079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1a410a9b0 msgr2=0x7fb1a419b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:23.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.695+0000 7fb1ac600640 1 --2- 172.21.15.3:0/363700079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1a410a9b0 0x7fb1a419b8d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb19000e9f0 tx=0x7fb19000eeb0 comp rx=0 tx=0).stop 2024-09-10T23:23:23.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.696+0000 7fb1ac600640 1 -- 172.21.15.3:0/363700079 shutdown_connections 2024-09-10T23:23:23.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.696+0000 7fb1ac600640 1 --2- 172.21.15.3:0/363700079 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb18c0b53b0 0x7fb18c0b7870 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:23.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.696+0000 7fb1ac600640 1 --2- 172.21.15.3:0/363700079 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1a410b330 0x7fb1a41a0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:23.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.696+0000 7fb1ac600640 1 --2- 172.21.15.3:0/363700079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1a410a9b0 0x7fb1a419b8d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:23.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.696+0000 7fb1ac600640 1 --2- 172.21.15.3:0/363700079 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1a4104fa0 0x7fb1a419b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:23.698 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.696+0000 7fb1ac600640 1 -- 172.21.15.3:0/363700079 >> 172.21.15.3:0/363700079 conn(0x7fb1a4100a50 msgr2=0x7fb1a4102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:23.698 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.696+0000 7fb1ac600640 1 -- 172.21.15.3:0/363700079 shutdown_connections 2024-09-10T23:23:23.698 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:23.696+0000 7fb1ac600640 1 -- 172.21.15.3:0/363700079 wait complete. 2024-09-10T23:23:23.698 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 10 23:23:23 smithi194 podman[65724]: 2024-09-10 23:23:23.248926753 +0000 UTC m=+0.381477654 container start ca0eeceaff69b56486304de381b84d6d352b5cc473698a0d1ddbb4a9a9413458 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-f, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:23:23.698 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 10 23:23:23 smithi194 ceph-mds[65743]: -- 172.21.15.194:0/1153362500 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a7df853c20 con 0x55a7df831400 2024-09-10T23:23:23.698 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 10 23:23:23 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-f[65739]: starting mds.f at 2024-09-10T23:23:23.698 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 10 23:23:23 smithi194 bash[65724]: ca0eeceaff69b56486304de381b84d6d352b5cc473698a0d1ddbb4a9a9413458 2024-09-10T23:23:23.698 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 10 23:23:23 smithi194 systemd[1]: Started Ceph mds.f for 3f4e30d0-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:23:24.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:24 smithi194 ceph-mon[33904]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:24.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:24 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:24.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:24 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:24.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:24 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:24.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:24 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:24.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:24 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:24.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:24 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:24.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:24 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:24.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:24 smithi194 ceph-mon[33904]: Deploying daemon mds.c on smithi194 2024-09-10T23:23:24.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:24 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/363700079' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:24.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:24 smithi194 ceph-mon[33904]: mds.? [v2:172.21.15.194:6834/2380508105,v1:172.21.15.194:6835/2380508105] up:boot 2024-09-10T23:23:24.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:24 smithi194 ceph-mon[33904]: fsmap 6 up:standby 2024-09-10T23:23:24.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:24 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T23:23:24.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:24 smithi003 ceph-mon[30348]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:24.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:24 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:24.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:24 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:24.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:24 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:24.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:24 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:24.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:24 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:24.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:24 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:24.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:24 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:24.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:24 smithi003 ceph-mon[30348]: Deploying daemon mds.c on smithi194 2024-09-10T23:23:24.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:24 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/363700079' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:24.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:24 smithi003 ceph-mon[30348]: mds.? [v2:172.21.15.194:6834/2380508105,v1:172.21.15.194:6835/2380508105] up:boot 2024-09-10T23:23:24.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:24 smithi003 ceph-mon[30348]: fsmap 6 up:standby 2024-09-10T23:23:24.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:24 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T23:23:24.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:24 smithi038 ceph-mon[34225]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:24.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:24 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:24.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:24 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:24.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:24 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:24.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:24 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:24.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:24 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:24.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:24 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:24.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:24 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:24.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:24 smithi038 ceph-mon[34225]: Deploying daemon mds.c on smithi194 2024-09-10T23:23:24.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:24 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/363700079' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:24.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:24 smithi038 ceph-mon[34225]: mds.? [v2:172.21.15.194:6834/2380508105,v1:172.21.15.194:6835/2380508105] up:boot 2024-09-10T23:23:24.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:24 smithi038 ceph-mon[34225]: fsmap 6 up:standby 2024-09-10T23:23:24.849 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:24 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T23:23:26.433 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 10 23:23:26 smithi194 systemd[1]: Starting Ceph mds.c for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:23:26.436 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:23:26.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:26 smithi194 ceph-mon[33904]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:26.698 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 10 23:23:26 smithi194 podman[66038]: 2024-09-10 23:23:26.373498226 +0000 UTC m=+0.026918250 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:23:26.698 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 10 23:23:26 smithi194 podman[66038]: 2024-09-10 23:23:26.478829354 +0000 UTC m=+0.132249382 container create 2466729636bd0b066a58fbbbd54289a594bc8d86d2ae4b04872334b00a0cd2d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-c, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-10T23:23:26.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:26 smithi003 ceph-mon[30348]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:26.827 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:26.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:26 smithi038 ceph-mon[34225]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:27.197 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 10 23:23:26 smithi194 podman[66038]: 2024-09-10 23:23:26.740523323 +0000 UTC m=+0.393943347 container init 2466729636bd0b066a58fbbbd54289a594bc8d86d2ae4b04872334b00a0cd2d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-c, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-10T23:23:27.198 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 10 23:23:26 smithi194 podman[66038]: 2024-09-10 23:23:26.746959482 +0000 UTC m=+0.400379506 container start 2466729636bd0b066a58fbbbd54289a594bc8d86d2ae4b04872334b00a0cd2d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-c, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-10T23:23:27.198 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 10 23:23:26 smithi194 ceph-mds[66057]: -- 172.21.15.194:0/1188789447 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560aebfb9860 con 0x560aebf96800 2024-09-10T23:23:27.198 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 10 23:23:26 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-c[66053]: starting mds.c at 2024-09-10T23:23:27.198 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 10 23:23:26 smithi194 bash[66038]: 2466729636bd0b066a58fbbbd54289a594bc8d86d2ae4b04872334b00a0cd2d0 2024-09-10T23:23:27.198 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 10 23:23:26 smithi194 systemd[1]: Started Ceph mds.c for 3f4e30d0-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:23:27.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.395+0000 7f678a400640 1 -- 172.21.15.3:0/2662317839 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f67841093d0 msgr2=0x7f67841097b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:27.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.395+0000 7f678a400640 1 --2- 172.21.15.3:0/2662317839 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f67841093d0 0x7f67841097b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6774009900 tx=0x7f677402a410 comp rx=0 tx=0).stop 2024-09-10T23:23:27.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.395+0000 7f678a400640 1 -- 172.21.15.3:0/2662317839 shutdown_connections 2024-09-10T23:23:27.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.395+0000 7f678a400640 1 --2- 172.21.15.3:0/2662317839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f678410f760 0x7f6784115f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:27.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.395+0000 7f678a400640 1 --2- 172.21.15.3:0/2662317839 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f678410ede0 0x7f678410f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:27.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.395+0000 7f678a400640 1 --2- 172.21.15.3:0/2662317839 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f67841093d0 0x7f67841097b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:27.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.395+0000 7f678a400640 1 -- 172.21.15.3:0/2662317839 >> 172.21.15.3:0/2662317839 conn(0x7f6784078a40 msgr2=0x7f678407ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:27.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.395+0000 7f678a400640 1 -- 172.21.15.3:0/2662317839 shutdown_connections 2024-09-10T23:23:27.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.395+0000 7f678a400640 1 -- 172.21.15.3:0/2662317839 wait complete. 2024-09-10T23:23:27.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.396+0000 7f678a400640 1 Processor -- start 2024-09-10T23:23:27.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.396+0000 7f678a400640 1 -- start start 2024-09-10T23:23:27.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.397+0000 7f678a400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67841093d0 0x7f678419f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:27.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.397+0000 7f678a400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f678410ede0 0x7f678419fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:27.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.397+0000 7f678a400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f678410f760 0x7f67841a5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:27.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.397+0000 7f678a400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6784119220 con 0x7f678410f760 2024-09-10T23:23:27.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.397+0000 7f678a400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f67841190a0 con 0x7f678410ede0 2024-09-10T23:23:27.399 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.397+0000 7f678a400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f67841193a0 con 0x7f67841093d0 2024-09-10T23:23:27.400 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.397+0000 7f6783e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f678410f760 0x7f67841a5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:27.400 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.397+0000 7f6783400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67841093d0 0x7f678419f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:27.400 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.397+0000 7f677aa00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f678410ede0 0x7f678419fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:27.400 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.397+0000 7f6783400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67841093d0 0x7f678419f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.3:47538/0 (socket says 172.21.15.3:47538) 2024-09-10T23:23:27.400 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.397+0000 7f6783400640 1 -- 172.21.15.3:0/2698020359 learned_addr learned my addr 172.21.15.3:0/2698020359 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:23:27.400 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.398+0000 7f677aa00640 1 -- 172.21.15.3:0/2698020359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67841093d0 msgr2=0x7f678419f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:27.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.398+0000 7f677aa00640 1 --2- 172.21.15.3:0/2698020359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67841093d0 0x7f678419f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:27.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.398+0000 7f677aa00640 1 -- 172.21.15.3:0/2698020359 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f678410f760 msgr2=0x7f67841a5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:27.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.398+0000 7f677aa00640 1 --2- 172.21.15.3:0/2698020359 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f678410f760 0x7f67841a5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:27.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.398+0000 7f677aa00640 1 -- 172.21.15.3:0/2698020359 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67841a58e0 con 0x7f678410ede0 2024-09-10T23:23:27.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.398+0000 7f677aa00640 1 --2- 172.21.15.3:0/2698020359 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f678410ede0 0x7f678419fd70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f676c00e9f0 tx=0x7f676c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:27.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.398+0000 7f6780c00640 1 -- 172.21.15.3:0/2698020359 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676c00ccc0 con 0x7f678410ede0 2024-09-10T23:23:27.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.398+0000 7f6780c00640 1 -- 172.21.15.3:0/2698020359 <== mon.2 v2:172.21.15.38:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f676c0108c0 con 0x7f678410ede0 2024-09-10T23:23:27.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.398+0000 7f6780c00640 1 -- 172.21.15.3:0/2698020359 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676c0187e0 con 0x7f678410ede0 2024-09-10T23:23:27.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.398+0000 7f678a400640 1 -- 172.21.15.3:0/2698020359 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67841a5bd0 con 0x7f678410ede0 2024-09-10T23:23:27.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.398+0000 7f678a400640 1 -- 172.21.15.3:0/2698020359 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67841ac460 con 0x7f678410ede0 2024-09-10T23:23:27.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.399+0000 7f678a400640 1 -- 172.21.15.3:0/2698020359 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f678410a680 con 0x7f678410ede0 2024-09-10T23:23:27.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.402+0000 7f6780c00640 1 -- 172.21.15.3:0/2698020359 <== mon.2 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7f676c010430 con 0x7f678410ede0 2024-09-10T23:23:27.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.403+0000 7f6780c00640 1 --2- 172.21.15.3:0/2698020359 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f67680b53b0 0x7f67680b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:27.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.403+0000 7f6780c00640 1 -- 172.21.15.3:0/2698020359 <== mon.2 v2:172.21.15.38:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f676c0e5fe0 con 0x7f678410ede0 2024-09-10T23:23:27.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.403+0000 7f6783400640 1 --2- 172.21.15.3:0/2698020359 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f67680b53b0 0x7f67680b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:27.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.404+0000 7f6783400640 1 --2- 172.21.15.3:0/2698020359 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f67680b53b0 0x7f67680b7870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6774000c00 tx=0x7f6774009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:27.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.405+0000 7f6780c00640 1 -- 172.21.15.3:0/2698020359 <== mon.2 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f676c0acba0 con 0x7f678410ede0 2024-09-10T23:23:27.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.641+0000 7f678a400640 1 -- 172.21.15.3:0/2698020359 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f67841097b0 con 0x7f678410ede0 2024-09-10T23:23:27.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.642+0000 7f6780c00640 1 -- 172.21.15.3:0/2698020359 <== mon.2 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6379 (secure 0 0 0) 0x7f676c0ade20 con 0x7f678410ede0 2024-09-10T23:23:27.643 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:23:27.644 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":8,"btime":"2024-09-10T23:23:27:432064+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/1495411512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":1495411512},{"type":"v1","addr":"172.21.15.3:6835","nonce":1495411512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/1857372777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1857372777},{"type":"v1","addr":"172.21.15.3:6837","nonce":1857372777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/352514665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":352514665},{"type":"v1","addr":"172.21.15.194:6833","nonce":352514665}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2380508105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2380508105},{"type":"v1","addr":"172.21.15.194:6835","nonce":2380508105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/739730313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":739730313},{"type":"v1","addr":"172.21.15.194:6837","nonce":739730313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":34619,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/1194099617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1194099617},{"type":"v1","addr":"172.21.15.38:6833","nonce":1194099617}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34652,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/218783320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":218783320},{"type":"v1","addr":"172.21.15.38:6835","nonce":218783320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-10T23:23:27.644 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 8 2024-09-10T23:23:27.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.644+0000 7f678a400640 1 -- 172.21.15.3:0/2698020359 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f67680b53b0 msgr2=0x7f67680b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:27.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.644+0000 7f678a400640 1 --2- 172.21.15.3:0/2698020359 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f67680b53b0 0x7f67680b7870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6774000c00 tx=0x7f6774009560 comp rx=0 tx=0).stop 2024-09-10T23:23:27.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.644+0000 7f678a400640 1 -- 172.21.15.3:0/2698020359 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f678410ede0 msgr2=0x7f678419fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:27.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.644+0000 7f678a400640 1 --2- 172.21.15.3:0/2698020359 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f678410ede0 0x7f678419fd70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f676c00e9f0 tx=0x7f676c00eeb0 comp rx=0 tx=0).stop 2024-09-10T23:23:27.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.645+0000 7f678a400640 1 -- 172.21.15.3:0/2698020359 shutdown_connections 2024-09-10T23:23:27.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.645+0000 7f678a400640 1 --2- 172.21.15.3:0/2698020359 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f67680b53b0 0x7f67680b7870 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:27.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.645+0000 7f678a400640 1 --2- 172.21.15.3:0/2698020359 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f678410f760 0x7f67841a5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:27.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.645+0000 7f678a400640 1 --2- 172.21.15.3:0/2698020359 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f678410ede0 0x7f678419fd70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:27.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.645+0000 7f678a400640 1 --2- 172.21.15.3:0/2698020359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67841093d0 0x7f678419f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:27.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.645+0000 7f678a400640 1 -- 172.21.15.3:0/2698020359 >> 172.21.15.3:0/2698020359 conn(0x7f6784078a40 msgr2=0x7f67840794a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:27.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.645+0000 7f678a400640 1 -- 172.21.15.3:0/2698020359 shutdown_connections 2024-09-10T23:23:27.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:27.645+0000 7f678a400640 1 -- 172.21.15.3:0/2698020359 wait complete. 2024-09-10T23:23:28.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:27 smithi038 ceph-mon[34225]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:28.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:27 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:28.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:27 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:28.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:27 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:28.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:27 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:28.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:27 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:28.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:27 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:28.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:27 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:28.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:27 smithi038 ceph-mon[34225]: Deploying daemon mds.h on smithi038 2024-09-10T23:23:28.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:27 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T23:23:28.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:27 smithi038 ceph-mon[34225]: mds.? [v2:172.21.15.194:6836/739730313,v1:172.21.15.194:6837/739730313] up:boot 2024-09-10T23:23:28.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:27 smithi038 ceph-mon[34225]: fsmap 7 up:standby 2024-09-10T23:23:28.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:27 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2698020359' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:28.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:27 smithi194 ceph-mon[33904]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:28.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:27 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:28.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:27 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:28.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:27 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:28.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:27 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:28.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:27 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:28.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:27 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:28.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:27 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:28.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:27 smithi194 ceph-mon[33904]: Deploying daemon mds.h on smithi038 2024-09-10T23:23:28.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:27 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T23:23:28.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:27 smithi194 ceph-mon[33904]: mds.? [v2:172.21.15.194:6836/739730313,v1:172.21.15.194:6837/739730313] up:boot 2024-09-10T23:23:28.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:27 smithi194 ceph-mon[33904]: fsmap 7 up:standby 2024-09-10T23:23:28.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:27 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2698020359' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:28.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:27 smithi003 ceph-mon[30348]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:28.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:27 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:28.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:27 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:28.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:27 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:28.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:27 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:28.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:27 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:28.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:27 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:28.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:27 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:28.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:27 smithi003 ceph-mon[30348]: Deploying daemon mds.h on smithi038 2024-09-10T23:23:28.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:27 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T23:23:28.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:27 smithi003 ceph-mon[30348]: mds.? [v2:172.21.15.194:6836/739730313,v1:172.21.15.194:6837/739730313] up:boot 2024-09-10T23:23:28.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:27 smithi003 ceph-mon[30348]: fsmap 7 up:standby 2024-09-10T23:23:28.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:27 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2698020359' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:29.666 INFO:journalctl@ceph.mds.h.smithi038.stdout:Sep 10 23:23:29 smithi038 systemd[1]: Starting Ceph mds.h for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:23:29.917 INFO:journalctl@ceph.mds.h.smithi038.stdout:Sep 10 23:23:29 smithi038 podman[65324]: 2024-09-10 23:23:29.569653667 +0000 UTC m=+0.027406800 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:23:29.918 INFO:journalctl@ceph.mds.h.smithi038.stdout:Sep 10 23:23:29 smithi038 podman[65324]: 2024-09-10 23:23:29.692167602 +0000 UTC m=+0.149920733 container create f5826b115319c814e3f64cd7114886c2563bb5bf6d66d1658b026e61ea513b20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-h, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:23:30.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:29 smithi194 ceph-mon[33904]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:30.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:29 smithi003 ceph-mon[30348]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:30.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:29 smithi038 ceph-mon[34225]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:30.347 INFO:journalctl@ceph.mds.h.smithi038.stdout:Sep 10 23:23:29 smithi038 podman[65324]: 2024-09-10 23:23:29.962495673 +0000 UTC m=+0.420248831 container init f5826b115319c814e3f64cd7114886c2563bb5bf6d66d1658b026e61ea513b20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-h, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-10T23:23:30.347 INFO:journalctl@ceph.mds.h.smithi038.stdout:Sep 10 23:23:29 smithi038 podman[65324]: 2024-09-10 23:23:29.969218698 +0000 UTC m=+0.426971830 container start f5826b115319c814e3f64cd7114886c2563bb5bf6d66d1658b026e61ea513b20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-h, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-10T23:23:30.348 INFO:journalctl@ceph.mds.h.smithi038.stdout:Sep 10 23:23:30 smithi038 ceph-mds[65343]: -- 172.21.15.38:0/543006853 <== mon.2 v2:172.21.15.38:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d6f1fe3860 con 0x55d6f1fc0800 2024-09-10T23:23:30.348 INFO:journalctl@ceph.mds.h.smithi038.stdout:Sep 10 23:23:30 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-h[65339]: starting mds.h at 2024-09-10T23:23:30.348 INFO:journalctl@ceph.mds.h.smithi038.stdout:Sep 10 23:23:30 smithi038 bash[65324]: f5826b115319c814e3f64cd7114886c2563bb5bf6d66d1658b026e61ea513b20 2024-09-10T23:23:30.348 INFO:journalctl@ceph.mds.h.smithi038.stdout:Sep 10 23:23:30 smithi038 systemd[1]: Started Ceph mds.h for 3f4e30d0-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:23:30.489 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:23:30.879 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:31.293 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:31 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:31.293 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:31 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:31.293 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:31 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:31.293 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:31 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:31.293 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:31 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:31.293 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:31 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:31.293 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:31 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:31.293 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:31 smithi003 ceph-mon[30348]: Deploying daemon mds.i on smithi194 2024-09-10T23:23:31.293 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:31 smithi003 ceph-mon[30348]: mds.? [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] up:boot 2024-09-10T23:23:31.293 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:31 smithi003 ceph-mon[30348]: fsmap 8 up:standby 2024-09-10T23:23:31.294 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:31 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T23:23:31.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.403+0000 7f78daa00640 1 -- 172.21.15.3:0/888970535 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78d410b350 msgr2=0x7f78d4111b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:31.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.403+0000 7f78daa00640 1 --2- 172.21.15.3:0/888970535 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78d410b350 0x7f78d4111b50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f78cc009ca0 tx=0x7f78cc02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:23:31.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.403+0000 7f78daa00640 1 -- 172.21.15.3:0/888970535 shutdown_connections 2024-09-10T23:23:31.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.403+0000 7f78daa00640 1 --2- 172.21.15.3:0/888970535 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78d410b350 0x7f78d4111b50 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:31.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.403+0000 7f78daa00640 1 --2- 172.21.15.3:0/888970535 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78d410a9d0 0x7f78d410ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:31.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.404+0000 7f78daa00640 1 --2- 172.21.15.3:0/888970535 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78d4104fc0 0x7f78d41053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:31.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.404+0000 7f78daa00640 1 -- 172.21.15.3:0/888970535 >> 172.21.15.3:0/888970535 conn(0x7f78d41009f0 msgr2=0x7f78d4102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:31.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.404+0000 7f78daa00640 1 -- 172.21.15.3:0/888970535 shutdown_connections 2024-09-10T23:23:31.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.404+0000 7f78daa00640 1 -- 172.21.15.3:0/888970535 wait complete. 2024-09-10T23:23:31.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.404+0000 7f78daa00640 1 Processor -- start 2024-09-10T23:23:31.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.405+0000 7f78daa00640 1 -- start start 2024-09-10T23:23:31.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.405+0000 7f78daa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78d4104fc0 0x7f78d419b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:31.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.405+0000 7f78daa00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78d410a9d0 0x7f78d419b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:31.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.405+0000 7f78daa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78d410b350 0x7f78d41a0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:31.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.405+0000 7f78daa00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f78d4114e80 con 0x7f78d4104fc0 2024-09-10T23:23:31.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.405+0000 7f78daa00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f78d4114d00 con 0x7f78d410a9d0 2024-09-10T23:23:31.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.405+0000 7f78daa00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f78d4115000 con 0x7f78d410b350 2024-09-10T23:23:31.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.405+0000 7f78d3e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78d4104fc0 0x7f78d419b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:31.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.405+0000 7f78cbe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78d410a9d0 0x7f78d419b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:31.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.405+0000 7f78d3e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78d4104fc0 0x7f78d419b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45000/0 (socket says 172.21.15.3:45000) 2024-09-10T23:23:31.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.405+0000 7f78cbe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78d410a9d0 0x7f78d419b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.3:38424/0 (socket says 172.21.15.3:38424) 2024-09-10T23:23:31.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.405+0000 7f78d3e00640 1 -- 172.21.15.3:0/4266908558 learned_addr learned my addr 172.21.15.3:0/4266908558 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:23:31.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.405+0000 7f78d8a00640 1 --2- 172.21.15.3:0/4266908558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78d410b350 0x7f78d41a0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:31.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.406+0000 7f78d3e00640 1 -- 172.21.15.3:0/4266908558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78d410b350 msgr2=0x7f78d41a0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:31.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.406+0000 7f78d3e00640 1 --2- 172.21.15.3:0/4266908558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78d410b350 0x7f78d41a0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:31.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.406+0000 7f78d3e00640 1 -- 172.21.15.3:0/4266908558 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78d410a9d0 msgr2=0x7f78d419b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:31.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.406+0000 7f78d3e00640 1 --2- 172.21.15.3:0/4266908558 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78d410a9d0 0x7f78d419b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:31.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.406+0000 7f78d3e00640 1 -- 172.21.15.3:0/4266908558 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d41a1400 con 0x7f78d4104fc0 2024-09-10T23:23:31.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.406+0000 7f78cbe00640 1 --2- 172.21.15.3:0/4266908558 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78d410a9d0 0x7f78d419b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:23:31.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.406+0000 7f78d3e00640 1 --2- 172.21.15.3:0/4266908558 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78d4104fc0 0x7f78d419b350 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f78c400e9f0 tx=0x7f78c400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:31.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.406+0000 7f78d1600640 1 -- 172.21.15.3:0/4266908558 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c400cd80 con 0x7f78d4104fc0 2024-09-10T23:23:31.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.406+0000 7f78d1600640 1 -- 172.21.15.3:0/4266908558 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f78c40054b0 con 0x7f78d4104fc0 2024-09-10T23:23:31.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.406+0000 7f78daa00640 1 -- 172.21.15.3:0/4266908558 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78d41a16f0 con 0x7f78d4104fc0 2024-09-10T23:23:31.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.406+0000 7f78d1600640 1 -- 172.21.15.3:0/4266908558 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c4010430 con 0x7f78d4104fc0 2024-09-10T23:23:31.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.407+0000 7f78daa00640 1 -- 172.21.15.3:0/4266908558 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78d41a7db0 con 0x7f78d4104fc0 2024-09-10T23:23:31.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.408+0000 7f78daa00640 1 -- 172.21.15.3:0/4266908558 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78d41053a0 con 0x7f78d4104fc0 2024-09-10T23:23:31.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.412+0000 7f78d1600640 1 -- 172.21.15.3:0/4266908558 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7f78c4005000 con 0x7f78d4104fc0 2024-09-10T23:23:31.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.413+0000 7f78d1600640 1 --2- 172.21.15.3:0/4266908558 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f78b80b53b0 0x7f78b80b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:31.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.413+0000 7f78d1600640 1 -- 172.21.15.3:0/4266908558 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f78c40e5e30 con 0x7f78d4104fc0 2024-09-10T23:23:31.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.413+0000 7f78cbe00640 1 --2- 172.21.15.3:0/4266908558 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f78b80b53b0 0x7f78b80b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:31.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.414+0000 7f78cbe00640 1 --2- 172.21.15.3:0/4266908558 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f78b80b53b0 0x7f78b80b7870 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f78d4107480 tx=0x7f78bc00b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:31.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.415+0000 7f78d1600640 1 -- 172.21.15.3:0/4266908558 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f78c4056220 con 0x7f78d4104fc0 2024-09-10T23:23:31.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:31 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:31.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:31 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:31.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:31 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:31.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:31 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:31.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:31 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:31.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:31 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:31.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:31 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:31.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:31 smithi194 ceph-mon[33904]: Deploying daemon mds.i on smithi194 2024-09-10T23:23:31.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:31 smithi194 ceph-mon[33904]: mds.? [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] up:boot 2024-09-10T23:23:31.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:31 smithi194 ceph-mon[33904]: fsmap 8 up:standby 2024-09-10T23:23:31.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:31 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T23:23:31.475 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:31 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:31.475 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:31 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:31.475 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:31 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:31.476 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:31 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:31.476 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:31 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:31.476 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:31 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:31.476 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:31 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:31.476 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:31 smithi038 ceph-mon[34225]: Deploying daemon mds.i on smithi194 2024-09-10T23:23:31.476 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:31 smithi038 ceph-mon[34225]: mds.? [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] up:boot 2024-09-10T23:23:31.476 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:31 smithi038 ceph-mon[34225]: fsmap 8 up:standby 2024-09-10T23:23:31.476 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:31 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T23:23:31.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.652+0000 7f78daa00640 1 -- 172.21.15.3:0/4266908558 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78d41a81b0 con 0x7f78d4104fc0 2024-09-10T23:23:31.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.652+0000 7f78d1600640 1 -- 172.21.15.3:0/4266908558 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7204 (secure 0 0 0) 0x7f78c40ad020 con 0x7f78d4104fc0 2024-09-10T23:23:31.654 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:23:31.654 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":9,"btime":"2024-09-10T23:23:30:916644+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/1495411512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":1495411512},{"type":"v1","addr":"172.21.15.3:6835","nonce":1495411512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/1857372777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1857372777},{"type":"v1","addr":"172.21.15.3:6837","nonce":1857372777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/352514665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":352514665},{"type":"v1","addr":"172.21.15.194:6833","nonce":352514665}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2380508105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2380508105},{"type":"v1","addr":"172.21.15.194:6835","nonce":2380508105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/739730313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":739730313},{"type":"v1","addr":"172.21.15.194:6837","nonce":739730313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":34619,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/1194099617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1194099617},{"type":"v1","addr":"172.21.15.38:6833","nonce":1194099617}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34652,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/218783320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":218783320},{"type":"v1","addr":"172.21.15.38:6835","nonce":218783320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34682,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/1821839397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":1821839397},{"type":"v1","addr":"172.21.15.38:6837","nonce":1821839397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-10T23:23:31.654 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 9 2024-09-10T23:23:31.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.655+0000 7f78daa00640 1 -- 172.21.15.3:0/4266908558 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f78b80b53b0 msgr2=0x7f78b80b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:31.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.655+0000 7f78daa00640 1 --2- 172.21.15.3:0/4266908558 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f78b80b53b0 0x7f78b80b7870 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f78d4107480 tx=0x7f78bc00b410 comp rx=0 tx=0).stop 2024-09-10T23:23:31.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.655+0000 7f78daa00640 1 -- 172.21.15.3:0/4266908558 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78d4104fc0 msgr2=0x7f78d419b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:31.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.655+0000 7f78daa00640 1 --2- 172.21.15.3:0/4266908558 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78d4104fc0 0x7f78d419b350 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f78c400e9f0 tx=0x7f78c400edf0 comp rx=0 tx=0).stop 2024-09-10T23:23:31.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.655+0000 7f78daa00640 1 -- 172.21.15.3:0/4266908558 shutdown_connections 2024-09-10T23:23:31.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.655+0000 7f78daa00640 1 --2- 172.21.15.3:0/4266908558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78d410b350 0x7f78d41a0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:31.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.655+0000 7f78daa00640 1 --2- 172.21.15.3:0/4266908558 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78d410a9d0 0x7f78d419b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:31.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.655+0000 7f78daa00640 1 --2- 172.21.15.3:0/4266908558 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f78b80b53b0 0x7f78b80b7870 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:31.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.655+0000 7f78daa00640 1 --2- 172.21.15.3:0/4266908558 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78d4104fc0 0x7f78d419b350 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:31.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.655+0000 7f78daa00640 1 -- 172.21.15.3:0/4266908558 >> 172.21.15.3:0/4266908558 conn(0x7f78d41009f0 msgr2=0x7f78d4101250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:31.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.655+0000 7f78daa00640 1 -- 172.21.15.3:0/4266908558 shutdown_connections 2024-09-10T23:23:31.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:31.655+0000 7f78daa00640 1 -- 172.21.15.3:0/4266908558 wait complete. 2024-09-10T23:23:32.422 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:32 smithi003 ceph-mon[30348]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:32.422 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:32 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/4266908558' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:32.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:32 smithi194 ceph-mon[33904]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:32.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:32 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/4266908558' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:32.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:32 smithi038 ceph-mon[34225]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:32.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:32 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/4266908558' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:32.947 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 10 23:23:32 smithi194 systemd[1]: Starting Ceph mds.i for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:23:33.271 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 10 23:23:33 smithi194 podman[66338]: 2024-09-10 23:23:32.912268315 +0000 UTC m=+0.026865189 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:23:33.271 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 10 23:23:33 smithi194 podman[66338]: 2024-09-10 23:23:33.043005989 +0000 UTC m=+0.157602852 container create a1a9eedf5869029543da3955ad96e15fa0eca49b6d8a45305ded7d20b7b883be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-10T23:23:33.271 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 10 23:23:33 smithi194 podman[66338]: 2024-09-10 23:23:33.270755435 +0000 UTC m=+0.385352300 container init a1a9eedf5869029543da3955ad96e15fa0eca49b6d8a45305ded7d20b7b883be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-i, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD) 2024-09-10T23:23:33.697 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 10 23:23:33 smithi194 podman[66338]: 2024-09-10 23:23:33.27691583 +0000 UTC m=+0.391512693 container start a1a9eedf5869029543da3955ad96e15fa0eca49b6d8a45305ded7d20b7b883be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-i, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-09-10T23:23:33.697 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 10 23:23:33 smithi194 ceph-mds[66357]: -- 172.21.15.194:0/1026905689 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5576588db860 con 0x5576588b9400 2024-09-10T23:23:33.697 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 10 23:23:33 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-i[66353]: starting mds.i at 2024-09-10T23:23:33.697 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 10 23:23:33 smithi194 bash[66338]: a1a9eedf5869029543da3955ad96e15fa0eca49b6d8a45305ded7d20b7b883be 2024-09-10T23:23:33.697 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 10 23:23:33 smithi194 systemd[1]: Started Ceph mds.i for 3f4e30d0-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:23:34.462 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:23:34.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:34 smithi003 ceph-mon[30348]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:34.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:34 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:34.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:34 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:34.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:34 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:34.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:34 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:34.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:34 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:34.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:34 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:34.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:34 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:34.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:34 smithi003 ceph-mon[30348]: Deploying daemon mds.g on smithi003 2024-09-10T23:23:34.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:34 smithi003 ceph-mon[30348]: mds.? [v2:172.21.15.194:6838/3198777710,v1:172.21.15.194:6839/3198777710] up:boot 2024-09-10T23:23:34.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:34 smithi003 ceph-mon[30348]: fsmap 9 up:standby 2024-09-10T23:23:34.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:34 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T23:23:34.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:34 smithi038 ceph-mon[34225]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:34.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:34 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:34.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:34 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:34.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:34 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:34.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:34 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:34.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:34 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:34.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:34 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:34.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:34 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:34.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:34 smithi038 ceph-mon[34225]: Deploying daemon mds.g on smithi003 2024-09-10T23:23:34.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:34 smithi038 ceph-mon[34225]: mds.? [v2:172.21.15.194:6838/3198777710,v1:172.21.15.194:6839/3198777710] up:boot 2024-09-10T23:23:34.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:34 smithi038 ceph-mon[34225]: fsmap 9 up:standby 2024-09-10T23:23:34.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:34 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T23:23:34.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:34 smithi194 ceph-mon[33904]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:34.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:34 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:34.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:34 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:34.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:34 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:34.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:34 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:34.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:34 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:34.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:34 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:34.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:34 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:34.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:34 smithi194 ceph-mon[33904]: Deploying daemon mds.g on smithi003 2024-09-10T23:23:34.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:34 smithi194 ceph-mon[33904]: mds.? [v2:172.21.15.194:6838/3198777710,v1:172.21.15.194:6839/3198777710] up:boot 2024-09-10T23:23:34.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:34 smithi194 ceph-mon[33904]: fsmap 9 up:standby 2024-09-10T23:23:34.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:34 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T23:23:35.223 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:35.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.874+0000 7fd30ec00640 1 -- 172.21.15.3:0/1711798604 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd308102c10 msgr2=0x7fd308102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:35.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.874+0000 7fd30ec00640 1 --2- 172.21.15.3:0/1711798604 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd308102c10 0x7fd308102ff0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc009900 tx=0x7fd2fc02a410 comp rx=0 tx=0).stop 2024-09-10T23:23:35.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.874+0000 7fd30ec00640 1 -- 172.21.15.3:0/1711798604 shutdown_connections 2024-09-10T23:23:35.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.874+0000 7fd30ec00640 1 --2- 172.21.15.3:0/1711798604 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd308108fa0 0x7fd30810f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.874+0000 7fd30ec00640 1 --2- 172.21.15.3:0/1711798604 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd308108620 0x7fd308108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.874+0000 7fd30ec00640 1 --2- 172.21.15.3:0/1711798604 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd308102c10 0x7fd308102ff0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.874+0000 7fd30ec00640 1 -- 172.21.15.3:0/1711798604 >> 172.21.15.3:0/1711798604 conn(0x7fd3080fe660 msgr2=0x7fd308100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:35.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.874+0000 7fd30ec00640 1 -- 172.21.15.3:0/1711798604 shutdown_connections 2024-09-10T23:23:35.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.874+0000 7fd30ec00640 1 -- 172.21.15.3:0/1711798604 wait complete. 2024-09-10T23:23:35.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.875+0000 7fd30ec00640 1 Processor -- start 2024-09-10T23:23:35.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.876+0000 7fd30ec00640 1 -- start start 2024-09-10T23:23:35.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.876+0000 7fd30ec00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd308102c10 0x7fd3080754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:35.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.876+0000 7fd30ec00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd308108620 0x7fd3080759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:35.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.876+0000 7fd30ec00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd308108fa0 0x7fd308075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:35.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.876+0000 7fd30ec00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd308112b60 con 0x7fd308108620 2024-09-10T23:23:35.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.876+0000 7fd30ec00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd3081129e0 con 0x7fd308108fa0 2024-09-10T23:23:35.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.876+0000 7fd30ec00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd308112ce0 con 0x7fd308102c10 2024-09-10T23:23:35.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.876+0000 7fd30ce00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd308108620 0x7fd3080759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:35.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.876+0000 7fd30ce00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd308108620 0x7fd3080759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45022/0 (socket says 172.21.15.3:45022) 2024-09-10T23:23:35.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.876+0000 7fd30ce00640 1 -- 172.21.15.3:0/2951390423 learned_addr learned my addr 172.21.15.3:0/2951390423 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:23:35.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.876+0000 7fd30d800640 1 --2- 172.21.15.3:0/2951390423 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd308102c10 0x7fd3080754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:35.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.877+0000 7fd30e200640 1 --2- 172.21.15.3:0/2951390423 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd308108fa0 0x7fd308075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:35.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.877+0000 7fd30ce00640 1 -- 172.21.15.3:0/2951390423 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd308102c10 msgr2=0x7fd3080754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:35.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.877+0000 7fd30ce00640 1 --2- 172.21.15.3:0/2951390423 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd308102c10 0x7fd3080754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.877+0000 7fd30ce00640 1 -- 172.21.15.3:0/2951390423 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd308108fa0 msgr2=0x7fd308075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:35.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.877+0000 7fd30ce00640 1 --2- 172.21.15.3:0/2951390423 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd308108fa0 0x7fd308075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:35.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.877+0000 7fd30ce00640 1 -- 172.21.15.3:0/2951390423 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3081a7430 con 0x7fd308108620 2024-09-10T23:23:35.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.877+0000 7fd30e200640 1 --2- 172.21.15.3:0/2951390423 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd308108fa0 0x7fd308075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:23:35.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.877+0000 7fd30d800640 1 --2- 172.21.15.3:0/2951390423 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd308102c10 0x7fd3080754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:23:35.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.877+0000 7fd30ce00640 1 --2- 172.21.15.3:0/2951390423 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd308108620 0x7fd3080759e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd2f800e9f0 tx=0x7fd2f800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:35.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.878+0000 7fd306000640 1 -- 172.21.15.3:0/2951390423 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f800cd80 con 0x7fd308108620 2024-09-10T23:23:35.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.878+0000 7fd306000640 1 -- 172.21.15.3:0/2951390423 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd2f80108c0 con 0x7fd308108620 2024-09-10T23:23:35.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.878+0000 7fd306000640 1 -- 172.21.15.3:0/2951390423 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f80187c0 con 0x7fd308108620 2024-09-10T23:23:35.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.878+0000 7fd30ec00640 1 -- 172.21.15.3:0/2951390423 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3081a7720 con 0x7fd308108620 2024-09-10T23:23:35.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.878+0000 7fd30ec00640 1 -- 172.21.15.3:0/2951390423 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3081a7c10 con 0x7fd308108620 2024-09-10T23:23:35.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.879+0000 7fd30ec00640 1 -- 172.21.15.3:0/2951390423 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd308102ff0 con 0x7fd308108620 2024-09-10T23:23:35.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.882+0000 7fd306000640 1 -- 172.21.15.3:0/2951390423 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7fd2f8010430 con 0x7fd308108620 2024-09-10T23:23:35.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.884+0000 7fd306000640 1 --2- 172.21.15.3:0/2951390423 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd2f00b5460 0x7fd2f00b7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:35.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.884+0000 7fd306000640 1 -- 172.21.15.3:0/2951390423 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7fd2f80e60d0 con 0x7fd308108620 2024-09-10T23:23:35.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.884+0000 7fd30d800640 1 --2- 172.21.15.3:0/2951390423 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd2f00b5460 0x7fd2f00b7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:35.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.885+0000 7fd30d800640 1 --2- 172.21.15.3:0/2951390423 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd2f00b5460 0x7fd2f00b7920 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc006010 tx=0x7fd2fc000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:35.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:35.885+0000 7fd306000640 1 -- 172.21.15.3:0/2951390423 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd2f80ad360 con 0x7fd308108620 2024-09-10T23:23:36.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:36.137+0000 7fd30ec00640 1 -- 172.21.15.3:0/2951390423 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd3080767a0 con 0x7fd308108620 2024-09-10T23:23:36.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:36.138+0000 7fd306000640 1 -- 172.21.15.3:0/2951390423 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8034 (secure 0 0 0) 0x7fd2f80acc60 con 0x7fd308108620 2024-09-10T23:23:36.139 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:23:36.139 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":10,"btime":"2024-09-10T23:23:34:163207+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/1495411512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":1495411512},{"type":"v1","addr":"172.21.15.3:6835","nonce":1495411512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/1857372777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1857372777},{"type":"v1","addr":"172.21.15.3:6837","nonce":1857372777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/352514665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":352514665},{"type":"v1","addr":"172.21.15.194:6833","nonce":352514665}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2380508105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2380508105},{"type":"v1","addr":"172.21.15.194:6835","nonce":2380508105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/739730313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":739730313},{"type":"v1","addr":"172.21.15.194:6837","nonce":739730313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24673,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6839/3198777710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3198777710},{"type":"v1","addr":"172.21.15.194:6839","nonce":3198777710}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34619,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/1194099617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1194099617},{"type":"v1","addr":"172.21.15.38:6833","nonce":1194099617}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34652,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/218783320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":218783320},{"type":"v1","addr":"172.21.15.38:6835","nonce":218783320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34682,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/1821839397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":1821839397},{"type":"v1","addr":"172.21.15.38:6837","nonce":1821839397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-10T23:23:36.140 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 10 2024-09-10T23:23:36.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:36.140+0000 7fd30ec00640 1 -- 172.21.15.3:0/2951390423 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd2f00b5460 msgr2=0x7fd2f00b7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:36.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:36.140+0000 7fd30ec00640 1 --2- 172.21.15.3:0/2951390423 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd2f00b5460 0x7fd2f00b7920 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc006010 tx=0x7fd2fc000bc0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:36.140+0000 7fd30ec00640 1 -- 172.21.15.3:0/2951390423 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd308108620 msgr2=0x7fd3080759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:36.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:36.140+0000 7fd30ec00640 1 --2- 172.21.15.3:0/2951390423 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd308108620 0x7fd3080759e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd2f800e9f0 tx=0x7fd2f800eeb0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:36.140+0000 7fd30ec00640 1 -- 172.21.15.3:0/2951390423 shutdown_connections 2024-09-10T23:23:36.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:36.141+0000 7fd30ec00640 1 --2- 172.21.15.3:0/2951390423 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd308108fa0 0x7fd308075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:36.141+0000 7fd30ec00640 1 --2- 172.21.15.3:0/2951390423 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd2f00b5460 0x7fd2f00b7920 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:36.141+0000 7fd30ec00640 1 --2- 172.21.15.3:0/2951390423 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd308108620 0x7fd3080759e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:36.141+0000 7fd30ec00640 1 --2- 172.21.15.3:0/2951390423 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd308102c10 0x7fd3080754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:36.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:36.141+0000 7fd30ec00640 1 -- 172.21.15.3:0/2951390423 >> 172.21.15.3:0/2951390423 conn(0x7fd3080fe660 msgr2=0x7fd3080fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:36.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:36.141+0000 7fd30ec00640 1 -- 172.21.15.3:0/2951390423 shutdown_connections 2024-09-10T23:23:36.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:36.141+0000 7fd30ec00640 1 -- 172.21.15.3:0/2951390423 wait complete. 2024-09-10T23:23:36.453 INFO:journalctl@ceph.mds.g.smithi003.stdout:Sep 10 23:23:36 smithi003 podman[75975]: 2024-09-10 23:23:36.204451809 +0000 UTC m=+0.028517952 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:23:36.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:36 smithi003 ceph-mon[30348]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:36.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:36 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2951390423' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:36.721 INFO:journalctl@ceph.mds.g.smithi003.stdout:Sep 10 23:23:36 smithi003 podman[75975]: 2024-09-10 23:23:36.662844704 +0000 UTC m=+0.486910852 container create cbbf94f8749d7c50788fc68f766d2c971dda9979805fa7f270ba9f7fda53f40f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-g, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-10T23:23:36.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:36 smithi038 ceph-mon[34225]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:36.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:36 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2951390423' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:36.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:36 smithi194 ceph-mon[33904]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:36.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:36 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2951390423' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:37.461 INFO:journalctl@ceph.mds.g.smithi003.stdout:Sep 10 23:23:37 smithi003 podman[75975]: 2024-09-10 23:23:37.360362572 +0000 UTC m=+1.184428719 container init cbbf94f8749d7c50788fc68f766d2c971dda9979805fa7f270ba9f7fda53f40f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-g, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-10T23:23:37.461 INFO:journalctl@ceph.mds.g.smithi003.stdout:Sep 10 23:23:37 smithi003 podman[75975]: 2024-09-10 23:23:37.367119101 +0000 UTC m=+1.191185254 container start cbbf94f8749d7c50788fc68f766d2c971dda9979805fa7f270ba9f7fda53f40f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-10T23:23:37.461 INFO:journalctl@ceph.mds.g.smithi003.stdout:Sep 10 23:23:37 smithi003 ceph-mds[76008]: -- 172.21.15.3:0/1085602013 <== mon.0 v2:172.21.15.3:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ebf29d7860 con 0x55ebf29b5000 2024-09-10T23:23:37.461 INFO:journalctl@ceph.mds.g.smithi003.stdout:Sep 10 23:23:37 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-g[76004]: starting mds.g at 2024-09-10T23:23:37.720 INFO:journalctl@ceph.mds.g.smithi003.stdout:Sep 10 23:23:37 smithi003 bash[75975]: cbbf94f8749d7c50788fc68f766d2c971dda9979805fa7f270ba9f7fda53f40f 2024-09-10T23:23:37.720 INFO:journalctl@ceph.mds.g.smithi003.stdout:Sep 10 23:23:37 smithi003 systemd[1]: Started Ceph mds.g for 3f4e30d0-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:23:38.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:38 smithi003 ceph-mon[30348]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:38.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:38 smithi003 ceph-mon[30348]: mds.? [v2:172.21.15.3:6838/493850676,v1:172.21.15.3:6839/493850676] up:boot 2024-09-10T23:23:38.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:38 smithi003 ceph-mon[30348]: fsmap 10 up:standby 2024-09-10T23:23:38.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:38 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T23:23:38.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:38 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:38.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:38 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:38.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:38 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:38.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:38 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:38.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:38 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:38.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:38 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:38.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:38 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:38.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:38 smithi003 ceph-mon[30348]: Deploying daemon mds.a on smithi003 2024-09-10T23:23:38.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:38 smithi038 ceph-mon[34225]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:38.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:38 smithi038 ceph-mon[34225]: mds.? [v2:172.21.15.3:6838/493850676,v1:172.21.15.3:6839/493850676] up:boot 2024-09-10T23:23:38.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:38 smithi038 ceph-mon[34225]: fsmap 10 up:standby 2024-09-10T23:23:38.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:38 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T23:23:38.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:38 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:38.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:38 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:38.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:38 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:38.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:38 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:38.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:38 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:38.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:38 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:38.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:38 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:38.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:38 smithi038 ceph-mon[34225]: Deploying daemon mds.a on smithi003 2024-09-10T23:23:38.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:38 smithi194 ceph-mon[33904]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:38.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:38 smithi194 ceph-mon[33904]: mds.? [v2:172.21.15.3:6838/493850676,v1:172.21.15.3:6839/493850676] up:boot 2024-09-10T23:23:38.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:38 smithi194 ceph-mon[33904]: fsmap 10 up:standby 2024-09-10T23:23:38.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:38 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T23:23:38.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:38 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:38.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:38 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:38.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:38 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:38.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:38 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:38.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:38 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:38.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:38 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:38.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:38 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:38.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:38 smithi194 ceph-mon[33904]: Deploying daemon mds.a on smithi003 2024-09-10T23:23:39.241 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:23:39.657 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:40.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.238+0000 7f600a600640 1 -- 172.21.15.3:0/2706494890 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6004108f90 msgr2=0x7f600410f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:40.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.238+0000 7f600a600640 1 --2- 172.21.15.3:0/2706494890 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6004108f90 0x7f600410f790 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc009ca0 tx=0x7f5ffc02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:23:40.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.238+0000 7f600a600640 1 -- 172.21.15.3:0/2706494890 shutdown_connections 2024-09-10T23:23:40.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.238+0000 7f600a600640 1 --2- 172.21.15.3:0/2706494890 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6004108f90 0x7f600410f790 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:40.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.238+0000 7f600a600640 1 --2- 172.21.15.3:0/2706494890 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6004108610 0x7f6004108a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:40.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.238+0000 7f600a600640 1 --2- 172.21.15.3:0/2706494890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6004102c00 0x7f6004102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:40.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.238+0000 7f600a600640 1 -- 172.21.15.3:0/2706494890 >> 172.21.15.3:0/2706494890 conn(0x7f60040fe6d0 msgr2=0x7f6004100af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:40.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.238+0000 7f600a600640 1 -- 172.21.15.3:0/2706494890 shutdown_connections 2024-09-10T23:23:40.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.238+0000 7f600a600640 1 -- 172.21.15.3:0/2706494890 wait complete. 2024-09-10T23:23:40.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.239+0000 7f600a600640 1 Processor -- start 2024-09-10T23:23:40.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.240+0000 7f600a600640 1 -- start start 2024-09-10T23:23:40.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.240+0000 7f600a600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6004102c00 0x7f600419b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:40.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.240+0000 7f600a600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6004108610 0x7f600419b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:40.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.240+0000 7f600a600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6004108f90 0x7f60041a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:40.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.240+0000 7f600a600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6004112b20 con 0x7f6004108f90 2024-09-10T23:23:40.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.240+0000 7f600a600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f60041129a0 con 0x7f6004102c00 2024-09-10T23:23:40.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.240+0000 7f600a600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6004112ca0 con 0x7f6004108610 2024-09-10T23:23:40.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.240+0000 7f6009c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6004108f90 0x7f60041a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:40.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.240+0000 7f6003e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6004108610 0x7f600419b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:40.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.241+0000 7f6009c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6004108f90 0x7f60041a0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45040/0 (socket says 172.21.15.3:45040) 2024-09-10T23:23:40.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.241+0000 7f6003e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6004108610 0x7f600419b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.3:49346/0 (socket says 172.21.15.3:49346) 2024-09-10T23:23:40.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.241+0000 7f6009c00640 1 -- 172.21.15.3:0/3487393754 learned_addr learned my addr 172.21.15.3:0/3487393754 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:23:40.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.241+0000 7f6009200640 1 --2- 172.21.15.3:0/3487393754 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6004102c00 0x7f600419b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:40.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.241+0000 7f6009200640 1 -- 172.21.15.3:0/3487393754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6004108610 msgr2=0x7f600419b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:40.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.241+0000 7f6009200640 1 --2- 172.21.15.3:0/3487393754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6004108610 0x7f600419b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:40.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.241+0000 7f6009200640 1 -- 172.21.15.3:0/3487393754 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6004108f90 msgr2=0x7f60041a0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:40.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.241+0000 7f6009200640 1 --2- 172.21.15.3:0/3487393754 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6004108f90 0x7f60041a0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:40.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.241+0000 7f6009200640 1 -- 172.21.15.3:0/3487393754 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60041a1220 con 0x7f6004102c00 2024-09-10T23:23:40.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.241+0000 7f6003e00640 1 --2- 172.21.15.3:0/3487393754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6004108610 0x7f600419b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:23:40.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.242+0000 7f6009200640 1 --2- 172.21.15.3:0/3487393754 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6004102c00 0x7f600419b170 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5ff800d720 tx=0x7f5ff800dbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:40.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.242+0000 7f6001600640 1 -- 172.21.15.3:0/3487393754 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8017070 con 0x7f6004102c00 2024-09-10T23:23:40.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.242+0000 7f600a600640 1 -- 172.21.15.3:0/3487393754 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60041a1510 con 0x7f6004102c00 2024-09-10T23:23:40.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.242+0000 7f600a600640 1 -- 172.21.15.3:0/3487393754 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60041a7bd0 con 0x7f6004102c00 2024-09-10T23:23:40.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.242+0000 7f6001600640 1 -- 172.21.15.3:0/3487393754 <== mon.2 v2:172.21.15.38:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ff800de30 con 0x7f6004102c00 2024-09-10T23:23:40.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.242+0000 7f6001600640 1 -- 172.21.15.3:0/3487393754 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8004de0 con 0x7f6004102c00 2024-09-10T23:23:40.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.244+0000 7f600a600640 1 -- 172.21.15.3:0/3487393754 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fe40052c0 con 0x7f6004102c00 2024-09-10T23:23:40.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.247+0000 7f6001600640 1 -- 172.21.15.3:0/3487393754 <== mon.2 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7f5ff80046c0 con 0x7f6004102c00 2024-09-10T23:23:40.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.248+0000 7f6001600640 1 --2- 172.21.15.3:0/3487393754 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5fec0b5460 0x7f5fec0b7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:40.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.248+0000 7f6001600640 1 -- 172.21.15.3:0/3487393754 <== mon.2 v2:172.21.15.38:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f5ff80e53a0 con 0x7f6004102c00 2024-09-10T23:23:40.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.248+0000 7f6003e00640 1 --2- 172.21.15.3:0/3487393754 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5fec0b5460 0x7f5fec0b7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:40.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.249+0000 7f6003e00640 1 --2- 172.21.15.3:0/3487393754 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5fec0b5460 0x7f5fec0b7920 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6004100fc0 tx=0x7f5ff000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:40.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.250+0000 7f6001600640 1 -- 172.21.15.3:0/3487393754 <== mon.2 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5ff8020020 con 0x7f6004102c00 2024-09-10T23:23:40.465 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 10 23:23:40 smithi003 systemd[1]: Starting Ceph mds.a for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:23:40.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.528+0000 7f600a600640 1 -- 172.21.15.3:0/3487393754 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5fe40055b0 con 0x7f6004102c00 2024-09-10T23:23:40.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.529+0000 7f6001600640 1 -- 172.21.15.3:0/3487393754 <== mon.2 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8854 (secure 0 0 0) 0x7f5ff80ac610 con 0x7f6004102c00 2024-09-10T23:23:40.529 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:23:40.530 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 11 2024-09-10T23:23:40.531 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":11,"btime":"2024-09-10T23:23:37:453445+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/1495411512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":1495411512},{"type":"v1","addr":"172.21.15.3:6835","nonce":1495411512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/1857372777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1857372777},{"type":"v1","addr":"172.21.15.3:6837","nonce":1857372777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14862,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6839/493850676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":493850676},{"type":"v1","addr":"172.21.15.3:6839","nonce":493850676}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/352514665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":352514665},{"type":"v1","addr":"172.21.15.194:6833","nonce":352514665}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2380508105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2380508105},{"type":"v1","addr":"172.21.15.194:6835","nonce":2380508105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/739730313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":739730313},{"type":"v1","addr":"172.21.15.194:6837","nonce":739730313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24673,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6839/3198777710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3198777710},{"type":"v1","addr":"172.21.15.194:6839","nonce":3198777710}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34619,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/1194099617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1194099617},{"type":"v1","addr":"172.21.15.38:6833","nonce":1194099617}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34652,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/218783320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":218783320},{"type":"v1","addr":"172.21.15.38:6835","nonce":218783320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34682,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/1821839397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":1821839397},{"type":"v1","addr":"172.21.15.38:6837","nonce":1821839397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-10T23:23:40.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.532+0000 7f600a600640 1 -- 172.21.15.3:0/3487393754 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5fec0b5460 msgr2=0x7f5fec0b7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:40.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.532+0000 7f600a600640 1 --2- 172.21.15.3:0/3487393754 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5fec0b5460 0x7f5fec0b7920 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6004100fc0 tx=0x7f5ff000b390 comp rx=0 tx=0).stop 2024-09-10T23:23:40.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.532+0000 7f600a600640 1 -- 172.21.15.3:0/3487393754 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6004102c00 msgr2=0x7f600419b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:40.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.532+0000 7f600a600640 1 --2- 172.21.15.3:0/3487393754 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6004102c00 0x7f600419b170 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5ff800d720 tx=0x7f5ff800dbe0 comp rx=0 tx=0).stop 2024-09-10T23:23:40.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.532+0000 7f600a600640 1 -- 172.21.15.3:0/3487393754 shutdown_connections 2024-09-10T23:23:40.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.532+0000 7f600a600640 1 --2- 172.21.15.3:0/3487393754 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5fec0b5460 0x7f5fec0b7920 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:40.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.532+0000 7f600a600640 1 --2- 172.21.15.3:0/3487393754 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6004108f90 0x7f60041a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:40.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.532+0000 7f600a600640 1 --2- 172.21.15.3:0/3487393754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6004108610 0x7f600419b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:40.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.532+0000 7f600a600640 1 --2- 172.21.15.3:0/3487393754 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6004102c00 0x7f600419b170 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:40.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.532+0000 7f600a600640 1 -- 172.21.15.3:0/3487393754 >> 172.21.15.3:0/3487393754 conn(0x7f60040fe6d0 msgr2=0x7f60040fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:40.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.532+0000 7f600a600640 1 -- 172.21.15.3:0/3487393754 shutdown_connections 2024-09-10T23:23:40.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:40.532+0000 7f600a600640 1 -- 172.21.15.3:0/3487393754 wait complete. 2024-09-10T23:23:40.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:40 smithi003 ceph-mon[30348]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:40.721 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 10 23:23:40 smithi003 podman[76386]: 2024-09-10 23:23:40.54202621 +0000 UTC m=+0.028390130 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:23:40.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:40 smithi038 ceph-mon[34225]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:40.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:40 smithi194 ceph-mon[33904]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:41.633 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:41 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3487393754' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:41.634 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 10 23:23:41 smithi003 podman[76386]: 2024-09-10 23:23:41.486421362 +0000 UTC m=+0.972785270 container create 0200c64007a9d101c0c22bcef0aef11979f386a6ca996b97a1c57269a29d28bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-a, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-10T23:23:41.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:41 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3487393754' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:41.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:41 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3487393754' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:42.221 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 10 23:23:41 smithi003 podman[76386]: 2024-09-10 23:23:41.764984211 +0000 UTC m=+1.251348143 container init 0200c64007a9d101c0c22bcef0aef11979f386a6ca996b97a1c57269a29d28bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-a, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-10T23:23:42.221 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 10 23:23:41 smithi003 podman[76386]: 2024-09-10 23:23:41.771535481 +0000 UTC m=+1.257899390 container start 0200c64007a9d101c0c22bcef0aef11979f386a6ca996b97a1c57269a29d28bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-10T23:23:42.221 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 10 23:23:41 smithi003 ceph-mds[76421]: -- 172.21.15.3:0/3289331168 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5574acb00ea0 con 0x5574acad5000 2024-09-10T23:23:42.221 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 10 23:23:41 smithi003 ceph-mds[76421]: -- 172.21.15.3:0/3289331168 <== mon.0 v2:172.21.15.3:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5574acaf7860 con 0x5574acad5000 2024-09-10T23:23:42.221 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 10 23:23:41 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-a[76417]: starting mds.a at 2024-09-10T23:23:42.221 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 10 23:23:41 smithi003 bash[76386]: 0200c64007a9d101c0c22bcef0aef11979f386a6ca996b97a1c57269a29d28bb 2024-09-10T23:23:42.221 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 10 23:23:41 smithi003 systemd[1]: Started Ceph mds.a for 3f4e30d0-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:23:42.742 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:42 smithi038 ceph-mon[34225]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:42.742 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:42 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:42.742 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:42 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:42.742 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:42 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:42.742 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:42 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:42.742 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:42 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:42.742 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:42 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:42.743 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:42 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:42.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:42 smithi194 ceph-mon[33904]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:42.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:42 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:42.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:42 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:42.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:42 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:42.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:42 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:42.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:42 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:42.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:42 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:42.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:42 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:42.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:42 smithi003 ceph-mon[30348]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:42.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:42 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:42.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:42 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:42.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:42 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:42.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:42 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:42.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:42 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:23:42.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:42 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:23:42.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:42 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:43.377 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:23:43.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:43 smithi003 ceph-mon[30348]: Deploying daemon mds.b on smithi038 2024-09-10T23:23:43.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:43 smithi003 ceph-mon[30348]: mds.? [v2:172.21.15.3:6840/1580524358,v1:172.21.15.3:6841/1580524358] up:boot 2024-09-10T23:23:43.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:43 smithi003 ceph-mon[30348]: fsmap 11 up:standby 2024-09-10T23:23:43.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:43 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T23:23:43.752 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:43 smithi038 ceph-mon[34225]: Deploying daemon mds.b on smithi038 2024-09-10T23:23:43.752 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:43 smithi038 ceph-mon[34225]: mds.? [v2:172.21.15.3:6840/1580524358,v1:172.21.15.3:6841/1580524358] up:boot 2024-09-10T23:23:43.752 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:43 smithi038 ceph-mon[34225]: fsmap 11 up:standby 2024-09-10T23:23:43.752 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:43 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T23:23:43.773 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:43.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:43 smithi194 ceph-mon[33904]: Deploying daemon mds.b on smithi038 2024-09-10T23:23:43.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:43 smithi194 ceph-mon[33904]: mds.? [v2:172.21.15.3:6840/1580524358,v1:172.21.15.3:6841/1580524358] up:boot 2024-09-10T23:23:43.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:43 smithi194 ceph-mon[33904]: fsmap 11 up:standby 2024-09-10T23:23:43.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:43 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T23:23:44.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.350+0000 7fd3e2600640 1 -- 172.21.15.3:0/4134388343 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd3dc109150 msgr2=0x7fd3dc10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:44.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.350+0000 7fd3e2600640 1 --2- 172.21.15.3:0/4134388343 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd3dc109150 0x7fd3dc10f950 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4009ca0 tx=0x7fd3d402a8b0 comp rx=0 tx=0).stop 2024-09-10T23:23:44.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.350+0000 7fd3e2600640 1 -- 172.21.15.3:0/4134388343 shutdown_connections 2024-09-10T23:23:44.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.350+0000 7fd3e2600640 1 --2- 172.21.15.3:0/4134388343 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd3dc109150 0x7fd3dc10f950 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:44.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.350+0000 7fd3e2600640 1 --2- 172.21.15.3:0/4134388343 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3dc1087d0 0x7fd3dc108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:44.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.350+0000 7fd3e2600640 1 --2- 172.21.15.3:0/4134388343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3dc102dc0 0x7fd3dc1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:44.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.350+0000 7fd3e2600640 1 -- 172.21.15.3:0/4134388343 >> 172.21.15.3:0/4134388343 conn(0x7fd3dc0fe830 msgr2=0x7fd3dc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:44.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.350+0000 7fd3e2600640 1 -- 172.21.15.3:0/4134388343 shutdown_connections 2024-09-10T23:23:44.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.350+0000 7fd3e2600640 1 -- 172.21.15.3:0/4134388343 wait complete. 2024-09-10T23:23:44.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.351+0000 7fd3e2600640 1 Processor -- start 2024-09-10T23:23:44.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.351+0000 7fd3e2600640 1 -- start start 2024-09-10T23:23:44.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.352+0000 7fd3e2600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd3dc102dc0 0x7fd3dc1990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:44.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.352+0000 7fd3e2600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3dc1087d0 0x7fd3dc199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:44.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.352+0000 7fd3e2600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3dc109150 0x7fd3dc19e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:44.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.352+0000 7fd3e2600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd3dc112cc0 con 0x7fd3dc102dc0 2024-09-10T23:23:44.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.352+0000 7fd3e2600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd3dc112b40 con 0x7fd3dc1087d0 2024-09-10T23:23:44.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.352+0000 7fd3e2600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd3dc112e40 con 0x7fd3dc109150 2024-09-10T23:23:44.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.352+0000 7fd3db400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd3dc102dc0 0x7fd3dc1990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:44.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.352+0000 7fd3daa00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3dc1087d0 0x7fd3dc199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:44.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.352+0000 7fd3db400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd3dc102dc0 0x7fd3dc1990d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43514/0 (socket says 172.21.15.3:43514) 2024-09-10T23:23:44.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.352+0000 7fd3db400640 1 -- 172.21.15.3:0/3608300825 learned_addr learned my addr 172.21.15.3:0/3608300825 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:23:44.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.352+0000 7fd3dbe00640 1 --2- 172.21.15.3:0/3608300825 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3dc109150 0x7fd3dc19e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:44.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.353+0000 7fd3daa00640 1 -- 172.21.15.3:0/3608300825 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3dc109150 msgr2=0x7fd3dc19e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:44.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.353+0000 7fd3daa00640 1 --2- 172.21.15.3:0/3608300825 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3dc109150 0x7fd3dc19e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:44.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.353+0000 7fd3daa00640 1 -- 172.21.15.3:0/3608300825 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd3dc102dc0 msgr2=0x7fd3dc1990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:44.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.353+0000 7fd3daa00640 1 --2- 172.21.15.3:0/3608300825 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd3dc102dc0 0x7fd3dc1990d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:44.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.353+0000 7fd3daa00640 1 -- 172.21.15.3:0/3608300825 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3dc19f180 con 0x7fd3dc1087d0 2024-09-10T23:23:44.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.353+0000 7fd3db400640 1 --2- 172.21.15.3:0/3608300825 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd3dc102dc0 0x7fd3dc1990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:23:44.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.353+0000 7fd3daa00640 1 --2- 172.21.15.3:0/3608300825 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3dc1087d0 0x7fd3dc199610 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd3c800e9f0 tx=0x7fd3c800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:44.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.353+0000 7fd3d3e00640 1 -- 172.21.15.3:0/3608300825 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c800ccc0 con 0x7fd3dc1087d0 2024-09-10T23:23:44.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.353+0000 7fd3d3e00640 1 -- 172.21.15.3:0/3608300825 <== mon.2 v2:172.21.15.38:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd3c80108c0 con 0x7fd3dc1087d0 2024-09-10T23:23:44.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.353+0000 7fd3e2600640 1 -- 172.21.15.3:0/3608300825 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3dc19f470 con 0x7fd3dc1087d0 2024-09-10T23:23:44.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.353+0000 7fd3d3e00640 1 -- 172.21.15.3:0/3608300825 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c80187e0 con 0x7fd3dc1087d0 2024-09-10T23:23:44.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.353+0000 7fd3e2600640 1 -- 172.21.15.3:0/3608300825 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3dc1a5d00 con 0x7fd3dc1087d0 2024-09-10T23:23:44.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.354+0000 7fd3e2600640 1 -- 172.21.15.3:0/3608300825 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3dc104070 con 0x7fd3dc1087d0 2024-09-10T23:23:44.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.357+0000 7fd3d3e00640 1 -- 172.21.15.3:0/3608300825 <== mon.2 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7fd3c8010430 con 0x7fd3dc1087d0 2024-09-10T23:23:44.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.359+0000 7fd3d3e00640 1 --2- 172.21.15.3:0/3608300825 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd3c00b53b0 0x7fd3c00b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:44.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.359+0000 7fd3d3e00640 1 -- 172.21.15.3:0/3608300825 <== mon.2 v2:172.21.15.38:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7fd3c80e5ea0 con 0x7fd3dc1087d0 2024-09-10T23:23:44.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.359+0000 7fd3db400640 1 --2- 172.21.15.3:0/3608300825 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd3c00b53b0 0x7fd3c00b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:44.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.360+0000 7fd3db400640 1 --2- 172.21.15.3:0/3608300825 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd3c00b53b0 0x7fd3c00b7870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc00f4d0 tx=0x7fd3cc00a380 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:44.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.360+0000 7fd3d3e00640 1 -- 172.21.15.3:0/3608300825 <== mon.2 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd3c80ad090 con 0x7fd3dc1087d0 2024-09-10T23:23:44.493 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:44 smithi038 ceph-mon[34225]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:44.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.597+0000 7fd3e2600640 1 -- 172.21.15.3:0/3608300825 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd3dc1031a0 con 0x7fd3dc1087d0 2024-09-10T23:23:44.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.598+0000 7fd3d3e00640 1 -- 172.21.15.3:0/3608300825 <== mon.2 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9677 (secure 0 0 0) 0x7fd3dc1031a0 con 0x7fd3dc1087d0 2024-09-10T23:23:44.598 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:23:44.599 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":12,"btime":"2024-09-10T23:23:42:475389+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/1495411512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":1495411512},{"type":"v1","addr":"172.21.15.3:6835","nonce":1495411512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/1857372777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1857372777},{"type":"v1","addr":"172.21.15.3:6837","nonce":1857372777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14862,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6839/493850676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":493850676},{"type":"v1","addr":"172.21.15.3:6839","nonce":493850676}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14874,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6841/1580524358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":1580524358},{"type":"v1","addr":"172.21.15.3:6841","nonce":1580524358}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/352514665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":352514665},{"type":"v1","addr":"172.21.15.194:6833","nonce":352514665}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2380508105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2380508105},{"type":"v1","addr":"172.21.15.194:6835","nonce":2380508105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/739730313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":739730313},{"type":"v1","addr":"172.21.15.194:6837","nonce":739730313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24673,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6839/3198777710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3198777710},{"type":"v1","addr":"172.21.15.194:6839","nonce":3198777710}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34619,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/1194099617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1194099617},{"type":"v1","addr":"172.21.15.38:6833","nonce":1194099617}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34652,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/218783320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":218783320},{"type":"v1","addr":"172.21.15.38:6835","nonce":218783320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34682,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/1821839397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":1821839397},{"type":"v1","addr":"172.21.15.38:6837","nonce":1821839397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-10T23:23:44.599 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 12 2024-09-10T23:23:44.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.600+0000 7fd3e2600640 1 -- 172.21.15.3:0/3608300825 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd3c00b53b0 msgr2=0x7fd3c00b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:44.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.600+0000 7fd3e2600640 1 --2- 172.21.15.3:0/3608300825 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd3c00b53b0 0x7fd3c00b7870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc00f4d0 tx=0x7fd3cc00a380 comp rx=0 tx=0).stop 2024-09-10T23:23:44.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.600+0000 7fd3e2600640 1 -- 172.21.15.3:0/3608300825 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3dc1087d0 msgr2=0x7fd3dc199610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:44.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.600+0000 7fd3e2600640 1 --2- 172.21.15.3:0/3608300825 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3dc1087d0 0x7fd3dc199610 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd3c800e9f0 tx=0x7fd3c800eeb0 comp rx=0 tx=0).stop 2024-09-10T23:23:44.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.600+0000 7fd3e2600640 1 -- 172.21.15.3:0/3608300825 shutdown_connections 2024-09-10T23:23:44.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.600+0000 7fd3e2600640 1 --2- 172.21.15.3:0/3608300825 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3dc109150 0x7fd3dc19e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:44.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.600+0000 7fd3e2600640 1 --2- 172.21.15.3:0/3608300825 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3dc1087d0 0x7fd3dc199610 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:44.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.600+0000 7fd3e2600640 1 --2- 172.21.15.3:0/3608300825 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd3c00b53b0 0x7fd3c00b7870 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:44.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.600+0000 7fd3e2600640 1 --2- 172.21.15.3:0/3608300825 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd3dc102dc0 0x7fd3dc1990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:44.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.600+0000 7fd3e2600640 1 -- 172.21.15.3:0/3608300825 >> 172.21.15.3:0/3608300825 conn(0x7fd3dc0fe830 msgr2=0x7fd3dc100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:44.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.601+0000 7fd3e2600640 1 -- 172.21.15.3:0/3608300825 shutdown_connections 2024-09-10T23:23:44.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:44.601+0000 7fd3e2600640 1 -- 172.21.15.3:0/3608300825 wait complete. 2024-09-10T23:23:44.823 INFO:journalctl@ceph.mds.b.smithi038.stdout:Sep 10 23:23:44 smithi038 systemd[1]: Starting Ceph mds.b for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:23:44.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:44 smithi194 ceph-mon[33904]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:44.949 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:44 smithi003 ceph-mon[30348]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:45.089 INFO:journalctl@ceph.mds.b.smithi038.stdout:Sep 10 23:23:44 smithi038 podman[65634]: 2024-09-10 23:23:44.727167869 +0000 UTC m=+0.028189273 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:23:45.090 INFO:journalctl@ceph.mds.b.smithi038.stdout:Sep 10 23:23:44 smithi038 podman[65634]: 2024-09-10 23:23:44.832814288 +0000 UTC m=+0.133835681 container create ac6480bce797be8d0f63c7fe91a076719eeee1d5e78299305e2a753fd514f018 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:23:45.090 INFO:journalctl@ceph.mds.b.smithi038.stdout:Sep 10 23:23:45 smithi038 podman[65634]: 2024-09-10 23:23:45.089152765 +0000 UTC m=+0.390174172 container init ac6480bce797be8d0f63c7fe91a076719eeee1d5e78299305e2a753fd514f018 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-b, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:23:45.347 INFO:journalctl@ceph.mds.b.smithi038.stdout:Sep 10 23:23:45 smithi038 podman[65634]: 2024-09-10 23:23:45.095463532 +0000 UTC m=+0.396484925 container start ac6480bce797be8d0f63c7fe91a076719eeee1d5e78299305e2a753fd514f018 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-b, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-10T23:23:45.347 INFO:journalctl@ceph.mds.b.smithi038.stdout:Sep 10 23:23:45 smithi038 ceph-mds[65653]: -- 172.21.15.38:0/1159890929 <== mon.2 v2:172.21.15.38:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562953f0d860 con 0x562953eeb400 2024-09-10T23:23:45.347 INFO:journalctl@ceph.mds.b.smithi038.stdout:Sep 10 23:23:45 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-b[65649]: starting mds.b at 2024-09-10T23:23:45.348 INFO:journalctl@ceph.mds.b.smithi038.stdout:Sep 10 23:23:45 smithi038 bash[65634]: ac6480bce797be8d0f63c7fe91a076719eeee1d5e78299305e2a753fd514f018 2024-09-10T23:23:45.348 INFO:journalctl@ceph.mds.b.smithi038.stdout:Sep 10 23:23:45 smithi038 systemd[1]: Started Ceph mds.b for 3f4e30d0-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:23:45.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:45 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3608300825' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:45.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:45 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:45.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:45 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:45.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:45 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:45.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:45 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:45.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:45 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:45.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:45 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3608300825' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:45.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:45 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:45.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:45 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:45.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:45 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:45.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:45 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:45.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:45 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:45.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:45 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3608300825' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:45.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:45 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:45.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:45 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:45.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:45 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:45.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:45 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:45.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:45 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:46.680 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:46 smithi003 ceph-mon[30348]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:46.680 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:46 smithi003 ceph-mon[30348]: mds.? [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] up:boot 2024-09-10T23:23:46.680 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:46 smithi003 ceph-mon[30348]: fsmap 12 up:standby 2024-09-10T23:23:46.681 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:46 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T23:23:46.681 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:46 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:23:46.681 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:46 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:46.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:46 smithi194 ceph-mon[33904]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:46.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:46 smithi194 ceph-mon[33904]: mds.? [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] up:boot 2024-09-10T23:23:46.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:46 smithi194 ceph-mon[33904]: fsmap 12 up:standby 2024-09-10T23:23:46.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:46 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T23:23:46.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:46 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:23:46.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:46 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:46.767 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:46 smithi038 ceph-mon[34225]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:46.767 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:46 smithi038 ceph-mon[34225]: mds.? [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] up:boot 2024-09-10T23:23:46.767 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:46 smithi038 ceph-mon[34225]: fsmap 12 up:standby 2024-09-10T23:23:46.767 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:46 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T23:23:46.767 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:46 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:23:46.767 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:46 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:47.496 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:23:47.907 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:48.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.492+0000 7fc73b800640 1 -- 172.21.15.3:0/3956013801 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc734102dc0 msgr2=0x7fc7341031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:48.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.492+0000 7fc73b800640 1 --2- 172.21.15.3:0/3956013801 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc734102dc0 0x7fc7341031a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc724009900 tx=0x7fc72402a410 comp rx=0 tx=0).stop 2024-09-10T23:23:48.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.492+0000 7fc73b800640 1 -- 172.21.15.3:0/3956013801 shutdown_connections 2024-09-10T23:23:48.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.492+0000 7fc73b800640 1 --2- 172.21.15.3:0/3956013801 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc734109150 0x7fc73410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:48.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.492+0000 7fc73b800640 1 --2- 172.21.15.3:0/3956013801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7341087d0 0x7fc734108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:48.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.492+0000 7fc73b800640 1 --2- 172.21.15.3:0/3956013801 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc734102dc0 0x7fc7341031a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:48.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.492+0000 7fc73b800640 1 -- 172.21.15.3:0/3956013801 >> 172.21.15.3:0/3956013801 conn(0x7fc7340fe830 msgr2=0x7fc734100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:48.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.492+0000 7fc73b800640 1 -- 172.21.15.3:0/3956013801 shutdown_connections 2024-09-10T23:23:48.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.492+0000 7fc73b800640 1 -- 172.21.15.3:0/3956013801 wait complete. 2024-09-10T23:23:48.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.493+0000 7fc73b800640 1 Processor -- start 2024-09-10T23:23:48.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.493+0000 7fc73b800640 1 -- start start 2024-09-10T23:23:48.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.493+0000 7fc73b800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc734102dc0 0x7fc7341991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:48.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.493+0000 7fc73b800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7341087d0 0x7fc734199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:48.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.493+0000 7fc73b800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc734109150 0x7fc73419eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:48.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.493+0000 7fc73b800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc734112d10 con 0x7fc734109150 2024-09-10T23:23:48.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.493+0000 7fc73b800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fc734112b90 con 0x7fc7341087d0 2024-09-10T23:23:48.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.493+0000 7fc73b800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc734112e90 con 0x7fc734102dc0 2024-09-10T23:23:48.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.494+0000 7fc739800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc734109150 0x7fc73419eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:48.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.494+0000 7fc738e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc734102dc0 0x7fc7341991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:48.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.494+0000 7fc738e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc734102dc0 0x7fc7341991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.3:34706/0 (socket says 172.21.15.3:34706) 2024-09-10T23:23:48.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.494+0000 7fc738e00640 1 -- 172.21.15.3:0/3629637727 learned_addr learned my addr 172.21.15.3:0/3629637727 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:23:48.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.494+0000 7fc72be00640 1 --2- 172.21.15.3:0/3629637727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7341087d0 0x7fc734199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:48.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.494+0000 7fc739800640 1 -- 172.21.15.3:0/3629637727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc734102dc0 msgr2=0x7fc7341991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:48.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.494+0000 7fc739800640 1 --2- 172.21.15.3:0/3629637727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc734102dc0 0x7fc7341991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:48.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.494+0000 7fc739800640 1 -- 172.21.15.3:0/3629637727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7341087d0 msgr2=0x7fc734199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:48.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.494+0000 7fc739800640 1 --2- 172.21.15.3:0/3629637727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7341087d0 0x7fc734199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:48.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.494+0000 7fc739800640 1 -- 172.21.15.3:0/3629637727 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc73419f290 con 0x7fc734109150 2024-09-10T23:23:48.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.494+0000 7fc72be00640 1 --2- 172.21.15.3:0/3629637727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7341087d0 0x7fc734199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:23:48.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.494+0000 7fc739800640 1 --2- 172.21.15.3:0/3629637727 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc734109150 0x7fc73419eac0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc72c009fd0 tx=0x7fc72c00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:48.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.495+0000 7fc732000640 1 -- 172.21.15.3:0/3629637727 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc72c00ce20 con 0x7fc734109150 2024-09-10T23:23:48.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.495+0000 7fc732000640 1 -- 172.21.15.3:0/3629637727 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc72c005020 con 0x7fc734109150 2024-09-10T23:23:48.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.495+0000 7fc73b800640 1 -- 172.21.15.3:0/3629637727 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc73419f580 con 0x7fc734109150 2024-09-10T23:23:48.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.495+0000 7fc732000640 1 -- 172.21.15.3:0/3629637727 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc72c010690 con 0x7fc734109150 2024-09-10T23:23:48.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.495+0000 7fc73b800640 1 -- 172.21.15.3:0/3629637727 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7341a5c40 con 0x7fc734109150 2024-09-10T23:23:48.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.496+0000 7fc73b800640 1 -- 172.21.15.3:0/3629637727 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7341031a0 con 0x7fc734109150 2024-09-10T23:23:48.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.498+0000 7fc732000640 1 -- 172.21.15.3:0/3629637727 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7fc72c004a40 con 0x7fc734109150 2024-09-10T23:23:48.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.500+0000 7fc732000640 1 --2- 172.21.15.3:0/3629637727 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc7180b53b0 0x7fc7180b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:48.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.500+0000 7fc732000640 1 -- 172.21.15.3:0/3629637727 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7fc72c0e5f50 con 0x7fc734109150 2024-09-10T23:23:48.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.500+0000 7fc738e00640 1 --2- 172.21.15.3:0/3629637727 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc7180b53b0 0x7fc7180b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:48.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.501+0000 7fc738e00640 1 --2- 172.21.15.3:0/3629637727 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc7180b53b0 0x7fc7180b7870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc7240096c0 tx=0x7fc724005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:48.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.504+0000 7fc732000640 1 -- 172.21.15.3:0/3629637727 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc72c0ad140 con 0x7fc734109150 2024-09-10T23:23:48.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:48 smithi003 ceph-mon[30348]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:48.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:48 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:48.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:48 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:48.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:48 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:48.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:48 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:48.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:48 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:48.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:48 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:48.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:48 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:48.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:48 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:23:48.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:48 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:48.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:48 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:23:48.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.744+0000 7fc73b800640 1 -- 172.21.15.3:0/3629637727 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc73402e5c0 con 0x7fc734109150 2024-09-10T23:23:48.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.744+0000 7fc732000640 1 -- 172.21.15.3:0/3629637727 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10500 (secure 0 0 0) 0x7fc72c0aca40 con 0x7fc734109150 2024-09-10T23:23:48.746 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:23:48.746 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":13,"btime":"2024-09-10T23:23:45:492670+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/1495411512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":1495411512},{"type":"v1","addr":"172.21.15.3:6835","nonce":1495411512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/1857372777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1857372777},{"type":"v1","addr":"172.21.15.3:6837","nonce":1857372777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14862,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6839/493850676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":493850676},{"type":"v1","addr":"172.21.15.3:6839","nonce":493850676}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14874,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6841/1580524358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":1580524358},{"type":"v1","addr":"172.21.15.3:6841","nonce":1580524358}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/352514665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":352514665},{"type":"v1","addr":"172.21.15.194:6833","nonce":352514665}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2380508105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2380508105},{"type":"v1","addr":"172.21.15.194:6835","nonce":2380508105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/739730313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":739730313},{"type":"v1","addr":"172.21.15.194:6837","nonce":739730313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24673,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6839/3198777710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3198777710},{"type":"v1","addr":"172.21.15.194:6839","nonce":3198777710}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34619,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/1194099617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1194099617},{"type":"v1","addr":"172.21.15.38:6833","nonce":1194099617}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34652,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/218783320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":218783320},{"type":"v1","addr":"172.21.15.38:6835","nonce":218783320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34682,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/1821839397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":1821839397},{"type":"v1","addr":"172.21.15.38:6837","nonce":1821839397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":34724,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/458259815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":458259815},{"type":"v1","addr":"172.21.15.38:6839","nonce":458259815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-10T23:23:48.746 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 13 2024-09-10T23:23:48.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.747+0000 7fc73b800640 1 -- 172.21.15.3:0/3629637727 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc7180b53b0 msgr2=0x7fc7180b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:48.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.747+0000 7fc73b800640 1 --2- 172.21.15.3:0/3629637727 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc7180b53b0 0x7fc7180b7870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc7240096c0 tx=0x7fc724005e80 comp rx=0 tx=0).stop 2024-09-10T23:23:48.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.747+0000 7fc73b800640 1 -- 172.21.15.3:0/3629637727 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc734109150 msgr2=0x7fc73419eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:48.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.747+0000 7fc73b800640 1 --2- 172.21.15.3:0/3629637727 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc734109150 0x7fc73419eac0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc72c009fd0 tx=0x7fc72c00ef10 comp rx=0 tx=0).stop 2024-09-10T23:23:48.749 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.747+0000 7fc73b800640 1 -- 172.21.15.3:0/3629637727 shutdown_connections 2024-09-10T23:23:48.749 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.747+0000 7fc73b800640 1 --2- 172.21.15.3:0/3629637727 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc7180b53b0 0x7fc7180b7870 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:48.749 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.747+0000 7fc73b800640 1 --2- 172.21.15.3:0/3629637727 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc734109150 0x7fc73419eac0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:48.749 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.747+0000 7fc73b800640 1 --2- 172.21.15.3:0/3629637727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7341087d0 0x7fc734199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:48.749 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.747+0000 7fc73b800640 1 --2- 172.21.15.3:0/3629637727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc734102dc0 0x7fc7341991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:48.749 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.747+0000 7fc73b800640 1 -- 172.21.15.3:0/3629637727 >> 172.21.15.3:0/3629637727 conn(0x7fc7340fe830 msgr2=0x7fc734100160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:48.749 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.747+0000 7fc73b800640 1 -- 172.21.15.3:0/3629637727 shutdown_connections 2024-09-10T23:23:48.749 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:48.747+0000 7fc73b800640 1 -- 172.21.15.3:0/3629637727 wait complete. 2024-09-10T23:23:48.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:48 smithi038 ceph-mon[34225]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:48.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:48 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:48.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:48 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:48.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:48 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:48.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:48 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:48.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:48 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:48.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:48 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:48.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:48 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:48.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:48 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:23:48.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:48 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:48.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:48 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:23:48.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:48 smithi194 ceph-mon[33904]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:48.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:48 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:48.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:48 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:48.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:48 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:48.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:48 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:48.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:48 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:48.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:48 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:48.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:48 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:48.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:48 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:23:48.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:48 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:48.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:48 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:23:49.595 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-10T23:23:49.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:49 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3629637727' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:49.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:49 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3629637727' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:49.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:49 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3629637727' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:23:50.839 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:50.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:50 smithi038 ceph-mon[34225]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:50.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:50 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:50.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:50 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:50.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:50 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:50.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:50 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:50.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:50 smithi194 ceph-mon[33904]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:50.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:50 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:50.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:50 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:50.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:50 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:50.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:50 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:50.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:50 smithi003 ceph-mon[30348]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:50.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:50 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:50.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:50 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:50.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:50 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:50.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:50 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:51.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.444+0000 7fc25f800640 1 -- 172.21.15.3:0/3028961747 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc25810b330 msgr2=0x7fc258111b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:51.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.444+0000 7fc25f800640 1 --2- 172.21.15.3:0/3028961747 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc25810b330 0x7fc258111b30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc250009ca0 tx=0x7fc25002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:23:51.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.444+0000 7fc25f800640 1 -- 172.21.15.3:0/3028961747 shutdown_connections 2024-09-10T23:23:51.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.444+0000 7fc25f800640 1 --2- 172.21.15.3:0/3028961747 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc25810b330 0x7fc258111b30 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:51.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.444+0000 7fc25f800640 1 --2- 172.21.15.3:0/3028961747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc25810a9b0 0x7fc25810adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:51.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.444+0000 7fc25f800640 1 --2- 172.21.15.3:0/3028961747 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc258104fa0 0x7fc258105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:51.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.444+0000 7fc25f800640 1 -- 172.21.15.3:0/3028961747 >> 172.21.15.3:0/3028961747 conn(0x7fc258100a50 msgr2=0x7fc258102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:51.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.444+0000 7fc25f800640 1 -- 172.21.15.3:0/3028961747 shutdown_connections 2024-09-10T23:23:51.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.444+0000 7fc25f800640 1 -- 172.21.15.3:0/3028961747 wait complete. 2024-09-10T23:23:51.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.445+0000 7fc25f800640 1 Processor -- start 2024-09-10T23:23:51.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.445+0000 7fc25f800640 1 -- start start 2024-09-10T23:23:51.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.446+0000 7fc25f800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc258104fa0 0x7fc25819b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:51.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.446+0000 7fc25f800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc25810a9b0 0x7fc25819b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:51.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.446+0000 7fc25f800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc25810b330 0x7fc2581a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:51.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.446+0000 7fc25f800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc258114e60 con 0x7fc25810a9b0 2024-09-10T23:23:51.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.446+0000 7fc25f800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fc258114ce0 con 0x7fc258104fa0 2024-09-10T23:23:51.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.446+0000 7fc25f800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc258114fe0 con 0x7fc25810b330 2024-09-10T23:23:51.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.446+0000 7fc257e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc25810a9b0 0x7fc25819b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:51.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.446+0000 7fc25d800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc25810b330 0x7fc2581a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:51.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.446+0000 7fc25d800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc25810b330 0x7fc2581a0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.3:34794/0 (socket says 172.21.15.3:34794) 2024-09-10T23:23:51.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.446+0000 7fc25d800640 1 -- 172.21.15.3:0/3106780006 learned_addr learned my addr 172.21.15.3:0/3106780006 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:23:51.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.447+0000 7fc25ce00640 1 --2- 172.21.15.3:0/3106780006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc258104fa0 0x7fc25819b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:51.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.447+0000 7fc257e00640 1 -- 172.21.15.3:0/3106780006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc25810b330 msgr2=0x7fc2581a0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:51.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.447+0000 7fc257e00640 1 --2- 172.21.15.3:0/3106780006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc25810b330 0x7fc2581a0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:51.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.447+0000 7fc257e00640 1 -- 172.21.15.3:0/3106780006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc258104fa0 msgr2=0x7fc25819b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:51.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.447+0000 7fc257e00640 1 --2- 172.21.15.3:0/3106780006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc258104fa0 0x7fc25819b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:51.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.447+0000 7fc257e00640 1 -- 172.21.15.3:0/3106780006 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2581a1410 con 0x7fc25810a9b0 2024-09-10T23:23:51.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.447+0000 7fc25ce00640 1 --2- 172.21.15.3:0/3106780006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc258104fa0 0x7fc25819b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:23:51.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.447+0000 7fc257e00640 1 --2- 172.21.15.3:0/3106780006 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc25810a9b0 0x7fc25819b8a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc24400e9f0 tx=0x7fc24400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:51.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.447+0000 7fc255600640 1 -- 172.21.15.3:0/3106780006 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24400ccc0 con 0x7fc25810a9b0 2024-09-10T23:23:51.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.447+0000 7fc255600640 1 -- 172.21.15.3:0/3106780006 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc244005020 con 0x7fc25810a9b0 2024-09-10T23:23:51.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.447+0000 7fc255600640 1 -- 172.21.15.3:0/3106780006 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24400ce60 con 0x7fc25810a9b0 2024-09-10T23:23:51.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.447+0000 7fc25f800640 1 -- 172.21.15.3:0/3106780006 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2581a1700 con 0x7fc25810a9b0 2024-09-10T23:23:51.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.447+0000 7fc25f800640 1 -- 172.21.15.3:0/3106780006 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2581a7dc0 con 0x7fc25810a9b0 2024-09-10T23:23:51.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.448+0000 7fc25f800640 1 -- 172.21.15.3:0/3106780006 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc258105380 con 0x7fc25810a9b0 2024-09-10T23:23:51.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.451+0000 7fc255600640 1 -- 172.21.15.3:0/3106780006 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7fc244004a60 con 0x7fc25810a9b0 2024-09-10T23:23:51.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.452+0000 7fc255600640 1 --2- 172.21.15.3:0/3106780006 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc2400b53b0 0x7fc2400b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:51.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.452+0000 7fc255600640 1 -- 172.21.15.3:0/3106780006 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7fc2440e58c0 con 0x7fc25810a9b0 2024-09-10T23:23:51.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.452+0000 7fc25ce00640 1 --2- 172.21.15.3:0/3106780006 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc2400b53b0 0x7fc2400b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:51.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.453+0000 7fc25ce00640 1 --2- 172.21.15.3:0/3106780006 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc2400b53b0 0x7fc2400b7870 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc24c009c20 tx=0x7fc24c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:51.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.456+0000 7fc255600640 1 -- 172.21.15.3:0/3106780006 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc2440acab0 con 0x7fc25810a9b0 2024-09-10T23:23:51.672 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.670+0000 7fc25f800640 1 -- 172.21.15.3:0/3106780006 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc25802e5c0 con 0x7fc25810a9b0 2024-09-10T23:23:51.672 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.671+0000 7fc255600640 1 -- 172.21.15.3:0/3106780006 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v72) ==== 84+0+65 (secure 0 0 0) 0x7fc2440ac3b0 con 0x7fc25810a9b0 2024-09-10T23:23:51.672 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:23:51.672 INFO:teuthology.orchestra.run.smithi003.stdout:[ 2024-09-10T23:23:51.673 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:23:51.673 INFO:teuthology.orchestra.run.smithi003.stdout: "poolnum": 1, 2024-09-10T23:23:51.673 INFO:teuthology.orchestra.run.smithi003.stdout: "poolname": ".mgr" 2024-09-10T23:23:51.673 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:23:51.673 INFO:teuthology.orchestra.run.smithi003.stdout:] 2024-09-10T23:23:51.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.674+0000 7fc25f800640 1 -- 172.21.15.3:0/3106780006 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc2400b53b0 msgr2=0x7fc2400b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:51.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.674+0000 7fc25f800640 1 --2- 172.21.15.3:0/3106780006 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc2400b53b0 0x7fc2400b7870 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc24c009c20 tx=0x7fc24c005f90 comp rx=0 tx=0).stop 2024-09-10T23:23:51.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.674+0000 7fc25f800640 1 -- 172.21.15.3:0/3106780006 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc25810a9b0 msgr2=0x7fc25819b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:51.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.674+0000 7fc25f800640 1 --2- 172.21.15.3:0/3106780006 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc25810a9b0 0x7fc25819b8a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc24400e9f0 tx=0x7fc24400eeb0 comp rx=0 tx=0).stop 2024-09-10T23:23:51.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.675+0000 7fc25f800640 1 -- 172.21.15.3:0/3106780006 shutdown_connections 2024-09-10T23:23:51.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.675+0000 7fc25f800640 1 --2- 172.21.15.3:0/3106780006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc25810b330 0x7fc2581a0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:51.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.675+0000 7fc25f800640 1 --2- 172.21.15.3:0/3106780006 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc2400b53b0 0x7fc2400b7870 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:51.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.675+0000 7fc25f800640 1 --2- 172.21.15.3:0/3106780006 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc25810a9b0 0x7fc25819b8a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:51.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.675+0000 7fc25f800640 1 --2- 172.21.15.3:0/3106780006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc258104fa0 0x7fc25819b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:51.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.675+0000 7fc25f800640 1 -- 172.21.15.3:0/3106780006 >> 172.21.15.3:0/3106780006 conn(0x7fc258100a50 msgr2=0x7fc258102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:51.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.675+0000 7fc25f800640 1 -- 172.21.15.3:0/3106780006 shutdown_connections 2024-09-10T23:23:51.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:51.675+0000 7fc25f800640 1 -- 172.21.15.3:0/3106780006 wait complete. 2024-09-10T23:23:52.487 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T23:23:52.487 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T23:23:52.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:52 smithi003 ceph-mon[30348]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:52.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:52 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3106780006' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-10T23:23:52.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:52 smithi038 ceph-mon[34225]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:52.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:52 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3106780006' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-10T23:23:52.886 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:52.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:52 smithi194 ceph-mon[33904]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:52.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:52 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3106780006' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-10T23:23:53.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.466+0000 7ff360800640 1 -- 172.21.15.3:0/2618944412 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff35810a9b0 msgr2=0x7ff35810adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:53.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.466+0000 7ff360800640 1 --2- 172.21.15.3:0/2618944412 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff35810a9b0 0x7ff35810adf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff348009900 tx=0x7ff34802a410 comp rx=0 tx=0).stop 2024-09-10T23:23:53.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.466+0000 7ff360800640 1 -- 172.21.15.3:0/2618944412 shutdown_connections 2024-09-10T23:23:53.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.466+0000 7ff360800640 1 --2- 172.21.15.3:0/2618944412 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff35810b330 0x7ff358111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:53.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.466+0000 7ff360800640 1 --2- 172.21.15.3:0/2618944412 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff35810a9b0 0x7ff35810adf0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:53.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.466+0000 7ff360800640 1 --2- 172.21.15.3:0/2618944412 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff358104fa0 0x7ff358105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:53.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.466+0000 7ff360800640 1 -- 172.21.15.3:0/2618944412 >> 172.21.15.3:0/2618944412 conn(0x7ff358100a50 msgr2=0x7ff358102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:53.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.466+0000 7ff360800640 1 -- 172.21.15.3:0/2618944412 shutdown_connections 2024-09-10T23:23:53.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.466+0000 7ff360800640 1 -- 172.21.15.3:0/2618944412 wait complete. 2024-09-10T23:23:53.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.467+0000 7ff360800640 1 Processor -- start 2024-09-10T23:23:53.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.467+0000 7ff360800640 1 -- start start 2024-09-10T23:23:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.468+0000 7ff360800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff358104fa0 0x7ff35819b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.468+0000 7ff360800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff35810a9b0 0x7ff35819b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.468+0000 7ff360800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff35810b330 0x7ff3581a0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.468+0000 7ff360800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff358114e60 con 0x7ff35810a9b0 2024-09-10T23:23:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.468+0000 7ff360800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff358114ce0 con 0x7ff35810b330 2024-09-10T23:23:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.468+0000 7ff360800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff358114fe0 con 0x7ff358104fa0 2024-09-10T23:23:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.468+0000 7ff35d400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff35810a9b0 0x7ff35819b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.468+0000 7ff35d400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff35810a9b0 0x7ff35819b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50392/0 (socket says 172.21.15.3:50392) 2024-09-10T23:23:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.468+0000 7ff35de00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff358104fa0 0x7ff35819b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.468+0000 7ff35d400640 1 -- 172.21.15.3:0/1945753368 learned_addr learned my addr 172.21.15.3:0/1945753368 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:23:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.468+0000 7ff35e800640 1 --2- 172.21.15.3:0/1945753368 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff35810b330 0x7ff3581a0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:53.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.469+0000 7ff35de00640 1 -- 172.21.15.3:0/1945753368 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff35810b330 msgr2=0x7ff3581a0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:53.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.469+0000 7ff35de00640 1 --2- 172.21.15.3:0/1945753368 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff35810b330 0x7ff3581a0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:53.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.469+0000 7ff35de00640 1 -- 172.21.15.3:0/1945753368 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff35810a9b0 msgr2=0x7ff35819b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:53.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.469+0000 7ff35de00640 1 --2- 172.21.15.3:0/1945753368 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff35810a9b0 0x7ff35819b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:53.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.469+0000 7ff35de00640 1 -- 172.21.15.3:0/1945753368 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3581a1480 con 0x7ff358104fa0 2024-09-10T23:23:53.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.469+0000 7ff35de00640 1 --2- 172.21.15.3:0/1945753368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff358104fa0 0x7ff35819b3d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff34c00e9f0 tx=0x7ff34c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:53.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.469+0000 7ff352a00640 1 -- 172.21.15.3:0/1945753368 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff34c00ccc0 con 0x7ff358104fa0 2024-09-10T23:23:53.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.469+0000 7ff360800640 1 -- 172.21.15.3:0/1945753368 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3581a1770 con 0x7ff358104fa0 2024-09-10T23:23:53.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.469+0000 7ff352a00640 1 -- 172.21.15.3:0/1945753368 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff34c0108c0 con 0x7ff358104fa0 2024-09-10T23:23:53.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.469+0000 7ff352a00640 1 -- 172.21.15.3:0/1945753368 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff34c0187c0 con 0x7ff358104fa0 2024-09-10T23:23:53.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.469+0000 7ff360800640 1 -- 172.21.15.3:0/1945753368 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3581a7e30 con 0x7ff358104fa0 2024-09-10T23:23:53.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.471+0000 7ff360800640 1 -- 172.21.15.3:0/1945753368 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff358105380 con 0x7ff358104fa0 2024-09-10T23:23:53.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.475+0000 7ff352a00640 1 -- 172.21.15.3:0/1945753368 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7ff34c010430 con 0x7ff358104fa0 2024-09-10T23:23:53.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.476+0000 7ff352a00640 1 --2- 172.21.15.3:0/1945753368 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff3400b5330 0x7ff3400b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:53.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.476+0000 7ff352a00640 1 -- 172.21.15.3:0/1945753368 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7ff34c0e5dc0 con 0x7ff358104fa0 2024-09-10T23:23:53.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.476+0000 7ff35d400640 1 --2- 172.21.15.3:0/1945753368 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff3400b5330 0x7ff3400b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:53.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.477+0000 7ff352a00640 1 -- 172.21.15.3:0/1945753368 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff34c07a2e0 con 0x7ff358104fa0 2024-09-10T23:23:53.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.477+0000 7ff35d400640 1 --2- 172.21.15.3:0/1945753368 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff3400b5330 0x7ff3400b77f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff3480096c0 tx=0x7ff348005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:53.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.677+0000 7ff360800640 1 -- 172.21.15.3:0/1945753368 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff35802e5c0 con 0x7ff358104fa0 2024-09-10T23:23:53.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.767+0000 7ff352a00640 1 -- 172.21.15.3:0/1945753368 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v73) ==== 138+0+0 (secure 0 0 0) 0x7ff34c0ac960 con 0x7ff358104fa0 2024-09-10T23:23:53.771 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_metadata' created 2024-09-10T23:23:53.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.773+0000 7ff360800640 1 -- 172.21.15.3:0/1945753368 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff3400b5330 msgr2=0x7ff3400b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:53.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.773+0000 7ff360800640 1 --2- 172.21.15.3:0/1945753368 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff3400b5330 0x7ff3400b77f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff3480096c0 tx=0x7ff348005e80 comp rx=0 tx=0).stop 2024-09-10T23:23:53.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.773+0000 7ff360800640 1 -- 172.21.15.3:0/1945753368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff358104fa0 msgr2=0x7ff35819b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:53.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.773+0000 7ff360800640 1 --2- 172.21.15.3:0/1945753368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff358104fa0 0x7ff35819b3d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff34c00e9f0 tx=0x7ff34c00eeb0 comp rx=0 tx=0).stop 2024-09-10T23:23:53.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.773+0000 7ff360800640 1 -- 172.21.15.3:0/1945753368 shutdown_connections 2024-09-10T23:23:53.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.773+0000 7ff360800640 1 --2- 172.21.15.3:0/1945753368 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff35810b330 0x7ff3581a0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:53.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.773+0000 7ff360800640 1 --2- 172.21.15.3:0/1945753368 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff3400b5330 0x7ff3400b77f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:53.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.773+0000 7ff360800640 1 --2- 172.21.15.3:0/1945753368 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff35810a9b0 0x7ff35819b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:53.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.773+0000 7ff360800640 1 --2- 172.21.15.3:0/1945753368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff358104fa0 0x7ff35819b3d0 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff34c00e9f0 tx=0x7ff34c00eeb0 comp rx=0 tx=0).stop 2024-09-10T23:23:53.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.773+0000 7ff360800640 1 -- 172.21.15.3:0/1945753368 >> 172.21.15.3:0/1945753368 conn(0x7ff358100a50 msgr2=0x7ff358102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:53.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.774+0000 7ff360800640 1 -- 172.21.15.3:0/1945753368 shutdown_connections 2024-09-10T23:23:53.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:53.774+0000 7ff360800640 1 -- 172.21.15.3:0/1945753368 wait complete. 2024-09-10T23:23:53.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:53 smithi003 ceph-mon[30348]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:53.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:53 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:53.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:53 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:53.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:53 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:53.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:53 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:23:53.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:53 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:53.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:53 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1945753368' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-10T23:23:53.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:53 smithi003 ceph-mon[30348]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-10T23:23:54.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:53 smithi038 ceph-mon[34225]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:54.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:53 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:54.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:53 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:54.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:53 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:54.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:53 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:23:54.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:53 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:54.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:53 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/1945753368' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-10T23:23:54.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:53 smithi038 ceph-mon[34225]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-10T23:23:54.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:53 smithi194 ceph-mon[33904]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:54.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:53 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:54.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:53 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:54.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:53 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:23:54.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:53 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:23:54.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:53 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:23:54.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:53 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/1945753368' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-10T23:23:54.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:53 smithi194 ceph-mon[33904]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-10T23:23:54.677 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-10T23:23:55.070 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:55.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:54 smithi038 ceph-mon[34225]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T23:23:55.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:54 smithi038 ceph-mon[34225]: osdmap e73: 12 total, 12 up, 12 in 2024-09-10T23:23:55.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:54 smithi194 ceph-mon[33904]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T23:23:55.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:54 smithi194 ceph-mon[33904]: osdmap e73: 12 total, 12 up, 12 in 2024-09-10T23:23:55.209 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:54 smithi003 ceph-mon[30348]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T23:23:55.209 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:54 smithi003 ceph-mon[30348]: osdmap e73: 12 total, 12 up, 12 in 2024-09-10T23:23:55.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.641+0000 7fb890e00640 1 -- 172.21.15.3:0/2880258671 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb88c102c10 msgr2=0x7fb88c102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:55.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.641+0000 7fb890e00640 1 --2- 172.21.15.3:0/2880258671 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb88c102c10 0x7fb88c102ff0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb87c009900 tx=0x7fb87c02a410 comp rx=0 tx=0).stop 2024-09-10T23:23:55.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.641+0000 7fb890e00640 1 -- 172.21.15.3:0/2880258671 shutdown_connections 2024-09-10T23:23:55.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.641+0000 7fb890e00640 1 --2- 172.21.15.3:0/2880258671 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb88c108fa0 0x7fb88c10f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:55.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.641+0000 7fb890e00640 1 --2- 172.21.15.3:0/2880258671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb88c108620 0x7fb88c108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:55.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.641+0000 7fb890e00640 1 --2- 172.21.15.3:0/2880258671 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb88c102c10 0x7fb88c102ff0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:55.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.641+0000 7fb890e00640 1 -- 172.21.15.3:0/2880258671 >> 172.21.15.3:0/2880258671 conn(0x7fb88c0fe660 msgr2=0x7fb88c100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:55.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.641+0000 7fb890e00640 1 -- 172.21.15.3:0/2880258671 shutdown_connections 2024-09-10T23:23:55.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.641+0000 7fb890e00640 1 -- 172.21.15.3:0/2880258671 wait complete. 2024-09-10T23:23:55.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.642+0000 7fb890e00640 1 Processor -- start 2024-09-10T23:23:55.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.642+0000 7fb890e00640 1 -- start start 2024-09-10T23:23:55.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.643+0000 7fb890e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb88c102c10 0x7fb88c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:55.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.643+0000 7fb890e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb88c108620 0x7fb88c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:55.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.643+0000 7fb890e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb88c108fa0 0x7fb88c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:55.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.643+0000 7fb890e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c112b10 con 0x7fb88c108620 2024-09-10T23:23:55.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.643+0000 7fb890e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c112990 con 0x7fb88c102c10 2024-09-10T23:23:55.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.643+0000 7fb890e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c112c90 con 0x7fb88c108fa0 2024-09-10T23:23:55.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.643+0000 7fb883e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb88c108620 0x7fb88c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:55.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.643+0000 7fb883e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb88c108620 0x7fb88c0759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50406/0 (socket says 172.21.15.3:50406) 2024-09-10T23:23:55.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.643+0000 7fb883e00640 1 -- 172.21.15.3:0/1832756238 learned_addr learned my addr 172.21.15.3:0/1832756238 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:23:55.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.643+0000 7fb88be00640 1 --2- 172.21.15.3:0/1832756238 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb88c108fa0 0x7fb88c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:55.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.643+0000 7fb88b400640 1 --2- 172.21.15.3:0/1832756238 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb88c102c10 0x7fb88c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:55.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.644+0000 7fb883e00640 1 -- 172.21.15.3:0/1832756238 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb88c108fa0 msgr2=0x7fb88c075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:55.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.644+0000 7fb883e00640 1 --2- 172.21.15.3:0/1832756238 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb88c108fa0 0x7fb88c075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:55.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.644+0000 7fb883e00640 1 -- 172.21.15.3:0/1832756238 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb88c102c10 msgr2=0x7fb88c0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:55.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.644+0000 7fb883e00640 1 --2- 172.21.15.3:0/1832756238 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb88c102c10 0x7fb88c0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:55.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.644+0000 7fb883e00640 1 -- 172.21.15.3:0/1832756238 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb88c1a7340 con 0x7fb88c108620 2024-09-10T23:23:55.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.644+0000 7fb88be00640 1 --2- 172.21.15.3:0/1832756238 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb88c108fa0 0x7fb88c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:23:55.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.644+0000 7fb883e00640 1 --2- 172.21.15.3:0/1832756238 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb88c108620 0x7fb88c0759e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb87400e9f0 tx=0x7fb87400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:55.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.644+0000 7fb888c00640 1 -- 172.21.15.3:0/1832756238 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87400cd80 con 0x7fb88c108620 2024-09-10T23:23:55.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.645+0000 7fb888c00640 1 -- 172.21.15.3:0/1832756238 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb8740054b0 con 0x7fb88c108620 2024-09-10T23:23:55.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.645+0000 7fb890e00640 1 -- 172.21.15.3:0/1832756238 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb88c1a7630 con 0x7fb88c108620 2024-09-10T23:23:55.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.645+0000 7fb888c00640 1 -- 172.21.15.3:0/1832756238 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb874010430 con 0x7fb88c108620 2024-09-10T23:23:55.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.645+0000 7fb890e00640 1 -- 172.21.15.3:0/1832756238 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb88c1a7b70 con 0x7fb88c108620 2024-09-10T23:23:55.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.646+0000 7fb890e00640 1 -- 172.21.15.3:0/1832756238 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb88c102ff0 con 0x7fb88c108620 2024-09-10T23:23:55.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.649+0000 7fb888c00640 1 -- 172.21.15.3:0/1832756238 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7fb874005000 con 0x7fb88c108620 2024-09-10T23:23:55.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.651+0000 7fb888c00640 1 --2- 172.21.15.3:0/1832756238 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb8700b5460 0x7fb8700b7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:55.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.651+0000 7fb888c00640 1 -- 172.21.15.3:0/1832756238 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7712+0+0 (secure 0 0 0) 0x7fb8740e5f80 con 0x7fb88c108620 2024-09-10T23:23:55.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.651+0000 7fb88b400640 1 --2- 172.21.15.3:0/1832756238 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb8700b5460 0x7fb8700b7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:55.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.652+0000 7fb88b400640 1 --2- 172.21.15.3:0/1832756238 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb8700b5460 0x7fb8700b7920 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb87c0057c0 tx=0x7fb87c0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:55.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.652+0000 7fb888c00640 1 -- 172.21.15.3:0/1832756238 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb874056220 con 0x7fb88c108620 2024-09-10T23:23:55.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:55.855+0000 7fb890e00640 1 -- 172.21.15.3:0/1832756238 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fb88c02e5c0 con 0x7fb88c108620 2024-09-10T23:23:56.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:55 smithi038 ceph-mon[34225]: pgmap v288: 33 pgs: 1 creating+peering, 31 unknown, 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:56.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:55 smithi038 ceph-mon[34225]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T23:23:56.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:55 smithi038 ceph-mon[34225]: osdmap e74: 12 total, 12 up, 12 in 2024-09-10T23:23:56.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:55 smithi194 ceph-mon[33904]: pgmap v288: 33 pgs: 1 creating+peering, 31 unknown, 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:56.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:55 smithi194 ceph-mon[33904]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T23:23:56.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:55 smithi194 ceph-mon[33904]: osdmap e74: 12 total, 12 up, 12 in 2024-09-10T23:23:56.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:55 smithi003 ceph-mon[30348]: pgmap v288: 33 pgs: 1 creating+peering, 31 unknown, 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:56.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:55 smithi003 ceph-mon[30348]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T23:23:56.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:55 smithi003 ceph-mon[30348]: osdmap e74: 12 total, 12 up, 12 in 2024-09-10T23:23:56.796 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:56.794+0000 7fb888c00640 1 -- 172.21.15.3:0/1832756238 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v76) ==== 171+0+0 (secure 0 0 0) 0x7fb8740ad020 con 0x7fb88c108620 2024-09-10T23:23:56.796 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_data' created 2024-09-10T23:23:56.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:56.798+0000 7fb890e00640 1 -- 172.21.15.3:0/1832756238 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb8700b5460 msgr2=0x7fb8700b7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:56.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:56.798+0000 7fb890e00640 1 --2- 172.21.15.3:0/1832756238 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb8700b5460 0x7fb8700b7920 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb87c0057c0 tx=0x7fb87c0058d0 comp rx=0 tx=0).stop 2024-09-10T23:23:56.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:56.798+0000 7fb890e00640 1 -- 172.21.15.3:0/1832756238 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb88c108620 msgr2=0x7fb88c0759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:56.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:56.798+0000 7fb890e00640 1 --2- 172.21.15.3:0/1832756238 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb88c108620 0x7fb88c0759e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb87400e9f0 tx=0x7fb87400edf0 comp rx=0 tx=0).stop 2024-09-10T23:23:56.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:56.798+0000 7fb890e00640 1 -- 172.21.15.3:0/1832756238 shutdown_connections 2024-09-10T23:23:56.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:56.798+0000 7fb890e00640 1 --2- 172.21.15.3:0/1832756238 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb88c108fa0 0x7fb88c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:56.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:56.798+0000 7fb890e00640 1 --2- 172.21.15.3:0/1832756238 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb8700b5460 0x7fb8700b7920 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:56.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:56.798+0000 7fb890e00640 1 --2- 172.21.15.3:0/1832756238 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb88c108620 0x7fb88c0759e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:56.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:56.798+0000 7fb890e00640 1 --2- 172.21.15.3:0/1832756238 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb88c102c10 0x7fb88c0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:56.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:56.798+0000 7fb890e00640 1 -- 172.21.15.3:0/1832756238 >> 172.21.15.3:0/1832756238 conn(0x7fb88c0fe660 msgr2=0x7fb88c100a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:56.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:56.798+0000 7fb890e00640 1 -- 172.21.15.3:0/1832756238 shutdown_connections 2024-09-10T23:23:56.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:56.798+0000 7fb890e00640 1 -- 172.21.15.3:0/1832756238 wait complete. 2024-09-10T23:23:57.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:56 smithi038 ceph-mon[34225]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T23:23:57.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:56 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/1832756238' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-10T23:23:57.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:56 smithi194 ceph-mon[33904]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T23:23:57.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:56 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/1832756238' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-10T23:23:57.207 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:56 smithi003 ceph-mon[30348]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T23:23:57.207 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:56 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1832756238' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-10T23:23:57.665 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T23:23:57.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:57 smithi003 ceph-mon[30348]: pgmap v291: 33 pgs: 7 active+clean, 1 creating+peering, 25 unknown; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:57.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:57 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1832756238' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-10T23:23:57.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:57 smithi003 ceph-mon[30348]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T23:23:58.070 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:23:58.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:57 smithi038 ceph-mon[34225]: pgmap v291: 33 pgs: 7 active+clean, 1 creating+peering, 25 unknown; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:58.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:57 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/1832756238' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-10T23:23:58.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:57 smithi038 ceph-mon[34225]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T23:23:58.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:57 smithi194 ceph-mon[33904]: pgmap v291: 33 pgs: 7 active+clean, 1 creating+peering, 25 unknown; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:23:58.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:57 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/1832756238' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-10T23:23:58.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:57 smithi194 ceph-mon[33904]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T23:23:58.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.618+0000 7f1cee200640 1 -- 172.21.15.3:0/4284720204 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ce8102da0 msgr2=0x7f1ce8103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:58.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.618+0000 7f1cee200640 1 --2- 172.21.15.3:0/4284720204 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ce8102da0 0x7f1ce8103180 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8009900 tx=0x7f1cd802a410 comp rx=0 tx=0).stop 2024-09-10T23:23:58.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.619+0000 7f1cee200640 1 -- 172.21.15.3:0/4284720204 shutdown_connections 2024-09-10T23:23:58.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.619+0000 7f1cee200640 1 --2- 172.21.15.3:0/4284720204 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ce8109130 0x7f1ce810f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:58.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.619+0000 7f1cee200640 1 --2- 172.21.15.3:0/4284720204 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ce81087b0 0x7f1ce8108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:58.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.619+0000 7f1cee200640 1 --2- 172.21.15.3:0/4284720204 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ce8102da0 0x7f1ce8103180 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:58.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.619+0000 7f1cee200640 1 -- 172.21.15.3:0/4284720204 >> 172.21.15.3:0/4284720204 conn(0x7f1ce80fe810 msgr2=0x7f1ce8100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:58.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.619+0000 7f1cee200640 1 -- 172.21.15.3:0/4284720204 shutdown_connections 2024-09-10T23:23:58.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.619+0000 7f1cee200640 1 -- 172.21.15.3:0/4284720204 wait complete. 2024-09-10T23:23:58.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.620+0000 7f1cee200640 1 Processor -- start 2024-09-10T23:23:58.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.620+0000 7f1cee200640 1 -- start start 2024-09-10T23:23:58.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.620+0000 7f1cee200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ce8102da0 0x7f1ce819b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:58.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.620+0000 7f1cee200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ce81087b0 0x7f1ce819b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:58.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.620+0000 7f1cee200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ce8109130 0x7f1ce81a0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:58.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.620+0000 7f1cee200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce8112cf0 con 0x7f1ce8109130 2024-09-10T23:23:58.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.620+0000 7f1cee200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce8112b70 con 0x7f1ce8102da0 2024-09-10T23:23:58.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.620+0000 7f1cee200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce8112e70 con 0x7f1ce81087b0 2024-09-10T23:23:58.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.620+0000 7f1ce7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ce8109130 0x7f1ce81a0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:58.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.620+0000 7f1ce7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ce8109130 0x7f1ce81a0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50420/0 (socket says 172.21.15.3:50420) 2024-09-10T23:23:58.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.620+0000 7f1ce7e00640 1 -- 172.21.15.3:0/411725520 learned_addr learned my addr 172.21.15.3:0/411725520 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:23:58.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.620+0000 7f1ce6a00640 1 --2- 172.21.15.3:0/411725520 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ce81087b0 0x7f1ce819b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:58.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.621+0000 7f1ce7400640 1 --2- 172.21.15.3:0/411725520 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ce8102da0 0x7f1ce819b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:58.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.621+0000 7f1ce7e00640 1 -- 172.21.15.3:0/411725520 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ce81087b0 msgr2=0x7f1ce819b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:58.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.621+0000 7f1ce7e00640 1 --2- 172.21.15.3:0/411725520 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ce81087b0 0x7f1ce819b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:58.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.621+0000 7f1ce7e00640 1 -- 172.21.15.3:0/411725520 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ce8102da0 msgr2=0x7f1ce819b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:58.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.621+0000 7f1ce7e00640 1 --2- 172.21.15.3:0/411725520 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ce8102da0 0x7f1ce819b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:58.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.621+0000 7f1ce7e00640 1 -- 172.21.15.3:0/411725520 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce81a13f0 con 0x7f1ce8109130 2024-09-10T23:23:58.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.621+0000 7f1ce7400640 1 --2- 172.21.15.3:0/411725520 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ce8102da0 0x7f1ce819b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:23:58.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.621+0000 7f1ce7e00640 1 --2- 172.21.15.3:0/411725520 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ce8109130 0x7f1ce81a0c20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1ce000cce0 tx=0x7f1ce000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:58.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.621+0000 7f1cdfe00640 1 -- 172.21.15.3:0/411725520 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce000f450 con 0x7f1ce8109130 2024-09-10T23:23:58.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.621+0000 7f1cdfe00640 1 -- 172.21.15.3:0/411725520 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1ce000fa80 con 0x7f1ce8109130 2024-09-10T23:23:58.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.622+0000 7f1cdfe00640 1 -- 172.21.15.3:0/411725520 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0018ad0 con 0x7f1ce8109130 2024-09-10T23:23:58.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.622+0000 7f1cee200640 1 -- 172.21.15.3:0/411725520 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ce81a16e0 con 0x7f1ce8109130 2024-09-10T23:23:58.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.622+0000 7f1cee200640 1 -- 172.21.15.3:0/411725520 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ce81a7da0 con 0x7f1ce8109130 2024-09-10T23:23:58.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.623+0000 7f1cee200640 1 -- 172.21.15.3:0/411725520 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ce8103180 con 0x7f1ce8109130 2024-09-10T23:23:58.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.625+0000 7f1cdfe00640 1 -- 172.21.15.3:0/411725520 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7f1ce000f5f0 con 0x7f1ce8109130 2024-09-10T23:23:58.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.627+0000 7f1cdfe00640 1 --2- 172.21.15.3:0/411725520 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f1ccc0b5330 0x7f1ccc0b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:58.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.627+0000 7f1cdfe00640 1 -- 172.21.15.3:0/411725520 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8094+0+0 (secure 0 0 0) 0x7f1ce00e6490 con 0x7f1ce8109130 2024-09-10T23:23:58.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.627+0000 7f1ce7400640 1 --2- 172.21.15.3:0/411725520 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f1ccc0b5330 0x7f1ccc0b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:58.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.628+0000 7f1ce7400640 1 --2- 172.21.15.3:0/411725520 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f1ccc0b5330 0x7f1ccc0b77f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8006010 tx=0x7f1cd8005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:58.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.629+0000 7f1cdfe00640 1 -- 172.21.15.3:0/411725520 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1ce0014030 con 0x7f1ce8109130 2024-09-10T23:23:58.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:58.864+0000 7f1cee200640 1 -- 172.21.15.3:0/411725520 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1ce819c470 con 0x7f1ce8109130 2024-09-10T23:23:59.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:58 smithi038 ceph-mon[34225]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T23:23:59.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:58 smithi038 ceph-mon[34225]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T23:23:59.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:58 smithi194 ceph-mon[33904]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T23:23:59.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:58 smithi194 ceph-mon[33904]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T23:23:59.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:58 smithi003 ceph-mon[30348]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T23:23:59.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:58 smithi003 ceph-mon[30348]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T23:23:59.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:59.832+0000 7f1cdfe00640 1 -- 172.21.15.3:0/411725520 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f1ce819c470 con 0x7f1ce8109130 2024-09-10T23:23:59.834 INFO:teuthology.orchestra.run.smithi003.stderr:new fs with metadata pool 2 and data pool 3 2024-09-10T23:23:59.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:59.836+0000 7f1cee200640 1 -- 172.21.15.3:0/411725520 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f1ccc0b5330 msgr2=0x7f1ccc0b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:59.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:59.836+0000 7f1cee200640 1 --2- 172.21.15.3:0/411725520 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f1ccc0b5330 0x7f1ccc0b77f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8006010 tx=0x7f1cd8005a20 comp rx=0 tx=0).stop 2024-09-10T23:23:59.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:59.836+0000 7f1cee200640 1 -- 172.21.15.3:0/411725520 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ce8109130 msgr2=0x7f1ce81a0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:59.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:59.836+0000 7f1cee200640 1 --2- 172.21.15.3:0/411725520 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ce8109130 0x7f1ce81a0c20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1ce000cce0 tx=0x7f1ce000a620 comp rx=0 tx=0).stop 2024-09-10T23:23:59.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:59.836+0000 7f1cee200640 1 -- 172.21.15.3:0/411725520 shutdown_connections 2024-09-10T23:23:59.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:59.836+0000 7f1cee200640 1 --2- 172.21.15.3:0/411725520 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f1ccc0b5330 0x7f1ccc0b77f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:59.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:59.836+0000 7f1cee200640 1 --2- 172.21.15.3:0/411725520 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ce8109130 0x7f1ce81a0c20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:59.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:59.836+0000 7f1cee200640 1 --2- 172.21.15.3:0/411725520 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ce81087b0 0x7f1ce819b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:59.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:59.836+0000 7f1cee200640 1 --2- 172.21.15.3:0/411725520 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ce8102da0 0x7f1ce819b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:59.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:59.836+0000 7f1cee200640 1 -- 172.21.15.3:0/411725520 >> 172.21.15.3:0/411725520 conn(0x7f1ce80fe810 msgr2=0x7f1ce8104d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:59.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:59.836+0000 7f1cee200640 1 -- 172.21.15.3:0/411725520 shutdown_connections 2024-09-10T23:23:59.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:23:59.836+0000 7f1cee200640 1 -- 172.21.15.3:0/411725520 wait complete. 2024-09-10T23:24:00.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:59 smithi038 ceph-mon[34225]: pgmap v294: 97 pgs: 34 active+clean, 30 creating+peering, 33 unknown; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:24:00.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:59 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/411725520' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-10T23:24:00.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:23:59 smithi038 ceph-mon[34225]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T23:24:00.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:59 smithi194 ceph-mon[33904]: pgmap v294: 97 pgs: 34 active+clean, 30 creating+peering, 33 unknown; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:24:00.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:59 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/411725520' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-10T23:24:00.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:23:59 smithi194 ceph-mon[33904]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T23:24:00.199 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:59 smithi003 ceph-mon[30348]: pgmap v294: 97 pgs: 34 active+clean, 30 creating+peering, 33 unknown; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:24:00.200 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:59 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/411725520' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-10T23:24:00.200 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:23:59 smithi003 ceph-mon[30348]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T23:24:00.598 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-10T23:24:00.598 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-10T23:24:00.984 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:01.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:00 smithi038 ceph-mon[34225]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T23:24:01.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:00 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/411725520' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T23:24:01.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:00 smithi038 ceph-mon[34225]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-10T23:24:01.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:00 smithi038 ceph-mon[34225]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T23:24:01.122 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:00 smithi003 ceph-mon[30348]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T23:24:01.122 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:00 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/411725520' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T23:24:01.122 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:00 smithi003 ceph-mon[30348]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-10T23:24:01.122 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:00 smithi003 ceph-mon[30348]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T23:24:01.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:00 smithi194 ceph-mon[33904]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T23:24:01.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:00 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/411725520' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T23:24:01.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:00 smithi194 ceph-mon[33904]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-10T23:24:01.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:00 smithi194 ceph-mon[33904]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T23:24:01.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.557+0000 7f4df4200640 1 -- 172.21.15.3:0/3374188621 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4dec0776d0 msgr2=0x7f4dec077ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:01.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.557+0000 7f4df4200640 1 --2- 172.21.15.3:0/3374188621 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4dec0776d0 0x7f4dec077ab0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009ca0 tx=0x7f4de002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.558+0000 7f4df4200640 1 -- 172.21.15.3:0/3374188621 shutdown_connections 2024-09-10T23:24:01.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.558+0000 7f4df4200640 1 --2- 172.21.15.3:0/3374188621 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dec113990 0x7f4dec115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.558+0000 7f4df4200640 1 --2- 172.21.15.3:0/3374188621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4dec077ff0 0x7f4dec113450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.558+0000 7f4df4200640 1 --2- 172.21.15.3:0/3374188621 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4dec0776d0 0x7f4dec077ab0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.558+0000 7f4df4200640 1 -- 172.21.15.3:0/3374188621 >> 172.21.15.3:0/3374188621 conn(0x7f4dec100a50 msgr2=0x7f4dec102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:01.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.558+0000 7f4df4200640 1 -- 172.21.15.3:0/3374188621 shutdown_connections 2024-09-10T23:24:01.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.558+0000 7f4df4200640 1 -- 172.21.15.3:0/3374188621 wait complete. 2024-09-10T23:24:01.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.559+0000 7f4df4200640 1 Processor -- start 2024-09-10T23:24:01.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.559+0000 7f4df4200640 1 -- start start 2024-09-10T23:24:01.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.559+0000 7f4df4200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dec0776d0 0x7f4dec19f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:01.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.559+0000 7f4df4200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4dec077ff0 0x7f4dec19fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:01.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.559+0000 7f4df4200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4dec113990 0x7f4dec1a5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:01.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.559+0000 7f4df4200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec119290 con 0x7f4dec077ff0 2024-09-10T23:24:01.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.559+0000 7f4df4200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec119110 con 0x7f4dec113990 2024-09-10T23:24:01.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.559+0000 7f4df4200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec119410 con 0x7f4dec0776d0 2024-09-10T23:24:01.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.559+0000 7f4df0e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4dec077ff0 0x7f4dec19fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:01.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.560+0000 7f4df0e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4dec077ff0 0x7f4dec19fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60902/0 (socket says 172.21.15.3:60902) 2024-09-10T23:24:01.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.560+0000 7f4df0e00640 1 -- 172.21.15.3:0/2255407570 learned_addr learned my addr 172.21.15.3:0/2255407570 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:24:01.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.560+0000 7f4df2200640 1 --2- 172.21.15.3:0/2255407570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4dec113990 0x7f4dec1a5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:01.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.560+0000 7f4df1800640 1 --2- 172.21.15.3:0/2255407570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dec0776d0 0x7f4dec19f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:01.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.560+0000 7f4df0e00640 1 -- 172.21.15.3:0/2255407570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dec0776d0 msgr2=0x7f4dec19f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:01.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.560+0000 7f4df0e00640 1 --2- 172.21.15.3:0/2255407570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dec0776d0 0x7f4dec19f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.560+0000 7f4df0e00640 1 -- 172.21.15.3:0/2255407570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4dec113990 msgr2=0x7f4dec1a5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:01.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.560+0000 7f4df0e00640 1 --2- 172.21.15.3:0/2255407570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4dec113990 0x7f4dec1a5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.560+0000 7f4df0e00640 1 -- 172.21.15.3:0/2255407570 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dec1a5850 con 0x7f4dec077ff0 2024-09-10T23:24:01.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.560+0000 7f4df0e00640 1 --2- 172.21.15.3:0/2255407570 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4dec077ff0 0x7f4dec19fce0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4dd800e9f0 tx=0x7f4dd800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:01.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.560+0000 7f4dea000640 1 -- 172.21.15.3:0/2255407570 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd800cd80 con 0x7f4dec077ff0 2024-09-10T23:24:01.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.561+0000 7f4dea000640 1 -- 172.21.15.3:0/2255407570 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4dd80108c0 con 0x7f4dec077ff0 2024-09-10T23:24:01.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.561+0000 7f4dea000640 1 -- 172.21.15.3:0/2255407570 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd80187c0 con 0x7f4dec077ff0 2024-09-10T23:24:01.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.561+0000 7f4df4200640 1 -- 172.21.15.3:0/2255407570 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dec1a5b40 con 0x7f4dec077ff0 2024-09-10T23:24:01.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.561+0000 7f4df4200640 1 -- 172.21.15.3:0/2255407570 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dec1ac200 con 0x7f4dec077ff0 2024-09-10T23:24:01.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.562+0000 7f4df4200640 1 -- 172.21.15.3:0/2255407570 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dec077ab0 con 0x7f4dec077ff0 2024-09-10T23:24:01.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.564+0000 7f4dea000640 1 -- 172.21.15.3:0/2255407570 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7f4dd8010430 con 0x7f4dec077ff0 2024-09-10T23:24:01.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.565+0000 7f4dea000640 1 --2- 172.21.15.3:0/2255407570 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f4dd40b53b0 0x7f4dd40b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:01.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.566+0000 7f4dea000640 1 -- 172.21.15.3:0/2255407570 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8194+0+0 (secure 0 0 0) 0x7f4dd80e5f50 con 0x7f4dec077ff0 2024-09-10T23:24:01.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.566+0000 7f4df1800640 1 --2- 172.21.15.3:0/2255407570 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f4dd40b53b0 0x7f4dd40b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:01.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.567+0000 7f4df1800640 1 --2- 172.21.15.3:0/2255407570 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f4dd40b53b0 0x7f4dd40b7870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4de0006010 tx=0x7f4de0031000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:01.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.569+0000 7f4dea000640 1 -- 172.21.15.3:0/2255407570 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4dd80ac780 con 0x7f4dec077ff0 2024-09-10T23:24:01.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.772+0000 7f4df4200640 1 -- 172.21.15.3:0/2255407570 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f4dec1ac590 con 0x7f4dec077ff0 2024-09-10T23:24:01.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.846+0000 7f4dea000640 1 -- 172.21.15.3:0/2255407570 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v80) ==== 157+0+0 (secure 0 0 0) 0x7f4dd80b11b0 con 0x7f4dec077ff0 2024-09-10T23:24:01.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.849+0000 7f4df4200640 1 -- 172.21.15.3:0/2255407570 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f4dd40b53b0 msgr2=0x7f4dd40b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:01.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.849+0000 7f4df4200640 1 --2- 172.21.15.3:0/2255407570 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f4dd40b53b0 0x7f4dd40b7870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4de0006010 tx=0x7f4de0031000 comp rx=0 tx=0).stop 2024-09-10T23:24:01.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.849+0000 7f4df4200640 1 -- 172.21.15.3:0/2255407570 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4dec077ff0 msgr2=0x7f4dec19fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:01.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.849+0000 7f4df4200640 1 --2- 172.21.15.3:0/2255407570 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4dec077ff0 0x7f4dec19fce0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4dd800e9f0 tx=0x7f4dd800eeb0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.850+0000 7f4df4200640 1 -- 172.21.15.3:0/2255407570 shutdown_connections 2024-09-10T23:24:01.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.850+0000 7f4df4200640 1 --2- 172.21.15.3:0/2255407570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4dec113990 0x7f4dec1a5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.850+0000 7f4df4200640 1 --2- 172.21.15.3:0/2255407570 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f4dd40b53b0 0x7f4dd40b7870 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.850+0000 7f4df4200640 1 --2- 172.21.15.3:0/2255407570 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4dec077ff0 0x7f4dec19fce0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.850+0000 7f4df4200640 1 --2- 172.21.15.3:0/2255407570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dec0776d0 0x7f4dec19f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:01.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.850+0000 7f4df4200640 1 -- 172.21.15.3:0/2255407570 >> 172.21.15.3:0/2255407570 conn(0x7f4dec100a50 msgr2=0x7f4dec102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:01.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.850+0000 7f4df4200640 1 -- 172.21.15.3:0/2255407570 shutdown_connections 2024-09-10T23:24:01.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:01.850+0000 7f4df4200640 1 -- 172.21.15.3:0/2255407570 wait complete. 2024-09-10T23:24:02.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:01 smithi038 ceph-mon[34225]: pgmap v297: 97 pgs: 56 active+clean, 29 creating+peering, 12 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:24:02.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:01 smithi038 ceph-mon[34225]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T23:24:02.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:01 smithi038 ceph-mon[34225]: Cluster is now healthy 2024-09-10T23:24:02.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:01 smithi038 ceph-mon[34225]: mds.? [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] up:active 2024-09-10T23:24:02.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:01 smithi038 ceph-mon[34225]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T23:24:02.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:01 smithi038 ceph-mon[34225]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T23:24:02.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:01 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2255407570' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-10T23:24:02.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:01 smithi194 ceph-mon[33904]: pgmap v297: 97 pgs: 56 active+clean, 29 creating+peering, 12 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:24:02.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:01 smithi194 ceph-mon[33904]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T23:24:02.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:01 smithi194 ceph-mon[33904]: Cluster is now healthy 2024-09-10T23:24:02.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:01 smithi194 ceph-mon[33904]: mds.? [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] up:active 2024-09-10T23:24:02.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:01 smithi194 ceph-mon[33904]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T23:24:02.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:01 smithi194 ceph-mon[33904]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T23:24:02.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:01 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2255407570' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-10T23:24:02.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:01 smithi003 ceph-mon[30348]: pgmap v297: 97 pgs: 56 active+clean, 29 creating+peering, 12 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:24:02.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:01 smithi003 ceph-mon[30348]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T23:24:02.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:01 smithi003 ceph-mon[30348]: Cluster is now healthy 2024-09-10T23:24:02.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:01 smithi003 ceph-mon[30348]: mds.? [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] up:active 2024-09-10T23:24:02.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:01 smithi003 ceph-mon[30348]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T23:24:02.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:01 smithi003 ceph-mon[30348]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T23:24:02.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:01 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2255407570' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-10T23:24:02.603 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T23:24:02.985 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:03.124 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:02 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2255407570' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-10T23:24:03.125 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:02 smithi003 ceph-mon[30348]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T23:24:03.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:02 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2255407570' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-10T23:24:03.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:02 smithi194 ceph-mon[33904]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T23:24:03.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:02 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2255407570' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-10T23:24:03.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:02 smithi038 ceph-mon[34225]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T23:24:03.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.537+0000 7ff1d8e00640 1 -- 172.21.15.3:0/1634334007 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff1d410f3b0 msgr2=0x7ff1d41117a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:03.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.537+0000 7ff1d8e00640 1 --2- 172.21.15.3:0/1634334007 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff1d410f3b0 0x7ff1d41117a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc009900 tx=0x7ff1cc02a3f0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.537+0000 7ff1d8e00640 1 -- 172.21.15.3:0/1634334007 shutdown_connections 2024-09-10T23:24:03.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.537+0000 7ff1d8e00640 1 --2- 172.21.15.3:0/1634334007 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff1d410f3b0 0x7ff1d41117a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.537+0000 7ff1d8e00640 1 --2- 172.21.15.3:0/1634334007 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1d4075de0 0x7ff1d410ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.537+0000 7ff1d8e00640 1 --2- 172.21.15.3:0/1634334007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1d40754c0 0x7ff1d40758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.537+0000 7ff1d8e00640 1 -- 172.21.15.3:0/1634334007 >> 172.21.15.3:0/1634334007 conn(0x7ff1d40fe810 msgr2=0x7ff1d4100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:03.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.537+0000 7ff1d8e00640 1 -- 172.21.15.3:0/1634334007 shutdown_connections 2024-09-10T23:24:03.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.537+0000 7ff1d8e00640 1 -- 172.21.15.3:0/1634334007 wait complete. 2024-09-10T23:24:03.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.538+0000 7ff1d8e00640 1 Processor -- start 2024-09-10T23:24:03.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.538+0000 7ff1d8e00640 1 -- start start 2024-09-10T23:24:03.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.539+0000 7ff1d8e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff1d40754c0 0x7ff1d419b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:03.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.539+0000 7ff1d8e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1d4075de0 0x7ff1d419b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:03.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.539+0000 7ff1d8e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1d410f3b0 0x7ff1d41a0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:03.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.539+0000 7ff1d8e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d4114e60 con 0x7ff1d40754c0 2024-09-10T23:24:03.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.539+0000 7ff1d8e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d4114ce0 con 0x7ff1d4075de0 2024-09-10T23:24:03.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.539+0000 7ff1d8e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d4114fe0 con 0x7ff1d410f3b0 2024-09-10T23:24:03.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.539+0000 7ff1d1e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff1d40754c0 0x7ff1d419b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:03.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.539+0000 7ff1d1e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff1d40754c0 0x7ff1d419b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60930/0 (socket says 172.21.15.3:60930) 2024-09-10T23:24:03.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.539+0000 7ff1d1e00640 1 -- 172.21.15.3:0/3006268291 learned_addr learned my addr 172.21.15.3:0/3006268291 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:24:03.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.539+0000 7ff1d1400640 1 --2- 172.21.15.3:0/3006268291 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1d4075de0 0x7ff1d419b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:03.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.539+0000 7ff1d2800640 1 --2- 172.21.15.3:0/3006268291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1d410f3b0 0x7ff1d41a0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:03.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.539+0000 7ff1d1e00640 1 -- 172.21.15.3:0/3006268291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1d410f3b0 msgr2=0x7ff1d41a0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:03.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.539+0000 7ff1d1e00640 1 --2- 172.21.15.3:0/3006268291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1d410f3b0 0x7ff1d41a0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.539+0000 7ff1d1e00640 1 -- 172.21.15.3:0/3006268291 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1d4075de0 msgr2=0x7ff1d419b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:03.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.539+0000 7ff1d1e00640 1 --2- 172.21.15.3:0/3006268291 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1d4075de0 0x7ff1d419b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:03.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.539+0000 7ff1d1e00640 1 -- 172.21.15.3:0/3006268291 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d41a1440 con 0x7ff1d40754c0 2024-09-10T23:24:03.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.539+0000 7ff1d2800640 1 --2- 172.21.15.3:0/3006268291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1d410f3b0 0x7ff1d41a0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:03.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.540+0000 7ff1d1e00640 1 --2- 172.21.15.3:0/3006268291 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff1d40754c0 0x7ff1d419b390 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff1c400eab0 tx=0x7ff1c400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:03.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.540+0000 7ff1caa00640 1 -- 172.21.15.3:0/3006268291 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c400ce40 con 0x7ff1d40754c0 2024-09-10T23:24:03.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.540+0000 7ff1d8e00640 1 -- 172.21.15.3:0/3006268291 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1d41a1730 con 0x7ff1d40754c0 2024-09-10T23:24:03.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.540+0000 7ff1caa00640 1 -- 172.21.15.3:0/3006268291 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff1c4011900 con 0x7ff1d40754c0 2024-09-10T23:24:03.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.540+0000 7ff1caa00640 1 -- 172.21.15.3:0/3006268291 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4010990 con 0x7ff1d40754c0 2024-09-10T23:24:03.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.540+0000 7ff1d8e00640 1 -- 172.21.15.3:0/3006268291 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1d41a7fc0 con 0x7ff1d40754c0 2024-09-10T23:24:03.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.541+0000 7ff1d8e00640 1 -- 172.21.15.3:0/3006268291 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1d40758a0 con 0x7ff1d40754c0 2024-09-10T23:24:03.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.543+0000 7ff1caa00640 1 -- 172.21.15.3:0/3006268291 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7ff1c400f040 con 0x7ff1d40754c0 2024-09-10T23:24:03.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.545+0000 7ff1caa00640 1 --2- 172.21.15.3:0/3006268291 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff1b80b53b0 0x7ff1b80b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:03.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.545+0000 7ff1caa00640 1 -- 172.21.15.3:0/3006268291 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8492+0+0 (secure 0 0 0) 0x7ff1c40e6070 con 0x7ff1d40754c0 2024-09-10T23:24:03.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.545+0000 7ff1d1400640 1 --2- 172.21.15.3:0/3006268291 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff1b80b53b0 0x7ff1b80b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:03.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.546+0000 7ff1d1400640 1 --2- 172.21.15.3:0/3006268291 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff1b80b53b0 0x7ff1b80b7870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4101060 tx=0x7ff1bc00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:03.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.549+0000 7ff1caa00640 1 -- 172.21.15.3:0/3006268291 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff1c4016030 con 0x7ff1d40754c0 2024-09-10T23:24:03.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:03.746+0000 7ff1d8e00640 1 -- 172.21.15.3:0/3006268291 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff1d419c4c0 con 0x7ff1d40754c0 2024-09-10T23:24:04.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:03 smithi194 ceph-mon[33904]: pgmap v299: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s wr, 8 op/s 2024-09-10T23:24:04.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:03 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3006268291' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-10T23:24:04.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:03 smithi003 ceph-mon[30348]: pgmap v299: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s wr, 8 op/s 2024-09-10T23:24:04.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:03 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3006268291' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-10T23:24:04.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:03 smithi038 ceph-mon[34225]: pgmap v299: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s wr, 8 op/s 2024-09-10T23:24:04.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:03 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3006268291' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-10T23:24:04.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:04.858+0000 7ff1caa00640 1 -- 172.21.15.3:0/3006268291 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v82) ==== 228+0+0 (secure 0 0 0) 0x7ff1c40acdd0 con 0x7ff1d40754c0 2024-09-10T23:24:04.860 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_data_ec' created 2024-09-10T23:24:04.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:04.862+0000 7ff1d8e00640 1 -- 172.21.15.3:0/3006268291 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff1b80b53b0 msgr2=0x7ff1b80b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:04.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:04.862+0000 7ff1d8e00640 1 --2- 172.21.15.3:0/3006268291 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff1b80b53b0 0x7ff1b80b7870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4101060 tx=0x7ff1bc00b390 comp rx=0 tx=0).stop 2024-09-10T23:24:04.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:04.862+0000 7ff1d8e00640 1 -- 172.21.15.3:0/3006268291 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff1d40754c0 msgr2=0x7ff1d419b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:04.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:04.862+0000 7ff1d8e00640 1 --2- 172.21.15.3:0/3006268291 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff1d40754c0 0x7ff1d419b390 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff1c400eab0 tx=0x7ff1c400ef70 comp rx=0 tx=0).stop 2024-09-10T23:24:04.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:04.862+0000 7ff1d8e00640 1 -- 172.21.15.3:0/3006268291 shutdown_connections 2024-09-10T23:24:04.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:04.862+0000 7ff1d8e00640 1 --2- 172.21.15.3:0/3006268291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1d410f3b0 0x7ff1d41a0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:04.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:04.862+0000 7ff1d8e00640 1 --2- 172.21.15.3:0/3006268291 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1d4075de0 0x7ff1d419b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:04.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:04.862+0000 7ff1d8e00640 1 --2- 172.21.15.3:0/3006268291 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff1b80b53b0 0x7ff1b80b7870 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:04.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:04.862+0000 7ff1d8e00640 1 --2- 172.21.15.3:0/3006268291 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff1d40754c0 0x7ff1d419b390 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:04.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:04.862+0000 7ff1d8e00640 1 -- 172.21.15.3:0/3006268291 >> 172.21.15.3:0/3006268291 conn(0x7ff1d40fe810 msgr2=0x7ff1d41115d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:04.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:04.862+0000 7ff1d8e00640 1 -- 172.21.15.3:0/3006268291 shutdown_connections 2024-09-10T23:24:04.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:04.863+0000 7ff1d8e00640 1 -- 172.21.15.3:0/3006268291 wait complete. 2024-09-10T23:24:05.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:04 smithi194 ceph-mon[33904]: osdmap e81: 12 total, 12 up, 12 in 2024-09-10T23:24:05.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:04 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3006268291' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T23:24:05.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:04 smithi194 ceph-mon[33904]: osdmap e82: 12 total, 12 up, 12 in 2024-09-10T23:24:05.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:04 smithi003 ceph-mon[30348]: osdmap e81: 12 total, 12 up, 12 in 2024-09-10T23:24:05.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:04 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3006268291' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T23:24:05.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:04 smithi003 ceph-mon[30348]: osdmap e82: 12 total, 12 up, 12 in 2024-09-10T23:24:05.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:04 smithi038 ceph-mon[34225]: osdmap e81: 12 total, 12 up, 12 in 2024-09-10T23:24:05.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:04 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3006268291' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T23:24:05.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:04 smithi038 ceph-mon[34225]: osdmap e82: 12 total, 12 up, 12 in 2024-09-10T23:24:05.799 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-10T23:24:05.847 INFO:journalctl@ceph.mds.b.smithi038.stdout:Sep 10 23:24:05 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-b[65649]: 2024-09-10T23:24:05.513+0000 7fe26fa00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:24:06.196 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:06.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:05 smithi194 ceph-mon[33904]: pgmap v301: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-10T23:24:06.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:05 smithi194 ceph-mon[33904]: osdmap e83: 12 total, 12 up, 12 in 2024-09-10T23:24:06.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:05 smithi003 ceph-mon[30348]: pgmap v301: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-10T23:24:06.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:05 smithi003 ceph-mon[30348]: osdmap e83: 12 total, 12 up, 12 in 2024-09-10T23:24:06.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:05 smithi038 ceph-mon[34225]: pgmap v301: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-10T23:24:06.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:05 smithi038 ceph-mon[34225]: osdmap e83: 12 total, 12 up, 12 in 2024-09-10T23:24:06.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.710+0000 7fc215a00640 1 -- 172.21.15.3:0/2436848819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc2100754e0 msgr2=0x7fc2100758c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:06.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.710+0000 7fc215a00640 1 --2- 172.21.15.3:0/2436848819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc2100754e0 0x7fc2100758c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc200009900 tx=0x7fc20002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.710+0000 7fc215a00640 1 -- 172.21.15.3:0/2436848819 shutdown_connections 2024-09-10T23:24:06.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.710+0000 7fc215a00640 1 --2- 172.21.15.3:0/2436848819 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc21010f200 0x7fc2101115f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.710+0000 7fc215a00640 1 --2- 172.21.15.3:0/2436848819 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc210075e00 0x7fc21010ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.710+0000 7fc215a00640 1 --2- 172.21.15.3:0/2436848819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc2100754e0 0x7fc2100758c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.710+0000 7fc215a00640 1 -- 172.21.15.3:0/2436848819 >> 172.21.15.3:0/2436848819 conn(0x7fc2100fe660 msgr2=0x7fc210100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:06.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.710+0000 7fc215a00640 1 -- 172.21.15.3:0/2436848819 shutdown_connections 2024-09-10T23:24:06.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.710+0000 7fc215a00640 1 -- 172.21.15.3:0/2436848819 wait complete. 2024-09-10T23:24:06.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.711+0000 7fc215a00640 1 Processor -- start 2024-09-10T23:24:06.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.711+0000 7fc215a00640 1 -- start start 2024-09-10T23:24:06.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.712+0000 7fc215a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2100754e0 0x7fc21019b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:06.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.712+0000 7fc215a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc210075e00 0x7fc21019b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:06.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.712+0000 7fc215a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc21010f200 0x7fc2101a0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:06.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.712+0000 7fc215a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc210114c90 con 0x7fc210075e00 2024-09-10T23:24:06.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.712+0000 7fc215a00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fc210114b10 con 0x7fc2100754e0 2024-09-10T23:24:06.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.712+0000 7fc215a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc210114e10 con 0x7fc21010f200 2024-09-10T23:24:06.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.712+0000 7fc207e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc210075e00 0x7fc21019b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:06.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.712+0000 7fc207e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc210075e00 0x7fc21019b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60958/0 (socket says 172.21.15.3:60958) 2024-09-10T23:24:06.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.712+0000 7fc207e00640 1 -- 172.21.15.3:0/3670957223 learned_addr learned my addr 172.21.15.3:0/3670957223 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:24:06.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.712+0000 7fc20fe00640 1 --2- 172.21.15.3:0/3670957223 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2100754e0 0x7fc21019b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:06.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.712+0000 7fc215000640 1 --2- 172.21.15.3:0/3670957223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc21010f200 0x7fc2101a0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:06.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.713+0000 7fc207e00640 1 -- 172.21.15.3:0/3670957223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc21010f200 msgr2=0x7fc2101a0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:06.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.713+0000 7fc207e00640 1 --2- 172.21.15.3:0/3670957223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc21010f200 0x7fc2101a0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.713+0000 7fc207e00640 1 -- 172.21.15.3:0/3670957223 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2100754e0 msgr2=0x7fc21019b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:06.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.713+0000 7fc207e00640 1 --2- 172.21.15.3:0/3670957223 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2100754e0 0x7fc21019b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:06.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.713+0000 7fc207e00640 1 -- 172.21.15.3:0/3670957223 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2101a1150 con 0x7fc210075e00 2024-09-10T23:24:06.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.713+0000 7fc207e00640 1 --2- 172.21.15.3:0/3670957223 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc210075e00 0x7fc21019b5e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc1f800c920 tx=0x7fc1f800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:06.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.713+0000 7fc20d600640 1 -- 172.21.15.3:0/3670957223 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f8007c70 con 0x7fc210075e00 2024-09-10T23:24:06.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.713+0000 7fc20d600640 1 -- 172.21.15.3:0/3670957223 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc1f8007e10 con 0x7fc210075e00 2024-09-10T23:24:06.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.713+0000 7fc20d600640 1 -- 172.21.15.3:0/3670957223 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f8018710 con 0x7fc210075e00 2024-09-10T23:24:06.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.713+0000 7fc215a00640 1 -- 172.21.15.3:0/3670957223 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2101a1440 con 0x7fc210075e00 2024-09-10T23:24:06.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.713+0000 7fc215a00640 1 -- 172.21.15.3:0/3670957223 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2101a7b00 con 0x7fc210075e00 2024-09-10T23:24:06.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.714+0000 7fc215a00640 1 -- 172.21.15.3:0/3670957223 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2100758c0 con 0x7fc210075e00 2024-09-10T23:24:06.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.717+0000 7fc20d600640 1 -- 172.21.15.3:0/3670957223 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7fc1f800f450 con 0x7fc210075e00 2024-09-10T23:24:06.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.718+0000 7fc20d600640 1 --2- 172.21.15.3:0/3670957223 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc1f40b53e0 0x7fc1f40b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:06.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.719+0000 7fc20d600640 1 -- 172.21.15.3:0/3670957223 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8985+0+0 (secure 0 0 0) 0x7fc1f80e63c0 con 0x7fc210075e00 2024-09-10T23:24:06.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.719+0000 7fc20fe00640 1 --2- 172.21.15.3:0/3670957223 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc1f40b53e0 0x7fc1f40b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:06.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.720+0000 7fc20fe00640 1 --2- 172.21.15.3:0/3670957223 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc1f40b53e0 0x7fc1f40b78a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc2000057c0 tx=0x7fc2000058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:06.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.721+0000 7fc20d600640 1 -- 172.21.15.3:0/3670957223 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc1f8014030 con 0x7fc210075e00 2024-09-10T23:24:06.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:06.920+0000 7fc215a00640 1 -- 172.21.15.3:0/3670957223 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fc2101a7ef0 con 0x7fc210075e00 2024-09-10T23:24:07.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:07.894+0000 7fc20d600640 1 -- 172.21.15.3:0/3670957223 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v85) ==== 169+0+0 (secure 0 0 0) 0x7fc1f80acfc0 con 0x7fc210075e00 2024-09-10T23:24:07.895 INFO:teuthology.orchestra.run.smithi003.stderr:set pool 4 allow_ec_overwrites to true 2024-09-10T23:24:07.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:07.898+0000 7fc215a00640 1 -- 172.21.15.3:0/3670957223 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc1f40b53e0 msgr2=0x7fc1f40b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:07.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:07.898+0000 7fc215a00640 1 --2- 172.21.15.3:0/3670957223 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc1f40b53e0 0x7fc1f40b78a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc2000057c0 tx=0x7fc2000058d0 comp rx=0 tx=0).stop 2024-09-10T23:24:07.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:07.898+0000 7fc215a00640 1 -- 172.21.15.3:0/3670957223 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc210075e00 msgr2=0x7fc21019b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:07.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:07.898+0000 7fc215a00640 1 --2- 172.21.15.3:0/3670957223 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc210075e00 0x7fc21019b5e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc1f800c920 tx=0x7fc1f800cde0 comp rx=0 tx=0).stop 2024-09-10T23:24:07.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:07.898+0000 7fc215a00640 1 -- 172.21.15.3:0/3670957223 shutdown_connections 2024-09-10T23:24:07.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:07.898+0000 7fc215a00640 1 --2- 172.21.15.3:0/3670957223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc21010f200 0x7fc2101a0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:07.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:07.898+0000 7fc215a00640 1 --2- 172.21.15.3:0/3670957223 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc1f40b53e0 0x7fc1f40b78a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:07.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:07.898+0000 7fc215a00640 1 --2- 172.21.15.3:0/3670957223 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc210075e00 0x7fc21019b5e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:07.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:07.898+0000 7fc215a00640 1 --2- 172.21.15.3:0/3670957223 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2100754e0 0x7fc21019b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:07.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:07.898+0000 7fc215a00640 1 -- 172.21.15.3:0/3670957223 >> 172.21.15.3:0/3670957223 conn(0x7fc2100fe660 msgr2=0x7fc210111350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:07.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:07.898+0000 7fc215a00640 1 -- 172.21.15.3:0/3670957223 shutdown_connections 2024-09-10T23:24:07.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:07.898+0000 7fc215a00640 1 -- 172.21.15.3:0/3670957223 wait complete. 2024-09-10T23:24:08.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:07 smithi194 ceph-mon[33904]: pgmap v304: 129 pgs: 3 creating+peering, 28 unknown, 98 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 7 op/s 2024-09-10T23:24:08.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:07 smithi194 ceph-mon[33904]: osdmap e84: 12 total, 12 up, 12 in 2024-09-10T23:24:08.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:07 smithi194 ceph-mon[33904]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T23:24:08.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:07 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3670957223' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-10T23:24:08.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:07 smithi003 ceph-mon[30348]: pgmap v304: 129 pgs: 3 creating+peering, 28 unknown, 98 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 7 op/s 2024-09-10T23:24:08.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:07 smithi003 ceph-mon[30348]: osdmap e84: 12 total, 12 up, 12 in 2024-09-10T23:24:08.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:07 smithi003 ceph-mon[30348]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T23:24:08.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:07 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3670957223' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-10T23:24:08.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:07 smithi038 ceph-mon[34225]: pgmap v304: 129 pgs: 3 creating+peering, 28 unknown, 98 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 7 op/s 2024-09-10T23:24:08.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:07 smithi038 ceph-mon[34225]: osdmap e84: 12 total, 12 up, 12 in 2024-09-10T23:24:08.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:07 smithi038 ceph-mon[34225]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T23:24:08.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:07 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3670957223' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-10T23:24:08.653 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-10T23:24:09.042 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:09.180 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:08 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3670957223' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-10T23:24:09.180 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:08 smithi003 ceph-mon[30348]: osdmap e85: 12 total, 12 up, 12 in 2024-09-10T23:24:09.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:08 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3670957223' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-10T23:24:09.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:08 smithi194 ceph-mon[33904]: osdmap e85: 12 total, 12 up, 12 in 2024-09-10T23:24:09.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:08 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3670957223' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-10T23:24:09.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:08 smithi038 ceph-mon[34225]: osdmap e85: 12 total, 12 up, 12 in 2024-09-10T23:24:09.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.717+0000 7f901d200640 1 -- 172.21.15.3:0/4041252540 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90180776d0 msgr2=0x7f9018077ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:09.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.717+0000 7f901d200640 1 --2- 172.21.15.3:0/4041252540 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90180776d0 0x7f9018077ab0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9008009900 tx=0x7f900802a3f0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.717+0000 7f901d200640 1 -- 172.21.15.3:0/4041252540 shutdown_connections 2024-09-10T23:24:09.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.717+0000 7f901d200640 1 --2- 172.21.15.3:0/4041252540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90181137e0 0x7f9018115bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.717+0000 7f901d200640 1 --2- 172.21.15.3:0/4041252540 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9018077ff0 0x7f90181132a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.717+0000 7f901d200640 1 --2- 172.21.15.3:0/4041252540 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90180776d0 0x7f9018077ab0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.717+0000 7f901d200640 1 -- 172.21.15.3:0/4041252540 >> 172.21.15.3:0/4041252540 conn(0x7f9018100840 msgr2=0x7f9018102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:09.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.717+0000 7f901d200640 1 -- 172.21.15.3:0/4041252540 shutdown_connections 2024-09-10T23:24:09.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.717+0000 7f901d200640 1 -- 172.21.15.3:0/4041252540 wait complete. 2024-09-10T23:24:09.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.718+0000 7f901d200640 1 Processor -- start 2024-09-10T23:24:09.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.718+0000 7f901d200640 1 -- start start 2024-09-10T23:24:09.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.719+0000 7f901d200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90180776d0 0x7f901819f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:09.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.719+0000 7f901d200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9018077ff0 0x7f901819f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:09.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.719+0000 7f901d200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90181137e0 0x7f90181a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:09.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.719+0000 7f901d200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9018119080 con 0x7f9018077ff0 2024-09-10T23:24:09.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.719+0000 7f901d200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9018118f00 con 0x7f90181137e0 2024-09-10T23:24:09.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.719+0000 7f901d200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9018119200 con 0x7f90180776d0 2024-09-10T23:24:09.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.719+0000 7f900ea00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9018077ff0 0x7f901819f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:09.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.719+0000 7f900ea00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9018077ff0 0x7f901819f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60978/0 (socket says 172.21.15.3:60978) 2024-09-10T23:24:09.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.719+0000 7f900ea00640 1 -- 172.21.15.3:0/2725069033 learned_addr learned my addr 172.21.15.3:0/2725069033 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:24:09.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.719+0000 7f9017e00640 1 --2- 172.21.15.3:0/2725069033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90181137e0 0x7f90181a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:09.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.719+0000 7f9017400640 1 --2- 172.21.15.3:0/2725069033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90180776d0 0x7f901819f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:09.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.719+0000 7f900ea00640 1 -- 172.21.15.3:0/2725069033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90180776d0 msgr2=0x7f901819f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:09.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.719+0000 7f900ea00640 1 --2- 172.21.15.3:0/2725069033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90180776d0 0x7f901819f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.720+0000 7f900ea00640 1 -- 172.21.15.3:0/2725069033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90181137e0 msgr2=0x7f90181a4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:09.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.720+0000 7f900ea00640 1 --2- 172.21.15.3:0/2725069033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90181137e0 0x7f90181a4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.720+0000 7f900ea00640 1 -- 172.21.15.3:0/2725069033 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90181a5540 con 0x7f9018077ff0 2024-09-10T23:24:09.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.720+0000 7f9017e00640 1 --2- 172.21.15.3:0/2725069033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90181137e0 0x7f90181a4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:24:09.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.720+0000 7f900ea00640 1 --2- 172.21.15.3:0/2725069033 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9018077ff0 0x7f901819f9d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f900000c920 tx=0x7f900000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:09.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.720+0000 7f9014c00640 1 -- 172.21.15.3:0/2725069033 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9000007c70 con 0x7f9018077ff0 2024-09-10T23:24:09.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.720+0000 7f9014c00640 1 -- 172.21.15.3:0/2725069033 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9000007e10 con 0x7f9018077ff0 2024-09-10T23:24:09.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.720+0000 7f901d200640 1 -- 172.21.15.3:0/2725069033 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90181a5830 con 0x7f9018077ff0 2024-09-10T23:24:09.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.720+0000 7f9014c00640 1 -- 172.21.15.3:0/2725069033 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9000018710 con 0x7f9018077ff0 2024-09-10T23:24:09.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.720+0000 7f901d200640 1 -- 172.21.15.3:0/2725069033 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90181abef0 con 0x7f9018077ff0 2024-09-10T23:24:09.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.721+0000 7f901d200640 1 -- 172.21.15.3:0/2725069033 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9018077ab0 con 0x7f9018077ff0 2024-09-10T23:24:09.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.724+0000 7f9014c00640 1 -- 172.21.15.3:0/2725069033 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7f900000f450 con 0x7f9018077ff0 2024-09-10T23:24:09.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.725+0000 7f9014c00640 1 --2- 172.21.15.3:0/2725069033 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f8ffc0b53e0 0x7f8ffc0b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:09.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.725+0000 7f9014c00640 1 -- 172.21.15.3:0/2725069033 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8985+0+0 (secure 0 0 0) 0x7f90000e60c0 con 0x7f9018077ff0 2024-09-10T23:24:09.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.725+0000 7f9017400640 1 --2- 172.21.15.3:0/2725069033 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f8ffc0b53e0 0x7f8ffc0b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:09.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.726+0000 7f9017400640 1 --2- 172.21.15.3:0/2725069033 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f8ffc0b53e0 0x7f8ffc0b78a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f90080057c0 tx=0x7f90080058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:09.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.729+0000 7f9014c00640 1 -- 172.21.15.3:0/2725069033 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9000014030 con 0x7f9018077ff0 2024-09-10T23:24:09.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:09.967+0000 7f901d200640 1 -- 172.21.15.3:0/2725069033 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f90181ac2e0 con 0x7f9018077ff0 2024-09-10T23:24:09.968 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:09 smithi003 ceph-mon[30348]: pgmap v307: 129 pgs: 3 creating+peering, 3 unknown, 123 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:24:10.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:09 smithi194 ceph-mon[33904]: pgmap v307: 129 pgs: 3 creating+peering, 3 unknown, 123 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:24:10.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:09 smithi038 ceph-mon[34225]: pgmap v307: 129 pgs: 3 creating+peering, 3 unknown, 123 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:24:10.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:10.917+0000 7f9014c00640 1 -- 172.21.15.3:0/2725069033 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7f90000acc30 con 0x7f9018077ff0 2024-09-10T23:24:10.919 INFO:teuthology.orchestra.run.smithi003.stderr:added data pool 4 to fsmap 2024-09-10T23:24:10.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:10.921+0000 7f901d200640 1 -- 172.21.15.3:0/2725069033 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f8ffc0b53e0 msgr2=0x7f8ffc0b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:10.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:10.921+0000 7f901d200640 1 --2- 172.21.15.3:0/2725069033 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f8ffc0b53e0 0x7f8ffc0b78a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f90080057c0 tx=0x7f90080058d0 comp rx=0 tx=0).stop 2024-09-10T23:24:10.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:10.921+0000 7f901d200640 1 -- 172.21.15.3:0/2725069033 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9018077ff0 msgr2=0x7f901819f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:10.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:10.921+0000 7f901d200640 1 --2- 172.21.15.3:0/2725069033 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9018077ff0 0x7f901819f9d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f900000c920 tx=0x7f900000cde0 comp rx=0 tx=0).stop 2024-09-10T23:24:10.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:10.921+0000 7f901d200640 1 -- 172.21.15.3:0/2725069033 shutdown_connections 2024-09-10T23:24:10.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:10.921+0000 7f901d200640 1 --2- 172.21.15.3:0/2725069033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90181137e0 0x7f90181a4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:10.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:10.921+0000 7f901d200640 1 --2- 172.21.15.3:0/2725069033 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f8ffc0b53e0 0x7f8ffc0b78a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:10.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:10.921+0000 7f901d200640 1 --2- 172.21.15.3:0/2725069033 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9018077ff0 0x7f901819f9d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:10.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:10.921+0000 7f901d200640 1 --2- 172.21.15.3:0/2725069033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90180776d0 0x7f901819f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:10.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:10.921+0000 7f901d200640 1 -- 172.21.15.3:0/2725069033 >> 172.21.15.3:0/2725069033 conn(0x7f9018100840 msgr2=0x7f9018102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:10.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:10.921+0000 7f901d200640 1 -- 172.21.15.3:0/2725069033 shutdown_connections 2024-09-10T23:24:10.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:10.921+0000 7f901d200640 1 -- 172.21.15.3:0/2725069033 wait complete. 2024-09-10T23:24:11.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:10 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2725069033' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-10T23:24:11.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:10 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2725069033' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-10T23:24:11.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:10 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2725069033' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-10T23:24:11.625 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:24:12.007 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:12.167 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:11 smithi003 ceph-mon[30348]: pgmap v308: 129 pgs: 129 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:24:12.167 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:11 smithi003 ceph-mon[30348]: osdmap e86: 12 total, 12 up, 12 in 2024-09-10T23:24:12.167 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:11 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2725069033' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-10T23:24:12.167 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:11 smithi003 ceph-mon[30348]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T23:24:12.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:11 smithi194 ceph-mon[33904]: pgmap v308: 129 pgs: 129 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:24:12.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:11 smithi194 ceph-mon[33904]: osdmap e86: 12 total, 12 up, 12 in 2024-09-10T23:24:12.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:11 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2725069033' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-10T23:24:12.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:11 smithi194 ceph-mon[33904]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T23:24:12.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:11 smithi038 ceph-mon[34225]: pgmap v308: 129 pgs: 129 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:24:12.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:11 smithi038 ceph-mon[34225]: osdmap e86: 12 total, 12 up, 12 in 2024-09-10T23:24:12.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:11 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2725069033' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-10T23:24:12.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:11 smithi038 ceph-mon[34225]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T23:24:12.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.632+0000 7f6bf7a00640 1 -- 172.21.15.3:0/547247130 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6bf0075540 msgr2=0x7f6bf0075920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.632+0000 7f6bf7a00640 1 --2- 172.21.15.3:0/547247130 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6bf0075540 0x7f6bf0075920 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6be4009900 tx=0x7f6be402a410 comp rx=0 tx=0).stop 2024-09-10T23:24:12.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.632+0000 7f6bf7a00640 1 -- 172.21.15.3:0/547247130 shutdown_connections 2024-09-10T23:24:12.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.632+0000 7f6bf7a00640 1 --2- 172.21.15.3:0/547247130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6bf010f3e0 0x7f6bf01117d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.632+0000 7f6bf7a00640 1 --2- 172.21.15.3:0/547247130 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6bf0075f40 0x7f6bf010ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.632+0000 7f6bf7a00640 1 --2- 172.21.15.3:0/547247130 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6bf0075540 0x7f6bf0075920 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.632+0000 7f6bf7a00640 1 -- 172.21.15.3:0/547247130 >> 172.21.15.3:0/547247130 conn(0x7f6bf00fe830 msgr2=0x7f6bf0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:12.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.632+0000 7f6bf7a00640 1 -- 172.21.15.3:0/547247130 shutdown_connections 2024-09-10T23:24:12.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.632+0000 7f6bf7a00640 1 -- 172.21.15.3:0/547247130 wait complete. 2024-09-10T23:24:12.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.633+0000 7f6bf7a00640 1 Processor -- start 2024-09-10T23:24:12.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.633+0000 7f6bf7a00640 1 -- start start 2024-09-10T23:24:12.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.634+0000 7f6bf7a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6bf0075540 0x7f6bf019b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:12.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.634+0000 7f6bf7a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6bf0075f40 0x7f6bf019b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:12.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.634+0000 7f6bf7a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6bf010f3e0 0x7f6bf01a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:12.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.634+0000 7f6bf7a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf0114e40 con 0x7f6bf010f3e0 2024-09-10T23:24:12.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.634+0000 7f6bf7a00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf0114cc0 con 0x7f6bf0075540 2024-09-10T23:24:12.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.634+0000 7f6bf7a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf0114fc0 con 0x7f6bf0075f40 2024-09-10T23:24:12.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.634+0000 7f6bf5a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6bf010f3e0 0x7f6bf01a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:12.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.634+0000 7f6bf5a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6bf010f3e0 0x7f6bf01a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44268/0 (socket says 172.21.15.3:44268) 2024-09-10T23:24:12.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.634+0000 7f6bf5a00640 1 -- 172.21.15.3:0/1797300140 learned_addr learned my addr 172.21.15.3:0/1797300140 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:24:12.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.634+0000 7f6bf5000640 1 --2- 172.21.15.3:0/1797300140 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6bf0075540 0x7f6bf019b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:12.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.634+0000 7f6befe00640 1 --2- 172.21.15.3:0/1797300140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6bf0075f40 0x7f6bf019b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:12.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.634+0000 7f6bf5a00640 1 -- 172.21.15.3:0/1797300140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6bf0075f40 msgr2=0x7f6bf019b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.634+0000 7f6bf5a00640 1 --2- 172.21.15.3:0/1797300140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6bf0075f40 0x7f6bf019b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.634+0000 7f6bf5a00640 1 -- 172.21.15.3:0/1797300140 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6bf0075540 msgr2=0x7f6bf019b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.634+0000 7f6bf5a00640 1 --2- 172.21.15.3:0/1797300140 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6bf0075540 0x7f6bf019b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.634+0000 7f6bf5a00640 1 -- 172.21.15.3:0/1797300140 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf01a14c0 con 0x7f6bf010f3e0 2024-09-10T23:24:12.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.635+0000 7f6bf5a00640 1 --2- 172.21.15.3:0/1797300140 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6bf010f3e0 0x7f6bf01a0cf0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6be800e9d0 tx=0x7f6be800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:12.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.635+0000 7f6bed600640 1 -- 172.21.15.3:0/1797300140 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be800cd80 con 0x7f6bf010f3e0 2024-09-10T23:24:12.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.635+0000 7f6bed600640 1 -- 172.21.15.3:0/1797300140 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6be8005020 con 0x7f6bf010f3e0 2024-09-10T23:24:12.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.635+0000 7f6bf7a00640 1 -- 172.21.15.3:0/1797300140 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bf01a17b0 con 0x7f6bf010f3e0 2024-09-10T23:24:12.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.635+0000 7f6bed600640 1 -- 172.21.15.3:0/1797300140 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be80116d0 con 0x7f6bf010f3e0 2024-09-10T23:24:12.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.635+0000 7f6bf7a00640 1 -- 172.21.15.3:0/1797300140 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bf01a7e70 con 0x7f6bf010f3e0 2024-09-10T23:24:12.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.636+0000 7f6bf7a00640 1 -- 172.21.15.3:0/1797300140 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bf0075920 con 0x7f6bf010f3e0 2024-09-10T23:24:12.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.639+0000 7f6bed600640 1 -- 172.21.15.3:0/1797300140 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7f6be800f040 con 0x7f6bf010f3e0 2024-09-10T23:24:12.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.640+0000 7f6bed600640 1 --2- 172.21.15.3:0/1797300140 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f6bd80b53b0 0x7f6bd80b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:12.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.640+0000 7f6bed600640 1 -- 172.21.15.3:0/1797300140 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9017+0+0 (secure 0 0 0) 0x7f6be80e5fe0 con 0x7f6bf010f3e0 2024-09-10T23:24:12.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.640+0000 7f6bf5000640 1 --2- 172.21.15.3:0/1797300140 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f6bd80b53b0 0x7f6bd80b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:12.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.641+0000 7f6bf5000640 1 --2- 172.21.15.3:0/1797300140 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f6bd80b53b0 0x7f6bd80b7870 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6be40057c0 tx=0x7f6be40058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:12.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.642+0000 7f6bed600640 1 -- 172.21.15.3:0/1797300140 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6be8016030 con 0x7f6bf010f3e0 2024-09-10T23:24:12.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.875+0000 7f6bf7a00640 1 -- 172.21.15.3:0/1797300140 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6bf019c540 con 0x7f6bf010f3e0 2024-09-10T23:24:12.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.875+0000 7f6bed600640 1 -- 172.21.15.3:0/1797300140 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11818 (secure 0 0 0) 0x7f6bf019c540 con 0x7f6bf010f3e0 2024-09-10T23:24:12.878 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:24:12.878 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":17,"btime":"2024-09-10T23:24:10:905387+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/1495411512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":1495411512},{"type":"v1","addr":"172.21.15.3:6835","nonce":1495411512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/1857372777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1857372777},{"type":"v1","addr":"172.21.15.3:6837","nonce":1857372777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14862,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6839/493850676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":493850676},{"type":"v1","addr":"172.21.15.3:6839","nonce":493850676}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14874,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6841/1580524358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":1580524358},{"type":"v1","addr":"172.21.15.3:6841","nonce":1580524358}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/352514665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":352514665},{"type":"v1","addr":"172.21.15.194:6833","nonce":352514665}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2380508105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2380508105},{"type":"v1","addr":"172.21.15.194:6835","nonce":2380508105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/739730313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":739730313},{"type":"v1","addr":"172.21.15.194:6837","nonce":739730313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24673,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6839/3198777710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3198777710},{"type":"v1","addr":"172.21.15.194:6839","nonce":3198777710}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34619,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/1194099617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1194099617},{"type":"v1","addr":"172.21.15.38:6833","nonce":1194099617}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34652,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/218783320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":218783320},{"type":"v1","addr":"172.21.15.38:6835","nonce":218783320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34682,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/1821839397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":1821839397},{"type":"v1","addr":"172.21.15.38:6837","nonce":1821839397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:23:58.866253+0000","modified":"2024-09-10T23:24:09.969086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34724},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34724":{"gid":34724,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.38:6839/458259815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":458259815},{"type":"v1","addr":"172.21.15.38:6839","nonce":458259815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34724,"qdb_cluster":[34724]},"id":1}]} 2024-09-10T23:24:12.878 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 17 2024-09-10T23:24:12.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.878+0000 7f6bf7a00640 1 -- 172.21.15.3:0/1797300140 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f6bd80b53b0 msgr2=0x7f6bd80b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.878+0000 7f6bf7a00640 1 --2- 172.21.15.3:0/1797300140 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f6bd80b53b0 0x7f6bd80b7870 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6be40057c0 tx=0x7f6be40058d0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.878+0000 7f6bf7a00640 1 -- 172.21.15.3:0/1797300140 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6bf010f3e0 msgr2=0x7f6bf01a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.878+0000 7f6bf7a00640 1 --2- 172.21.15.3:0/1797300140 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6bf010f3e0 0x7f6bf01a0cf0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6be800e9d0 tx=0x7f6be800ee90 comp rx=0 tx=0).stop 2024-09-10T23:24:12.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.878+0000 7f6bf7a00640 1 -- 172.21.15.3:0/1797300140 shutdown_connections 2024-09-10T23:24:12.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.878+0000 7f6bf7a00640 1 --2- 172.21.15.3:0/1797300140 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f6bd80b53b0 0x7f6bd80b7870 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.878+0000 7f6bf7a00640 1 --2- 172.21.15.3:0/1797300140 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6bf010f3e0 0x7f6bf01a0cf0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.878+0000 7f6bf7a00640 1 --2- 172.21.15.3:0/1797300140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6bf0075f40 0x7f6bf019b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.878+0000 7f6bf7a00640 1 --2- 172.21.15.3:0/1797300140 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6bf0075540 0x7f6bf019b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.878+0000 7f6bf7a00640 1 -- 172.21.15.3:0/1797300140 >> 172.21.15.3:0/1797300140 conn(0x7f6bf00fe830 msgr2=0x7f6bf00ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:12.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.879+0000 7f6bf7a00640 1 -- 172.21.15.3:0/1797300140 shutdown_connections 2024-09-10T23:24:12.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:12.879+0000 7f6bf7a00640 1 -- 172.21.15.3:0/1797300140 wait complete. 2024-09-10T23:24:13.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:12 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/1797300140' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:24:13.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:12 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1797300140' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:24:13.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:12 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/1797300140' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:24:13.621 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:24:14.009 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:14.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:13 smithi194 ceph-mon[33904]: pgmap v310: 129 pgs: 129 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:24:14.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:13 smithi194 ceph-mon[33904]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T23:24:14.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:13 smithi194 ceph-mon[33904]: Cluster is now healthy 2024-09-10T23:24:14.201 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:13 smithi003 ceph-mon[30348]: pgmap v310: 129 pgs: 129 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:24:14.201 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:13 smithi003 ceph-mon[30348]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T23:24:14.201 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:13 smithi003 ceph-mon[30348]: Cluster is now healthy 2024-09-10T23:24:14.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:13 smithi038 ceph-mon[34225]: pgmap v310: 129 pgs: 129 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:24:14.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:13 smithi038 ceph-mon[34225]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T23:24:14.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:13 smithi038 ceph-mon[34225]: Cluster is now healthy 2024-09-10T23:24:14.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.582+0000 7fe820400640 1 -- 172.21.15.3:0/3191033013 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe818077ff0 msgr2=0x7fe818113450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:14.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.582+0000 7fe820400640 1 --2- 172.21.15.3:0/3191033013 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe818077ff0 0x7fe818113450 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe804009900 tx=0x7fe80402a410 comp rx=0 tx=0).stop 2024-09-10T23:24:14.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.582+0000 7fe820400640 1 -- 172.21.15.3:0/3191033013 shutdown_connections 2024-09-10T23:24:14.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.582+0000 7fe820400640 1 --2- 172.21.15.3:0/3191033013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe818113990 0x7fe818115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:14.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.582+0000 7fe820400640 1 --2- 172.21.15.3:0/3191033013 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe818077ff0 0x7fe818113450 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:14.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.582+0000 7fe820400640 1 --2- 172.21.15.3:0/3191033013 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe8180776d0 0x7fe818077ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:14.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.583+0000 7fe820400640 1 -- 172.21.15.3:0/3191033013 >> 172.21.15.3:0/3191033013 conn(0x7fe818100a50 msgr2=0x7fe818102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:14.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.583+0000 7fe820400640 1 -- 172.21.15.3:0/3191033013 shutdown_connections 2024-09-10T23:24:14.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.583+0000 7fe820400640 1 -- 172.21.15.3:0/3191033013 wait complete. 2024-09-10T23:24:14.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.584+0000 7fe820400640 1 Processor -- start 2024-09-10T23:24:14.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.584+0000 7fe820400640 1 -- start start 2024-09-10T23:24:14.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.585+0000 7fe820400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8180776d0 0x7fe81819f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:14.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.585+0000 7fe820400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe818077ff0 0x7fe81819fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:14.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.585+0000 7fe820400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe818113990 0x7fe8181a5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:14.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.585+0000 7fe820400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe818119230 con 0x7fe818113990 2024-09-10T23:24:14.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.585+0000 7fe820400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe8181190b0 con 0x7fe818077ff0 2024-09-10T23:24:14.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.585+0000 7fe820400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe8181193b0 con 0x7fe8180776d0 2024-09-10T23:24:14.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.585+0000 7fe81e400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe818113990 0x7fe8181a5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:14.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.585+0000 7fe81da00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8180776d0 0x7fe81819f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:14.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.585+0000 7fe81e400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe818113990 0x7fe8181a5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44280/0 (socket says 172.21.15.3:44280) 2024-09-10T23:24:14.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.585+0000 7fe81e400640 1 -- 172.21.15.3:0/1635322109 learned_addr learned my addr 172.21.15.3:0/1635322109 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:24:14.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.585+0000 7fe81d000640 1 --2- 172.21.15.3:0/1635322109 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe818077ff0 0x7fe81819fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:14.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.585+0000 7fe81e400640 1 -- 172.21.15.3:0/1635322109 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8180776d0 msgr2=0x7fe81819f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:14.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.585+0000 7fe81e400640 1 --2- 172.21.15.3:0/1635322109 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8180776d0 0x7fe81819f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:14.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.585+0000 7fe81e400640 1 -- 172.21.15.3:0/1635322109 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe818077ff0 msgr2=0x7fe81819fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:14.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.585+0000 7fe81e400640 1 --2- 172.21.15.3:0/1635322109 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe818077ff0 0x7fe81819fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:14.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.585+0000 7fe81e400640 1 -- 172.21.15.3:0/1635322109 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8181a5850 con 0x7fe818113990 2024-09-10T23:24:14.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.586+0000 7fe81e400640 1 --2- 172.21.15.3:0/1635322109 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe818113990 0x7fe8181a5080 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe81000e970 tx=0x7fe81000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:14.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.586+0000 7fe816000640 1 -- 172.21.15.3:0/1635322109 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81000ccc0 con 0x7fe818113990 2024-09-10T23:24:14.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.586+0000 7fe816000640 1 -- 172.21.15.3:0/1635322109 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8100054b0 con 0x7fe818113990 2024-09-10T23:24:14.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.586+0000 7fe820400640 1 -- 172.21.15.3:0/1635322109 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8181a5b40 con 0x7fe818113990 2024-09-10T23:24:14.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.586+0000 7fe816000640 1 -- 172.21.15.3:0/1635322109 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe810010430 con 0x7fe818113990 2024-09-10T23:24:14.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.586+0000 7fe820400640 1 -- 172.21.15.3:0/1635322109 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8181ac3d0 con 0x7fe818113990 2024-09-10T23:24:14.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.587+0000 7fe820400640 1 -- 172.21.15.3:0/1635322109 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe818077ab0 con 0x7fe818113990 2024-09-10T23:24:14.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.589+0000 7fe816000640 1 -- 172.21.15.3:0/1635322109 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7fe810004f60 con 0x7fe818113990 2024-09-10T23:24:14.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.592+0000 7fe816000640 1 --2- 172.21.15.3:0/1635322109 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fe8000b53b0 0x7fe8000b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:14.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.592+0000 7fe816000640 1 -- 172.21.15.3:0/1635322109 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9017+0+0 (secure 0 0 0) 0x7fe8100e66b0 con 0x7fe818113990 2024-09-10T23:24:14.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.592+0000 7fe81da00640 1 --2- 172.21.15.3:0/1635322109 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fe8000b53b0 0x7fe8000b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:14.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.593+0000 7fe81da00640 1 --2- 172.21.15.3:0/1635322109 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fe8000b53b0 0x7fe8000b7870 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe80c005fd0 tx=0x7fe80c009760 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:14.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.594+0000 7fe816000640 1 -- 172.21.15.3:0/1635322109 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe8100ad200 con 0x7fe818113990 2024-09-10T23:24:14.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.792+0000 7fe820400640 1 -- 172.21.15.3:0/1635322109 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe81810eb20 con 0x7fe818113990 2024-09-10T23:24:14.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.794+0000 7fe816000640 1 -- 172.21.15.3:0/1635322109 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24427 (secure 0 0 0) 0x7fe8100acb00 con 0x7fe818113990 2024-09-10T23:24:14.795 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:24:14.795 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":86,"fsid":"3f4e30d0-6fca-11ef-bcea-c7b262605968","created":"2024-09-10T23:14:12.377466+0000","modified":"2024-09-10T23:24:09.968883+0000","last_up_change":"2024-09-10T23:22:54.895554+0000","last_in_change":"2024-09-10T23:22:29.701108+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:18:27.131879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:23:53.689954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:23:55.864693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:24:03.869094+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a38330ed-a85b-4e61-b373-dd8f1d5f7ba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6803","nonce":824467747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6805","nonce":824467747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6809","nonce":824467747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6807","nonce":824467747}]},"public_addr":"172.21.15.3:6803/824467747","cluster_addr":"172.21.15.3:6805/824467747","heartbeat_back_addr":"172.21.15.3:6809/824467747","heartbeat_front_addr":"172.21.15.3:6807/824467747","state":["exists","up"]},{"osd":1,"uuid":"49bb1212-a83e-4f85-ad71-d863880d8268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6801","nonce":1447444485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6803","nonce":1447444485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6807","nonce":1447444485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6805","nonce":1447444485}]},"public_addr":"172.21.15.38:6801/1447444485","cluster_addr":"172.21.15.38:6803/1447444485","heartbeat_back_addr":"172.21.15.38:6807/1447444485","heartbeat_front_addr":"172.21.15.38:6805/1447444485","state":["exists","up"]},{"osd":2,"uuid":"ea53eb27-e7fa-4783-9a53-8b44b4e293ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6801","nonce":3191263316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6803","nonce":3191263316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6807","nonce":3191263316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6805","nonce":3191263316}]},"public_addr":"172.21.15.194:6801/3191263316","cluster_addr":"172.21.15.194:6803/3191263316","heartbeat_back_addr":"172.21.15.194:6807/3191263316","heartbeat_front_addr":"172.21.15.194:6805/3191263316","state":["exists","up"]},{"osd":3,"uuid":"75067769-7be5-4a99-9e02-f7735b2e69c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6811","nonce":2061990952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6813","nonce":2061990952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6817","nonce":2061990952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6815","nonce":2061990952}]},"public_addr":"172.21.15.3:6811/2061990952","cluster_addr":"172.21.15.3:6813/2061990952","heartbeat_back_addr":"172.21.15.3:6817/2061990952","heartbeat_front_addr":"172.21.15.3:6815/2061990952","state":["exists","up"]},{"osd":4,"uuid":"872e90ca-b711-4206-b586-e7fa41122199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6809","nonce":413294160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6811","nonce":413294160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6815","nonce":413294160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6813","nonce":413294160}]},"public_addr":"172.21.15.38:6809/413294160","cluster_addr":"172.21.15.38:6811/413294160","heartbeat_back_addr":"172.21.15.38:6815/413294160","heartbeat_front_addr":"172.21.15.38:6813/413294160","state":["exists","up"]},{"osd":5,"uuid":"2cfa107c-6dae-4c26-9e29-8175b1237b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6809","nonce":4117812658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6811","nonce":4117812658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6815","nonce":4117812658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6813","nonce":4117812658}]},"public_addr":"172.21.15.194:6809/4117812658","cluster_addr":"172.21.15.194:6811/4117812658","heartbeat_back_addr":"172.21.15.194:6815/4117812658","heartbeat_front_addr":"172.21.15.194:6813/4117812658","state":["exists","up"]},{"osd":6,"uuid":"d2e4e309-c587-4725-a5b3-cbc7b1226750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6819","nonce":3470543721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6821","nonce":3470543721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6825","nonce":3470543721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6823","nonce":3470543721}]},"public_addr":"172.21.15.3:6819/3470543721","cluster_addr":"172.21.15.3:6821/3470543721","heartbeat_back_addr":"172.21.15.3:6825/3470543721","heartbeat_front_addr":"172.21.15.3:6823/3470543721","state":["exists","up"]},{"osd":7,"uuid":"46ecaec5-29da-4e1d-ac2f-42bbbd77e949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6817","nonce":2054203924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6819","nonce":2054203924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6823","nonce":2054203924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6821","nonce":2054203924}]},"public_addr":"172.21.15.38:6817/2054203924","cluster_addr":"172.21.15.38:6819/2054203924","heartbeat_back_addr":"172.21.15.38:6823/2054203924","heartbeat_front_addr":"172.21.15.38:6821/2054203924","state":["exists","up"]},{"osd":8,"uuid":"57fd8e43-9612-4f74-8eb2-8bdbbf7c0417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6817","nonce":170051722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6819","nonce":170051722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6823","nonce":170051722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6821","nonce":170051722}]},"public_addr":"172.21.15.194:6817/170051722","cluster_addr":"172.21.15.194:6819/170051722","heartbeat_back_addr":"172.21.15.194:6823/170051722","heartbeat_front_addr":"172.21.15.194:6821/170051722","state":["exists","up"]},{"osd":9,"uuid":"aeaaf23b-d2e2-4e30-9a49-de4aaba53900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6827","nonce":3967749600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6829","nonce":3967749600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6833","nonce":3967749600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6831","nonce":3967749600}]},"public_addr":"172.21.15.3:6827/3967749600","cluster_addr":"172.21.15.3:6829/3967749600","heartbeat_back_addr":"172.21.15.3:6833/3967749600","heartbeat_front_addr":"172.21.15.3:6831/3967749600","state":["exists","up"]},{"osd":10,"uuid":"b0ece81b-1c5b-40da-b579-fb99bacb005d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6825","nonce":1671957178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6827","nonce":1671957178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6831","nonce":1671957178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6829","nonce":1671957178}]},"public_addr":"172.21.15.38:6825/1671957178","cluster_addr":"172.21.15.38:6827/1671957178","heartbeat_back_addr":"172.21.15.38:6831/1671957178","heartbeat_front_addr":"172.21.15.38:6829/1671957178","state":["exists","up"]},{"osd":11,"uuid":"a0036526-54bf-4e8b-95cc-e7b75725961c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6825","nonce":1048859686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6827","nonce":1048859686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6831","nonce":1048859686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6829","nonce":1048859686}]},"public_addr":"172.21.15.194:6825/1048859686","cluster_addr":"172.21.15.194:6827/1048859686","heartbeat_back_addr":"172.21.15.194:6831/1048859686","heartbeat_front_addr":"172.21.15.194:6829/1048859686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:27.013354+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:56.609046+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:24.878988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:55.218204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:25.224770+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:54.614336+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:25.385483+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:55.317137+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:25.064825+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:54.655361+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:22:24.080027+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:22:52.886412+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.3:0/776988825":"2024-09-11T23:16:20.647314+0000","172.21.15.3:0/2965090335":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/2364823868":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/3186881356":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/911991463":"2024-09-11T23:16:20.647314+0000","172.21.15.3:6800/2582365069":"2024-09-11T23:14:37.169991+0000","172.21.15.3:6801/2582365069":"2024-09-11T23:14:37.169991+0000","172.21.15.3:6801/1528153492":"2024-09-11T23:15:05.835734+0000","172.21.15.3:6800/1924113958":"2024-09-11T23:16:20.647314+0000","172.21.15.3:0/554479543":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/4238683346":"2024-09-11T23:15:05.835734+0000","172.21.15.3:6800/1528153492":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/285471483":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/1249510760":"2024-09-11T23:16:20.647314+0000","172.21.15.3:6801/1924113958":"2024-09-11T23:16:20.647314+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:24:14.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.797+0000 7fe820400640 1 -- 172.21.15.3:0/1635322109 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fe8000b53b0 msgr2=0x7fe8000b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:14.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.797+0000 7fe820400640 1 --2- 172.21.15.3:0/1635322109 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fe8000b53b0 0x7fe8000b7870 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe80c005fd0 tx=0x7fe80c009760 comp rx=0 tx=0).stop 2024-09-10T23:24:14.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.797+0000 7fe820400640 1 -- 172.21.15.3:0/1635322109 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe818113990 msgr2=0x7fe8181a5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:14.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.797+0000 7fe820400640 1 --2- 172.21.15.3:0/1635322109 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe818113990 0x7fe8181a5080 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe81000e970 tx=0x7fe81000ee30 comp rx=0 tx=0).stop 2024-09-10T23:24:14.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.797+0000 7fe820400640 1 -- 172.21.15.3:0/1635322109 shutdown_connections 2024-09-10T23:24:14.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.797+0000 7fe820400640 1 --2- 172.21.15.3:0/1635322109 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fe8000b53b0 0x7fe8000b7870 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:14.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.797+0000 7fe820400640 1 --2- 172.21.15.3:0/1635322109 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe818113990 0x7fe8181a5080 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:14.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.797+0000 7fe820400640 1 --2- 172.21.15.3:0/1635322109 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe818077ff0 0x7fe81819fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:14.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.797+0000 7fe820400640 1 --2- 172.21.15.3:0/1635322109 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8180776d0 0x7fe81819f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:14.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.797+0000 7fe820400640 1 -- 172.21.15.3:0/1635322109 >> 172.21.15.3:0/1635322109 conn(0x7fe818100a50 msgr2=0x7fe818102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:14.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.797+0000 7fe820400640 1 -- 172.21.15.3:0/1635322109 shutdown_connections 2024-09-10T23:24:14.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:14.797+0000 7fe820400640 1 -- 172.21.15.3:0/1635322109 wait complete. 2024-09-10T23:24:15.113 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:14 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1635322109' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:24:15.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:14 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/1635322109' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:24:15.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:14 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/1635322109' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:24:15.498 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:24:15.875 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:16.190 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:15 smithi003 ceph-mon[30348]: pgmap v311: 129 pgs: 129 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:24:16.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:15 smithi194 ceph-mon[33904]: pgmap v311: 129 pgs: 129 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:24:16.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:15 smithi038 ceph-mon[34225]: pgmap v311: 129 pgs: 129 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:24:16.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.448+0000 7ff105c00640 1 -- 172.21.15.3:0/2346267641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff100075540 msgr2=0x7ff100075920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:16.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.448+0000 7ff105c00640 1 --2- 172.21.15.3:0/2346267641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff100075540 0x7ff100075920 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0009900 tx=0x7ff0f002a410 comp rx=0 tx=0).stop 2024-09-10T23:24:16.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.449+0000 7ff105c00640 1 -- 172.21.15.3:0/2346267641 shutdown_connections 2024-09-10T23:24:16.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.449+0000 7ff105c00640 1 --2- 172.21.15.3:0/2346267641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff10010f3e0 0x7ff1001117d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:16.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.449+0000 7ff105c00640 1 --2- 172.21.15.3:0/2346267641 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff100075f40 0x7ff10010ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:16.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.449+0000 7ff105c00640 1 --2- 172.21.15.3:0/2346267641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff100075540 0x7ff100075920 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:16.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.449+0000 7ff105c00640 1 -- 172.21.15.3:0/2346267641 >> 172.21.15.3:0/2346267641 conn(0x7ff1000fe830 msgr2=0x7ff100100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:16.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.449+0000 7ff105c00640 1 -- 172.21.15.3:0/2346267641 shutdown_connections 2024-09-10T23:24:16.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.449+0000 7ff105c00640 1 -- 172.21.15.3:0/2346267641 wait complete. 2024-09-10T23:24:16.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.450+0000 7ff105c00640 1 Processor -- start 2024-09-10T23:24:16.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.450+0000 7ff105c00640 1 -- start start 2024-09-10T23:24:16.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.450+0000 7ff105c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff100075540 0x7ff10019b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:16.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.450+0000 7ff105c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff100075f40 0x7ff10019b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:16.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.450+0000 7ff105c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff10010f3e0 0x7ff1001a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:16.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.450+0000 7ff105c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff100114ea0 con 0x7ff100075f40 2024-09-10T23:24:16.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.450+0000 7ff105c00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff100114d20 con 0x7ff100075540 2024-09-10T23:24:16.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.450+0000 7ff105c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff100115020 con 0x7ff10010f3e0 2024-09-10T23:24:16.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.450+0000 7ff0f6000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff100075f40 0x7ff10019b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:16.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.451+0000 7ff0f6000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff100075f40 0x7ff10019b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44300/0 (socket says 172.21.15.3:44300) 2024-09-10T23:24:16.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.451+0000 7ff0f6000640 1 -- 172.21.15.3:0/2695330443 learned_addr learned my addr 172.21.15.3:0/2695330443 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:24:16.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.451+0000 7ff0fea00640 1 --2- 172.21.15.3:0/2695330443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff100075540 0x7ff10019b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:16.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.451+0000 7ff0ff400640 1 --2- 172.21.15.3:0/2695330443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff10010f3e0 0x7ff1001a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:16.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.451+0000 7ff0f6000640 1 -- 172.21.15.3:0/2695330443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff10010f3e0 msgr2=0x7ff1001a0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:16.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.451+0000 7ff0f6000640 1 --2- 172.21.15.3:0/2695330443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff10010f3e0 0x7ff1001a0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:16.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.451+0000 7ff0f6000640 1 -- 172.21.15.3:0/2695330443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff100075540 msgr2=0x7ff10019b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:16.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.451+0000 7ff0f6000640 1 --2- 172.21.15.3:0/2695330443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff100075540 0x7ff10019b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:16.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.451+0000 7ff0f6000640 1 -- 172.21.15.3:0/2695330443 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1001a1540 con 0x7ff100075f40 2024-09-10T23:24:16.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.451+0000 7ff0ff400640 1 --2- 172.21.15.3:0/2695330443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff10010f3e0 0x7ff1001a0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:16.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.451+0000 7ff0f6000640 1 --2- 172.21.15.3:0/2695330443 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff100075f40 0x7ff10019b9d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff0e800b4a0 tx=0x7ff0e800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:16.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.452+0000 7ff0f7e00640 1 -- 172.21.15.3:0/2695330443 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8014070 con 0x7ff100075f40 2024-09-10T23:24:16.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.452+0000 7ff0f7e00640 1 -- 172.21.15.3:0/2695330443 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0e8010aa0 con 0x7ff100075f40 2024-09-10T23:24:16.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.452+0000 7ff105c00640 1 -- 172.21.15.3:0/2695330443 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1001a1830 con 0x7ff100075f40 2024-09-10T23:24:16.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.452+0000 7ff0f7e00640 1 -- 172.21.15.3:0/2695330443 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8017b70 con 0x7ff100075f40 2024-09-10T23:24:16.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.452+0000 7ff105c00640 1 -- 172.21.15.3:0/2695330443 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1001a7f70 con 0x7ff100075f40 2024-09-10T23:24:16.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.453+0000 7ff105c00640 1 -- 172.21.15.3:0/2695330443 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff100075920 con 0x7ff100075f40 2024-09-10T23:24:16.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.455+0000 7ff0f7e00640 1 -- 172.21.15.3:0/2695330443 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7ff0e8010610 con 0x7ff100075f40 2024-09-10T23:24:16.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.457+0000 7ff0f7e00640 1 --2- 172.21.15.3:0/2695330443 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff0e40b5330 0x7ff0e40b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:16.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.458+0000 7ff0f7e00640 1 -- 172.21.15.3:0/2695330443 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9017+0+0 (secure 0 0 0) 0x7ff0e80e5900 con 0x7ff100075f40 2024-09-10T23:24:16.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.458+0000 7ff0fea00640 1 --2- 172.21.15.3:0/2695330443 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff0e40b5330 0x7ff0e40b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:16.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.458+0000 7ff0fea00640 1 --2- 172.21.15.3:0/2695330443 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff0e40b5330 0x7ff0e40b77f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff0f00057c0 tx=0x7ff0f00058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:16.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.458+0000 7ff0f7e00640 1 -- 172.21.15.3:0/2695330443 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff0e80ac450 con 0x7ff100075f40 2024-09-10T23:24:16.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.656+0000 7ff105c00640 1 -- 172.21.15.3:0/2695330443 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff10019c5c0 con 0x7ff100075f40 2024-09-10T23:24:16.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.657+0000 7ff0f7e00640 1 -- 172.21.15.3:0/2695330443 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24427 (secure 0 0 0) 0x7ff10019c5c0 con 0x7ff100075f40 2024-09-10T23:24:16.659 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:24:16.659 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":86,"fsid":"3f4e30d0-6fca-11ef-bcea-c7b262605968","created":"2024-09-10T23:14:12.377466+0000","modified":"2024-09-10T23:24:09.968883+0000","last_up_change":"2024-09-10T23:22:54.895554+0000","last_in_change":"2024-09-10T23:22:29.701108+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:18:27.131879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:23:53.689954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:23:55.864693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:24:03.869094+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a38330ed-a85b-4e61-b373-dd8f1d5f7ba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6803","nonce":824467747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6805","nonce":824467747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6809","nonce":824467747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6807","nonce":824467747}]},"public_addr":"172.21.15.3:6803/824467747","cluster_addr":"172.21.15.3:6805/824467747","heartbeat_back_addr":"172.21.15.3:6809/824467747","heartbeat_front_addr":"172.21.15.3:6807/824467747","state":["exists","up"]},{"osd":1,"uuid":"49bb1212-a83e-4f85-ad71-d863880d8268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6801","nonce":1447444485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6803","nonce":1447444485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6807","nonce":1447444485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6805","nonce":1447444485}]},"public_addr":"172.21.15.38:6801/1447444485","cluster_addr":"172.21.15.38:6803/1447444485","heartbeat_back_addr":"172.21.15.38:6807/1447444485","heartbeat_front_addr":"172.21.15.38:6805/1447444485","state":["exists","up"]},{"osd":2,"uuid":"ea53eb27-e7fa-4783-9a53-8b44b4e293ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6801","nonce":3191263316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6803","nonce":3191263316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6807","nonce":3191263316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6805","nonce":3191263316}]},"public_addr":"172.21.15.194:6801/3191263316","cluster_addr":"172.21.15.194:6803/3191263316","heartbeat_back_addr":"172.21.15.194:6807/3191263316","heartbeat_front_addr":"172.21.15.194:6805/3191263316","state":["exists","up"]},{"osd":3,"uuid":"75067769-7be5-4a99-9e02-f7735b2e69c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6811","nonce":2061990952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6813","nonce":2061990952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6817","nonce":2061990952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6815","nonce":2061990952}]},"public_addr":"172.21.15.3:6811/2061990952","cluster_addr":"172.21.15.3:6813/2061990952","heartbeat_back_addr":"172.21.15.3:6817/2061990952","heartbeat_front_addr":"172.21.15.3:6815/2061990952","state":["exists","up"]},{"osd":4,"uuid":"872e90ca-b711-4206-b586-e7fa41122199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6809","nonce":413294160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6811","nonce":413294160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6815","nonce":413294160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6813","nonce":413294160}]},"public_addr":"172.21.15.38:6809/413294160","cluster_addr":"172.21.15.38:6811/413294160","heartbeat_back_addr":"172.21.15.38:6815/413294160","heartbeat_front_addr":"172.21.15.38:6813/413294160","state":["exists","up"]},{"osd":5,"uuid":"2cfa107c-6dae-4c26-9e29-8175b1237b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6809","nonce":4117812658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6811","nonce":4117812658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6815","nonce":4117812658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6813","nonce":4117812658}]},"public_addr":"172.21.15.194:6809/4117812658","cluster_addr":"172.21.15.194:6811/4117812658","heartbeat_back_addr":"172.21.15.194:6815/4117812658","heartbeat_front_addr":"172.21.15.194:6813/4117812658","state":["exists","up"]},{"osd":6,"uuid":"d2e4e309-c587-4725-a5b3-cbc7b1226750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6819","nonce":3470543721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6821","nonce":3470543721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6825","nonce":3470543721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6823","nonce":3470543721}]},"public_addr":"172.21.15.3:6819/3470543721","cluster_addr":"172.21.15.3:6821/3470543721","heartbeat_back_addr":"172.21.15.3:6825/3470543721","heartbeat_front_addr":"172.21.15.3:6823/3470543721","state":["exists","up"]},{"osd":7,"uuid":"46ecaec5-29da-4e1d-ac2f-42bbbd77e949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6817","nonce":2054203924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6819","nonce":2054203924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6823","nonce":2054203924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6821","nonce":2054203924}]},"public_addr":"172.21.15.38:6817/2054203924","cluster_addr":"172.21.15.38:6819/2054203924","heartbeat_back_addr":"172.21.15.38:6823/2054203924","heartbeat_front_addr":"172.21.15.38:6821/2054203924","state":["exists","up"]},{"osd":8,"uuid":"57fd8e43-9612-4f74-8eb2-8bdbbf7c0417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6817","nonce":170051722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6819","nonce":170051722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6823","nonce":170051722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6821","nonce":170051722}]},"public_addr":"172.21.15.194:6817/170051722","cluster_addr":"172.21.15.194:6819/170051722","heartbeat_back_addr":"172.21.15.194:6823/170051722","heartbeat_front_addr":"172.21.15.194:6821/170051722","state":["exists","up"]},{"osd":9,"uuid":"aeaaf23b-d2e2-4e30-9a49-de4aaba53900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6827","nonce":3967749600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6829","nonce":3967749600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6833","nonce":3967749600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6831","nonce":3967749600}]},"public_addr":"172.21.15.3:6827/3967749600","cluster_addr":"172.21.15.3:6829/3967749600","heartbeat_back_addr":"172.21.15.3:6833/3967749600","heartbeat_front_addr":"172.21.15.3:6831/3967749600","state":["exists","up"]},{"osd":10,"uuid":"b0ece81b-1c5b-40da-b579-fb99bacb005d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6825","nonce":1671957178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6827","nonce":1671957178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6831","nonce":1671957178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6829","nonce":1671957178}]},"public_addr":"172.21.15.38:6825/1671957178","cluster_addr":"172.21.15.38:6827/1671957178","heartbeat_back_addr":"172.21.15.38:6831/1671957178","heartbeat_front_addr":"172.21.15.38:6829/1671957178","state":["exists","up"]},{"osd":11,"uuid":"a0036526-54bf-4e8b-95cc-e7b75725961c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6825","nonce":1048859686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6827","nonce":1048859686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6831","nonce":1048859686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6829","nonce":1048859686}]},"public_addr":"172.21.15.194:6825/1048859686","cluster_addr":"172.21.15.194:6827/1048859686","heartbeat_back_addr":"172.21.15.194:6831/1048859686","heartbeat_front_addr":"172.21.15.194:6829/1048859686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:27.013354+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:56.609046+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:24.878988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:55.218204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:25.224770+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:54.614336+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:25.385483+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:55.317137+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:25.064825+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:54.655361+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:22:24.080027+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:22:52.886412+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.3:0/776988825":"2024-09-11T23:16:20.647314+0000","172.21.15.3:0/2965090335":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/2364823868":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/3186881356":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/911991463":"2024-09-11T23:16:20.647314+0000","172.21.15.3:6800/2582365069":"2024-09-11T23:14:37.169991+0000","172.21.15.3:6801/2582365069":"2024-09-11T23:14:37.169991+0000","172.21.15.3:6801/1528153492":"2024-09-11T23:15:05.835734+0000","172.21.15.3:6800/1924113958":"2024-09-11T23:16:20.647314+0000","172.21.15.3:0/554479543":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/4238683346":"2024-09-11T23:15:05.835734+0000","172.21.15.3:6800/1528153492":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/285471483":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/1249510760":"2024-09-11T23:16:20.647314+0000","172.21.15.3:6801/1924113958":"2024-09-11T23:16:20.647314+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:24:16.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.660+0000 7ff105c00640 1 -- 172.21.15.3:0/2695330443 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff0e40b5330 msgr2=0x7ff0e40b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:16.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.660+0000 7ff105c00640 1 --2- 172.21.15.3:0/2695330443 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff0e40b5330 0x7ff0e40b77f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff0f00057c0 tx=0x7ff0f00058d0 comp rx=0 tx=0).stop 2024-09-10T23:24:16.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.660+0000 7ff105c00640 1 -- 172.21.15.3:0/2695330443 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff100075f40 msgr2=0x7ff10019b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:16.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.660+0000 7ff105c00640 1 --2- 172.21.15.3:0/2695330443 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff100075f40 0x7ff10019b9d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff0e800b4a0 tx=0x7ff0e800b960 comp rx=0 tx=0).stop 2024-09-10T23:24:16.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.660+0000 7ff105c00640 1 -- 172.21.15.3:0/2695330443 shutdown_connections 2024-09-10T23:24:16.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.660+0000 7ff105c00640 1 --2- 172.21.15.3:0/2695330443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff10010f3e0 0x7ff1001a0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:16.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.660+0000 7ff105c00640 1 --2- 172.21.15.3:0/2695330443 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff0e40b5330 0x7ff0e40b77f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:16.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.660+0000 7ff105c00640 1 --2- 172.21.15.3:0/2695330443 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff100075f40 0x7ff10019b9d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:16.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.660+0000 7ff105c00640 1 --2- 172.21.15.3:0/2695330443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff100075540 0x7ff10019b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:16.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.660+0000 7ff105c00640 1 -- 172.21.15.3:0/2695330443 >> 172.21.15.3:0/2695330443 conn(0x7ff1000fe830 msgr2=0x7ff1000ff490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:16.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.660+0000 7ff105c00640 1 -- 172.21.15.3:0/2695330443 shutdown_connections 2024-09-10T23:24:16.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:16.661+0000 7ff105c00640 1 -- 172.21.15.3:0/2695330443 wait complete. 2024-09-10T23:24:17.076 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:16 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2695330443' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:24:17.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:16 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2695330443' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:24:17.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:16 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2695330443' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:24:17.453 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:24:17.833 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:18.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:17 smithi194 ceph-mon[33904]: pgmap v312: 129 pgs: 129 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:24:18.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:17 smithi003 ceph-mon[30348]: pgmap v312: 129 pgs: 129 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:24:18.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:17 smithi038 ceph-mon[34225]: pgmap v312: 129 pgs: 129 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:24:18.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.416+0000 7efc1ce00640 1 -- 172.21.15.3:0/4061674770 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc18104fa0 msgr2=0x7efc18105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:18.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.416+0000 7efc1ce00640 1 --2- 172.21.15.3:0/4061674770 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc18104fa0 0x7efc18105380 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efc08009900 tx=0x7efc0802a3f0 comp rx=0 tx=0).stop 2024-09-10T23:24:18.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.416+0000 7efc1ce00640 1 -- 172.21.15.3:0/4061674770 shutdown_connections 2024-09-10T23:24:18.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.416+0000 7efc1ce00640 1 --2- 172.21.15.3:0/4061674770 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc1810b330 0x7efc18111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:18.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.416+0000 7efc1ce00640 1 --2- 172.21.15.3:0/4061674770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc1810a9b0 0x7efc1810adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:18.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.416+0000 7efc1ce00640 1 --2- 172.21.15.3:0/4061674770 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc18104fa0 0x7efc18105380 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:18.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.416+0000 7efc1ce00640 1 -- 172.21.15.3:0/4061674770 >> 172.21.15.3:0/4061674770 conn(0x7efc18100a50 msgr2=0x7efc18102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:18.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.416+0000 7efc1ce00640 1 -- 172.21.15.3:0/4061674770 shutdown_connections 2024-09-10T23:24:18.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.416+0000 7efc1ce00640 1 -- 172.21.15.3:0/4061674770 wait complete. 2024-09-10T23:24:18.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.417+0000 7efc1ce00640 1 Processor -- start 2024-09-10T23:24:18.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.418+0000 7efc1ce00640 1 -- start start 2024-09-10T23:24:18.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.418+0000 7efc1ce00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc18104fa0 0x7efc1819b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:18.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.418+0000 7efc1ce00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc1810a9b0 0x7efc1819b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:18.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.418+0000 7efc1ce00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc1810b330 0x7efc181a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:18.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.418+0000 7efc1ce00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7efc18114df0 con 0x7efc1810b330 2024-09-10T23:24:18.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.418+0000 7efc1ce00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7efc18114c70 con 0x7efc18104fa0 2024-09-10T23:24:18.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.418+0000 7efc1ce00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7efc18114f70 con 0x7efc1810a9b0 2024-09-10T23:24:18.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.418+0000 7efc16800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc1810b330 0x7efc181a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:18.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.418+0000 7efc15e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc18104fa0 0x7efc1819b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:18.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.418+0000 7efc15e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc18104fa0 0x7efc1819b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.3:41378/0 (socket says 172.21.15.3:41378) 2024-09-10T23:24:18.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.418+0000 7efc15e00640 1 -- 172.21.15.3:0/4231555359 learned_addr learned my addr 172.21.15.3:0/4231555359 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:24:18.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.418+0000 7efc15400640 1 --2- 172.21.15.3:0/4231555359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc1810a9b0 0x7efc1819b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:18.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.419+0000 7efc15e00640 1 -- 172.21.15.3:0/4231555359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc1810a9b0 msgr2=0x7efc1819b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:18.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.419+0000 7efc15e00640 1 --2- 172.21.15.3:0/4231555359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc1810a9b0 0x7efc1819b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:18.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.419+0000 7efc15e00640 1 -- 172.21.15.3:0/4231555359 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc1810b330 msgr2=0x7efc181a0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:18.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.419+0000 7efc15e00640 1 --2- 172.21.15.3:0/4231555359 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc1810b330 0x7efc181a0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:18.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.419+0000 7efc15e00640 1 -- 172.21.15.3:0/4231555359 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc181a1410 con 0x7efc18104fa0 2024-09-10T23:24:18.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.419+0000 7efc16800640 1 --2- 172.21.15.3:0/4231555359 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc1810b330 0x7efc181a0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:24:18.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.419+0000 7efc15e00640 1 --2- 172.21.15.3:0/4231555359 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc18104fa0 0x7efc1819b360 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efc08009230 tx=0x7efc08004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:18.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.420+0000 7efc0ea00640 1 -- 172.21.15.3:0/4231555359 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0803f030 con 0x7efc18104fa0 2024-09-10T23:24:18.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.420+0000 7efc1ce00640 1 -- 172.21.15.3:0/4231555359 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc181a16a0 con 0x7efc18104fa0 2024-09-10T23:24:18.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.420+0000 7efc0ea00640 1 -- 172.21.15.3:0/4231555359 <== mon.2 v2:172.21.15.38:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc08003a80 con 0x7efc18104fa0 2024-09-10T23:24:18.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.420+0000 7efc0ea00640 1 -- 172.21.15.3:0/4231555359 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc08035070 con 0x7efc18104fa0 2024-09-10T23:24:18.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.420+0000 7efc1ce00640 1 -- 172.21.15.3:0/4231555359 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc181a7dc0 con 0x7efc18104fa0 2024-09-10T23:24:18.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.421+0000 7efc1ce00640 1 -- 172.21.15.3:0/4231555359 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc18105380 con 0x7efc18104fa0 2024-09-10T23:24:18.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.424+0000 7efc0ea00640 1 -- 172.21.15.3:0/4231555359 <== mon.2 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7efc0803bc30 con 0x7efc18104fa0 2024-09-10T23:24:18.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.425+0000 7efc0ea00640 1 --2- 172.21.15.3:0/4231555359 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7efbfc0b53b0 0x7efbfc0b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:18.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.425+0000 7efc0ea00640 1 -- 172.21.15.3:0/4231555359 <== mon.2 v2:172.21.15.38:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9017+0+0 (secure 0 0 0) 0x7efc08106ce0 con 0x7efc18104fa0 2024-09-10T23:24:18.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.425+0000 7efc15400640 1 --2- 172.21.15.3:0/4231555359 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7efbfc0b53b0 0x7efbfc0b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:18.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.426+0000 7efc15400640 1 --2- 172.21.15.3:0/4231555359 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7efbfc0b53b0 0x7efbfc0b7870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efc1810a000 tx=0x7efc0400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:18.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.427+0000 7efc0ea00640 1 -- 172.21.15.3:0/4231555359 <== mon.2 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7efc080cd1e0 con 0x7efc18104fa0 2024-09-10T23:24:18.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.662+0000 7efc1ce00640 1 -- 172.21.15.3:0/4231555359 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc1819c490 con 0x7efc18104fa0 2024-09-10T23:24:18.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.663+0000 7efc0ea00640 1 -- 172.21.15.3:0/4231555359 <== mon.2 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11818 (secure 0 0 0) 0x7efc080d1c10 con 0x7efc18104fa0 2024-09-10T23:24:18.664 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:24:18.664 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":17,"btime":"2024-09-10T23:24:10:905387+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/1495411512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":1495411512},{"type":"v1","addr":"172.21.15.3:6835","nonce":1495411512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/1857372777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1857372777},{"type":"v1","addr":"172.21.15.3:6837","nonce":1857372777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14862,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6839/493850676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":493850676},{"type":"v1","addr":"172.21.15.3:6839","nonce":493850676}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14874,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6841/1580524358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":1580524358},{"type":"v1","addr":"172.21.15.3:6841","nonce":1580524358}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/352514665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":352514665},{"type":"v1","addr":"172.21.15.194:6833","nonce":352514665}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2380508105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2380508105},{"type":"v1","addr":"172.21.15.194:6835","nonce":2380508105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/739730313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":739730313},{"type":"v1","addr":"172.21.15.194:6837","nonce":739730313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24673,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6839/3198777710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3198777710},{"type":"v1","addr":"172.21.15.194:6839","nonce":3198777710}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34619,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/1194099617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1194099617},{"type":"v1","addr":"172.21.15.38:6833","nonce":1194099617}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34652,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/218783320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":218783320},{"type":"v1","addr":"172.21.15.38:6835","nonce":218783320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34682,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/1821839397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":1821839397},{"type":"v1","addr":"172.21.15.38:6837","nonce":1821839397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:23:58.866253+0000","modified":"2024-09-10T23:24:09.969086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34724},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34724":{"gid":34724,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.38:6839/458259815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":458259815},{"type":"v1","addr":"172.21.15.38:6839","nonce":458259815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34724,"qdb_cluster":[34724]},"id":1}]} 2024-09-10T23:24:18.664 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 17 2024-09-10T23:24:18.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.667+0000 7efc1ce00640 1 -- 172.21.15.3:0/4231555359 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7efbfc0b53b0 msgr2=0x7efbfc0b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:18.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.667+0000 7efc1ce00640 1 --2- 172.21.15.3:0/4231555359 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7efbfc0b53b0 0x7efbfc0b7870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efc1810a000 tx=0x7efc0400b390 comp rx=0 tx=0).stop 2024-09-10T23:24:18.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.667+0000 7efc1ce00640 1 -- 172.21.15.3:0/4231555359 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc18104fa0 msgr2=0x7efc1819b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:18.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.667+0000 7efc1ce00640 1 --2- 172.21.15.3:0/4231555359 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc18104fa0 0x7efc1819b360 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efc08009230 tx=0x7efc08004270 comp rx=0 tx=0).stop 2024-09-10T23:24:18.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.667+0000 7efc1ce00640 1 -- 172.21.15.3:0/4231555359 shutdown_connections 2024-09-10T23:24:18.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.667+0000 7efc1ce00640 1 --2- 172.21.15.3:0/4231555359 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7efbfc0b53b0 0x7efbfc0b7870 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:18.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.667+0000 7efc1ce00640 1 --2- 172.21.15.3:0/4231555359 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc1810b330 0x7efc181a0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:18.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.667+0000 7efc1ce00640 1 --2- 172.21.15.3:0/4231555359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc1810a9b0 0x7efc1819b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:18.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.667+0000 7efc1ce00640 1 --2- 172.21.15.3:0/4231555359 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc18104fa0 0x7efc1819b360 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:18.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.667+0000 7efc1ce00640 1 -- 172.21.15.3:0/4231555359 >> 172.21.15.3:0/4231555359 conn(0x7efc18100a50 msgr2=0x7efc18101460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:18.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.667+0000 7efc1ce00640 1 -- 172.21.15.3:0/4231555359 shutdown_connections 2024-09-10T23:24:18.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:18.667+0000 7efc1ce00640 1 -- 172.21.15.3:0/4231555359 wait complete. 2024-09-10T23:24:19.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:18 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/4231555359' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:24:19.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:18 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/4231555359' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:24:19.426 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:24:19.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:18 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/4231555359' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:24:19.804 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:20.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:19 smithi003 ceph-mon[30348]: pgmap v313: 129 pgs: 129 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:24:20.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:19 smithi038 ceph-mon[34225]: pgmap v313: 129 pgs: 129 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:24:20.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.391+0000 7f3d53600640 1 -- 172.21.15.3:0/2096808359 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d4c075540 msgr2=0x7f3d4c075920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:20.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.391+0000 7f3d53600640 1 --2- 172.21.15.3:0/2096808359 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d4c075540 0x7f3d4c075920 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3d40009900 tx=0x7f3d4002a410 comp rx=0 tx=0).stop 2024-09-10T23:24:20.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.391+0000 7f3d53600640 1 -- 172.21.15.3:0/2096808359 shutdown_connections 2024-09-10T23:24:20.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.391+0000 7f3d53600640 1 --2- 172.21.15.3:0/2096808359 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d4c113b00 0x7f3d4c115ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.391+0000 7f3d53600640 1 --2- 172.21.15.3:0/2096808359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d4c075e60 0x7f3d4c1135c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.391+0000 7f3d53600640 1 --2- 172.21.15.3:0/2096808359 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d4c075540 0x7f3d4c075920 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.391+0000 7f3d53600640 1 -- 172.21.15.3:0/2096808359 >> 172.21.15.3:0/2096808359 conn(0x7f3d4c0fe810 msgr2=0x7f3d4c100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:20.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.391+0000 7f3d53600640 1 -- 172.21.15.3:0/2096808359 shutdown_connections 2024-09-10T23:24:20.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.391+0000 7f3d53600640 1 -- 172.21.15.3:0/2096808359 wait complete. 2024-09-10T23:24:20.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.392+0000 7f3d53600640 1 Processor -- start 2024-09-10T23:24:20.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.392+0000 7f3d53600640 1 -- start start 2024-09-10T23:24:20.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.392+0000 7f3d53600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d4c075540 0x7f3d4c19f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:20.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.392+0000 7f3d53600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d4c075e60 0x7f3d4c19fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:20.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.393+0000 7f3d53600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d4c113b00 0x7f3d4c1a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:20.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.393+0000 7f3d53600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4c1192a0 con 0x7f3d4c075e60 2024-09-10T23:24:20.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.393+0000 7f3d53600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4c119120 con 0x7f3d4c075540 2024-09-10T23:24:20.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.393+0000 7f3d53600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4c119420 con 0x7f3d4c113b00 2024-09-10T23:24:20.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.393+0000 7f3d4be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d4c075e60 0x7f3d4c19fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:20.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.393+0000 7f3d4be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d4c075e60 0x7f3d4c19fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44322/0 (socket says 172.21.15.3:44322) 2024-09-10T23:24:20.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.393+0000 7f3d4be00640 1 -- 172.21.15.3:0/2033096516 learned_addr learned my addr 172.21.15.3:0/2033096516 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:24:20.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.393+0000 7f3d50c00640 1 --2- 172.21.15.3:0/2033096516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d4c075540 0x7f3d4c19f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:20.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.393+0000 7f3d51600640 1 --2- 172.21.15.3:0/2033096516 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d4c113b00 0x7f3d4c1a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:20.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.393+0000 7f3d4be00640 1 -- 172.21.15.3:0/2033096516 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d4c113b00 msgr2=0x7f3d4c1a5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:20.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.393+0000 7f3d4be00640 1 --2- 172.21.15.3:0/2033096516 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d4c113b00 0x7f3d4c1a5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.393+0000 7f3d4be00640 1 -- 172.21.15.3:0/2033096516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d4c075540 msgr2=0x7f3d4c19f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:20.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.393+0000 7f3d4be00640 1 --2- 172.21.15.3:0/2033096516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d4c075540 0x7f3d4c19f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.393+0000 7f3d4be00640 1 -- 172.21.15.3:0/2033096516 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d4c1a5920 con 0x7f3d4c075e60 2024-09-10T23:24:20.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.394+0000 7f3d4be00640 1 --2- 172.21.15.3:0/2033096516 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d4c075e60 0x7f3d4c19fdb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3d3800d770 tx=0x7f3d3800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:20.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.394+0000 7f3d49600640 1 -- 172.21.15.3:0/2033096516 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d38017070 con 0x7f3d4c075e60 2024-09-10T23:24:20.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.394+0000 7f3d49600640 1 -- 172.21.15.3:0/2033096516 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3d380054b0 con 0x7f3d4c075e60 2024-09-10T23:24:20.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.394+0000 7f3d49600640 1 -- 172.21.15.3:0/2033096516 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d38004c60 con 0x7f3d4c075e60 2024-09-10T23:24:20.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.394+0000 7f3d53600640 1 -- 172.21.15.3:0/2033096516 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d4c1a5c10 con 0x7f3d4c075e60 2024-09-10T23:24:20.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.394+0000 7f3d53600640 1 -- 172.21.15.3:0/2033096516 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d4c1ac2d0 con 0x7f3d4c075e60 2024-09-10T23:24:20.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.395+0000 7f3d53600640 1 -- 172.21.15.3:0/2033096516 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d4c075920 con 0x7f3d4c075e60 2024-09-10T23:24:20.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.397+0000 7f3d49600640 1 -- 172.21.15.3:0/2033096516 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7f3d38004e00 con 0x7f3d4c075e60 2024-09-10T23:24:20.399 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.399+0000 7f3d49600640 1 --2- 172.21.15.3:0/2033096516 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f3d340b53b0 0x7f3d340b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:20.400 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.399+0000 7f3d49600640 1 -- 172.21.15.3:0/2033096516 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9017+0+0 (secure 0 0 0) 0x7f3d380e59b0 con 0x7f3d4c075e60 2024-09-10T23:24:20.400 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.399+0000 7f3d50c00640 1 --2- 172.21.15.3:0/2033096516 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f3d340b53b0 0x7f3d340b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:20.400 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.400+0000 7f3d50c00640 1 --2- 172.21.15.3:0/2033096516 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f3d340b53b0 0x7f3d340b7870 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3d40006010 tx=0x7f3d40005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:20.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.403+0000 7f3d49600640 1 -- 172.21.15.3:0/2033096516 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3d380ac500 con 0x7f3d4c075e60 2024-09-10T23:24:20.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:19 smithi194 ceph-mon[33904]: pgmap v313: 129 pgs: 129 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:24:20.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.600+0000 7f3d53600640 1 -- 172.21.15.3:0/2033096516 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3d4c105990 con 0x7f3d4c075e60 2024-09-10T23:24:20.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.602+0000 7f3d49600640 1 -- 172.21.15.3:0/2033096516 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24427 (secure 0 0 0) 0x7f3d380abe00 con 0x7f3d4c075e60 2024-09-10T23:24:20.603 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:24:20.603 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":86,"fsid":"3f4e30d0-6fca-11ef-bcea-c7b262605968","created":"2024-09-10T23:14:12.377466+0000","modified":"2024-09-10T23:24:09.968883+0000","last_up_change":"2024-09-10T23:22:54.895554+0000","last_in_change":"2024-09-10T23:22:29.701108+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:18:27.131879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:23:53.689954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:23:55.864693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:24:03.869094+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a38330ed-a85b-4e61-b373-dd8f1d5f7ba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6803","nonce":824467747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6805","nonce":824467747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6809","nonce":824467747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6807","nonce":824467747}]},"public_addr":"172.21.15.3:6803/824467747","cluster_addr":"172.21.15.3:6805/824467747","heartbeat_back_addr":"172.21.15.3:6809/824467747","heartbeat_front_addr":"172.21.15.3:6807/824467747","state":["exists","up"]},{"osd":1,"uuid":"49bb1212-a83e-4f85-ad71-d863880d8268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6801","nonce":1447444485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6803","nonce":1447444485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6807","nonce":1447444485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6805","nonce":1447444485}]},"public_addr":"172.21.15.38:6801/1447444485","cluster_addr":"172.21.15.38:6803/1447444485","heartbeat_back_addr":"172.21.15.38:6807/1447444485","heartbeat_front_addr":"172.21.15.38:6805/1447444485","state":["exists","up"]},{"osd":2,"uuid":"ea53eb27-e7fa-4783-9a53-8b44b4e293ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6801","nonce":3191263316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6803","nonce":3191263316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6807","nonce":3191263316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6805","nonce":3191263316}]},"public_addr":"172.21.15.194:6801/3191263316","cluster_addr":"172.21.15.194:6803/3191263316","heartbeat_back_addr":"172.21.15.194:6807/3191263316","heartbeat_front_addr":"172.21.15.194:6805/3191263316","state":["exists","up"]},{"osd":3,"uuid":"75067769-7be5-4a99-9e02-f7735b2e69c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6811","nonce":2061990952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6813","nonce":2061990952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6817","nonce":2061990952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6815","nonce":2061990952}]},"public_addr":"172.21.15.3:6811/2061990952","cluster_addr":"172.21.15.3:6813/2061990952","heartbeat_back_addr":"172.21.15.3:6817/2061990952","heartbeat_front_addr":"172.21.15.3:6815/2061990952","state":["exists","up"]},{"osd":4,"uuid":"872e90ca-b711-4206-b586-e7fa41122199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6809","nonce":413294160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6811","nonce":413294160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6815","nonce":413294160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6813","nonce":413294160}]},"public_addr":"172.21.15.38:6809/413294160","cluster_addr":"172.21.15.38:6811/413294160","heartbeat_back_addr":"172.21.15.38:6815/413294160","heartbeat_front_addr":"172.21.15.38:6813/413294160","state":["exists","up"]},{"osd":5,"uuid":"2cfa107c-6dae-4c26-9e29-8175b1237b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6809","nonce":4117812658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6811","nonce":4117812658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6815","nonce":4117812658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6813","nonce":4117812658}]},"public_addr":"172.21.15.194:6809/4117812658","cluster_addr":"172.21.15.194:6811/4117812658","heartbeat_back_addr":"172.21.15.194:6815/4117812658","heartbeat_front_addr":"172.21.15.194:6813/4117812658","state":["exists","up"]},{"osd":6,"uuid":"d2e4e309-c587-4725-a5b3-cbc7b1226750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6819","nonce":3470543721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6821","nonce":3470543721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6825","nonce":3470543721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6823","nonce":3470543721}]},"public_addr":"172.21.15.3:6819/3470543721","cluster_addr":"172.21.15.3:6821/3470543721","heartbeat_back_addr":"172.21.15.3:6825/3470543721","heartbeat_front_addr":"172.21.15.3:6823/3470543721","state":["exists","up"]},{"osd":7,"uuid":"46ecaec5-29da-4e1d-ac2f-42bbbd77e949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6817","nonce":2054203924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6819","nonce":2054203924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6823","nonce":2054203924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6821","nonce":2054203924}]},"public_addr":"172.21.15.38:6817/2054203924","cluster_addr":"172.21.15.38:6819/2054203924","heartbeat_back_addr":"172.21.15.38:6823/2054203924","heartbeat_front_addr":"172.21.15.38:6821/2054203924","state":["exists","up"]},{"osd":8,"uuid":"57fd8e43-9612-4f74-8eb2-8bdbbf7c0417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6817","nonce":170051722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6819","nonce":170051722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6823","nonce":170051722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6821","nonce":170051722}]},"public_addr":"172.21.15.194:6817/170051722","cluster_addr":"172.21.15.194:6819/170051722","heartbeat_back_addr":"172.21.15.194:6823/170051722","heartbeat_front_addr":"172.21.15.194:6821/170051722","state":["exists","up"]},{"osd":9,"uuid":"aeaaf23b-d2e2-4e30-9a49-de4aaba53900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6827","nonce":3967749600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6829","nonce":3967749600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6833","nonce":3967749600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6831","nonce":3967749600}]},"public_addr":"172.21.15.3:6827/3967749600","cluster_addr":"172.21.15.3:6829/3967749600","heartbeat_back_addr":"172.21.15.3:6833/3967749600","heartbeat_front_addr":"172.21.15.3:6831/3967749600","state":["exists","up"]},{"osd":10,"uuid":"b0ece81b-1c5b-40da-b579-fb99bacb005d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6825","nonce":1671957178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6827","nonce":1671957178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6831","nonce":1671957178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6829","nonce":1671957178}]},"public_addr":"172.21.15.38:6825/1671957178","cluster_addr":"172.21.15.38:6827/1671957178","heartbeat_back_addr":"172.21.15.38:6831/1671957178","heartbeat_front_addr":"172.21.15.38:6829/1671957178","state":["exists","up"]},{"osd":11,"uuid":"a0036526-54bf-4e8b-95cc-e7b75725961c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6825","nonce":1048859686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6827","nonce":1048859686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6831","nonce":1048859686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6829","nonce":1048859686}]},"public_addr":"172.21.15.194:6825/1048859686","cluster_addr":"172.21.15.194:6827/1048859686","heartbeat_back_addr":"172.21.15.194:6831/1048859686","heartbeat_front_addr":"172.21.15.194:6829/1048859686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:27.013354+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:56.609046+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:24.878988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:55.218204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:25.224770+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:54.614336+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:25.385483+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:55.317137+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:25.064825+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:54.655361+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:22:24.080027+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:22:52.886412+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.3:0/776988825":"2024-09-11T23:16:20.647314+0000","172.21.15.3:0/2965090335":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/2364823868":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/3186881356":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/911991463":"2024-09-11T23:16:20.647314+0000","172.21.15.3:6800/2582365069":"2024-09-11T23:14:37.169991+0000","172.21.15.3:6801/2582365069":"2024-09-11T23:14:37.169991+0000","172.21.15.3:6801/1528153492":"2024-09-11T23:15:05.835734+0000","172.21.15.3:6800/1924113958":"2024-09-11T23:16:20.647314+0000","172.21.15.3:0/554479543":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/4238683346":"2024-09-11T23:15:05.835734+0000","172.21.15.3:6800/1528153492":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/285471483":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/1249510760":"2024-09-11T23:16:20.647314+0000","172.21.15.3:6801/1924113958":"2024-09-11T23:16:20.647314+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:24:20.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.604+0000 7f3d53600640 1 -- 172.21.15.3:0/2033096516 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f3d340b53b0 msgr2=0x7f3d340b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:20.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.604+0000 7f3d53600640 1 --2- 172.21.15.3:0/2033096516 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f3d340b53b0 0x7f3d340b7870 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3d40006010 tx=0x7f3d40005e80 comp rx=0 tx=0).stop 2024-09-10T23:24:20.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.604+0000 7f3d53600640 1 -- 172.21.15.3:0/2033096516 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d4c075e60 msgr2=0x7f3d4c19fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:20.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.604+0000 7f3d53600640 1 --2- 172.21.15.3:0/2033096516 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d4c075e60 0x7f3d4c19fdb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3d3800d770 tx=0x7f3d3800dc30 comp rx=0 tx=0).stop 2024-09-10T23:24:20.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.604+0000 7f3d53600640 1 -- 172.21.15.3:0/2033096516 shutdown_connections 2024-09-10T23:24:20.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.604+0000 7f3d53600640 1 --2- 172.21.15.3:0/2033096516 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d4c113b00 0x7f3d4c1a5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.604+0000 7f3d53600640 1 --2- 172.21.15.3:0/2033096516 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f3d340b53b0 0x7f3d340b7870 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.604+0000 7f3d53600640 1 --2- 172.21.15.3:0/2033096516 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d4c075e60 0x7f3d4c19fdb0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.604+0000 7f3d53600640 1 --2- 172.21.15.3:0/2033096516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d4c075540 0x7f3d4c19f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.604+0000 7f3d53600640 1 -- 172.21.15.3:0/2033096516 >> 172.21.15.3:0/2033096516 conn(0x7f3d4c0fe810 msgr2=0x7f3d4c0ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:20.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.604+0000 7f3d53600640 1 -- 172.21.15.3:0/2033096516 shutdown_connections 2024-09-10T23:24:20.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:20.604+0000 7f3d53600640 1 -- 172.21.15.3:0/2033096516 wait complete. 2024-09-10T23:24:21.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:20 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2033096516' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:24:21.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:20 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 1]} : dispatch 2024-09-10T23:24:21.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:20 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]} : dispatch 2024-09-10T23:24:21.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:20 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 1]} : dispatch 2024-09-10T23:24:21.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:20 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]} : dispatch 2024-09-10T23:24:21.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:20 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]} : dispatch 2024-09-10T23:24:21.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:20 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]} : dispatch 2024-09-10T23:24:21.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:20 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]} : dispatch 2024-09-10T23:24:21.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:20 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]} : dispatch 2024-09-10T23:24:21.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:20 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]} : dispatch 2024-09-10T23:24:21.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:20 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]} : dispatch 2024-09-10T23:24:21.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:20 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]} : dispatch 2024-09-10T23:24:21.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:20 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]} : dispatch 2024-09-10T23:24:21.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:20 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 6, 5, 9]} : dispatch 2024-09-10T23:24:21.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:20 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]} : dispatch 2024-09-10T23:24:21.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:20 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]} : dispatch 2024-09-10T23:24:21.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:20 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]} : dispatch 2024-09-10T23:24:21.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:20 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 6, 5, 9]} : dispatch 2024-09-10T23:24:21.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:20 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]} : dispatch 2024-09-10T23:24:21.331 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:23:58.866253+0000', 'modified': '2024-09-10T23:24:09.969086+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 34724}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_34724': {'gid': 34724, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.38:6839/458259815', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6838', 'nonce': 458259815}, {'type': 'v1', 'addr': '172.21.15.38:6839', 'nonce': 458259815}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 34724, 'qdb_cluster': [34724]} 2024-09-10T23:24:21.331 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:24:21.332 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T23:24:21.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:20 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2033096516' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:24:21.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:20 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 1]} : dispatch 2024-09-10T23:24:21.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:20 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]} : dispatch 2024-09-10T23:24:21.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:20 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 1]} : dispatch 2024-09-10T23:24:21.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:20 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]} : dispatch 2024-09-10T23:24:21.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:20 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]} : dispatch 2024-09-10T23:24:21.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:20 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]} : dispatch 2024-09-10T23:24:21.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:20 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]} : dispatch 2024-09-10T23:24:21.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:20 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]} : dispatch 2024-09-10T23:24:21.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:20 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]} : dispatch 2024-09-10T23:24:21.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:20 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]} : dispatch 2024-09-10T23:24:21.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:20 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]} : dispatch 2024-09-10T23:24:21.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:20 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]} : dispatch 2024-09-10T23:24:21.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:20 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 6, 5, 9]} : dispatch 2024-09-10T23:24:21.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:20 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]} : dispatch 2024-09-10T23:24:21.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:20 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]} : dispatch 2024-09-10T23:24:21.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:20 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]} : dispatch 2024-09-10T23:24:21.349 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:20 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 6, 5, 9]} : dispatch 2024-09-10T23:24:21.349 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:20 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]} : dispatch 2024-09-10T23:24:21.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:20 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2033096516' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:24:21.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:20 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 1]} : dispatch 2024-09-10T23:24:21.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:20 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]} : dispatch 2024-09-10T23:24:21.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:20 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 1]} : dispatch 2024-09-10T23:24:21.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:20 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]} : dispatch 2024-09-10T23:24:21.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:20 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]} : dispatch 2024-09-10T23:24:21.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:20 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]} : dispatch 2024-09-10T23:24:21.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:20 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]} : dispatch 2024-09-10T23:24:21.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:20 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]} : dispatch 2024-09-10T23:24:21.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:20 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]} : dispatch 2024-09-10T23:24:21.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:20 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]} : dispatch 2024-09-10T23:24:21.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:20 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]} : dispatch 2024-09-10T23:24:21.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:20 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]} : dispatch 2024-09-10T23:24:21.449 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:20 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 6, 5, 9]} : dispatch 2024-09-10T23:24:21.449 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:20 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]} : dispatch 2024-09-10T23:24:21.449 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:20 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]} : dispatch 2024-09-10T23:24:21.449 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:20 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]} : dispatch 2024-09-10T23:24:21.449 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:20 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 6, 5, 9]} : dispatch 2024-09-10T23:24:21.449 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:20 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]} : dispatch 2024-09-10T23:24:21.712 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:22.159 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:21 smithi003 ceph-mon[30348]: pgmap v314: 129 pgs: 129 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:24:22.159 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:21 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 1]}]': finished 2024-09-10T23:24:22.159 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:21 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-09-10T23:24:22.159 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:21 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-10T23:24:22.159 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:21 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-10T23:24:22.160 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:21 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]': finished 2024-09-10T23:24:22.160 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:21 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-10T23:24:22.160 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:21 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-09-10T23:24:22.160 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:21 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 6, 5, 9]}]': finished 2024-09-10T23:24:22.160 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:21 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]': finished 2024-09-10T23:24:22.160 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:21 smithi003 ceph-mon[30348]: osdmap e87: 12 total, 12 up, 12 in 2024-09-10T23:24:22.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.272+0000 7f492b400640 1 -- 172.21.15.3:0/78338265 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f492410f3c0 msgr2=0x7f49241117b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:22.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.272+0000 7f492b400640 1 --2- 172.21.15.3:0/78338265 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f492410f3c0 0x7f49241117b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f491c009ca0 tx=0x7f491c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.272+0000 7f492b400640 1 -- 172.21.15.3:0/78338265 shutdown_connections 2024-09-10T23:24:22.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.272+0000 7f492b400640 1 --2- 172.21.15.3:0/78338265 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f492410f3c0 0x7f49241117b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.272+0000 7f492b400640 1 --2- 172.21.15.3:0/78338265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4924075f40 0x7f492410edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.272+0000 7f492b400640 1 --2- 172.21.15.3:0/78338265 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4924075540 0x7f4924075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.272+0000 7f492b400640 1 -- 172.21.15.3:0/78338265 >> 172.21.15.3:0/78338265 conn(0x7f49240fe810 msgr2=0x7f4924100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:22.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.272+0000 7f492b400640 1 -- 172.21.15.3:0/78338265 shutdown_connections 2024-09-10T23:24:22.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.272+0000 7f492b400640 1 -- 172.21.15.3:0/78338265 wait complete. 2024-09-10T23:24:22.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.273+0000 7f492b400640 1 Processor -- start 2024-09-10T23:24:22.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.273+0000 7f492b400640 1 -- start start 2024-09-10T23:24:22.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.273+0000 7f492b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4924075540 0x7f492419b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.273+0000 7f492b400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4924075f40 0x7f492419b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.273+0000 7f492b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f492410f3c0 0x7f49241a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.273+0000 7f492b400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f4924114e60 con 0x7f492410f3c0 2024-09-10T23:24:22.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.273+0000 7f492b400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4924114ce0 con 0x7f4924075f40 2024-09-10T23:24:22.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.273+0000 7f492b400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4924114fe0 con 0x7f4924075540 2024-09-10T23:24:22.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.274+0000 7f4929400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f492410f3c0 0x7f49241a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.274+0000 7f4929400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f492410f3c0 0x7f49241a0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50266/0 (socket says 172.21.15.3:50266) 2024-09-10T23:24:22.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.274+0000 7f4929400640 1 -- 172.21.15.3:0/879333727 learned_addr learned my addr 172.21.15.3:0/879333727 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:24:22.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.274+0000 7f4928a00640 1 --2- 172.21.15.3:0/879333727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4924075540 0x7f492419b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.274+0000 7f491be00640 1 --2- 172.21.15.3:0/879333727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4924075f40 0x7f492419b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.274+0000 7f4929400640 1 -- 172.21.15.3:0/879333727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4924075540 msgr2=0x7f492419b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:22.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.274+0000 7f4929400640 1 --2- 172.21.15.3:0/879333727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4924075540 0x7f492419b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.274+0000 7f4929400640 1 -- 172.21.15.3:0/879333727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4924075f40 msgr2=0x7f492419b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:22.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.274+0000 7f4929400640 1 --2- 172.21.15.3:0/879333727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4924075f40 0x7f492419b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.274+0000 7f4929400640 1 -- 172.21.15.3:0/879333727 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49241a1460 con 0x7f492410f3c0 2024-09-10T23:24:22.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.274+0000 7f4929400640 1 --2- 172.21.15.3:0/879333727 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f492410f3c0 0x7f49241a0c90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f491c005e30 tx=0x7f491c003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:22.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.275+0000 7f4922000640 1 -- 172.21.15.3:0/879333727 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f491c032c10 con 0x7f492410f3c0 2024-09-10T23:24:22.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.275+0000 7f4922000640 1 -- 172.21.15.3:0/879333727 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f491c032db0 con 0x7f492410f3c0 2024-09-10T23:24:22.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.275+0000 7f492b400640 1 -- 172.21.15.3:0/879333727 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49241a16f0 con 0x7f492410f3c0 2024-09-10T23:24:22.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.275+0000 7f4922000640 1 -- 172.21.15.3:0/879333727 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f491c030ab0 con 0x7f492410f3c0 2024-09-10T23:24:22.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.275+0000 7f492b400640 1 -- 172.21.15.3:0/879333727 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49241a7e10 con 0x7f492410f3c0 2024-09-10T23:24:22.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.278+0000 7f492deae740 1 Processor -- start 2024-09-10T23:24:22.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.278+0000 7f4922000640 1 -- 172.21.15.3:0/879333727 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7f491c030c50 con 0x7f492410f3c0 2024-09-10T23:24:22.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.279+0000 7f492deae740 1 -- start start 2024-09-10T23:24:22.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.279+0000 7f492deae740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55835ef9a240 0x55835ef9a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.279+0000 7f492deae740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55835ef9ab60 0x55835efa65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.279+0000 7f492deae740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55835efa6af0 0x55835efa8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.279+0000 7f492deae740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55835ef11d50 con 0x55835ef9ab60 2024-09-10T23:24:22.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.279+0000 7f492deae740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55835ef01180 con 0x55835ef9a240 2024-09-10T23:24:22.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.279+0000 7f492deae740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55835ef04f90 con 0x55835efa6af0 2024-09-10T23:24:22.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.279+0000 7f4928a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55835ef9ab60 0x55835efa65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.279+0000 7f4928a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55835ef9ab60 0x55835efa65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50272/0 (socket says 172.21.15.3:50272) 2024-09-10T23:24:22.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.279+0000 7f4928a00640 1 -- 172.21.15.3:0/165900507 learned_addr learned my addr 172.21.15.3:0/165900507 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:24:22.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.279+0000 7f491be00640 1 --2- 172.21.15.3:0/165900507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55835ef9a240 0x55835ef9a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.280+0000 7f491be00640 1 --2- 172.21.15.3:0/165900507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55835efa6af0 0x55835efa8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.280+0000 7f4928a00640 1 -- 172.21.15.3:0/165900507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55835efa6af0 msgr2=0x55835efa8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:22.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.280+0000 7f4928a00640 1 --2- 172.21.15.3:0/165900507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55835efa6af0 0x55835efa8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.280+0000 7f4928a00640 1 -- 172.21.15.3:0/165900507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55835ef9a240 msgr2=0x55835ef9a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:22.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.280+0000 7f4928a00640 1 --2- 172.21.15.3:0/165900507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55835ef9a240 0x55835ef9a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.280+0000 7f4928a00640 1 -- 172.21.15.3:0/165900507 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55835eecba70 con 0x55835ef9ab60 2024-09-10T23:24:22.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.280+0000 7f4922000640 1 --2- 172.21.15.3:0/879333727 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f49080b53b0 0x7f49080b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.280+0000 7f4928a00640 1 --2- 172.21.15.3:0/165900507 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55835ef9ab60 0x55835efa65b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4914009d50 tx=0x7f4914011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62bb9bfa8b0df36e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:22.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.280+0000 7f4922000640 1 -- 172.21.15.3:0/879333727 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9286+0+0 (secure 0 0 0) 0x7f491c106fe0 con 0x7f492410f3c0 2024-09-10T23:24:22.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.280+0000 7f4919c00640 1 -- 172.21.15.3:0/165900507 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4914009e40 con 0x55835ef9ab60 2024-09-10T23:24:22.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.281+0000 7f4919c00640 1 -- 172.21.15.3:0/165900507 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f49140044b0 con 0x55835ef9ab60 2024-09-10T23:24:22.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.281+0000 7f4919c00640 1 -- 172.21.15.3:0/165900507 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4914019670 con 0x55835ef9ab60 2024-09-10T23:24:22.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.281+0000 7f491be00640 1 --2- 172.21.15.3:0/879333727 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f49080b53b0 0x7f49080b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.281+0000 7f492deae740 1 -- 172.21.15.3:0/165900507 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55835ef9ab60 msgr2=0x55835efa65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:22.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.281+0000 7f491be00640 1 --2- 172.21.15.3:0/879333727 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f49080b53b0 0x7f49080b7870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x55835ef9a1f0 tx=0x7f490c0096c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:22.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.281+0000 7f492deae740 1 --2- 172.21.15.3:0/165900507 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55835ef9ab60 0x55835efa65b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4914009d50 tx=0x7f4914011810 comp rx=0 tx=0).stop 2024-09-10T23:24:22.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.281+0000 7f492deae740 1 -- 172.21.15.3:0/165900507 shutdown_connections 2024-09-10T23:24:22.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.281+0000 7f492deae740 1 --2- 172.21.15.3:0/165900507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55835efa6af0 0x55835efa8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.281+0000 7f492deae740 1 --2- 172.21.15.3:0/165900507 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55835ef9ab60 0x55835efa65b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.282+0000 7f492deae740 1 --2- 172.21.15.3:0/165900507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55835ef9a240 0x55835ef9a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.282+0000 7f492deae740 1 -- 172.21.15.3:0/165900507 >> 172.21.15.3:0/165900507 conn(0x55835ef98020 msgr2=0x55835ef99210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:22.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.282+0000 7f492deae740 1 -- 172.21.15.3:0/165900507 shutdown_connections 2024-09-10T23:24:22.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.282+0000 7f492deae740 1 -- 172.21.15.3:0/165900507 wait complete. 2024-09-10T23:24:22.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.282+0000 7f492deae740 1 -- start start 2024-09-10T23:24:22.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.282+0000 7f492deae740 1 Processor -- start 2024-09-10T23:24:22.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.283+0000 7f492deae740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55835ef9a240 0x55835efa65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.283+0000 7f492deae740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55835ef9ab60 0x55835efa3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.283+0000 7f492deae740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55835efa6af0 0x55835efa41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.283+0000 7f492deae740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55835ed625f0 con 0x55835efa6af0 2024-09-10T23:24:22.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.283+0000 7f492deae740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55835ee9c460 con 0x55835ef9a240 2024-09-10T23:24:22.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.283+0000 7f492deae740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55835efa9840 con 0x55835ef9ab60 2024-09-10T23:24:22.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.283+0000 7f492deae740 10 client.0 _ll_register_callbacks cb 0x55835eeac210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:22.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.283+0000 7f4929400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55835efa6af0 0x55835efa41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.283+0000 7f4929400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55835efa6af0 0x55835efa41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50282/0 (socket says 172.21.15.3:50282) 2024-09-10T23:24:22.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.283+0000 7f4929400640 1 -- 172.21.15.3:0/619439613 learned_addr learned my addr 172.21.15.3:0/619439613 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:24:22.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.283+0000 7f4928a00640 1 --2- 172.21.15.3:0/619439613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55835ef9a240 0x55835efa65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.283+0000 7f491be00640 1 --2- 172.21.15.3:0/619439613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55835ef9ab60 0x55835efa3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.283+0000 7f4929400640 1 -- 172.21.15.3:0/619439613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55835ef9ab60 msgr2=0x55835efa3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:22.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.283+0000 7f4929400640 1 --2- 172.21.15.3:0/619439613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55835ef9ab60 0x55835efa3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.283+0000 7f4929400640 1 -- 172.21.15.3:0/619439613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55835ef9a240 msgr2=0x55835efa65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:22.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.283+0000 7f4929400640 1 --2- 172.21.15.3:0/619439613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55835ef9a240 0x55835efa65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.283+0000 7f4929400640 1 -- 172.21.15.3:0/619439613 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55835ec5f540 con 0x55835efa6af0 2024-09-10T23:24:22.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.283+0000 7f4928a00640 1 --2- 172.21.15.3:0/619439613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55835ef9a240 0x55835efa65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:22.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.284+0000 7f4929400640 1 --2- 172.21.15.3:0/619439613 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55835efa6af0 0x55835efa41d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f491c0ca680 tx=0x7f491c0cce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d39b08f58069a102 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:22.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.284+0000 7f4912000640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-10T23:24:22.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.284+0000 7f4912000640 1 -- 172.21.15.3:0/619439613 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f491c0cd870 con 0x55835efa6af0 2024-09-10T23:24:22.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.284+0000 7f4912000640 1 -- 172.21.15.3:0/619439613 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9286+0+0 (secure 0 0 0) 0x7f491c0d6480 con 0x55835efa6af0 2024-09-10T23:24:22.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.284+0000 7f492deae740 1 -- 172.21.15.3:0/619439613 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55835ee9ea70 con 0x55835efa6af0 2024-09-10T23:24:22.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.284+0000 7f4912000640 1 -- 172.21.15.3:0/619439613 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f491c0cdb10 con 0x55835efa6af0 2024-09-10T23:24:22.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.284+0000 7f492deae740 10 client.14982 fetch_fsmap learned FSMap version 17 2024-09-10T23:24:22.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.284+0000 7f492deae740 1 -- 172.21.15.3:0/619439613 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55835eeb96f0 con 0x55835efa6af0 2024-09-10T23:24:22.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.284+0000 7f4912000640 1 -- 172.21.15.3:0/619439613 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55835ee9ea70 con 0x55835efa6af0 2024-09-10T23:24:22.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.285+0000 7f4912000640 1 -- 172.21.15.3:0/619439613 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f491c0b4070 con 0x55835efa6af0 2024-09-10T23:24:22.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.285+0000 7f492deae740 10 client.14982 fetch_fsmap finished waiting for FSMap version 17 2024-09-10T23:24:22.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.285+0000 7f492deae740 10 client.14982 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T23:24:22.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.285+0000 7f492deae740 20 client.14982 populate_metadata read hostname 'smithi003' 2024-09-10T23:24:22.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.285+0000 7f492deae740 1 --2- 172.21.15.3:0/619439613 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x55835efb7840 0x55835efb8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.285+0000 7f492deae740 4 client.14982 mds_command: new command op to 34724 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:24:22.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.285+0000 7f492deae740 1 -- 172.21.15.3:0/619439613 --> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55835ef13ca0 con 0x55835efb7840 2024-09-10T23:24:22.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.285+0000 7f4928a00640 1 --2- 172.21.15.3:0/619439613 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x55835efb7840 0x55835efb8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.286+0000 7f4928a00640 1 --2- 172.21.15.3:0/619439613 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x55835efb7840 0x55835efb8cb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ce15b68eaeefcf server_cookie=31da1f730725a6ad in_seq=0 out_seq=0 2024-09-10T23:24:22.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.286+0000 7f4912000640 10 client.14982 ms_handle_connect on v2:172.21.15.38:6838/458259815 2024-09-10T23:24:22.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.287+0000 7f4912000640 1 -- 172.21.15.3:0/619439613 <== mds.0 v2:172.21.15.38:6838/458259815 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55835ef13ca0 con 0x55835efb7840 2024-09-10T23:24:22.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.287+0000 7f4912000640 10 client.14982 handle_command_reply: tid=0 2024-09-10T23:24:22.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.287+0000 7f492deae740 1 client.14982 shutdown 2024-09-10T23:24:22.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.287+0000 7f492deae740 1 -- 172.21.15.3:0/619439613 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55835efa6af0 msgr2=0x55835efa41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:22.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.287+0000 7f492deae740 1 --2- 172.21.15.3:0/619439613 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55835efa6af0 0x55835efa41d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f491c0ca680 tx=0x7f491c0cce20 comp rx=0 tx=0).stop 2024-09-10T23:24:22.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.287+0000 7f492deae740 1 -- 172.21.15.3:0/619439613 shutdown_connections 2024-09-10T23:24:22.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.287+0000 7f492deae740 1 --2- 172.21.15.3:0/619439613 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x55835efb7840 0x55835efb8cb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.287+0000 7f492deae740 1 --2- 172.21.15.3:0/619439613 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55835efa6af0 0x55835efa41d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.288+0000 7f492deae740 1 --2- 172.21.15.3:0/619439613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55835ef9ab60 0x55835efa3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.288+0000 7f492deae740 1 --2- 172.21.15.3:0/619439613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55835ef9a240 0x55835efa65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.288+0000 7f492deae740 1 -- 172.21.15.3:0/619439613 >> 172.21.15.3:0/619439613 conn(0x55835ef98020 msgr2=0x55835ef9dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:22.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.288+0000 7f4912000640 0 client.14982 ms_handle_reset on v2:172.21.15.38:6838/458259815 2024-09-10T23:24:22.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.288+0000 7f492deae740 1 -- 172.21.15.3:0/619439613 shutdown_connections 2024-09-10T23:24:22.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.288+0000 7f492deae740 1 -- 172.21.15.3:0/619439613 wait complete. 2024-09-10T23:24:22.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.288+0000 7f492deae740 20 client.14982 trim_cache size 0 max 16384 2024-09-10T23:24:22.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.308+0000 7f492deae740 1 Processor -- start 2024-09-10T23:24:22.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.309+0000 7f492deae740 1 -- start start 2024-09-10T23:24:22.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.309+0000 7f492deae740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55835ef9a240 0x55835efa8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.309+0000 7f492deae740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55835ef9ab60 0x55835efb8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.309+0000 7f492deae740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55835efa6af0 0x55835efb7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.309+0000 7f492deae740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55835efb6ff0 con 0x55835ef9a240 2024-09-10T23:24:22.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.309+0000 7f492deae740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55835efb76c0 con 0x55835ef9ab60 2024-09-10T23:24:22.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.309+0000 7f492deae740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55835efb7d90 con 0x55835efa6af0 2024-09-10T23:24:22.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.309+0000 7f4928a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55835ef9a240 0x55835efa8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.309+0000 7f4928a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55835ef9a240 0x55835efa8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50294/0 (socket says 172.21.15.3:50294) 2024-09-10T23:24:22.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.309+0000 7f4928a00640 1 -- 172.21.15.3:0/3876591257 learned_addr learned my addr 172.21.15.3:0/3876591257 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:24:22.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.309+0000 7f491be00640 1 --2- 172.21.15.3:0/3876591257 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55835ef9ab60 0x55835efb8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.310+0000 7f4929400640 1 --2- 172.21.15.3:0/3876591257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55835efa6af0 0x55835efb7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.310+0000 7f4928a00640 1 -- 172.21.15.3:0/3876591257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55835efa6af0 msgr2=0x55835efb7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:22.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.310+0000 7f4928a00640 1 --2- 172.21.15.3:0/3876591257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55835efa6af0 0x55835efb7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.310+0000 7f4928a00640 1 -- 172.21.15.3:0/3876591257 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55835ef9ab60 msgr2=0x55835efb8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:22.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.310+0000 7f4928a00640 1 --2- 172.21.15.3:0/3876591257 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55835ef9ab60 0x55835efb8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.310+0000 7f4928a00640 1 -- 172.21.15.3:0/3876591257 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55835ef9a950 con 0x55835ef9a240 2024-09-10T23:24:22.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.310+0000 7f491be00640 1 --2- 172.21.15.3:0/3876591257 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55835ef9ab60 0x55835efb8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:22.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.310+0000 7f4928a00640 1 --2- 172.21.15.3:0/3876591257 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55835ef9a240 0x55835efa8f50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4914000c00 tx=0x7f4914014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e9e15e07ee4f7ec server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:22.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.310+0000 7f4919200640 1 -- 172.21.15.3:0/3876591257 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4914031070 con 0x55835ef9a240 2024-09-10T23:24:22.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.310+0000 7f4919200640 1 -- 172.21.15.3:0/3876591257 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4914005040 con 0x55835ef9a240 2024-09-10T23:24:22.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.310+0000 7f4919200640 1 -- 172.21.15.3:0/3876591257 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4914025670 con 0x55835ef9a240 2024-09-10T23:24:22.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.311+0000 7f492deae740 1 -- 172.21.15.3:0/3876591257 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55835ef9a240 msgr2=0x55835efa8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:22.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.311+0000 7f492deae740 1 --2- 172.21.15.3:0/3876591257 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55835ef9a240 0x55835efa8f50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4914000c00 tx=0x7f4914014000 comp rx=0 tx=0).stop 2024-09-10T23:24:22.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.311+0000 7f492deae740 1 -- 172.21.15.3:0/3876591257 shutdown_connections 2024-09-10T23:24:22.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.311+0000 7f492deae740 1 --2- 172.21.15.3:0/3876591257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55835efa6af0 0x55835efb7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.311+0000 7f492deae740 1 --2- 172.21.15.3:0/3876591257 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55835ef9ab60 0x55835efb8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.311+0000 7f492deae740 1 --2- 172.21.15.3:0/3876591257 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55835ef9a240 0x55835efa8f50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.311+0000 7f492deae740 1 -- 172.21.15.3:0/3876591257 >> 172.21.15.3:0/3876591257 conn(0x55835ef98020 msgr2=0x55835efb6530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:22.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.311+0000 7f492deae740 1 -- 172.21.15.3:0/3876591257 shutdown_connections 2024-09-10T23:24:22.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.311+0000 7f492deae740 1 -- 172.21.15.3:0/3876591257 wait complete. 2024-09-10T23:24:22.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.312+0000 7f492deae740 1 -- start start 2024-09-10T23:24:22.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.312+0000 7f492deae740 1 Processor -- start 2024-09-10T23:24:22.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.312+0000 7f492deae740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55835ef9a240 0x55835efc1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.312+0000 7f492deae740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55835ef9ab60 0x55835efc0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.312+0000 7f492deae740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55835efa6af0 0x55835efc06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.312+0000 7f492deae740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55835efb8b30 con 0x55835efa6af0 2024-09-10T23:24:22.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.312+0000 7f492deae740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55835efb8460 con 0x55835ef9a240 2024-09-10T23:24:22.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.312+0000 7f492deae740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55835efb9200 con 0x55835ef9ab60 2024-09-10T23:24:22.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.312+0000 7f492deae740 10 client.0 _ll_register_callbacks cb 0x7f491c0c93a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:22.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.313+0000 7f4929400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55835efa6af0 0x55835efc06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.313+0000 7f4929400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55835efa6af0 0x55835efc06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50304/0 (socket says 172.21.15.3:50304) 2024-09-10T23:24:22.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.313+0000 7f4928a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55835ef9a240 0x55835efc1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.313+0000 7f4929400640 1 -- 172.21.15.3:0/3118737501 learned_addr learned my addr 172.21.15.3:0/3118737501 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:24:22.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.313+0000 7f491be00640 1 --2- 172.21.15.3:0/3118737501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55835ef9ab60 0x55835efc0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.313+0000 7f4929400640 1 -- 172.21.15.3:0/3118737501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55835ef9ab60 msgr2=0x55835efc0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:22.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.313+0000 7f4929400640 1 --2- 172.21.15.3:0/3118737501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55835ef9ab60 0x55835efc0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.313+0000 7f4929400640 1 -- 172.21.15.3:0/3118737501 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55835ef9a240 msgr2=0x55835efc1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:22.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.313+0000 7f4929400640 1 --2- 172.21.15.3:0/3118737501 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55835ef9a240 0x55835efc1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.313+0000 7f4929400640 1 -- 172.21.15.3:0/3118737501 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55835efc0d10 con 0x55835efa6af0 2024-09-10T23:24:22.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.313+0000 7f491be00640 1 --2- 172.21.15.3:0/3118737501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55835ef9ab60 0x55835efc0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:22.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.313+0000 7f4929400640 1 --2- 172.21.15.3:0/3118737501 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55835efa6af0 0x55835efc06d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f491c107300 tx=0x7f491c005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5df04f21201fb49 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:22.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.313+0000 7f4912000640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-10T23:24:22.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.314+0000 7f4912000640 1 -- 172.21.15.3:0/3118737501 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f491c0cd410 con 0x55835efa6af0 2024-09-10T23:24:22.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.314+0000 7f4912000640 1 -- 172.21.15.3:0/3118737501 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9286+0+0 (secure 0 0 0) 0x7f491c104d90 con 0x55835efa6af0 2024-09-10T23:24:22.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.314+0000 7f492deae740 1 -- 172.21.15.3:0/3118737501 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4914005040 con 0x55835efa6af0 2024-09-10T23:24:22.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.314+0000 7f4912000640 1 -- 172.21.15.3:0/3118737501 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f491c0d1ef0 con 0x55835efa6af0 2024-09-10T23:24:22.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.314+0000 7f492deae740 10 client.14988 fetch_fsmap learned FSMap version 17 2024-09-10T23:24:22.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.314+0000 7f492deae740 1 -- 172.21.15.3:0/3118737501 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55835f024180 con 0x55835efa6af0 2024-09-10T23:24:22.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.314+0000 7f4912000640 1 -- 172.21.15.3:0/3118737501 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4914005040 con 0x55835efa6af0 2024-09-10T23:24:22.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.314+0000 7f4912000640 1 -- 172.21.15.3:0/3118737501 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f491c0b4040 con 0x55835efa6af0 2024-09-10T23:24:22.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.314+0000 7f492deae740 10 client.14988 fetch_fsmap finished waiting for FSMap version 17 2024-09-10T23:24:22.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.315+0000 7f492deae740 10 client.14988 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T23:24:22.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.315+0000 7f492deae740 20 client.14988 populate_metadata read hostname 'smithi003' 2024-09-10T23:24:22.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.315+0000 7f492deae740 1 --2- 172.21.15.3:0/3118737501 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x55835f028930 0x55835f027640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:22.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.315+0000 7f492deae740 4 client.14988 mds_command: new command op to 34724 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:24:22.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.315+0000 7f492deae740 1 -- 172.21.15.3:0/3118737501 --> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] -- command(tid 0: {"prefix": "status"}) -- 0x55835ef0f750 con 0x55835f028930 2024-09-10T23:24:22.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.315+0000 7f4928a00640 1 --2- 172.21.15.3:0/3118737501 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x55835f028930 0x55835f027640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:22.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.316+0000 7f4912000640 10 client.14988 ms_handle_connect on v2:172.21.15.38:6838/458259815 2024-09-10T23:24:22.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.315+0000 7f4928a00640 1 --2- 172.21.15.3:0/3118737501 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x55835f028930 0x55835f027640 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5220e6569361f1c server_cookie=f09dba0e43d0fca4 in_seq=0 out_seq=0 2024-09-10T23:24:22.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.316+0000 7f4912000640 1 -- 172.21.15.3:0/3118737501 <== mds.0 v2:172.21.15.38:6838/458259815 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55835ef0f750 con 0x55835f028930 2024-09-10T23:24:22.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.316+0000 7f4912000640 10 client.14988 handle_command_reply: tid=0 2024-09-10T23:24:22.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.316+0000 7f492deae740 1 client.14988 shutdown 2024-09-10T23:24:22.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.316+0000 7f492deae740 1 -- 172.21.15.3:0/3118737501 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55835efa6af0 msgr2=0x55835efc06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:22.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.316+0000 7f492deae740 1 --2- 172.21.15.3:0/3118737501 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55835efa6af0 0x55835efc06d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f491c107300 tx=0x7f491c005ef0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.316+0000 7f492deae740 1 -- 172.21.15.3:0/3118737501 shutdown_connections 2024-09-10T23:24:22.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.316+0000 7f492deae740 1 --2- 172.21.15.3:0/3118737501 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x55835f028930 0x55835f027640 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.316+0000 7f492deae740 1 --2- 172.21.15.3:0/3118737501 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55835efa6af0 0x55835efc06d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.316+0000 7f492deae740 1 --2- 172.21.15.3:0/3118737501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55835ef9ab60 0x55835efc0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.316+0000 7f492deae740 1 --2- 172.21.15.3:0/3118737501 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55835ef9a240 0x55835efc1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.316+0000 7f4912000640 0 client.14988 ms_handle_reset on v2:172.21.15.38:6838/458259815 2024-09-10T23:24:22.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.316+0000 7f492deae740 1 -- 172.21.15.3:0/3118737501 >> 172.21.15.3:0/3118737501 conn(0x55835ef98020 msgr2=0x55835ef9ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:22.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.316+0000 7f492deae740 1 -- 172.21.15.3:0/3118737501 shutdown_connections 2024-09-10T23:24:22.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.316+0000 7f492deae740 1 -- 172.21.15.3:0/3118737501 wait complete. 2024-09-10T23:24:22.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.317+0000 7f492deae740 20 client.14988 trim_cache size 0 max 16384 2024-09-10T23:24:22.322 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-10T23:24:22.322 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_fsid": "3f4e30d0-6fca-11ef-bcea-c7b262605968", 2024-09-10T23:24:22.322 INFO:teuthology.orchestra.run.smithi003.stdout: "whoami": 0, 2024-09-10T23:24:22.322 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 34724, 2024-09-10T23:24:22.322 INFO:teuthology.orchestra.run.smithi003.stdout: "want_state": "up:active", 2024-09-10T23:24:22.322 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "up:active", 2024-09-10T23:24:22.322 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs", 2024-09-10T23:24:22.322 INFO:teuthology.orchestra.run.smithi003.stdout: "rank_uptime": 22.480961412999999, 2024-09-10T23:24:22.322 INFO:teuthology.orchestra.run.smithi003.stdout: "mdsmap_epoch": 17, 2024-09-10T23:24:22.322 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch": 88, 2024-09-10T23:24:22.322 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch_barrier": 86, 2024-09-10T23:24:22.322 INFO:teuthology.orchestra.run.smithi003.stdout: "uptime": 37.178459046999997 2024-09-10T23:24:22.323 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-10T23:24:22.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.317+0000 7f492b400640 1 -- 172.21.15.3:0/879333727 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f49080b53b0 msgr2=0x7f49080b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:22.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.317+0000 7f492b400640 1 --2- 172.21.15.3:0/879333727 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f49080b53b0 0x7f49080b7870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x55835ef9a1f0 tx=0x7f490c0096c0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.317+0000 7f492b400640 1 -- 172.21.15.3:0/879333727 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f492410f3c0 msgr2=0x7f49241a0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:22.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.317+0000 7f492b400640 1 --2- 172.21.15.3:0/879333727 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f492410f3c0 0x7f49241a0c90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f491c005e30 tx=0x7f491c003f30 comp rx=0 tx=0).stop 2024-09-10T23:24:22.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.317+0000 7f492b400640 1 -- 172.21.15.3:0/879333727 shutdown_connections 2024-09-10T23:24:22.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.317+0000 7f492b400640 1 --2- 172.21.15.3:0/879333727 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f49080b53b0 0x7f49080b7870 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.317+0000 7f492b400640 1 --2- 172.21.15.3:0/879333727 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f492410f3c0 0x7f49241a0c90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.317+0000 7f492b400640 1 --2- 172.21.15.3:0/879333727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4924075f40 0x7f492419b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.317+0000 7f492b400640 1 --2- 172.21.15.3:0/879333727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4924075540 0x7f492419b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.317+0000 7f492b400640 1 -- 172.21.15.3:0/879333727 >> 172.21.15.3:0/879333727 conn(0x7f49240fe810 msgr2=0x7f49240ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:22.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.317+0000 7f492b400640 1 -- 172.21.15.3:0/879333727 shutdown_connections 2024-09-10T23:24:22.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:22.318+0000 7f492b400640 1 -- 172.21.15.3:0/879333727 wait complete. 2024-09-10T23:24:22.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:21 smithi038 ceph-mon[34225]: pgmap v314: 129 pgs: 129 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:24:22.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:21 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 1]}]': finished 2024-09-10T23:24:22.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:21 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-09-10T23:24:22.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:21 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-10T23:24:22.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:21 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-10T23:24:22.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:21 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]': finished 2024-09-10T23:24:22.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:21 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-10T23:24:22.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:21 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-09-10T23:24:22.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:21 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 6, 5, 9]}]': finished 2024-09-10T23:24:22.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:21 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]': finished 2024-09-10T23:24:22.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:21 smithi038 ceph-mon[34225]: osdmap e87: 12 total, 12 up, 12 in 2024-09-10T23:24:22.349 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:21 smithi194 ceph-mon[33904]: pgmap v314: 129 pgs: 129 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:24:22.349 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:21 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 1]}]': finished 2024-09-10T23:24:22.349 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:21 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-09-10T23:24:22.349 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:21 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-10T23:24:22.349 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:21 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-10T23:24:22.349 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:21 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]': finished 2024-09-10T23:24:22.349 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:21 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-10T23:24:22.350 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:21 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-09-10T23:24:22.350 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:21 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 6, 5, 9]}]': finished 2024-09-10T23:24:22.350 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:21 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]': finished 2024-09-10T23:24:22.350 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:21 smithi194 ceph-mon[33904]: osdmap e87: 12 total, 12 up, 12 in 2024-09-10T23:24:23.058 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T23:24:23.058 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-10T23:24:23.058 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-10T23:24:23.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:22 smithi038 ceph-mon[34225]: osdmap e88: 12 total, 12 up, 12 in 2024-09-10T23:24:23.372 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:22 smithi194 ceph-mon[33904]: osdmap e88: 12 total, 12 up, 12 in 2024-09-10T23:24:23.452 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:23.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:22 smithi003 ceph-mon[30348]: osdmap e88: 12 total, 12 up, 12 in 2024-09-10T23:24:24.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.078+0000 7f6ad8a00640 1 -- 172.21.15.3:0/507348755 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ad4109130 msgr2=0x7f6ad410f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:24.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.078+0000 7f6ad8a00640 1 --2- 172.21.15.3:0/507348755 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ad4109130 0x7f6ad410f930 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6acc009ca0 tx=0x7f6acc02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:24:24.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.079+0000 7f6ad8a00640 1 -- 172.21.15.3:0/507348755 shutdown_connections 2024-09-10T23:24:24.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.079+0000 7f6ad8a00640 1 --2- 172.21.15.3:0/507348755 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ad4109130 0x7f6ad410f930 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:24.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.079+0000 7f6ad8a00640 1 --2- 172.21.15.3:0/507348755 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ad41087b0 0x7f6ad4108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:24.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.079+0000 7f6ad8a00640 1 --2- 172.21.15.3:0/507348755 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ad4102da0 0x7f6ad4103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:24.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.079+0000 7f6ad8a00640 1 -- 172.21.15.3:0/507348755 >> 172.21.15.3:0/507348755 conn(0x7f6ad40fe810 msgr2=0x7f6ad4100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:24.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.079+0000 7f6ad8a00640 1 -- 172.21.15.3:0/507348755 shutdown_connections 2024-09-10T23:24:24.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.079+0000 7f6ad8a00640 1 -- 172.21.15.3:0/507348755 wait complete. 2024-09-10T23:24:24.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.080+0000 7f6ad8a00640 1 Processor -- start 2024-09-10T23:24:24.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.080+0000 7f6ad8a00640 1 -- start start 2024-09-10T23:24:24.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.080+0000 7f6ad8a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ad4102da0 0x7f6ad40754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:24.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.080+0000 7f6ad8a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ad41087b0 0x7f6ad40759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:24.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.080+0000 7f6ad8a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ad4109130 0x7f6ad4075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:24.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.080+0000 7f6ad8a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad4112cf0 con 0x7f6ad4109130 2024-09-10T23:24:24.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.080+0000 7f6ad8a00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad4112b70 con 0x7f6ad41087b0 2024-09-10T23:24:24.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.080+0000 7f6ad8a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad4112e70 con 0x7f6ad4102da0 2024-09-10T23:24:24.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.080+0000 7f6ad2800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ad4109130 0x7f6ad4075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:24.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.080+0000 7f6ad2800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ad4109130 0x7f6ad4075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50314/0 (socket says 172.21.15.3:50314) 2024-09-10T23:24:24.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.080+0000 7f6ad1e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ad4102da0 0x7f6ad40754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:24.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.080+0000 7f6ad2800640 1 -- 172.21.15.3:0/3621894553 learned_addr learned my addr 172.21.15.3:0/3621894553 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:24:24.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.081+0000 7f6ac9400640 1 --2- 172.21.15.3:0/3621894553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ad41087b0 0x7f6ad40759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:24.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.081+0000 7f6ad2800640 1 -- 172.21.15.3:0/3621894553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ad4102da0 msgr2=0x7f6ad40754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:24.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.081+0000 7f6ad2800640 1 --2- 172.21.15.3:0/3621894553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ad4102da0 0x7f6ad40754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:24.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.081+0000 7f6ad2800640 1 -- 172.21.15.3:0/3621894553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ad41087b0 msgr2=0x7f6ad40759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:24.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.081+0000 7f6ad2800640 1 --2- 172.21.15.3:0/3621894553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ad41087b0 0x7f6ad40759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:24.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.081+0000 7f6ad2800640 1 -- 172.21.15.3:0/3621894553 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad41a74e0 con 0x7f6ad4109130 2024-09-10T23:24:24.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.081+0000 7f6ad1e00640 1 --2- 172.21.15.3:0/3621894553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ad4102da0 0x7f6ad40754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:24:24.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.081+0000 7f6ad2800640 1 --2- 172.21.15.3:0/3621894553 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ad4109130 0x7f6ad4075f20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6acc005e30 tx=0x7f6acc0093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:24.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.082+0000 7f6acb400640 1 -- 172.21.15.3:0/3621894553 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6acc032d10 con 0x7f6ad4109130 2024-09-10T23:24:24.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.082+0000 7f6acb400640 1 -- 172.21.15.3:0/3621894553 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6acc032eb0 con 0x7f6ad4109130 2024-09-10T23:24:24.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.082+0000 7f6acb400640 1 -- 172.21.15.3:0/3621894553 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6acc030a60 con 0x7f6ad4109130 2024-09-10T23:24:24.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.082+0000 7f6ad8a00640 1 -- 172.21.15.3:0/3621894553 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ad41a7770 con 0x7f6ad4109130 2024-09-10T23:24:24.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.082+0000 7f6ad8a00640 1 -- 172.21.15.3:0/3621894553 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ad41a7cb0 con 0x7f6ad4109130 2024-09-10T23:24:24.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.083+0000 7f6ad8a00640 1 -- 172.21.15.3:0/3621894553 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ad4103180 con 0x7f6ad4109130 2024-09-10T23:24:24.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.085+0000 7f6acb400640 1 -- 172.21.15.3:0/3621894553 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7f6acc030c20 con 0x7f6ad4109130 2024-09-10T23:24:24.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.086+0000 7f6acb400640 1 --2- 172.21.15.3:0/3621894553 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f6ab80b5330 0x7f6ab80b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:24.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.087+0000 7f6acb400640 1 -- 172.21.15.3:0/3621894553 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9286+0+0 (secure 0 0 0) 0x7f6acc107210 con 0x7f6ad4109130 2024-09-10T23:24:24.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.087+0000 7f6ad1e00640 1 --2- 172.21.15.3:0/3621894553 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f6ab80b5330 0x7f6ab80b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:24.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.087+0000 7f6ad1e00640 1 --2- 172.21.15.3:0/3621894553 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f6ab80b5330 0x7f6ab80b77f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4009fc0 tx=0x7f6ac4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:24.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.090+0000 7f6acb400640 1 -- 172.21.15.3:0/3621894553 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6acc0cdc50 con 0x7f6ad4109130 2024-09-10T23:24:24.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:24 smithi003 ceph-mon[30348]: pgmap v317: 129 pgs: 1 peering, 128 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-10T23:24:24.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.327+0000 7f6ad8a00640 1 -- 172.21.15.3:0/3621894553 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6ad41a7fa0 con 0x7f6ad4109130 2024-09-10T23:24:24.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.328+0000 7f6acb400640 1 -- 172.21.15.3:0/3621894553 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7f6acc0cd550 con 0x7f6ad4109130 2024-09-10T23:24:24.329 INFO:teuthology.orchestra.run.smithi003.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-10T23:24:24.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.330+0000 7f6ad8a00640 1 -- 172.21.15.3:0/3621894553 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f6ab80b5330 msgr2=0x7f6ab80b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:24.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.330+0000 7f6ad8a00640 1 --2- 172.21.15.3:0/3621894553 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f6ab80b5330 0x7f6ab80b77f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4009fc0 tx=0x7f6ac4005f90 comp rx=0 tx=0).stop 2024-09-10T23:24:24.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.330+0000 7f6ad8a00640 1 -- 172.21.15.3:0/3621894553 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ad4109130 msgr2=0x7f6ad4075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:24.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.330+0000 7f6ad8a00640 1 --2- 172.21.15.3:0/3621894553 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ad4109130 0x7f6ad4075f20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6acc005e30 tx=0x7f6acc0093d0 comp rx=0 tx=0).stop 2024-09-10T23:24:24.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.330+0000 7f6ad8a00640 1 -- 172.21.15.3:0/3621894553 shutdown_connections 2024-09-10T23:24:24.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.330+0000 7f6ad8a00640 1 --2- 172.21.15.3:0/3621894553 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f6ab80b5330 0x7f6ab80b77f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:24.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.330+0000 7f6ad8a00640 1 --2- 172.21.15.3:0/3621894553 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ad4109130 0x7f6ad4075f20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:24.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.330+0000 7f6ad8a00640 1 --2- 172.21.15.3:0/3621894553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ad41087b0 0x7f6ad40759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:24.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.330+0000 7f6ad8a00640 1 --2- 172.21.15.3:0/3621894553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ad4102da0 0x7f6ad40754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:24.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.330+0000 7f6ad8a00640 1 -- 172.21.15.3:0/3621894553 >> 172.21.15.3:0/3621894553 conn(0x7f6ad40fe810 msgr2=0x7f6ad4101d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:24.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.330+0000 7f6ad8a00640 1 -- 172.21.15.3:0/3621894553 shutdown_connections 2024-09-10T23:24:24.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:24.330+0000 7f6ad8a00640 1 -- 172.21.15.3:0/3621894553 wait complete. 2024-09-10T23:24:24.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:24 smithi194 ceph-mon[33904]: pgmap v317: 129 pgs: 1 peering, 128 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-10T23:24:24.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:24 smithi038 ceph-mon[34225]: pgmap v317: 129 pgs: 1 peering, 128 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-10T23:24:25.041 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T23:24:25.042 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:24:25.042 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi003.front.sepia.ceph.com 2024-09-10T23:24:25.042 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-10T23:24:25.042 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-10T23:24:25.042 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T23:24:25.042 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T23:24:25.042 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:24:25.042 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-10T23:24:25.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:25.043 DEBUG:teuthology.orchestra.run.smithi003:> ip addr 2024-09-10T23:24:25.080 INFO:teuthology.orchestra.run.smithi003.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:24:25.080 INFO:teuthology.orchestra.run.smithi003.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:24:25.080 INFO:teuthology.orchestra.run.smithi003.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:24:25.080 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:24:25.080 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 ::1/128 scope host 2024-09-10T23:24:25.080 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:24:25.080 INFO:teuthology.orchestra.run.smithi003.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:24:25.080 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:6b:fd:ac brd ff:ff:ff:ff:ff:ff 2024-09-10T23:24:25.080 INFO:teuthology.orchestra.run.smithi003.stdout: altname enp7s0f0 2024-09-10T23:24:25.080 INFO:teuthology.orchestra.run.smithi003.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:24:25.080 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:6b:fd:ad brd ff:ff:ff:ff:ff:ff 2024-09-10T23:24:25.081 INFO:teuthology.orchestra.run.smithi003.stdout: altname enp7s0f1 2024-09-10T23:24:25.081 INFO:teuthology.orchestra.run.smithi003.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:24:25.081 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:bd:15:dc brd ff:ff:ff:ff:ff:ff 2024-09-10T23:24:25.081 INFO:teuthology.orchestra.run.smithi003.stdout: altname enp1s0f0 2024-09-10T23:24:25.081 INFO:teuthology.orchestra.run.smithi003.stdout: inet 172.21.15.3/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T23:24:25.081 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft 42063sec preferred_lft 42063sec 2024-09-10T23:24:25.081 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 fe80::ec4:7aff:febd:15dc/64 scope link 2024-09-10T23:24:25.082 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:24:25.082 INFO:teuthology.orchestra.run.smithi003.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:24:25.082 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:bd:15:dd brd ff:ff:ff:ff:ff:ff 2024-09-10T23:24:25.082 INFO:teuthology.orchestra.run.smithi003.stdout: altname enp1s0f1 2024-09-10T23:24:25.083 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T23:24:25.083 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:24:25.083 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2024-09-10T23:24:25.083 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link add name ceph-brx type bridge 2024-09-10T23:24:25.083 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip addr flush dev ceph-brx 2024-09-10T23:24:25.083 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link set ceph-brx up 2024-09-10T23:24:25.083 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T23:24:25.084 DEBUG:teuthology.orchestra.run.smithi003:> ') 2024-09-10T23:24:25.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:24:25.429 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:25 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3621894553' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T23:24:25.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:25 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3621894553' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T23:24:25.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:25.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:25.515 DEBUG:teuthology.orchestra.run.smithi003:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:24:25.571 INFO:teuthology.orchestra.run.smithi003.stdout:1 2024-09-10T23:24:25.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:25.575 DEBUG:teuthology.orchestra.run.smithi003:> route 2024-09-10T23:24:25.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:25 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3621894553' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T23:24:25.637 INFO:teuthology.orchestra.run.smithi003.stdout:Kernel IP routing table 2024-09-10T23:24:25.637 INFO:teuthology.orchestra.run.smithi003.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:24:25.637 INFO:teuthology.orchestra.run.smithi003.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T23:24:25.637 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T23:24:25.637 INFO:teuthology.orchestra.run.smithi003.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:24:25.638 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:24:25.638 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2024-09-10T23:24:25.638 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T23:24:25.638 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T23:24:25.638 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T23:24:25.638 DEBUG:teuthology.orchestra.run.smithi003:> ') 2024-09-10T23:24:25.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:24:26.191 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:26.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:26.201 DEBUG:teuthology.orchestra.run.smithi003:> ip netns list 2024-09-10T23:24:26.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:26.238 DEBUG:teuthology.orchestra.run.smithi003:> ip netns list-id 2024-09-10T23:24:26.314 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:24:26.314 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2024-09-10T23:24:26.314 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T23:24:26.314 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-10T23:24:26.314 DEBUG:teuthology.orchestra.run.smithi003:> ') 2024-09-10T23:24:26.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:24:26.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:26 smithi194 ceph-mon[33904]: pgmap v318: 129 pgs: 1 peering, 128 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-10T23:24:26.449 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:26 smithi003 ceph-mon[30348]: pgmap v318: 129 pgs: 1 peering, 128 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-10T23:24:26.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:26.493 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-10T23:24:26.494 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:24:26.494 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2024-09-10T23:24:26.494 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-10T23:24:26.494 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T23:24:26.494 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-10T23:24:26.494 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-10T23:24:26.494 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-10T23:24:26.494 DEBUG:teuthology.orchestra.run.smithi003:> ') 2024-09-10T23:24:26.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:24:26.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:26 smithi038 ceph-mon[34225]: pgmap v318: 129 pgs: 1 peering, 128 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-10T23:24:26.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:26.732 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:24:26.732 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2024-09-10T23:24:26.732 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link set brx.0 up 2024-09-10T23:24:26.732 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T23:24:26.732 DEBUG:teuthology.orchestra.run.smithi003:> ') 2024-09-10T23:24:26.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:24:26.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:26.903 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-10T23:24:26.903 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:24:26.904 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-10T23:24:26.938 INFO:teuthology.orchestra.run.smithi003.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-10T23:24:26.939 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:24:26.939 DEBUG:teuthology.orchestra.run.smithi003:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-10T23:24:27.015 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2024-09-10T23:24:27.113 DEBUG:teuthology.orchestra.run.smithi003:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:24:27.149 INFO:teuthology.orchestra.run.smithi003.stdout:/proc 2024-09-10T23:24:27.149 INFO:teuthology.orchestra.run.smithi003.stdout:/sys 2024-09-10T23:24:27.149 INFO:teuthology.orchestra.run.smithi003.stdout:/dev 2024-09-10T23:24:27.149 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/kernel/security 2024-09-10T23:24:27.149 INFO:teuthology.orchestra.run.smithi003.stdout:/dev/shm 2024-09-10T23:24:27.149 INFO:teuthology.orchestra.run.smithi003.stdout:/dev/pts 2024-09-10T23:24:27.149 INFO:teuthology.orchestra.run.smithi003.stdout:/run 2024-09-10T23:24:27.149 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/cgroup 2024-09-10T23:24:27.149 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/pstore 2024-09-10T23:24:27.150 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/bpf 2024-09-10T23:24:27.150 INFO:teuthology.orchestra.run.smithi003.stdout:/ 2024-09-10T23:24:27.150 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/selinux 2024-09-10T23:24:27.150 INFO:teuthology.orchestra.run.smithi003.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:24:27.150 INFO:teuthology.orchestra.run.smithi003.stdout:/dev/hugepages 2024-09-10T23:24:27.150 INFO:teuthology.orchestra.run.smithi003.stdout:/dev/mqueue 2024-09-10T23:24:27.150 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/kernel/debug 2024-09-10T23:24:27.150 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/kernel/tracing 2024-09-10T23:24:27.150 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/fuse/connections 2024-09-10T23:24:27.150 INFO:teuthology.orchestra.run.smithi003.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T23:24:27.150 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/kernel/config 2024-09-10T23:24:27.150 INFO:teuthology.orchestra.run.smithi003.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T23:24:27.150 INFO:teuthology.orchestra.run.smithi003.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T23:24:27.150 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T23:24:27.150 INFO:teuthology.orchestra.run.smithi003.stdout:/run/user/1000 2024-09-10T23:24:27.151 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/ceph 2024-09-10T23:24:27.151 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay 2024-09-10T23:24:27.151 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/77a52a37e8f88462cea6771d4aa25e63ac6d837ba398cf6f00e776111cc2de6c/merged 2024-09-10T23:24:27.151 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/2be80f4f7316ca8a5c459cb75da698a51fd97ddeee5287fced694a5cf5f140d6/merged 2024-09-10T23:24:27.151 INFO:teuthology.orchestra.run.smithi003.stdout:/run/user/0 2024-09-10T23:24:27.151 INFO:teuthology.orchestra.run.smithi003.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:24:27.151 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/66878287880ab44aac3a698d632b53d186ef96bd229817e2c32daf048dd97f92/merged 2024-09-10T23:24:27.151 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/b40eef2d3fcd560ad2ef7624aab75a55df76bba8f030a4902fdfa408775bcac1/merged 2024-09-10T23:24:27.151 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/149be40fb418ab1c50a85b04773165856107476c82452a4214334bcb0c68f990/merged 2024-09-10T23:24:27.151 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/c99549f2a487791a4307554b64eaaf405a56145721c6c639f26838d93dbcae27/merged 2024-09-10T23:24:27.151 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/5d955b957d4a0e77655edc5bca007d7b5205d27be8e86779763ae4c28882193b/merged 2024-09-10T23:24:27.151 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/8dc267f2e57c5e4611917f0bf3096933c3206bb6dfbc875fbefb8c38a037f015/merged 2024-09-10T23:24:27.151 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/79206fec5c2e5e2f4ebd93c5b5af04de66191d2569b256cb135f90cfd0f322ce/merged 2024-09-10T23:24:27.151 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/a7c378ff9d49bdc46d1c11d67a029b08e6cd1ab59462f0d54c417e00a17cf5c4/merged 2024-09-10T23:24:27.151 INFO:teuthology.orchestra.run.smithi003.stdout:/run/netns 2024-09-10T23:24:27.152 INFO:teuthology.orchestra.run.smithi003.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T23:24:27.152 INFO:teuthology.orchestra.run.smithi003.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T23:24:27.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:27.152 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2024-09-10T23:24:27.228 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T23:24:27.228 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-10T23:24:27.272 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2024-09-10T23:24:27.329 DEBUG:teuthology.orchestra.run.smithi003:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:24:27.366 INFO:teuthology.orchestra.run.smithi003.stdout:/proc 2024-09-10T23:24:27.367 INFO:teuthology.orchestra.run.smithi003.stdout:/sys 2024-09-10T23:24:27.367 INFO:teuthology.orchestra.run.smithi003.stdout:/dev 2024-09-10T23:24:27.367 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/kernel/security 2024-09-10T23:24:27.367 INFO:teuthology.orchestra.run.smithi003.stdout:/dev/shm 2024-09-10T23:24:27.367 INFO:teuthology.orchestra.run.smithi003.stdout:/dev/pts 2024-09-10T23:24:27.367 INFO:teuthology.orchestra.run.smithi003.stdout:/run 2024-09-10T23:24:27.367 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/cgroup 2024-09-10T23:24:27.367 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/pstore 2024-09-10T23:24:27.367 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/bpf 2024-09-10T23:24:27.367 INFO:teuthology.orchestra.run.smithi003.stdout:/ 2024-09-10T23:24:27.367 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/selinux 2024-09-10T23:24:27.367 INFO:teuthology.orchestra.run.smithi003.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:24:27.368 INFO:teuthology.orchestra.run.smithi003.stdout:/dev/hugepages 2024-09-10T23:24:27.368 INFO:teuthology.orchestra.run.smithi003.stdout:/dev/mqueue 2024-09-10T23:24:27.368 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/kernel/debug 2024-09-10T23:24:27.368 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/kernel/tracing 2024-09-10T23:24:27.368 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/fuse/connections 2024-09-10T23:24:27.368 INFO:teuthology.orchestra.run.smithi003.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T23:24:27.368 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/kernel/config 2024-09-10T23:24:27.368 INFO:teuthology.orchestra.run.smithi003.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T23:24:27.368 INFO:teuthology.orchestra.run.smithi003.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T23:24:27.368 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T23:24:27.368 INFO:teuthology.orchestra.run.smithi003.stdout:/run/user/1000 2024-09-10T23:24:27.368 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/ceph 2024-09-10T23:24:27.368 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay 2024-09-10T23:24:27.369 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/77a52a37e8f88462cea6771d4aa25e63ac6d837ba398cf6f00e776111cc2de6c/merged 2024-09-10T23:24:27.369 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/2be80f4f7316ca8a5c459cb75da698a51fd97ddeee5287fced694a5cf5f140d6/merged 2024-09-10T23:24:27.369 INFO:teuthology.orchestra.run.smithi003.stdout:/run/user/0 2024-09-10T23:24:27.369 INFO:teuthology.orchestra.run.smithi003.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:24:27.369 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/66878287880ab44aac3a698d632b53d186ef96bd229817e2c32daf048dd97f92/merged 2024-09-10T23:24:27.369 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/b40eef2d3fcd560ad2ef7624aab75a55df76bba8f030a4902fdfa408775bcac1/merged 2024-09-10T23:24:27.369 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/149be40fb418ab1c50a85b04773165856107476c82452a4214334bcb0c68f990/merged 2024-09-10T23:24:27.369 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/c99549f2a487791a4307554b64eaaf405a56145721c6c639f26838d93dbcae27/merged 2024-09-10T23:24:27.369 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/5d955b957d4a0e77655edc5bca007d7b5205d27be8e86779763ae4c28882193b/merged 2024-09-10T23:24:27.369 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/8dc267f2e57c5e4611917f0bf3096933c3206bb6dfbc875fbefb8c38a037f015/merged 2024-09-10T23:24:27.369 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/79206fec5c2e5e2f4ebd93c5b5af04de66191d2569b256cb135f90cfd0f322ce/merged 2024-09-10T23:24:27.369 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/a7c378ff9d49bdc46d1c11d67a029b08e6cd1ab59462f0d54c417e00a17cf5c4/merged 2024-09-10T23:24:27.369 INFO:teuthology.orchestra.run.smithi003.stdout:/run/netns 2024-09-10T23:24:27.369 INFO:teuthology.orchestra.run.smithi003.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T23:24:27.370 INFO:teuthology.orchestra.run.smithi003.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T23:24:27.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:27.370 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2024-09-10T23:24:27.448 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi003.stderr:2024-09-10T23:24:27.447+0000 7fa74a029480 -1 init, newargv = 0x556c6a2f3dd0 newargc=15 2024-09-10T23:24:27.448 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi003.stderr:ceph-fuse[79565]: starting ceph client 2024-09-10T23:24:27.460 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi003.stderr:ceph-fuse[79565]: starting fuse 2024-09-10T23:24:28.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:28 smithi194 ceph-mon[33904]: pgmap v319: 129 pgs: 129 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-10T23:24:28.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:28 smithi003 ceph-mon[30348]: pgmap v319: 129 pgs: 129 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-10T23:24:28.549 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2024-09-10T23:24:28.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:28 smithi038 ceph-mon[34225]: pgmap v319: 129 pgs: 129 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-10T23:24:28.614 DEBUG:teuthology.orchestra.run.smithi003:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:24:28.653 INFO:teuthology.orchestra.run.smithi003.stdout:/proc 2024-09-10T23:24:28.654 INFO:teuthology.orchestra.run.smithi003.stdout:/sys 2024-09-10T23:24:28.654 INFO:teuthology.orchestra.run.smithi003.stdout:/dev 2024-09-10T23:24:28.654 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/kernel/security 2024-09-10T23:24:28.654 INFO:teuthology.orchestra.run.smithi003.stdout:/dev/shm 2024-09-10T23:24:28.654 INFO:teuthology.orchestra.run.smithi003.stdout:/dev/pts 2024-09-10T23:24:28.654 INFO:teuthology.orchestra.run.smithi003.stdout:/run 2024-09-10T23:24:28.654 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/cgroup 2024-09-10T23:24:28.654 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/pstore 2024-09-10T23:24:28.654 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/bpf 2024-09-10T23:24:28.654 INFO:teuthology.orchestra.run.smithi003.stdout:/ 2024-09-10T23:24:28.654 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/selinux 2024-09-10T23:24:28.654 INFO:teuthology.orchestra.run.smithi003.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:24:28.655 INFO:teuthology.orchestra.run.smithi003.stdout:/dev/hugepages 2024-09-10T23:24:28.655 INFO:teuthology.orchestra.run.smithi003.stdout:/dev/mqueue 2024-09-10T23:24:28.655 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/kernel/debug 2024-09-10T23:24:28.655 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/kernel/tracing 2024-09-10T23:24:28.655 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/fuse/connections 2024-09-10T23:24:28.655 INFO:teuthology.orchestra.run.smithi003.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T23:24:28.655 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/kernel/config 2024-09-10T23:24:28.655 INFO:teuthology.orchestra.run.smithi003.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T23:24:28.655 INFO:teuthology.orchestra.run.smithi003.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T23:24:28.655 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T23:24:28.655 INFO:teuthology.orchestra.run.smithi003.stdout:/run/user/1000 2024-09-10T23:24:28.655 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/ceph 2024-09-10T23:24:28.655 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay 2024-09-10T23:24:28.656 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/77a52a37e8f88462cea6771d4aa25e63ac6d837ba398cf6f00e776111cc2de6c/merged 2024-09-10T23:24:28.656 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/2be80f4f7316ca8a5c459cb75da698a51fd97ddeee5287fced694a5cf5f140d6/merged 2024-09-10T23:24:28.656 INFO:teuthology.orchestra.run.smithi003.stdout:/run/user/0 2024-09-10T23:24:28.656 INFO:teuthology.orchestra.run.smithi003.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:24:28.656 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/66878287880ab44aac3a698d632b53d186ef96bd229817e2c32daf048dd97f92/merged 2024-09-10T23:24:28.656 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/b40eef2d3fcd560ad2ef7624aab75a55df76bba8f030a4902fdfa408775bcac1/merged 2024-09-10T23:24:28.656 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/149be40fb418ab1c50a85b04773165856107476c82452a4214334bcb0c68f990/merged 2024-09-10T23:24:28.656 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/c99549f2a487791a4307554b64eaaf405a56145721c6c639f26838d93dbcae27/merged 2024-09-10T23:24:28.656 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/5d955b957d4a0e77655edc5bca007d7b5205d27be8e86779763ae4c28882193b/merged 2024-09-10T23:24:28.656 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/8dc267f2e57c5e4611917f0bf3096933c3206bb6dfbc875fbefb8c38a037f015/merged 2024-09-10T23:24:28.656 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/79206fec5c2e5e2f4ebd93c5b5af04de66191d2569b256cb135f90cfd0f322ce/merged 2024-09-10T23:24:28.656 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/a7c378ff9d49bdc46d1c11d67a029b08e6cd1ab59462f0d54c417e00a17cf5c4/merged 2024-09-10T23:24:28.656 INFO:teuthology.orchestra.run.smithi003.stdout:/run/netns 2024-09-10T23:24:28.656 INFO:teuthology.orchestra.run.smithi003.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T23:24:28.656 INFO:teuthology.orchestra.run.smithi003.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T23:24:28.657 INFO:teuthology.orchestra.run.smithi003.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-10T23:24:28.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:28.657 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2024-09-10T23:24:28.729 INFO:teuthology.orchestra.run.smithi003.stdout:120 2024-09-10T23:24:28.730 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-10T23:24:28.730 DEBUG:teuthology.orchestra.run.smithi003:> sudo stdin-killer -- python3 -c ' 2024-09-10T23:24:28.730 DEBUG:teuthology.orchestra.run.smithi003:> import glob 2024-09-10T23:24:28.730 DEBUG:teuthology.orchestra.run.smithi003:> import re 2024-09-10T23:24:28.730 DEBUG:teuthology.orchestra.run.smithi003:> import os 2024-09-10T23:24:28.730 DEBUG:teuthology.orchestra.run.smithi003:> import subprocess 2024-09-10T23:24:28.730 DEBUG:teuthology.orchestra.run.smithi003:> 2024-09-10T23:24:28.730 DEBUG:teuthology.orchestra.run.smithi003:> def _find_admin_socket(client_name): 2024-09-10T23:24:28.730 DEBUG:teuthology.orchestra.run.smithi003:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-10T23:24:28.731 DEBUG:teuthology.orchestra.run.smithi003:> files = glob.glob(asok_path) 2024-09-10T23:24:28.731 DEBUG:teuthology.orchestra.run.smithi003:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-10T23:24:28.731 DEBUG:teuthology.orchestra.run.smithi003:> 2024-09-10T23:24:28.731 DEBUG:teuthology.orchestra.run.smithi003:> # Given a non-glob path, it better be there 2024-09-10T23:24:28.731 DEBUG:teuthology.orchestra.run.smithi003:> if "*" not in asok_path: 2024-09-10T23:24:28.731 DEBUG:teuthology.orchestra.run.smithi003:> assert(len(files) == 1) 2024-09-10T23:24:28.731 DEBUG:teuthology.orchestra.run.smithi003:> return files[0] 2024-09-10T23:24:28.731 DEBUG:teuthology.orchestra.run.smithi003:> 2024-09-10T23:24:28.731 DEBUG:teuthology.orchestra.run.smithi003:> for f in files: 2024-09-10T23:24:28.731 DEBUG:teuthology.orchestra.run.smithi003:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T23:24:28.731 DEBUG:teuthology.orchestra.run.smithi003:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T23:24:28.731 DEBUG:teuthology.orchestra.run.smithi003:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T23:24:28.731 DEBUG:teuthology.orchestra.run.smithi003:> contents = proc_f.read() 2024-09-10T23:24:28.731 DEBUG:teuthology.orchestra.run.smithi003:> if mountpoint in contents: 2024-09-10T23:24:28.732 DEBUG:teuthology.orchestra.run.smithi003:> return f 2024-09-10T23:24:28.732 DEBUG:teuthology.orchestra.run.smithi003:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T23:24:28.732 DEBUG:teuthology.orchestra.run.smithi003:> 2024-09-10T23:24:28.732 DEBUG:teuthology.orchestra.run.smithi003:> print(_find_admin_socket("client.admin")) 2024-09-10T23:24:28.732 DEBUG:teuthology.orchestra.run.smithi003:> ' 2024-09-10T23:24:28.895 INFO:teuthology.orchestra.run.smithi003.stdout:/var/run/ceph/ceph-client.admin.79565.asok 2024-09-10T23:24:28.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:28.909 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.79565.asok 2024-09-10T23:24:28.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:28.909 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.79565.asok status 2024-09-10T23:24:29.095 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-10T23:24:29.095 INFO:teuthology.orchestra.run.smithi003.stdout: "metadata": { 2024-09-10T23:24:29.095 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T23:24:29.095 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:24:29.095 INFO:teuthology.orchestra.run.smithi003.stdout: "entity_id": "admin", 2024-09-10T23:24:29.095 INFO:teuthology.orchestra.run.smithi003.stdout: "hostname": "smithi003", 2024-09-10T23:24:29.095 INFO:teuthology.orchestra.run.smithi003.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-10T23:24:29.096 INFO:teuthology.orchestra.run.smithi003.stdout: "pid": "79565", 2024-09-10T23:24:29.096 INFO:teuthology.orchestra.run.smithi003.stdout: "root": "/" 2024-09-10T23:24:29.096 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:24:29.096 INFO:teuthology.orchestra.run.smithi003.stdout: "dentry_count": 0, 2024-09-10T23:24:29.096 INFO:teuthology.orchestra.run.smithi003.stdout: "dentry_pinned_count": 0, 2024-09-10T23:24:29.096 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 15000, 2024-09-10T23:24:29.096 INFO:teuthology.orchestra.run.smithi003.stdout: "inst": { 2024-09-10T23:24:29.096 INFO:teuthology.orchestra.run.smithi003.stdout: "name": { 2024-09-10T23:24:29.096 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client", 2024-09-10T23:24:29.096 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 15000 2024-09-10T23:24:29.096 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:24:29.096 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": { 2024-09-10T23:24:29.096 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2024-09-10T23:24:29.097 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:24:29.097 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 932077041 2024-09-10T23:24:29.097 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:24:29.097 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:24:29.097 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": { 2024-09-10T23:24:29.097 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2024-09-10T23:24:29.097 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:24:29.097 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 932077041 2024-09-10T23:24:29.097 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:24:29.097 INFO:teuthology.orchestra.run.smithi003.stdout: "inst_str": "client.15000 192.168.0.1:0/932077041", 2024-09-10T23:24:29.097 INFO:teuthology.orchestra.run.smithi003.stdout: "addr_str": "192.168.0.1:0/932077041", 2024-09-10T23:24:29.097 INFO:teuthology.orchestra.run.smithi003.stdout: "inode_count": 1, 2024-09-10T23:24:29.097 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_epoch": 17, 2024-09-10T23:24:29.098 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_epoch": 88, 2024-09-10T23:24:29.098 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_epoch_barrier": 0, 2024-09-10T23:24:29.098 INFO:teuthology.orchestra.run.smithi003.stdout: "blocklisted": false, 2024-09-10T23:24:29.098 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs" 2024-09-10T23:24:29.098 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-10T23:24:29.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:29.107 DEBUG:teuthology.orchestra.run.smithi003:> stat --file-system '--printf=%T 2024-09-10T23:24:29.108 DEBUG:teuthology.orchestra.run.smithi003:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-10T23:24:29.143 INFO:teuthology.orchestra.run.smithi003.stdout:fuseblk 2024-09-10T23:24:29.144 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-10T23:24:29.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:29.144 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-10T23:24:29.242 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-10T23:24:29.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:29.353 INFO:teuthology.orchestra.run.smithi003.stdout:# file: . 2024-09-10T23:24:29.353 INFO:teuthology.orchestra.run.smithi003.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-10T23:24:29.354 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:24:29.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:29.362 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-10T23:24:29.363 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:24:29.399 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-10T23:24:29.818 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:30.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:30 smithi003 ceph-mon[30348]: pgmap v320: 129 pgs: 129 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-10T23:24:30.399 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:30 smithi038 ceph-mon[34225]: pgmap v320: 129 pgs: 129 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-10T23:24:30.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.416+0000 7f1490600640 1 -- 172.21.15.3:0/1664786167 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1488102dc0 msgr2=0x7f14881031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:30.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.416+0000 7f1490600640 1 --2- 172.21.15.3:0/1664786167 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1488102dc0 0x7f14881031a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f147c009900 tx=0x7f147c02a410 comp rx=0 tx=0).stop 2024-09-10T23:24:30.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.416+0000 7f1490600640 1 -- 172.21.15.3:0/1664786167 shutdown_connections 2024-09-10T23:24:30.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.416+0000 7f1490600640 1 --2- 172.21.15.3:0/1664786167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1488109150 0x7f148810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.416+0000 7f1490600640 1 --2- 172.21.15.3:0/1664786167 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14881087d0 0x7f1488108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.416+0000 7f1490600640 1 --2- 172.21.15.3:0/1664786167 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1488102dc0 0x7f14881031a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.416+0000 7f1490600640 1 -- 172.21.15.3:0/1664786167 >> 172.21.15.3:0/1664786167 conn(0x7f14880fe830 msgr2=0x7f1488100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:30.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.416+0000 7f1490600640 1 -- 172.21.15.3:0/1664786167 shutdown_connections 2024-09-10T23:24:30.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.416+0000 7f1490600640 1 -- 172.21.15.3:0/1664786167 wait complete. 2024-09-10T23:24:30.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.417+0000 7f1490600640 1 Processor -- start 2024-09-10T23:24:30.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.417+0000 7f1490600640 1 -- start start 2024-09-10T23:24:30.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.417+0000 7f1490600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1488102dc0 0x7f1488199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:30.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.417+0000 7f1490600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14881087d0 0x7f1488199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:30.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.417+0000 7f1490600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1488109150 0x7f148819eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:30.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.417+0000 7f1490600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1488112d10 con 0x7f14881087d0 2024-09-10T23:24:30.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.417+0000 7f1490600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f1488112b90 con 0x7f1488102dc0 2024-09-10T23:24:30.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.417+0000 7f1490600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1488112e90 con 0x7f1488109150 2024-09-10T23:24:30.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.418+0000 7f148d200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14881087d0 0x7f1488199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:30.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.418+0000 7f148d200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14881087d0 0x7f1488199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50344/0 (socket says 172.21.15.3:50344) 2024-09-10T23:24:30.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.418+0000 7f148d200640 1 -- 172.21.15.3:0/454431544 learned_addr learned my addr 172.21.15.3:0/454431544 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:24:30.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.418+0000 7f148dc00640 1 --2- 172.21.15.3:0/454431544 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1488102dc0 0x7f1488199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:30.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.418+0000 7f148e600640 1 --2- 172.21.15.3:0/454431544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1488109150 0x7f148819eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:30.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.418+0000 7f148d200640 1 -- 172.21.15.3:0/454431544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1488109150 msgr2=0x7f148819eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:30.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.418+0000 7f148d200640 1 --2- 172.21.15.3:0/454431544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1488109150 0x7f148819eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.418+0000 7f148d200640 1 -- 172.21.15.3:0/454431544 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1488102dc0 msgr2=0x7f1488199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:30.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.418+0000 7f148d200640 1 --2- 172.21.15.3:0/454431544 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1488102dc0 0x7f1488199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.418+0000 7f148d200640 1 -- 172.21.15.3:0/454431544 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f148819f2b0 con 0x7f14881087d0 2024-09-10T23:24:30.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.418+0000 7f148d200640 1 --2- 172.21.15.3:0/454431544 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14881087d0 0x7f1488199740 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f147400ea60 tx=0x7f147400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:30.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.419+0000 7f1486000640 1 -- 172.21.15.3:0/454431544 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147400cde0 con 0x7f14881087d0 2024-09-10T23:24:30.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.419+0000 7f1486000640 1 -- 172.21.15.3:0/454431544 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f14740035f0 con 0x7f14881087d0 2024-09-10T23:24:30.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.419+0000 7f1490600640 1 -- 172.21.15.3:0/454431544 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f148819f5a0 con 0x7f14881087d0 2024-09-10T23:24:30.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.419+0000 7f1486000640 1 -- 172.21.15.3:0/454431544 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1474010690 con 0x7f14881087d0 2024-09-10T23:24:30.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.419+0000 7f1490600640 1 -- 172.21.15.3:0/454431544 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14881a5e30 con 0x7f14881087d0 2024-09-10T23:24:30.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.420+0000 7f1490600640 1 -- 172.21.15.3:0/454431544 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14881031a0 con 0x7f14881087d0 2024-09-10T23:24:30.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.423+0000 7f1486000640 1 -- 172.21.15.3:0/454431544 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7f1474004000 con 0x7f14881087d0 2024-09-10T23:24:30.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.424+0000 7f1486000640 1 --2- 172.21.15.3:0/454431544 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f14700b53b0 0x7f14700b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:30.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.425+0000 7f1486000640 1 -- 172.21.15.3:0/454431544 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9286+0+0 (secure 0 0 0) 0x7f14740e67e0 con 0x7f14881087d0 2024-09-10T23:24:30.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.425+0000 7f148dc00640 1 --2- 172.21.15.3:0/454431544 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f14700b53b0 0x7f14700b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:30.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.426+0000 7f148dc00640 1 --2- 172.21.15.3:0/454431544 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f14700b53b0 0x7f14700b7870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f147c006010 tx=0x7f147c005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:30.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.426+0000 7f1486000640 1 -- 172.21.15.3:0/454431544 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f14740ad280 con 0x7f14881087d0 2024-09-10T23:24:30.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:30 smithi194 ceph-mon[33904]: pgmap v320: 129 pgs: 129 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-10T23:24:30.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.633+0000 7f1490600640 1 -- 172.21.15.3:0/454431544 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f148819a330 con 0x7f14881087d0 2024-09-10T23:24:30.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.634+0000 7f1486000640 1 -- 172.21.15.3:0/454431544 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v88) ==== 81+0+869 (secure 0 0 0) 0x7f14740acb80 con 0x7f14881087d0 2024-09-10T23:24:30.635 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/776988825 2024-09-11T23:16:20.647314+0000 2024-09-10T23:24:30.635 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/2965090335 2024-09-11T23:14:37.169991+0000 2024-09-10T23:24:30.635 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/2364823868 2024-09-11T23:14:37.169991+0000 2024-09-10T23:24:30.636 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/3186881356 2024-09-11T23:14:37.169991+0000 2024-09-10T23:24:30.636 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/911991463 2024-09-11T23:16:20.647314+0000 2024-09-10T23:24:30.636 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6800/2582365069 2024-09-11T23:14:37.169991+0000 2024-09-10T23:24:30.636 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6801/2582365069 2024-09-11T23:14:37.169991+0000 2024-09-10T23:24:30.636 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6801/1528153492 2024-09-11T23:15:05.835734+0000 2024-09-10T23:24:30.636 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6800/1924113958 2024-09-11T23:16:20.647314+0000 2024-09-10T23:24:30.636 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/554479543 2024-09-11T23:15:05.835734+0000 2024-09-10T23:24:30.636 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/4238683346 2024-09-11T23:15:05.835734+0000 2024-09-10T23:24:30.636 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6800/1528153492 2024-09-11T23:15:05.835734+0000 2024-09-10T23:24:30.636 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/285471483 2024-09-11T23:15:05.835734+0000 2024-09-10T23:24:30.636 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/1249510760 2024-09-11T23:16:20.647314+0000 2024-09-10T23:24:30.636 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6801/1924113958 2024-09-11T23:16:20.647314+0000 2024-09-10T23:24:30.637 INFO:teuthology.orchestra.run.smithi003.stderr:listed 15 entries 2024-09-10T23:24:30.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.637+0000 7f1490600640 1 -- 172.21.15.3:0/454431544 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f14700b53b0 msgr2=0x7f14700b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:30.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.637+0000 7f1490600640 1 --2- 172.21.15.3:0/454431544 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f14700b53b0 0x7f14700b7870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f147c006010 tx=0x7f147c005a20 comp rx=0 tx=0).stop 2024-09-10T23:24:30.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.637+0000 7f1490600640 1 -- 172.21.15.3:0/454431544 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14881087d0 msgr2=0x7f1488199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:30.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.637+0000 7f1490600640 1 --2- 172.21.15.3:0/454431544 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14881087d0 0x7f1488199740 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f147400ea60 tx=0x7f147400ef20 comp rx=0 tx=0).stop 2024-09-10T23:24:30.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.637+0000 7f1490600640 1 -- 172.21.15.3:0/454431544 shutdown_connections 2024-09-10T23:24:30.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.637+0000 7f1490600640 1 --2- 172.21.15.3:0/454431544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1488109150 0x7f148819eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.637+0000 7f1490600640 1 --2- 172.21.15.3:0/454431544 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f14700b53b0 0x7f14700b7870 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.637+0000 7f1490600640 1 --2- 172.21.15.3:0/454431544 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14881087d0 0x7f1488199740 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.637+0000 7f1490600640 1 --2- 172.21.15.3:0/454431544 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1488102dc0 0x7f1488199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.637+0000 7f1490600640 1 -- 172.21.15.3:0/454431544 >> 172.21.15.3:0/454431544 conn(0x7f14880fe830 msgr2=0x7f14881001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:30.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.637+0000 7f1490600640 1 -- 172.21.15.3:0/454431544 shutdown_connections 2024-09-10T23:24:30.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:30.638+0000 7f1490600640 1 -- 172.21.15.3:0/454431544 wait complete. 2024-09-10T23:24:31.306 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:31 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/454431544' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T23:24:31.343 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-10T23:24:31.343 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:24:31.380 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-10T23:24:31.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:31 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/454431544' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T23:24:31.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:31 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/454431544' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T23:24:31.799 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:32.210 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:32 smithi003 ceph-mon[30348]: pgmap v321: 129 pgs: 129 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3 B/s, 1 keys/s, 0 objects/s recovering 2024-09-10T23:24:32.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.323+0000 7f1426e00640 1 -- 172.21.15.3:0/455680712 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1420102da0 msgr2=0x7f1420103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:32.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.323+0000 7f1426e00640 1 --2- 172.21.15.3:0/455680712 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1420102da0 0x7f1420103180 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1410009900 tx=0x7f141002a400 comp rx=0 tx=0).stop 2024-09-10T23:24:32.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.323+0000 7f1426e00640 1 -- 172.21.15.3:0/455680712 shutdown_connections 2024-09-10T23:24:32.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.323+0000 7f1426e00640 1 --2- 172.21.15.3:0/455680712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1420109130 0x7f142010f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.323+0000 7f1426e00640 1 --2- 172.21.15.3:0/455680712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14201087b0 0x7f1420108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.323+0000 7f1426e00640 1 --2- 172.21.15.3:0/455680712 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1420102da0 0x7f1420103180 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.323+0000 7f1426e00640 1 -- 172.21.15.3:0/455680712 >> 172.21.15.3:0/455680712 conn(0x7f14200fe810 msgr2=0x7f1420100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:32.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.323+0000 7f1426e00640 1 -- 172.21.15.3:0/455680712 shutdown_connections 2024-09-10T23:24:32.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.323+0000 7f1426e00640 1 -- 172.21.15.3:0/455680712 wait complete. 2024-09-10T23:24:32.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.324+0000 7f1426e00640 1 Processor -- start 2024-09-10T23:24:32.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.325+0000 7f1426e00640 1 -- start start 2024-09-10T23:24:32.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.325+0000 7f1426e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1420102da0 0x7f142019b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:32.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.325+0000 7f1426e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14201087b0 0x7f142019b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:32.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.325+0000 7f1426e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1420109130 0x7f14201a0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:32.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.325+0000 7f1426e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1420112cf0 con 0x7f1420102da0 2024-09-10T23:24:32.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.325+0000 7f1426e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f1420112b70 con 0x7f1420109130 2024-09-10T23:24:32.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.325+0000 7f1426e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1420112e70 con 0x7f14201087b0 2024-09-10T23:24:32.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.325+0000 7f141fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1420102da0 0x7f142019b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:32.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.325+0000 7f141fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1420102da0 0x7f142019b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41884/0 (socket says 172.21.15.3:41884) 2024-09-10T23:24:32.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.325+0000 7f141fe00640 1 -- 172.21.15.3:0/3750747559 learned_addr learned my addr 172.21.15.3:0/3750747559 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:24:32.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.325+0000 7f141f400640 1 --2- 172.21.15.3:0/3750747559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14201087b0 0x7f142019b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:32.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.326+0000 7f1424e00640 1 --2- 172.21.15.3:0/3750747559 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1420109130 0x7f14201a0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:32.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.326+0000 7f141fe00640 1 -- 172.21.15.3:0/3750747559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14201087b0 msgr2=0x7f142019b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:32.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.326+0000 7f141fe00640 1 --2- 172.21.15.3:0/3750747559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14201087b0 0x7f142019b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.326+0000 7f141fe00640 1 -- 172.21.15.3:0/3750747559 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1420109130 msgr2=0x7f14201a0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:32.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.326+0000 7f141fe00640 1 --2- 172.21.15.3:0/3750747559 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1420109130 0x7f14201a0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.326+0000 7f141fe00640 1 -- 172.21.15.3:0/3750747559 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14201a1490 con 0x7f1420102da0 2024-09-10T23:24:32.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.326+0000 7f1424e00640 1 --2- 172.21.15.3:0/3750747559 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1420109130 0x7f14201a0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:32.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.326+0000 7f141fe00640 1 --2- 172.21.15.3:0/3750747559 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1420102da0 0x7f142019b3e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f141002a920 tx=0x7f1410003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:32.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.326+0000 7f141cc00640 1 -- 172.21.15.3:0/3750747559 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141003f070 con 0x7f1420102da0 2024-09-10T23:24:32.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.326+0000 7f141cc00640 1 -- 172.21.15.3:0/3750747559 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1410003e40 con 0x7f1420102da0 2024-09-10T23:24:32.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.327+0000 7f1426e00640 1 -- 172.21.15.3:0/3750747559 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14201a1720 con 0x7f1420102da0 2024-09-10T23:24:32.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.327+0000 7f141cc00640 1 -- 172.21.15.3:0/3750747559 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1410035030 con 0x7f1420102da0 2024-09-10T23:24:32.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.327+0000 7f1426e00640 1 -- 172.21.15.3:0/3750747559 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14201a7e40 con 0x7f1420102da0 2024-09-10T23:24:32.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.328+0000 7f1426e00640 1 -- 172.21.15.3:0/3750747559 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1420103180 con 0x7f1420102da0 2024-09-10T23:24:32.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.330+0000 7f141cc00640 1 -- 172.21.15.3:0/3750747559 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7f1410031400 con 0x7f1420102da0 2024-09-10T23:24:32.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.331+0000 7f141cc00640 1 --2- 172.21.15.3:0/3750747559 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f14040b5330 0x7f14040b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:32.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.332+0000 7f141cc00640 1 -- 172.21.15.3:0/3750747559 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9286+0+0 (secure 0 0 0) 0x7f1410106f70 con 0x7f1420102da0 2024-09-10T23:24:32.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.332+0000 7f141f400640 1 --2- 172.21.15.3:0/3750747559 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f14040b5330 0x7f14040b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:32.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.333+0000 7f141f400640 1 --2- 172.21.15.3:0/3750747559 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f14040b5330 0x7f14040b77f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f14200ffce0 tx=0x7f140c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:32.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.334+0000 7f141cc00640 1 -- 172.21.15.3:0/3750747559 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f14100cd9b0 con 0x7f1420102da0 2024-09-10T23:24:32.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:32 smithi194 ceph-mon[33904]: pgmap v321: 129 pgs: 129 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3 B/s, 1 keys/s, 0 objects/s recovering 2024-09-10T23:24:32.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.542+0000 7f1426e00640 1 -- 172.21.15.3:0/3750747559 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f14201a80e0 con 0x7f1420102da0 2024-09-10T23:24:32.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.543+0000 7f141cc00640 1 -- 172.21.15.3:0/3750747559 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v88) ==== 81+0+869 (secure 0 0 0) 0x7f14100cd2b0 con 0x7f1420102da0 2024-09-10T23:24:32.545 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/776988825 2024-09-11T23:16:20.647314+0000 2024-09-10T23:24:32.545 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/2965090335 2024-09-11T23:14:37.169991+0000 2024-09-10T23:24:32.545 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/2364823868 2024-09-11T23:14:37.169991+0000 2024-09-10T23:24:32.545 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/3186881356 2024-09-11T23:14:37.169991+0000 2024-09-10T23:24:32.545 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/911991463 2024-09-11T23:16:20.647314+0000 2024-09-10T23:24:32.545 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6800/2582365069 2024-09-11T23:14:37.169991+0000 2024-09-10T23:24:32.545 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6801/2582365069 2024-09-11T23:14:37.169991+0000 2024-09-10T23:24:32.545 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6801/1528153492 2024-09-11T23:15:05.835734+0000 2024-09-10T23:24:32.545 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6800/1924113958 2024-09-11T23:16:20.647314+0000 2024-09-10T23:24:32.546 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/554479543 2024-09-11T23:15:05.835734+0000 2024-09-10T23:24:32.546 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/4238683346 2024-09-11T23:15:05.835734+0000 2024-09-10T23:24:32.546 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6800/1528153492 2024-09-11T23:15:05.835734+0000 2024-09-10T23:24:32.546 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/285471483 2024-09-11T23:15:05.835734+0000 2024-09-10T23:24:32.546 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/1249510760 2024-09-11T23:16:20.647314+0000 2024-09-10T23:24:32.546 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6801/1924113958 2024-09-11T23:16:20.647314+0000 2024-09-10T23:24:32.547 INFO:teuthology.orchestra.run.smithi003.stderr:listed 15 entries 2024-09-10T23:24:32.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.545+0000 7f1426e00640 1 -- 172.21.15.3:0/3750747559 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f14040b5330 msgr2=0x7f14040b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:32.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.545+0000 7f1426e00640 1 --2- 172.21.15.3:0/3750747559 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f14040b5330 0x7f14040b77f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f14200ffce0 tx=0x7f140c00b390 comp rx=0 tx=0).stop 2024-09-10T23:24:32.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.545+0000 7f1426e00640 1 -- 172.21.15.3:0/3750747559 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1420102da0 msgr2=0x7f142019b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:32.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.545+0000 7f1426e00640 1 --2- 172.21.15.3:0/3750747559 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1420102da0 0x7f142019b3e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f141002a920 tx=0x7f1410003c20 comp rx=0 tx=0).stop 2024-09-10T23:24:32.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.545+0000 7f1426e00640 1 -- 172.21.15.3:0/3750747559 shutdown_connections 2024-09-10T23:24:32.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.545+0000 7f1426e00640 1 --2- 172.21.15.3:0/3750747559 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1420109130 0x7f14201a0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.545+0000 7f1426e00640 1 --2- 172.21.15.3:0/3750747559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14201087b0 0x7f142019b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.545+0000 7f1426e00640 1 --2- 172.21.15.3:0/3750747559 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f14040b5330 0x7f14040b77f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.545+0000 7f1426e00640 1 --2- 172.21.15.3:0/3750747559 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1420102da0 0x7f142019b3e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:32.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.545+0000 7f1426e00640 1 -- 172.21.15.3:0/3750747559 >> 172.21.15.3:0/3750747559 conn(0x7f14200fe810 msgr2=0x7f14200fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:32.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.546+0000 7f1426e00640 1 -- 172.21.15.3:0/3750747559 shutdown_connections 2024-09-10T23:24:32.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:32.546+0000 7f1426e00640 1 -- 172.21.15.3:0/3750747559 wait complete. 2024-09-10T23:24:32.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:32 smithi038 ceph-mon[34225]: pgmap v321: 129 pgs: 129 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3 B/s, 1 keys/s, 0 objects/s recovering 2024-09-10T23:24:33.264 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi003.front.sepia.ceph.com... 2024-09-10T23:24:33.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:33.265 DEBUG:teuthology.orchestra.run.smithi003:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-10T23:24:33.320 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi003.stderr:ceph-fuse[79565]: fuse finished with error 0 and tester_r 0 2024-09-10T23:24:33.324 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:24:33.420 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:33 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3750747559' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T23:24:33.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:33 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3750747559' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T23:24:33.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:33 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3750747559' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T23:24:34.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:34 smithi194 ceph-mon[33904]: pgmap v322: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 379 B/s wr, 0 op/s; 3 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T23:24:34.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:34 smithi003 ceph-mon[30348]: pgmap v322: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 379 B/s wr, 0 op/s; 3 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T23:24:34.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:34 smithi038 ceph-mon[34225]: pgmap v322: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 379 B/s wr, 0 op/s; 3 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T23:24:36.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:36 smithi194 ceph-mon[33904]: pgmap v323: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T23:24:36.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:36 smithi003 ceph-mon[30348]: pgmap v323: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T23:24:36.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:36 smithi038 ceph-mon[34225]: pgmap v323: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T23:24:38.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:38 smithi194 ceph-mon[33904]: pgmap v324: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T23:24:38.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:38 smithi003 ceph-mon[30348]: pgmap v324: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T23:24:38.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:38 smithi038 ceph-mon[34225]: pgmap v324: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T23:24:39.425 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi003.front.sepia.ceph.com 2024-09-10T23:24:39.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:39.426 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-10T23:24:39.471 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:24:39.900 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:40.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:40 smithi003 ceph-mon[30348]: pgmap v325: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-10T23:24:40.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:40 smithi194 ceph-mon[33904]: pgmap v325: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-10T23:24:40.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.448+0000 7fcf65200640 1 -- 172.21.15.3:0/1219189687 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf60104df0 msgr2=0x7fcf601051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:40.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.448+0000 7fcf65200640 1 --2- 172.21.15.3:0/1219189687 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf60104df0 0x7fcf601051d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fcf50009900 tx=0x7fcf5002a410 comp rx=0 tx=0).stop 2024-09-10T23:24:40.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.448+0000 7fcf65200640 1 -- 172.21.15.3:0/1219189687 shutdown_connections 2024-09-10T23:24:40.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.448+0000 7fcf65200640 1 --2- 172.21.15.3:0/1219189687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf6010b180 0x7fcf60111980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:40.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.448+0000 7fcf65200640 1 --2- 172.21.15.3:0/1219189687 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf6010a800 0x7fcf6010ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:40.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.448+0000 7fcf65200640 1 --2- 172.21.15.3:0/1219189687 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf60104df0 0x7fcf601051d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:40.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.448+0000 7fcf65200640 1 -- 172.21.15.3:0/1219189687 >> 172.21.15.3:0/1219189687 conn(0x7fcf60100840 msgr2=0x7fcf60102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:40.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.448+0000 7fcf65200640 1 -- 172.21.15.3:0/1219189687 shutdown_connections 2024-09-10T23:24:40.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.448+0000 7fcf65200640 1 -- 172.21.15.3:0/1219189687 wait complete. 2024-09-10T23:24:40.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.449+0000 7fcf65200640 1 Processor -- start 2024-09-10T23:24:40.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.449+0000 7fcf65200640 1 -- start start 2024-09-10T23:24:40.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.449+0000 7fcf65200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf60104df0 0x7fcf6019b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:40.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.449+0000 7fcf65200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf6010a800 0x7fcf6019b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:40.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.449+0000 7fcf65200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf6010b180 0x7fcf601a0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:40.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.449+0000 7fcf65200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fcf60114d00 con 0x7fcf6010b180 2024-09-10T23:24:40.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.449+0000 7fcf65200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fcf60114b80 con 0x7fcf60104df0 2024-09-10T23:24:40.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.449+0000 7fcf65200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcf60114e80 con 0x7fcf6010a800 2024-09-10T23:24:40.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.450+0000 7fcf5fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf6010b180 0x7fcf601a0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:40.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.450+0000 7fcf5ea00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf6010a800 0x7fcf6019b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:40.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.450+0000 7fcf5f400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf60104df0 0x7fcf6019b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:40.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.450+0000 7fcf5fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf6010b180 0x7fcf601a0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41908/0 (socket says 172.21.15.3:41908) 2024-09-10T23:24:40.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.450+0000 7fcf5fe00640 1 -- 172.21.15.3:0/1517075847 learned_addr learned my addr 172.21.15.3:0/1517075847 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:24:40.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.450+0000 7fcf5fe00640 1 -- 172.21.15.3:0/1517075847 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf6010a800 msgr2=0x7fcf6019b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:40.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.450+0000 7fcf5fe00640 1 --2- 172.21.15.3:0/1517075847 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf6010a800 0x7fcf6019b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:40.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.450+0000 7fcf5fe00640 1 -- 172.21.15.3:0/1517075847 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf60104df0 msgr2=0x7fcf6019b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:40.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.450+0000 7fcf5fe00640 1 --2- 172.21.15.3:0/1517075847 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf60104df0 0x7fcf6019b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:40.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.450+0000 7fcf5fe00640 1 -- 172.21.15.3:0/1517075847 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf601a11d0 con 0x7fcf6010b180 2024-09-10T23:24:40.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.450+0000 7fcf5f400640 1 --2- 172.21.15.3:0/1517075847 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf60104df0 0x7fcf6019b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:24:40.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.451+0000 7fcf5fe00640 1 --2- 172.21.15.3:0/1517075847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf6010b180 0x7fcf601a0a00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcf5800eaa0 tx=0x7fcf5800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:40.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.451+0000 7fcf57e00640 1 -- 172.21.15.3:0/1517075847 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5800cdb0 con 0x7fcf6010b180 2024-09-10T23:24:40.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.451+0000 7fcf65200640 1 -- 172.21.15.3:0/1517075847 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf601a14c0 con 0x7fcf6010b180 2024-09-10T23:24:40.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.451+0000 7fcf57e00640 1 -- 172.21.15.3:0/1517075847 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf58005020 con 0x7fcf6010b180 2024-09-10T23:24:40.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.451+0000 7fcf57e00640 1 -- 172.21.15.3:0/1517075847 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf580116d0 con 0x7fcf6010b180 2024-09-10T23:24:40.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.451+0000 7fcf65200640 1 -- 172.21.15.3:0/1517075847 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf601a7b80 con 0x7fcf6010b180 2024-09-10T23:24:40.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.452+0000 7fcf65200640 1 -- 172.21.15.3:0/1517075847 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf601051d0 con 0x7fcf6010b180 2024-09-10T23:24:40.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.454+0000 7fcf57e00640 1 -- 172.21.15.3:0/1517075847 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7fcf5800f040 con 0x7fcf6010b180 2024-09-10T23:24:40.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.456+0000 7fcf57e00640 1 --2- 172.21.15.3:0/1517075847 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcf440b53e0 0x7fcf440b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:40.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.456+0000 7fcf57e00640 1 -- 172.21.15.3:0/1517075847 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9286+0+0 (secure 0 0 0) 0x7fcf580e5ef0 con 0x7fcf6010b180 2024-09-10T23:24:40.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.456+0000 7fcf5f400640 1 --2- 172.21.15.3:0/1517075847 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcf440b53e0 0x7fcf440b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:40.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.457+0000 7fcf5f400640 1 --2- 172.21.15.3:0/1517075847 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcf440b53e0 0x7fcf440b78a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcf50006010 tx=0x7fcf50000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:40.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.460+0000 7fcf57e00640 1 -- 172.21.15.3:0/1517075847 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcf58016030 con 0x7fcf6010b180 2024-09-10T23:24:40.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:40 smithi038 ceph-mon[34225]: pgmap v325: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-10T23:24:40.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.655+0000 7fcf65200640 1 -- 172.21.15.3:0/1517075847 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcf6010c9d0 con 0x7fcf6010b180 2024-09-10T23:24:40.760 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.657+0000 7fcf57e00640 1 -- 172.21.15.3:0/1517075847 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24924 (secure 0 0 0) 0x7fcf580ac2e0 con 0x7fcf6010b180 2024-09-10T23:24:40.760 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:24:40.761 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":88,"fsid":"3f4e30d0-6fca-11ef-bcea-c7b262605968","created":"2024-09-10T23:14:12.377466+0000","modified":"2024-09-10T23:24:21.960046+0000","last_up_change":"2024-09-10T23:22:54.895554+0000","last_in_change":"2024-09-10T23:22:29.701108+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:18:27.131879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:23:53.689954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:23:55.864693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:24:03.869094+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a38330ed-a85b-4e61-b373-dd8f1d5f7ba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6803","nonce":824467747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6805","nonce":824467747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6809","nonce":824467747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6807","nonce":824467747}]},"public_addr":"172.21.15.3:6803/824467747","cluster_addr":"172.21.15.3:6805/824467747","heartbeat_back_addr":"172.21.15.3:6809/824467747","heartbeat_front_addr":"172.21.15.3:6807/824467747","state":["exists","up"]},{"osd":1,"uuid":"49bb1212-a83e-4f85-ad71-d863880d8268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6801","nonce":1447444485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6803","nonce":1447444485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6807","nonce":1447444485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6805","nonce":1447444485}]},"public_addr":"172.21.15.38:6801/1447444485","cluster_addr":"172.21.15.38:6803/1447444485","heartbeat_back_addr":"172.21.15.38:6807/1447444485","heartbeat_front_addr":"172.21.15.38:6805/1447444485","state":["exists","up"]},{"osd":2,"uuid":"ea53eb27-e7fa-4783-9a53-8b44b4e293ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6801","nonce":3191263316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6803","nonce":3191263316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6807","nonce":3191263316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6805","nonce":3191263316}]},"public_addr":"172.21.15.194:6801/3191263316","cluster_addr":"172.21.15.194:6803/3191263316","heartbeat_back_addr":"172.21.15.194:6807/3191263316","heartbeat_front_addr":"172.21.15.194:6805/3191263316","state":["exists","up"]},{"osd":3,"uuid":"75067769-7be5-4a99-9e02-f7735b2e69c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6811","nonce":2061990952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6813","nonce":2061990952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6817","nonce":2061990952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6815","nonce":2061990952}]},"public_addr":"172.21.15.3:6811/2061990952","cluster_addr":"172.21.15.3:6813/2061990952","heartbeat_back_addr":"172.21.15.3:6817/2061990952","heartbeat_front_addr":"172.21.15.3:6815/2061990952","state":["exists","up"]},{"osd":4,"uuid":"872e90ca-b711-4206-b586-e7fa41122199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6809","nonce":413294160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6811","nonce":413294160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6815","nonce":413294160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6813","nonce":413294160}]},"public_addr":"172.21.15.38:6809/413294160","cluster_addr":"172.21.15.38:6811/413294160","heartbeat_back_addr":"172.21.15.38:6815/413294160","heartbeat_front_addr":"172.21.15.38:6813/413294160","state":["exists","up"]},{"osd":5,"uuid":"2cfa107c-6dae-4c26-9e29-8175b1237b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6809","nonce":4117812658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6811","nonce":4117812658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6815","nonce":4117812658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6813","nonce":4117812658}]},"public_addr":"172.21.15.194:6809/4117812658","cluster_addr":"172.21.15.194:6811/4117812658","heartbeat_back_addr":"172.21.15.194:6815/4117812658","heartbeat_front_addr":"172.21.15.194:6813/4117812658","state":["exists","up"]},{"osd":6,"uuid":"d2e4e309-c587-4725-a5b3-cbc7b1226750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6819","nonce":3470543721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6821","nonce":3470543721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6825","nonce":3470543721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6823","nonce":3470543721}]},"public_addr":"172.21.15.3:6819/3470543721","cluster_addr":"172.21.15.3:6821/3470543721","heartbeat_back_addr":"172.21.15.3:6825/3470543721","heartbeat_front_addr":"172.21.15.3:6823/3470543721","state":["exists","up"]},{"osd":7,"uuid":"46ecaec5-29da-4e1d-ac2f-42bbbd77e949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6817","nonce":2054203924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6819","nonce":2054203924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6823","nonce":2054203924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6821","nonce":2054203924}]},"public_addr":"172.21.15.38:6817/2054203924","cluster_addr":"172.21.15.38:6819/2054203924","heartbeat_back_addr":"172.21.15.38:6823/2054203924","heartbeat_front_addr":"172.21.15.38:6821/2054203924","state":["exists","up"]},{"osd":8,"uuid":"57fd8e43-9612-4f74-8eb2-8bdbbf7c0417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6817","nonce":170051722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6819","nonce":170051722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6823","nonce":170051722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6821","nonce":170051722}]},"public_addr":"172.21.15.194:6817/170051722","cluster_addr":"172.21.15.194:6819/170051722","heartbeat_back_addr":"172.21.15.194:6823/170051722","heartbeat_front_addr":"172.21.15.194:6821/170051722","state":["exists","up"]},{"osd":9,"uuid":"aeaaf23b-d2e2-4e30-9a49-de4aaba53900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6827","nonce":3967749600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6829","nonce":3967749600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6833","nonce":3967749600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6831","nonce":3967749600}]},"public_addr":"172.21.15.3:6827/3967749600","cluster_addr":"172.21.15.3:6829/3967749600","heartbeat_back_addr":"172.21.15.3:6833/3967749600","heartbeat_front_addr":"172.21.15.3:6831/3967749600","state":["exists","up"]},{"osd":10,"uuid":"b0ece81b-1c5b-40da-b579-fb99bacb005d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6825","nonce":1671957178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6827","nonce":1671957178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6831","nonce":1671957178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6829","nonce":1671957178}]},"public_addr":"172.21.15.38:6825/1671957178","cluster_addr":"172.21.15.38:6827/1671957178","heartbeat_back_addr":"172.21.15.38:6831/1671957178","heartbeat_front_addr":"172.21.15.38:6829/1671957178","state":["exists","up"]},{"osd":11,"uuid":"a0036526-54bf-4e8b-95cc-e7b75725961c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6825","nonce":1048859686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6827","nonce":1048859686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6831","nonce":1048859686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6829","nonce":1048859686}]},"public_addr":"172.21.15.194:6825/1048859686","cluster_addr":"172.21.15.194:6827/1048859686","heartbeat_back_addr":"172.21.15.194:6831/1048859686","heartbeat_front_addr":"172.21.15.194:6829/1048859686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:27.013354+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:56.609046+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:24.878988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:55.218204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:25.224770+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:54.614336+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:25.385483+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:55.317137+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:25.064825+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:54.655361+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:22:24.080027+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:22:52.886412+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":4,"to":6},{"from":5,"to":9}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.3:0/776988825":"2024-09-11T23:16:20.647314+0000","172.21.15.3:0/2965090335":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/2364823868":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/3186881356":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/911991463":"2024-09-11T23:16:20.647314+0000","172.21.15.3:6800/2582365069":"2024-09-11T23:14:37.169991+0000","172.21.15.3:6801/2582365069":"2024-09-11T23:14:37.169991+0000","172.21.15.3:6801/1528153492":"2024-09-11T23:15:05.835734+0000","172.21.15.3:6800/1924113958":"2024-09-11T23:16:20.647314+0000","172.21.15.3:0/554479543":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/4238683346":"2024-09-11T23:15:05.835734+0000","172.21.15.3:6800/1528153492":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/285471483":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/1249510760":"2024-09-11T23:16:20.647314+0000","172.21.15.3:6801/1924113958":"2024-09-11T23:16:20.647314+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:24:40.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.659+0000 7fcf65200640 1 -- 172.21.15.3:0/1517075847 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcf440b53e0 msgr2=0x7fcf440b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:40.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.659+0000 7fcf65200640 1 --2- 172.21.15.3:0/1517075847 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcf440b53e0 0x7fcf440b78a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcf50006010 tx=0x7fcf50000bc0 comp rx=0 tx=0).stop 2024-09-10T23:24:40.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.659+0000 7fcf65200640 1 -- 172.21.15.3:0/1517075847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf6010b180 msgr2=0x7fcf601a0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:40.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.659+0000 7fcf65200640 1 --2- 172.21.15.3:0/1517075847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf6010b180 0x7fcf601a0a00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcf5800eaa0 tx=0x7fcf5800ef60 comp rx=0 tx=0).stop 2024-09-10T23:24:40.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.659+0000 7fcf65200640 1 -- 172.21.15.3:0/1517075847 shutdown_connections 2024-09-10T23:24:40.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.659+0000 7fcf65200640 1 --2- 172.21.15.3:0/1517075847 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcf440b53e0 0x7fcf440b78a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:40.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.660+0000 7fcf65200640 1 --2- 172.21.15.3:0/1517075847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf6010b180 0x7fcf601a0a00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:40.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.660+0000 7fcf65200640 1 --2- 172.21.15.3:0/1517075847 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf6010a800 0x7fcf6019b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:40.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.660+0000 7fcf65200640 1 --2- 172.21.15.3:0/1517075847 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf60104df0 0x7fcf6019b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:40.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.660+0000 7fcf65200640 1 -- 172.21.15.3:0/1517075847 >> 172.21.15.3:0/1517075847 conn(0x7fcf60100840 msgr2=0x7fcf60102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:40.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.660+0000 7fcf65200640 1 -- 172.21.15.3:0/1517075847 shutdown_connections 2024-09-10T23:24:40.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:40.660+0000 7fcf65200640 1 -- 172.21.15.3:0/1517075847 wait complete. 2024-09-10T23:24:41.289 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:41 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1517075847' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:24:41.328 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:24:41.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:41 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/1517075847' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:24:41.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:41 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/1517075847' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:24:41.709 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:42.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.331+0000 7ff9bc600640 1 -- 172.21.15.3:0/1555817228 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff9b4102dc0 msgr2=0x7ff9b41031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:42.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.331+0000 7ff9bc600640 1 --2- 172.21.15.3:0/1555817228 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff9b4102dc0 0x7ff9b41031a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8009900 tx=0x7ff9a802a410 comp rx=0 tx=0).stop 2024-09-10T23:24:42.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.331+0000 7ff9bc600640 1 -- 172.21.15.3:0/1555817228 shutdown_connections 2024-09-10T23:24:42.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.331+0000 7ff9bc600640 1 --2- 172.21.15.3:0/1555817228 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9b4109150 0x7ff9b410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:42.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.331+0000 7ff9bc600640 1 --2- 172.21.15.3:0/1555817228 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9b41087d0 0x7ff9b4108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:42.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.331+0000 7ff9bc600640 1 --2- 172.21.15.3:0/1555817228 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff9b4102dc0 0x7ff9b41031a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:42.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.331+0000 7ff9bc600640 1 -- 172.21.15.3:0/1555817228 >> 172.21.15.3:0/1555817228 conn(0x7ff9b40fe830 msgr2=0x7ff9b4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:42.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.331+0000 7ff9bc600640 1 -- 172.21.15.3:0/1555817228 shutdown_connections 2024-09-10T23:24:42.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.331+0000 7ff9bc600640 1 -- 172.21.15.3:0/1555817228 wait complete. 2024-09-10T23:24:42.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.332+0000 7ff9bc600640 1 Processor -- start 2024-09-10T23:24:42.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.332+0000 7ff9bc600640 1 -- start start 2024-09-10T23:24:42.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.332+0000 7ff9bc600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9b4102dc0 0x7ff9b4076f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:42.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.332+0000 7ff9bc600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9b41087d0 0x7ff9b40754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:42.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.332+0000 7ff9bc600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff9b4109150 0x7ff9b4075ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:42.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.332+0000 7ff9bc600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b4112cc0 con 0x7ff9b4109150 2024-09-10T23:24:42.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.332+0000 7ff9bc600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b4112b40 con 0x7ff9b41087d0 2024-09-10T23:24:42.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.332+0000 7ff9bc600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b4112e40 con 0x7ff9b4102dc0 2024-09-10T23:24:42.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.333+0000 7ff9ba600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff9b4109150 0x7ff9b4075ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:42.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.333+0000 7ff9ba600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff9b4109150 0x7ff9b4075ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50380/0 (socket says 172.21.15.3:50380) 2024-09-10T23:24:42.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.333+0000 7ff9ba600640 1 -- 172.21.15.3:0/889669271 learned_addr learned my addr 172.21.15.3:0/889669271 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:24:42.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.333+0000 7ff9b9c00640 1 --2- 172.21.15.3:0/889669271 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9b4102dc0 0x7ff9b4076f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:42.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.333+0000 7ff9b9200640 1 --2- 172.21.15.3:0/889669271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9b41087d0 0x7ff9b40754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:42.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.333+0000 7ff9ba600640 1 -- 172.21.15.3:0/889669271 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9b4102dc0 msgr2=0x7ff9b4076f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:42.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.333+0000 7ff9ba600640 1 --2- 172.21.15.3:0/889669271 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9b4102dc0 0x7ff9b4076f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:42.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.333+0000 7ff9ba600640 1 -- 172.21.15.3:0/889669271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9b41087d0 msgr2=0x7ff9b40754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:42.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.333+0000 7ff9ba600640 1 --2- 172.21.15.3:0/889669271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9b41087d0 0x7ff9b40754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:42.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.333+0000 7ff9ba600640 1 -- 172.21.15.3:0/889669271 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b41abb10 con 0x7ff9b4109150 2024-09-10T23:24:42.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.333+0000 7ff9b9200640 1 --2- 172.21.15.3:0/889669271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9b41087d0 0x7ff9b40754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:42.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.334+0000 7ff9ba600640 1 --2- 172.21.15.3:0/889669271 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff9b4109150 0x7ff9b4075ad0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac00eaa0 tx=0x7ff9ac00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:42.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.334+0000 7ff9b2000640 1 -- 172.21.15.3:0/889669271 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac00cdb0 con 0x7ff9b4109150 2024-09-10T23:24:42.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.334+0000 7ff9b2000640 1 -- 172.21.15.3:0/889669271 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff9ac005020 con 0x7ff9b4109150 2024-09-10T23:24:42.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.334+0000 7ff9bc600640 1 -- 172.21.15.3:0/889669271 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9b41abce0 con 0x7ff9b4109150 2024-09-10T23:24:42.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.334+0000 7ff9b2000640 1 -- 172.21.15.3:0/889669271 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac0116d0 con 0x7ff9b4109150 2024-09-10T23:24:42.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.334+0000 7ff9bc600640 1 -- 172.21.15.3:0/889669271 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9b41ac1a0 con 0x7ff9b4109150 2024-09-10T23:24:42.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.335+0000 7ff9bc600640 1 -- 172.21.15.3:0/889669271 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9b41031a0 con 0x7ff9b4109150 2024-09-10T23:24:42.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.337+0000 7ff9b2000640 1 -- 172.21.15.3:0/889669271 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7ff9ac00f040 con 0x7ff9b4109150 2024-09-10T23:24:42.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.339+0000 7ff9b2000640 1 --2- 172.21.15.3:0/889669271 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff99c0b5330 0x7ff99c0b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:42.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.339+0000 7ff9b2000640 1 -- 172.21.15.3:0/889669271 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9286+0+0 (secure 0 0 0) 0x7ff9ac0e6280 con 0x7ff9b4109150 2024-09-10T23:24:42.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.339+0000 7ff9b9c00640 1 --2- 172.21.15.3:0/889669271 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff99c0b5330 0x7ff99c0b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:42.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.340+0000 7ff9b9c00640 1 --2- 172.21.15.3:0/889669271 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff99c0b5330 0x7ff99c0b77f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff9a80057c0 tx=0x7ff9a80058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:42.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.340+0000 7ff9b2000640 1 -- 172.21.15.3:0/889669271 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff9ac016030 con 0x7ff9b4109150 2024-09-10T23:24:42.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:42 smithi194 ceph-mon[33904]: pgmap v326: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-10T23:24:42.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:42 smithi003 ceph-mon[30348]: pgmap v326: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-10T23:24:42.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.536+0000 7ff9bc600640 1 -- 172.21.15.3:0/889669271 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff9b402e5c0 con 0x7ff9b4109150 2024-09-10T23:24:42.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.538+0000 7ff9b2000640 1 -- 172.21.15.3:0/889669271 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24924 (secure 0 0 0) 0x7ff9ac0accc0 con 0x7ff9b4109150 2024-09-10T23:24:42.539 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:24:42.539 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":88,"fsid":"3f4e30d0-6fca-11ef-bcea-c7b262605968","created":"2024-09-10T23:14:12.377466+0000","modified":"2024-09-10T23:24:21.960046+0000","last_up_change":"2024-09-10T23:22:54.895554+0000","last_in_change":"2024-09-10T23:22:29.701108+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:18:27.131879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:23:53.689954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:23:55.864693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:24:03.869094+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a38330ed-a85b-4e61-b373-dd8f1d5f7ba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6803","nonce":824467747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6805","nonce":824467747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6809","nonce":824467747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6807","nonce":824467747}]},"public_addr":"172.21.15.3:6803/824467747","cluster_addr":"172.21.15.3:6805/824467747","heartbeat_back_addr":"172.21.15.3:6809/824467747","heartbeat_front_addr":"172.21.15.3:6807/824467747","state":["exists","up"]},{"osd":1,"uuid":"49bb1212-a83e-4f85-ad71-d863880d8268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6801","nonce":1447444485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6803","nonce":1447444485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6807","nonce":1447444485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6805","nonce":1447444485}]},"public_addr":"172.21.15.38:6801/1447444485","cluster_addr":"172.21.15.38:6803/1447444485","heartbeat_back_addr":"172.21.15.38:6807/1447444485","heartbeat_front_addr":"172.21.15.38:6805/1447444485","state":["exists","up"]},{"osd":2,"uuid":"ea53eb27-e7fa-4783-9a53-8b44b4e293ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6801","nonce":3191263316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6803","nonce":3191263316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6807","nonce":3191263316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6805","nonce":3191263316}]},"public_addr":"172.21.15.194:6801/3191263316","cluster_addr":"172.21.15.194:6803/3191263316","heartbeat_back_addr":"172.21.15.194:6807/3191263316","heartbeat_front_addr":"172.21.15.194:6805/3191263316","state":["exists","up"]},{"osd":3,"uuid":"75067769-7be5-4a99-9e02-f7735b2e69c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6811","nonce":2061990952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6813","nonce":2061990952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6817","nonce":2061990952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6815","nonce":2061990952}]},"public_addr":"172.21.15.3:6811/2061990952","cluster_addr":"172.21.15.3:6813/2061990952","heartbeat_back_addr":"172.21.15.3:6817/2061990952","heartbeat_front_addr":"172.21.15.3:6815/2061990952","state":["exists","up"]},{"osd":4,"uuid":"872e90ca-b711-4206-b586-e7fa41122199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6809","nonce":413294160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6811","nonce":413294160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6815","nonce":413294160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6813","nonce":413294160}]},"public_addr":"172.21.15.38:6809/413294160","cluster_addr":"172.21.15.38:6811/413294160","heartbeat_back_addr":"172.21.15.38:6815/413294160","heartbeat_front_addr":"172.21.15.38:6813/413294160","state":["exists","up"]},{"osd":5,"uuid":"2cfa107c-6dae-4c26-9e29-8175b1237b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6809","nonce":4117812658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6811","nonce":4117812658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6815","nonce":4117812658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6813","nonce":4117812658}]},"public_addr":"172.21.15.194:6809/4117812658","cluster_addr":"172.21.15.194:6811/4117812658","heartbeat_back_addr":"172.21.15.194:6815/4117812658","heartbeat_front_addr":"172.21.15.194:6813/4117812658","state":["exists","up"]},{"osd":6,"uuid":"d2e4e309-c587-4725-a5b3-cbc7b1226750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6819","nonce":3470543721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6821","nonce":3470543721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6825","nonce":3470543721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6823","nonce":3470543721}]},"public_addr":"172.21.15.3:6819/3470543721","cluster_addr":"172.21.15.3:6821/3470543721","heartbeat_back_addr":"172.21.15.3:6825/3470543721","heartbeat_front_addr":"172.21.15.3:6823/3470543721","state":["exists","up"]},{"osd":7,"uuid":"46ecaec5-29da-4e1d-ac2f-42bbbd77e949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6817","nonce":2054203924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6819","nonce":2054203924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6823","nonce":2054203924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6821","nonce":2054203924}]},"public_addr":"172.21.15.38:6817/2054203924","cluster_addr":"172.21.15.38:6819/2054203924","heartbeat_back_addr":"172.21.15.38:6823/2054203924","heartbeat_front_addr":"172.21.15.38:6821/2054203924","state":["exists","up"]},{"osd":8,"uuid":"57fd8e43-9612-4f74-8eb2-8bdbbf7c0417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6817","nonce":170051722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6819","nonce":170051722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6823","nonce":170051722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6821","nonce":170051722}]},"public_addr":"172.21.15.194:6817/170051722","cluster_addr":"172.21.15.194:6819/170051722","heartbeat_back_addr":"172.21.15.194:6823/170051722","heartbeat_front_addr":"172.21.15.194:6821/170051722","state":["exists","up"]},{"osd":9,"uuid":"aeaaf23b-d2e2-4e30-9a49-de4aaba53900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6827","nonce":3967749600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6829","nonce":3967749600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6833","nonce":3967749600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6831","nonce":3967749600}]},"public_addr":"172.21.15.3:6827/3967749600","cluster_addr":"172.21.15.3:6829/3967749600","heartbeat_back_addr":"172.21.15.3:6833/3967749600","heartbeat_front_addr":"172.21.15.3:6831/3967749600","state":["exists","up"]},{"osd":10,"uuid":"b0ece81b-1c5b-40da-b579-fb99bacb005d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6825","nonce":1671957178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6827","nonce":1671957178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6831","nonce":1671957178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6829","nonce":1671957178}]},"public_addr":"172.21.15.38:6825/1671957178","cluster_addr":"172.21.15.38:6827/1671957178","heartbeat_back_addr":"172.21.15.38:6831/1671957178","heartbeat_front_addr":"172.21.15.38:6829/1671957178","state":["exists","up"]},{"osd":11,"uuid":"a0036526-54bf-4e8b-95cc-e7b75725961c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6825","nonce":1048859686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6827","nonce":1048859686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6831","nonce":1048859686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6829","nonce":1048859686}]},"public_addr":"172.21.15.194:6825/1048859686","cluster_addr":"172.21.15.194:6827/1048859686","heartbeat_back_addr":"172.21.15.194:6831/1048859686","heartbeat_front_addr":"172.21.15.194:6829/1048859686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:27.013354+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:56.609046+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:24.878988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:55.218204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:25.224770+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:54.614336+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:25.385483+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:55.317137+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:25.064825+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:54.655361+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:22:24.080027+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:22:52.886412+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":4,"to":6},{"from":5,"to":9}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.3:0/776988825":"2024-09-11T23:16:20.647314+0000","172.21.15.3:0/2965090335":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/2364823868":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/3186881356":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/911991463":"2024-09-11T23:16:20.647314+0000","172.21.15.3:6800/2582365069":"2024-09-11T23:14:37.169991+0000","172.21.15.3:6801/2582365069":"2024-09-11T23:14:37.169991+0000","172.21.15.3:6801/1528153492":"2024-09-11T23:15:05.835734+0000","172.21.15.3:6800/1924113958":"2024-09-11T23:16:20.647314+0000","172.21.15.3:0/554479543":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/4238683346":"2024-09-11T23:15:05.835734+0000","172.21.15.3:6800/1528153492":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/285471483":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/1249510760":"2024-09-11T23:16:20.647314+0000","172.21.15.3:6801/1924113958":"2024-09-11T23:16:20.647314+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:24:42.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.540+0000 7ff9bc600640 1 -- 172.21.15.3:0/889669271 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff99c0b5330 msgr2=0x7ff99c0b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:42.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.540+0000 7ff9bc600640 1 --2- 172.21.15.3:0/889669271 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff99c0b5330 0x7ff99c0b77f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff9a80057c0 tx=0x7ff9a80058d0 comp rx=0 tx=0).stop 2024-09-10T23:24:42.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.540+0000 7ff9bc600640 1 -- 172.21.15.3:0/889669271 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff9b4109150 msgr2=0x7ff9b4075ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:42.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.540+0000 7ff9bc600640 1 --2- 172.21.15.3:0/889669271 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff9b4109150 0x7ff9b4075ad0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac00eaa0 tx=0x7ff9ac00ef60 comp rx=0 tx=0).stop 2024-09-10T23:24:42.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.540+0000 7ff9bc600640 1 -- 172.21.15.3:0/889669271 shutdown_connections 2024-09-10T23:24:42.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.540+0000 7ff9bc600640 1 --2- 172.21.15.3:0/889669271 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff99c0b5330 0x7ff99c0b77f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:42.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.540+0000 7ff9bc600640 1 --2- 172.21.15.3:0/889669271 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff9b4109150 0x7ff9b4075ad0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:42.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.540+0000 7ff9bc600640 1 --2- 172.21.15.3:0/889669271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9b41087d0 0x7ff9b40754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:42.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.540+0000 7ff9bc600640 1 --2- 172.21.15.3:0/889669271 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9b4102dc0 0x7ff9b4076f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:42.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.540+0000 7ff9bc600640 1 -- 172.21.15.3:0/889669271 >> 172.21.15.3:0/889669271 conn(0x7ff9b40fe830 msgr2=0x7ff9b4100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:42.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.540+0000 7ff9bc600640 1 -- 172.21.15.3:0/889669271 shutdown_connections 2024-09-10T23:24:42.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:42.540+0000 7ff9bc600640 1 -- 172.21.15.3:0/889669271 wait complete. 2024-09-10T23:24:42.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:42 smithi038 ceph-mon[34225]: pgmap v326: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-10T23:24:43.305 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-10T23:24:43.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:43 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/889669271' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:24:43.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:43 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/889669271' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:24:43.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:43 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/889669271' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:24:43.685 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:44.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.242+0000 7fb3dc400640 1 -- 172.21.15.3:0/3194177633 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb3d41087b0 msgr2=0x7fb3d4108bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:44.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.242+0000 7fb3dc400640 1 --2- 172.21.15.3:0/3194177633 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb3d41087b0 0x7fb3d4108bf0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0009900 tx=0x7fb3c002a410 comp rx=0 tx=0).stop 2024-09-10T23:24:44.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.242+0000 7fb3dc400640 1 -- 172.21.15.3:0/3194177633 shutdown_connections 2024-09-10T23:24:44.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.242+0000 7fb3dc400640 1 --2- 172.21.15.3:0/3194177633 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3d4109130 0x7fb3d410f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:44.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.242+0000 7fb3dc400640 1 --2- 172.21.15.3:0/3194177633 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb3d41087b0 0x7fb3d4108bf0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:44.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.242+0000 7fb3dc400640 1 --2- 172.21.15.3:0/3194177633 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3d4102da0 0x7fb3d4103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:44.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.242+0000 7fb3dc400640 1 -- 172.21.15.3:0/3194177633 >> 172.21.15.3:0/3194177633 conn(0x7fb3d40fe810 msgr2=0x7fb3d4100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:44.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.243+0000 7fb3dc400640 1 -- 172.21.15.3:0/3194177633 shutdown_connections 2024-09-10T23:24:44.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.243+0000 7fb3dc400640 1 -- 172.21.15.3:0/3194177633 wait complete. 2024-09-10T23:24:44.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.244+0000 7fb3dc400640 1 Processor -- start 2024-09-10T23:24:44.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.244+0000 7fb3dc400640 1 -- start start 2024-09-10T23:24:44.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.244+0000 7fb3dc400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3d4102da0 0x7fb3d40754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:44.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.244+0000 7fb3dc400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3d41087b0 0x7fb3d40759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:44.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.244+0000 7fb3dc400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb3d4109130 0x7fb3d4075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:44.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.244+0000 7fb3dc400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d4112cf0 con 0x7fb3d4109130 2024-09-10T23:24:44.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.244+0000 7fb3dc400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d4112b70 con 0x7fb3d4102da0 2024-09-10T23:24:44.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.244+0000 7fb3dc400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d4112e70 con 0x7fb3d41087b0 2024-09-10T23:24:44.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.245+0000 7fb3da400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb3d4109130 0x7fb3d4075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:44.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.245+0000 7fb3da400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb3d4109130 0x7fb3d4075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50402/0 (socket says 172.21.15.3:50402) 2024-09-10T23:24:44.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.245+0000 7fb3da400640 1 -- 172.21.15.3:0/3095486971 learned_addr learned my addr 172.21.15.3:0/3095486971 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:24:44.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.245+0000 7fb3d9a00640 1 --2- 172.21.15.3:0/3095486971 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3d4102da0 0x7fb3d40754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:44.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.245+0000 7fb3d9000640 1 --2- 172.21.15.3:0/3095486971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3d41087b0 0x7fb3d40759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:44.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.245+0000 7fb3da400640 1 -- 172.21.15.3:0/3095486971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3d41087b0 msgr2=0x7fb3d40759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:44.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.245+0000 7fb3da400640 1 --2- 172.21.15.3:0/3095486971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3d41087b0 0x7fb3d40759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:44.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.245+0000 7fb3da400640 1 -- 172.21.15.3:0/3095486971 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3d4102da0 msgr2=0x7fb3d40754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:44.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.245+0000 7fb3da400640 1 --2- 172.21.15.3:0/3095486971 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3d4102da0 0x7fb3d40754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:44.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.245+0000 7fb3da400640 1 -- 172.21.15.3:0/3095486971 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3d41a75c0 con 0x7fb3d4109130 2024-09-10T23:24:44.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.246+0000 7fb3da400640 1 --2- 172.21.15.3:0/3095486971 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb3d4109130 0x7fb3d4075f20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc009fd0 tx=0x7fb3cc00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:44.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.246+0000 7fb3d2000640 1 -- 172.21.15.3:0/3095486971 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc017070 con 0x7fb3d4109130 2024-09-10T23:24:44.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.246+0000 7fb3d2000640 1 -- 172.21.15.3:0/3095486971 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb3cc003e00 con 0x7fb3d4109130 2024-09-10T23:24:44.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.246+0000 7fb3dc400640 1 -- 172.21.15.3:0/3095486971 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3d41a78b0 con 0x7fb3d4109130 2024-09-10T23:24:44.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.246+0000 7fb3d2000640 1 -- 172.21.15.3:0/3095486971 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc010460 con 0x7fb3d4109130 2024-09-10T23:24:44.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.246+0000 7fb3dc400640 1 -- 172.21.15.3:0/3095486971 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3d41a7dc0 con 0x7fb3d4109130 2024-09-10T23:24:44.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.247+0000 7fb3dc400640 1 -- 172.21.15.3:0/3095486971 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3d4103180 con 0x7fb3d4109130 2024-09-10T23:24:44.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.249+0000 7fb3d2000640 1 -- 172.21.15.3:0/3095486971 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7fb3cc003970 con 0x7fb3d4109130 2024-09-10T23:24:44.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.251+0000 7fb3d2000640 1 --2- 172.21.15.3:0/3095486971 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb3bc0b53b0 0x7fb3bc0b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:44.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.252+0000 7fb3d2000640 1 -- 172.21.15.3:0/3095486971 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9286+0+0 (secure 0 0 0) 0x7fb3cc0e61b0 con 0x7fb3d4109130 2024-09-10T23:24:44.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.252+0000 7fb3d9a00640 1 --2- 172.21.15.3:0/3095486971 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb3bc0b53b0 0x7fb3bc0b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:44.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.253+0000 7fb3d9a00640 1 --2- 172.21.15.3:0/3095486971 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb3bc0b53b0 0x7fb3bc0b7870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb3c8005fd0 tx=0x7fb3c800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:44.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.256+0000 7fb3d2000640 1 -- 172.21.15.3:0/3095486971 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb3cc0acbf0 con 0x7fb3d4109130 2024-09-10T23:24:44.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:44 smithi194 ceph-mon[33904]: pgmap v327: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-10T23:24:44.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:44 smithi003 ceph-mon[30348]: pgmap v327: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-10T23:24:44.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:44.491+0000 7fb3dc400640 1 -- 172.21.15.3:0/3095486971 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb3d402e5c0 con 0x7fb3d4109130 2024-09-10T23:24:44.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:44 smithi038 ceph-mon[34225]: pgmap v327: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-10T23:24:45.199 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:45.198+0000 7fb3d2000640 1 -- 172.21.15.3:0/3095486971 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7fb3cc0ac4f0 con 0x7fb3d4109130 2024-09-10T23:24:45.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:45.202+0000 7fb3dc400640 1 -- 172.21.15.3:0/3095486971 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb3bc0b53b0 msgr2=0x7fb3bc0b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:45.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:45.202+0000 7fb3dc400640 1 --2- 172.21.15.3:0/3095486971 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb3bc0b53b0 0x7fb3bc0b7870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb3c8005fd0 tx=0x7fb3c800b390 comp rx=0 tx=0).stop 2024-09-10T23:24:45.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:45.202+0000 7fb3dc400640 1 -- 172.21.15.3:0/3095486971 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb3d4109130 msgr2=0x7fb3d4075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:45.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:45.202+0000 7fb3dc400640 1 --2- 172.21.15.3:0/3095486971 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb3d4109130 0x7fb3d4075f20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc009fd0 tx=0x7fb3cc00b260 comp rx=0 tx=0).stop 2024-09-10T23:24:45.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:45.202+0000 7fb3dc400640 1 -- 172.21.15.3:0/3095486971 shutdown_connections 2024-09-10T23:24:45.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:45.202+0000 7fb3dc400640 1 --2- 172.21.15.3:0/3095486971 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb3bc0b53b0 0x7fb3bc0b7870 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:45.202+0000 7fb3dc400640 1 --2- 172.21.15.3:0/3095486971 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb3d4109130 0x7fb3d4075f20 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:45.202+0000 7fb3dc400640 1 --2- 172.21.15.3:0/3095486971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3d41087b0 0x7fb3d40759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:45.202+0000 7fb3dc400640 1 --2- 172.21.15.3:0/3095486971 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3d4102da0 0x7fb3d40754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:45.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:45.202+0000 7fb3dc400640 1 -- 172.21.15.3:0/3095486971 >> 172.21.15.3:0/3095486971 conn(0x7fb3d40fe810 msgr2=0x7fb3d4100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:45.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:45.203+0000 7fb3dc400640 1 -- 172.21.15.3:0/3095486971 shutdown_connections 2024-09-10T23:24:45.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:45.203+0000 7fb3dc400640 1 -- 172.21.15.3:0/3095486971 wait complete. 2024-09-10T23:24:45.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:45 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3095486971' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-10T23:24:45.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:45 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3095486971' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-10T23:24:45.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:45 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3095486971' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-10T23:24:45.944 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-09-10T23:24:45.944 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-09-10T23:24:46.328 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:46.467 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:46 smithi003 ceph-mon[30348]: pgmap v328: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-10T23:24:46.467 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:46 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3095486971' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T23:24:46.467 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:46 smithi003 ceph-mon[30348]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T23:24:46.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:46 smithi038 ceph-mon[34225]: pgmap v328: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-10T23:24:46.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:46 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3095486971' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T23:24:46.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:46 smithi038 ceph-mon[34225]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T23:24:46.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:46 smithi194 ceph-mon[33904]: pgmap v328: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-10T23:24:46.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:46 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3095486971' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T23:24:46.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:46 smithi194 ceph-mon[33904]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T23:24:46.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.919+0000 7f00dbe00640 1 -- 172.21.15.3:0/4202236583 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f00dc10a820 msgr2=0x7f00dc10ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:46.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.919+0000 7f00dbe00640 1 --2- 172.21.15.3:0/4202236583 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f00dc10a820 0x7f00dc10ac60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f00c8009900 tx=0x7f00c802a410 comp rx=0 tx=0).stop 2024-09-10T23:24:46.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.919+0000 7f00dbe00640 1 -- 172.21.15.3:0/4202236583 shutdown_connections 2024-09-10T23:24:46.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.919+0000 7f00dbe00640 1 --2- 172.21.15.3:0/4202236583 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00dc10b1a0 0x7f00dc1119a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:46.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.919+0000 7f00dbe00640 1 --2- 172.21.15.3:0/4202236583 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f00dc10a820 0x7f00dc10ac60 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:46.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.919+0000 7f00dbe00640 1 --2- 172.21.15.3:0/4202236583 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00dc104e10 0x7f00dc1051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:46.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.919+0000 7f00dbe00640 1 -- 172.21.15.3:0/4202236583 >> 172.21.15.3:0/4202236583 conn(0x7f00dc100840 msgr2=0x7f00dc102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:46.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.920+0000 7f00dbe00640 1 -- 172.21.15.3:0/4202236583 shutdown_connections 2024-09-10T23:24:46.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.920+0000 7f00dbe00640 1 -- 172.21.15.3:0/4202236583 wait complete. 2024-09-10T23:24:46.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.921+0000 7f00dbe00640 1 Processor -- start 2024-09-10T23:24:46.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.921+0000 7f00dbe00640 1 -- start start 2024-09-10T23:24:46.924 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.921+0000 7f00dbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f00dc104e10 0x7f00dc19b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:46.924 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.921+0000 7f00dbe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00dc10a820 0x7f00dc19b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:46.924 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.921+0000 7f00dbe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00dc10b1a0 0x7f00dc1a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:46.924 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.921+0000 7f00dbe00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f00dc114d10 con 0x7f00dc104e10 2024-09-10T23:24:46.924 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.921+0000 7f00dbe00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f00dc114b90 con 0x7f00dc10a820 2024-09-10T23:24:46.924 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.921+0000 7f00dbe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f00dc114e90 con 0x7f00dc10b1a0 2024-09-10T23:24:46.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.922+0000 7f00daa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f00dc104e10 0x7f00dc19b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:46.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.922+0000 7f00daa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f00dc104e10 0x7f00dc19b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50422/0 (socket says 172.21.15.3:50422) 2024-09-10T23:24:46.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.922+0000 7f00daa00640 1 -- 172.21.15.3:0/4087500322 learned_addr learned my addr 172.21.15.3:0/4087500322 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:24:46.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.922+0000 7f00da000640 1 --2- 172.21.15.3:0/4087500322 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00dc10a820 0x7f00dc19b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:46.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.922+0000 7f00db400640 1 --2- 172.21.15.3:0/4087500322 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00dc10b1a0 0x7f00dc1a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:46.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.922+0000 7f00daa00640 1 -- 172.21.15.3:0/4087500322 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00dc10b1a0 msgr2=0x7f00dc1a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:46.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.922+0000 7f00daa00640 1 --2- 172.21.15.3:0/4087500322 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00dc10b1a0 0x7f00dc1a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:46.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.922+0000 7f00daa00640 1 -- 172.21.15.3:0/4087500322 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00dc10a820 msgr2=0x7f00dc19b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:46.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.922+0000 7f00daa00640 1 --2- 172.21.15.3:0/4087500322 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00dc10a820 0x7f00dc19b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:46.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.922+0000 7f00daa00640 1 -- 172.21.15.3:0/4087500322 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00dc1a1290 con 0x7f00dc104e10 2024-09-10T23:24:46.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.922+0000 7f00da000640 1 --2- 172.21.15.3:0/4087500322 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00dc10a820 0x7f00dc19b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:46.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.922+0000 7f00db400640 1 --2- 172.21.15.3:0/4087500322 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00dc10b1a0 0x7f00dc1a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:46.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.923+0000 7f00daa00640 1 --2- 172.21.15.3:0/4087500322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f00dc104e10 0x7f00dc19b1e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f00cc00e9f0 tx=0x7f00cc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:46.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.923+0000 7f00d3400640 1 -- 172.21.15.3:0/4087500322 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00cc00cd80 con 0x7f00dc104e10 2024-09-10T23:24:46.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.923+0000 7f00d3400640 1 -- 172.21.15.3:0/4087500322 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00cc0054b0 con 0x7f00dc104e10 2024-09-10T23:24:46.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.923+0000 7f00dbe00640 1 -- 172.21.15.3:0/4087500322 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00dc1a1580 con 0x7f00dc104e10 2024-09-10T23:24:46.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.923+0000 7f00d3400640 1 -- 172.21.15.3:0/4087500322 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00cc010430 con 0x7f00dc104e10 2024-09-10T23:24:46.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.923+0000 7f00dbe00640 1 -- 172.21.15.3:0/4087500322 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00dc1a7c40 con 0x7f00dc104e10 2024-09-10T23:24:46.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.924+0000 7f00dbe00640 1 -- 172.21.15.3:0/4087500322 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00dc1051f0 con 0x7f00dc104e10 2024-09-10T23:24:46.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.926+0000 7f00d3400640 1 -- 172.21.15.3:0/4087500322 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7f00cc005000 con 0x7f00dc104e10 2024-09-10T23:24:46.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.928+0000 7f00d3400640 1 --2- 172.21.15.3:0/4087500322 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f00c00b53e0 0x7f00c00b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:46.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.928+0000 7f00d3400640 1 -- 172.21.15.3:0/4087500322 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9286+0+0 (secure 0 0 0) 0x7f00cc0e67b0 con 0x7f00dc104e10 2024-09-10T23:24:46.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.928+0000 7f00da000640 1 --2- 172.21.15.3:0/4087500322 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f00c00b53e0 0x7f00c00b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:46.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.929+0000 7f00da000640 1 --2- 172.21.15.3:0/4087500322 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f00c00b53e0 0x7f00c00b78a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f00c8000c00 tx=0x7f00c8005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:46.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:46.930+0000 7f00d3400640 1 -- 172.21.15.3:0/4087500322 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f00cc056220 con 0x7f00dc104e10 2024-09-10T23:24:47.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:47.169+0000 7f00dbe00640 1 -- 172.21.15.3:0/4087500322 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f00dc10cfe0 con 0x7f00dc104e10 2024-09-10T23:24:47.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:47.210+0000 7f00d3400640 1 -- 172.21.15.3:0/4087500322 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7f00cc0ad1f0 con 0x7f00dc104e10 2024-09-10T23:24:47.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:47.213+0000 7f00dbe00640 1 -- 172.21.15.3:0/4087500322 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f00c00b53e0 msgr2=0x7f00c00b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:47.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:47.213+0000 7f00dbe00640 1 --2- 172.21.15.3:0/4087500322 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f00c00b53e0 0x7f00c00b78a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f00c8000c00 tx=0x7f00c8005a20 comp rx=0 tx=0).stop 2024-09-10T23:24:47.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:47.213+0000 7f00dbe00640 1 -- 172.21.15.3:0/4087500322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f00dc104e10 msgr2=0x7f00dc19b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:47.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:47.213+0000 7f00dbe00640 1 --2- 172.21.15.3:0/4087500322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f00dc104e10 0x7f00dc19b1e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f00cc00e9f0 tx=0x7f00cc00edf0 comp rx=0 tx=0).stop 2024-09-10T23:24:47.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:47.214+0000 7f00dbe00640 1 -- 172.21.15.3:0/4087500322 shutdown_connections 2024-09-10T23:24:47.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:47.214+0000 7f00dbe00640 1 --2- 172.21.15.3:0/4087500322 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00dc10b1a0 0x7f00dc1a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:47.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:47.214+0000 7f00dbe00640 1 --2- 172.21.15.3:0/4087500322 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00dc10a820 0x7f00dc19b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:47.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:47.214+0000 7f00dbe00640 1 --2- 172.21.15.3:0/4087500322 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f00c00b53e0 0x7f00c00b78a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:47.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:47.214+0000 7f00dbe00640 1 --2- 172.21.15.3:0/4087500322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f00dc104e10 0x7f00dc19b1e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:47.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:47.214+0000 7f00dbe00640 1 -- 172.21.15.3:0/4087500322 >> 172.21.15.3:0/4087500322 conn(0x7f00dc100840 msgr2=0x7f00dc102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:47.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:47.214+0000 7f00dbe00640 1 -- 172.21.15.3:0/4087500322 shutdown_connections 2024-09-10T23:24:47.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:47.214+0000 7f00dbe00640 1 -- 172.21.15.3:0/4087500322 wait complete. 2024-09-10T23:24:47.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:47 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/4087500322' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-10T23:24:47.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:47 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/4087500322' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-10T23:24:47.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:47 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/4087500322' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-10T23:24:47.982 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-10T23:24:48.367 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:48.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:48 smithi003 ceph-mon[30348]: pgmap v329: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-10T23:24:48.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:48 smithi003 ceph-mon[30348]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T23:24:48.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:48 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/4087500322' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-10T23:24:48.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:48 smithi003 ceph-mon[30348]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T23:24:48.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:48 smithi003 ceph-mon[30348]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T23:24:48.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:48 smithi003 ceph-mon[30348]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-10T23:24:48.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:48 smithi003 ceph-mon[30348]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-10T23:24:48.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:48 smithi038 ceph-mon[34225]: pgmap v329: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-10T23:24:48.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:48 smithi038 ceph-mon[34225]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T23:24:48.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:48 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/4087500322' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-10T23:24:48.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:48 smithi038 ceph-mon[34225]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T23:24:48.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:48 smithi038 ceph-mon[34225]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T23:24:48.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:48 smithi038 ceph-mon[34225]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-10T23:24:48.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:48 smithi038 ceph-mon[34225]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-10T23:24:48.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:48 smithi194 ceph-mon[33904]: pgmap v329: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-10T23:24:48.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:48 smithi194 ceph-mon[33904]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T23:24:48.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:48 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/4087500322' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-10T23:24:48.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:48 smithi194 ceph-mon[33904]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T23:24:48.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:48 smithi194 ceph-mon[33904]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T23:24:48.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:48 smithi194 ceph-mon[33904]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-10T23:24:48.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:48 smithi194 ceph-mon[33904]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-10T23:24:48.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.945+0000 7ff305e00640 1 -- 172.21.15.3:0/1499748350 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff3001087b0 msgr2=0x7ff300108bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:48.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.945+0000 7ff305e00640 1 --2- 172.21.15.3:0/1499748350 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff3001087b0 0x7ff300108bf0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8009900 tx=0x7ff2e802a410 comp rx=0 tx=0).stop 2024-09-10T23:24:48.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.946+0000 7ff305e00640 1 -- 172.21.15.3:0/1499748350 shutdown_connections 2024-09-10T23:24:48.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.946+0000 7ff305e00640 1 --2- 172.21.15.3:0/1499748350 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff300109130 0x7ff30010f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:48.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.946+0000 7ff305e00640 1 --2- 172.21.15.3:0/1499748350 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff3001087b0 0x7ff300108bf0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:48.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.946+0000 7ff305e00640 1 --2- 172.21.15.3:0/1499748350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff300102da0 0x7ff300103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:48.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.946+0000 7ff305e00640 1 -- 172.21.15.3:0/1499748350 >> 172.21.15.3:0/1499748350 conn(0x7ff3000fe810 msgr2=0x7ff300100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:48.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.946+0000 7ff305e00640 1 -- 172.21.15.3:0/1499748350 shutdown_connections 2024-09-10T23:24:48.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.946+0000 7ff305e00640 1 -- 172.21.15.3:0/1499748350 wait complete. 2024-09-10T23:24:48.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.947+0000 7ff305e00640 1 Processor -- start 2024-09-10T23:24:48.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.947+0000 7ff305e00640 1 -- start start 2024-09-10T23:24:48.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.948+0000 7ff305e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff300102da0 0x7ff30019b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:48.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.948+0000 7ff305e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3001087b0 0x7ff30019b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:48.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.948+0000 7ff305e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff300109130 0x7ff3001a0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:48.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.948+0000 7ff305e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff300112cb0 con 0x7ff300109130 2024-09-10T23:24:48.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.948+0000 7ff305e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff300112b30 con 0x7ff3001087b0 2024-09-10T23:24:48.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.948+0000 7ff305e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff300112e30 con 0x7ff300102da0 2024-09-10T23:24:48.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.948+0000 7ff2ff400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff300109130 0x7ff3001a0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:48.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.948+0000 7ff2ff400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff300109130 0x7ff3001a0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50430/0 (socket says 172.21.15.3:50430) 2024-09-10T23:24:48.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.948+0000 7ff2ff400640 1 -- 172.21.15.3:0/3130202532 learned_addr learned my addr 172.21.15.3:0/3130202532 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:24:48.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.948+0000 7ff2fea00640 1 --2- 172.21.15.3:0/3130202532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff300102da0 0x7ff30019b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:48.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.948+0000 7ff2f6000640 1 --2- 172.21.15.3:0/3130202532 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3001087b0 0x7ff30019b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:48.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.949+0000 7ff2ff400640 1 -- 172.21.15.3:0/3130202532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff300102da0 msgr2=0x7ff30019b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:48.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.949+0000 7ff2ff400640 1 --2- 172.21.15.3:0/3130202532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff300102da0 0x7ff30019b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:48.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.949+0000 7ff2ff400640 1 -- 172.21.15.3:0/3130202532 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3001087b0 msgr2=0x7ff30019b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:48.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.949+0000 7ff2ff400640 1 --2- 172.21.15.3:0/3130202532 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3001087b0 0x7ff30019b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:48.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.949+0000 7ff2ff400640 1 -- 172.21.15.3:0/3130202532 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3001a14b0 con 0x7ff300109130 2024-09-10T23:24:48.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.949+0000 7ff2ff400640 1 --2- 172.21.15.3:0/3130202532 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff300109130 0x7ff3001a0ce0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8009fd0 tx=0x7ff2f800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:48.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.949+0000 7ff304a00640 1 -- 172.21.15.3:0/3130202532 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8017070 con 0x7ff300109130 2024-09-10T23:24:48.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.949+0000 7ff304a00640 1 -- 172.21.15.3:0/3130202532 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff2f8003e00 con 0x7ff300109130 2024-09-10T23:24:48.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.949+0000 7ff304a00640 1 -- 172.21.15.3:0/3130202532 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8010460 con 0x7ff300109130 2024-09-10T23:24:48.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.949+0000 7ff305e00640 1 -- 172.21.15.3:0/3130202532 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3001a17a0 con 0x7ff300109130 2024-09-10T23:24:48.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.949+0000 7ff305e00640 1 -- 172.21.15.3:0/3130202532 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3001a7e60 con 0x7ff300109130 2024-09-10T23:24:48.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.951+0000 7ff305e00640 1 -- 172.21.15.3:0/3130202532 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff300103180 con 0x7ff300109130 2024-09-10T23:24:48.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.955+0000 7ff304a00640 1 -- 172.21.15.3:0/3130202532 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7ff2f8003970 con 0x7ff300109130 2024-09-10T23:24:48.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.956+0000 7ff304a00640 1 --2- 172.21.15.3:0/3130202532 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff2e40b5330 0x7ff2e40b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:48.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.956+0000 7ff304a00640 1 -- 172.21.15.3:0/3130202532 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9286+0+0 (secure 0 0 0) 0x7ff2f80e6160 con 0x7ff300109130 2024-09-10T23:24:48.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.956+0000 7ff2fea00640 1 --2- 172.21.15.3:0/3130202532 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff2e40b5330 0x7ff2e40b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:48.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.957+0000 7ff2fea00640 1 --2- 172.21.15.3:0/3130202532 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff2e40b5330 0x7ff2e40b77f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0005fd0 tx=0x7ff2f000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:48.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:48.958+0000 7ff304a00640 1 -- 172.21.15.3:0/3130202532 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff2f80ac5b0 con 0x7ff300109130 2024-09-10T23:24:49.191 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:49.190+0000 7ff305e00640 1 -- 172.21.15.3:0/3130202532 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7ff30019c530 con 0x7ff300109130 2024-09-10T23:24:49.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:49.238+0000 7ff304a00640 1 -- 172.21.15.3:0/3130202532 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7ff30019c530 con 0x7ff300109130 2024-09-10T23:24:49.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:49.240+0000 7ff305e00640 1 -- 172.21.15.3:0/3130202532 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff2e40b5330 msgr2=0x7ff2e40b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:49.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:49.240+0000 7ff305e00640 1 --2- 172.21.15.3:0/3130202532 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff2e40b5330 0x7ff2e40b77f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0005fd0 tx=0x7ff2f000b390 comp rx=0 tx=0).stop 2024-09-10T23:24:49.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:49.240+0000 7ff305e00640 1 -- 172.21.15.3:0/3130202532 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff300109130 msgr2=0x7ff3001a0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:49.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:49.240+0000 7ff305e00640 1 --2- 172.21.15.3:0/3130202532 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff300109130 0x7ff3001a0ce0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8009fd0 tx=0x7ff2f800b260 comp rx=0 tx=0).stop 2024-09-10T23:24:49.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:49.240+0000 7ff305e00640 1 -- 172.21.15.3:0/3130202532 shutdown_connections 2024-09-10T23:24:49.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:49.240+0000 7ff305e00640 1 --2- 172.21.15.3:0/3130202532 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff2e40b5330 0x7ff2e40b77f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:49.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:49.240+0000 7ff305e00640 1 --2- 172.21.15.3:0/3130202532 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff300109130 0x7ff3001a0ce0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:49.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:49.240+0000 7ff305e00640 1 --2- 172.21.15.3:0/3130202532 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3001087b0 0x7ff30019b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:49.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:49.240+0000 7ff305e00640 1 --2- 172.21.15.3:0/3130202532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff300102da0 0x7ff30019b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:49.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:49.240+0000 7ff305e00640 1 -- 172.21.15.3:0/3130202532 >> 172.21.15.3:0/3130202532 conn(0x7ff3000fe810 msgr2=0x7ff300105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:49.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:49.241+0000 7ff305e00640 1 -- 172.21.15.3:0/3130202532 shutdown_connections 2024-09-10T23:24:49.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:49.241+0000 7ff305e00640 1 -- 172.21.15.3:0/3130202532 wait complete. 2024-09-10T23:24:49.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:49 smithi003 ceph-mon[30348]: mds.? [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] up:active 2024-09-10T23:24:49.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:49 smithi003 ceph-mon[30348]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T23:24:49.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:49 smithi003 ceph-mon[30348]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T23:24:49.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:49 smithi003 ceph-mon[30348]: Cluster is now healthy 2024-09-10T23:24:49.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:49 smithi003 ceph-mon[30348]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-10T23:24:49.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:49 smithi003 ceph-mon[30348]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2024-09-10T23:24:49.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:49 smithi003 ceph-mon[30348]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-09-10T23:24:49.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:49 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3130202532' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-10T23:24:49.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:49 smithi038 ceph-mon[34225]: mds.? [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] up:active 2024-09-10T23:24:49.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:49 smithi038 ceph-mon[34225]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T23:24:49.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:49 smithi038 ceph-mon[34225]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T23:24:49.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:49 smithi038 ceph-mon[34225]: Cluster is now healthy 2024-09-10T23:24:49.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:49 smithi038 ceph-mon[34225]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-10T23:24:49.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:49 smithi038 ceph-mon[34225]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2024-09-10T23:24:49.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:49 smithi038 ceph-mon[34225]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-09-10T23:24:49.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:49 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3130202532' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-10T23:24:49.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:49 smithi194 ceph-mon[33904]: mds.? [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] up:active 2024-09-10T23:24:49.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:49 smithi194 ceph-mon[33904]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T23:24:49.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:49 smithi194 ceph-mon[33904]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T23:24:49.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:49 smithi194 ceph-mon[33904]: Cluster is now healthy 2024-09-10T23:24:49.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:49 smithi194 ceph-mon[33904]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-10T23:24:49.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:49 smithi194 ceph-mon[33904]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2024-09-10T23:24:49.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:49 smithi194 ceph-mon[33904]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-09-10T23:24:49.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:49 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3130202532' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-10T23:24:49.999 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-10T23:24:50.378 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:50.517 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:50 smithi038 ceph-mon[34225]: pgmap v330: 129 pgs: 129 active+clean; 582 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s wr, 1 op/s 2024-09-10T23:24:50.517 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:50 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3130202532' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T23:24:50.517 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:50 smithi038 ceph-mon[34225]: mds.? [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] up:active 2024-09-10T23:24:50.517 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:50 smithi038 ceph-mon[34225]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2024-09-10T23:24:50.517 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:50 smithi038 ceph-mon[34225]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T23:24:50.518 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:50 smithi003 ceph-mon[30348]: pgmap v330: 129 pgs: 129 active+clean; 582 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s wr, 1 op/s 2024-09-10T23:24:50.518 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:50 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3130202532' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T23:24:50.518 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:50 smithi003 ceph-mon[30348]: mds.? [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] up:active 2024-09-10T23:24:50.518 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:50 smithi003 ceph-mon[30348]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2024-09-10T23:24:50.518 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:50 smithi003 ceph-mon[30348]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T23:24:50.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:50 smithi194 ceph-mon[33904]: pgmap v330: 129 pgs: 129 active+clean; 582 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s wr, 1 op/s 2024-09-10T23:24:50.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:50 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3130202532' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T23:24:50.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:50 smithi194 ceph-mon[33904]: mds.? [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] up:active 2024-09-10T23:24:50.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:50 smithi194 ceph-mon[33904]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2024-09-10T23:24:50.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:50 smithi194 ceph-mon[33904]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T23:24:50.847 INFO:journalctl@ceph.mds.b.smithi038.stdout:Sep 10 23:24:50 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-b[65649]: 2024-09-10T23:24:50.516+0000 7fe26fa00640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-10T23:24:50.847 INFO:journalctl@ceph.mds.b.smithi038.stdout:Sep 10 23:24:50 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-b[65649]: 2024-09-10T23:24:50.516+0000 7fe26fa00640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-10T23:24:50.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.929+0000 7f3de3e00640 1 -- 172.21.15.3:0/3218624819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3de4104df0 msgr2=0x7f3de41051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:50.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.929+0000 7f3de3e00640 1 --2- 172.21.15.3:0/3218624819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3de4104df0 0x7f3de41051d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4009900 tx=0x7f3dd402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:24:50.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.929+0000 7f3de3e00640 1 -- 172.21.15.3:0/3218624819 shutdown_connections 2024-09-10T23:24:50.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.929+0000 7f3de3e00640 1 --2- 172.21.15.3:0/3218624819 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3de410b180 0x7f3de4111980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:50.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.929+0000 7f3de3e00640 1 --2- 172.21.15.3:0/3218624819 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3de410a800 0x7f3de410ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:50.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.929+0000 7f3de3e00640 1 --2- 172.21.15.3:0/3218624819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3de4104df0 0x7f3de41051d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:50.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.929+0000 7f3de3e00640 1 -- 172.21.15.3:0/3218624819 >> 172.21.15.3:0/3218624819 conn(0x7f3de4100840 msgr2=0x7f3de4102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:50.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.929+0000 7f3de3e00640 1 -- 172.21.15.3:0/3218624819 shutdown_connections 2024-09-10T23:24:50.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.929+0000 7f3de3e00640 1 -- 172.21.15.3:0/3218624819 wait complete. 2024-09-10T23:24:50.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.930+0000 7f3de3e00640 1 Processor -- start 2024-09-10T23:24:50.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.930+0000 7f3de3e00640 1 -- start start 2024-09-10T23:24:50.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.931+0000 7f3de3e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3de4104df0 0x7f3de419b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:50.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.931+0000 7f3de3e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3de410a800 0x7f3de419b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:50.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.931+0000 7f3de3e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3de410b180 0x7f3de41a0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:50.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.931+0000 7f3de3e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f3de4114d40 con 0x7f3de4104df0 2024-09-10T23:24:50.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.931+0000 7f3de3e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3de4114bc0 con 0x7f3de410a800 2024-09-10T23:24:50.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.931+0000 7f3de3e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3de4114ec0 con 0x7f3de410b180 2024-09-10T23:24:50.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.931+0000 7f3de2a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3de4104df0 0x7f3de419b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:50.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.931+0000 7f3de3400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3de410b180 0x7f3de41a0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:50.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.931+0000 7f3de2a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3de4104df0 0x7f3de419b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38920/0 (socket says 172.21.15.3:38920) 2024-09-10T23:24:50.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.931+0000 7f3de2a00640 1 -- 172.21.15.3:0/4024845765 learned_addr learned my addr 172.21.15.3:0/4024845765 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:24:50.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.931+0000 7f3de2000640 1 --2- 172.21.15.3:0/4024845765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3de410a800 0x7f3de419b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:50.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.932+0000 7f3de2a00640 1 -- 172.21.15.3:0/4024845765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3de410b180 msgr2=0x7f3de41a0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:50.935 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.932+0000 7f3de2a00640 1 --2- 172.21.15.3:0/4024845765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3de410b180 0x7f3de41a0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:50.935 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.932+0000 7f3de2a00640 1 -- 172.21.15.3:0/4024845765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3de410a800 msgr2=0x7f3de419b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:50.935 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.932+0000 7f3de2a00640 1 --2- 172.21.15.3:0/4024845765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3de410a800 0x7f3de419b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:50.935 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.932+0000 7f3de2a00640 1 -- 172.21.15.3:0/4024845765 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de41a11f0 con 0x7f3de4104df0 2024-09-10T23:24:50.935 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.932+0000 7f3de2000640 1 --2- 172.21.15.3:0/4024845765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3de410a800 0x7f3de419b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:50.935 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.932+0000 7f3de2a00640 1 --2- 172.21.15.3:0/4024845765 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3de4104df0 0x7f3de419b140 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3dd402a910 tx=0x7f3dd4003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:50.935 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.933+0000 7f3ddb400640 1 -- 172.21.15.3:0/4024845765 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd403f070 con 0x7f3de4104df0 2024-09-10T23:24:50.935 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.933+0000 7f3ddb400640 1 -- 172.21.15.3:0/4024845765 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3dd4003e40 con 0x7f3de4104df0 2024-09-10T23:24:50.935 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.933+0000 7f3ddb400640 1 -- 172.21.15.3:0/4024845765 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd4035030 con 0x7f3de4104df0 2024-09-10T23:24:50.935 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.933+0000 7f3de3e00640 1 -- 172.21.15.3:0/4024845765 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3de41a1480 con 0x7f3de4104df0 2024-09-10T23:24:50.935 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.933+0000 7f3de3e00640 1 -- 172.21.15.3:0/4024845765 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3de41a7ba0 con 0x7f3de4104df0 2024-09-10T23:24:50.936 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.934+0000 7f3de3e00640 1 -- 172.21.15.3:0/4024845765 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3de41051d0 con 0x7f3de4104df0 2024-09-10T23:24:50.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.936+0000 7f3ddb400640 1 -- 172.21.15.3:0/4024845765 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7f3dd4031400 con 0x7f3de4104df0 2024-09-10T23:24:50.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.939+0000 7f3ddb400640 1 --2- 172.21.15.3:0/4024845765 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f3dc80b53e0 0x7f3dc80b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:50.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.939+0000 7f3ddb400640 1 -- 172.21.15.3:0/4024845765 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9286+0+0 (secure 0 0 0) 0x7f3dd4106f70 con 0x7f3de4104df0 2024-09-10T23:24:50.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.939+0000 7f3de2000640 1 --2- 172.21.15.3:0/4024845765 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f3dc80b53e0 0x7f3dc80b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:50.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.939+0000 7f3de2000640 1 --2- 172.21.15.3:0/4024845765 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f3dc80b53e0 0x7f3dc80b78a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3dd00058c0 tx=0x7f3dd0005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:50.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:50.941+0000 7f3ddb400640 1 -- 172.21.15.3:0/4024845765 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3dd40cd9b0 con 0x7f3de4104df0 2024-09-10T23:24:51.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:51.176+0000 7f3de3e00640 1 -- 172.21.15.3:0/4024845765 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f3de41a7dd0 con 0x7f3de4104df0 2024-09-10T23:24:51.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:51.250+0000 7f3ddb400640 1 -- 172.21.15.3:0/4024845765 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v25) ==== 115+0+0 (secure 0 0 0) 0x7f3dd40cd2b0 con 0x7f3de4104df0 2024-09-10T23:24:51.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:51.253+0000 7f3de3e00640 1 -- 172.21.15.3:0/4024845765 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f3dc80b53e0 msgr2=0x7f3dc80b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:51.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:51.253+0000 7f3de3e00640 1 --2- 172.21.15.3:0/4024845765 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f3dc80b53e0 0x7f3dc80b78a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3dd00058c0 tx=0x7f3dd0005850 comp rx=0 tx=0).stop 2024-09-10T23:24:51.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:51.253+0000 7f3de3e00640 1 -- 172.21.15.3:0/4024845765 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3de4104df0 msgr2=0x7f3de419b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:51.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:51.253+0000 7f3de3e00640 1 --2- 172.21.15.3:0/4024845765 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3de4104df0 0x7f3de419b140 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3dd402a910 tx=0x7f3dd4003c20 comp rx=0 tx=0).stop 2024-09-10T23:24:51.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:51.253+0000 7f3de3e00640 1 -- 172.21.15.3:0/4024845765 shutdown_connections 2024-09-10T23:24:51.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:51.253+0000 7f3de3e00640 1 --2- 172.21.15.3:0/4024845765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3de410b180 0x7f3de41a0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:51.253+0000 7f3de3e00640 1 --2- 172.21.15.3:0/4024845765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3de410a800 0x7f3de419b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:51.253+0000 7f3de3e00640 1 --2- 172.21.15.3:0/4024845765 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f3dc80b53e0 0x7f3dc80b78a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:51.253+0000 7f3de3e00640 1 --2- 172.21.15.3:0/4024845765 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3de4104df0 0x7f3de419b140 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:51.253+0000 7f3de3e00640 1 -- 172.21.15.3:0/4024845765 >> 172.21.15.3:0/4024845765 conn(0x7f3de4100840 msgr2=0x7f3de4101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:51.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:51.253+0000 7f3de3e00640 1 -- 172.21.15.3:0/4024845765 shutdown_connections 2024-09-10T23:24:51.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:51.253+0000 7f3de3e00640 1 -- 172.21.15.3:0/4024845765 wait complete. 2024-09-10T23:24:51.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:51 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/4024845765' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-10T23:24:51.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:51 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/4024845765' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-10T23:24:51.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:51 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/4024845765' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-10T23:24:51.957 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-09-10T23:24:51.958 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-10T23:24:52.338 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:52.477 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:52 smithi003 ceph-mon[30348]: pgmap v331: 129 pgs: 129 active+clean; 582 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 938 B/s wr, 2 op/s 2024-09-10T23:24:52.477 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:52 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/4024845765' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T23:24:52.477 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:52 smithi003 ceph-mon[30348]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T23:24:52.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:52 smithi038 ceph-mon[34225]: pgmap v331: 129 pgs: 129 active+clean; 582 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 938 B/s wr, 2 op/s 2024-09-10T23:24:52.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:52 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/4024845765' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T23:24:52.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:52 smithi038 ceph-mon[34225]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T23:24:52.599 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:52 smithi194 ceph-mon[33904]: pgmap v331: 129 pgs: 129 active+clean; 582 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 938 B/s wr, 2 op/s 2024-09-10T23:24:52.599 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:52 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/4024845765' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T23:24:52.599 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:52 smithi194 ceph-mon[33904]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T23:24:52.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.880+0000 7f075f000640 1 -- 172.21.15.3:0/3204646985 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f07581087d0 msgr2=0x7f0758108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:52.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.880+0000 7f075f000640 1 --2- 172.21.15.3:0/3204646985 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f07581087d0 0x7f0758108c10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0740009900 tx=0x7f074002a410 comp rx=0 tx=0).stop 2024-09-10T23:24:52.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.881+0000 7f075f000640 1 -- 172.21.15.3:0/3204646985 shutdown_connections 2024-09-10T23:24:52.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.881+0000 7f075f000640 1 --2- 172.21.15.3:0/3204646985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0758109150 0x7f075810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:52.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.881+0000 7f075f000640 1 --2- 172.21.15.3:0/3204646985 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f07581087d0 0x7f0758108c10 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:52.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.881+0000 7f075f000640 1 --2- 172.21.15.3:0/3204646985 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0758102dc0 0x7f07581031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:52.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.881+0000 7f075f000640 1 -- 172.21.15.3:0/3204646985 >> 172.21.15.3:0/3204646985 conn(0x7f07580fe830 msgr2=0x7f0758100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:52.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.881+0000 7f075f000640 1 -- 172.21.15.3:0/3204646985 shutdown_connections 2024-09-10T23:24:52.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.881+0000 7f075f000640 1 -- 172.21.15.3:0/3204646985 wait complete. 2024-09-10T23:24:52.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.882+0000 7f075f000640 1 Processor -- start 2024-09-10T23:24:52.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.882+0000 7f075f000640 1 -- start start 2024-09-10T23:24:52.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.883+0000 7f075f000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0758102dc0 0x7f075819b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:52.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.883+0000 7f075f000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f07581087d0 0x7f075819b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:52.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.883+0000 7f075f000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0758109150 0x7f07581a0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:52.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.883+0000 7f075f000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0758112cc0 con 0x7f07581087d0 2024-09-10T23:24:52.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.883+0000 7f075f000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0758112b40 con 0x7f0758109150 2024-09-10T23:24:52.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.883+0000 7f075f000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0758112e40 con 0x7f0758102dc0 2024-09-10T23:24:52.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.883+0000 7f074f400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f07581087d0 0x7f075819b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:52.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.883+0000 7f074f400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f07581087d0 0x7f075819b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38934/0 (socket says 172.21.15.3:38934) 2024-09-10T23:24:52.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.883+0000 7f074f400640 1 -- 172.21.15.3:0/470830829 learned_addr learned my addr 172.21.15.3:0/470830829 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:24:52.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.883+0000 7f075d000640 1 --2- 172.21.15.3:0/470830829 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0758109150 0x7f07581a0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:52.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.883+0000 7f0757e00640 1 --2- 172.21.15.3:0/470830829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0758102dc0 0x7f075819b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:52.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.884+0000 7f074f400640 1 -- 172.21.15.3:0/470830829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0758102dc0 msgr2=0x7f075819b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:52.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.884+0000 7f074f400640 1 --2- 172.21.15.3:0/470830829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0758102dc0 0x7f075819b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:52.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.884+0000 7f074f400640 1 -- 172.21.15.3:0/470830829 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0758109150 msgr2=0x7f07581a0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:52.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.884+0000 7f074f400640 1 --2- 172.21.15.3:0/470830829 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0758109150 0x7f07581a0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:52.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.884+0000 7f074f400640 1 -- 172.21.15.3:0/470830829 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07581a1440 con 0x7f07581087d0 2024-09-10T23:24:52.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.884+0000 7f074f400640 1 --2- 172.21.15.3:0/470830829 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f07581087d0 0x7f075819b8d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0740009230 tx=0x7f0740004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:52.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.884+0000 7f0755600640 1 -- 172.21.15.3:0/470830829 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074003f030 con 0x7f07581087d0 2024-09-10T23:24:52.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.884+0000 7f0755600640 1 -- 172.21.15.3:0/470830829 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0740003a80 con 0x7f07581087d0 2024-09-10T23:24:52.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.884+0000 7f075f000640 1 -- 172.21.15.3:0/470830829 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07581a16d0 con 0x7f07581087d0 2024-09-10T23:24:52.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.884+0000 7f0755600640 1 -- 172.21.15.3:0/470830829 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0740035070 con 0x7f07581087d0 2024-09-10T23:24:52.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.884+0000 7f075f000640 1 -- 172.21.15.3:0/470830829 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07581a7df0 con 0x7f07581087d0 2024-09-10T23:24:52.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.885+0000 7f075f000640 1 -- 172.21.15.3:0/470830829 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07581031a0 con 0x7f07581087d0 2024-09-10T23:24:52.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.888+0000 7f0755600640 1 -- 172.21.15.3:0/470830829 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 153266+0+0 (secure 0 0 0) 0x7f0740003c30 con 0x7f07581087d0 2024-09-10T23:24:52.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.889+0000 7f0755600640 1 --2- 172.21.15.3:0/470830829 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f073c0b53b0 0x7f073c0b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:52.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.889+0000 7f0755600640 1 -- 172.21.15.3:0/470830829 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9286+0+0 (secure 0 0 0) 0x7f0740106e70 con 0x7f07581087d0 2024-09-10T23:24:52.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.889+0000 7f0757e00640 1 --2- 172.21.15.3:0/470830829 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f073c0b53b0 0x7f073c0b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:52.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.890+0000 7f0757e00640 1 --2- 172.21.15.3:0/470830829 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f073c0b53b0 0x7f073c0b7870 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0748009bd0 tx=0x7f0748005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:52.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:52.891+0000 7f0755600640 1 -- 172.21.15.3:0/470830829 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f07400cd260 con 0x7f07581087d0 2024-09-10T23:24:53.120 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:53.118+0000 7f075f000640 1 -- 172.21.15.3:0/470830829 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f0758063590 con 0x7f073c0b53b0 2024-09-10T23:24:53.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:53.153+0000 7f0755600640 1 -- 172.21.15.3:0/470830829 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0758063590 con 0x7f073c0b53b0 2024-09-10T23:24:53.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:53.155+0000 7f075f000640 1 -- 172.21.15.3:0/470830829 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f073c0b53b0 msgr2=0x7f073c0b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:53.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:53.155+0000 7f075f000640 1 --2- 172.21.15.3:0/470830829 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f073c0b53b0 0x7f073c0b7870 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0748009bd0 tx=0x7f0748005f90 comp rx=0 tx=0).stop 2024-09-10T23:24:53.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:53.155+0000 7f075f000640 1 -- 172.21.15.3:0/470830829 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f07581087d0 msgr2=0x7f075819b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:53.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:53.155+0000 7f075f000640 1 --2- 172.21.15.3:0/470830829 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f07581087d0 0x7f075819b8d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0740009230 tx=0x7f0740004270 comp rx=0 tx=0).stop 2024-09-10T23:24:53.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:53.155+0000 7f075f000640 1 -- 172.21.15.3:0/470830829 shutdown_connections 2024-09-10T23:24:53.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:53.155+0000 7f075f000640 1 --2- 172.21.15.3:0/470830829 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0758109150 0x7f07581a0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:53.155+0000 7f075f000640 1 --2- 172.21.15.3:0/470830829 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f073c0b53b0 0x7f073c0b7870 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:53.155+0000 7f075f000640 1 --2- 172.21.15.3:0/470830829 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f07581087d0 0x7f075819b8d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:53.155+0000 7f075f000640 1 --2- 172.21.15.3:0/470830829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0758102dc0 0x7f075819b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:53.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:53.155+0000 7f075f000640 1 -- 172.21.15.3:0/470830829 >> 172.21.15.3:0/470830829 conn(0x7f07580fe830 msgr2=0x7f0758104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:53.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:53.156+0000 7f075f000640 1 -- 172.21.15.3:0/470830829 shutdown_connections 2024-09-10T23:24:53.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:53.156+0000 7f075f000640 1 -- 172.21.15.3:0/470830829 wait complete. 2024-09-10T23:24:53.360 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:53 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:24:53.361 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:24:53 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T23:24:53.126+0000 7f7096e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:24:53.361 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:24:53 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T23:24:53.126+0000 7f7096e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:24:53.361 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:24:53 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T23:24:53.126+0000 7f7096e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:24:53.361 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:24:53 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T23:24:53.126+0000 7f7096e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:24:53.361 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:24:53 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T23:24:53.126+0000 7f7096e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:24:53.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:53 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:24:53.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:53 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:24:54.040 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-10T23:24:54.537 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:54 smithi003 ceph-mon[30348]: pgmap v332: 129 pgs: 129 active+clean; 583 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-09-10T23:24:54.537 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:54 smithi003 ceph-mon[30348]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:24:54.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:54 smithi038 ceph-mon[34225]: pgmap v332: 129 pgs: 129 active+clean; 583 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-09-10T23:24:54.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:54 smithi038 ceph-mon[34225]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:24:54.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:54 smithi194 ceph-mon[33904]: pgmap v332: 129 pgs: 129 active+clean; 583 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-09-10T23:24:54.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:54 smithi194 ceph-mon[33904]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:24:55.095 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:55.700 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.669+0000 7fe41be00640 1 -- 172.21.15.3:0/3060958574 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe41410b330 msgr2=0x7fe414111b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:55.700 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.669+0000 7fe41be00640 1 --2- 172.21.15.3:0/3060958574 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe41410b330 0x7fe414111b30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe40c009900 tx=0x7fe40c02a3f0 comp rx=0 tx=0).stop 2024-09-10T23:24:55.700 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.669+0000 7fe41be00640 1 -- 172.21.15.3:0/3060958574 shutdown_connections 2024-09-10T23:24:55.700 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.669+0000 7fe41be00640 1 --2- 172.21.15.3:0/3060958574 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe41410b330 0x7fe414111b30 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:55.700 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.669+0000 7fe41be00640 1 --2- 172.21.15.3:0/3060958574 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe41410a9b0 0x7fe41410adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:55.700 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.669+0000 7fe41be00640 1 --2- 172.21.15.3:0/3060958574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe414104fa0 0x7fe414105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:55.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.669+0000 7fe41be00640 1 -- 172.21.15.3:0/3060958574 >> 172.21.15.3:0/3060958574 conn(0x7fe414100a50 msgr2=0x7fe414102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:55.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.669+0000 7fe41be00640 1 -- 172.21.15.3:0/3060958574 shutdown_connections 2024-09-10T23:24:55.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.669+0000 7fe41be00640 1 -- 172.21.15.3:0/3060958574 wait complete. 2024-09-10T23:24:55.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.670+0000 7fe41be00640 1 Processor -- start 2024-09-10T23:24:55.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.670+0000 7fe41be00640 1 -- start start 2024-09-10T23:24:55.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.671+0000 7fe41be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe414104fa0 0x7fe41419b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:55.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.671+0000 7fe41be00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe41410a9b0 0x7fe41419b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:55.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.671+0000 7fe41be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe41410b330 0x7fe4141a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:55.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.671+0000 7fe41be00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe414114e10 con 0x7fe41410b330 2024-09-10T23:24:55.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.671+0000 7fe41be00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe414114c90 con 0x7fe41410a9b0 2024-09-10T23:24:55.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.671+0000 7fe41be00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe414114f90 con 0x7fe414104fa0 2024-09-10T23:24:55.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.671+0000 7fe419e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe41410b330 0x7fe4141a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:55.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.671+0000 7fe418a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe41410a9b0 0x7fe41419b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:55.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.671+0000 7fe419400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe414104fa0 0x7fe41419b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:55.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.671+0000 7fe418a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe41410a9b0 0x7fe41419b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.3:42598/0 (socket says 172.21.15.3:42598) 2024-09-10T23:24:55.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.671+0000 7fe419400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe414104fa0 0x7fe41419b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.3:57850/0 (socket says 172.21.15.3:57850) 2024-09-10T23:24:55.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.671+0000 7fe418a00640 1 -- 172.21.15.3:0/2816563083 learned_addr learned my addr 172.21.15.3:0/2816563083 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:24:55.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.671+0000 7fe419400640 1 -- 172.21.15.3:0/2816563083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe41410a9b0 msgr2=0x7fe41419b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:55.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.671+0000 7fe419400640 1 --2- 172.21.15.3:0/2816563083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe41410a9b0 0x7fe41419b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:55.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.671+0000 7fe419400640 1 -- 172.21.15.3:0/2816563083 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe41410b330 msgr2=0x7fe4141a0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:55.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.671+0000 7fe419400640 1 --2- 172.21.15.3:0/2816563083 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe41410b330 0x7fe4141a0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:55.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.671+0000 7fe419400640 1 -- 172.21.15.3:0/2816563083 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4141a1410 con 0x7fe414104fa0 2024-09-10T23:24:55.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.672+0000 7fe419400640 1 --2- 172.21.15.3:0/2816563083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe414104fa0 0x7fe41419b360 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe408009fd0 tx=0x7fe40800ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:55.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.672+0000 7fe412000640 1 -- 172.21.15.3:0/2816563083 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe408004b20 con 0x7fe414104fa0 2024-09-10T23:24:55.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.672+0000 7fe41be00640 1 -- 172.21.15.3:0/2816563083 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4141a1700 con 0x7fe414104fa0 2024-09-10T23:24:55.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.672+0000 7fe41be00640 1 -- 172.21.15.3:0/2816563083 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4141a7dc0 con 0x7fe414104fa0 2024-09-10T23:24:55.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.672+0000 7fe412000640 1 -- 172.21.15.3:0/2816563083 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe408004cc0 con 0x7fe414104fa0 2024-09-10T23:24:55.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.672+0000 7fe412000640 1 -- 172.21.15.3:0/2816563083 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe40800f620 con 0x7fe414104fa0 2024-09-10T23:24:55.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.673+0000 7fe41be00640 1 -- 172.21.15.3:0/2816563083 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe414105380 con 0x7fe414104fa0 2024-09-10T23:24:55.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.675+0000 7fe412000640 1 -- 172.21.15.3:0/2816563083 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7fe40801f020 con 0x7fe414104fa0 2024-09-10T23:24:55.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.677+0000 7fe412000640 1 --2- 172.21.15.3:0/2816563083 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fe3fc0b53c0 0x7fe3fc0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:55.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.677+0000 7fe412000640 1 -- 172.21.15.3:0/2816563083 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9286+0+0 (secure 0 0 0) 0x7fe4080e63e0 con 0x7fe414104fa0 2024-09-10T23:24:55.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.677+0000 7fe418a00640 1 --2- 172.21.15.3:0/2816563083 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fe3fc0b53c0 0x7fe3fc0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:55.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.678+0000 7fe418a00640 1 --2- 172.21.15.3:0/2816563083 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fe3fc0b53c0 0x7fe3fc0b7880 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe41410a080 tx=0x7fe400005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:55.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.678+0000 7fe412000640 1 -- 172.21.15.3:0/2816563083 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe4080accc0 con 0x7fe414104fa0 2024-09-10T23:24:55.911 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.910+0000 7fe41be00640 1 -- 172.21.15.3:0/2816563083 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fe414063590 con 0x7fe3fc0b53c0 2024-09-10T23:24:55.936 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.936+0000 7fe412000640 1 -- 172.21.15.3:0/2816563083 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe414063590 con 0x7fe3fc0b53c0 2024-09-10T23:24:55.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.938+0000 7fe41be00640 1 -- 172.21.15.3:0/2816563083 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fe3fc0b53c0 msgr2=0x7fe3fc0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:55.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.938+0000 7fe41be00640 1 --2- 172.21.15.3:0/2816563083 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fe3fc0b53c0 0x7fe3fc0b7880 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe41410a080 tx=0x7fe400005f90 comp rx=0 tx=0).stop 2024-09-10T23:24:55.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.938+0000 7fe41be00640 1 -- 172.21.15.3:0/2816563083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe414104fa0 msgr2=0x7fe41419b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:55.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.938+0000 7fe41be00640 1 --2- 172.21.15.3:0/2816563083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe414104fa0 0x7fe41419b360 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe408009fd0 tx=0x7fe40800ef90 comp rx=0 tx=0).stop 2024-09-10T23:24:55.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.938+0000 7fe41be00640 1 -- 172.21.15.3:0/2816563083 shutdown_connections 2024-09-10T23:24:55.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.938+0000 7fe41be00640 1 --2- 172.21.15.3:0/2816563083 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fe3fc0b53c0 0x7fe3fc0b7880 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:55.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.938+0000 7fe41be00640 1 --2- 172.21.15.3:0/2816563083 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe41410b330 0x7fe4141a0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:55.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.938+0000 7fe41be00640 1 --2- 172.21.15.3:0/2816563083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe41410a9b0 0x7fe41419b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:55.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.938+0000 7fe41be00640 1 --2- 172.21.15.3:0/2816563083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe414104fa0 0x7fe41419b360 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:55.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.938+0000 7fe41be00640 1 -- 172.21.15.3:0/2816563083 >> 172.21.15.3:0/2816563083 conn(0x7fe414100a50 msgr2=0x7fe414102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:55.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.938+0000 7fe41be00640 1 -- 172.21.15.3:0/2816563083 shutdown_connections 2024-09-10T23:24:55.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:55.938+0000 7fe41be00640 1 -- 172.21.15.3:0/2816563083 wait complete. 2024-09-10T23:24:56.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:56 smithi003 ceph-mon[30348]: pgmap v333: 129 pgs: 129 active+clean; 584 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-09-10T23:24:56.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:56 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:24:56.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:56 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:24:56.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:56 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:24:56.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:56 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:24:56.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:56 smithi003 ceph-mon[30348]: mgrmap e21: x(active, since 8m), standbys: z, y 2024-09-10T23:24:56.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:56 smithi038 ceph-mon[34225]: pgmap v333: 129 pgs: 129 active+clean; 584 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-09-10T23:24:56.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:56 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:24:56.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:56 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:24:56.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:56 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:24:56.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:56 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:24:56.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:56 smithi038 ceph-mon[34225]: mgrmap e21: x(active, since 8m), standbys: z, y 2024-09-10T23:24:56.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:56 smithi194 ceph-mon[33904]: pgmap v333: 129 pgs: 129 active+clean; 584 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-09-10T23:24:56.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:56 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:24:56.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:56 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:24:56.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:56 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:24:56.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:56 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:24:56.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:56 smithi194 ceph-mon[33904]: mgrmap e21: x(active, since 8m), standbys: z, y 2024-09-10T23:24:56.730 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-10T23:24:57.136 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:57.285 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:57 smithi003 ceph-mon[30348]: from='client.24874 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:24:57.285 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:57 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:24:57.285 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:57 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:24:57.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:57 smithi038 ceph-mon[34225]: from='client.24874 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:24:57.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:57 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:24:57.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:57 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:24:57.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:57 smithi194 ceph-mon[33904]: from='client.24874 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:24:57.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:57 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:24:57.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:57 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:24:57.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.745+0000 7f7aa6c00640 1 -- 172.21.15.3:0/1987771023 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7aa0103cc0 msgr2=0x7f7aa01040a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:57.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.745+0000 7f7aa6c00640 1 --2- 172.21.15.3:0/1987771023 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7aa0103cc0 0x7f7aa01040a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7a90009900 tx=0x7f7a9002a410 comp rx=0 tx=0).stop 2024-09-10T23:24:57.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.746+0000 7f7aa6c00640 1 -- 172.21.15.3:0/1987771023 shutdown_connections 2024-09-10T23:24:57.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.746+0000 7f7aa6c00640 1 --2- 172.21.15.3:0/1987771023 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7aa010d120 0x7f7aa010f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.746+0000 7f7aa6c00640 1 --2- 172.21.15.3:0/1987771023 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7aa01045e0 0x7f7aa010cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.746+0000 7f7aa6c00640 1 --2- 172.21.15.3:0/1987771023 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7aa0103cc0 0x7f7aa01040a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.746+0000 7f7aa6c00640 1 -- 172.21.15.3:0/1987771023 >> 172.21.15.3:0/1987771023 conn(0x7f7aa00fd700 msgr2=0x7f7aa00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:57.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.746+0000 7f7aa6c00640 1 -- 172.21.15.3:0/1987771023 shutdown_connections 2024-09-10T23:24:57.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.746+0000 7f7aa6c00640 1 -- 172.21.15.3:0/1987771023 wait complete. 2024-09-10T23:24:57.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.747+0000 7f7aa6c00640 1 Processor -- start 2024-09-10T23:24:57.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.747+0000 7f7aa6c00640 1 -- start start 2024-09-10T23:24:57.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.748+0000 7f7aa6c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7aa0103cc0 0x7f7aa01991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.748+0000 7f7aa6c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7aa01045e0 0x7f7aa0199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.748+0000 7f7aa6c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7aa010d120 0x7f7aa019ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.748+0000 7f7aa6c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa0112c40 con 0x7f7aa0103cc0 2024-09-10T23:24:57.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.748+0000 7f7aa6c00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa0112ac0 con 0x7f7aa01045e0 2024-09-10T23:24:57.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.748+0000 7f7aa6c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa0112dc0 con 0x7f7aa010d120 2024-09-10T23:24:57.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.748+0000 7f7a9fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7aa0103cc0 0x7f7aa01991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.748+0000 7f7a9fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7aa0103cc0 0x7f7aa01991f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39000/0 (socket says 172.21.15.3:39000) 2024-09-10T23:24:57.749 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.748+0000 7f7a9fe00640 1 -- 172.21.15.3:0/1562965627 learned_addr learned my addr 172.21.15.3:0/1562965627 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:24:57.749 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.748+0000 7f7aa4c00640 1 --2- 172.21.15.3:0/1562965627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7aa010d120 0x7f7aa019ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.749 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.748+0000 7f7a9f400640 1 --2- 172.21.15.3:0/1562965627 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7aa01045e0 0x7f7aa0199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.748+0000 7f7a9fe00640 1 -- 172.21.15.3:0/1562965627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7aa010d120 msgr2=0x7f7aa019ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:57.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.749+0000 7f7a9fe00640 1 --2- 172.21.15.3:0/1562965627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7aa010d120 0x7f7aa019ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.749+0000 7f7a9fe00640 1 -- 172.21.15.3:0/1562965627 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7aa01045e0 msgr2=0x7f7aa0199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:57.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.749+0000 7f7a9fe00640 1 --2- 172.21.15.3:0/1562965627 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7aa01045e0 0x7f7aa0199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.749+0000 7f7a9fe00640 1 -- 172.21.15.3:0/1562965627 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa019f2a0 con 0x7f7aa0103cc0 2024-09-10T23:24:57.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.749+0000 7f7a9fe00640 1 --2- 172.21.15.3:0/1562965627 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7aa0103cc0 0x7f7aa01991f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7a90009230 tx=0x7f7a90004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:57.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.749+0000 7f7a9cc00640 1 -- 172.21.15.3:0/1562965627 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a9003f030 con 0x7f7aa0103cc0 2024-09-10T23:24:57.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.749+0000 7f7a9cc00640 1 -- 172.21.15.3:0/1562965627 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a90003a80 con 0x7f7aa0103cc0 2024-09-10T23:24:57.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.749+0000 7f7a9cc00640 1 -- 172.21.15.3:0/1562965627 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a90035070 con 0x7f7aa0103cc0 2024-09-10T23:24:57.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.749+0000 7f7aa6c00640 1 -- 172.21.15.3:0/1562965627 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aa019f530 con 0x7f7aa0103cc0 2024-09-10T23:24:57.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.749+0000 7f7aa6c00640 1 -- 172.21.15.3:0/1562965627 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aa01a5c50 con 0x7f7aa0103cc0 2024-09-10T23:24:57.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.751+0000 7f7aa6c00640 1 -- 172.21.15.3:0/1562965627 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7aa01040a0 con 0x7f7aa0103cc0 2024-09-10T23:24:57.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.753+0000 7f7a9cc00640 1 -- 172.21.15.3:0/1562965627 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7f7a9003ba00 con 0x7f7aa0103cc0 2024-09-10T23:24:57.754 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.754+0000 7f7a9cc00640 1 --2- 172.21.15.3:0/1562965627 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f7a840b5440 0x7f7a840b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.755 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.755+0000 7f7a9cc00640 1 -- 172.21.15.3:0/1562965627 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9286+0+0 (secure 0 0 0) 0x7f7a90106f80 con 0x7f7aa0103cc0 2024-09-10T23:24:57.755 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.755+0000 7f7a9f400640 1 --2- 172.21.15.3:0/1562965627 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f7a840b5440 0x7f7a840b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.755 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.756+0000 7f7a9f400640 1 --2- 172.21.15.3:0/1562965627 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f7a840b5440 0x7f7a840b7900 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7aa010f800 tx=0x7f7a8c00b2e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:57.756 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.757+0000 7f7a9cc00640 1 -- 172.21.15.3:0/1562965627 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7a900cd210 con 0x7f7aa0103cc0 2024-09-10T23:24:57.986 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.986+0000 7f7aa6c00640 1 -- 172.21.15.3:0/1562965627 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f7aa0063590 con 0x7f7a840b5440 2024-09-10T23:24:57.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.992+0000 7f7a9cc00640 1 -- 172.21.15.3:0/1562965627 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f7aa0063590 con 0x7f7a840b5440 2024-09-10T23:24:57.992 INFO:teuthology.orchestra.run.smithi003.stdout:/volumes/qa/sv_0/669cda76-c58d-41dc-ae12-1e5b6e68c3de 2024-09-10T23:24:57.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.995+0000 7f7aa6c00640 1 -- 172.21.15.3:0/1562965627 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f7a840b5440 msgr2=0x7f7a840b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:57.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.995+0000 7f7aa6c00640 1 --2- 172.21.15.3:0/1562965627 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f7a840b5440 0x7f7a840b7900 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7aa010f800 tx=0x7f7a8c00b2e0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.995+0000 7f7aa6c00640 1 -- 172.21.15.3:0/1562965627 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7aa0103cc0 msgr2=0x7f7aa01991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:57.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.995+0000 7f7aa6c00640 1 --2- 172.21.15.3:0/1562965627 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7aa0103cc0 0x7f7aa01991f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7a90009230 tx=0x7f7a90004270 comp rx=0 tx=0).stop 2024-09-10T23:24:57.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.995+0000 7f7aa6c00640 1 -- 172.21.15.3:0/1562965627 shutdown_connections 2024-09-10T23:24:57.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.995+0000 7f7aa6c00640 1 --2- 172.21.15.3:0/1562965627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7aa010d120 0x7f7aa019ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.995+0000 7f7aa6c00640 1 --2- 172.21.15.3:0/1562965627 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7aa01045e0 0x7f7aa0199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.995+0000 7f7aa6c00640 1 --2- 172.21.15.3:0/1562965627 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f7a840b5440 0x7f7a840b7900 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.995+0000 7f7aa6c00640 1 --2- 172.21.15.3:0/1562965627 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7aa0103cc0 0x7f7aa01991f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.996 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.995+0000 7f7aa6c00640 1 -- 172.21.15.3:0/1562965627 >> 172.21.15.3:0/1562965627 conn(0x7f7aa00fd700 msgr2=0x7f7aa00fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:57.996 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.995+0000 7f7aa6c00640 1 -- 172.21.15.3:0/1562965627 shutdown_connections 2024-09-10T23:24:57.996 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:57.995+0000 7f7aa6c00640 1 -- 172.21.15.3:0/1562965627 wait complete. 2024-09-10T23:24:58.331 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:58 smithi003 ceph-mon[30348]: pgmap v334: 129 pgs: 129 active+clean; 604 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.1 KiB/s wr, 12 op/s 2024-09-10T23:24:58.331 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:58 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:24:58.331 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:58 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:24:58.331 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:58 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:24:58.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:58 smithi038 ceph-mon[34225]: pgmap v334: 129 pgs: 129 active+clean; 604 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.1 KiB/s wr, 12 op/s 2024-09-10T23:24:58.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:58 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:24:58.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:58 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:24:58.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:58 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:24:58.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:58 smithi194 ceph-mon[33904]: pgmap v334: 129 pgs: 129 active+clean; 604 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.1 KiB/s wr, 12 op/s 2024-09-10T23:24:58.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:58 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:24:58.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:58 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:24:58.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:58 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:24:58.848 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-10T23:24:59.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:24:59 smithi003 ceph-mon[30348]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:24:59.231 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:24:59.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:24:59 smithi038 ceph-mon[34225]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:24:59.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:24:59 smithi194 ceph-mon[33904]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:24:59.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.792+0000 7fdaf0a00640 1 -- 172.21.15.3:0/2889119485 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdaec1087b0 msgr2=0x7fdaec108bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:59.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.792+0000 7fdaf0a00640 1 --2- 172.21.15.3:0/2889119485 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdaec1087b0 0x7fdaec108bf0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009900 tx=0x7fdad402a410 comp rx=0 tx=0).stop 2024-09-10T23:24:59.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.792+0000 7fdaf0a00640 1 -- 172.21.15.3:0/2889119485 shutdown_connections 2024-09-10T23:24:59.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.792+0000 7fdaf0a00640 1 --2- 172.21.15.3:0/2889119485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaec109130 0x7fdaec10f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.792+0000 7fdaf0a00640 1 --2- 172.21.15.3:0/2889119485 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdaec1087b0 0x7fdaec108bf0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.792+0000 7fdaf0a00640 1 --2- 172.21.15.3:0/2889119485 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdaec102da0 0x7fdaec103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.792+0000 7fdaf0a00640 1 -- 172.21.15.3:0/2889119485 >> 172.21.15.3:0/2889119485 conn(0x7fdaec0fe810 msgr2=0x7fdaec100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:59.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.793+0000 7fdaf0a00640 1 -- 172.21.15.3:0/2889119485 shutdown_connections 2024-09-10T23:24:59.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.793+0000 7fdaf0a00640 1 -- 172.21.15.3:0/2889119485 wait complete. 2024-09-10T23:24:59.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.794+0000 7fdaf0a00640 1 Processor -- start 2024-09-10T23:24:59.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.794+0000 7fdaf0a00640 1 -- start start 2024-09-10T23:24:59.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.794+0000 7fdaf0a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdaec102da0 0x7fdaec19b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.794+0000 7fdaf0a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaec1087b0 0x7fdaec19b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.794+0000 7fdaf0a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdaec109130 0x7fdaec1a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.794+0000 7fdaf0a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fdaec112ca0 con 0x7fdaec109130 2024-09-10T23:24:59.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.794+0000 7fdaf0a00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fdaec112b20 con 0x7fdaec102da0 2024-09-10T23:24:59.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.794+0000 7fdaf0a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fdaec112e20 con 0x7fdaec1087b0 2024-09-10T23:24:59.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.794+0000 7fdaea800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdaec109130 0x7fdaec1a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.795+0000 7fdae9e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdaec102da0 0x7fdaec19b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.795+0000 7fdae1400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaec1087b0 0x7fdaec19b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.795+0000 7fdae9e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdaec102da0 0x7fdaec19b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.3:42628/0 (socket says 172.21.15.3:42628) 2024-09-10T23:24:59.796 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.795+0000 7fdae9e00640 1 -- 172.21.15.3:0/73306969 learned_addr learned my addr 172.21.15.3:0/73306969 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:24:59.796 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.795+0000 7fdaea800640 1 --2- 172.21.15.3:0/73306969 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdaec109130 0x7fdaec1a0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39018/0 (socket says 172.21.15.3:39018) 2024-09-10T23:24:59.796 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.795+0000 7fdae9e00640 1 -- 172.21.15.3:0/73306969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaec1087b0 msgr2=0x7fdaec19b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:59.797 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.795+0000 7fdae9e00640 1 --2- 172.21.15.3:0/73306969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaec1087b0 0x7fdaec19b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.797 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.795+0000 7fdae9e00640 1 -- 172.21.15.3:0/73306969 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdaec109130 msgr2=0x7fdaec1a0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:59.797 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.795+0000 7fdae9e00640 1 --2- 172.21.15.3:0/73306969 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdaec109130 0x7fdaec1a0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.797 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.795+0000 7fdae9e00640 1 -- 172.21.15.3:0/73306969 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaec1a14f0 con 0x7fdaec102da0 2024-09-10T23:24:59.797 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.795+0000 7fdaea800640 1 --2- 172.21.15.3:0/73306969 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdaec109130 0x7fdaec1a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:24:59.797 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.795+0000 7fdae9e00640 1 --2- 172.21.15.3:0/73306969 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdaec102da0 0x7fdaec19b440 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdadc00e9f0 tx=0x7fdadc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:59.797 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.796+0000 7fdae3400640 1 -- 172.21.15.3:0/73306969 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdadc00cd80 con 0x7fdaec102da0 2024-09-10T23:24:59.797 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.796+0000 7fdae3400640 1 -- 172.21.15.3:0/73306969 <== mon.2 v2:172.21.15.38:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdadc0108c0 con 0x7fdaec102da0 2024-09-10T23:24:59.797 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.796+0000 7fdaf0a00640 1 -- 172.21.15.3:0/73306969 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaec1a17e0 con 0x7fdaec102da0 2024-09-10T23:24:59.797 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.796+0000 7fdae3400640 1 -- 172.21.15.3:0/73306969 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdadc0187c0 con 0x7fdaec102da0 2024-09-10T23:24:59.797 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.796+0000 7fdaf0a00640 1 -- 172.21.15.3:0/73306969 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaec1a7f20 con 0x7fdaec102da0 2024-09-10T23:24:59.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.797+0000 7fdaf0a00640 1 -- 172.21.15.3:0/73306969 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaec103180 con 0x7fdaec102da0 2024-09-10T23:24:59.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.799+0000 7fdae3400640 1 -- 172.21.15.3:0/73306969 <== mon.2 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7fdadc010430 con 0x7fdaec102da0 2024-09-10T23:24:59.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.801+0000 7fdae3400640 1 --2- 172.21.15.3:0/73306969 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fdad00b53c0 0x7fdad00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.801+0000 7fdae3400640 1 -- 172.21.15.3:0/73306969 <== mon.2 v2:172.21.15.38:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9286+0+0 (secure 0 0 0) 0x7fdadc0e6a70 con 0x7fdaec102da0 2024-09-10T23:24:59.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.801+0000 7fdae1400640 1 --2- 172.21.15.3:0/73306969 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fdad00b53c0 0x7fdad00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.802+0000 7fdae1400640 1 --2- 172.21.15.3:0/73306969 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fdad00b53c0 0x7fdad00b7880 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdad40057c0 tx=0x7fdad40058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:59.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:24:59.803+0000 7fdae3400640 1 -- 172.21.15.3:0/73306969 <== mon.2 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fdadc0acd00 con 0x7fdaec102da0 2024-09-10T23:25:00.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:00.023+0000 7fdaf0a00640 1 -- 172.21.15.3:0/73306969 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fdaec063620 con 0x7fdad00b53c0 2024-09-10T23:25:00.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:00.053+0000 7fdae3400640 1 -- 172.21.15.3:0/73306969 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fdaec063620 con 0x7fdad00b53c0 2024-09-10T23:25:00.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:00.056+0000 7fdaf0a00640 1 -- 172.21.15.3:0/73306969 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fdad00b53c0 msgr2=0x7fdad00b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:00.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:00.056+0000 7fdaf0a00640 1 --2- 172.21.15.3:0/73306969 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fdad00b53c0 0x7fdad00b7880 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdad40057c0 tx=0x7fdad40058d0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:00.056+0000 7fdaf0a00640 1 -- 172.21.15.3:0/73306969 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdaec102da0 msgr2=0x7fdaec19b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:00.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:00.056+0000 7fdaf0a00640 1 --2- 172.21.15.3:0/73306969 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdaec102da0 0x7fdaec19b440 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdadc00e9f0 tx=0x7fdadc00eeb0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:00.056+0000 7fdaf0a00640 1 -- 172.21.15.3:0/73306969 shutdown_connections 2024-09-10T23:25:00.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:00.056+0000 7fdaf0a00640 1 --2- 172.21.15.3:0/73306969 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fdad00b53c0 0x7fdad00b7880 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:00.056+0000 7fdaf0a00640 1 --2- 172.21.15.3:0/73306969 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdaec109130 0x7fdaec1a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:00.056+0000 7fdaf0a00640 1 --2- 172.21.15.3:0/73306969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaec1087b0 0x7fdaec19b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:00.056+0000 7fdaf0a00640 1 --2- 172.21.15.3:0/73306969 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdaec102da0 0x7fdaec19b440 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:00.056+0000 7fdaf0a00640 1 -- 172.21.15.3:0/73306969 >> 172.21.15.3:0/73306969 conn(0x7fdaec0fe810 msgr2=0x7fdaec105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:00.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:00.056+0000 7fdaf0a00640 1 -- 172.21.15.3:0/73306969 shutdown_connections 2024-09-10T23:25:00.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:00.056+0000 7fdaf0a00640 1 -- 172.21.15.3:0/73306969 wait complete. 2024-09-10T23:25:00.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:00 smithi038 ceph-mon[34225]: pgmap v335: 129 pgs: 129 active+clean; 605 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.3 KiB/s wr, 13 op/s 2024-09-10T23:25:00.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:00 smithi194 ceph-mon[33904]: pgmap v335: 129 pgs: 129 active+clean; 605 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.3 KiB/s wr, 13 op/s 2024-09-10T23:25:00.449 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:00 smithi003 ceph-mon[30348]: pgmap v335: 129 pgs: 129 active+clean; 605 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.3 KiB/s wr, 13 op/s 2024-09-10T23:25:00.839 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-10T23:25:01.216 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:01.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:01 smithi003 ceph-mon[30348]: from='client.34898 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:25:01.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:01 smithi038 ceph-mon[34225]: from='client.34898 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:25:01.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:01 smithi194 ceph-mon[33904]: from='client.34898 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:25:01.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.800+0000 7fd453c00640 1 -- 172.21.15.3:0/3487812933 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd44c10a9b0 msgr2=0x7fd44c10adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:01.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.800+0000 7fd453c00640 1 --2- 172.21.15.3:0/3487812933 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd44c10a9b0 0x7fd44c10adf0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd438009900 tx=0x7fd43802a3f0 comp rx=0 tx=0).stop 2024-09-10T23:25:01.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.800+0000 7fd453c00640 1 -- 172.21.15.3:0/3487812933 shutdown_connections 2024-09-10T23:25:01.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.800+0000 7fd453c00640 1 --2- 172.21.15.3:0/3487812933 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd44c10b330 0x7fd44c111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:01.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.800+0000 7fd453c00640 1 --2- 172.21.15.3:0/3487812933 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd44c10a9b0 0x7fd44c10adf0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:01.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.800+0000 7fd453c00640 1 --2- 172.21.15.3:0/3487812933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd44c104fa0 0x7fd44c105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:01.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.800+0000 7fd453c00640 1 -- 172.21.15.3:0/3487812933 >> 172.21.15.3:0/3487812933 conn(0x7fd44c100a50 msgr2=0x7fd44c102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:01.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.800+0000 7fd453c00640 1 -- 172.21.15.3:0/3487812933 shutdown_connections 2024-09-10T23:25:01.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.800+0000 7fd453c00640 1 -- 172.21.15.3:0/3487812933 wait complete. 2024-09-10T23:25:01.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.801+0000 7fd453c00640 1 Processor -- start 2024-09-10T23:25:01.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.801+0000 7fd453c00640 1 -- start start 2024-09-10T23:25:01.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.802+0000 7fd453c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd44c104fa0 0x7fd44c19b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:01.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.802+0000 7fd453c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd44c10a9b0 0x7fd44c19b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:01.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.802+0000 7fd453c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd44c10b330 0x7fd44c1a0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:01.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.802+0000 7fd453c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd44c114eb0 con 0x7fd44c10b330 2024-09-10T23:25:01.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.802+0000 7fd453c00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd44c114d30 con 0x7fd44c104fa0 2024-09-10T23:25:01.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.802+0000 7fd453c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd44c115030 con 0x7fd44c10a9b0 2024-09-10T23:25:01.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.802+0000 7fd451200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd44c104fa0 0x7fd44c19b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:01.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.802+0000 7fd451c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd44c10b330 0x7fd44c1a0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:01.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.802+0000 7fd451200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd44c104fa0 0x7fd44c19b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.3:49420/0 (socket says 172.21.15.3:49420) 2024-09-10T23:25:01.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.802+0000 7fd451200640 1 -- 172.21.15.3:0/3567805731 learned_addr learned my addr 172.21.15.3:0/3567805731 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:01.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.802+0000 7fd44be00640 1 --2- 172.21.15.3:0/3567805731 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd44c10a9b0 0x7fd44c19b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:01.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.802+0000 7fd451200640 1 -- 172.21.15.3:0/3567805731 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd44c10a9b0 msgr2=0x7fd44c19b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:01.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.802+0000 7fd451200640 1 --2- 172.21.15.3:0/3567805731 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd44c10a9b0 0x7fd44c19b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:01.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.802+0000 7fd451200640 1 -- 172.21.15.3:0/3567805731 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd44c10b330 msgr2=0x7fd44c1a0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:01.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.802+0000 7fd451200640 1 --2- 172.21.15.3:0/3567805731 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd44c10b330 0x7fd44c1a0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:01.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.802+0000 7fd451200640 1 -- 172.21.15.3:0/3567805731 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd44c1a14d0 con 0x7fd44c104fa0 2024-09-10T23:25:01.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.803+0000 7fd451c00640 1 --2- 172.21.15.3:0/3567805731 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd44c10b330 0x7fd44c1a0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:01.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.803+0000 7fd451200640 1 --2- 172.21.15.3:0/3567805731 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd44c104fa0 0x7fd44c19b420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd44000b4a0 tx=0x7fd44000b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:01.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.803+0000 7fd449600640 1 -- 172.21.15.3:0/3567805731 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd440014070 con 0x7fd44c104fa0 2024-09-10T23:25:01.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.803+0000 7fd449600640 1 -- 172.21.15.3:0/3567805731 <== mon.2 v2:172.21.15.38:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd440010aa0 con 0x7fd44c104fa0 2024-09-10T23:25:01.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.803+0000 7fd449600640 1 -- 172.21.15.3:0/3567805731 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd440017b70 con 0x7fd44c104fa0 2024-09-10T23:25:01.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.803+0000 7fd453c00640 1 -- 172.21.15.3:0/3567805731 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd44c1a17c0 con 0x7fd44c104fa0 2024-09-10T23:25:01.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.803+0000 7fd453c00640 1 -- 172.21.15.3:0/3567805731 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd44c1a7e80 con 0x7fd44c104fa0 2024-09-10T23:25:01.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.805+0000 7fd453c00640 1 -- 172.21.15.3:0/3567805731 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd44c105380 con 0x7fd44c104fa0 2024-09-10T23:25:01.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.806+0000 7fd449600640 1 -- 172.21.15.3:0/3567805731 <== mon.2 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7fd440010610 con 0x7fd44c104fa0 2024-09-10T23:25:01.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.808+0000 7fd449600640 1 --2- 172.21.15.3:0/3567805731 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd4340b5440 0x7fd4340b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:01.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.808+0000 7fd449600640 1 -- 172.21.15.3:0/3567805731 <== mon.2 v2:172.21.15.38:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9286+0+0 (secure 0 0 0) 0x7fd4400e59d0 con 0x7fd44c104fa0 2024-09-10T23:25:01.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.808+0000 7fd44be00640 1 --2- 172.21.15.3:0/3567805731 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd4340b5440 0x7fd4340b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:01.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.809+0000 7fd44be00640 1 --2- 172.21.15.3:0/3567805731 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd4340b5440 0x7fd4340b7900 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd438006010 tx=0x7fd438005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:01.812 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:01.812+0000 7fd449600640 1 -- 172.21.15.3:0/3567805731 <== mon.2 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd4400abc60 con 0x7fd44c104fa0 2024-09-10T23:25:02.046 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:02.046+0000 7fd453c00640 1 -- 172.21.15.3:0/3567805731 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fd44c063590 con 0x7fd4340b5440 2024-09-10T23:25:02.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:02.051+0000 7fd449600640 1 -- 172.21.15.3:0/3567805731 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fd44c063590 con 0x7fd4340b5440 2024-09-10T23:25:02.051 INFO:teuthology.orchestra.run.smithi003.stdout:/volumes/qa/sv_1/45bace5b-e7e5-427a-8173-1d7d8c6a20cc 2024-09-10T23:25:02.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:02.054+0000 7fd453c00640 1 -- 172.21.15.3:0/3567805731 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd4340b5440 msgr2=0x7fd4340b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:02.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:02.054+0000 7fd453c00640 1 --2- 172.21.15.3:0/3567805731 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd4340b5440 0x7fd4340b7900 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd438006010 tx=0x7fd438005e80 comp rx=0 tx=0).stop 2024-09-10T23:25:02.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:02.054+0000 7fd453c00640 1 -- 172.21.15.3:0/3567805731 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd44c104fa0 msgr2=0x7fd44c19b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:02.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:02.054+0000 7fd453c00640 1 --2- 172.21.15.3:0/3567805731 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd44c104fa0 0x7fd44c19b420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd44000b4a0 tx=0x7fd44000b960 comp rx=0 tx=0).stop 2024-09-10T23:25:02.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:02.054+0000 7fd453c00640 1 -- 172.21.15.3:0/3567805731 shutdown_connections 2024-09-10T23:25:02.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:02.054+0000 7fd453c00640 1 --2- 172.21.15.3:0/3567805731 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd4340b5440 0x7fd4340b7900 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:02.054+0000 7fd453c00640 1 --2- 172.21.15.3:0/3567805731 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd44c10b330 0x7fd44c1a0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:02.054+0000 7fd453c00640 1 --2- 172.21.15.3:0/3567805731 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd44c10a9b0 0x7fd44c19b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:02.054+0000 7fd453c00640 1 --2- 172.21.15.3:0/3567805731 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd44c104fa0 0x7fd44c19b420 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:02.054+0000 7fd453c00640 1 -- 172.21.15.3:0/3567805731 >> 172.21.15.3:0/3567805731 conn(0x7fd44c100a50 msgr2=0x7fd44c102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:02.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:02.054+0000 7fd453c00640 1 -- 172.21.15.3:0/3567805731 shutdown_connections 2024-09-10T23:25:02.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:02.054+0000 7fd453c00640 1 -- 172.21.15.3:0/3567805731 wait complete. 2024-09-10T23:25:02.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:02 smithi038 ceph-mon[34225]: pgmap v336: 129 pgs: 129 active+clean; 605 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.4 KiB/s wr, 12 op/s 2024-09-10T23:25:02.419 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:02 smithi003 ceph-mon[30348]: pgmap v336: 129 pgs: 129 active+clean; 605 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.4 KiB/s wr, 12 op/s 2024-09-10T23:25:02.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:02 smithi194 ceph-mon[33904]: pgmap v336: 129 pgs: 129 active+clean; 605 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.4 KiB/s wr, 12 op/s 2024-09-10T23:25:02.844 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:25:03.223 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:03.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:03 smithi038 ceph-mon[34225]: from='client.34904 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:25:03.361 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:03 smithi003 ceph-mon[30348]: from='client.34904 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:25:03.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:03 smithi194 ceph-mon[33904]: from='client.34904 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:25:03.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.761+0000 7f88a0e00640 1 -- 172.21.15.3:0/3710312633 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f889c10b330 msgr2=0x7f889c111b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:03.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.761+0000 7f88a0e00640 1 --2- 172.21.15.3:0/3710312633 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f889c10b330 0x7f889c111b30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8894009900 tx=0x7f889402a410 comp rx=0 tx=0).stop 2024-09-10T23:25:03.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.762+0000 7f88a0e00640 1 -- 172.21.15.3:0/3710312633 shutdown_connections 2024-09-10T23:25:03.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.762+0000 7f88a0e00640 1 --2- 172.21.15.3:0/3710312633 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f889c10b330 0x7f889c111b30 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.762+0000 7f88a0e00640 1 --2- 172.21.15.3:0/3710312633 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f889c10a9b0 0x7f889c10adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.762+0000 7f88a0e00640 1 --2- 172.21.15.3:0/3710312633 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f889c104fa0 0x7f889c105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.762+0000 7f88a0e00640 1 -- 172.21.15.3:0/3710312633 >> 172.21.15.3:0/3710312633 conn(0x7f889c100a50 msgr2=0x7f889c102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:03.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.762+0000 7f88a0e00640 1 -- 172.21.15.3:0/3710312633 shutdown_connections 2024-09-10T23:25:03.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.762+0000 7f88a0e00640 1 -- 172.21.15.3:0/3710312633 wait complete. 2024-09-10T23:25:03.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.763+0000 7f88a0e00640 1 Processor -- start 2024-09-10T23:25:03.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.763+0000 7f88a0e00640 1 -- start start 2024-09-10T23:25:03.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.763+0000 7f88a0e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f889c104fa0 0x7f889c19b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:03.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.763+0000 7f88a0e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f889c10a9b0 0x7f889c19b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:03.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.763+0000 7f88a0e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f889c10b330 0x7f889c1a0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:03.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.763+0000 7f88a0e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f889c114e10 con 0x7f889c10a9b0 2024-09-10T23:25:03.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.763+0000 7f88a0e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f889c114c90 con 0x7f889c10b330 2024-09-10T23:25:03.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.763+0000 7f88a0e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f889c114f90 con 0x7f889c104fa0 2024-09-10T23:25:03.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.763+0000 7f8891400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f889c10a9b0 0x7f889c19b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:03.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.763+0000 7f8891400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f889c10a9b0 0x7f889c19b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58612/0 (socket says 172.21.15.3:58612) 2024-09-10T23:25:03.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.763+0000 7f8891400640 1 -- 172.21.15.3:0/2604961711 learned_addr learned my addr 172.21.15.3:0/2604961711 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:03.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.763+0000 7f889a800640 1 --2- 172.21.15.3:0/2604961711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f889c10b330 0x7f889c1a0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:03.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.764+0000 7f8899e00640 1 --2- 172.21.15.3:0/2604961711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f889c104fa0 0x7f889c19b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:03.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.764+0000 7f8891400640 1 -- 172.21.15.3:0/2604961711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f889c104fa0 msgr2=0x7f889c19b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:03.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.764+0000 7f8891400640 1 --2- 172.21.15.3:0/2604961711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f889c104fa0 0x7f889c19b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.764+0000 7f8891400640 1 -- 172.21.15.3:0/2604961711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f889c10b330 msgr2=0x7f889c1a0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:03.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.764+0000 7f8891400640 1 --2- 172.21.15.3:0/2604961711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f889c10b330 0x7f889c1a0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.764+0000 7f8891400640 1 -- 172.21.15.3:0/2604961711 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f889c1a13f0 con 0x7f889c10a9b0 2024-09-10T23:25:03.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.764+0000 7f8899e00640 1 --2- 172.21.15.3:0/2604961711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f889c104fa0 0x7f889c19b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:03.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.764+0000 7f889a800640 1 --2- 172.21.15.3:0/2604961711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f889c10b330 0x7f889c1a0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:03.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.764+0000 7f8891400640 1 --2- 172.21.15.3:0/2604961711 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f889c10a9b0 0x7f889c19b880 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f888400d950 tx=0x7f888400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:03.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.764+0000 7f8893400640 1 -- 172.21.15.3:0/2604961711 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8884017070 con 0x7f889c10a9b0 2024-09-10T23:25:03.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.765+0000 7f8893400640 1 -- 172.21.15.3:0/2604961711 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8884009c30 con 0x7f889c10a9b0 2024-09-10T23:25:03.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.765+0000 7f88a0e00640 1 -- 172.21.15.3:0/2604961711 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f889c1a16e0 con 0x7f889c10a9b0 2024-09-10T23:25:03.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.765+0000 7f8893400640 1 -- 172.21.15.3:0/2604961711 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888400f620 con 0x7f889c10a9b0 2024-09-10T23:25:03.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.765+0000 7f88a0e00640 1 -- 172.21.15.3:0/2604961711 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f889c1a7da0 con 0x7f889c10a9b0 2024-09-10T23:25:03.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.766+0000 7f88a0e00640 1 -- 172.21.15.3:0/2604961711 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f889c105380 con 0x7f889c10a9b0 2024-09-10T23:25:03.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.768+0000 7f8893400640 1 -- 172.21.15.3:0/2604961711 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7f8884010460 con 0x7f889c10a9b0 2024-09-10T23:25:03.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.769+0000 7f8893400640 1 --2- 172.21.15.3:0/2604961711 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f88800b53c0 0x7f88800b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:03.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.769+0000 7f8893400640 1 -- 172.21.15.3:0/2604961711 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9286+0+0 (secure 0 0 0) 0x7f88840e5ed0 con 0x7f889c10a9b0 2024-09-10T23:25:03.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.770+0000 7f8899e00640 1 --2- 172.21.15.3:0/2604961711 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f88800b53c0 0x7f88800b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:03.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.770+0000 7f8899e00640 1 --2- 172.21.15.3:0/2604961711 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f88800b53c0 0x7f88800b7880 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f888c005c40 tx=0x7f888c00a430 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:03.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:03.773+0000 7f8893400640 1 -- 172.21.15.3:0/2604961711 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f88840ac7b0 con 0x7f889c10a9b0 2024-09-10T23:25:04.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:04.006+0000 7f88a0e00640 1 -- 172.21.15.3:0/2604961711 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f889c02e5c0 con 0x7f889c10a9b0 2024-09-10T23:25:04.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:04.007+0000 7f8893400640 1 -- 172.21.15.3:0/2604961711 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11891 (secure 0 0 0) 0x7f8884009de0 con 0x7f889c10a9b0 2024-09-10T23:25:04.007 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:25:04.007 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":25,"btime":"2024-09-10T23:24:51:241992+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/1495411512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":1495411512},{"type":"v1","addr":"172.21.15.3:6835","nonce":1495411512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/1857372777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1857372777},{"type":"v1","addr":"172.21.15.3:6837","nonce":1857372777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14862,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6839/493850676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":493850676},{"type":"v1","addr":"172.21.15.3:6839","nonce":493850676}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14874,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6841/1580524358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":1580524358},{"type":"v1","addr":"172.21.15.3:6841","nonce":1580524358}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/352514665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":352514665},{"type":"v1","addr":"172.21.15.194:6833","nonce":352514665}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2380508105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2380508105},{"type":"v1","addr":"172.21.15.194:6835","nonce":2380508105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:23:58.866253+0000","modified":"2024-09-10T23:24:51.177863+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34724,"mds_1":34682,"mds_2":34652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24649":{"gid":24649,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/739730313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":739730313},{"type":"v1","addr":"172.21.15.194:6837","nonce":739730313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/3198777710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3198777710},{"type":"v1","addr":"172.21.15.194:6839","nonce":3198777710}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34619":{"gid":34619,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6833/1194099617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1194099617},{"type":"v1","addr":"172.21.15.38:6833","nonce":1194099617}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34652":{"gid":34652,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.38:6835/218783320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":218783320},{"type":"v1","addr":"172.21.15.38:6835","nonce":218783320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34682":{"gid":34682,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":21,"addr":"172.21.15.38:6837/1821839397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":1821839397},{"type":"v1","addr":"172.21.15.38:6837","nonce":1821839397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34724":{"gid":34724,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.38:6839/458259815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":458259815},{"type":"v1","addr":"172.21.15.38:6839","nonce":458259815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34724,"qdb_cluster":[34652,34682,34724]},"id":1}]} 2024-09-10T23:25:04.008 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 25 2024-09-10T23:25:04.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:04.009+0000 7f88a0e00640 1 -- 172.21.15.3:0/2604961711 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f88800b53c0 msgr2=0x7f88800b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:04.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:04.009+0000 7f88a0e00640 1 --2- 172.21.15.3:0/2604961711 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f88800b53c0 0x7f88800b7880 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f888c005c40 tx=0x7f888c00a430 comp rx=0 tx=0).stop 2024-09-10T23:25:04.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:04.009+0000 7f88a0e00640 1 -- 172.21.15.3:0/2604961711 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f889c10a9b0 msgr2=0x7f889c19b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:04.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:04.009+0000 7f88a0e00640 1 --2- 172.21.15.3:0/2604961711 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f889c10a9b0 0x7f889c19b880 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f888400d950 tx=0x7f888400de10 comp rx=0 tx=0).stop 2024-09-10T23:25:04.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:04.009+0000 7f88a0e00640 1 -- 172.21.15.3:0/2604961711 shutdown_connections 2024-09-10T23:25:04.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:04.009+0000 7f88a0e00640 1 --2- 172.21.15.3:0/2604961711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f889c10b330 0x7f889c1a0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:04.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:04.009+0000 7f88a0e00640 1 --2- 172.21.15.3:0/2604961711 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f88800b53c0 0x7f88800b7880 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:04.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:04.009+0000 7f88a0e00640 1 --2- 172.21.15.3:0/2604961711 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f889c10a9b0 0x7f889c19b880 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:04.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:04.009+0000 7f88a0e00640 1 --2- 172.21.15.3:0/2604961711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f889c104fa0 0x7f889c19b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:04.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:04.009+0000 7f88a0e00640 1 -- 172.21.15.3:0/2604961711 >> 172.21.15.3:0/2604961711 conn(0x7f889c100a50 msgr2=0x7f889c102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:04.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:04.009+0000 7f88a0e00640 1 -- 172.21.15.3:0/2604961711 shutdown_connections 2024-09-10T23:25:04.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:04.009+0000 7f88a0e00640 1 -- 172.21.15.3:0/2604961711 wait complete. 2024-09-10T23:25:04.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:04 smithi038 ceph-mon[34225]: pgmap v337: 129 pgs: 129 active+clean; 628 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.7 KiB/s wr, 14 op/s 2024-09-10T23:25:04.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:04 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2604961711' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:25:04.369 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:04 smithi003 ceph-mon[30348]: pgmap v337: 129 pgs: 129 active+clean; 628 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.7 KiB/s wr, 14 op/s 2024-09-10T23:25:04.370 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:04 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2604961711' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:25:04.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:04 smithi194 ceph-mon[33904]: pgmap v337: 129 pgs: 129 active+clean; 628 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.7 KiB/s wr, 14 op/s 2024-09-10T23:25:04.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:04 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2604961711' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:25:04.727 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:25:05.106 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:05.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.631+0000 7fbf43a00640 1 -- 172.21.15.3:0/1129453854 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf3c104fa0 msgr2=0x7fbf3c105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:05.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.631+0000 7fbf43a00640 1 --2- 172.21.15.3:0/1129453854 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf3c104fa0 0x7fbf3c105380 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c009900 tx=0x7fbf2c02a3f0 comp rx=0 tx=0).stop 2024-09-10T23:25:05.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.631+0000 7fbf43a00640 1 -- 172.21.15.3:0/1129453854 shutdown_connections 2024-09-10T23:25:05.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.631+0000 7fbf43a00640 1 --2- 172.21.15.3:0/1129453854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf3c10b330 0x7fbf3c111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:05.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.631+0000 7fbf43a00640 1 --2- 172.21.15.3:0/1129453854 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf3c10a9b0 0x7fbf3c10adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:05.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.631+0000 7fbf43a00640 1 --2- 172.21.15.3:0/1129453854 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf3c104fa0 0x7fbf3c105380 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:05.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.631+0000 7fbf43a00640 1 -- 172.21.15.3:0/1129453854 >> 172.21.15.3:0/1129453854 conn(0x7fbf3c100a50 msgr2=0x7fbf3c102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:05.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.631+0000 7fbf43a00640 1 -- 172.21.15.3:0/1129453854 shutdown_connections 2024-09-10T23:25:05.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.631+0000 7fbf43a00640 1 -- 172.21.15.3:0/1129453854 wait complete. 2024-09-10T23:25:05.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.632+0000 7fbf43a00640 1 Processor -- start 2024-09-10T23:25:05.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.632+0000 7fbf43a00640 1 -- start start 2024-09-10T23:25:05.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.632+0000 7fbf43a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf3c104fa0 0x7fbf3c19b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:05.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.632+0000 7fbf43a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf3c10a9b0 0x7fbf3c19b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:05.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.632+0000 7fbf43a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf3c10b330 0x7fbf3c1a0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:05.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.632+0000 7fbf43a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3c114e40 con 0x7fbf3c10a9b0 2024-09-10T23:25:05.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.632+0000 7fbf43a00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3c114cc0 con 0x7fbf3c104fa0 2024-09-10T23:25:05.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.632+0000 7fbf43a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3c114fc0 con 0x7fbf3c10b330 2024-09-10T23:25:05.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.633+0000 7fbf33e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf3c10a9b0 0x7fbf3c19b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:05.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.633+0000 7fbf33e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf3c10a9b0 0x7fbf3c19b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58632/0 (socket says 172.21.15.3:58632) 2024-09-10T23:25:05.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.633+0000 7fbf33e00640 1 -- 172.21.15.3:0/930338943 learned_addr learned my addr 172.21.15.3:0/930338943 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:05.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.633+0000 7fbf41a00640 1 --2- 172.21.15.3:0/930338943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf3c10b330 0x7fbf3c1a0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:05.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.633+0000 7fbf41000640 1 --2- 172.21.15.3:0/930338943 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf3c104fa0 0x7fbf3c19b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:05.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.633+0000 7fbf33e00640 1 -- 172.21.15.3:0/930338943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf3c10b330 msgr2=0x7fbf3c1a0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:05.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.633+0000 7fbf33e00640 1 --2- 172.21.15.3:0/930338943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf3c10b330 0x7fbf3c1a0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:05.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.633+0000 7fbf33e00640 1 -- 172.21.15.3:0/930338943 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf3c104fa0 msgr2=0x7fbf3c19b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:05.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.633+0000 7fbf33e00640 1 --2- 172.21.15.3:0/930338943 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf3c104fa0 0x7fbf3c19b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:05.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.633+0000 7fbf33e00640 1 -- 172.21.15.3:0/930338943 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf3c1a1480 con 0x7fbf3c10a9b0 2024-09-10T23:25:05.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.634+0000 7fbf33e00640 1 --2- 172.21.15.3:0/930338943 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf3c10a9b0 0x7fbf3c19b910 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbf2400d950 tx=0x7fbf2400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:05.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.634+0000 7fbf3a000640 1 -- 172.21.15.3:0/930338943 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf24017070 con 0x7fbf3c10a9b0 2024-09-10T23:25:05.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.634+0000 7fbf3a000640 1 -- 172.21.15.3:0/930338943 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf24009c30 con 0x7fbf3c10a9b0 2024-09-10T23:25:05.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.634+0000 7fbf3a000640 1 -- 172.21.15.3:0/930338943 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf2400f620 con 0x7fbf3c10a9b0 2024-09-10T23:25:05.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.634+0000 7fbf43a00640 1 -- 172.21.15.3:0/930338943 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf3c1a1770 con 0x7fbf3c10a9b0 2024-09-10T23:25:05.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.634+0000 7fbf43a00640 1 -- 172.21.15.3:0/930338943 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf3c1a7e30 con 0x7fbf3c10a9b0 2024-09-10T23:25:05.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.635+0000 7fbf43a00640 1 -- 172.21.15.3:0/930338943 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf3c105380 con 0x7fbf3c10a9b0 2024-09-10T23:25:05.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.637+0000 7fbf3a000640 1 -- 172.21.15.3:0/930338943 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7fbf24010460 con 0x7fbf3c10a9b0 2024-09-10T23:25:05.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.639+0000 7fbf3a000640 1 --2- 172.21.15.3:0/930338943 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fbf200b5440 0x7fbf200b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:05.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.639+0000 7fbf3a000640 1 -- 172.21.15.3:0/930338943 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9286+0+0 (secure 0 0 0) 0x7fbf240e5d50 con 0x7fbf3c10a9b0 2024-09-10T23:25:05.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.639+0000 7fbf41000640 1 --2- 172.21.15.3:0/930338943 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fbf200b5440 0x7fbf200b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:05.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.640+0000 7fbf41000640 1 --2- 172.21.15.3:0/930338943 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fbf200b5440 0x7fbf200b7900 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c006010 tx=0x7fbf2c005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:05.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.642+0000 7fbf3a000640 1 -- 172.21.15.3:0/930338943 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fbf24009de0 con 0x7fbf3c10a9b0 2024-09-10T23:25:05.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.841+0000 7fbf43a00640 1 -- 172.21.15.3:0/930338943 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbf3c10cb80 con 0x7fbf3c10a9b0 2024-09-10T23:25:05.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.843+0000 7fbf3a000640 1 -- 172.21.15.3:0/930338943 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24924 (secure 0 0 0) 0x7fbf240abfe0 con 0x7fbf3c10a9b0 2024-09-10T23:25:05.843 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:25:05.843 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":88,"fsid":"3f4e30d0-6fca-11ef-bcea-c7b262605968","created":"2024-09-10T23:14:12.377466+0000","modified":"2024-09-10T23:24:21.960046+0000","last_up_change":"2024-09-10T23:22:54.895554+0000","last_in_change":"2024-09-10T23:22:29.701108+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:18:27.131879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:23:53.689954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:23:55.864693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:24:03.869094+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a38330ed-a85b-4e61-b373-dd8f1d5f7ba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6803","nonce":824467747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6805","nonce":824467747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6809","nonce":824467747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6807","nonce":824467747}]},"public_addr":"172.21.15.3:6803/824467747","cluster_addr":"172.21.15.3:6805/824467747","heartbeat_back_addr":"172.21.15.3:6809/824467747","heartbeat_front_addr":"172.21.15.3:6807/824467747","state":["exists","up"]},{"osd":1,"uuid":"49bb1212-a83e-4f85-ad71-d863880d8268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6801","nonce":1447444485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6803","nonce":1447444485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6807","nonce":1447444485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6805","nonce":1447444485}]},"public_addr":"172.21.15.38:6801/1447444485","cluster_addr":"172.21.15.38:6803/1447444485","heartbeat_back_addr":"172.21.15.38:6807/1447444485","heartbeat_front_addr":"172.21.15.38:6805/1447444485","state":["exists","up"]},{"osd":2,"uuid":"ea53eb27-e7fa-4783-9a53-8b44b4e293ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6801","nonce":3191263316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6803","nonce":3191263316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6807","nonce":3191263316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6805","nonce":3191263316}]},"public_addr":"172.21.15.194:6801/3191263316","cluster_addr":"172.21.15.194:6803/3191263316","heartbeat_back_addr":"172.21.15.194:6807/3191263316","heartbeat_front_addr":"172.21.15.194:6805/3191263316","state":["exists","up"]},{"osd":3,"uuid":"75067769-7be5-4a99-9e02-f7735b2e69c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6811","nonce":2061990952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6813","nonce":2061990952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6817","nonce":2061990952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6815","nonce":2061990952}]},"public_addr":"172.21.15.3:6811/2061990952","cluster_addr":"172.21.15.3:6813/2061990952","heartbeat_back_addr":"172.21.15.3:6817/2061990952","heartbeat_front_addr":"172.21.15.3:6815/2061990952","state":["exists","up"]},{"osd":4,"uuid":"872e90ca-b711-4206-b586-e7fa41122199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6809","nonce":413294160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6811","nonce":413294160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6815","nonce":413294160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6813","nonce":413294160}]},"public_addr":"172.21.15.38:6809/413294160","cluster_addr":"172.21.15.38:6811/413294160","heartbeat_back_addr":"172.21.15.38:6815/413294160","heartbeat_front_addr":"172.21.15.38:6813/413294160","state":["exists","up"]},{"osd":5,"uuid":"2cfa107c-6dae-4c26-9e29-8175b1237b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6809","nonce":4117812658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6811","nonce":4117812658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6815","nonce":4117812658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6813","nonce":4117812658}]},"public_addr":"172.21.15.194:6809/4117812658","cluster_addr":"172.21.15.194:6811/4117812658","heartbeat_back_addr":"172.21.15.194:6815/4117812658","heartbeat_front_addr":"172.21.15.194:6813/4117812658","state":["exists","up"]},{"osd":6,"uuid":"d2e4e309-c587-4725-a5b3-cbc7b1226750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6819","nonce":3470543721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6821","nonce":3470543721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6825","nonce":3470543721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6823","nonce":3470543721}]},"public_addr":"172.21.15.3:6819/3470543721","cluster_addr":"172.21.15.3:6821/3470543721","heartbeat_back_addr":"172.21.15.3:6825/3470543721","heartbeat_front_addr":"172.21.15.3:6823/3470543721","state":["exists","up"]},{"osd":7,"uuid":"46ecaec5-29da-4e1d-ac2f-42bbbd77e949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6817","nonce":2054203924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6819","nonce":2054203924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6823","nonce":2054203924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6821","nonce":2054203924}]},"public_addr":"172.21.15.38:6817/2054203924","cluster_addr":"172.21.15.38:6819/2054203924","heartbeat_back_addr":"172.21.15.38:6823/2054203924","heartbeat_front_addr":"172.21.15.38:6821/2054203924","state":["exists","up"]},{"osd":8,"uuid":"57fd8e43-9612-4f74-8eb2-8bdbbf7c0417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6817","nonce":170051722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6819","nonce":170051722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6823","nonce":170051722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6821","nonce":170051722}]},"public_addr":"172.21.15.194:6817/170051722","cluster_addr":"172.21.15.194:6819/170051722","heartbeat_back_addr":"172.21.15.194:6823/170051722","heartbeat_front_addr":"172.21.15.194:6821/170051722","state":["exists","up"]},{"osd":9,"uuid":"aeaaf23b-d2e2-4e30-9a49-de4aaba53900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6827","nonce":3967749600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6829","nonce":3967749600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6833","nonce":3967749600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6831","nonce":3967749600}]},"public_addr":"172.21.15.3:6827/3967749600","cluster_addr":"172.21.15.3:6829/3967749600","heartbeat_back_addr":"172.21.15.3:6833/3967749600","heartbeat_front_addr":"172.21.15.3:6831/3967749600","state":["exists","up"]},{"osd":10,"uuid":"b0ece81b-1c5b-40da-b579-fb99bacb005d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6825","nonce":1671957178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6827","nonce":1671957178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6831","nonce":1671957178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6829","nonce":1671957178}]},"public_addr":"172.21.15.38:6825/1671957178","cluster_addr":"172.21.15.38:6827/1671957178","heartbeat_back_addr":"172.21.15.38:6831/1671957178","heartbeat_front_addr":"172.21.15.38:6829/1671957178","state":["exists","up"]},{"osd":11,"uuid":"a0036526-54bf-4e8b-95cc-e7b75725961c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6825","nonce":1048859686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6827","nonce":1048859686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6831","nonce":1048859686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6829","nonce":1048859686}]},"public_addr":"172.21.15.194:6825/1048859686","cluster_addr":"172.21.15.194:6827/1048859686","heartbeat_back_addr":"172.21.15.194:6831/1048859686","heartbeat_front_addr":"172.21.15.194:6829/1048859686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:27.013354+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:56.609046+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:24.878988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:55.218204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:25.224770+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:54.614336+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:25.385483+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:55.317137+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:25.064825+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:54.655361+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:22:24.080027+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:22:52.886412+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":4,"to":6},{"from":5,"to":9}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.3:0/776988825":"2024-09-11T23:16:20.647314+0000","172.21.15.3:0/2965090335":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/2364823868":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/3186881356":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/911991463":"2024-09-11T23:16:20.647314+0000","172.21.15.3:6800/2582365069":"2024-09-11T23:14:37.169991+0000","172.21.15.3:6801/2582365069":"2024-09-11T23:14:37.169991+0000","172.21.15.3:6801/1528153492":"2024-09-11T23:15:05.835734+0000","172.21.15.3:6800/1924113958":"2024-09-11T23:16:20.647314+0000","172.21.15.3:0/554479543":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/4238683346":"2024-09-11T23:15:05.835734+0000","172.21.15.3:6800/1528153492":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/285471483":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/1249510760":"2024-09-11T23:16:20.647314+0000","172.21.15.3:6801/1924113958":"2024-09-11T23:16:20.647314+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:25:05.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.846+0000 7fbf43a00640 1 -- 172.21.15.3:0/930338943 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fbf200b5440 msgr2=0x7fbf200b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:05.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.846+0000 7fbf43a00640 1 --2- 172.21.15.3:0/930338943 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fbf200b5440 0x7fbf200b7900 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c006010 tx=0x7fbf2c005e80 comp rx=0 tx=0).stop 2024-09-10T23:25:05.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.846+0000 7fbf43a00640 1 -- 172.21.15.3:0/930338943 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf3c10a9b0 msgr2=0x7fbf3c19b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:05.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.846+0000 7fbf43a00640 1 --2- 172.21.15.3:0/930338943 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf3c10a9b0 0x7fbf3c19b910 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbf2400d950 tx=0x7fbf2400de10 comp rx=0 tx=0).stop 2024-09-10T23:25:05.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.846+0000 7fbf43a00640 1 -- 172.21.15.3:0/930338943 shutdown_connections 2024-09-10T23:25:05.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.846+0000 7fbf43a00640 1 --2- 172.21.15.3:0/930338943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf3c10b330 0x7fbf3c1a0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:05.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.846+0000 7fbf43a00640 1 --2- 172.21.15.3:0/930338943 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fbf200b5440 0x7fbf200b7900 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:05.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.846+0000 7fbf43a00640 1 --2- 172.21.15.3:0/930338943 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbf3c10a9b0 0x7fbf3c19b910 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:05.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.846+0000 7fbf43a00640 1 --2- 172.21.15.3:0/930338943 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf3c104fa0 0x7fbf3c19b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:05.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.846+0000 7fbf43a00640 1 -- 172.21.15.3:0/930338943 >> 172.21.15.3:0/930338943 conn(0x7fbf3c100a50 msgr2=0x7fbf3c101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:05.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.846+0000 7fbf43a00640 1 -- 172.21.15.3:0/930338943 shutdown_connections 2024-09-10T23:25:05.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:05.846+0000 7fbf43a00640 1 -- 172.21.15.3:0/930338943 wait complete. 2024-09-10T23:25:06.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:06 smithi003 ceph-mon[30348]: pgmap v338: 129 pgs: 129 active+clean; 629 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.9 KiB/s wr, 8 op/s 2024-09-10T23:25:06.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:06 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/930338943' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:25:06.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:06 smithi038 ceph-mon[34225]: pgmap v338: 129 pgs: 129 active+clean; 629 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.9 KiB/s wr, 8 op/s 2024-09-10T23:25:06.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:06 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/930338943' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:25:06.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:06 smithi194 ceph-mon[33904]: pgmap v338: 129 pgs: 129 active+clean; 629 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.9 KiB/s wr, 8 op/s 2024-09-10T23:25:06.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:06 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/930338943' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:25:06.672 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T23:25:06.672 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T23:25:07.056 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:07.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.625+0000 7fca42a00640 1 -- 172.21.15.3:0/639127421 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca3c10a9b0 msgr2=0x7fca3c10adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:07.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.625+0000 7fca42a00640 1 --2- 172.21.15.3:0/639127421 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca3c10a9b0 0x7fca3c10adf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fca28009900 tx=0x7fca2802a3f0 comp rx=0 tx=0).stop 2024-09-10T23:25:07.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.625+0000 7fca42a00640 1 -- 172.21.15.3:0/639127421 shutdown_connections 2024-09-10T23:25:07.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.625+0000 7fca42a00640 1 --2- 172.21.15.3:0/639127421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca3c10b330 0x7fca3c111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:07.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.625+0000 7fca42a00640 1 --2- 172.21.15.3:0/639127421 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca3c10a9b0 0x7fca3c10adf0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:07.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.625+0000 7fca42a00640 1 --2- 172.21.15.3:0/639127421 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca3c104fa0 0x7fca3c105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:07.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.625+0000 7fca42a00640 1 -- 172.21.15.3:0/639127421 >> 172.21.15.3:0/639127421 conn(0x7fca3c100a50 msgr2=0x7fca3c102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:07.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.625+0000 7fca42a00640 1 -- 172.21.15.3:0/639127421 shutdown_connections 2024-09-10T23:25:07.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.625+0000 7fca42a00640 1 -- 172.21.15.3:0/639127421 wait complete. 2024-09-10T23:25:07.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.626+0000 7fca42a00640 1 Processor -- start 2024-09-10T23:25:07.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.626+0000 7fca42a00640 1 -- start start 2024-09-10T23:25:07.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.626+0000 7fca42a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca3c104fa0 0x7fca3c0776b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:07.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.627+0000 7fca42a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca3c10a9b0 0x7fca3c077bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:07.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.627+0000 7fca42a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca3c10b330 0x7fca3c078130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:07.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.627+0000 7fca42a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fca3c114e60 con 0x7fca3c10a9b0 2024-09-10T23:25:07.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.627+0000 7fca42a00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fca3c114ce0 con 0x7fca3c104fa0 2024-09-10T23:25:07.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.627+0000 7fca42a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fca3c114fe0 con 0x7fca3c10b330 2024-09-10T23:25:07.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.627+0000 7fca3b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca3c10a9b0 0x7fca3c077bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:07.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.627+0000 7fca3b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca3c10a9b0 0x7fca3c077bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58650/0 (socket says 172.21.15.3:58650) 2024-09-10T23:25:07.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.627+0000 7fca3b400640 1 -- 172.21.15.3:0/242193914 learned_addr learned my addr 172.21.15.3:0/242193914 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:07.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.627+0000 7fca3be00640 1 --2- 172.21.15.3:0/242193914 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca3c104fa0 0x7fca3c0776b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:07.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.627+0000 7fca40a00640 1 --2- 172.21.15.3:0/242193914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca3c10b330 0x7fca3c078130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:07.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.627+0000 7fca3b400640 1 -- 172.21.15.3:0/242193914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca3c10b330 msgr2=0x7fca3c078130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:07.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.627+0000 7fca3b400640 1 --2- 172.21.15.3:0/242193914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca3c10b330 0x7fca3c078130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:07.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.627+0000 7fca3b400640 1 -- 172.21.15.3:0/242193914 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca3c104fa0 msgr2=0x7fca3c0776b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:07.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.627+0000 7fca3b400640 1 --2- 172.21.15.3:0/242193914 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca3c104fa0 0x7fca3c0776b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:07.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.627+0000 7fca3b400640 1 -- 172.21.15.3:0/242193914 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca3c1ab950 con 0x7fca3c10a9b0 2024-09-10T23:25:07.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.628+0000 7fca3b400640 1 --2- 172.21.15.3:0/242193914 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca3c10a9b0 0x7fca3c077bf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fca28009a20 tx=0x7fca28004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:07.630 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.628+0000 7fca38c00640 1 -- 172.21.15.3:0/242193914 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2803f030 con 0x7fca3c10a9b0 2024-09-10T23:25:07.630 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.628+0000 7fca38c00640 1 -- 172.21.15.3:0/242193914 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fca280035f0 con 0x7fca3c10a9b0 2024-09-10T23:25:07.630 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.628+0000 7fca42a00640 1 -- 172.21.15.3:0/242193914 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca3c1abbe0 con 0x7fca3c10a9b0 2024-09-10T23:25:07.630 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.628+0000 7fca38c00640 1 -- 172.21.15.3:0/242193914 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca28035070 con 0x7fca3c10a9b0 2024-09-10T23:25:07.630 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.628+0000 7fca42a00640 1 -- 172.21.15.3:0/242193914 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca3c1ac0c0 con 0x7fca3c10a9b0 2024-09-10T23:25:07.630 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.630+0000 7fca42a00640 1 -- 172.21.15.3:0/242193914 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca3c105380 con 0x7fca3c10a9b0 2024-09-10T23:25:07.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.633+0000 7fca38c00640 1 -- 172.21.15.3:0/242193914 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7fca28031a70 con 0x7fca3c10a9b0 2024-09-10T23:25:07.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.634+0000 7fca38c00640 1 --2- 172.21.15.3:0/242193914 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fca200b53c0 0x7fca200b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:07.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.634+0000 7fca38c00640 1 -- 172.21.15.3:0/242193914 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9286+0+0 (secure 0 0 0) 0x7fca28106b80 con 0x7fca3c10a9b0 2024-09-10T23:25:07.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.634+0000 7fca3be00640 1 --2- 172.21.15.3:0/242193914 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fca200b53c0 0x7fca200b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:07.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.635+0000 7fca3be00640 1 --2- 172.21.15.3:0/242193914 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fca200b53c0 0x7fca200b7880 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fca2c00abe0 tx=0x7fca2c00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:07.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.638+0000 7fca38c00640 1 -- 172.21.15.3:0/242193914 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fca280cd460 con 0x7fca3c10a9b0 2024-09-10T23:25:07.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.826+0000 7fca42a00640 1 -- 172.21.15.3:0/242193914 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fca3c063590 con 0x7fca200b53c0 2024-09-10T23:25:07.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.833+0000 7fca38c00640 1 -- 172.21.15.3:0/242193914 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340655 (secure 0 0 0) 0x7fca3c063590 con 0x7fca200b53c0 2024-09-10T23:25:07.839 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:25:07.841 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-10T23:25:07.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.838+0000 7fca42a00640 1 -- 172.21.15.3:0/242193914 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fca200b53c0 msgr2=0x7fca200b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:07.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.838+0000 7fca42a00640 1 --2- 172.21.15.3:0/242193914 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fca200b53c0 0x7fca200b7880 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fca2c00abe0 tx=0x7fca2c00a2d0 comp rx=0 tx=0).stop 2024-09-10T23:25:07.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.838+0000 7fca42a00640 1 -- 172.21.15.3:0/242193914 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca3c10a9b0 msgr2=0x7fca3c077bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:07.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.838+0000 7fca42a00640 1 --2- 172.21.15.3:0/242193914 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca3c10a9b0 0x7fca3c077bf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fca28009a20 tx=0x7fca28004270 comp rx=0 tx=0).stop 2024-09-10T23:25:07.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.838+0000 7fca42a00640 1 -- 172.21.15.3:0/242193914 shutdown_connections 2024-09-10T23:25:07.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.838+0000 7fca42a00640 1 --2- 172.21.15.3:0/242193914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca3c10b330 0x7fca3c078130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:07.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.838+0000 7fca42a00640 1 --2- 172.21.15.3:0/242193914 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fca200b53c0 0x7fca200b7880 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:07.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.838+0000 7fca42a00640 1 --2- 172.21.15.3:0/242193914 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca3c10a9b0 0x7fca3c077bf0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:07.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.838+0000 7fca42a00640 1 --2- 172.21.15.3:0/242193914 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca3c104fa0 0x7fca3c0776b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:07.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.838+0000 7fca42a00640 1 -- 172.21.15.3:0/242193914 >> 172.21.15.3:0/242193914 conn(0x7fca3c100a50 msgr2=0x7fca3c102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:07.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.838+0000 7fca42a00640 1 -- 172.21.15.3:0/242193914 shutdown_connections 2024-09-10T23:25:07.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:07.839+0000 7fca42a00640 1 -- 172.21.15.3:0/242193914 wait complete. 2024-09-10T23:25:08.248 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:08 smithi003 ceph-mon[30348]: pgmap v339: 129 pgs: 129 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.6 KiB/s wr, 8 op/s 2024-09-10T23:25:08.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:08 smithi038 ceph-mon[34225]: pgmap v339: 129 pgs: 129 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.6 KiB/s wr, 8 op/s 2024-09-10T23:25:08.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:08 smithi194 ceph-mon[33904]: pgmap v339: 129 pgs: 129 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.6 KiB/s wr, 8 op/s 2024-09-10T23:25:08.759 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":339,"stamp":"2024-09-10T23:25:06.765458+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651857,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":202,"num_read_kb":196,"num_write":280,"num_write_kb":2260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2951874,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365232,"kb_used_data":11824,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576592,"statfs":{"total":1151940427776,"available":1151566430208,"internally_reserved":0,"allocated":12107776,"data_stored":8104865,"data_compressed":433782,"data_compressed_allocated":589824,"data_compressed_original":2678784,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":54037,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":94,"num_write":28,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003634"},"pg_stats":[{"pgid":"2.1f","version":"88'9","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:48.248520+0000","last_change":"2024-09-10T23:23:54.796561+0000","last_active":"2024-09-10T23:24:48.248520+0000","last_peered":"2024-09-10T23:24:48.248520+0000","last_clean":"2024-09-10T23:24:48.248520+0000","last_became_active":"2024-09-10T23:23:54.796058+0000","last_became_peered":"2024-09-10T23:23:54.796058+0000","last_unstale":"2024-09-10T23:24:48.248520+0000","last_undegraded":"2024-09-10T23:24:48.248520+0000","last_fullsized":"2024-09-10T23:24:48.248520+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:27.790990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971290+0000","last_change":"2024-09-10T23:23:57.828660+0000","last_active":"2024-09-10T23:24:21.971290+0000","last_peered":"2024-09-10T23:24:21.971290+0000","last_clean":"2024-09-10T23:24:21.971290+0000","last_became_active":"2024-09-10T23:23:57.828287+0000","last_became_peered":"2024-09-10T23:23:57.828287+0000","last_unstale":"2024-09-10T23:24:21.971290+0000","last_undegraded":"2024-09-10T23:24:21.971290+0000","last_fullsized":"2024-09-10T23:24:21.971290+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:13.085003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971534+0000","last_change":"2024-09-10T23:24:05.886167+0000","last_active":"2024-09-10T23:24:21.971534+0000","last_peered":"2024-09-10T23:24:21.971534+0000","last_clean":"2024-09-10T23:24:21.971534+0000","last_became_active":"2024-09-10T23:24:05.885706+0000","last_became_peered":"2024-09-10T23:24:05.885706+0000","last_unstale":"2024-09-10T23:24:21.971534+0000","last_undegraded":"2024-09-10T23:24:21.971534+0000","last_fullsized":"2024-09-10T23:24:21.971534+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:42.337384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971714+0000","last_change":"2024-09-10T23:23:54.791770+0000","last_active":"2024-09-10T23:24:21.971714+0000","last_peered":"2024-09-10T23:24:21.971714+0000","last_clean":"2024-09-10T23:24:21.971714+0000","last_became_active":"2024-09-10T23:23:54.791476+0000","last_became_peered":"2024-09-10T23:23:54.791476+0000","last_unstale":"2024-09-10T23:24:21.971714+0000","last_undegraded":"2024-09-10T23:24:21.971714+0000","last_fullsized":"2024-09-10T23:24:21.971714+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:07.493654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.968523+0000","last_change":"2024-09-10T23:23:57.833858+0000","last_active":"2024-09-10T23:24:21.968523+0000","last_peered":"2024-09-10T23:24:21.968523+0000","last_clean":"2024-09-10T23:24:21.968523+0000","last_became_active":"2024-09-10T23:23:57.833496+0000","last_became_peered":"2024-09-10T23:23:57.833496+0000","last_unstale":"2024-09-10T23:24:21.968523+0000","last_undegraded":"2024-09-10T23:24:21.968523+0000","last_fullsized":"2024-09-10T23:24:21.968523+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:48:50.293342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:22.295150+0000","last_change":"2024-09-10T23:24:05.878733+0000","last_active":"2024-09-10T23:24:22.295150+0000","last_peered":"2024-09-10T23:24:22.295150+0000","last_clean":"2024-09-10T23:24:22.295150+0000","last_became_active":"2024-09-10T23:24:05.878285+0000","last_became_peered":"2024-09-10T23:24:05.878285+0000","last_unstale":"2024-09-10T23:24:22.295150+0000","last_undegraded":"2024-09-10T23:24:22.295150+0000","last_fullsized":"2024-09-10T23:24:22.295150+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:21:11.636292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:48.247289+0000","last_change":"2024-09-10T23:23:54.792253+0000","last_active":"2024-09-10T23:24:48.247289+0000","last_peered":"2024-09-10T23:24:48.247289+0000","last_clean":"2024-09-10T23:24:48.247289+0000","last_became_active":"2024-09-10T23:23:54.791847+0000","last_became_peered":"2024-09-10T23:23:54.791847+0000","last_unstale":"2024-09-10T23:24:48.247289+0000","last_undegraded":"2024-09-10T23:24:48.247289+0000","last_fullsized":"2024-09-10T23:24:48.247289+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:03.563741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972784+0000","last_change":"2024-09-10T23:23:57.837009+0000","last_active":"2024-09-10T23:24:21.972784+0000","last_peered":"2024-09-10T23:24:21.972784+0000","last_clean":"2024-09-10T23:24:21.972784+0000","last_became_active":"2024-09-10T23:23:57.835152+0000","last_became_peered":"2024-09-10T23:23:57.835152+0000","last_unstale":"2024-09-10T23:24:21.972784+0000","last_undegraded":"2024-09-10T23:24:21.972784+0000","last_fullsized":"2024-09-10T23:24:21.972784+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:25.345514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:22.295404+0000","last_change":"2024-09-10T23:24:05.882593+0000","last_active":"2024-09-10T23:24:22.295404+0000","last_peered":"2024-09-10T23:24:22.295404+0000","last_clean":"2024-09-10T23:24:22.295404+0000","last_became_active":"2024-09-10T23:24:05.882123+0000","last_became_peered":"2024-09-10T23:24:05.882123+0000","last_unstale":"2024-09-10T23:24:22.295404+0000","last_undegraded":"2024-09-10T23:24:22.295404+0000","last_fullsized":"2024-09-10T23:24:22.295404+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:22:30.103412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.981010+0000","last_change":"2024-09-10T23:24:21.980433+0000","last_active":"2024-09-10T23:24:21.981010+0000","last_peered":"2024-09-10T23:24:21.981010+0000","last_clean":"2024-09-10T23:24:21.981010+0000","last_became_active":"2024-09-10T23:24:21.974096+0000","last_became_peered":"2024-09-10T23:24:21.974096+0000","last_unstale":"2024-09-10T23:24:21.981010+0000","last_undegraded":"2024-09-10T23:24:21.981010+0000","last_fullsized":"2024-09-10T23:24:21.981010+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:33.430921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.978947+0000","last_change":"2024-09-10T23:24:21.978526+0000","last_active":"2024-09-10T23:24:21.978947+0000","last_peered":"2024-09-10T23:24:21.978947+0000","last_clean":"2024-09-10T23:24:21.978947+0000","last_became_active":"2024-09-10T23:24:21.978137+0000","last_became_peered":"2024-09-10T23:24:21.978137+0000","last_unstale":"2024-09-10T23:24:21.978947+0000","last_undegraded":"2024-09-10T23:24:21.978947+0000","last_fullsized":"2024-09-10T23:24:21.978947+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:53:31.785033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:22.295306+0000","last_change":"2024-09-10T23:24:05.889983+0000","last_active":"2024-09-10T23:24:22.295306+0000","last_peered":"2024-09-10T23:24:22.295306+0000","last_clean":"2024-09-10T23:24:22.295306+0000","last_became_active":"2024-09-10T23:24:05.889003+0000","last_became_peered":"2024-09-10T23:24:05.889003+0000","last_unstale":"2024-09-10T23:24:22.295306+0000","last_undegraded":"2024-09-10T23:24:22.295306+0000","last_fullsized":"2024-09-10T23:24:22.295306+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:19:13.555187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.970787+0000","last_change":"2024-09-10T23:23:57.831433+0000","last_active":"2024-09-10T23:24:21.970787+0000","last_peered":"2024-09-10T23:24:21.970787+0000","last_clean":"2024-09-10T23:24:21.970787+0000","last_became_active":"2024-09-10T23:23:57.831108+0000","last_became_peered":"2024-09-10T23:23:57.831108+0000","last_unstale":"2024-09-10T23:24:21.970787+0000","last_undegraded":"2024-09-10T23:24:21.970787+0000","last_fullsized":"2024-09-10T23:24:21.970787+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:50:20.160455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:47.240073+0000","last_change":"2024-09-10T23:23:54.792269+0000","last_active":"2024-09-10T23:24:47.240073+0000","last_peered":"2024-09-10T23:24:47.240073+0000","last_clean":"2024-09-10T23:24:47.240073+0000","last_became_active":"2024-09-10T23:23:54.791853+0000","last_became_peered":"2024-09-10T23:23:54.791853+0000","last_unstale":"2024-09-10T23:24:47.240073+0000","last_undegraded":"2024-09-10T23:24:47.240073+0000","last_fullsized":"2024-09-10T23:24:47.240073+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:43.020267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:22.295698+0000","last_change":"2024-09-10T23:24:05.886155+0000","last_active":"2024-09-10T23:24:22.295698+0000","last_peered":"2024-09-10T23:24:22.295698+0000","last_clean":"2024-09-10T23:24:22.295698+0000","last_became_active":"2024-09-10T23:24:05.885674+0000","last_became_peered":"2024-09-10T23:24:05.885674+0000","last_unstale":"2024-09-10T23:24:22.295698+0000","last_undegraded":"2024-09-10T23:24:22.295698+0000","last_fullsized":"2024-09-10T23:24:22.295698+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:46:00.891311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971300+0000","last_change":"2024-09-10T23:23:57.830440+0000","last_active":"2024-09-10T23:24:21.971300+0000","last_peered":"2024-09-10T23:24:21.971300+0000","last_clean":"2024-09-10T23:24:21.971300+0000","last_became_active":"2024-09-10T23:23:57.829219+0000","last_became_peered":"2024-09-10T23:23:57.829219+0000","last_unstale":"2024-09-10T23:24:21.971300+0000","last_undegraded":"2024-09-10T23:24:21.971300+0000","last_fullsized":"2024-09-10T23:24:21.971300+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:28:15.696684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"88'1","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972310+0000","last_change":"2024-09-10T23:23:54.796493+0000","last_active":"2024-09-10T23:24:21.972310+0000","last_peered":"2024-09-10T23:24:21.972310+0000","last_clean":"2024-09-10T23:24:21.972310+0000","last_became_active":"2024-09-10T23:23:54.796077+0000","last_became_peered":"2024-09-10T23:23:54.796077+0000","last_unstale":"2024-09-10T23:24:21.972310+0000","last_undegraded":"2024-09-10T23:24:21.972310+0000","last_fullsized":"2024-09-10T23:24:21.972310+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:13.054307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:22.295589+0000","last_change":"2024-09-10T23:24:05.885557+0000","last_active":"2024-09-10T23:24:22.295589+0000","last_peered":"2024-09-10T23:24:22.295589+0000","last_clean":"2024-09-10T23:24:22.295589+0000","last_became_active":"2024-09-10T23:24:05.884773+0000","last_became_peered":"2024-09-10T23:24:05.884773+0000","last_unstale":"2024-09-10T23:24:22.295589+0000","last_undegraded":"2024-09-10T23:24:22.295589+0000","last_fullsized":"2024-09-10T23:24:22.295589+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:52.596822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.967800+0000","last_change":"2024-09-10T23:23:57.816395+0000","last_active":"2024-09-10T23:24:21.967800+0000","last_peered":"2024-09-10T23:24:21.967800+0000","last_clean":"2024-09-10T23:24:21.967800+0000","last_became_active":"2024-09-10T23:23:57.816047+0000","last_became_peered":"2024-09-10T23:23:57.816047+0000","last_unstale":"2024-09-10T23:24:21.967800+0000","last_undegraded":"2024-09-10T23:24:21.967800+0000","last_fullsized":"2024-09-10T23:24:21.967800+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:08:11.535738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:47.238793+0000","last_change":"2024-09-10T23:23:54.795827+0000","last_active":"2024-09-10T23:24:47.238793+0000","last_peered":"2024-09-10T23:24:47.238793+0000","last_clean":"2024-09-10T23:24:47.238793+0000","last_became_active":"2024-09-10T23:23:54.794253+0000","last_became_peered":"2024-09-10T23:23:54.794253+0000","last_unstale":"2024-09-10T23:24:47.238793+0000","last_undegraded":"2024-09-10T23:24:47.238793+0000","last_fullsized":"2024-09-10T23:24:47.238793+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:27:27.988380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.974330+0000","last_change":"2024-09-10T23:24:05.889120+0000","last_active":"2024-09-10T23:24:21.974330+0000","last_peered":"2024-09-10T23:24:21.974330+0000","last_clean":"2024-09-10T23:24:21.974330+0000","last_became_active":"2024-09-10T23:24:05.888771+0000","last_became_peered":"2024-09-10T23:24:05.888771+0000","last_unstale":"2024-09-10T23:24:21.974330+0000","last_undegraded":"2024-09-10T23:24:21.974330+0000","last_fullsized":"2024-09-10T23:24:21.974330+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:55.414786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.965197+0000","last_change":"2024-09-10T23:23:57.814073+0000","last_active":"2024-09-10T23:24:21.965197+0000","last_peered":"2024-09-10T23:24:21.965197+0000","last_clean":"2024-09-10T23:24:21.965197+0000","last_became_active":"2024-09-10T23:23:57.813681+0000","last_became_peered":"2024-09-10T23:23:57.813681+0000","last_unstale":"2024-09-10T23:24:21.965197+0000","last_undegraded":"2024-09-10T23:24:21.965197+0000","last_fullsized":"2024-09-10T23:24:21.965197+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:44.129174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:47.238565+0000","last_change":"2024-09-10T23:23:54.791119+0000","last_active":"2024-09-10T23:24:47.238565+0000","last_peered":"2024-09-10T23:24:47.238565+0000","last_clean":"2024-09-10T23:24:47.238565+0000","last_became_active":"2024-09-10T23:23:54.790770+0000","last_became_peered":"2024-09-10T23:23:54.790770+0000","last_unstale":"2024-09-10T23:24:47.238565+0000","last_undegraded":"2024-09-10T23:24:47.238565+0000","last_fullsized":"2024-09-10T23:24:47.238565+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:35.015104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:22.296391+0000","last_change":"2024-09-10T23:24:05.885654+0000","last_active":"2024-09-10T23:24:22.296391+0000","last_peered":"2024-09-10T23:24:22.296391+0000","last_clean":"2024-09-10T23:24:22.296391+0000","last_became_active":"2024-09-10T23:24:05.885176+0000","last_became_peered":"2024-09-10T23:24:05.885176+0000","last_unstale":"2024-09-10T23:24:22.296391+0000","last_undegraded":"2024-09-10T23:24:22.296391+0000","last_fullsized":"2024-09-10T23:24:22.296391+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:24:47.007414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.976267+0000","last_change":"2024-09-10T23:24:21.976169+0000","last_active":"2024-09-10T23:24:21.976267+0000","last_peered":"2024-09-10T23:24:21.976267+0000","last_clean":"2024-09-10T23:24:21.976267+0000","last_became_active":"2024-09-10T23:24:21.975330+0000","last_became_peered":"2024-09-10T23:24:21.975330+0000","last_unstale":"2024-09-10T23:24:21.976267+0000","last_undegraded":"2024-09-10T23:24:21.976267+0000","last_fullsized":"2024-09-10T23:24:21.976267+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:54:59.422630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:47.235036+0000","last_change":"2024-09-10T23:23:55.082093+0000","last_active":"2024-09-10T23:24:47.235036+0000","last_peered":"2024-09-10T23:24:47.235036+0000","last_clean":"2024-09-10T23:24:47.235036+0000","last_became_active":"2024-09-10T23:23:55.081705+0000","last_became_peered":"2024-09-10T23:23:55.081705+0000","last_unstale":"2024-09-10T23:24:47.235036+0000","last_undegraded":"2024-09-10T23:24:47.235036+0000","last_fullsized":"2024-09-10T23:24:47.235036+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:01:04.150153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971708+0000","last_change":"2024-09-10T23:24:05.880084+0000","last_active":"2024-09-10T23:24:21.971708+0000","last_peered":"2024-09-10T23:24:21.971708+0000","last_clean":"2024-09-10T23:24:21.971708+0000","last_became_active":"2024-09-10T23:24:05.879655+0000","last_became_peered":"2024-09-10T23:24:05.879655+0000","last_unstale":"2024-09-10T23:24:21.971708+0000","last_undegraded":"2024-09-10T23:24:21.971708+0000","last_fullsized":"2024-09-10T23:24:21.971708+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:01.473494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972634+0000","last_change":"2024-09-10T23:23:57.836207+0000","last_active":"2024-09-10T23:24:21.972634+0000","last_peered":"2024-09-10T23:24:21.972634+0000","last_clean":"2024-09-10T23:24:21.972634+0000","last_became_active":"2024-09-10T23:23:57.835801+0000","last_became_peered":"2024-09-10T23:23:57.835801+0000","last_unstale":"2024-09-10T23:24:21.972634+0000","last_undegraded":"2024-09-10T23:24:21.972634+0000","last_fullsized":"2024-09-10T23:24:21.972634+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:48:18.246508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'7","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:25:00.852186+0000","last_change":"2024-09-10T23:23:54.798126+0000","last_active":"2024-09-10T23:25:00.852186+0000","last_peered":"2024-09-10T23:25:00.852186+0000","last_clean":"2024-09-10T23:25:00.852186+0000","last_became_active":"2024-09-10T23:23:54.797755+0000","last_became_peered":"2024-09-10T23:23:54.797755+0000","last_unstale":"2024-09-10T23:25:00.852186+0000","last_undegraded":"2024-09-10T23:25:00.852186+0000","last_fullsized":"2024-09-10T23:25:00.852186+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:54.474382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971825+0000","last_change":"2024-09-10T23:24:05.886431+0000","last_active":"2024-09-10T23:24:21.971825+0000","last_peered":"2024-09-10T23:24:21.971825+0000","last_clean":"2024-09-10T23:24:21.971825+0000","last_became_active":"2024-09-10T23:24:05.885962+0000","last_became_peered":"2024-09-10T23:24:05.885962+0000","last_unstale":"2024-09-10T23:24:21.971825+0000","last_undegraded":"2024-09-10T23:24:21.971825+0000","last_fullsized":"2024-09-10T23:24:21.971825+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:32.568553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973866+0000","last_change":"2024-09-10T23:23:57.825790+0000","last_active":"2024-09-10T23:24:21.973866+0000","last_peered":"2024-09-10T23:24:21.973866+0000","last_clean":"2024-09-10T23:24:21.973866+0000","last_became_active":"2024-09-10T23:23:57.825510+0000","last_became_peered":"2024-09-10T23:23:57.825510+0000","last_unstale":"2024-09-10T23:24:21.973866+0000","last_undegraded":"2024-09-10T23:24:21.973866+0000","last_fullsized":"2024-09-10T23:24:21.973866+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:43.816144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:47.236533+0000","last_change":"2024-09-10T23:23:54.791957+0000","last_active":"2024-09-10T23:24:47.236533+0000","last_peered":"2024-09-10T23:24:47.236533+0000","last_clean":"2024-09-10T23:24:47.236533+0000","last_became_active":"2024-09-10T23:23:54.791607+0000","last_became_peered":"2024-09-10T23:23:54.791607+0000","last_unstale":"2024-09-10T23:24:47.236533+0000","last_undegraded":"2024-09-10T23:24:47.236533+0000","last_fullsized":"2024-09-10T23:24:47.236533+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:00:47.600299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.967912+0000","last_change":"2024-09-10T23:24:05.884275+0000","last_active":"2024-09-10T23:24:21.967912+0000","last_peered":"2024-09-10T23:24:21.967912+0000","last_clean":"2024-09-10T23:24:21.967912+0000","last_became_active":"2024-09-10T23:24:05.882340+0000","last_became_peered":"2024-09-10T23:24:05.882340+0000","last_unstale":"2024-09-10T23:24:21.967912+0000","last_undegraded":"2024-09-10T23:24:21.967912+0000","last_fullsized":"2024-09-10T23:24:21.967912+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:15.243993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973617+0000","last_change":"2024-09-10T23:23:57.828322+0000","last_active":"2024-09-10T23:24:21.973617+0000","last_peered":"2024-09-10T23:24:21.973617+0000","last_clean":"2024-09-10T23:24:21.973617+0000","last_became_active":"2024-09-10T23:23:57.827925+0000","last_became_peered":"2024-09-10T23:23:57.827925+0000","last_unstale":"2024-09-10T23:24:21.973617+0000","last_undegraded":"2024-09-10T23:24:21.973617+0000","last_fullsized":"2024-09-10T23:24:21.973617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:55.214207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973889+0000","last_change":"2024-09-10T23:23:54.789507+0000","last_active":"2024-09-10T23:24:21.973889+0000","last_peered":"2024-09-10T23:24:21.973889+0000","last_clean":"2024-09-10T23:24:21.973889+0000","last_became_active":"2024-09-10T23:23:54.789120+0000","last_became_peered":"2024-09-10T23:23:54.789120+0000","last_unstale":"2024-09-10T23:24:21.973889+0000","last_undegraded":"2024-09-10T23:24:21.973889+0000","last_fullsized":"2024-09-10T23:24:21.973889+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:58.033953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.965204+0000","last_change":"2024-09-10T23:24:05.881015+0000","last_active":"2024-09-10T23:24:21.965204+0000","last_peered":"2024-09-10T23:24:21.965204+0000","last_clean":"2024-09-10T23:24:21.965204+0000","last_became_active":"2024-09-10T23:24:05.880261+0000","last_became_peered":"2024-09-10T23:24:05.880261+0000","last_unstale":"2024-09-10T23:24:21.965204+0000","last_undegraded":"2024-09-10T23:24:21.965204+0000","last_fullsized":"2024-09-10T23:24:21.965204+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:13:36.937503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.974422+0000","last_change":"2024-09-10T23:23:57.842018+0000","last_active":"2024-09-10T23:24:21.974422+0000","last_peered":"2024-09-10T23:24:21.974422+0000","last_clean":"2024-09-10T23:24:21.974422+0000","last_became_active":"2024-09-10T23:23:57.841669+0000","last_became_peered":"2024-09-10T23:23:57.841669+0000","last_unstale":"2024-09-10T23:24:21.974422+0000","last_undegraded":"2024-09-10T23:24:21.974422+0000","last_fullsized":"2024-09-10T23:24:21.974422+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:11.619741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971178+0000","last_change":"2024-09-10T23:23:54.794565+0000","last_active":"2024-09-10T23:24:21.971178+0000","last_peered":"2024-09-10T23:24:21.971178+0000","last_clean":"2024-09-10T23:24:21.971178+0000","last_became_active":"2024-09-10T23:23:54.793794+0000","last_became_peered":"2024-09-10T23:23:54.793794+0000","last_unstale":"2024-09-10T23:24:21.971178+0000","last_undegraded":"2024-09-10T23:24:21.971178+0000","last_fullsized":"2024-09-10T23:24:21.971178+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:42.665924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973350+0000","last_change":"2024-09-10T23:24:05.883706+0000","last_active":"2024-09-10T23:24:21.973350+0000","last_peered":"2024-09-10T23:24:21.973350+0000","last_clean":"2024-09-10T23:24:21.973350+0000","last_became_active":"2024-09-10T23:24:05.881621+0000","last_became_peered":"2024-09-10T23:24:05.881621+0000","last_unstale":"2024-09-10T23:24:21.973350+0000","last_undegraded":"2024-09-10T23:24:21.973350+0000","last_fullsized":"2024-09-10T23:24:21.973350+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:23.468331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971770+0000","last_change":"2024-09-10T23:23:57.834504+0000","last_active":"2024-09-10T23:24:21.971770+0000","last_peered":"2024-09-10T23:24:21.971770+0000","last_clean":"2024-09-10T23:24:21.971770+0000","last_became_active":"2024-09-10T23:23:57.834105+0000","last_became_peered":"2024-09-10T23:23:57.834105+0000","last_unstale":"2024-09-10T23:24:21.971770+0000","last_undegraded":"2024-09-10T23:24:21.971770+0000","last_fullsized":"2024-09-10T23:24:21.971770+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:03.539763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'4","reported_seq":59,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:25:01.276406+0000","last_change":"2024-09-10T23:23:54.796519+0000","last_active":"2024-09-10T23:25:01.276406+0000","last_peered":"2024-09-10T23:25:01.276406+0000","last_clean":"2024-09-10T23:25:01.276406+0000","last_became_active":"2024-09-10T23:23:54.795174+0000","last_became_peered":"2024-09-10T23:23:54.795174+0000","last_unstale":"2024-09-10T23:25:01.276406+0000","last_undegraded":"2024-09-10T23:25:01.276406+0000","last_fullsized":"2024-09-10T23:25:01.276406+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:53.622935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973682+0000","last_change":"2024-09-10T23:24:05.884496+0000","last_active":"2024-09-10T23:24:21.973682+0000","last_peered":"2024-09-10T23:24:21.973682+0000","last_clean":"2024-09-10T23:24:21.973682+0000","last_became_active":"2024-09-10T23:24:05.883659+0000","last_became_peered":"2024-09-10T23:24:05.883659+0000","last_unstale":"2024-09-10T23:24:21.973682+0000","last_undegraded":"2024-09-10T23:24:21.973682+0000","last_fullsized":"2024-09-10T23:24:21.973682+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:23.449830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972837+0000","last_change":"2024-09-10T23:23:57.842436+0000","last_active":"2024-09-10T23:24:21.972837+0000","last_peered":"2024-09-10T23:24:21.972837+0000","last_clean":"2024-09-10T23:24:21.972837+0000","last_became_active":"2024-09-10T23:23:57.842054+0000","last_became_peered":"2024-09-10T23:23:57.842054+0000","last_unstale":"2024-09-10T23:24:21.972837+0000","last_undegraded":"2024-09-10T23:24:21.972837+0000","last_fullsized":"2024-09-10T23:24:21.972837+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:07.234201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:48.246954+0000","last_change":"2024-09-10T23:24:21.974615+0000","last_active":"2024-09-10T23:24:48.246954+0000","last_peered":"2024-09-10T23:24:48.246954+0000","last_clean":"2024-09-10T23:24:48.246954+0000","last_became_active":"2024-09-10T23:24:21.974129+0000","last_became_peered":"2024-09-10T23:24:21.974129+0000","last_unstale":"2024-09-10T23:24:48.246954+0000","last_undegraded":"2024-09-10T23:24:48.246954+0000","last_fullsized":"2024-09-10T23:24:48.246954+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:11.510005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973879+0000","last_change":"2024-09-10T23:24:05.887848+0000","last_active":"2024-09-10T23:24:21.973879+0000","last_peered":"2024-09-10T23:24:21.973879+0000","last_clean":"2024-09-10T23:24:21.973879+0000","last_became_active":"2024-09-10T23:24:05.886426+0000","last_became_peered":"2024-09-10T23:24:05.886426+0000","last_unstale":"2024-09-10T23:24:21.973879+0000","last_undegraded":"2024-09-10T23:24:21.973879+0000","last_fullsized":"2024-09-10T23:24:21.973879+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:46:51.756285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972184+0000","last_change":"2024-09-10T23:23:57.828722+0000","last_active":"2024-09-10T23:24:21.972184+0000","last_peered":"2024-09-10T23:24:21.972184+0000","last_clean":"2024-09-10T23:24:21.972184+0000","last_became_active":"2024-09-10T23:23:57.828373+0000","last_became_peered":"2024-09-10T23:23:57.828373+0000","last_unstale":"2024-09-10T23:24:21.972184+0000","last_undegraded":"2024-09-10T23:24:21.972184+0000","last_fullsized":"2024-09-10T23:24:21.972184+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:19.891684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:49.252766+0000","last_change":"2024-09-10T23:23:54.789584+0000","last_active":"2024-09-10T23:24:49.252766+0000","last_peered":"2024-09-10T23:24:49.252766+0000","last_clean":"2024-09-10T23:24:49.252766+0000","last_became_active":"2024-09-10T23:23:54.789166+0000","last_became_peered":"2024-09-10T23:23:54.789166+0000","last_unstale":"2024-09-10T23:24:49.252766+0000","last_undegraded":"2024-09-10T23:24:49.252766+0000","last_fullsized":"2024-09-10T23:24:49.252766+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:02.292384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":117,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971320+0000","last_change":"2024-09-10T23:22:28.076475+0000","last_active":"2024-09-10T23:24:21.971320+0000","last_peered":"2024-09-10T23:24:21.971320+0000","last_clean":"2024-09-10T23:24:21.971320+0000","last_became_active":"2024-09-10T23:22:28.070622+0000","last_became_peered":"2024-09-10T23:22:28.070622+0000","last_unstale":"2024-09-10T23:24:21.971320+0000","last_undegraded":"2024-09-10T23:24:21.971320+0000","last_fullsized":"2024-09-10T23:24:21.971320+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:28.022462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:28.022462+0000","last_clean_scrub_stamp":"2024-09-10T23:18:28.022462+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:46:16.329399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971335+0000","last_change":"2024-09-10T23:24:05.884647+0000","last_active":"2024-09-10T23:24:21.971335+0000","last_peered":"2024-09-10T23:24:21.971335+0000","last_clean":"2024-09-10T23:24:21.971335+0000","last_became_active":"2024-09-10T23:24:05.883476+0000","last_became_peered":"2024-09-10T23:24:05.883476+0000","last_unstale":"2024-09-10T23:24:21.971335+0000","last_undegraded":"2024-09-10T23:24:21.971335+0000","last_fullsized":"2024-09-10T23:24:21.971335+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:02.524767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971536+0000","last_change":"2024-09-10T23:23:57.840835+0000","last_active":"2024-09-10T23:24:21.971536+0000","last_peered":"2024-09-10T23:24:21.971536+0000","last_clean":"2024-09-10T23:24:21.971536+0000","last_became_active":"2024-09-10T23:23:57.840472+0000","last_became_peered":"2024-09-10T23:23:57.840472+0000","last_unstale":"2024-09-10T23:24:21.971536+0000","last_undegraded":"2024-09-10T23:24:21.971536+0000","last_fullsized":"2024-09-10T23:24:21.971536+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:18.050686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:48.248827+0000","last_change":"2024-09-10T23:23:55.081669+0000","last_active":"2024-09-10T23:24:48.248827+0000","last_peered":"2024-09-10T23:24:48.248827+0000","last_clean":"2024-09-10T23:24:48.248827+0000","last_became_active":"2024-09-10T23:23:55.081306+0000","last_became_peered":"2024-09-10T23:23:55.081306+0000","last_unstale":"2024-09-10T23:24:48.248827+0000","last_undegraded":"2024-09-10T23:24:48.248827+0000","last_fullsized":"2024-09-10T23:24:48.248827+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:54.968431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972265+0000","last_change":"2024-09-10T23:24:05.880876+0000","last_active":"2024-09-10T23:24:21.972265+0000","last_peered":"2024-09-10T23:24:21.972265+0000","last_clean":"2024-09-10T23:24:21.972265+0000","last_became_active":"2024-09-10T23:24:05.880504+0000","last_became_peered":"2024-09-10T23:24:05.880504+0000","last_unstale":"2024-09-10T23:24:21.972265+0000","last_undegraded":"2024-09-10T23:24:21.972265+0000","last_fullsized":"2024-09-10T23:24:21.972265+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:17:55.689134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971589+0000","last_change":"2024-09-10T23:23:57.826637+0000","last_active":"2024-09-10T23:24:21.971589+0000","last_peered":"2024-09-10T23:24:21.971589+0000","last_clean":"2024-09-10T23:24:21.971589+0000","last_became_active":"2024-09-10T23:23:57.825915+0000","last_became_peered":"2024-09-10T23:23:57.825915+0000","last_unstale":"2024-09-10T23:24:21.971589+0000","last_undegraded":"2024-09-10T23:24:21.971589+0000","last_fullsized":"2024-09-10T23:24:21.971589+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:55.281687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.974360+0000","last_change":"2024-09-10T23:23:54.789847+0000","last_active":"2024-09-10T23:24:21.974360+0000","last_peered":"2024-09-10T23:24:21.974360+0000","last_clean":"2024-09-10T23:24:21.974360+0000","last_became_active":"2024-09-10T23:23:54.789082+0000","last_became_peered":"2024-09-10T23:23:54.789082+0000","last_unstale":"2024-09-10T23:24:21.974360+0000","last_undegraded":"2024-09-10T23:24:21.974360+0000","last_fullsized":"2024-09-10T23:24:21.974360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:39:16.162317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.968326+0000","last_change":"2024-09-10T23:24:05.895799+0000","last_active":"2024-09-10T23:24:21.968326+0000","last_peered":"2024-09-10T23:24:21.968326+0000","last_clean":"2024-09-10T23:24:21.968326+0000","last_became_active":"2024-09-10T23:24:05.895361+0000","last_became_peered":"2024-09-10T23:24:05.895361+0000","last_unstale":"2024-09-10T23:24:21.968326+0000","last_undegraded":"2024-09-10T23:24:21.968326+0000","last_fullsized":"2024-09-10T23:24:21.968326+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:10.893000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971780+0000","last_change":"2024-09-10T23:23:57.834954+0000","last_active":"2024-09-10T23:24:21.971780+0000","last_peered":"2024-09-10T23:24:21.971780+0000","last_clean":"2024-09-10T23:24:21.971780+0000","last_became_active":"2024-09-10T23:23:57.834215+0000","last_became_peered":"2024-09-10T23:23:57.834215+0000","last_unstale":"2024-09-10T23:24:21.971780+0000","last_undegraded":"2024-09-10T23:24:21.971780+0000","last_fullsized":"2024-09-10T23:24:21.971780+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:19:42.051352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:22.301120+0000","last_change":"2024-09-10T23:24:22.301029+0000","last_active":"2024-09-10T23:24:22.301120+0000","last_peered":"2024-09-10T23:24:22.301120+0000","last_clean":"2024-09-10T23:24:22.301120+0000","last_became_active":"2024-09-10T23:24:22.297759+0000","last_became_peered":"2024-09-10T23:24:22.297759+0000","last_unstale":"2024-09-10T23:24:22.301120+0000","last_undegraded":"2024-09-10T23:24:22.301120+0000","last_fullsized":"2024-09-10T23:24:22.301120+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:05.364737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971346+0000","last_change":"2024-09-10T23:24:05.884172+0000","last_active":"2024-09-10T23:24:21.971346+0000","last_peered":"2024-09-10T23:24:21.971346+0000","last_clean":"2024-09-10T23:24:21.971346+0000","last_became_active":"2024-09-10T23:24:05.881918+0000","last_became_peered":"2024-09-10T23:24:05.881918+0000","last_unstale":"2024-09-10T23:24:21.971346+0000","last_undegraded":"2024-09-10T23:24:21.971346+0000","last_fullsized":"2024-09-10T23:24:21.971346+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:19:15.250926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:22.297283+0000","last_change":"2024-09-10T23:24:22.297163+0000","last_active":"2024-09-10T23:24:22.297283+0000","last_peered":"2024-09-10T23:24:22.297283+0000","last_clean":"2024-09-10T23:24:22.297283+0000","last_became_active":"2024-09-10T23:24:22.296751+0000","last_became_peered":"2024-09-10T23:24:22.296751+0000","last_unstale":"2024-09-10T23:24:22.297283+0000","last_undegraded":"2024-09-10T23:24:22.297283+0000","last_fullsized":"2024-09-10T23:24:22.297283+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:37:50.379101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:49.252398+0000","last_change":"2024-09-10T23:23:54.788008+0000","last_active":"2024-09-10T23:24:49.252398+0000","last_peered":"2024-09-10T23:24:49.252398+0000","last_clean":"2024-09-10T23:24:49.252398+0000","last_became_active":"2024-09-10T23:23:54.787702+0000","last_became_peered":"2024-09-10T23:23:54.787702+0000","last_unstale":"2024-09-10T23:24:49.252398+0000","last_undegraded":"2024-09-10T23:24:49.252398+0000","last_fullsized":"2024-09-10T23:24:49.252398+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:45.997467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972396+0000","last_change":"2024-09-10T23:24:05.887208+0000","last_active":"2024-09-10T23:24:21.972396+0000","last_peered":"2024-09-10T23:24:21.972396+0000","last_clean":"2024-09-10T23:24:21.972396+0000","last_became_active":"2024-09-10T23:24:05.885556+0000","last_became_peered":"2024-09-10T23:24:05.885556+0000","last_unstale":"2024-09-10T23:24:21.972396+0000","last_undegraded":"2024-09-10T23:24:21.972396+0000","last_fullsized":"2024-09-10T23:24:21.972396+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:21.843558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972698+0000","last_change":"2024-09-10T23:23:57.842937+0000","last_active":"2024-09-10T23:24:21.972698+0000","last_peered":"2024-09-10T23:24:21.972698+0000","last_clean":"2024-09-10T23:24:21.972698+0000","last_became_active":"2024-09-10T23:23:57.842158+0000","last_became_peered":"2024-09-10T23:23:57.842158+0000","last_unstale":"2024-09-10T23:24:21.972698+0000","last_undegraded":"2024-09-10T23:24:21.972698+0000","last_fullsized":"2024-09-10T23:24:21.972698+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:49:58.716816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":57,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:48.248651+0000","last_change":"2024-09-10T23:23:54.787515+0000","last_active":"2024-09-10T23:24:48.248651+0000","last_peered":"2024-09-10T23:24:48.248651+0000","last_clean":"2024-09-10T23:24:48.248651+0000","last_became_active":"2024-09-10T23:23:54.786950+0000","last_became_peered":"2024-09-10T23:23:54.786950+0000","last_unstale":"2024-09-10T23:24:48.248651+0000","last_undegraded":"2024-09-10T23:24:48.248651+0000","last_fullsized":"2024-09-10T23:24:48.248651+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:12.546459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973072+0000","last_change":"2024-09-10T23:24:05.882784+0000","last_active":"2024-09-10T23:24:21.973072+0000","last_peered":"2024-09-10T23:24:21.973072+0000","last_clean":"2024-09-10T23:24:21.973072+0000","last_became_active":"2024-09-10T23:24:05.882331+0000","last_became_peered":"2024-09-10T23:24:05.882331+0000","last_unstale":"2024-09-10T23:24:21.973072+0000","last_undegraded":"2024-09-10T23:24:21.973072+0000","last_fullsized":"2024-09-10T23:24:21.973072+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:51:42.519144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.970370+0000","last_change":"2024-09-10T23:23:57.827896+0000","last_active":"2024-09-10T23:24:21.970370+0000","last_peered":"2024-09-10T23:24:21.970370+0000","last_clean":"2024-09-10T23:24:21.970370+0000","last_became_active":"2024-09-10T23:23:57.827572+0000","last_became_peered":"2024-09-10T23:23:57.827572+0000","last_unstale":"2024-09-10T23:24:21.970370+0000","last_undegraded":"2024-09-10T23:24:21.970370+0000","last_fullsized":"2024-09-10T23:24:21.970370+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:11.126594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'4","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:25:01.277274+0000","last_change":"2024-09-10T23:23:54.795582+0000","last_active":"2024-09-10T23:25:01.277274+0000","last_peered":"2024-09-10T23:25:01.277274+0000","last_clean":"2024-09-10T23:25:01.277274+0000","last_became_active":"2024-09-10T23:23:54.795225+0000","last_became_peered":"2024-09-10T23:23:54.795225+0000","last_unstale":"2024-09-10T23:25:01.277274+0000","last_undegraded":"2024-09-10T23:25:01.277274+0000","last_fullsized":"2024-09-10T23:25:01.277274+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:11.827090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.974398+0000","last_change":"2024-09-10T23:24:05.890159+0000","last_active":"2024-09-10T23:24:21.974398+0000","last_peered":"2024-09-10T23:24:21.974398+0000","last_clean":"2024-09-10T23:24:21.974398+0000","last_became_active":"2024-09-10T23:24:05.889583+0000","last_became_peered":"2024-09-10T23:24:05.889583+0000","last_unstale":"2024-09-10T23:24:21.974398+0000","last_undegraded":"2024-09-10T23:24:21.974398+0000","last_fullsized":"2024-09-10T23:24:21.974398+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:38.022627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971471+0000","last_change":"2024-09-10T23:23:57.843899+0000","last_active":"2024-09-10T23:24:21.971471+0000","last_peered":"2024-09-10T23:24:21.971471+0000","last_clean":"2024-09-10T23:24:21.971471+0000","last_became_active":"2024-09-10T23:23:57.843590+0000","last_became_peered":"2024-09-10T23:23:57.843590+0000","last_unstale":"2024-09-10T23:24:21.971471+0000","last_undegraded":"2024-09-10T23:24:21.971471+0000","last_fullsized":"2024-09-10T23:24:21.971471+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:32:17.919904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:47.240610+0000","last_change":"2024-09-10T23:23:54.795091+0000","last_active":"2024-09-10T23:24:47.240610+0000","last_peered":"2024-09-10T23:24:47.240610+0000","last_clean":"2024-09-10T23:24:47.240610+0000","last_became_active":"2024-09-10T23:23:54.794726+0000","last_became_peered":"2024-09-10T23:23:54.794726+0000","last_unstale":"2024-09-10T23:24:47.240610+0000","last_undegraded":"2024-09-10T23:24:47.240610+0000","last_fullsized":"2024-09-10T23:24:47.240610+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:56:20.322532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.968800+0000","last_change":"2024-09-10T23:24:05.881074+0000","last_active":"2024-09-10T23:24:21.968800+0000","last_peered":"2024-09-10T23:24:21.968800+0000","last_clean":"2024-09-10T23:24:21.968800+0000","last_became_active":"2024-09-10T23:24:05.880699+0000","last_became_peered":"2024-09-10T23:24:05.880699+0000","last_unstale":"2024-09-10T23:24:21.968800+0000","last_undegraded":"2024-09-10T23:24:21.968800+0000","last_fullsized":"2024-09-10T23:24:21.968800+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:38:22.268698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972953+0000","last_change":"2024-09-10T23:23:57.823729+0000","last_active":"2024-09-10T23:24:21.972953+0000","last_peered":"2024-09-10T23:24:21.972953+0000","last_clean":"2024-09-10T23:24:21.972953+0000","last_became_active":"2024-09-10T23:23:57.822797+0000","last_became_peered":"2024-09-10T23:23:57.822797+0000","last_unstale":"2024-09-10T23:24:21.972953+0000","last_undegraded":"2024-09-10T23:24:21.972953+0000","last_fullsized":"2024-09-10T23:24:21.972953+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:09.646543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:48.247363+0000","last_change":"2024-09-10T23:24:21.985389+0000","last_active":"2024-09-10T23:24:48.247363+0000","last_peered":"2024-09-10T23:24:48.247363+0000","last_clean":"2024-09-10T23:24:48.247363+0000","last_became_active":"2024-09-10T23:24:21.976084+0000","last_became_peered":"2024-09-10T23:24:21.976084+0000","last_unstale":"2024-09-10T23:24:48.247363+0000","last_undegraded":"2024-09-10T23:24:48.247363+0000","last_fullsized":"2024-09-10T23:24:48.247363+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:33.284211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973931+0000","last_change":"2024-09-10T23:24:05.890656+0000","last_active":"2024-09-10T23:24:21.973931+0000","last_peered":"2024-09-10T23:24:21.973931+0000","last_clean":"2024-09-10T23:24:21.973931+0000","last_became_active":"2024-09-10T23:24:05.889827+0000","last_became_peered":"2024-09-10T23:24:05.889827+0000","last_unstale":"2024-09-10T23:24:21.973931+0000","last_undegraded":"2024-09-10T23:24:21.973931+0000","last_fullsized":"2024-09-10T23:24:21.973931+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:15.301567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.965674+0000","last_change":"2024-09-10T23:23:57.827348+0000","last_active":"2024-09-10T23:24:21.965674+0000","last_peered":"2024-09-10T23:24:21.965674+0000","last_clean":"2024-09-10T23:24:21.965674+0000","last_became_active":"2024-09-10T23:23:57.826670+0000","last_became_peered":"2024-09-10T23:23:57.826670+0000","last_unstale":"2024-09-10T23:24:21.965674+0000","last_undegraded":"2024-09-10T23:24:21.965674+0000","last_fullsized":"2024-09-10T23:24:21.965674+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:19.268930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"88'29","reported_seq":112,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:25:06.285774+0000","last_change":"2024-09-10T23:23:54.789603+0000","last_active":"2024-09-10T23:25:06.285774+0000","last_peered":"2024-09-10T23:25:06.285774+0000","last_clean":"2024-09-10T23:25:06.285774+0000","last_became_active":"2024-09-10T23:23:54.789136+0000","last_became_peered":"2024-09-10T23:23:54.789136+0000","last_unstale":"2024-09-10T23:25:06.285774+0000","last_undegraded":"2024-09-10T23:25:06.285774+0000","last_fullsized":"2024-09-10T23:25:06.285774+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:47.648232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57254,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":76,"num_write":30,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973433+0000","last_change":"2024-09-10T23:24:05.883758+0000","last_active":"2024-09-10T23:24:21.973433+0000","last_peered":"2024-09-10T23:24:21.973433+0000","last_clean":"2024-09-10T23:24:21.973433+0000","last_became_active":"2024-09-10T23:24:05.883401+0000","last_became_peered":"2024-09-10T23:24:05.883401+0000","last_unstale":"2024-09-10T23:24:21.973433+0000","last_undegraded":"2024-09-10T23:24:21.973433+0000","last_fullsized":"2024-09-10T23:24:21.973433+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:52.862088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973201+0000","last_change":"2024-09-10T23:23:57.846524+0000","last_active":"2024-09-10T23:24:21.973201+0000","last_peered":"2024-09-10T23:24:21.973201+0000","last_clean":"2024-09-10T23:24:21.973201+0000","last_became_active":"2024-09-10T23:23:57.846036+0000","last_became_peered":"2024-09-10T23:23:57.846036+0000","last_unstale":"2024-09-10T23:24:21.973201+0000","last_undegraded":"2024-09-10T23:24:21.973201+0000","last_fullsized":"2024-09-10T23:24:21.973201+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:13.866827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:47.239944+0000","last_change":"2024-09-10T23:23:54.789925+0000","last_active":"2024-09-10T23:24:47.239944+0000","last_peered":"2024-09-10T23:24:47.239944+0000","last_clean":"2024-09-10T23:24:47.239944+0000","last_became_active":"2024-09-10T23:23:54.789600+0000","last_became_peered":"2024-09-10T23:23:54.789600+0000","last_unstale":"2024-09-10T23:24:47.239944+0000","last_undegraded":"2024-09-10T23:24:47.239944+0000","last_fullsized":"2024-09-10T23:24:47.239944+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:54.937422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:22.295875+0000","last_change":"2024-09-10T23:24:05.882530+0000","last_active":"2024-09-10T23:24:22.295875+0000","last_peered":"2024-09-10T23:24:22.295875+0000","last_clean":"2024-09-10T23:24:22.295875+0000","last_became_active":"2024-09-10T23:24:05.881092+0000","last_became_peered":"2024-09-10T23:24:05.881092+0000","last_unstale":"2024-09-10T23:24:22.295875+0000","last_undegraded":"2024-09-10T23:24:22.295875+0000","last_fullsized":"2024-09-10T23:24:22.295875+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:54.954300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.968620+0000","last_change":"2024-09-10T23:23:57.837341+0000","last_active":"2024-09-10T23:24:21.968620+0000","last_peered":"2024-09-10T23:24:21.968620+0000","last_clean":"2024-09-10T23:24:21.968620+0000","last_became_active":"2024-09-10T23:23:57.837024+0000","last_became_peered":"2024-09-10T23:23:57.837024+0000","last_unstale":"2024-09-10T23:24:21.968620+0000","last_undegraded":"2024-09-10T23:24:21.968620+0000","last_fullsized":"2024-09-10T23:24:21.968620+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:22:48.241471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:47.238857+0000","last_change":"2024-09-10T23:23:54.792028+0000","last_active":"2024-09-10T23:24:47.238857+0000","last_peered":"2024-09-10T23:24:47.238857+0000","last_clean":"2024-09-10T23:24:47.238857+0000","last_became_active":"2024-09-10T23:23:54.791589+0000","last_became_peered":"2024-09-10T23:23:54.791589+0000","last_unstale":"2024-09-10T23:24:47.238857+0000","last_undegraded":"2024-09-10T23:24:47.238857+0000","last_fullsized":"2024-09-10T23:24:47.238857+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:48.589441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972529+0000","last_change":"2024-09-10T23:24:05.888627+0000","last_active":"2024-09-10T23:24:21.972529+0000","last_peered":"2024-09-10T23:24:21.972529+0000","last_clean":"2024-09-10T23:24:21.972529+0000","last_became_active":"2024-09-10T23:24:05.887925+0000","last_became_peered":"2024-09-10T23:24:05.887925+0000","last_unstale":"2024-09-10T23:24:21.972529+0000","last_undegraded":"2024-09-10T23:24:21.972529+0000","last_fullsized":"2024-09-10T23:24:21.972529+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:15.956333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973375+0000","last_change":"2024-09-10T23:23:57.833009+0000","last_active":"2024-09-10T23:24:21.973375+0000","last_peered":"2024-09-10T23:24:21.973375+0000","last_clean":"2024-09-10T23:24:21.973375+0000","last_became_active":"2024-09-10T23:23:57.830782+0000","last_became_peered":"2024-09-10T23:23:57.830782+0000","last_unstale":"2024-09-10T23:24:21.973375+0000","last_undegraded":"2024-09-10T23:24:21.973375+0000","last_fullsized":"2024-09-10T23:24:21.973375+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:42.520461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"88'3","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:25:05.283554+0000","last_change":"2024-09-10T23:23:54.789322+0000","last_active":"2024-09-10T23:25:05.283554+0000","last_peered":"2024-09-10T23:25:05.283554+0000","last_clean":"2024-09-10T23:25:05.283554+0000","last_became_active":"2024-09-10T23:23:54.788879+0000","last_became_peered":"2024-09-10T23:23:54.788879+0000","last_unstale":"2024-09-10T23:25:05.283554+0000","last_undegraded":"2024-09-10T23:25:05.283554+0000","last_fullsized":"2024-09-10T23:25:05.283554+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:37.276413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971758+0000","last_change":"2024-09-10T23:24:05.886626+0000","last_active":"2024-09-10T23:24:21.971758+0000","last_peered":"2024-09-10T23:24:21.971758+0000","last_clean":"2024-09-10T23:24:21.971758+0000","last_became_active":"2024-09-10T23:24:05.886076+0000","last_became_peered":"2024-09-10T23:24:05.886076+0000","last_unstale":"2024-09-10T23:24:21.971758+0000","last_undegraded":"2024-09-10T23:24:21.971758+0000","last_fullsized":"2024-09-10T23:24:21.971758+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:44.987664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.968409+0000","last_change":"2024-09-10T23:24:05.891242+0000","last_active":"2024-09-10T23:24:21.968409+0000","last_peered":"2024-09-10T23:24:21.968409+0000","last_clean":"2024-09-10T23:24:21.968409+0000","last_became_active":"2024-09-10T23:24:05.889513+0000","last_became_peered":"2024-09-10T23:24:05.889513+0000","last_unstale":"2024-09-10T23:24:21.968409+0000","last_undegraded":"2024-09-10T23:24:21.968409+0000","last_fullsized":"2024-09-10T23:24:21.968409+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:07.774304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.974198+0000","last_change":"2024-09-10T23:23:57.831698+0000","last_active":"2024-09-10T23:24:21.974198+0000","last_peered":"2024-09-10T23:24:21.974198+0000","last_clean":"2024-09-10T23:24:21.974198+0000","last_became_active":"2024-09-10T23:23:57.829348+0000","last_became_peered":"2024-09-10T23:23:57.829348+0000","last_unstale":"2024-09-10T23:24:21.974198+0000","last_undegraded":"2024-09-10T23:24:21.974198+0000","last_fullsized":"2024-09-10T23:24:21.974198+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:09.636786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972156+0000","last_change":"2024-09-10T23:23:54.795380+0000","last_active":"2024-09-10T23:24:21.972156+0000","last_peered":"2024-09-10T23:24:21.972156+0000","last_clean":"2024-09-10T23:24:21.972156+0000","last_became_active":"2024-09-10T23:23:54.794465+0000","last_became_peered":"2024-09-10T23:23:54.794465+0000","last_unstale":"2024-09-10T23:24:21.972156+0000","last_undegraded":"2024-09-10T23:24:21.972156+0000","last_fullsized":"2024-09-10T23:24:21.972156+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:32.082020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.968010+0000","last_change":"2024-09-10T23:24:05.886531+0000","last_active":"2024-09-10T23:24:21.968010+0000","last_peered":"2024-09-10T23:24:21.968010+0000","last_clean":"2024-09-10T23:24:21.968010+0000","last_became_active":"2024-09-10T23:24:05.885762+0000","last_became_peered":"2024-09-10T23:24:05.885762+0000","last_unstale":"2024-09-10T23:24:21.968010+0000","last_undegraded":"2024-09-10T23:24:21.968010+0000","last_fullsized":"2024-09-10T23:24:21.968010+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:35.407364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972187+0000","last_change":"2024-09-10T23:23:57.828052+0000","last_active":"2024-09-10T23:24:21.972187+0000","last_peered":"2024-09-10T23:24:21.972187+0000","last_clean":"2024-09-10T23:24:21.972187+0000","last_became_active":"2024-09-10T23:23:57.827653+0000","last_became_peered":"2024-09-10T23:23:57.827653+0000","last_unstale":"2024-09-10T23:24:21.972187+0000","last_undegraded":"2024-09-10T23:24:21.972187+0000","last_fullsized":"2024-09-10T23:24:21.972187+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:33.605054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:48.248830+0000","last_change":"2024-09-10T23:23:54.791375+0000","last_active":"2024-09-10T23:24:48.248830+0000","last_peered":"2024-09-10T23:24:48.248830+0000","last_clean":"2024-09-10T23:24:48.248830+0000","last_became_active":"2024-09-10T23:23:54.790974+0000","last_became_peered":"2024-09-10T23:23:54.790974+0000","last_unstale":"2024-09-10T23:24:48.248830+0000","last_undegraded":"2024-09-10T23:24:48.248830+0000","last_fullsized":"2024-09-10T23:24:48.248830+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:23:44.066787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:48.247457+0000","last_change":"2024-09-10T23:23:54.792056+0000","last_active":"2024-09-10T23:24:48.247457+0000","last_peered":"2024-09-10T23:24:48.247457+0000","last_clean":"2024-09-10T23:24:48.247457+0000","last_became_active":"2024-09-10T23:23:54.791665+0000","last_became_peered":"2024-09-10T23:23:54.791665+0000","last_unstale":"2024-09-10T23:24:48.247457+0000","last_undegraded":"2024-09-10T23:24:48.247457+0000","last_fullsized":"2024-09-10T23:24:48.247457+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:34:38.517066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973941+0000","last_change":"2024-09-10T23:23:57.842524+0000","last_active":"2024-09-10T23:24:21.973941+0000","last_peered":"2024-09-10T23:24:21.973941+0000","last_clean":"2024-09-10T23:24:21.973941+0000","last_became_active":"2024-09-10T23:23:57.842033+0000","last_became_peered":"2024-09-10T23:23:57.842033+0000","last_unstale":"2024-09-10T23:24:21.973941+0000","last_undegraded":"2024-09-10T23:24:21.973941+0000","last_fullsized":"2024-09-10T23:24:21.973941+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:39.431115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971295+0000","last_change":"2024-09-10T23:24:05.891676+0000","last_active":"2024-09-10T23:24:21.971295+0000","last_peered":"2024-09-10T23:24:21.971295+0000","last_clean":"2024-09-10T23:24:21.971295+0000","last_became_active":"2024-09-10T23:24:05.891224+0000","last_became_peered":"2024-09-10T23:24:05.891224+0000","last_unstale":"2024-09-10T23:24:21.971295+0000","last_undegraded":"2024-09-10T23:24:21.971295+0000","last_fullsized":"2024-09-10T23:24:21.971295+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:16:50.384745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'5","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:25:01.277439+0000","last_change":"2024-09-10T23:23:54.795126+0000","last_active":"2024-09-10T23:25:01.277439+0000","last_peered":"2024-09-10T23:25:01.277439+0000","last_clean":"2024-09-10T23:25:01.277439+0000","last_became_active":"2024-09-10T23:23:54.794553+0000","last_became_peered":"2024-09-10T23:23:54.794553+0000","last_unstale":"2024-09-10T23:25:01.277439+0000","last_undegraded":"2024-09-10T23:25:01.277439+0000","last_fullsized":"2024-09-10T23:25:01.277439+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:15:43.181180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.965394+0000","last_change":"2024-09-10T23:23:57.826827+0000","last_active":"2024-09-10T23:24:21.965394+0000","last_peered":"2024-09-10T23:24:21.965394+0000","last_clean":"2024-09-10T23:24:21.965394+0000","last_became_active":"2024-09-10T23:23:57.826457+0000","last_became_peered":"2024-09-10T23:23:57.826457+0000","last_unstale":"2024-09-10T23:24:21.965394+0000","last_undegraded":"2024-09-10T23:24:21.965394+0000","last_fullsized":"2024-09-10T23:24:21.965394+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:13.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972285+0000","last_change":"2024-09-10T23:24:05.888774+0000","last_active":"2024-09-10T23:24:21.972285+0000","last_peered":"2024-09-10T23:24:21.972285+0000","last_clean":"2024-09-10T23:24:21.972285+0000","last_became_active":"2024-09-10T23:24:05.888267+0000","last_became_peered":"2024-09-10T23:24:05.888267+0000","last_unstale":"2024-09-10T23:24:21.972285+0000","last_undegraded":"2024-09-10T23:24:21.972285+0000","last_fullsized":"2024-09-10T23:24:21.972285+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:29.283509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.967718+0000","last_change":"2024-09-10T23:23:57.819178+0000","last_active":"2024-09-10T23:24:21.967718+0000","last_peered":"2024-09-10T23:24:21.967718+0000","last_clean":"2024-09-10T23:24:21.967718+0000","last_became_active":"2024-09-10T23:23:57.817029+0000","last_became_peered":"2024-09-10T23:23:57.817029+0000","last_unstale":"2024-09-10T23:24:21.967718+0000","last_undegraded":"2024-09-10T23:24:21.967718+0000","last_fullsized":"2024-09-10T23:24:21.967718+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:28:51.491402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.978330+0000","last_change":"2024-09-10T23:24:21.978215+0000","last_active":"2024-09-10T23:24:21.978330+0000","last_peered":"2024-09-10T23:24:21.978330+0000","last_clean":"2024-09-10T23:24:21.978330+0000","last_became_active":"2024-09-10T23:24:21.977811+0000","last_became_peered":"2024-09-10T23:24:21.977811+0000","last_unstale":"2024-09-10T23:24:21.978330+0000","last_undegraded":"2024-09-10T23:24:21.978330+0000","last_fullsized":"2024-09-10T23:24:21.978330+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:41.769216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972164+0000","last_change":"2024-09-10T23:23:57.824147+0000","last_active":"2024-09-10T23:24:21.972164+0000","last_peered":"2024-09-10T23:24:21.972164+0000","last_clean":"2024-09-10T23:24:21.972164+0000","last_became_active":"2024-09-10T23:23:57.823503+0000","last_became_peered":"2024-09-10T23:23:57.823503+0000","last_unstale":"2024-09-10T23:24:21.972164+0000","last_undegraded":"2024-09-10T23:24:21.972164+0000","last_fullsized":"2024-09-10T23:24:21.972164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:12:34.310648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.968432+0000","last_change":"2024-09-10T23:23:57.841413+0000","last_active":"2024-09-10T23:24:21.968432+0000","last_peered":"2024-09-10T23:24:21.968432+0000","last_clean":"2024-09-10T23:24:21.968432+0000","last_became_active":"2024-09-10T23:23:57.840889+0000","last_became_peered":"2024-09-10T23:23:57.840889+0000","last_unstale":"2024-09-10T23:24:21.968432+0000","last_undegraded":"2024-09-10T23:24:21.968432+0000","last_fullsized":"2024-09-10T23:24:21.968432+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:10:08.757628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973456+0000","last_change":"2024-09-10T23:23:57.837267+0000","last_active":"2024-09-10T23:24:21.973456+0000","last_peered":"2024-09-10T23:24:21.973456+0000","last_clean":"2024-09-10T23:24:21.973456+0000","last_became_active":"2024-09-10T23:23:57.836911+0000","last_became_peered":"2024-09-10T23:23:57.836911+0000","last_unstale":"2024-09-10T23:24:21.973456+0000","last_undegraded":"2024-09-10T23:24:21.973456+0000","last_fullsized":"2024-09-10T23:24:21.973456+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:24.969215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.968413+0000","last_change":"2024-09-10T23:23:57.813855+0000","last_active":"2024-09-10T23:24:21.968413+0000","last_peered":"2024-09-10T23:24:21.968413+0000","last_clean":"2024-09-10T23:24:21.968413+0000","last_became_active":"2024-09-10T23:23:57.812862+0000","last_became_peered":"2024-09-10T23:23:57.812862+0000","last_unstale":"2024-09-10T23:24:21.968413+0000","last_undegraded":"2024-09-10T23:24:21.968413+0000","last_fullsized":"2024-09-10T23:24:21.968413+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:21.542499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972877+0000","last_change":"2024-09-10T23:23:57.826082+0000","last_active":"2024-09-10T23:24:21.972877+0000","last_peered":"2024-09-10T23:24:21.972877+0000","last_clean":"2024-09-10T23:24:21.972877+0000","last_became_active":"2024-09-10T23:23:57.825695+0000","last_became_peered":"2024-09-10T23:23:57.825695+0000","last_unstale":"2024-09-10T23:24:21.972877+0000","last_undegraded":"2024-09-10T23:24:21.972877+0000","last_fullsized":"2024-09-10T23:24:21.972877+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:08.518084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972540+0000","last_change":"2024-09-10T23:23:57.835147+0000","last_active":"2024-09-10T23:24:21.972540+0000","last_peered":"2024-09-10T23:24:21.972540+0000","last_clean":"2024-09-10T23:24:21.972540+0000","last_became_active":"2024-09-10T23:23:57.834739+0000","last_became_peered":"2024-09-10T23:23:57.834739+0000","last_unstale":"2024-09-10T23:24:21.972540+0000","last_undegraded":"2024-09-10T23:24:21.972540+0000","last_fullsized":"2024-09-10T23:24:21.972540+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:06:27.023088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971650+0000","last_change":"2024-09-10T23:23:57.825996+0000","last_active":"2024-09-10T23:24:21.971650+0000","last_peered":"2024-09-10T23:24:21.971650+0000","last_clean":"2024-09-10T23:24:21.971650+0000","last_became_active":"2024-09-10T23:23:57.824168+0000","last_became_peered":"2024-09-10T23:23:57.824168+0000","last_unstale":"2024-09-10T23:24:21.971650+0000","last_undegraded":"2024-09-10T23:24:21.971650+0000","last_fullsized":"2024-09-10T23:24:21.971650+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:36.396179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.979001+0000","last_change":"2024-09-10T23:24:21.976841+0000","last_active":"2024-09-10T23:24:21.979001+0000","last_peered":"2024-09-10T23:24:21.979001+0000","last_clean":"2024-09-10T23:24:21.979001+0000","last_became_active":"2024-09-10T23:24:21.976461+0000","last_became_peered":"2024-09-10T23:24:21.976461+0000","last_unstale":"2024-09-10T23:24:21.979001+0000","last_undegraded":"2024-09-10T23:24:21.979001+0000","last_fullsized":"2024-09-10T23:24:21.979001+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:04:00.000274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972429+0000","last_change":"2024-09-10T23:23:57.840477+0000","last_active":"2024-09-10T23:24:21.972429+0000","last_peered":"2024-09-10T23:24:21.972429+0000","last_clean":"2024-09-10T23:24:21.972429+0000","last_became_active":"2024-09-10T23:23:57.840113+0000","last_became_peered":"2024-09-10T23:23:57.840113+0000","last_unstale":"2024-09-10T23:24:21.972429+0000","last_undegraded":"2024-09-10T23:24:21.972429+0000","last_fullsized":"2024-09-10T23:24:21.972429+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:27:23.913802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973335+0000","last_change":"2024-09-10T23:23:57.837416+0000","last_active":"2024-09-10T23:24:21.973335+0000","last_peered":"2024-09-10T23:24:21.973335+0000","last_clean":"2024-09-10T23:24:21.973335+0000","last_became_active":"2024-09-10T23:23:57.837104+0000","last_became_peered":"2024-09-10T23:23:57.837104+0000","last_unstale":"2024-09-10T23:24:21.973335+0000","last_undegraded":"2024-09-10T23:24:21.973335+0000","last_fullsized":"2024-09-10T23:24:21.973335+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:00.712148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.968925+0000","last_change":"2024-09-10T23:23:57.838304+0000","last_active":"2024-09-10T23:24:21.968925+0000","last_peered":"2024-09-10T23:24:21.968925+0000","last_clean":"2024-09-10T23:24:21.968925+0000","last_became_active":"2024-09-10T23:23:57.837677+0000","last_became_peered":"2024-09-10T23:23:57.837677+0000","last_unstale":"2024-09-10T23:24:21.968925+0000","last_undegraded":"2024-09-10T23:24:21.968925+0000","last_fullsized":"2024-09-10T23:24:21.968925+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:40.862950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973043+0000","last_change":"2024-09-10T23:23:57.825579+0000","last_active":"2024-09-10T23:24:21.973043+0000","last_peered":"2024-09-10T23:24:21.973043+0000","last_clean":"2024-09-10T23:24:21.973043+0000","last_became_active":"2024-09-10T23:23:57.824840+0000","last_became_peered":"2024-09-10T23:23:57.824840+0000","last_unstale":"2024-09-10T23:24:21.973043+0000","last_undegraded":"2024-09-10T23:24:21.973043+0000","last_fullsized":"2024-09-10T23:24:21.973043+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:53:35.150858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972279+0000","last_change":"2024-09-10T23:23:57.833479+0000","last_active":"2024-09-10T23:24:21.972279+0000","last_peered":"2024-09-10T23:24:21.972279+0000","last_clean":"2024-09-10T23:24:21.972279+0000","last_became_active":"2024-09-10T23:23:57.833124+0000","last_became_peered":"2024-09-10T23:23:57.833124+0000","last_unstale":"2024-09-10T23:24:21.972279+0000","last_undegraded":"2024-09-10T23:24:21.972279+0000","last_fullsized":"2024-09-10T23:24:21.972279+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:02.869308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.968371+0000","last_change":"2024-09-10T23:23:57.831610+0000","last_active":"2024-09-10T23:24:21.968371+0000","last_peered":"2024-09-10T23:24:21.968371+0000","last_clean":"2024-09-10T23:24:21.968371+0000","last_became_active":"2024-09-10T23:23:57.831227+0000","last_became_peered":"2024-09-10T23:23:57.831227+0000","last_unstale":"2024-09-10T23:24:21.968371+0000","last_undegraded":"2024-09-10T23:24:21.968371+0000","last_fullsized":"2024-09-10T23:24:21.968371+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:45.735286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972054+0000","last_change":"2024-09-10T23:23:57.839295+0000","last_active":"2024-09-10T23:24:21.972054+0000","last_peered":"2024-09-10T23:24:21.972054+0000","last_clean":"2024-09-10T23:24:21.972054+0000","last_became_active":"2024-09-10T23:23:57.838857+0000","last_became_peered":"2024-09-10T23:23:57.838857+0000","last_unstale":"2024-09-10T23:24:21.972054+0000","last_undegraded":"2024-09-10T23:24:21.972054+0000","last_fullsized":"2024-09-10T23:24:21.972054+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:20:13.203324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.968113+0000","last_change":"2024-09-10T23:23:57.841459+0000","last_active":"2024-09-10T23:24:21.968113+0000","last_peered":"2024-09-10T23:24:21.968113+0000","last_clean":"2024-09-10T23:24:21.968113+0000","last_became_active":"2024-09-10T23:23:57.841049+0000","last_became_peered":"2024-09-10T23:23:57.841049+0000","last_unstale":"2024-09-10T23:24:21.968113+0000","last_undegraded":"2024-09-10T23:24:21.968113+0000","last_fullsized":"2024-09-10T23:24:21.968113+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:39:51.372657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.968054+0000","last_change":"2024-09-10T23:23:57.813028+0000","last_active":"2024-09-10T23:24:21.968054+0000","last_peered":"2024-09-10T23:24:21.968054+0000","last_clean":"2024-09-10T23:24:21.968054+0000","last_became_active":"2024-09-10T23:23:57.812648+0000","last_became_peered":"2024-09-10T23:23:57.812648+0000","last_unstale":"2024-09-10T23:24:21.968054+0000","last_undegraded":"2024-09-10T23:24:21.968054+0000","last_fullsized":"2024-09-10T23:24:21.968054+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:57.691811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973337+0000","last_change":"2024-09-10T23:23:57.814467+0000","last_active":"2024-09-10T23:24:21.973337+0000","last_peered":"2024-09-10T23:24:21.973337+0000","last_clean":"2024-09-10T23:24:21.973337+0000","last_became_active":"2024-09-10T23:23:57.812286+0000","last_became_peered":"2024-09-10T23:23:57.812286+0000","last_unstale":"2024-09-10T23:24:21.973337+0000","last_undegraded":"2024-09-10T23:24:21.973337+0000","last_fullsized":"2024-09-10T23:24:21.973337+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:42.044495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:22.295671+0000","last_change":"2024-09-10T23:23:57.834679+0000","last_active":"2024-09-10T23:24:22.295671+0000","last_peered":"2024-09-10T23:24:22.295671+0000","last_clean":"2024-09-10T23:24:22.295671+0000","last_became_active":"2024-09-10T23:23:57.833964+0000","last_became_peered":"2024-09-10T23:23:57.833964+0000","last_unstale":"2024-09-10T23:24:22.295671+0000","last_undegraded":"2024-09-10T23:24:22.295671+0000","last_fullsized":"2024-09-10T23:24:22.295671+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:29.160280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971428+0000","last_change":"2024-09-10T23:23:57.840788+0000","last_active":"2024-09-10T23:24:21.971428+0000","last_peered":"2024-09-10T23:24:21.971428+0000","last_clean":"2024-09-10T23:24:21.971428+0000","last_became_active":"2024-09-10T23:23:57.839946+0000","last_became_peered":"2024-09-10T23:23:57.839946+0000","last_unstale":"2024-09-10T23:24:21.971428+0000","last_undegraded":"2024-09-10T23:24:21.971428+0000","last_fullsized":"2024-09-10T23:24:21.971428+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:14.354925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.974381+0000","last_change":"2024-09-10T23:23:57.843454+0000","last_active":"2024-09-10T23:24:21.974381+0000","last_peered":"2024-09-10T23:24:21.974381+0000","last_clean":"2024-09-10T23:24:21.974381+0000","last_became_active":"2024-09-10T23:23:57.841623+0000","last_became_peered":"2024-09-10T23:23:57.841623+0000","last_unstale":"2024-09-10T23:24:21.974381+0000","last_undegraded":"2024-09-10T23:24:21.974381+0000","last_fullsized":"2024-09-10T23:24:21.974381+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:03:03.957444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973256+0000","last_change":"2024-09-10T23:23:57.834196+0000","last_active":"2024-09-10T23:24:21.973256+0000","last_peered":"2024-09-10T23:24:21.973256+0000","last_clean":"2024-09-10T23:24:21.973256+0000","last_became_active":"2024-09-10T23:23:57.833692+0000","last_became_peered":"2024-09-10T23:23:57.833692+0000","last_unstale":"2024-09-10T23:24:21.973256+0000","last_undegraded":"2024-09-10T23:24:21.973256+0000","last_fullsized":"2024-09-10T23:24:21.973256+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:49.814475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972161+0000","last_change":"2024-09-10T23:23:57.831457+0000","last_active":"2024-09-10T23:24:21.972161+0000","last_peered":"2024-09-10T23:24:21.972161+0000","last_clean":"2024-09-10T23:24:21.972161+0000","last_became_active":"2024-09-10T23:23:57.829686+0000","last_became_peered":"2024-09-10T23:23:57.829686+0000","last_unstale":"2024-09-10T23:24:21.972161+0000","last_undegraded":"2024-09-10T23:24:21.972161+0000","last_fullsized":"2024-09-10T23:24:21.972161+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:39.204501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.970523+0000","last_change":"2024-09-10T23:23:57.829437+0000","last_active":"2024-09-10T23:24:21.970523+0000","last_peered":"2024-09-10T23:24:21.970523+0000","last_clean":"2024-09-10T23:24:21.970523+0000","last_became_active":"2024-09-10T23:23:57.828956+0000","last_became_peered":"2024-09-10T23:23:57.828956+0000","last_unstale":"2024-09-10T23:24:21.970523+0000","last_undegraded":"2024-09-10T23:24:21.970523+0000","last_fullsized":"2024-09-10T23:24:21.970523+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:18.191002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973095+0000","last_change":"2024-09-10T23:23:57.839661+0000","last_active":"2024-09-10T23:24:21.973095+0000","last_peered":"2024-09-10T23:24:21.973095+0000","last_clean":"2024-09-10T23:24:21.973095+0000","last_became_active":"2024-09-10T23:23:57.839197+0000","last_became_peered":"2024-09-10T23:23:57.839197+0000","last_unstale":"2024-09-10T23:24:21.973095+0000","last_undegraded":"2024-09-10T23:24:21.973095+0000","last_fullsized":"2024-09-10T23:24:21.973095+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:33.599860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.965407+0000","last_change":"2024-09-10T23:23:57.820968+0000","last_active":"2024-09-10T23:24:21.965407+0000","last_peered":"2024-09-10T23:24:21.965407+0000","last_clean":"2024-09-10T23:24:21.965407+0000","last_became_active":"2024-09-10T23:23:57.820108+0000","last_became_peered":"2024-09-10T23:23:57.820108+0000","last_unstale":"2024-09-10T23:24:21.965407+0000","last_undegraded":"2024-09-10T23:24:21.965407+0000","last_fullsized":"2024-09-10T23:24:21.965407+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:23.864751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:22.295616+0000","last_change":"2024-09-10T23:23:57.842302+0000","last_active":"2024-09-10T23:24:22.295616+0000","last_peered":"2024-09-10T23:24:22.295616+0000","last_clean":"2024-09-10T23:24:22.295616+0000","last_became_active":"2024-09-10T23:23:57.838460+0000","last_became_peered":"2024-09-10T23:23:57.838460+0000","last_unstale":"2024-09-10T23:24:22.295616+0000","last_undegraded":"2024-09-10T23:24:22.295616+0000","last_fullsized":"2024-09-10T23:24:22.295616+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:54.731481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.968303+0000","last_change":"2024-09-10T23:23:57.837749+0000","last_active":"2024-09-10T23:24:21.968303+0000","last_peered":"2024-09-10T23:24:21.968303+0000","last_clean":"2024-09-10T23:24:21.968303+0000","last_became_active":"2024-09-10T23:23:57.836195+0000","last_became_peered":"2024-09-10T23:23:57.836195+0000","last_unstale":"2024-09-10T23:24:21.968303+0000","last_undegraded":"2024-09-10T23:24:21.968303+0000","last_fullsized":"2024-09-10T23:24:21.968303+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:10.064725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.968509+0000","last_change":"2024-09-10T23:23:57.812182+0000","last_active":"2024-09-10T23:24:21.968509+0000","last_peered":"2024-09-10T23:24:21.968509+0000","last_clean":"2024-09-10T23:24:21.968509+0000","last_became_active":"2024-09-10T23:23:57.811853+0000","last_became_peered":"2024-09-10T23:23:57.811853+0000","last_unstale":"2024-09-10T23:24:21.968509+0000","last_undegraded":"2024-09-10T23:24:21.968509+0000","last_fullsized":"2024-09-10T23:24:21.968509+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:03.389054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.968306+0000","last_change":"2024-09-10T23:23:57.833957+0000","last_active":"2024-09-10T23:24:21.968306+0000","last_peered":"2024-09-10T23:24:21.968306+0000","last_clean":"2024-09-10T23:24:21.968306+0000","last_became_active":"2024-09-10T23:23:57.833547+0000","last_became_peered":"2024-09-10T23:23:57.833547+0000","last_unstale":"2024-09-10T23:24:21.968306+0000","last_undegraded":"2024-09-10T23:24:21.968306+0000","last_fullsized":"2024-09-10T23:24:21.968306+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:30.917801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":61255,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":121,"num_read_kb":127,"num_write":155,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":167445,"data_compressed":5592,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":288697,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678045,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":974848,"data_stored":515841,"data_compressed":26508,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874275,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1105920,"data_stored":1160720,"data_compressed":65070,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037799,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":520139,"data_compressed":26508,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234029,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":515963,"data_compressed":26508,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430260,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1036288,"data_stored":1111872,"data_compressed":63206,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593786,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":511219,"data_compressed":26508,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790016,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1044480,"data_stored":1107069,"data_compressed":63206,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953542,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":516260,"data_compressed":26508,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149771,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":511413,"data_compressed":26508,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378706,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1036288,"data_stored":561539,"data_compressed":28372,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542230,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32176,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712976,"statfs":{"total":95995035648,"available":95962087424,"internally_reserved":0,"allocated":1015808,"data_stored":560223,"data_compressed":28372,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705757,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":991232,"data_stored":512607,"data_compressed":26508,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":49094,"data_compressed":1864,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":50410,"data_compressed":1864,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":59223,"data_compressed":1864,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:25:08.765 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T23:25:09.144 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:09.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:09 smithi038 ceph-mon[34225]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:25:09.383 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:09 smithi003 ceph-mon[30348]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:25:09.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:09 smithi194 ceph-mon[33904]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:25:09.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.662+0000 7fb950600640 1 -- 172.21.15.3:0/2835814488 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb948102da0 msgr2=0x7fb948103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:09.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.662+0000 7fb950600640 1 --2- 172.21.15.3:0/2835814488 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb948102da0 0x7fb948103180 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb93c009900 tx=0x7fb93c02a400 comp rx=0 tx=0).stop 2024-09-10T23:25:09.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.662+0000 7fb950600640 1 -- 172.21.15.3:0/2835814488 shutdown_connections 2024-09-10T23:25:09.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.662+0000 7fb950600640 1 --2- 172.21.15.3:0/2835814488 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb948109130 0x7fb94810f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:09.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.662+0000 7fb950600640 1 --2- 172.21.15.3:0/2835814488 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9481087b0 0x7fb948108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:09.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.662+0000 7fb950600640 1 --2- 172.21.15.3:0/2835814488 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb948102da0 0x7fb948103180 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:09.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.662+0000 7fb950600640 1 -- 172.21.15.3:0/2835814488 >> 172.21.15.3:0/2835814488 conn(0x7fb9480fe810 msgr2=0x7fb948100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:09.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.663+0000 7fb950600640 1 -- 172.21.15.3:0/2835814488 shutdown_connections 2024-09-10T23:25:09.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.663+0000 7fb950600640 1 -- 172.21.15.3:0/2835814488 wait complete. 2024-09-10T23:25:09.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.663+0000 7fb950600640 1 Processor -- start 2024-09-10T23:25:09.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.664+0000 7fb950600640 1 -- start start 2024-09-10T23:25:09.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.664+0000 7fb950600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb948102da0 0x7fb94819b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:09.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.664+0000 7fb950600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9481087b0 0x7fb94819ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:09.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.664+0000 7fb950600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb948109130 0x7fb9481a0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:09.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.664+0000 7fb950600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb948112ce0 con 0x7fb948102da0 2024-09-10T23:25:09.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.664+0000 7fb950600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb948112b60 con 0x7fb948109130 2024-09-10T23:25:09.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.664+0000 7fb950600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb948112e60 con 0x7fb9481087b0 2024-09-10T23:25:09.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.664+0000 7fb94dc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb948102da0 0x7fb94819b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:09.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.664+0000 7fb94dc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb948102da0 0x7fb94819b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58668/0 (socket says 172.21.15.3:58668) 2024-09-10T23:25:09.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.664+0000 7fb94dc00640 1 -- 172.21.15.3:0/1339529912 learned_addr learned my addr 172.21.15.3:0/1339529912 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:09.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.665+0000 7fb94d200640 1 --2- 172.21.15.3:0/1339529912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9481087b0 0x7fb94819ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:09.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.665+0000 7fb94e600640 1 --2- 172.21.15.3:0/1339529912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb948109130 0x7fb9481a0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:09.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.665+0000 7fb94dc00640 1 -- 172.21.15.3:0/1339529912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9481087b0 msgr2=0x7fb94819ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:09.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.665+0000 7fb94dc00640 1 --2- 172.21.15.3:0/1339529912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9481087b0 0x7fb94819ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:09.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.665+0000 7fb94dc00640 1 -- 172.21.15.3:0/1339529912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb948109130 msgr2=0x7fb9481a0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:09.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.665+0000 7fb94dc00640 1 --2- 172.21.15.3:0/1339529912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb948109130 0x7fb9481a0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:09.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.665+0000 7fb94dc00640 1 -- 172.21.15.3:0/1339529912 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9481a15c0 con 0x7fb948102da0 2024-09-10T23:25:09.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.665+0000 7fb94e600640 1 --2- 172.21.15.3:0/1339529912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb948109130 0x7fb9481a0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:09.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.665+0000 7fb94d200640 1 --2- 172.21.15.3:0/1339529912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9481087b0 0x7fb94819ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:09.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.665+0000 7fb94dc00640 1 --2- 172.21.15.3:0/1339529912 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb948102da0 0x7fb94819b510 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb93c009a20 tx=0x7fb93c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:09.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.666+0000 7fb946000640 1 -- 172.21.15.3:0/1339529912 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93c03f030 con 0x7fb948102da0 2024-09-10T23:25:09.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.666+0000 7fb950600640 1 -- 172.21.15.3:0/1339529912 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9481a1850 con 0x7fb948102da0 2024-09-10T23:25:09.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.666+0000 7fb946000640 1 -- 172.21.15.3:0/1339529912 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb93c0035f0 con 0x7fb948102da0 2024-09-10T23:25:09.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.666+0000 7fb946000640 1 -- 172.21.15.3:0/1339529912 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93c035070 con 0x7fb948102da0 2024-09-10T23:25:09.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.666+0000 7fb950600640 1 -- 172.21.15.3:0/1339529912 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9481a7f70 con 0x7fb948102da0 2024-09-10T23:25:09.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.667+0000 7fb950600640 1 -- 172.21.15.3:0/1339529912 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb948103200 con 0x7fb948102da0 2024-09-10T23:25:09.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.669+0000 7fb946000640 1 -- 172.21.15.3:0/1339529912 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7fb93c031a70 con 0x7fb948102da0 2024-09-10T23:25:09.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.670+0000 7fb946000640 1 --2- 172.21.15.3:0/1339529912 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb9300b53c0 0x7fb9300b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:09.672 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.670+0000 7fb946000640 1 -- 172.21.15.3:0/1339529912 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9286+0+0 (secure 0 0 0) 0x7fb93c106e60 con 0x7fb948102da0 2024-09-10T23:25:09.672 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.671+0000 7fb94d200640 1 --2- 172.21.15.3:0/1339529912 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb9300b53c0 0x7fb9300b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:09.672 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.671+0000 7fb94d200640 1 --2- 172.21.15.3:0/1339529912 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb9300b53c0 0x7fb9300b7880 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb948101640 tx=0x7fb934008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:09.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.674+0000 7fb946000640 1 -- 172.21.15.3:0/1339529912 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb93c0cd740 con 0x7fb948102da0 2024-09-10T23:25:09.874 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.873+0000 7fb950600640 1 -- 172.21.15.3:0/1339529912 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb948063590 con 0x7fb9300b53c0 2024-09-10T23:25:09.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.878+0000 7fb946000640 1 -- 172.21.15.3:0/1339529912 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340655 (secure 0 0 0) 0x7fb948063590 con 0x7fb9300b53c0 2024-09-10T23:25:09.880 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:25:09.885 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-10T23:25:09.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.884+0000 7fb950600640 1 -- 172.21.15.3:0/1339529912 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb9300b53c0 msgr2=0x7fb9300b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:09.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.884+0000 7fb950600640 1 --2- 172.21.15.3:0/1339529912 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb9300b53c0 0x7fb9300b7880 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb948101640 tx=0x7fb934008040 comp rx=0 tx=0).stop 2024-09-10T23:25:09.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.884+0000 7fb950600640 1 -- 172.21.15.3:0/1339529912 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb948102da0 msgr2=0x7fb94819b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:09.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.884+0000 7fb950600640 1 --2- 172.21.15.3:0/1339529912 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb948102da0 0x7fb94819b510 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb93c009a20 tx=0x7fb93c004270 comp rx=0 tx=0).stop 2024-09-10T23:25:09.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.884+0000 7fb950600640 1 -- 172.21.15.3:0/1339529912 shutdown_connections 2024-09-10T23:25:09.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.884+0000 7fb950600640 1 --2- 172.21.15.3:0/1339529912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb948109130 0x7fb9481a0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:09.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.884+0000 7fb950600640 1 --2- 172.21.15.3:0/1339529912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9481087b0 0x7fb94819ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:09.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.884+0000 7fb950600640 1 --2- 172.21.15.3:0/1339529912 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb9300b53c0 0x7fb9300b7880 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:09.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.884+0000 7fb950600640 1 --2- 172.21.15.3:0/1339529912 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb948102da0 0x7fb94819b510 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:09.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.884+0000 7fb950600640 1 -- 172.21.15.3:0/1339529912 >> 172.21.15.3:0/1339529912 conn(0x7fb9480fe810 msgr2=0x7fb948075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:09.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.885+0000 7fb950600640 1 -- 172.21.15.3:0/1339529912 shutdown_connections 2024-09-10T23:25:09.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:09.885+0000 7fb950600640 1 -- 172.21.15.3:0/1339529912 wait complete. 2024-09-10T23:25:10.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:10 smithi003 ceph-mon[30348]: pgmap v340: 129 pgs: 129 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.5 KiB/s wr, 8 op/s 2024-09-10T23:25:10.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:10 smithi038 ceph-mon[34225]: pgmap v340: 129 pgs: 129 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.5 KiB/s wr, 8 op/s 2024-09-10T23:25:10.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:10 smithi194 ceph-mon[33904]: pgmap v340: 129 pgs: 129 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.5 KiB/s wr, 8 op/s 2024-09-10T23:25:10.738 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":340,"stamp":"2024-09-10T23:25:08.766028+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651857,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":217,"num_read_kb":201,"num_write":284,"num_write_kb":2260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2951874,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":231,"ondisk_log_size":231,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365240,"kb_used_data":11832,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576584,"statfs":{"total":1151940427776,"available":1151566422016,"internally_reserved":0,"allocated":12115968,"data_stored":8113025,"data_compressed":433782,"data_compressed_allocated":589824,"data_compressed_original":2678784,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":33186,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":68,"num_write":23,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003756"},"pg_stats":[{"pgid":"2.1f","version":"88'9","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:48.248520+0000","last_change":"2024-09-10T23:23:54.796561+0000","last_active":"2024-09-10T23:24:48.248520+0000","last_peered":"2024-09-10T23:24:48.248520+0000","last_clean":"2024-09-10T23:24:48.248520+0000","last_became_active":"2024-09-10T23:23:54.796058+0000","last_became_peered":"2024-09-10T23:23:54.796058+0000","last_unstale":"2024-09-10T23:24:48.248520+0000","last_undegraded":"2024-09-10T23:24:48.248520+0000","last_fullsized":"2024-09-10T23:24:48.248520+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:27.790990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971290+0000","last_change":"2024-09-10T23:23:57.828660+0000","last_active":"2024-09-10T23:24:21.971290+0000","last_peered":"2024-09-10T23:24:21.971290+0000","last_clean":"2024-09-10T23:24:21.971290+0000","last_became_active":"2024-09-10T23:23:57.828287+0000","last_became_peered":"2024-09-10T23:23:57.828287+0000","last_unstale":"2024-09-10T23:24:21.971290+0000","last_undegraded":"2024-09-10T23:24:21.971290+0000","last_fullsized":"2024-09-10T23:24:21.971290+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:13.085003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971534+0000","last_change":"2024-09-10T23:24:05.886167+0000","last_active":"2024-09-10T23:24:21.971534+0000","last_peered":"2024-09-10T23:24:21.971534+0000","last_clean":"2024-09-10T23:24:21.971534+0000","last_became_active":"2024-09-10T23:24:05.885706+0000","last_became_peered":"2024-09-10T23:24:05.885706+0000","last_unstale":"2024-09-10T23:24:21.971534+0000","last_undegraded":"2024-09-10T23:24:21.971534+0000","last_fullsized":"2024-09-10T23:24:21.971534+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:42.337384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971714+0000","last_change":"2024-09-10T23:23:54.791770+0000","last_active":"2024-09-10T23:24:21.971714+0000","last_peered":"2024-09-10T23:24:21.971714+0000","last_clean":"2024-09-10T23:24:21.971714+0000","last_became_active":"2024-09-10T23:23:54.791476+0000","last_became_peered":"2024-09-10T23:23:54.791476+0000","last_unstale":"2024-09-10T23:24:21.971714+0000","last_undegraded":"2024-09-10T23:24:21.971714+0000","last_fullsized":"2024-09-10T23:24:21.971714+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:07.493654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.968523+0000","last_change":"2024-09-10T23:23:57.833858+0000","last_active":"2024-09-10T23:24:21.968523+0000","last_peered":"2024-09-10T23:24:21.968523+0000","last_clean":"2024-09-10T23:24:21.968523+0000","last_became_active":"2024-09-10T23:23:57.833496+0000","last_became_peered":"2024-09-10T23:23:57.833496+0000","last_unstale":"2024-09-10T23:24:21.968523+0000","last_undegraded":"2024-09-10T23:24:21.968523+0000","last_fullsized":"2024-09-10T23:24:21.968523+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:48:50.293342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:22.295150+0000","last_change":"2024-09-10T23:24:05.878733+0000","last_active":"2024-09-10T23:24:22.295150+0000","last_peered":"2024-09-10T23:24:22.295150+0000","last_clean":"2024-09-10T23:24:22.295150+0000","last_became_active":"2024-09-10T23:24:05.878285+0000","last_became_peered":"2024-09-10T23:24:05.878285+0000","last_unstale":"2024-09-10T23:24:22.295150+0000","last_undegraded":"2024-09-10T23:24:22.295150+0000","last_fullsized":"2024-09-10T23:24:22.295150+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:21:11.636292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:48.247289+0000","last_change":"2024-09-10T23:23:54.792253+0000","last_active":"2024-09-10T23:24:48.247289+0000","last_peered":"2024-09-10T23:24:48.247289+0000","last_clean":"2024-09-10T23:24:48.247289+0000","last_became_active":"2024-09-10T23:23:54.791847+0000","last_became_peered":"2024-09-10T23:23:54.791847+0000","last_unstale":"2024-09-10T23:24:48.247289+0000","last_undegraded":"2024-09-10T23:24:48.247289+0000","last_fullsized":"2024-09-10T23:24:48.247289+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:03.563741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972784+0000","last_change":"2024-09-10T23:23:57.837009+0000","last_active":"2024-09-10T23:24:21.972784+0000","last_peered":"2024-09-10T23:24:21.972784+0000","last_clean":"2024-09-10T23:24:21.972784+0000","last_became_active":"2024-09-10T23:23:57.835152+0000","last_became_peered":"2024-09-10T23:23:57.835152+0000","last_unstale":"2024-09-10T23:24:21.972784+0000","last_undegraded":"2024-09-10T23:24:21.972784+0000","last_fullsized":"2024-09-10T23:24:21.972784+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:25.345514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:22.295404+0000","last_change":"2024-09-10T23:24:05.882593+0000","last_active":"2024-09-10T23:24:22.295404+0000","last_peered":"2024-09-10T23:24:22.295404+0000","last_clean":"2024-09-10T23:24:22.295404+0000","last_became_active":"2024-09-10T23:24:05.882123+0000","last_became_peered":"2024-09-10T23:24:05.882123+0000","last_unstale":"2024-09-10T23:24:22.295404+0000","last_undegraded":"2024-09-10T23:24:22.295404+0000","last_fullsized":"2024-09-10T23:24:22.295404+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:22:30.103412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.981010+0000","last_change":"2024-09-10T23:24:21.980433+0000","last_active":"2024-09-10T23:24:21.981010+0000","last_peered":"2024-09-10T23:24:21.981010+0000","last_clean":"2024-09-10T23:24:21.981010+0000","last_became_active":"2024-09-10T23:24:21.974096+0000","last_became_peered":"2024-09-10T23:24:21.974096+0000","last_unstale":"2024-09-10T23:24:21.981010+0000","last_undegraded":"2024-09-10T23:24:21.981010+0000","last_fullsized":"2024-09-10T23:24:21.981010+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:33.430921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.978947+0000","last_change":"2024-09-10T23:24:21.978526+0000","last_active":"2024-09-10T23:24:21.978947+0000","last_peered":"2024-09-10T23:24:21.978947+0000","last_clean":"2024-09-10T23:24:21.978947+0000","last_became_active":"2024-09-10T23:24:21.978137+0000","last_became_peered":"2024-09-10T23:24:21.978137+0000","last_unstale":"2024-09-10T23:24:21.978947+0000","last_undegraded":"2024-09-10T23:24:21.978947+0000","last_fullsized":"2024-09-10T23:24:21.978947+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:53:31.785033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:22.295306+0000","last_change":"2024-09-10T23:24:05.889983+0000","last_active":"2024-09-10T23:24:22.295306+0000","last_peered":"2024-09-10T23:24:22.295306+0000","last_clean":"2024-09-10T23:24:22.295306+0000","last_became_active":"2024-09-10T23:24:05.889003+0000","last_became_peered":"2024-09-10T23:24:05.889003+0000","last_unstale":"2024-09-10T23:24:22.295306+0000","last_undegraded":"2024-09-10T23:24:22.295306+0000","last_fullsized":"2024-09-10T23:24:22.295306+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:19:13.555187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.970787+0000","last_change":"2024-09-10T23:23:57.831433+0000","last_active":"2024-09-10T23:24:21.970787+0000","last_peered":"2024-09-10T23:24:21.970787+0000","last_clean":"2024-09-10T23:24:21.970787+0000","last_became_active":"2024-09-10T23:23:57.831108+0000","last_became_peered":"2024-09-10T23:23:57.831108+0000","last_unstale":"2024-09-10T23:24:21.970787+0000","last_undegraded":"2024-09-10T23:24:21.970787+0000","last_fullsized":"2024-09-10T23:24:21.970787+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:50:20.160455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:47.240073+0000","last_change":"2024-09-10T23:23:54.792269+0000","last_active":"2024-09-10T23:24:47.240073+0000","last_peered":"2024-09-10T23:24:47.240073+0000","last_clean":"2024-09-10T23:24:47.240073+0000","last_became_active":"2024-09-10T23:23:54.791853+0000","last_became_peered":"2024-09-10T23:23:54.791853+0000","last_unstale":"2024-09-10T23:24:47.240073+0000","last_undegraded":"2024-09-10T23:24:47.240073+0000","last_fullsized":"2024-09-10T23:24:47.240073+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:43.020267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:22.295698+0000","last_change":"2024-09-10T23:24:05.886155+0000","last_active":"2024-09-10T23:24:22.295698+0000","last_peered":"2024-09-10T23:24:22.295698+0000","last_clean":"2024-09-10T23:24:22.295698+0000","last_became_active":"2024-09-10T23:24:05.885674+0000","last_became_peered":"2024-09-10T23:24:05.885674+0000","last_unstale":"2024-09-10T23:24:22.295698+0000","last_undegraded":"2024-09-10T23:24:22.295698+0000","last_fullsized":"2024-09-10T23:24:22.295698+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:46:00.891311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971300+0000","last_change":"2024-09-10T23:23:57.830440+0000","last_active":"2024-09-10T23:24:21.971300+0000","last_peered":"2024-09-10T23:24:21.971300+0000","last_clean":"2024-09-10T23:24:21.971300+0000","last_became_active":"2024-09-10T23:23:57.829219+0000","last_became_peered":"2024-09-10T23:23:57.829219+0000","last_unstale":"2024-09-10T23:24:21.971300+0000","last_undegraded":"2024-09-10T23:24:21.971300+0000","last_fullsized":"2024-09-10T23:24:21.971300+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:28:15.696684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"88'1","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972310+0000","last_change":"2024-09-10T23:23:54.796493+0000","last_active":"2024-09-10T23:24:21.972310+0000","last_peered":"2024-09-10T23:24:21.972310+0000","last_clean":"2024-09-10T23:24:21.972310+0000","last_became_active":"2024-09-10T23:23:54.796077+0000","last_became_peered":"2024-09-10T23:23:54.796077+0000","last_unstale":"2024-09-10T23:24:21.972310+0000","last_undegraded":"2024-09-10T23:24:21.972310+0000","last_fullsized":"2024-09-10T23:24:21.972310+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:13.054307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:22.295589+0000","last_change":"2024-09-10T23:24:05.885557+0000","last_active":"2024-09-10T23:24:22.295589+0000","last_peered":"2024-09-10T23:24:22.295589+0000","last_clean":"2024-09-10T23:24:22.295589+0000","last_became_active":"2024-09-10T23:24:05.884773+0000","last_became_peered":"2024-09-10T23:24:05.884773+0000","last_unstale":"2024-09-10T23:24:22.295589+0000","last_undegraded":"2024-09-10T23:24:22.295589+0000","last_fullsized":"2024-09-10T23:24:22.295589+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:52.596822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.967800+0000","last_change":"2024-09-10T23:23:57.816395+0000","last_active":"2024-09-10T23:24:21.967800+0000","last_peered":"2024-09-10T23:24:21.967800+0000","last_clean":"2024-09-10T23:24:21.967800+0000","last_became_active":"2024-09-10T23:23:57.816047+0000","last_became_peered":"2024-09-10T23:23:57.816047+0000","last_unstale":"2024-09-10T23:24:21.967800+0000","last_undegraded":"2024-09-10T23:24:21.967800+0000","last_fullsized":"2024-09-10T23:24:21.967800+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:08:11.535738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:47.238793+0000","last_change":"2024-09-10T23:23:54.795827+0000","last_active":"2024-09-10T23:24:47.238793+0000","last_peered":"2024-09-10T23:24:47.238793+0000","last_clean":"2024-09-10T23:24:47.238793+0000","last_became_active":"2024-09-10T23:23:54.794253+0000","last_became_peered":"2024-09-10T23:23:54.794253+0000","last_unstale":"2024-09-10T23:24:47.238793+0000","last_undegraded":"2024-09-10T23:24:47.238793+0000","last_fullsized":"2024-09-10T23:24:47.238793+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:27:27.988380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.974330+0000","last_change":"2024-09-10T23:24:05.889120+0000","last_active":"2024-09-10T23:24:21.974330+0000","last_peered":"2024-09-10T23:24:21.974330+0000","last_clean":"2024-09-10T23:24:21.974330+0000","last_became_active":"2024-09-10T23:24:05.888771+0000","last_became_peered":"2024-09-10T23:24:05.888771+0000","last_unstale":"2024-09-10T23:24:21.974330+0000","last_undegraded":"2024-09-10T23:24:21.974330+0000","last_fullsized":"2024-09-10T23:24:21.974330+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:55.414786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.965197+0000","last_change":"2024-09-10T23:23:57.814073+0000","last_active":"2024-09-10T23:24:21.965197+0000","last_peered":"2024-09-10T23:24:21.965197+0000","last_clean":"2024-09-10T23:24:21.965197+0000","last_became_active":"2024-09-10T23:23:57.813681+0000","last_became_peered":"2024-09-10T23:23:57.813681+0000","last_unstale":"2024-09-10T23:24:21.965197+0000","last_undegraded":"2024-09-10T23:24:21.965197+0000","last_fullsized":"2024-09-10T23:24:21.965197+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:44.129174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:47.238565+0000","last_change":"2024-09-10T23:23:54.791119+0000","last_active":"2024-09-10T23:24:47.238565+0000","last_peered":"2024-09-10T23:24:47.238565+0000","last_clean":"2024-09-10T23:24:47.238565+0000","last_became_active":"2024-09-10T23:23:54.790770+0000","last_became_peered":"2024-09-10T23:23:54.790770+0000","last_unstale":"2024-09-10T23:24:47.238565+0000","last_undegraded":"2024-09-10T23:24:47.238565+0000","last_fullsized":"2024-09-10T23:24:47.238565+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:35.015104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:22.296391+0000","last_change":"2024-09-10T23:24:05.885654+0000","last_active":"2024-09-10T23:24:22.296391+0000","last_peered":"2024-09-10T23:24:22.296391+0000","last_clean":"2024-09-10T23:24:22.296391+0000","last_became_active":"2024-09-10T23:24:05.885176+0000","last_became_peered":"2024-09-10T23:24:05.885176+0000","last_unstale":"2024-09-10T23:24:22.296391+0000","last_undegraded":"2024-09-10T23:24:22.296391+0000","last_fullsized":"2024-09-10T23:24:22.296391+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:24:47.007414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.976267+0000","last_change":"2024-09-10T23:24:21.976169+0000","last_active":"2024-09-10T23:24:21.976267+0000","last_peered":"2024-09-10T23:24:21.976267+0000","last_clean":"2024-09-10T23:24:21.976267+0000","last_became_active":"2024-09-10T23:24:21.975330+0000","last_became_peered":"2024-09-10T23:24:21.975330+0000","last_unstale":"2024-09-10T23:24:21.976267+0000","last_undegraded":"2024-09-10T23:24:21.976267+0000","last_fullsized":"2024-09-10T23:24:21.976267+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:54:59.422630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:47.235036+0000","last_change":"2024-09-10T23:23:55.082093+0000","last_active":"2024-09-10T23:24:47.235036+0000","last_peered":"2024-09-10T23:24:47.235036+0000","last_clean":"2024-09-10T23:24:47.235036+0000","last_became_active":"2024-09-10T23:23:55.081705+0000","last_became_peered":"2024-09-10T23:23:55.081705+0000","last_unstale":"2024-09-10T23:24:47.235036+0000","last_undegraded":"2024-09-10T23:24:47.235036+0000","last_fullsized":"2024-09-10T23:24:47.235036+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:01:04.150153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971708+0000","last_change":"2024-09-10T23:24:05.880084+0000","last_active":"2024-09-10T23:24:21.971708+0000","last_peered":"2024-09-10T23:24:21.971708+0000","last_clean":"2024-09-10T23:24:21.971708+0000","last_became_active":"2024-09-10T23:24:05.879655+0000","last_became_peered":"2024-09-10T23:24:05.879655+0000","last_unstale":"2024-09-10T23:24:21.971708+0000","last_undegraded":"2024-09-10T23:24:21.971708+0000","last_fullsized":"2024-09-10T23:24:21.971708+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:01.473494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972634+0000","last_change":"2024-09-10T23:23:57.836207+0000","last_active":"2024-09-10T23:24:21.972634+0000","last_peered":"2024-09-10T23:24:21.972634+0000","last_clean":"2024-09-10T23:24:21.972634+0000","last_became_active":"2024-09-10T23:23:57.835801+0000","last_became_peered":"2024-09-10T23:23:57.835801+0000","last_unstale":"2024-09-10T23:24:21.972634+0000","last_undegraded":"2024-09-10T23:24:21.972634+0000","last_fullsized":"2024-09-10T23:24:21.972634+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:48:18.246508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'9","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:25:03.852881+0000","last_change":"2024-09-10T23:23:54.798126+0000","last_active":"2024-09-10T23:25:03.852881+0000","last_peered":"2024-09-10T23:25:03.852881+0000","last_clean":"2024-09-10T23:25:03.852881+0000","last_became_active":"2024-09-10T23:23:54.797755+0000","last_became_peered":"2024-09-10T23:23:54.797755+0000","last_unstale":"2024-09-10T23:25:03.852881+0000","last_undegraded":"2024-09-10T23:25:03.852881+0000","last_fullsized":"2024-09-10T23:25:03.852881+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:54.474382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971825+0000","last_change":"2024-09-10T23:24:05.886431+0000","last_active":"2024-09-10T23:24:21.971825+0000","last_peered":"2024-09-10T23:24:21.971825+0000","last_clean":"2024-09-10T23:24:21.971825+0000","last_became_active":"2024-09-10T23:24:05.885962+0000","last_became_peered":"2024-09-10T23:24:05.885962+0000","last_unstale":"2024-09-10T23:24:21.971825+0000","last_undegraded":"2024-09-10T23:24:21.971825+0000","last_fullsized":"2024-09-10T23:24:21.971825+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:32.568553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973866+0000","last_change":"2024-09-10T23:23:57.825790+0000","last_active":"2024-09-10T23:24:21.973866+0000","last_peered":"2024-09-10T23:24:21.973866+0000","last_clean":"2024-09-10T23:24:21.973866+0000","last_became_active":"2024-09-10T23:23:57.825510+0000","last_became_peered":"2024-09-10T23:23:57.825510+0000","last_unstale":"2024-09-10T23:24:21.973866+0000","last_undegraded":"2024-09-10T23:24:21.973866+0000","last_fullsized":"2024-09-10T23:24:21.973866+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:43.816144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:47.236533+0000","last_change":"2024-09-10T23:23:54.791957+0000","last_active":"2024-09-10T23:24:47.236533+0000","last_peered":"2024-09-10T23:24:47.236533+0000","last_clean":"2024-09-10T23:24:47.236533+0000","last_became_active":"2024-09-10T23:23:54.791607+0000","last_became_peered":"2024-09-10T23:23:54.791607+0000","last_unstale":"2024-09-10T23:24:47.236533+0000","last_undegraded":"2024-09-10T23:24:47.236533+0000","last_fullsized":"2024-09-10T23:24:47.236533+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:00:47.600299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.967912+0000","last_change":"2024-09-10T23:24:05.884275+0000","last_active":"2024-09-10T23:24:21.967912+0000","last_peered":"2024-09-10T23:24:21.967912+0000","last_clean":"2024-09-10T23:24:21.967912+0000","last_became_active":"2024-09-10T23:24:05.882340+0000","last_became_peered":"2024-09-10T23:24:05.882340+0000","last_unstale":"2024-09-10T23:24:21.967912+0000","last_undegraded":"2024-09-10T23:24:21.967912+0000","last_fullsized":"2024-09-10T23:24:21.967912+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:15.243993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973617+0000","last_change":"2024-09-10T23:23:57.828322+0000","last_active":"2024-09-10T23:24:21.973617+0000","last_peered":"2024-09-10T23:24:21.973617+0000","last_clean":"2024-09-10T23:24:21.973617+0000","last_became_active":"2024-09-10T23:23:57.827925+0000","last_became_peered":"2024-09-10T23:23:57.827925+0000","last_unstale":"2024-09-10T23:24:21.973617+0000","last_undegraded":"2024-09-10T23:24:21.973617+0000","last_fullsized":"2024-09-10T23:24:21.973617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:55.214207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973889+0000","last_change":"2024-09-10T23:23:54.789507+0000","last_active":"2024-09-10T23:24:21.973889+0000","last_peered":"2024-09-10T23:24:21.973889+0000","last_clean":"2024-09-10T23:24:21.973889+0000","last_became_active":"2024-09-10T23:23:54.789120+0000","last_became_peered":"2024-09-10T23:23:54.789120+0000","last_unstale":"2024-09-10T23:24:21.973889+0000","last_undegraded":"2024-09-10T23:24:21.973889+0000","last_fullsized":"2024-09-10T23:24:21.973889+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:58.033953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.965204+0000","last_change":"2024-09-10T23:24:05.881015+0000","last_active":"2024-09-10T23:24:21.965204+0000","last_peered":"2024-09-10T23:24:21.965204+0000","last_clean":"2024-09-10T23:24:21.965204+0000","last_became_active":"2024-09-10T23:24:05.880261+0000","last_became_peered":"2024-09-10T23:24:05.880261+0000","last_unstale":"2024-09-10T23:24:21.965204+0000","last_undegraded":"2024-09-10T23:24:21.965204+0000","last_fullsized":"2024-09-10T23:24:21.965204+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:13:36.937503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.974422+0000","last_change":"2024-09-10T23:23:57.842018+0000","last_active":"2024-09-10T23:24:21.974422+0000","last_peered":"2024-09-10T23:24:21.974422+0000","last_clean":"2024-09-10T23:24:21.974422+0000","last_became_active":"2024-09-10T23:23:57.841669+0000","last_became_peered":"2024-09-10T23:23:57.841669+0000","last_unstale":"2024-09-10T23:24:21.974422+0000","last_undegraded":"2024-09-10T23:24:21.974422+0000","last_fullsized":"2024-09-10T23:24:21.974422+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:11.619741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971178+0000","last_change":"2024-09-10T23:23:54.794565+0000","last_active":"2024-09-10T23:24:21.971178+0000","last_peered":"2024-09-10T23:24:21.971178+0000","last_clean":"2024-09-10T23:24:21.971178+0000","last_became_active":"2024-09-10T23:23:54.793794+0000","last_became_peered":"2024-09-10T23:23:54.793794+0000","last_unstale":"2024-09-10T23:24:21.971178+0000","last_undegraded":"2024-09-10T23:24:21.971178+0000","last_fullsized":"2024-09-10T23:24:21.971178+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:42.665924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973350+0000","last_change":"2024-09-10T23:24:05.883706+0000","last_active":"2024-09-10T23:24:21.973350+0000","last_peered":"2024-09-10T23:24:21.973350+0000","last_clean":"2024-09-10T23:24:21.973350+0000","last_became_active":"2024-09-10T23:24:05.881621+0000","last_became_peered":"2024-09-10T23:24:05.881621+0000","last_unstale":"2024-09-10T23:24:21.973350+0000","last_undegraded":"2024-09-10T23:24:21.973350+0000","last_fullsized":"2024-09-10T23:24:21.973350+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:23.468331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971770+0000","last_change":"2024-09-10T23:23:57.834504+0000","last_active":"2024-09-10T23:24:21.971770+0000","last_peered":"2024-09-10T23:24:21.971770+0000","last_clean":"2024-09-10T23:24:21.971770+0000","last_became_active":"2024-09-10T23:23:57.834105+0000","last_became_peered":"2024-09-10T23:23:57.834105+0000","last_unstale":"2024-09-10T23:24:21.971770+0000","last_undegraded":"2024-09-10T23:24:21.971770+0000","last_fullsized":"2024-09-10T23:24:21.971770+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:03.539763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'4","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:25:06.285248+0000","last_change":"2024-09-10T23:23:54.796519+0000","last_active":"2024-09-10T23:25:06.285248+0000","last_peered":"2024-09-10T23:25:06.285248+0000","last_clean":"2024-09-10T23:25:06.285248+0000","last_became_active":"2024-09-10T23:23:54.795174+0000","last_became_peered":"2024-09-10T23:23:54.795174+0000","last_unstale":"2024-09-10T23:25:06.285248+0000","last_undegraded":"2024-09-10T23:25:06.285248+0000","last_fullsized":"2024-09-10T23:25:06.285248+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:53.622935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973682+0000","last_change":"2024-09-10T23:24:05.884496+0000","last_active":"2024-09-10T23:24:21.973682+0000","last_peered":"2024-09-10T23:24:21.973682+0000","last_clean":"2024-09-10T23:24:21.973682+0000","last_became_active":"2024-09-10T23:24:05.883659+0000","last_became_peered":"2024-09-10T23:24:05.883659+0000","last_unstale":"2024-09-10T23:24:21.973682+0000","last_undegraded":"2024-09-10T23:24:21.973682+0000","last_fullsized":"2024-09-10T23:24:21.973682+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:23.449830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972837+0000","last_change":"2024-09-10T23:23:57.842436+0000","last_active":"2024-09-10T23:24:21.972837+0000","last_peered":"2024-09-10T23:24:21.972837+0000","last_clean":"2024-09-10T23:24:21.972837+0000","last_became_active":"2024-09-10T23:23:57.842054+0000","last_became_peered":"2024-09-10T23:23:57.842054+0000","last_unstale":"2024-09-10T23:24:21.972837+0000","last_undegraded":"2024-09-10T23:24:21.972837+0000","last_fullsized":"2024-09-10T23:24:21.972837+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:07.234201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:48.246954+0000","last_change":"2024-09-10T23:24:21.974615+0000","last_active":"2024-09-10T23:24:48.246954+0000","last_peered":"2024-09-10T23:24:48.246954+0000","last_clean":"2024-09-10T23:24:48.246954+0000","last_became_active":"2024-09-10T23:24:21.974129+0000","last_became_peered":"2024-09-10T23:24:21.974129+0000","last_unstale":"2024-09-10T23:24:48.246954+0000","last_undegraded":"2024-09-10T23:24:48.246954+0000","last_fullsized":"2024-09-10T23:24:48.246954+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:11.510005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973879+0000","last_change":"2024-09-10T23:24:05.887848+0000","last_active":"2024-09-10T23:24:21.973879+0000","last_peered":"2024-09-10T23:24:21.973879+0000","last_clean":"2024-09-10T23:24:21.973879+0000","last_became_active":"2024-09-10T23:24:05.886426+0000","last_became_peered":"2024-09-10T23:24:05.886426+0000","last_unstale":"2024-09-10T23:24:21.973879+0000","last_undegraded":"2024-09-10T23:24:21.973879+0000","last_fullsized":"2024-09-10T23:24:21.973879+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:46:51.756285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972184+0000","last_change":"2024-09-10T23:23:57.828722+0000","last_active":"2024-09-10T23:24:21.972184+0000","last_peered":"2024-09-10T23:24:21.972184+0000","last_clean":"2024-09-10T23:24:21.972184+0000","last_became_active":"2024-09-10T23:23:57.828373+0000","last_became_peered":"2024-09-10T23:23:57.828373+0000","last_unstale":"2024-09-10T23:24:21.972184+0000","last_undegraded":"2024-09-10T23:24:21.972184+0000","last_fullsized":"2024-09-10T23:24:21.972184+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:19.891684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:49.252766+0000","last_change":"2024-09-10T23:23:54.789584+0000","last_active":"2024-09-10T23:24:49.252766+0000","last_peered":"2024-09-10T23:24:49.252766+0000","last_clean":"2024-09-10T23:24:49.252766+0000","last_became_active":"2024-09-10T23:23:54.789166+0000","last_became_peered":"2024-09-10T23:23:54.789166+0000","last_unstale":"2024-09-10T23:24:49.252766+0000","last_undegraded":"2024-09-10T23:24:49.252766+0000","last_fullsized":"2024-09-10T23:24:49.252766+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:02.292384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":117,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971320+0000","last_change":"2024-09-10T23:22:28.076475+0000","last_active":"2024-09-10T23:24:21.971320+0000","last_peered":"2024-09-10T23:24:21.971320+0000","last_clean":"2024-09-10T23:24:21.971320+0000","last_became_active":"2024-09-10T23:22:28.070622+0000","last_became_peered":"2024-09-10T23:22:28.070622+0000","last_unstale":"2024-09-10T23:24:21.971320+0000","last_undegraded":"2024-09-10T23:24:21.971320+0000","last_fullsized":"2024-09-10T23:24:21.971320+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:28.022462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:28.022462+0000","last_clean_scrub_stamp":"2024-09-10T23:18:28.022462+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:46:16.329399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971335+0000","last_change":"2024-09-10T23:24:05.884647+0000","last_active":"2024-09-10T23:24:21.971335+0000","last_peered":"2024-09-10T23:24:21.971335+0000","last_clean":"2024-09-10T23:24:21.971335+0000","last_became_active":"2024-09-10T23:24:05.883476+0000","last_became_peered":"2024-09-10T23:24:05.883476+0000","last_unstale":"2024-09-10T23:24:21.971335+0000","last_undegraded":"2024-09-10T23:24:21.971335+0000","last_fullsized":"2024-09-10T23:24:21.971335+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:02.524767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971536+0000","last_change":"2024-09-10T23:23:57.840835+0000","last_active":"2024-09-10T23:24:21.971536+0000","last_peered":"2024-09-10T23:24:21.971536+0000","last_clean":"2024-09-10T23:24:21.971536+0000","last_became_active":"2024-09-10T23:23:57.840472+0000","last_became_peered":"2024-09-10T23:23:57.840472+0000","last_unstale":"2024-09-10T23:24:21.971536+0000","last_undegraded":"2024-09-10T23:24:21.971536+0000","last_fullsized":"2024-09-10T23:24:21.971536+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:18.050686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:48.248827+0000","last_change":"2024-09-10T23:23:55.081669+0000","last_active":"2024-09-10T23:24:48.248827+0000","last_peered":"2024-09-10T23:24:48.248827+0000","last_clean":"2024-09-10T23:24:48.248827+0000","last_became_active":"2024-09-10T23:23:55.081306+0000","last_became_peered":"2024-09-10T23:23:55.081306+0000","last_unstale":"2024-09-10T23:24:48.248827+0000","last_undegraded":"2024-09-10T23:24:48.248827+0000","last_fullsized":"2024-09-10T23:24:48.248827+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:54.968431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972265+0000","last_change":"2024-09-10T23:24:05.880876+0000","last_active":"2024-09-10T23:24:21.972265+0000","last_peered":"2024-09-10T23:24:21.972265+0000","last_clean":"2024-09-10T23:24:21.972265+0000","last_became_active":"2024-09-10T23:24:05.880504+0000","last_became_peered":"2024-09-10T23:24:05.880504+0000","last_unstale":"2024-09-10T23:24:21.972265+0000","last_undegraded":"2024-09-10T23:24:21.972265+0000","last_fullsized":"2024-09-10T23:24:21.972265+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:17:55.689134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971589+0000","last_change":"2024-09-10T23:23:57.826637+0000","last_active":"2024-09-10T23:24:21.971589+0000","last_peered":"2024-09-10T23:24:21.971589+0000","last_clean":"2024-09-10T23:24:21.971589+0000","last_became_active":"2024-09-10T23:23:57.825915+0000","last_became_peered":"2024-09-10T23:23:57.825915+0000","last_unstale":"2024-09-10T23:24:21.971589+0000","last_undegraded":"2024-09-10T23:24:21.971589+0000","last_fullsized":"2024-09-10T23:24:21.971589+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:55.281687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.974360+0000","last_change":"2024-09-10T23:23:54.789847+0000","last_active":"2024-09-10T23:24:21.974360+0000","last_peered":"2024-09-10T23:24:21.974360+0000","last_clean":"2024-09-10T23:24:21.974360+0000","last_became_active":"2024-09-10T23:23:54.789082+0000","last_became_peered":"2024-09-10T23:23:54.789082+0000","last_unstale":"2024-09-10T23:24:21.974360+0000","last_undegraded":"2024-09-10T23:24:21.974360+0000","last_fullsized":"2024-09-10T23:24:21.974360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:39:16.162317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.968326+0000","last_change":"2024-09-10T23:24:05.895799+0000","last_active":"2024-09-10T23:24:21.968326+0000","last_peered":"2024-09-10T23:24:21.968326+0000","last_clean":"2024-09-10T23:24:21.968326+0000","last_became_active":"2024-09-10T23:24:05.895361+0000","last_became_peered":"2024-09-10T23:24:05.895361+0000","last_unstale":"2024-09-10T23:24:21.968326+0000","last_undegraded":"2024-09-10T23:24:21.968326+0000","last_fullsized":"2024-09-10T23:24:21.968326+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:10.893000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971780+0000","last_change":"2024-09-10T23:23:57.834954+0000","last_active":"2024-09-10T23:24:21.971780+0000","last_peered":"2024-09-10T23:24:21.971780+0000","last_clean":"2024-09-10T23:24:21.971780+0000","last_became_active":"2024-09-10T23:23:57.834215+0000","last_became_peered":"2024-09-10T23:23:57.834215+0000","last_unstale":"2024-09-10T23:24:21.971780+0000","last_undegraded":"2024-09-10T23:24:21.971780+0000","last_fullsized":"2024-09-10T23:24:21.971780+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:19:42.051352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:22.301120+0000","last_change":"2024-09-10T23:24:22.301029+0000","last_active":"2024-09-10T23:24:22.301120+0000","last_peered":"2024-09-10T23:24:22.301120+0000","last_clean":"2024-09-10T23:24:22.301120+0000","last_became_active":"2024-09-10T23:24:22.297759+0000","last_became_peered":"2024-09-10T23:24:22.297759+0000","last_unstale":"2024-09-10T23:24:22.301120+0000","last_undegraded":"2024-09-10T23:24:22.301120+0000","last_fullsized":"2024-09-10T23:24:22.301120+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:05.364737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971346+0000","last_change":"2024-09-10T23:24:05.884172+0000","last_active":"2024-09-10T23:24:21.971346+0000","last_peered":"2024-09-10T23:24:21.971346+0000","last_clean":"2024-09-10T23:24:21.971346+0000","last_became_active":"2024-09-10T23:24:05.881918+0000","last_became_peered":"2024-09-10T23:24:05.881918+0000","last_unstale":"2024-09-10T23:24:21.971346+0000","last_undegraded":"2024-09-10T23:24:21.971346+0000","last_fullsized":"2024-09-10T23:24:21.971346+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:19:15.250926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:22.297283+0000","last_change":"2024-09-10T23:24:22.297163+0000","last_active":"2024-09-10T23:24:22.297283+0000","last_peered":"2024-09-10T23:24:22.297283+0000","last_clean":"2024-09-10T23:24:22.297283+0000","last_became_active":"2024-09-10T23:24:22.296751+0000","last_became_peered":"2024-09-10T23:24:22.296751+0000","last_unstale":"2024-09-10T23:24:22.297283+0000","last_undegraded":"2024-09-10T23:24:22.297283+0000","last_fullsized":"2024-09-10T23:24:22.297283+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:37:50.379101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:49.252398+0000","last_change":"2024-09-10T23:23:54.788008+0000","last_active":"2024-09-10T23:24:49.252398+0000","last_peered":"2024-09-10T23:24:49.252398+0000","last_clean":"2024-09-10T23:24:49.252398+0000","last_became_active":"2024-09-10T23:23:54.787702+0000","last_became_peered":"2024-09-10T23:23:54.787702+0000","last_unstale":"2024-09-10T23:24:49.252398+0000","last_undegraded":"2024-09-10T23:24:49.252398+0000","last_fullsized":"2024-09-10T23:24:49.252398+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:45.997467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972396+0000","last_change":"2024-09-10T23:24:05.887208+0000","last_active":"2024-09-10T23:24:21.972396+0000","last_peered":"2024-09-10T23:24:21.972396+0000","last_clean":"2024-09-10T23:24:21.972396+0000","last_became_active":"2024-09-10T23:24:05.885556+0000","last_became_peered":"2024-09-10T23:24:05.885556+0000","last_unstale":"2024-09-10T23:24:21.972396+0000","last_undegraded":"2024-09-10T23:24:21.972396+0000","last_fullsized":"2024-09-10T23:24:21.972396+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:21.843558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972698+0000","last_change":"2024-09-10T23:23:57.842937+0000","last_active":"2024-09-10T23:24:21.972698+0000","last_peered":"2024-09-10T23:24:21.972698+0000","last_clean":"2024-09-10T23:24:21.972698+0000","last_became_active":"2024-09-10T23:23:57.842158+0000","last_became_peered":"2024-09-10T23:23:57.842158+0000","last_unstale":"2024-09-10T23:24:21.972698+0000","last_undegraded":"2024-09-10T23:24:21.972698+0000","last_fullsized":"2024-09-10T23:24:21.972698+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:49:58.716816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":57,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:48.248651+0000","last_change":"2024-09-10T23:23:54.787515+0000","last_active":"2024-09-10T23:24:48.248651+0000","last_peered":"2024-09-10T23:24:48.248651+0000","last_clean":"2024-09-10T23:24:48.248651+0000","last_became_active":"2024-09-10T23:23:54.786950+0000","last_became_peered":"2024-09-10T23:23:54.786950+0000","last_unstale":"2024-09-10T23:24:48.248651+0000","last_undegraded":"2024-09-10T23:24:48.248651+0000","last_fullsized":"2024-09-10T23:24:48.248651+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:12.546459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973072+0000","last_change":"2024-09-10T23:24:05.882784+0000","last_active":"2024-09-10T23:24:21.973072+0000","last_peered":"2024-09-10T23:24:21.973072+0000","last_clean":"2024-09-10T23:24:21.973072+0000","last_became_active":"2024-09-10T23:24:05.882331+0000","last_became_peered":"2024-09-10T23:24:05.882331+0000","last_unstale":"2024-09-10T23:24:21.973072+0000","last_undegraded":"2024-09-10T23:24:21.973072+0000","last_fullsized":"2024-09-10T23:24:21.973072+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:51:42.519144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.970370+0000","last_change":"2024-09-10T23:23:57.827896+0000","last_active":"2024-09-10T23:24:21.970370+0000","last_peered":"2024-09-10T23:24:21.970370+0000","last_clean":"2024-09-10T23:24:21.970370+0000","last_became_active":"2024-09-10T23:23:57.827572+0000","last_became_peered":"2024-09-10T23:23:57.827572+0000","last_unstale":"2024-09-10T23:24:21.970370+0000","last_undegraded":"2024-09-10T23:24:21.970370+0000","last_fullsized":"2024-09-10T23:24:21.970370+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:11.126594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'4","reported_seq":67,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:25:06.286100+0000","last_change":"2024-09-10T23:23:54.795582+0000","last_active":"2024-09-10T23:25:06.286100+0000","last_peered":"2024-09-10T23:25:06.286100+0000","last_clean":"2024-09-10T23:25:06.286100+0000","last_became_active":"2024-09-10T23:23:54.795225+0000","last_became_peered":"2024-09-10T23:23:54.795225+0000","last_unstale":"2024-09-10T23:25:06.286100+0000","last_undegraded":"2024-09-10T23:25:06.286100+0000","last_fullsized":"2024-09-10T23:25:06.286100+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:11.827090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.974398+0000","last_change":"2024-09-10T23:24:05.890159+0000","last_active":"2024-09-10T23:24:21.974398+0000","last_peered":"2024-09-10T23:24:21.974398+0000","last_clean":"2024-09-10T23:24:21.974398+0000","last_became_active":"2024-09-10T23:24:05.889583+0000","last_became_peered":"2024-09-10T23:24:05.889583+0000","last_unstale":"2024-09-10T23:24:21.974398+0000","last_undegraded":"2024-09-10T23:24:21.974398+0000","last_fullsized":"2024-09-10T23:24:21.974398+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:38.022627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971471+0000","last_change":"2024-09-10T23:23:57.843899+0000","last_active":"2024-09-10T23:24:21.971471+0000","last_peered":"2024-09-10T23:24:21.971471+0000","last_clean":"2024-09-10T23:24:21.971471+0000","last_became_active":"2024-09-10T23:23:57.843590+0000","last_became_peered":"2024-09-10T23:23:57.843590+0000","last_unstale":"2024-09-10T23:24:21.971471+0000","last_undegraded":"2024-09-10T23:24:21.971471+0000","last_fullsized":"2024-09-10T23:24:21.971471+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:32:17.919904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:47.240610+0000","last_change":"2024-09-10T23:23:54.795091+0000","last_active":"2024-09-10T23:24:47.240610+0000","last_peered":"2024-09-10T23:24:47.240610+0000","last_clean":"2024-09-10T23:24:47.240610+0000","last_became_active":"2024-09-10T23:23:54.794726+0000","last_became_peered":"2024-09-10T23:23:54.794726+0000","last_unstale":"2024-09-10T23:24:47.240610+0000","last_undegraded":"2024-09-10T23:24:47.240610+0000","last_fullsized":"2024-09-10T23:24:47.240610+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:56:20.322532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.968800+0000","last_change":"2024-09-10T23:24:05.881074+0000","last_active":"2024-09-10T23:24:21.968800+0000","last_peered":"2024-09-10T23:24:21.968800+0000","last_clean":"2024-09-10T23:24:21.968800+0000","last_became_active":"2024-09-10T23:24:05.880699+0000","last_became_peered":"2024-09-10T23:24:05.880699+0000","last_unstale":"2024-09-10T23:24:21.968800+0000","last_undegraded":"2024-09-10T23:24:21.968800+0000","last_fullsized":"2024-09-10T23:24:21.968800+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:38:22.268698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972953+0000","last_change":"2024-09-10T23:23:57.823729+0000","last_active":"2024-09-10T23:24:21.972953+0000","last_peered":"2024-09-10T23:24:21.972953+0000","last_clean":"2024-09-10T23:24:21.972953+0000","last_became_active":"2024-09-10T23:23:57.822797+0000","last_became_peered":"2024-09-10T23:23:57.822797+0000","last_unstale":"2024-09-10T23:24:21.972953+0000","last_undegraded":"2024-09-10T23:24:21.972953+0000","last_fullsized":"2024-09-10T23:24:21.972953+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:09.646543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:48.247363+0000","last_change":"2024-09-10T23:24:21.985389+0000","last_active":"2024-09-10T23:24:48.247363+0000","last_peered":"2024-09-10T23:24:48.247363+0000","last_clean":"2024-09-10T23:24:48.247363+0000","last_became_active":"2024-09-10T23:24:21.976084+0000","last_became_peered":"2024-09-10T23:24:21.976084+0000","last_unstale":"2024-09-10T23:24:48.247363+0000","last_undegraded":"2024-09-10T23:24:48.247363+0000","last_fullsized":"2024-09-10T23:24:48.247363+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:33.284211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973931+0000","last_change":"2024-09-10T23:24:05.890656+0000","last_active":"2024-09-10T23:24:21.973931+0000","last_peered":"2024-09-10T23:24:21.973931+0000","last_clean":"2024-09-10T23:24:21.973931+0000","last_became_active":"2024-09-10T23:24:05.889827+0000","last_became_peered":"2024-09-10T23:24:05.889827+0000","last_unstale":"2024-09-10T23:24:21.973931+0000","last_undegraded":"2024-09-10T23:24:21.973931+0000","last_fullsized":"2024-09-10T23:24:21.973931+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:15.301567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.965674+0000","last_change":"2024-09-10T23:23:57.827348+0000","last_active":"2024-09-10T23:24:21.965674+0000","last_peered":"2024-09-10T23:24:21.965674+0000","last_clean":"2024-09-10T23:24:21.965674+0000","last_became_active":"2024-09-10T23:23:57.826670+0000","last_became_peered":"2024-09-10T23:23:57.826670+0000","last_unstale":"2024-09-10T23:24:21.965674+0000","last_undegraded":"2024-09-10T23:24:21.965674+0000","last_fullsized":"2024-09-10T23:24:21.965674+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:19.268930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"88'29","reported_seq":112,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:25:06.285774+0000","last_change":"2024-09-10T23:23:54.789603+0000","last_active":"2024-09-10T23:25:06.285774+0000","last_peered":"2024-09-10T23:25:06.285774+0000","last_clean":"2024-09-10T23:25:06.285774+0000","last_became_active":"2024-09-10T23:23:54.789136+0000","last_became_peered":"2024-09-10T23:23:54.789136+0000","last_unstale":"2024-09-10T23:25:06.285774+0000","last_undegraded":"2024-09-10T23:25:06.285774+0000","last_fullsized":"2024-09-10T23:25:06.285774+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:47.648232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57254,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":76,"num_write":30,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973433+0000","last_change":"2024-09-10T23:24:05.883758+0000","last_active":"2024-09-10T23:24:21.973433+0000","last_peered":"2024-09-10T23:24:21.973433+0000","last_clean":"2024-09-10T23:24:21.973433+0000","last_became_active":"2024-09-10T23:24:05.883401+0000","last_became_peered":"2024-09-10T23:24:05.883401+0000","last_unstale":"2024-09-10T23:24:21.973433+0000","last_undegraded":"2024-09-10T23:24:21.973433+0000","last_fullsized":"2024-09-10T23:24:21.973433+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:52.862088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973201+0000","last_change":"2024-09-10T23:23:57.846524+0000","last_active":"2024-09-10T23:24:21.973201+0000","last_peered":"2024-09-10T23:24:21.973201+0000","last_clean":"2024-09-10T23:24:21.973201+0000","last_became_active":"2024-09-10T23:23:57.846036+0000","last_became_peered":"2024-09-10T23:23:57.846036+0000","last_unstale":"2024-09-10T23:24:21.973201+0000","last_undegraded":"2024-09-10T23:24:21.973201+0000","last_fullsized":"2024-09-10T23:24:21.973201+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:13.866827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:47.239944+0000","last_change":"2024-09-10T23:23:54.789925+0000","last_active":"2024-09-10T23:24:47.239944+0000","last_peered":"2024-09-10T23:24:47.239944+0000","last_clean":"2024-09-10T23:24:47.239944+0000","last_became_active":"2024-09-10T23:23:54.789600+0000","last_became_peered":"2024-09-10T23:23:54.789600+0000","last_unstale":"2024-09-10T23:24:47.239944+0000","last_undegraded":"2024-09-10T23:24:47.239944+0000","last_fullsized":"2024-09-10T23:24:47.239944+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:54.937422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:22.295875+0000","last_change":"2024-09-10T23:24:05.882530+0000","last_active":"2024-09-10T23:24:22.295875+0000","last_peered":"2024-09-10T23:24:22.295875+0000","last_clean":"2024-09-10T23:24:22.295875+0000","last_became_active":"2024-09-10T23:24:05.881092+0000","last_became_peered":"2024-09-10T23:24:05.881092+0000","last_unstale":"2024-09-10T23:24:22.295875+0000","last_undegraded":"2024-09-10T23:24:22.295875+0000","last_fullsized":"2024-09-10T23:24:22.295875+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:54.954300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.968620+0000","last_change":"2024-09-10T23:23:57.837341+0000","last_active":"2024-09-10T23:24:21.968620+0000","last_peered":"2024-09-10T23:24:21.968620+0000","last_clean":"2024-09-10T23:24:21.968620+0000","last_became_active":"2024-09-10T23:23:57.837024+0000","last_became_peered":"2024-09-10T23:23:57.837024+0000","last_unstale":"2024-09-10T23:24:21.968620+0000","last_undegraded":"2024-09-10T23:24:21.968620+0000","last_fullsized":"2024-09-10T23:24:21.968620+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:22:48.241471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:47.238857+0000","last_change":"2024-09-10T23:23:54.792028+0000","last_active":"2024-09-10T23:24:47.238857+0000","last_peered":"2024-09-10T23:24:47.238857+0000","last_clean":"2024-09-10T23:24:47.238857+0000","last_became_active":"2024-09-10T23:23:54.791589+0000","last_became_peered":"2024-09-10T23:23:54.791589+0000","last_unstale":"2024-09-10T23:24:47.238857+0000","last_undegraded":"2024-09-10T23:24:47.238857+0000","last_fullsized":"2024-09-10T23:24:47.238857+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:48.589441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972529+0000","last_change":"2024-09-10T23:24:05.888627+0000","last_active":"2024-09-10T23:24:21.972529+0000","last_peered":"2024-09-10T23:24:21.972529+0000","last_clean":"2024-09-10T23:24:21.972529+0000","last_became_active":"2024-09-10T23:24:05.887925+0000","last_became_peered":"2024-09-10T23:24:05.887925+0000","last_unstale":"2024-09-10T23:24:21.972529+0000","last_undegraded":"2024-09-10T23:24:21.972529+0000","last_fullsized":"2024-09-10T23:24:21.972529+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:15.956333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973375+0000","last_change":"2024-09-10T23:23:57.833009+0000","last_active":"2024-09-10T23:24:21.973375+0000","last_peered":"2024-09-10T23:24:21.973375+0000","last_clean":"2024-09-10T23:24:21.973375+0000","last_became_active":"2024-09-10T23:23:57.830782+0000","last_became_peered":"2024-09-10T23:23:57.830782+0000","last_unstale":"2024-09-10T23:24:21.973375+0000","last_undegraded":"2024-09-10T23:24:21.973375+0000","last_fullsized":"2024-09-10T23:24:21.973375+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:42.520461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"88'3","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:25:05.283554+0000","last_change":"2024-09-10T23:23:54.789322+0000","last_active":"2024-09-10T23:25:05.283554+0000","last_peered":"2024-09-10T23:25:05.283554+0000","last_clean":"2024-09-10T23:25:05.283554+0000","last_became_active":"2024-09-10T23:23:54.788879+0000","last_became_peered":"2024-09-10T23:23:54.788879+0000","last_unstale":"2024-09-10T23:25:05.283554+0000","last_undegraded":"2024-09-10T23:25:05.283554+0000","last_fullsized":"2024-09-10T23:25:05.283554+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:37.276413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971758+0000","last_change":"2024-09-10T23:24:05.886626+0000","last_active":"2024-09-10T23:24:21.971758+0000","last_peered":"2024-09-10T23:24:21.971758+0000","last_clean":"2024-09-10T23:24:21.971758+0000","last_became_active":"2024-09-10T23:24:05.886076+0000","last_became_peered":"2024-09-10T23:24:05.886076+0000","last_unstale":"2024-09-10T23:24:21.971758+0000","last_undegraded":"2024-09-10T23:24:21.971758+0000","last_fullsized":"2024-09-10T23:24:21.971758+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:44.987664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.968409+0000","last_change":"2024-09-10T23:24:05.891242+0000","last_active":"2024-09-10T23:24:21.968409+0000","last_peered":"2024-09-10T23:24:21.968409+0000","last_clean":"2024-09-10T23:24:21.968409+0000","last_became_active":"2024-09-10T23:24:05.889513+0000","last_became_peered":"2024-09-10T23:24:05.889513+0000","last_unstale":"2024-09-10T23:24:21.968409+0000","last_undegraded":"2024-09-10T23:24:21.968409+0000","last_fullsized":"2024-09-10T23:24:21.968409+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:07.774304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.974198+0000","last_change":"2024-09-10T23:23:57.831698+0000","last_active":"2024-09-10T23:24:21.974198+0000","last_peered":"2024-09-10T23:24:21.974198+0000","last_clean":"2024-09-10T23:24:21.974198+0000","last_became_active":"2024-09-10T23:23:57.829348+0000","last_became_peered":"2024-09-10T23:23:57.829348+0000","last_unstale":"2024-09-10T23:24:21.974198+0000","last_undegraded":"2024-09-10T23:24:21.974198+0000","last_fullsized":"2024-09-10T23:24:21.974198+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:09.636786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972156+0000","last_change":"2024-09-10T23:23:54.795380+0000","last_active":"2024-09-10T23:24:21.972156+0000","last_peered":"2024-09-10T23:24:21.972156+0000","last_clean":"2024-09-10T23:24:21.972156+0000","last_became_active":"2024-09-10T23:23:54.794465+0000","last_became_peered":"2024-09-10T23:23:54.794465+0000","last_unstale":"2024-09-10T23:24:21.972156+0000","last_undegraded":"2024-09-10T23:24:21.972156+0000","last_fullsized":"2024-09-10T23:24:21.972156+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:32.082020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.968010+0000","last_change":"2024-09-10T23:24:05.886531+0000","last_active":"2024-09-10T23:24:21.968010+0000","last_peered":"2024-09-10T23:24:21.968010+0000","last_clean":"2024-09-10T23:24:21.968010+0000","last_became_active":"2024-09-10T23:24:05.885762+0000","last_became_peered":"2024-09-10T23:24:05.885762+0000","last_unstale":"2024-09-10T23:24:21.968010+0000","last_undegraded":"2024-09-10T23:24:21.968010+0000","last_fullsized":"2024-09-10T23:24:21.968010+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:35.407364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972187+0000","last_change":"2024-09-10T23:23:57.828052+0000","last_active":"2024-09-10T23:24:21.972187+0000","last_peered":"2024-09-10T23:24:21.972187+0000","last_clean":"2024-09-10T23:24:21.972187+0000","last_became_active":"2024-09-10T23:23:57.827653+0000","last_became_peered":"2024-09-10T23:23:57.827653+0000","last_unstale":"2024-09-10T23:24:21.972187+0000","last_undegraded":"2024-09-10T23:24:21.972187+0000","last_fullsized":"2024-09-10T23:24:21.972187+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:33.605054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:48.248830+0000","last_change":"2024-09-10T23:23:54.791375+0000","last_active":"2024-09-10T23:24:48.248830+0000","last_peered":"2024-09-10T23:24:48.248830+0000","last_clean":"2024-09-10T23:24:48.248830+0000","last_became_active":"2024-09-10T23:23:54.790974+0000","last_became_peered":"2024-09-10T23:23:54.790974+0000","last_unstale":"2024-09-10T23:24:48.248830+0000","last_undegraded":"2024-09-10T23:24:48.248830+0000","last_fullsized":"2024-09-10T23:24:48.248830+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:23:44.066787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:48.247457+0000","last_change":"2024-09-10T23:23:54.792056+0000","last_active":"2024-09-10T23:24:48.247457+0000","last_peered":"2024-09-10T23:24:48.247457+0000","last_clean":"2024-09-10T23:24:48.247457+0000","last_became_active":"2024-09-10T23:23:54.791665+0000","last_became_peered":"2024-09-10T23:23:54.791665+0000","last_unstale":"2024-09-10T23:24:48.247457+0000","last_undegraded":"2024-09-10T23:24:48.247457+0000","last_fullsized":"2024-09-10T23:24:48.247457+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:34:38.517066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973941+0000","last_change":"2024-09-10T23:23:57.842524+0000","last_active":"2024-09-10T23:24:21.973941+0000","last_peered":"2024-09-10T23:24:21.973941+0000","last_clean":"2024-09-10T23:24:21.973941+0000","last_became_active":"2024-09-10T23:23:57.842033+0000","last_became_peered":"2024-09-10T23:23:57.842033+0000","last_unstale":"2024-09-10T23:24:21.973941+0000","last_undegraded":"2024-09-10T23:24:21.973941+0000","last_fullsized":"2024-09-10T23:24:21.973941+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:39.431115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971295+0000","last_change":"2024-09-10T23:24:05.891676+0000","last_active":"2024-09-10T23:24:21.971295+0000","last_peered":"2024-09-10T23:24:21.971295+0000","last_clean":"2024-09-10T23:24:21.971295+0000","last_became_active":"2024-09-10T23:24:05.891224+0000","last_became_peered":"2024-09-10T23:24:05.891224+0000","last_unstale":"2024-09-10T23:24:21.971295+0000","last_undegraded":"2024-09-10T23:24:21.971295+0000","last_fullsized":"2024-09-10T23:24:21.971295+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:16:50.384745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'5","reported_seq":67,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:25:06.286045+0000","last_change":"2024-09-10T23:23:54.795126+0000","last_active":"2024-09-10T23:25:06.286045+0000","last_peered":"2024-09-10T23:25:06.286045+0000","last_clean":"2024-09-10T23:25:06.286045+0000","last_became_active":"2024-09-10T23:23:54.794553+0000","last_became_peered":"2024-09-10T23:23:54.794553+0000","last_unstale":"2024-09-10T23:25:06.286045+0000","last_undegraded":"2024-09-10T23:25:06.286045+0000","last_fullsized":"2024-09-10T23:25:06.286045+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:15:43.181180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.965394+0000","last_change":"2024-09-10T23:23:57.826827+0000","last_active":"2024-09-10T23:24:21.965394+0000","last_peered":"2024-09-10T23:24:21.965394+0000","last_clean":"2024-09-10T23:24:21.965394+0000","last_became_active":"2024-09-10T23:23:57.826457+0000","last_became_peered":"2024-09-10T23:23:57.826457+0000","last_unstale":"2024-09-10T23:24:21.965394+0000","last_undegraded":"2024-09-10T23:24:21.965394+0000","last_fullsized":"2024-09-10T23:24:21.965394+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:13.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972285+0000","last_change":"2024-09-10T23:24:05.888774+0000","last_active":"2024-09-10T23:24:21.972285+0000","last_peered":"2024-09-10T23:24:21.972285+0000","last_clean":"2024-09-10T23:24:21.972285+0000","last_became_active":"2024-09-10T23:24:05.888267+0000","last_became_peered":"2024-09-10T23:24:05.888267+0000","last_unstale":"2024-09-10T23:24:21.972285+0000","last_undegraded":"2024-09-10T23:24:21.972285+0000","last_fullsized":"2024-09-10T23:24:21.972285+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:29.283509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.967718+0000","last_change":"2024-09-10T23:23:57.819178+0000","last_active":"2024-09-10T23:24:21.967718+0000","last_peered":"2024-09-10T23:24:21.967718+0000","last_clean":"2024-09-10T23:24:21.967718+0000","last_became_active":"2024-09-10T23:23:57.817029+0000","last_became_peered":"2024-09-10T23:23:57.817029+0000","last_unstale":"2024-09-10T23:24:21.967718+0000","last_undegraded":"2024-09-10T23:24:21.967718+0000","last_fullsized":"2024-09-10T23:24:21.967718+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:28:51.491402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.978330+0000","last_change":"2024-09-10T23:24:21.978215+0000","last_active":"2024-09-10T23:24:21.978330+0000","last_peered":"2024-09-10T23:24:21.978330+0000","last_clean":"2024-09-10T23:24:21.978330+0000","last_became_active":"2024-09-10T23:24:21.977811+0000","last_became_peered":"2024-09-10T23:24:21.977811+0000","last_unstale":"2024-09-10T23:24:21.978330+0000","last_undegraded":"2024-09-10T23:24:21.978330+0000","last_fullsized":"2024-09-10T23:24:21.978330+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:41.769216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972164+0000","last_change":"2024-09-10T23:23:57.824147+0000","last_active":"2024-09-10T23:24:21.972164+0000","last_peered":"2024-09-10T23:24:21.972164+0000","last_clean":"2024-09-10T23:24:21.972164+0000","last_became_active":"2024-09-10T23:23:57.823503+0000","last_became_peered":"2024-09-10T23:23:57.823503+0000","last_unstale":"2024-09-10T23:24:21.972164+0000","last_undegraded":"2024-09-10T23:24:21.972164+0000","last_fullsized":"2024-09-10T23:24:21.972164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:12:34.310648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.968432+0000","last_change":"2024-09-10T23:23:57.841413+0000","last_active":"2024-09-10T23:24:21.968432+0000","last_peered":"2024-09-10T23:24:21.968432+0000","last_clean":"2024-09-10T23:24:21.968432+0000","last_became_active":"2024-09-10T23:23:57.840889+0000","last_became_peered":"2024-09-10T23:23:57.840889+0000","last_unstale":"2024-09-10T23:24:21.968432+0000","last_undegraded":"2024-09-10T23:24:21.968432+0000","last_fullsized":"2024-09-10T23:24:21.968432+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:10:08.757628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973456+0000","last_change":"2024-09-10T23:23:57.837267+0000","last_active":"2024-09-10T23:24:21.973456+0000","last_peered":"2024-09-10T23:24:21.973456+0000","last_clean":"2024-09-10T23:24:21.973456+0000","last_became_active":"2024-09-10T23:23:57.836911+0000","last_became_peered":"2024-09-10T23:23:57.836911+0000","last_unstale":"2024-09-10T23:24:21.973456+0000","last_undegraded":"2024-09-10T23:24:21.973456+0000","last_fullsized":"2024-09-10T23:24:21.973456+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:24.969215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.968413+0000","last_change":"2024-09-10T23:23:57.813855+0000","last_active":"2024-09-10T23:24:21.968413+0000","last_peered":"2024-09-10T23:24:21.968413+0000","last_clean":"2024-09-10T23:24:21.968413+0000","last_became_active":"2024-09-10T23:23:57.812862+0000","last_became_peered":"2024-09-10T23:23:57.812862+0000","last_unstale":"2024-09-10T23:24:21.968413+0000","last_undegraded":"2024-09-10T23:24:21.968413+0000","last_fullsized":"2024-09-10T23:24:21.968413+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:21.542499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972877+0000","last_change":"2024-09-10T23:23:57.826082+0000","last_active":"2024-09-10T23:24:21.972877+0000","last_peered":"2024-09-10T23:24:21.972877+0000","last_clean":"2024-09-10T23:24:21.972877+0000","last_became_active":"2024-09-10T23:23:57.825695+0000","last_became_peered":"2024-09-10T23:23:57.825695+0000","last_unstale":"2024-09-10T23:24:21.972877+0000","last_undegraded":"2024-09-10T23:24:21.972877+0000","last_fullsized":"2024-09-10T23:24:21.972877+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:08.518084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972540+0000","last_change":"2024-09-10T23:23:57.835147+0000","last_active":"2024-09-10T23:24:21.972540+0000","last_peered":"2024-09-10T23:24:21.972540+0000","last_clean":"2024-09-10T23:24:21.972540+0000","last_became_active":"2024-09-10T23:23:57.834739+0000","last_became_peered":"2024-09-10T23:23:57.834739+0000","last_unstale":"2024-09-10T23:24:21.972540+0000","last_undegraded":"2024-09-10T23:24:21.972540+0000","last_fullsized":"2024-09-10T23:24:21.972540+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:06:27.023088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971650+0000","last_change":"2024-09-10T23:23:57.825996+0000","last_active":"2024-09-10T23:24:21.971650+0000","last_peered":"2024-09-10T23:24:21.971650+0000","last_clean":"2024-09-10T23:24:21.971650+0000","last_became_active":"2024-09-10T23:23:57.824168+0000","last_became_peered":"2024-09-10T23:23:57.824168+0000","last_unstale":"2024-09-10T23:24:21.971650+0000","last_undegraded":"2024-09-10T23:24:21.971650+0000","last_fullsized":"2024-09-10T23:24:21.971650+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:36.396179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.979001+0000","last_change":"2024-09-10T23:24:21.976841+0000","last_active":"2024-09-10T23:24:21.979001+0000","last_peered":"2024-09-10T23:24:21.979001+0000","last_clean":"2024-09-10T23:24:21.979001+0000","last_became_active":"2024-09-10T23:24:21.976461+0000","last_became_peered":"2024-09-10T23:24:21.976461+0000","last_unstale":"2024-09-10T23:24:21.979001+0000","last_undegraded":"2024-09-10T23:24:21.979001+0000","last_fullsized":"2024-09-10T23:24:21.979001+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:04:00.000274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972429+0000","last_change":"2024-09-10T23:23:57.840477+0000","last_active":"2024-09-10T23:24:21.972429+0000","last_peered":"2024-09-10T23:24:21.972429+0000","last_clean":"2024-09-10T23:24:21.972429+0000","last_became_active":"2024-09-10T23:23:57.840113+0000","last_became_peered":"2024-09-10T23:23:57.840113+0000","last_unstale":"2024-09-10T23:24:21.972429+0000","last_undegraded":"2024-09-10T23:24:21.972429+0000","last_fullsized":"2024-09-10T23:24:21.972429+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:27:23.913802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973335+0000","last_change":"2024-09-10T23:23:57.837416+0000","last_active":"2024-09-10T23:24:21.973335+0000","last_peered":"2024-09-10T23:24:21.973335+0000","last_clean":"2024-09-10T23:24:21.973335+0000","last_became_active":"2024-09-10T23:23:57.837104+0000","last_became_peered":"2024-09-10T23:23:57.837104+0000","last_unstale":"2024-09-10T23:24:21.973335+0000","last_undegraded":"2024-09-10T23:24:21.973335+0000","last_fullsized":"2024-09-10T23:24:21.973335+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:00.712148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.968925+0000","last_change":"2024-09-10T23:23:57.838304+0000","last_active":"2024-09-10T23:24:21.968925+0000","last_peered":"2024-09-10T23:24:21.968925+0000","last_clean":"2024-09-10T23:24:21.968925+0000","last_became_active":"2024-09-10T23:23:57.837677+0000","last_became_peered":"2024-09-10T23:23:57.837677+0000","last_unstale":"2024-09-10T23:24:21.968925+0000","last_undegraded":"2024-09-10T23:24:21.968925+0000","last_fullsized":"2024-09-10T23:24:21.968925+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:40.862950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973043+0000","last_change":"2024-09-10T23:23:57.825579+0000","last_active":"2024-09-10T23:24:21.973043+0000","last_peered":"2024-09-10T23:24:21.973043+0000","last_clean":"2024-09-10T23:24:21.973043+0000","last_became_active":"2024-09-10T23:23:57.824840+0000","last_became_peered":"2024-09-10T23:23:57.824840+0000","last_unstale":"2024-09-10T23:24:21.973043+0000","last_undegraded":"2024-09-10T23:24:21.973043+0000","last_fullsized":"2024-09-10T23:24:21.973043+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:53:35.150858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972279+0000","last_change":"2024-09-10T23:23:57.833479+0000","last_active":"2024-09-10T23:24:21.972279+0000","last_peered":"2024-09-10T23:24:21.972279+0000","last_clean":"2024-09-10T23:24:21.972279+0000","last_became_active":"2024-09-10T23:23:57.833124+0000","last_became_peered":"2024-09-10T23:23:57.833124+0000","last_unstale":"2024-09-10T23:24:21.972279+0000","last_undegraded":"2024-09-10T23:24:21.972279+0000","last_fullsized":"2024-09-10T23:24:21.972279+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:02.869308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.968371+0000","last_change":"2024-09-10T23:23:57.831610+0000","last_active":"2024-09-10T23:24:21.968371+0000","last_peered":"2024-09-10T23:24:21.968371+0000","last_clean":"2024-09-10T23:24:21.968371+0000","last_became_active":"2024-09-10T23:23:57.831227+0000","last_became_peered":"2024-09-10T23:23:57.831227+0000","last_unstale":"2024-09-10T23:24:21.968371+0000","last_undegraded":"2024-09-10T23:24:21.968371+0000","last_fullsized":"2024-09-10T23:24:21.968371+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:45.735286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972054+0000","last_change":"2024-09-10T23:23:57.839295+0000","last_active":"2024-09-10T23:24:21.972054+0000","last_peered":"2024-09-10T23:24:21.972054+0000","last_clean":"2024-09-10T23:24:21.972054+0000","last_became_active":"2024-09-10T23:23:57.838857+0000","last_became_peered":"2024-09-10T23:23:57.838857+0000","last_unstale":"2024-09-10T23:24:21.972054+0000","last_undegraded":"2024-09-10T23:24:21.972054+0000","last_fullsized":"2024-09-10T23:24:21.972054+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:20:13.203324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.968113+0000","last_change":"2024-09-10T23:23:57.841459+0000","last_active":"2024-09-10T23:24:21.968113+0000","last_peered":"2024-09-10T23:24:21.968113+0000","last_clean":"2024-09-10T23:24:21.968113+0000","last_became_active":"2024-09-10T23:23:57.841049+0000","last_became_peered":"2024-09-10T23:23:57.841049+0000","last_unstale":"2024-09-10T23:24:21.968113+0000","last_undegraded":"2024-09-10T23:24:21.968113+0000","last_fullsized":"2024-09-10T23:24:21.968113+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:39:51.372657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.968054+0000","last_change":"2024-09-10T23:23:57.813028+0000","last_active":"2024-09-10T23:24:21.968054+0000","last_peered":"2024-09-10T23:24:21.968054+0000","last_clean":"2024-09-10T23:24:21.968054+0000","last_became_active":"2024-09-10T23:23:57.812648+0000","last_became_peered":"2024-09-10T23:23:57.812648+0000","last_unstale":"2024-09-10T23:24:21.968054+0000","last_undegraded":"2024-09-10T23:24:21.968054+0000","last_fullsized":"2024-09-10T23:24:21.968054+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:57.691811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973337+0000","last_change":"2024-09-10T23:23:57.814467+0000","last_active":"2024-09-10T23:24:21.973337+0000","last_peered":"2024-09-10T23:24:21.973337+0000","last_clean":"2024-09-10T23:24:21.973337+0000","last_became_active":"2024-09-10T23:23:57.812286+0000","last_became_peered":"2024-09-10T23:23:57.812286+0000","last_unstale":"2024-09-10T23:24:21.973337+0000","last_undegraded":"2024-09-10T23:24:21.973337+0000","last_fullsized":"2024-09-10T23:24:21.973337+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:42.044495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:22.295671+0000","last_change":"2024-09-10T23:23:57.834679+0000","last_active":"2024-09-10T23:24:22.295671+0000","last_peered":"2024-09-10T23:24:22.295671+0000","last_clean":"2024-09-10T23:24:22.295671+0000","last_became_active":"2024-09-10T23:23:57.833964+0000","last_became_peered":"2024-09-10T23:23:57.833964+0000","last_unstale":"2024-09-10T23:24:22.295671+0000","last_undegraded":"2024-09-10T23:24:22.295671+0000","last_fullsized":"2024-09-10T23:24:22.295671+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:29.160280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.971428+0000","last_change":"2024-09-10T23:23:57.840788+0000","last_active":"2024-09-10T23:24:21.971428+0000","last_peered":"2024-09-10T23:24:21.971428+0000","last_clean":"2024-09-10T23:24:21.971428+0000","last_became_active":"2024-09-10T23:23:57.839946+0000","last_became_peered":"2024-09-10T23:23:57.839946+0000","last_unstale":"2024-09-10T23:24:21.971428+0000","last_undegraded":"2024-09-10T23:24:21.971428+0000","last_fullsized":"2024-09-10T23:24:21.971428+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:14.354925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.974381+0000","last_change":"2024-09-10T23:23:57.843454+0000","last_active":"2024-09-10T23:24:21.974381+0000","last_peered":"2024-09-10T23:24:21.974381+0000","last_clean":"2024-09-10T23:24:21.974381+0000","last_became_active":"2024-09-10T23:23:57.841623+0000","last_became_peered":"2024-09-10T23:23:57.841623+0000","last_unstale":"2024-09-10T23:24:21.974381+0000","last_undegraded":"2024-09-10T23:24:21.974381+0000","last_fullsized":"2024-09-10T23:24:21.974381+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:03:03.957444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973256+0000","last_change":"2024-09-10T23:23:57.834196+0000","last_active":"2024-09-10T23:24:21.973256+0000","last_peered":"2024-09-10T23:24:21.973256+0000","last_clean":"2024-09-10T23:24:21.973256+0000","last_became_active":"2024-09-10T23:23:57.833692+0000","last_became_peered":"2024-09-10T23:23:57.833692+0000","last_unstale":"2024-09-10T23:24:21.973256+0000","last_undegraded":"2024-09-10T23:24:21.973256+0000","last_fullsized":"2024-09-10T23:24:21.973256+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:49.814475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.972161+0000","last_change":"2024-09-10T23:23:57.831457+0000","last_active":"2024-09-10T23:24:21.972161+0000","last_peered":"2024-09-10T23:24:21.972161+0000","last_clean":"2024-09-10T23:24:21.972161+0000","last_became_active":"2024-09-10T23:23:57.829686+0000","last_became_peered":"2024-09-10T23:23:57.829686+0000","last_unstale":"2024-09-10T23:24:21.972161+0000","last_undegraded":"2024-09-10T23:24:21.972161+0000","last_fullsized":"2024-09-10T23:24:21.972161+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:39.204501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.970523+0000","last_change":"2024-09-10T23:23:57.829437+0000","last_active":"2024-09-10T23:24:21.970523+0000","last_peered":"2024-09-10T23:24:21.970523+0000","last_clean":"2024-09-10T23:24:21.970523+0000","last_became_active":"2024-09-10T23:23:57.828956+0000","last_became_peered":"2024-09-10T23:23:57.828956+0000","last_unstale":"2024-09-10T23:24:21.970523+0000","last_undegraded":"2024-09-10T23:24:21.970523+0000","last_fullsized":"2024-09-10T23:24:21.970523+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:18.191002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.973095+0000","last_change":"2024-09-10T23:23:57.839661+0000","last_active":"2024-09-10T23:24:21.973095+0000","last_peered":"2024-09-10T23:24:21.973095+0000","last_clean":"2024-09-10T23:24:21.973095+0000","last_became_active":"2024-09-10T23:23:57.839197+0000","last_became_peered":"2024-09-10T23:23:57.839197+0000","last_unstale":"2024-09-10T23:24:21.973095+0000","last_undegraded":"2024-09-10T23:24:21.973095+0000","last_fullsized":"2024-09-10T23:24:21.973095+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:33.599860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.965407+0000","last_change":"2024-09-10T23:23:57.820968+0000","last_active":"2024-09-10T23:24:21.965407+0000","last_peered":"2024-09-10T23:24:21.965407+0000","last_clean":"2024-09-10T23:24:21.965407+0000","last_became_active":"2024-09-10T23:23:57.820108+0000","last_became_peered":"2024-09-10T23:23:57.820108+0000","last_unstale":"2024-09-10T23:24:21.965407+0000","last_undegraded":"2024-09-10T23:24:21.965407+0000","last_fullsized":"2024-09-10T23:24:21.965407+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:23.864751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:22.295616+0000","last_change":"2024-09-10T23:23:57.842302+0000","last_active":"2024-09-10T23:24:22.295616+0000","last_peered":"2024-09-10T23:24:22.295616+0000","last_clean":"2024-09-10T23:24:22.295616+0000","last_became_active":"2024-09-10T23:23:57.838460+0000","last_became_peered":"2024-09-10T23:23:57.838460+0000","last_unstale":"2024-09-10T23:24:22.295616+0000","last_undegraded":"2024-09-10T23:24:22.295616+0000","last_fullsized":"2024-09-10T23:24:22.295616+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:54.731481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.968303+0000","last_change":"2024-09-10T23:23:57.837749+0000","last_active":"2024-09-10T23:24:21.968303+0000","last_peered":"2024-09-10T23:24:21.968303+0000","last_clean":"2024-09-10T23:24:21.968303+0000","last_became_active":"2024-09-10T23:23:57.836195+0000","last_became_peered":"2024-09-10T23:23:57.836195+0000","last_unstale":"2024-09-10T23:24:21.968303+0000","last_undegraded":"2024-09-10T23:24:21.968303+0000","last_fullsized":"2024-09-10T23:24:21.968303+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:10.064725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.968509+0000","last_change":"2024-09-10T23:23:57.812182+0000","last_active":"2024-09-10T23:24:21.968509+0000","last_peered":"2024-09-10T23:24:21.968509+0000","last_clean":"2024-09-10T23:24:21.968509+0000","last_became_active":"2024-09-10T23:23:57.811853+0000","last_became_peered":"2024-09-10T23:23:57.811853+0000","last_unstale":"2024-09-10T23:24:21.968509+0000","last_undegraded":"2024-09-10T23:24:21.968509+0000","last_fullsized":"2024-09-10T23:24:21.968509+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:03.389054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T23:24:21.968306+0000","last_change":"2024-09-10T23:23:57.833957+0000","last_active":"2024-09-10T23:24:21.968306+0000","last_peered":"2024-09-10T23:24:21.968306+0000","last_clean":"2024-09-10T23:24:21.968306+0000","last_became_active":"2024-09-10T23:23:57.833547+0000","last_became_peered":"2024-09-10T23:23:57.833547+0000","last_unstale":"2024-09-10T23:24:21.968306+0000","last_undegraded":"2024-09-10T23:24:21.968306+0000","last_fullsized":"2024-09-10T23:24:21.968306+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:30.917801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":61255,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":136,"num_read_kb":132,"num_write":159,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":385024,"data_stored":175605,"data_compressed":5592,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":288697,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678045,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":974848,"data_stored":515841,"data_compressed":26508,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874275,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1105920,"data_stored":1160720,"data_compressed":65070,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037800,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":520139,"data_compressed":26508,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234030,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":515963,"data_compressed":26508,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430260,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1036288,"data_stored":1111872,"data_compressed":63206,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593787,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":511219,"data_compressed":26508,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790017,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1044480,"data_stored":1107069,"data_compressed":63206,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953543,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":516260,"data_compressed":26508,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149772,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":511413,"data_compressed":26508,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378707,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1044480,"data_stored":569699,"data_compressed":28372,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542230,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32176,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712976,"statfs":{"total":95995035648,"available":95962087424,"internally_reserved":0,"allocated":1015808,"data_stored":560223,"data_compressed":28372,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705757,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":991232,"data_stored":512607,"data_compressed":26508,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":49094,"data_compressed":1864,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":58570,"data_compressed":1864,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":59223,"data_compressed":1864,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:25:10.743 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T23:25:10.743 INFO:tasks.cephadm:Setting up client nodes... 2024-09-10T23:25:10.744 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-10T23:25:11.156 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:11.333 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:11 smithi003 ceph-mon[30348]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:25:11.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:11 smithi038 ceph-mon[34225]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:25:11.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:11 smithi194 ceph-mon[33904]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:25:11.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.721+0000 7fa25b200640 1 -- 172.21.15.3:0/3833797453 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa25c104df0 msgr2=0x7fa25c1051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:11.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.721+0000 7fa25b200640 1 --2- 172.21.15.3:0/3833797453 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa25c104df0 0x7fa25c1051d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa24c009900 tx=0x7fa24c02a410 comp rx=0 tx=0).stop 2024-09-10T23:25:11.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.721+0000 7fa25b200640 1 -- 172.21.15.3:0/3833797453 shutdown_connections 2024-09-10T23:25:11.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.721+0000 7fa25b200640 1 --2- 172.21.15.3:0/3833797453 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa25c10b180 0x7fa25c111980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:11.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.721+0000 7fa25b200640 1 --2- 172.21.15.3:0/3833797453 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa25c10a800 0x7fa25c10ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:11.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.721+0000 7fa25b200640 1 --2- 172.21.15.3:0/3833797453 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa25c104df0 0x7fa25c1051d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:11.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.721+0000 7fa25b200640 1 -- 172.21.15.3:0/3833797453 >> 172.21.15.3:0/3833797453 conn(0x7fa25c100840 msgr2=0x7fa25c102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:11.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.721+0000 7fa25b200640 1 -- 172.21.15.3:0/3833797453 shutdown_connections 2024-09-10T23:25:11.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.721+0000 7fa25b200640 1 -- 172.21.15.3:0/3833797453 wait complete. 2024-09-10T23:25:11.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.722+0000 7fa25b200640 1 Processor -- start 2024-09-10T23:25:11.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.722+0000 7fa25b200640 1 -- start start 2024-09-10T23:25:11.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.722+0000 7fa25b200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa25c104df0 0x7fa25c19b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:11.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.722+0000 7fa25b200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa25c10a800 0x7fa25c19b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:11.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.722+0000 7fa25b200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa25c10b180 0x7fa25c1a0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:11.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.722+0000 7fa25b200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c114cf0 con 0x7fa25c10a800 2024-09-10T23:25:11.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.722+0000 7fa25b200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c114b70 con 0x7fa25c10b180 2024-09-10T23:25:11.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.722+0000 7fa25b200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c114e70 con 0x7fa25c104df0 2024-09-10T23:25:11.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.723+0000 7fa251400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa25c10a800 0x7fa25c19b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:11.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.723+0000 7fa251400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa25c10a800 0x7fa25c19b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35540/0 (socket says 172.21.15.3:35540) 2024-09-10T23:25:11.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.723+0000 7fa251400640 1 -- 172.21.15.3:0/2418256099 learned_addr learned my addr 172.21.15.3:0/2418256099 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:11.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.723+0000 7fa25a800640 1 --2- 172.21.15.3:0/2418256099 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa25c10b180 0x7fa25c1a0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:11.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.723+0000 7fa259e00640 1 --2- 172.21.15.3:0/2418256099 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa25c104df0 0x7fa25c19b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:11.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.723+0000 7fa251400640 1 -- 172.21.15.3:0/2418256099 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa25c104df0 msgr2=0x7fa25c19b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:11.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.723+0000 7fa251400640 1 --2- 172.21.15.3:0/2418256099 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa25c104df0 0x7fa25c19b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:11.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.723+0000 7fa251400640 1 -- 172.21.15.3:0/2418256099 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa25c10b180 msgr2=0x7fa25c1a0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:11.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.723+0000 7fa251400640 1 --2- 172.21.15.3:0/2418256099 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa25c10b180 0x7fa25c1a0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:11.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.723+0000 7fa251400640 1 -- 172.21.15.3:0/2418256099 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa25c1a11f0 con 0x7fa25c10a800 2024-09-10T23:25:11.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.724+0000 7fa251400640 1 --2- 172.21.15.3:0/2418256099 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa25c10a800 0x7fa25c19b680 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa24400d770 tx=0x7fa24400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:11.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.724+0000 7fa253400640 1 -- 172.21.15.3:0/2418256099 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa244017070 con 0x7fa25c10a800 2024-09-10T23:25:11.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.724+0000 7fa253400640 1 -- 172.21.15.3:0/2418256099 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2440054b0 con 0x7fa25c10a800 2024-09-10T23:25:11.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.724+0000 7fa25b200640 1 -- 172.21.15.3:0/2418256099 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa25c1a14e0 con 0x7fa25c10a800 2024-09-10T23:25:11.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.724+0000 7fa253400640 1 -- 172.21.15.3:0/2418256099 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa244004c60 con 0x7fa25c10a800 2024-09-10T23:25:11.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.724+0000 7fa25b200640 1 -- 172.21.15.3:0/2418256099 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa25c1a7ba0 con 0x7fa25c10a800 2024-09-10T23:25:11.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.725+0000 7fa25b200640 1 -- 172.21.15.3:0/2418256099 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa25c1051d0 con 0x7fa25c10a800 2024-09-10T23:25:11.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.729+0000 7fa253400640 1 -- 172.21.15.3:0/2418256099 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7fa244004e00 con 0x7fa25c10a800 2024-09-10T23:25:11.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.731+0000 7fa253400640 1 --2- 172.21.15.3:0/2418256099 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fa2400b5460 0x7fa2400b7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:11.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.731+0000 7fa253400640 1 -- 172.21.15.3:0/2418256099 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9286+0+0 (secure 0 0 0) 0x7fa2440e5ff0 con 0x7fa25c10a800 2024-09-10T23:25:11.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.732+0000 7fa259e00640 1 --2- 172.21.15.3:0/2418256099 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fa2400b5460 0x7fa2400b7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:11.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.732+0000 7fa253400640 1 -- 172.21.15.3:0/2418256099 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa2440ac280 con 0x7fa25c10a800 2024-09-10T23:25:11.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:11.732+0000 7fa259e00640 1 --2- 172.21.15.3:0/2418256099 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fa2400b5460 0x7fa2400b7920 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa24c0057c0 tx=0x7fa24c0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:12.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:12.003+0000 7fa25b200640 1 -- 172.21.15.3:0/2418256099 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fa25c19c270 con 0x7fa25c10a800 2024-09-10T23:25:12.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:12.006+0000 7fa253400640 1 -- 172.21.15.3:0/2418256099 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v33) ==== 170+0+59 (secure 0 0 0) 0x7fa25c19c270 con 0x7fa25c10a800 2024-09-10T23:25:12.008 INFO:teuthology.orchestra.run.smithi003.stdout:[client.0] 2024-09-10T23:25:12.008 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBY1eBmP2dKABAAG2VZBKCO05RgSdLZ6ioNsQ== 2024-09-10T23:25:12.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:12.009+0000 7fa25b200640 1 -- 172.21.15.3:0/2418256099 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fa2400b5460 msgr2=0x7fa2400b7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:12.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:12.009+0000 7fa25b200640 1 --2- 172.21.15.3:0/2418256099 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fa2400b5460 0x7fa2400b7920 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa24c0057c0 tx=0x7fa24c0058d0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:12.009+0000 7fa25b200640 1 -- 172.21.15.3:0/2418256099 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa25c10a800 msgr2=0x7fa25c19b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:12.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:12.009+0000 7fa25b200640 1 --2- 172.21.15.3:0/2418256099 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa25c10a800 0x7fa25c19b680 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa24400d770 tx=0x7fa24400dc30 comp rx=0 tx=0).stop 2024-09-10T23:25:12.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:12.009+0000 7fa25b200640 1 -- 172.21.15.3:0/2418256099 shutdown_connections 2024-09-10T23:25:12.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:12.009+0000 7fa25b200640 1 --2- 172.21.15.3:0/2418256099 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa25c10b180 0x7fa25c1a0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:12.009+0000 7fa25b200640 1 --2- 172.21.15.3:0/2418256099 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fa2400b5460 0x7fa2400b7920 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:12.009+0000 7fa25b200640 1 --2- 172.21.15.3:0/2418256099 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa25c10a800 0x7fa25c19b680 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:12.009+0000 7fa25b200640 1 --2- 172.21.15.3:0/2418256099 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa25c104df0 0x7fa25c19b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:12.009+0000 7fa25b200640 1 -- 172.21.15.3:0/2418256099 >> 172.21.15.3:0/2418256099 conn(0x7fa25c100840 msgr2=0x7fa25c102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:12.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:12.009+0000 7fa25b200640 1 -- 172.21.15.3:0/2418256099 shutdown_connections 2024-09-10T23:25:12.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:12.009+0000 7fa25b200640 1 -- 172.21.15.3:0/2418256099 wait complete. 2024-09-10T23:25:12.328 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:12 smithi003 ceph-mon[30348]: pgmap v341: 129 pgs: 129 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 6 op/s 2024-09-10T23:25:12.328 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:12 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2418256099' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-10T23:25:12.328 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:12 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2418256099' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T23:25:12.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:12 smithi038 ceph-mon[34225]: pgmap v341: 129 pgs: 129 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 6 op/s 2024-09-10T23:25:12.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:12 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2418256099' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-10T23:25:12.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:12 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2418256099' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T23:25:12.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:12 smithi194 ceph-mon[33904]: pgmap v341: 129 pgs: 129 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 6 op/s 2024-09-10T23:25:12.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:12 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2418256099' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-10T23:25:12.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:12 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2418256099' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T23:25:12.779 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-10T23:25:12.779 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-10T23:25:12.779 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T23:25:12.860 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph config log 1 --format=json 2024-09-10T23:25:13.280 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:13.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.824+0000 7f5816a00640 1 -- 172.21.15.3:0/3705028712 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5810075e60 msgr2=0x7f5810113430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:13.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.824+0000 7f5816a00640 1 --2- 172.21.15.3:0/3705028712 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5810075e60 0x7f5810113430 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f57fc009900 tx=0x7f57fc02a3f0 comp rx=0 tx=0).stop 2024-09-10T23:25:13.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.824+0000 7f5816a00640 1 -- 172.21.15.3:0/3705028712 shutdown_connections 2024-09-10T23:25:13.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.824+0000 7f5816a00640 1 --2- 172.21.15.3:0/3705028712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5810113970 0x7f5810115d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:13.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.824+0000 7f5816a00640 1 --2- 172.21.15.3:0/3705028712 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5810075e60 0x7f5810113430 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:13.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.824+0000 7f5816a00640 1 --2- 172.21.15.3:0/3705028712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5810075540 0x7f5810075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:13.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.824+0000 7f5816a00640 1 -- 172.21.15.3:0/3705028712 >> 172.21.15.3:0/3705028712 conn(0x7f58100fe6c0 msgr2=0x7f5810100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:13.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.824+0000 7f5816a00640 1 -- 172.21.15.3:0/3705028712 shutdown_connections 2024-09-10T23:25:13.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.824+0000 7f5816a00640 1 -- 172.21.15.3:0/3705028712 wait complete. 2024-09-10T23:25:13.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.825+0000 7f5816a00640 1 Processor -- start 2024-09-10T23:25:13.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.825+0000 7f5816a00640 1 -- start start 2024-09-10T23:25:13.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.826+0000 7f5816a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5810075540 0x7f581019f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:13.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.826+0000 7f5816a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5810075e60 0x7f581019fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:13.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.826+0000 7f5816a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5810113970 0x7f58101a4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:13.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.826+0000 7f5816a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f5810119100 con 0x7f5810075e60 2024-09-10T23:25:13.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.826+0000 7f5816a00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5810118f80 con 0x7f5810075540 2024-09-10T23:25:13.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.826+0000 7f5816a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5810119280 con 0x7f5810113970 2024-09-10T23:25:13.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.826+0000 7f5814c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5810075e60 0x7f581019fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:13.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.826+0000 7f5814c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5810075e60 0x7f581019fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35556/0 (socket says 172.21.15.3:35556) 2024-09-10T23:25:13.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.826+0000 7f5814c00640 1 -- 172.21.15.3:0/2075040913 learned_addr learned my addr 172.21.15.3:0/2075040913 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:13.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.826+0000 7f5815600640 1 --2- 172.21.15.3:0/2075040913 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5810075540 0x7f581019f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:13.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.826+0000 7f5816000640 1 --2- 172.21.15.3:0/2075040913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5810113970 0x7f58101a4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:13.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.827+0000 7f5814c00640 1 -- 172.21.15.3:0/2075040913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5810113970 msgr2=0x7f58101a4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:13.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.827+0000 7f5814c00640 1 --2- 172.21.15.3:0/2075040913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5810113970 0x7f58101a4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:13.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.827+0000 7f5814c00640 1 -- 172.21.15.3:0/2075040913 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5810075540 msgr2=0x7f581019f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:13.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.827+0000 7f5814c00640 1 --2- 172.21.15.3:0/2075040913 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5810075540 0x7f581019f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:13.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.827+0000 7f5814c00640 1 -- 172.21.15.3:0/2075040913 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58101a5620 con 0x7f5810075e60 2024-09-10T23:25:13.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.827+0000 7f5814c00640 1 --2- 172.21.15.3:0/2075040913 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5810075e60 0x7f581019fab0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f57fc02a910 tx=0x7f57fc003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:13.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.827+0000 7f580e000640 1 -- 172.21.15.3:0/2075040913 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57fc03f070 con 0x7f5810075e60 2024-09-10T23:25:13.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.827+0000 7f580e000640 1 -- 172.21.15.3:0/2075040913 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57fc003e40 con 0x7f5810075e60 2024-09-10T23:25:13.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.827+0000 7f5816a00640 1 -- 172.21.15.3:0/2075040913 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58101a58b0 con 0x7f5810075e60 2024-09-10T23:25:13.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.827+0000 7f580e000640 1 -- 172.21.15.3:0/2075040913 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57fc035030 con 0x7f5810075e60 2024-09-10T23:25:13.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.828+0000 7f5816a00640 1 -- 172.21.15.3:0/2075040913 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58101abfd0 con 0x7f5810075e60 2024-09-10T23:25:13.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.828+0000 7f5816a00640 1 -- 172.21.15.3:0/2075040913 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5810075920 con 0x7f5810075e60 2024-09-10T23:25:13.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.831+0000 7f580e000640 1 -- 172.21.15.3:0/2075040913 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7f57fc031400 con 0x7f5810075e60 2024-09-10T23:25:13.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.832+0000 7f580e000640 1 --2- 172.21.15.3:0/2075040913 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f57f80b54e0 0x7f57f80b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:13.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.832+0000 7f580e000640 1 -- 172.21.15.3:0/2075040913 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9286+0+0 (secure 0 0 0) 0x7f57fc106fe0 con 0x7f5810075e60 2024-09-10T23:25:13.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.832+0000 7f5815600640 1 --2- 172.21.15.3:0/2075040913 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f57f80b54e0 0x7f57f80b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:13.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.833+0000 7f5815600640 1 --2- 172.21.15.3:0/2075040913 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f57f80b54e0 0x7f57f80b79a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5804005d00 tx=0x7f580400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:13.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:13.834+0000 7f580e000640 1 -- 172.21.15.3:0/2075040913 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f57fc0cd270 con 0x7f5810075e60 2024-09-10T23:25:14.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:14.029+0000 7f5816a00640 1 -- 172.21.15.3:0/2075040913 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f58101ac2c0 con 0x7f5810075e60 2024-09-10T23:25:14.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:14.030+0000 7f580e000640 1 -- 172.21.15.3:0/2075040913 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v55) ==== 86+0+133 (secure 0 0 0) 0x7f57fc0d1ca0 con 0x7f5810075e60 2024-09-10T23:25:14.031 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:25:14.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:14.032+0000 7f5816a00640 1 -- 172.21.15.3:0/2075040913 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f57f80b54e0 msgr2=0x7f57f80b79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:14.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:14.032+0000 7f5816a00640 1 --2- 172.21.15.3:0/2075040913 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f57f80b54e0 0x7f57f80b79a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5804005d00 tx=0x7f580400b410 comp rx=0 tx=0).stop 2024-09-10T23:25:14.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:14.032+0000 7f5816a00640 1 -- 172.21.15.3:0/2075040913 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5810075e60 msgr2=0x7f581019fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:14.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:14.032+0000 7f5816a00640 1 --2- 172.21.15.3:0/2075040913 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5810075e60 0x7f581019fab0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f57fc02a910 tx=0x7f57fc003c20 comp rx=0 tx=0).stop 2024-09-10T23:25:14.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:14.032+0000 7f5816a00640 1 -- 172.21.15.3:0/2075040913 shutdown_connections 2024-09-10T23:25:14.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:14.032+0000 7f5816a00640 1 --2- 172.21.15.3:0/2075040913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5810113970 0x7f58101a4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:14.032+0000 7f5816a00640 1 --2- 172.21.15.3:0/2075040913 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f57f80b54e0 0x7f57f80b79a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:14.032+0000 7f5816a00640 1 --2- 172.21.15.3:0/2075040913 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5810075e60 0x7f581019fab0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:14.032+0000 7f5816a00640 1 --2- 172.21.15.3:0/2075040913 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5810075540 0x7f581019f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:14.032+0000 7f5816a00640 1 -- 172.21.15.3:0/2075040913 >> 172.21.15.3:0/2075040913 conn(0x7f58100fe6c0 msgr2=0x7f58100ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:14.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:14.033+0000 7f5816a00640 1 -- 172.21.15.3:0/2075040913 shutdown_connections 2024-09-10T23:25:14.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:14.033+0000 7f5816a00640 1 -- 172.21.15.3:0/2075040913 wait complete. 2024-09-10T23:25:14.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:14 smithi038 ceph-mon[34225]: pgmap v342: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.7 KiB/s wr, 9 op/s 2024-09-10T23:25:14.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:14 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2075040913' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-10T23:25:14.397 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:14 smithi003 ceph-mon[30348]: pgmap v342: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.7 KiB/s wr, 9 op/s 2024-09-10T23:25:14.397 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:14 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2075040913' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-10T23:25:14.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:14 smithi194 ceph-mon[33904]: pgmap v342: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.7 KiB/s wr, 9 op/s 2024-09-10T23:25:14.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:14 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2075040913' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-10T23:25:14.872 INFO:teuthology.orchestra.run.smithi003.stdout:[{"version":55,"timestamp":"2024-09-10T23:23:45.305947+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-10T23:25:14.872 INFO:tasks.ceph_manager:config epoch is 55 2024-09-10T23:25:14.872 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T23:25:14.873 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-10T23:25:14.873 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-10T23:25:15.253 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:15.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.825+0000 7fcf91200640 1 -- 172.21.15.3:0/2595249886 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf8c075e60 msgr2=0x7fcf8c1135e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:15.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.825+0000 7fcf91200640 1 --2- 172.21.15.3:0/2595249886 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf8c075e60 0x7fcf8c1135e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcf74009900 tx=0x7fcf7402a410 comp rx=0 tx=0).stop 2024-09-10T23:25:15.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.825+0000 7fcf91200640 1 -- 172.21.15.3:0/2595249886 shutdown_connections 2024-09-10T23:25:15.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.825+0000 7fcf91200640 1 --2- 172.21.15.3:0/2595249886 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf8c113b20 0x7fcf8c115f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.825+0000 7fcf91200640 1 --2- 172.21.15.3:0/2595249886 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf8c075e60 0x7fcf8c1135e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.825+0000 7fcf91200640 1 --2- 172.21.15.3:0/2595249886 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf8c075540 0x7fcf8c075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.826+0000 7fcf91200640 1 -- 172.21.15.3:0/2595249886 >> 172.21.15.3:0/2595249886 conn(0x7fcf8c0fe830 msgr2=0x7fcf8c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:15.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.826+0000 7fcf91200640 1 -- 172.21.15.3:0/2595249886 shutdown_connections 2024-09-10T23:25:15.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.826+0000 7fcf91200640 1 -- 172.21.15.3:0/2595249886 wait complete. 2024-09-10T23:25:15.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.827+0000 7fcf91200640 1 Processor -- start 2024-09-10T23:25:15.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.827+0000 7fcf91200640 1 -- start start 2024-09-10T23:25:15.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.828+0000 7fcf91200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf8c075540 0x7fcf8c19f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:15.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.828+0000 7fcf91200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf8c075e60 0x7fcf8c19fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:15.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.828+0000 7fcf91200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf8c113b20 0x7fcf8c1a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:15.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.828+0000 7fcf91200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8c1192b0 con 0x7fcf8c075540 2024-09-10T23:25:15.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.828+0000 7fcf91200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8c119130 con 0x7fcf8c113b20 2024-09-10T23:25:15.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.828+0000 7fcf91200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8c119430 con 0x7fcf8c075e60 2024-09-10T23:25:15.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.828+0000 7fcf89e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf8c075540 0x7fcf8c19f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:15.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.828+0000 7fcf89e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf8c075540 0x7fcf8c19f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35582/0 (socket says 172.21.15.3:35582) 2024-09-10T23:25:15.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.828+0000 7fcf89e00640 1 -- 172.21.15.3:0/2506024395 learned_addr learned my addr 172.21.15.3:0/2506024395 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:15.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.828+0000 7fcf83e00640 1 --2- 172.21.15.3:0/2506024395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf8c075e60 0x7fcf8c19fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:15.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.828+0000 7fcf8a800640 1 --2- 172.21.15.3:0/2506024395 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf8c113b20 0x7fcf8c1a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:15.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.828+0000 7fcf89e00640 1 -- 172.21.15.3:0/2506024395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf8c075e60 msgr2=0x7fcf8c19fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:15.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.828+0000 7fcf89e00640 1 --2- 172.21.15.3:0/2506024395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf8c075e60 0x7fcf8c19fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.828+0000 7fcf89e00640 1 -- 172.21.15.3:0/2506024395 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf8c113b20 msgr2=0x7fcf8c1a5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:15.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.828+0000 7fcf89e00640 1 --2- 172.21.15.3:0/2506024395 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf8c113b20 0x7fcf8c1a5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.828+0000 7fcf89e00640 1 -- 172.21.15.3:0/2506024395 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf8c1a58f0 con 0x7fcf8c075540 2024-09-10T23:25:15.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.828+0000 7fcf8a800640 1 --2- 172.21.15.3:0/2506024395 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf8c113b20 0x7fcf8c1a5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:15.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.829+0000 7fcf89e00640 1 --2- 172.21.15.3:0/2506024395 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf8c075540 0x7fcf8c19f840 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c00e9f0 tx=0x7fcf7c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:15.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.829+0000 7fcf82a00640 1 -- 172.21.15.3:0/2506024395 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c00cd80 con 0x7fcf8c075540 2024-09-10T23:25:15.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.829+0000 7fcf82a00640 1 -- 172.21.15.3:0/2506024395 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf7c0108c0 con 0x7fcf8c075540 2024-09-10T23:25:15.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.829+0000 7fcf82a00640 1 -- 172.21.15.3:0/2506024395 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c0187c0 con 0x7fcf8c075540 2024-09-10T23:25:15.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.829+0000 7fcf91200640 1 -- 172.21.15.3:0/2506024395 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf8c1a5be0 con 0x7fcf8c075540 2024-09-10T23:25:15.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.829+0000 7fcf91200640 1 -- 172.21.15.3:0/2506024395 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf8c1ac2a0 con 0x7fcf8c075540 2024-09-10T23:25:15.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.830+0000 7fcf91200640 1 -- 172.21.15.3:0/2506024395 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf8c075920 con 0x7fcf8c075540 2024-09-10T23:25:15.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.833+0000 7fcf82a00640 1 -- 172.21.15.3:0/2506024395 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7fcf7c010430 con 0x7fcf8c075540 2024-09-10T23:25:15.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.834+0000 7fcf82a00640 1 --2- 172.21.15.3:0/2506024395 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcf700b53c0 0x7fcf700b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:15.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.834+0000 7fcf82a00640 1 -- 172.21.15.3:0/2506024395 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9286+0+0 (secure 0 0 0) 0x7fcf7c0e6670 con 0x7fcf8c075540 2024-09-10T23:25:15.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.834+0000 7fcf83e00640 1 --2- 172.21.15.3:0/2506024395 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcf700b53c0 0x7fcf700b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:15.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.835+0000 7fcf83e00640 1 --2- 172.21.15.3:0/2506024395 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcf700b53c0 0x7fcf700b7880 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcf74006010 tx=0x7fcf74005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:15.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:15.838+0000 7fcf82a00640 1 -- 172.21.15.3:0/2506024395 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcf7c0acf50 con 0x7fcf8c075540 2024-09-10T23:25:16.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:16.090+0000 7fcf91200640 1 -- 172.21.15.3:0/2506024395 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fcf8c1ac5d0 con 0x7fcf8c075540 2024-09-10T23:25:16.099 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:16.098+0000 7fcf82a00640 1 -- 172.21.15.3:0/2506024395 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v21) ==== 74+0+294220 (secure 0 0 0) 0x7fcf7c0ac850 con 0x7fcf8c075540 2024-09-10T23:25:16.103 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:25:16.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:16.103+0000 7fcf91200640 1 -- 172.21.15.3:0/2506024395 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcf700b53c0 msgr2=0x7fcf700b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:16.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:16.103+0000 7fcf91200640 1 --2- 172.21.15.3:0/2506024395 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcf700b53c0 0x7fcf700b7880 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcf74006010 tx=0x7fcf74005e80 comp rx=0 tx=0).stop 2024-09-10T23:25:16.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:16.103+0000 7fcf91200640 1 -- 172.21.15.3:0/2506024395 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf8c075540 msgr2=0x7fcf8c19f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:16.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:16.103+0000 7fcf91200640 1 --2- 172.21.15.3:0/2506024395 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf8c075540 0x7fcf8c19f840 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c00e9f0 tx=0x7fcf7c00eeb0 comp rx=0 tx=0).stop 2024-09-10T23:25:16.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:16.103+0000 7fcf91200640 1 -- 172.21.15.3:0/2506024395 shutdown_connections 2024-09-10T23:25:16.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:16.103+0000 7fcf91200640 1 --2- 172.21.15.3:0/2506024395 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf8c113b20 0x7fcf8c1a5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:16.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:16.103+0000 7fcf91200640 1 --2- 172.21.15.3:0/2506024395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf8c075e60 0x7fcf8c19fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:16.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:16.103+0000 7fcf91200640 1 --2- 172.21.15.3:0/2506024395 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcf700b53c0 0x7fcf700b7880 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:16.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:16.103+0000 7fcf91200640 1 --2- 172.21.15.3:0/2506024395 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf8c075540 0x7fcf8c19f840 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:16.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:16.103+0000 7fcf91200640 1 -- 172.21.15.3:0/2506024395 >> 172.21.15.3:0/2506024395 conn(0x7fcf8c0fe830 msgr2=0x7fcf8c0ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:16.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:16.103+0000 7fcf91200640 1 -- 172.21.15.3:0/2506024395 shutdown_connections 2024-09-10T23:25:16.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:16.103+0000 7fcf91200640 1 -- 172.21.15.3:0/2506024395 wait complete. 2024-09-10T23:25:16.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:16 smithi038 ceph-mon[34225]: pgmap v343: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-10T23:25:16.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:16 smithi194 ceph-mon[33904]: pgmap v343: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-10T23:25:16.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:16 smithi003 ceph-mon[30348]: pgmap v343: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-10T23:25:16.970 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":21,"flags":0,"active_gid":14223,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":536493997},{"type":"v1","addr":"172.21.15.3:6801","nonce":536493997}]},"active_addr":"172.21.15.3:6801/536493997","active_change":"2024-09-10T23:16:20.647465+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":14307,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":34202,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.3:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.3:0","nonce":1305006808}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.3:0","nonce":3264842241}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.3:0","nonce":1980111985}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.3:0","nonce":1517971559}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.3:0","nonce":3859168709}]}]} 2024-09-10T23:25:17.028 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-10T23:25:17.028 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-10T23:25:17.029 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:25:17.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:17 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2506024395' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-10T23:25:17.405 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:17.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:17 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2506024395' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-10T23:25:17.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:17 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2506024395' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-10T23:25:17.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.979+0000 7fa77ac00640 1 -- 172.21.15.3:0/2031584155 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa7741087d0 msgr2=0x7fa774108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:17.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.979+0000 7fa77ac00640 1 --2- 172.21.15.3:0/2031584155 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa7741087d0 0x7fa774108c10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa760009900 tx=0x7fa76002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.979+0000 7fa77ac00640 1 -- 172.21.15.3:0/2031584155 shutdown_connections 2024-09-10T23:25:17.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.979+0000 7fa77ac00640 1 --2- 172.21.15.3:0/2031584155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa774109150 0x7fa77410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.979+0000 7fa77ac00640 1 --2- 172.21.15.3:0/2031584155 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa7741087d0 0x7fa774108c10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.979+0000 7fa77ac00640 1 --2- 172.21.15.3:0/2031584155 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa774102dc0 0x7fa7741031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.979+0000 7fa77ac00640 1 -- 172.21.15.3:0/2031584155 >> 172.21.15.3:0/2031584155 conn(0x7fa7740fe830 msgr2=0x7fa774100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:17.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.979+0000 7fa77ac00640 1 -- 172.21.15.3:0/2031584155 shutdown_connections 2024-09-10T23:25:17.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.979+0000 7fa77ac00640 1 -- 172.21.15.3:0/2031584155 wait complete. 2024-09-10T23:25:17.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.980+0000 7fa77ac00640 1 Processor -- start 2024-09-10T23:25:17.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.980+0000 7fa77ac00640 1 -- start start 2024-09-10T23:25:17.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.980+0000 7fa77ac00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa774102dc0 0x7fa77419b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:17.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.980+0000 7fa77ac00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa7741087d0 0x7fa77419b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:17.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.981+0000 7fa77ac00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa774109150 0x7fa7741a0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:17.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.981+0000 7fa77ac00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa774112ca0 con 0x7fa7741087d0 2024-09-10T23:25:17.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.981+0000 7fa77ac00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa774112b20 con 0x7fa774102dc0 2024-09-10T23:25:17.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.981+0000 7fa77ac00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa774112e20 con 0x7fa774109150 2024-09-10T23:25:17.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.981+0000 7fa773400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa7741087d0 0x7fa77419b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:17.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.981+0000 7fa773400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa7741087d0 0x7fa77419b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35592/0 (socket says 172.21.15.3:35592) 2024-09-10T23:25:17.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.981+0000 7fa773400640 1 -- 172.21.15.3:0/3732935086 learned_addr learned my addr 172.21.15.3:0/3732935086 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:17.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.981+0000 7fa773e00640 1 --2- 172.21.15.3:0/3732935086 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa774102dc0 0x7fa77419b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:17.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.981+0000 7fa778c00640 1 --2- 172.21.15.3:0/3732935086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa774109150 0x7fa7741a0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:17.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.981+0000 7fa773400640 1 -- 172.21.15.3:0/3732935086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa774109150 msgr2=0x7fa7741a0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:17.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.981+0000 7fa773400640 1 --2- 172.21.15.3:0/3732935086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa774109150 0x7fa7741a0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.981+0000 7fa773400640 1 -- 172.21.15.3:0/3732935086 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa774102dc0 msgr2=0x7fa77419b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:17.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.981+0000 7fa773400640 1 --2- 172.21.15.3:0/3732935086 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa774102dc0 0x7fa77419b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.981+0000 7fa773400640 1 -- 172.21.15.3:0/3732935086 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7741a1420 con 0x7fa7741087d0 2024-09-10T23:25:17.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.981+0000 7fa773e00640 1 --2- 172.21.15.3:0/3732935086 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa774102dc0 0x7fa77419b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:17.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.982+0000 7fa773400640 1 --2- 172.21.15.3:0/3732935086 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa7741087d0 0x7fa77419b8b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa76002a910 tx=0x7fa760003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:17.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.982+0000 7fa770c00640 1 -- 172.21.15.3:0/3732935086 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76003f070 con 0x7fa7741087d0 2024-09-10T23:25:17.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.982+0000 7fa770c00640 1 -- 172.21.15.3:0/3732935086 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa76003baf0 con 0x7fa7741087d0 2024-09-10T23:25:17.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.982+0000 7fa77ac00640 1 -- 172.21.15.3:0/3732935086 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7741a16b0 con 0x7fa7741087d0 2024-09-10T23:25:17.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.982+0000 7fa770c00640 1 -- 172.21.15.3:0/3732935086 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa760035030 con 0x7fa7741087d0 2024-09-10T23:25:17.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.982+0000 7fa77ac00640 1 -- 172.21.15.3:0/3732935086 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7741a7dd0 con 0x7fa7741087d0 2024-09-10T23:25:17.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.983+0000 7fa77ac00640 1 -- 172.21.15.3:0/3732935086 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7741031a0 con 0x7fa7741087d0 2024-09-10T23:25:17.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.985+0000 7fa770c00640 1 -- 172.21.15.3:0/3732935086 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7fa76003b660 con 0x7fa7741087d0 2024-09-10T23:25:17.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.987+0000 7fa770c00640 1 --2- 172.21.15.3:0/3732935086 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fa7580b5440 0x7fa7580b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:17.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.987+0000 7fa770c00640 1 -- 172.21.15.3:0/3732935086 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9286+0+0 (secure 0 0 0) 0x7fa760106a60 con 0x7fa7741087d0 2024-09-10T23:25:17.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.987+0000 7fa773e00640 1 --2- 172.21.15.3:0/3732935086 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fa7580b5440 0x7fa7580b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:17.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.988+0000 7fa773e00640 1 --2- 172.21.15.3:0/3732935086 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fa7580b5440 0x7fa7580b7900 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa764009fc0 tx=0x7fa764005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:17.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:17.991+0000 7fa770c00640 1 -- 172.21.15.3:0/3732935086 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa7600cccf0 con 0x7fa7741087d0 2024-09-10T23:25:18.191 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:18.190+0000 7fa77ac00640 1 -- 172.21.15.3:0/3732935086 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa77410edb0 con 0x7fa7741087d0 2024-09-10T23:25:18.191 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:18 smithi003 ceph-mon[30348]: pgmap v344: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-09-10T23:25:18.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:18.192+0000 7fa770c00640 1 -- 172.21.15.3:0/3732935086 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24924 (secure 0 0 0) 0x7fa7600d1720 con 0x7fa7741087d0 2024-09-10T23:25:18.193 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:25:18.194 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":88,"fsid":"3f4e30d0-6fca-11ef-bcea-c7b262605968","created":"2024-09-10T23:14:12.377466+0000","modified":"2024-09-10T23:24:21.960046+0000","last_up_change":"2024-09-10T23:22:54.895554+0000","last_in_change":"2024-09-10T23:22:29.701108+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:18:27.131879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:23:53.689954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:23:55.864693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:24:03.869094+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a38330ed-a85b-4e61-b373-dd8f1d5f7ba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6803","nonce":824467747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6805","nonce":824467747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6809","nonce":824467747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6807","nonce":824467747}]},"public_addr":"172.21.15.3:6803/824467747","cluster_addr":"172.21.15.3:6805/824467747","heartbeat_back_addr":"172.21.15.3:6809/824467747","heartbeat_front_addr":"172.21.15.3:6807/824467747","state":["exists","up"]},{"osd":1,"uuid":"49bb1212-a83e-4f85-ad71-d863880d8268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6801","nonce":1447444485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6803","nonce":1447444485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6807","nonce":1447444485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6805","nonce":1447444485}]},"public_addr":"172.21.15.38:6801/1447444485","cluster_addr":"172.21.15.38:6803/1447444485","heartbeat_back_addr":"172.21.15.38:6807/1447444485","heartbeat_front_addr":"172.21.15.38:6805/1447444485","state":["exists","up"]},{"osd":2,"uuid":"ea53eb27-e7fa-4783-9a53-8b44b4e293ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6801","nonce":3191263316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6803","nonce":3191263316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6807","nonce":3191263316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6805","nonce":3191263316}]},"public_addr":"172.21.15.194:6801/3191263316","cluster_addr":"172.21.15.194:6803/3191263316","heartbeat_back_addr":"172.21.15.194:6807/3191263316","heartbeat_front_addr":"172.21.15.194:6805/3191263316","state":["exists","up"]},{"osd":3,"uuid":"75067769-7be5-4a99-9e02-f7735b2e69c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6811","nonce":2061990952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6813","nonce":2061990952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6817","nonce":2061990952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6815","nonce":2061990952}]},"public_addr":"172.21.15.3:6811/2061990952","cluster_addr":"172.21.15.3:6813/2061990952","heartbeat_back_addr":"172.21.15.3:6817/2061990952","heartbeat_front_addr":"172.21.15.3:6815/2061990952","state":["exists","up"]},{"osd":4,"uuid":"872e90ca-b711-4206-b586-e7fa41122199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6809","nonce":413294160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6811","nonce":413294160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6815","nonce":413294160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6813","nonce":413294160}]},"public_addr":"172.21.15.38:6809/413294160","cluster_addr":"172.21.15.38:6811/413294160","heartbeat_back_addr":"172.21.15.38:6815/413294160","heartbeat_front_addr":"172.21.15.38:6813/413294160","state":["exists","up"]},{"osd":5,"uuid":"2cfa107c-6dae-4c26-9e29-8175b1237b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6809","nonce":4117812658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6811","nonce":4117812658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6815","nonce":4117812658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6813","nonce":4117812658}]},"public_addr":"172.21.15.194:6809/4117812658","cluster_addr":"172.21.15.194:6811/4117812658","heartbeat_back_addr":"172.21.15.194:6815/4117812658","heartbeat_front_addr":"172.21.15.194:6813/4117812658","state":["exists","up"]},{"osd":6,"uuid":"d2e4e309-c587-4725-a5b3-cbc7b1226750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6819","nonce":3470543721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6821","nonce":3470543721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6825","nonce":3470543721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6823","nonce":3470543721}]},"public_addr":"172.21.15.3:6819/3470543721","cluster_addr":"172.21.15.3:6821/3470543721","heartbeat_back_addr":"172.21.15.3:6825/3470543721","heartbeat_front_addr":"172.21.15.3:6823/3470543721","state":["exists","up"]},{"osd":7,"uuid":"46ecaec5-29da-4e1d-ac2f-42bbbd77e949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6817","nonce":2054203924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6819","nonce":2054203924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6823","nonce":2054203924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6821","nonce":2054203924}]},"public_addr":"172.21.15.38:6817/2054203924","cluster_addr":"172.21.15.38:6819/2054203924","heartbeat_back_addr":"172.21.15.38:6823/2054203924","heartbeat_front_addr":"172.21.15.38:6821/2054203924","state":["exists","up"]},{"osd":8,"uuid":"57fd8e43-9612-4f74-8eb2-8bdbbf7c0417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6817","nonce":170051722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6819","nonce":170051722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6823","nonce":170051722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6821","nonce":170051722}]},"public_addr":"172.21.15.194:6817/170051722","cluster_addr":"172.21.15.194:6819/170051722","heartbeat_back_addr":"172.21.15.194:6823/170051722","heartbeat_front_addr":"172.21.15.194:6821/170051722","state":["exists","up"]},{"osd":9,"uuid":"aeaaf23b-d2e2-4e30-9a49-de4aaba53900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6827","nonce":3967749600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6829","nonce":3967749600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6833","nonce":3967749600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6831","nonce":3967749600}]},"public_addr":"172.21.15.3:6827/3967749600","cluster_addr":"172.21.15.3:6829/3967749600","heartbeat_back_addr":"172.21.15.3:6833/3967749600","heartbeat_front_addr":"172.21.15.3:6831/3967749600","state":["exists","up"]},{"osd":10,"uuid":"b0ece81b-1c5b-40da-b579-fb99bacb005d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6825","nonce":1671957178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6827","nonce":1671957178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6831","nonce":1671957178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6829","nonce":1671957178}]},"public_addr":"172.21.15.38:6825/1671957178","cluster_addr":"172.21.15.38:6827/1671957178","heartbeat_back_addr":"172.21.15.38:6831/1671957178","heartbeat_front_addr":"172.21.15.38:6829/1671957178","state":["exists","up"]},{"osd":11,"uuid":"a0036526-54bf-4e8b-95cc-e7b75725961c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6825","nonce":1048859686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6827","nonce":1048859686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6831","nonce":1048859686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6829","nonce":1048859686}]},"public_addr":"172.21.15.194:6825/1048859686","cluster_addr":"172.21.15.194:6827/1048859686","heartbeat_back_addr":"172.21.15.194:6831/1048859686","heartbeat_front_addr":"172.21.15.194:6829/1048859686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:27.013354+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:56.609046+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:24.878988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:55.218204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:25.224770+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:54.614336+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:25.385483+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:55.317137+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:25.064825+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:54.655361+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:22:24.080027+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:22:52.886412+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":4,"to":6},{"from":5,"to":9}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.3:0/776988825":"2024-09-11T23:16:20.647314+0000","172.21.15.3:0/2965090335":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/2364823868":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/3186881356":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/911991463":"2024-09-11T23:16:20.647314+0000","172.21.15.3:6800/2582365069":"2024-09-11T23:14:37.169991+0000","172.21.15.3:6801/2582365069":"2024-09-11T23:14:37.169991+0000","172.21.15.3:6801/1528153492":"2024-09-11T23:15:05.835734+0000","172.21.15.3:6800/1924113958":"2024-09-11T23:16:20.647314+0000","172.21.15.3:0/554479543":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/4238683346":"2024-09-11T23:15:05.835734+0000","172.21.15.3:6800/1528153492":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/285471483":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/1249510760":"2024-09-11T23:16:20.647314+0000","172.21.15.3:6801/1924113958":"2024-09-11T23:16:20.647314+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:25:18.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:18.195+0000 7fa77ac00640 1 -- 172.21.15.3:0/3732935086 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fa7580b5440 msgr2=0x7fa7580b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:18.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:18.195+0000 7fa77ac00640 1 --2- 172.21.15.3:0/3732935086 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fa7580b5440 0x7fa7580b7900 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa764009fc0 tx=0x7fa764005f90 comp rx=0 tx=0).stop 2024-09-10T23:25:18.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:18.195+0000 7fa77ac00640 1 -- 172.21.15.3:0/3732935086 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa7741087d0 msgr2=0x7fa77419b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:18.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:18.195+0000 7fa77ac00640 1 --2- 172.21.15.3:0/3732935086 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa7741087d0 0x7fa77419b8b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa76002a910 tx=0x7fa760003b90 comp rx=0 tx=0).stop 2024-09-10T23:25:18.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:18.195+0000 7fa77ac00640 1 -- 172.21.15.3:0/3732935086 shutdown_connections 2024-09-10T23:25:18.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:18.195+0000 7fa77ac00640 1 --2- 172.21.15.3:0/3732935086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa774109150 0x7fa7741a0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:18.195+0000 7fa77ac00640 1 --2- 172.21.15.3:0/3732935086 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fa7580b5440 0x7fa7580b7900 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:18.195+0000 7fa77ac00640 1 --2- 172.21.15.3:0/3732935086 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa7741087d0 0x7fa77419b8b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:18.195+0000 7fa77ac00640 1 --2- 172.21.15.3:0/3732935086 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa774102dc0 0x7fa77419b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:18.195+0000 7fa77ac00640 1 -- 172.21.15.3:0/3732935086 >> 172.21.15.3:0/3732935086 conn(0x7fa7740fe830 msgr2=0x7fa774105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:18.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:18.195+0000 7fa77ac00640 1 -- 172.21.15.3:0/3732935086 shutdown_connections 2024-09-10T23:25:18.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:18.195+0000 7fa77ac00640 1 -- 172.21.15.3:0/3732935086 wait complete. 2024-09-10T23:25:18.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:18 smithi194 ceph-mon[33904]: pgmap v344: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-09-10T23:25:18.601 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:18 smithi038 ceph-mon[34225]: pgmap v344: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-09-10T23:25:18.941 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-10T23:25:18.942 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:25:19.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:19 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3732935086' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:25:19.324 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:19.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:19 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3732935086' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:25:19.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:19 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3732935086' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:25:19.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.885+0000 7f0ace600640 1 -- 172.21.15.3:0/586664166 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ac8102da0 msgr2=0x7f0ac8103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:19.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.885+0000 7f0ace600640 1 --2- 172.21.15.3:0/586664166 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ac8102da0 0x7f0ac8103180 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8009900 tx=0x7f0ab802a410 comp rx=0 tx=0).stop 2024-09-10T23:25:19.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.885+0000 7f0ace600640 1 -- 172.21.15.3:0/586664166 shutdown_connections 2024-09-10T23:25:19.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.885+0000 7f0ace600640 1 --2- 172.21.15.3:0/586664166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ac8109130 0x7f0ac810f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:19.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.885+0000 7f0ace600640 1 --2- 172.21.15.3:0/586664166 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ac81087b0 0x7f0ac8108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:19.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.885+0000 7f0ace600640 1 --2- 172.21.15.3:0/586664166 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ac8102da0 0x7f0ac8103180 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:19.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.885+0000 7f0ace600640 1 -- 172.21.15.3:0/586664166 >> 172.21.15.3:0/586664166 conn(0x7f0ac80fe810 msgr2=0x7f0ac8100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:19.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.885+0000 7f0ace600640 1 -- 172.21.15.3:0/586664166 shutdown_connections 2024-09-10T23:25:19.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.885+0000 7f0ace600640 1 -- 172.21.15.3:0/586664166 wait complete. 2024-09-10T23:25:19.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.886+0000 7f0ace600640 1 Processor -- start 2024-09-10T23:25:19.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.887+0000 7f0ace600640 1 -- start start 2024-09-10T23:25:19.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.887+0000 7f0ace600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ac8102da0 0x7f0ac80754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:19.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.887+0000 7f0ace600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ac81087b0 0x7f0ac80759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:19.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.887+0000 7f0ace600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ac8109130 0x7f0ac8075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:19.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.887+0000 7f0ace600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac8112ca0 con 0x7f0ac81087b0 2024-09-10T23:25:19.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.887+0000 7f0ace600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac8112b20 con 0x7f0ac8109130 2024-09-10T23:25:19.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.887+0000 7f0ace600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac8112e20 con 0x7f0ac8102da0 2024-09-10T23:25:19.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.887+0000 7f0abfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ac81087b0 0x7f0ac80759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:19.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.887+0000 7f0abfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ac81087b0 0x7f0ac80759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35620/0 (socket says 172.21.15.3:35620) 2024-09-10T23:25:19.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.887+0000 7f0abfe00640 1 -- 172.21.15.3:0/177296611 learned_addr learned my addr 172.21.15.3:0/177296611 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:19.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.888+0000 7f0ac7400640 1 --2- 172.21.15.3:0/177296611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ac8102da0 0x7f0ac80754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:19.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.888+0000 7f0ac7e00640 1 --2- 172.21.15.3:0/177296611 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ac8109130 0x7f0ac8075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:19.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.888+0000 7f0abfe00640 1 -- 172.21.15.3:0/177296611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ac8102da0 msgr2=0x7f0ac80754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:19.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.888+0000 7f0abfe00640 1 --2- 172.21.15.3:0/177296611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ac8102da0 0x7f0ac80754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:19.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.888+0000 7f0abfe00640 1 -- 172.21.15.3:0/177296611 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ac8109130 msgr2=0x7f0ac8075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:19.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.888+0000 7f0abfe00640 1 --2- 172.21.15.3:0/177296611 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ac8109130 0x7f0ac8075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:19.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.888+0000 7f0abfe00640 1 -- 172.21.15.3:0/177296611 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ac81a7630 con 0x7f0ac81087b0 2024-09-10T23:25:19.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.888+0000 7f0abfe00640 1 --2- 172.21.15.3:0/177296611 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ac81087b0 0x7f0ac80759e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0ab000b4a0 tx=0x7f0ab000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:19.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.889+0000 7f0ac4c00640 1 -- 172.21.15.3:0/177296611 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab0014070 con 0x7f0ac81087b0 2024-09-10T23:25:19.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.889+0000 7f0ace600640 1 -- 172.21.15.3:0/177296611 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ac81a7920 con 0x7f0ac81087b0 2024-09-10T23:25:19.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.889+0000 7f0ac4c00640 1 -- 172.21.15.3:0/177296611 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0ab0010aa0 con 0x7f0ac81087b0 2024-09-10T23:25:19.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.889+0000 7f0ac4c00640 1 -- 172.21.15.3:0/177296611 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab001e060 con 0x7f0ac81087b0 2024-09-10T23:25:19.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.889+0000 7f0ace600640 1 -- 172.21.15.3:0/177296611 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ac81a7ee0 con 0x7f0ac81087b0 2024-09-10T23:25:19.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.890+0000 7f0ace600640 1 -- 172.21.15.3:0/177296611 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ac8103180 con 0x7f0ac81087b0 2024-09-10T23:25:19.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.892+0000 7f0ac4c00640 1 -- 172.21.15.3:0/177296611 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7f0ab0010610 con 0x7f0ac81087b0 2024-09-10T23:25:19.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.893+0000 7f0ac4c00640 1 --2- 172.21.15.3:0/177296611 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0aac0b53c0 0x7f0aac0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:19.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.894+0000 7f0ac4c00640 1 -- 172.21.15.3:0/177296611 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9286+0+0 (secure 0 0 0) 0x7f0ab00e5a30 con 0x7f0ac81087b0 2024-09-10T23:25:19.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.894+0000 7f0ac7400640 1 --2- 172.21.15.3:0/177296611 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0aac0b53c0 0x7f0aac0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:19.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.894+0000 7f0ac7400640 1 --2- 172.21.15.3:0/177296611 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0aac0b53c0 0x7f0aac0b7880 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0ab80057c0 tx=0x7f0ab80058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:19.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:19.897+0000 7f0ac4c00640 1 -- 172.21.15.3:0/177296611 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0ab00abcc0 con 0x7f0ac81087b0 2024-09-10T23:25:20.097 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:20.096+0000 7f0ace600640 1 -- 172.21.15.3:0/177296611 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ac802e5c0 con 0x7f0ac81087b0 2024-09-10T23:25:20.098 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:20.098+0000 7f0ac4c00640 1 -- 172.21.15.3:0/177296611 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24924 (secure 0 0 0) 0x7f0ab00b06f0 con 0x7f0ac81087b0 2024-09-10T23:25:20.099 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:25:20.099 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":88,"fsid":"3f4e30d0-6fca-11ef-bcea-c7b262605968","created":"2024-09-10T23:14:12.377466+0000","modified":"2024-09-10T23:24:21.960046+0000","last_up_change":"2024-09-10T23:22:54.895554+0000","last_in_change":"2024-09-10T23:22:29.701108+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:18:27.131879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:23:53.689954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:23:55.864693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:24:03.869094+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a38330ed-a85b-4e61-b373-dd8f1d5f7ba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6803","nonce":824467747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6805","nonce":824467747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6809","nonce":824467747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6807","nonce":824467747}]},"public_addr":"172.21.15.3:6803/824467747","cluster_addr":"172.21.15.3:6805/824467747","heartbeat_back_addr":"172.21.15.3:6809/824467747","heartbeat_front_addr":"172.21.15.3:6807/824467747","state":["exists","up"]},{"osd":1,"uuid":"49bb1212-a83e-4f85-ad71-d863880d8268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6801","nonce":1447444485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6803","nonce":1447444485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6807","nonce":1447444485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6805","nonce":1447444485}]},"public_addr":"172.21.15.38:6801/1447444485","cluster_addr":"172.21.15.38:6803/1447444485","heartbeat_back_addr":"172.21.15.38:6807/1447444485","heartbeat_front_addr":"172.21.15.38:6805/1447444485","state":["exists","up"]},{"osd":2,"uuid":"ea53eb27-e7fa-4783-9a53-8b44b4e293ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6801","nonce":3191263316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6803","nonce":3191263316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6807","nonce":3191263316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6805","nonce":3191263316}]},"public_addr":"172.21.15.194:6801/3191263316","cluster_addr":"172.21.15.194:6803/3191263316","heartbeat_back_addr":"172.21.15.194:6807/3191263316","heartbeat_front_addr":"172.21.15.194:6805/3191263316","state":["exists","up"]},{"osd":3,"uuid":"75067769-7be5-4a99-9e02-f7735b2e69c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6811","nonce":2061990952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6813","nonce":2061990952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6817","nonce":2061990952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6815","nonce":2061990952}]},"public_addr":"172.21.15.3:6811/2061990952","cluster_addr":"172.21.15.3:6813/2061990952","heartbeat_back_addr":"172.21.15.3:6817/2061990952","heartbeat_front_addr":"172.21.15.3:6815/2061990952","state":["exists","up"]},{"osd":4,"uuid":"872e90ca-b711-4206-b586-e7fa41122199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6809","nonce":413294160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6811","nonce":413294160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6815","nonce":413294160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6813","nonce":413294160}]},"public_addr":"172.21.15.38:6809/413294160","cluster_addr":"172.21.15.38:6811/413294160","heartbeat_back_addr":"172.21.15.38:6815/413294160","heartbeat_front_addr":"172.21.15.38:6813/413294160","state":["exists","up"]},{"osd":5,"uuid":"2cfa107c-6dae-4c26-9e29-8175b1237b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6809","nonce":4117812658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6811","nonce":4117812658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6815","nonce":4117812658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6813","nonce":4117812658}]},"public_addr":"172.21.15.194:6809/4117812658","cluster_addr":"172.21.15.194:6811/4117812658","heartbeat_back_addr":"172.21.15.194:6815/4117812658","heartbeat_front_addr":"172.21.15.194:6813/4117812658","state":["exists","up"]},{"osd":6,"uuid":"d2e4e309-c587-4725-a5b3-cbc7b1226750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6819","nonce":3470543721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6821","nonce":3470543721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6825","nonce":3470543721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6823","nonce":3470543721}]},"public_addr":"172.21.15.3:6819/3470543721","cluster_addr":"172.21.15.3:6821/3470543721","heartbeat_back_addr":"172.21.15.3:6825/3470543721","heartbeat_front_addr":"172.21.15.3:6823/3470543721","state":["exists","up"]},{"osd":7,"uuid":"46ecaec5-29da-4e1d-ac2f-42bbbd77e949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6817","nonce":2054203924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6819","nonce":2054203924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6823","nonce":2054203924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6821","nonce":2054203924}]},"public_addr":"172.21.15.38:6817/2054203924","cluster_addr":"172.21.15.38:6819/2054203924","heartbeat_back_addr":"172.21.15.38:6823/2054203924","heartbeat_front_addr":"172.21.15.38:6821/2054203924","state":["exists","up"]},{"osd":8,"uuid":"57fd8e43-9612-4f74-8eb2-8bdbbf7c0417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6817","nonce":170051722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6819","nonce":170051722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6823","nonce":170051722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6821","nonce":170051722}]},"public_addr":"172.21.15.194:6817/170051722","cluster_addr":"172.21.15.194:6819/170051722","heartbeat_back_addr":"172.21.15.194:6823/170051722","heartbeat_front_addr":"172.21.15.194:6821/170051722","state":["exists","up"]},{"osd":9,"uuid":"aeaaf23b-d2e2-4e30-9a49-de4aaba53900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6827","nonce":3967749600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6829","nonce":3967749600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6833","nonce":3967749600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6831","nonce":3967749600}]},"public_addr":"172.21.15.3:6827/3967749600","cluster_addr":"172.21.15.3:6829/3967749600","heartbeat_back_addr":"172.21.15.3:6833/3967749600","heartbeat_front_addr":"172.21.15.3:6831/3967749600","state":["exists","up"]},{"osd":10,"uuid":"b0ece81b-1c5b-40da-b579-fb99bacb005d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6825","nonce":1671957178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6827","nonce":1671957178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6831","nonce":1671957178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6829","nonce":1671957178}]},"public_addr":"172.21.15.38:6825/1671957178","cluster_addr":"172.21.15.38:6827/1671957178","heartbeat_back_addr":"172.21.15.38:6831/1671957178","heartbeat_front_addr":"172.21.15.38:6829/1671957178","state":["exists","up"]},{"osd":11,"uuid":"a0036526-54bf-4e8b-95cc-e7b75725961c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6825","nonce":1048859686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6827","nonce":1048859686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6831","nonce":1048859686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6829","nonce":1048859686}]},"public_addr":"172.21.15.194:6825/1048859686","cluster_addr":"172.21.15.194:6827/1048859686","heartbeat_back_addr":"172.21.15.194:6831/1048859686","heartbeat_front_addr":"172.21.15.194:6829/1048859686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:27.013354+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:56.609046+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:24.878988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:55.218204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:25.224770+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:54.614336+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:25.385483+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:55.317137+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:25.064825+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:54.655361+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:22:24.080027+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:22:52.886412+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":4,"to":6},{"from":5,"to":9}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.3:0/776988825":"2024-09-11T23:16:20.647314+0000","172.21.15.3:0/2965090335":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/2364823868":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/3186881356":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/911991463":"2024-09-11T23:16:20.647314+0000","172.21.15.3:6800/2582365069":"2024-09-11T23:14:37.169991+0000","172.21.15.3:6801/2582365069":"2024-09-11T23:14:37.169991+0000","172.21.15.3:6801/1528153492":"2024-09-11T23:15:05.835734+0000","172.21.15.3:6800/1924113958":"2024-09-11T23:16:20.647314+0000","172.21.15.3:0/554479543":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/4238683346":"2024-09-11T23:15:05.835734+0000","172.21.15.3:6800/1528153492":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/285471483":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/1249510760":"2024-09-11T23:16:20.647314+0000","172.21.15.3:6801/1924113958":"2024-09-11T23:16:20.647314+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:25:20.101 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:20.100+0000 7f0ace600640 1 -- 172.21.15.3:0/177296611 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0aac0b53c0 msgr2=0x7f0aac0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:20.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:20.100+0000 7f0ace600640 1 --2- 172.21.15.3:0/177296611 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0aac0b53c0 0x7f0aac0b7880 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0ab80057c0 tx=0x7f0ab80058d0 comp rx=0 tx=0).stop 2024-09-10T23:25:20.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:20.100+0000 7f0ace600640 1 -- 172.21.15.3:0/177296611 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ac81087b0 msgr2=0x7f0ac80759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:20.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:20.100+0000 7f0ace600640 1 --2- 172.21.15.3:0/177296611 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ac81087b0 0x7f0ac80759e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0ab000b4a0 tx=0x7f0ab000b960 comp rx=0 tx=0).stop 2024-09-10T23:25:20.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:20.100+0000 7f0ace600640 1 -- 172.21.15.3:0/177296611 shutdown_connections 2024-09-10T23:25:20.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:20.100+0000 7f0ace600640 1 --2- 172.21.15.3:0/177296611 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ac8109130 0x7f0ac8075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:20.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:20.100+0000 7f0ace600640 1 --2- 172.21.15.3:0/177296611 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0aac0b53c0 0x7f0aac0b7880 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:20.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:20.101+0000 7f0ace600640 1 --2- 172.21.15.3:0/177296611 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ac81087b0 0x7f0ac80759e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:20.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:20.101+0000 7f0ace600640 1 --2- 172.21.15.3:0/177296611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ac8102da0 0x7f0ac80754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:20.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:20.101+0000 7f0ace600640 1 -- 172.21.15.3:0/177296611 >> 172.21.15.3:0/177296611 conn(0x7f0ac80fe810 msgr2=0x7f0ac8100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:20.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:20.101+0000 7f0ace600640 1 -- 172.21.15.3:0/177296611 shutdown_connections 2024-09-10T23:25:20.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:20.101+0000 7f0ace600640 1 -- 172.21.15.3:0/177296611 wait complete. 2024-09-10T23:25:20.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:20 smithi194 ceph-mon[33904]: pgmap v345: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-10T23:25:20.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:20 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/177296611' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:25:20.458 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:20 smithi003 ceph-mon[30348]: pgmap v345: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-10T23:25:20.458 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:20 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/177296611' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:25:20.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:20 smithi038 ceph-mon[34225]: pgmap v345: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-10T23:25:20.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:20 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/177296611' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:25:20.884 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-10T23:25:20.885 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-10T23:25:20.885 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-10T23:25:20.886 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-10T23:25:20.886 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-10T23:25:20.886 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-10T23:25:20.887 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-10T23:25:20.887 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-10T23:25:20.888 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-10T23:25:20.888 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-10T23:25:20.889 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-10T23:25:20.889 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-10T23:25:21.149 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:21 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]} : dispatch 2024-09-10T23:25:21.150 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:21 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]} : dispatch 2024-09-10T23:25:21.150 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:21 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]} : dispatch 2024-09-10T23:25:21.150 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:21 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 10]} : dispatch 2024-09-10T23:25:21.150 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:21 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]} : dispatch 2024-09-10T23:25:21.150 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:21 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]} : dispatch 2024-09-10T23:25:21.150 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:21 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]} : dispatch 2024-09-10T23:25:21.150 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:21 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 10]} : dispatch 2024-09-10T23:25:21.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:21 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]} : dispatch 2024-09-10T23:25:21.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:21 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]} : dispatch 2024-09-10T23:25:21.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:21 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]} : dispatch 2024-09-10T23:25:21.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:21 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 10]} : dispatch 2024-09-10T23:25:21.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:21 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]} : dispatch 2024-09-10T23:25:21.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:21 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]} : dispatch 2024-09-10T23:25:21.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:21 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]} : dispatch 2024-09-10T23:25:21.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:21 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 10]} : dispatch 2024-09-10T23:25:21.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:21 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]} : dispatch 2024-09-10T23:25:21.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:21 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]} : dispatch 2024-09-10T23:25:21.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:21 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]} : dispatch 2024-09-10T23:25:21.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:21 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 10]} : dispatch 2024-09-10T23:25:21.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:21 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]} : dispatch 2024-09-10T23:25:21.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:21 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]} : dispatch 2024-09-10T23:25:21.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:21 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]} : dispatch 2024-09-10T23:25:21.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:21 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 10]} : dispatch 2024-09-10T23:25:21.986 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:21.989 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:21.992 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:22.026 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:22.041 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:22.048 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:22.148 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:22.404 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:22 smithi003 ceph-mon[30348]: pgmap v346: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-10T23:25:22.404 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:22 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]': finished 2024-09-10T23:25:22.404 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:22 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]': finished 2024-09-10T23:25:22.404 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:22 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]': finished 2024-09-10T23:25:22.405 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:22 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 10]}]': finished 2024-09-10T23:25:22.405 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:22 smithi003 ceph-mon[30348]: osdmap e89: 12 total, 12 up, 12 in 2024-09-10T23:25:22.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:22 smithi194 ceph-mon[33904]: pgmap v346: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-10T23:25:22.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:22 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]': finished 2024-09-10T23:25:22.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:22 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]': finished 2024-09-10T23:25:22.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:22 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]': finished 2024-09-10T23:25:22.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:22 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 10]}]': finished 2024-09-10T23:25:22.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:22 smithi194 ceph-mon[33904]: osdmap e89: 12 total, 12 up, 12 in 2024-09-10T23:25:22.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:22 smithi038 ceph-mon[34225]: pgmap v346: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-10T23:25:22.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:22 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]': finished 2024-09-10T23:25:22.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:22 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]': finished 2024-09-10T23:25:22.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:22 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]': finished 2024-09-10T23:25:22.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:22 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 10]}]': finished 2024-09-10T23:25:22.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:22 smithi038 ceph-mon[34225]: osdmap e89: 12 total, 12 up, 12 in 2024-09-10T23:25:22.652 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:22.652 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:22.658 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:23.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.915+0000 7fa9e8c00640 1 -- 172.21.15.3:0/3749119092 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa9e4105570 msgr2=0x7fa9e41059b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:23.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.915+0000 7fa9e8c00640 1 --2- 172.21.15.3:0/3749119092 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa9e4105570 0x7fa9e41059b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0009900 tx=0x7fa9d002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.916+0000 7fa9e8c00640 1 -- 172.21.15.3:0/3749119092 shutdown_connections 2024-09-10T23:25:23.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.916+0000 7fa9e8c00640 1 --2- 172.21.15.3:0/3749119092 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9e4105ef0 0x7fa9e410f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.916+0000 7fa9e8c00640 1 --2- 172.21.15.3:0/3749119092 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa9e4105570 0x7fa9e41059b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.916+0000 7fa9e8c00640 1 --2- 172.21.15.3:0/3749119092 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9e4101220 0x7fa9e4101600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.916+0000 7fa9e8c00640 1 -- 172.21.15.3:0/3749119092 >> 172.21.15.3:0/3749119092 conn(0x7fa9e4078100 msgr2=0x7fa9e40ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:23.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.916+0000 7fa9e8c00640 1 -- 172.21.15.3:0/3749119092 shutdown_connections 2024-09-10T23:25:23.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.916+0000 7fa9e8c00640 1 -- 172.21.15.3:0/3749119092 wait complete. 2024-09-10T23:25:23.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.917+0000 7fa9e8c00640 1 Processor -- start 2024-09-10T23:25:23.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.917+0000 7fa9e8c00640 1 -- start start 2024-09-10T23:25:23.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.918+0000 7fa9e8c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa9e4101220 0x7fa9e41991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.918+0000 7fa9e8c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9e4105570 0x7fa9e4199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.918+0000 7fa9e8c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9e4105ef0 0x7fa9e419eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.918+0000 7fa9e8c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e4112c80 con 0x7fa9e4101220 2024-09-10T23:25:23.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.918+0000 7fa9e8c00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e4112b00 con 0x7fa9e4105570 2024-09-10T23:25:23.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.918+0000 7fa9e8c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e4112e00 con 0x7fa9e4105ef0 2024-09-10T23:25:23.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.918+0000 7fa9e1e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa9e4101220 0x7fa9e41991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.918+0000 7fa9e1e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa9e4101220 0x7fa9e41991d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:46884/0 (socket says 172.21.15.3:46884) 2024-09-10T23:25:23.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.918+0000 7fa9e1e00640 1 -- 172.21.15.3:0/791401981 learned_addr learned my addr 172.21.15.3:0/791401981 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:23.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.918+0000 7fa9e2800640 1 --2- 172.21.15.3:0/791401981 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9e4105ef0 0x7fa9e419eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.918+0000 7fa9e1400640 1 --2- 172.21.15.3:0/791401981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9e4105570 0x7fa9e4199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.919+0000 7fa9e1e00640 1 -- 172.21.15.3:0/791401981 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9e4105ef0 msgr2=0x7fa9e419eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:23.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.919+0000 7fa9e1e00640 1 --2- 172.21.15.3:0/791401981 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9e4105ef0 0x7fa9e419eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.919+0000 7fa9e1e00640 1 -- 172.21.15.3:0/791401981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9e4105570 msgr2=0x7fa9e4199710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:23.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.919+0000 7fa9e1e00640 1 --2- 172.21.15.3:0/791401981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9e4105570 0x7fa9e4199710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.919+0000 7fa9e1e00640 1 -- 172.21.15.3:0/791401981 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9e419f280 con 0x7fa9e4101220 2024-09-10T23:25:23.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.919+0000 7fa9e1e00640 1 --2- 172.21.15.3:0/791401981 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa9e4101220 0x7fa9e41991d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa9d400d950 tx=0x7fa9d400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:23.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.919+0000 7fa9daa00640 1 -- 172.21.15.3:0/791401981 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4017030 con 0x7fa9e4101220 2024-09-10T23:25:23.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.919+0000 7fa9daa00640 1 -- 172.21.15.3:0/791401981 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa9d4004020 con 0x7fa9e4101220 2024-09-10T23:25:23.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.919+0000 7fa9e8c00640 1 -- 172.21.15.3:0/791401981 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9e419f570 con 0x7fa9e4101220 2024-09-10T23:25:23.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.919+0000 7fa9daa00640 1 -- 172.21.15.3:0/791401981 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d40055d0 con 0x7fa9e4101220 2024-09-10T23:25:23.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.919+0000 7fa9e8c00640 1 -- 172.21.15.3:0/791401981 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9e41a5c30 con 0x7fa9e4101220 2024-09-10T23:25:23.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.920+0000 7fa9e8c00640 1 -- 172.21.15.3:0/791401981 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa9e40638e0 con 0x7fa9e4101220 2024-09-10T23:25:23.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.923+0000 7fa9daa00640 1 -- 172.21.15.3:0/791401981 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7fa9d4009a30 con 0x7fa9e4101220 2024-09-10T23:25:23.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.924+0000 7fa9daa00640 1 --2- 172.21.15.3:0/791401981 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fa9c80b53c0 0x7fa9c80b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.924+0000 7fa9daa00640 1 -- 172.21.15.3:0/791401981 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7fa9d40e62d0 con 0x7fa9e4101220 2024-09-10T23:25:23.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.925+0000 7fa9e1400640 1 --2- 172.21.15.3:0/791401981 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fa9c80b53c0 0x7fa9c80b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.925+0000 7fa9daa00640 1 --2- 172.21.15.3:0/791401981 >> [v2:172.21.15.3:6810/2061990952,v1:172.21.15.3:6811/2061990952] conn(0x7fa9c80c0880 0x7fa9c80c2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.925+0000 7fa9daa00640 1 -- 172.21.15.3:0/791401981 --> [v2:172.21.15.3:6810/2061990952,v1:172.21.15.3:6811/2061990952] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa9d4022e50 con 0x7fa9c80c0880 2024-09-10T23:25:23.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.925+0000 7fa9daa00640 1 -- 172.21.15.3:0/791401981 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fa9d40e6720 con 0x7fa9e4101220 2024-09-10T23:25:23.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.925+0000 7fa9e2800640 1 --2- 172.21.15.3:0/791401981 >> [v2:172.21.15.3:6810/2061990952,v1:172.21.15.3:6811/2061990952] conn(0x7fa9c80c0880 0x7fa9c80c2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.925+0000 7fa9e1400640 1 --2- 172.21.15.3:0/791401981 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fa9c80b53c0 0x7fa9c80b7880 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0006010 tx=0x7fa9d0005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:23.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.926+0000 7fa9e2800640 1 --2- 172.21.15.3:0/791401981 >> [v2:172.21.15.3:6810/2061990952,v1:172.21.15.3:6811/2061990952] conn(0x7fa9c80c0880 0x7fa9c80c2d20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:23.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.927+0000 7fa9daa00640 1 -- 172.21.15.3:0/791401981 <== osd.3 v2:172.21.15.3:6810/2061990952 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa9d4022e50 con 0x7fa9c80c0880 2024-09-10T23:25:23.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.941+0000 7fa9e8c00640 1 -- 172.21.15.3:0/791401981 --> [v2:172.21.15.3:6810/2061990952,v1:172.21.15.3:6811/2061990952] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa9e4063ce0 con 0x7fa9c80c0880 2024-09-10T23:25:23.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.942+0000 7fa9daa00640 1 -- 172.21.15.3:0/791401981 <== osd.3 v2:172.21.15.3:6810/2061990952 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa9e4063ce0 con 0x7fa9c80c0880 2024-09-10T23:25:23.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.942+0000 7fa9e8c00640 1 -- 172.21.15.3:0/791401981 >> [v2:172.21.15.3:6810/2061990952,v1:172.21.15.3:6811/2061990952] conn(0x7fa9c80c0880 msgr2=0x7fa9c80c2d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:23.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.942+0000 7fa9e8c00640 1 --2- 172.21.15.3:0/791401981 >> [v2:172.21.15.3:6810/2061990952,v1:172.21.15.3:6811/2061990952] conn(0x7fa9c80c0880 0x7fa9c80c2d20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.943+0000 7fa9e8c00640 1 -- 172.21.15.3:0/791401981 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fa9c80b53c0 msgr2=0x7fa9c80b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:23.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.943+0000 7fa9e8c00640 1 --2- 172.21.15.3:0/791401981 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fa9c80b53c0 0x7fa9c80b7880 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0006010 tx=0x7fa9d0005e80 comp rx=0 tx=0).stop 2024-09-10T23:25:23.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.943+0000 7fa9e8c00640 1 -- 172.21.15.3:0/791401981 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa9e4101220 msgr2=0x7fa9e41991d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:23.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.943+0000 7fa9e8c00640 1 --2- 172.21.15.3:0/791401981 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa9e4101220 0x7fa9e41991d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa9d400d950 tx=0x7fa9d400de10 comp rx=0 tx=0).stop 2024-09-10T23:25:23.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.943+0000 7fa9e2800640 1 -- 172.21.15.3:0/791401981 reap_dead start 2024-09-10T23:25:23.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.943+0000 7fa9e8c00640 1 -- 172.21.15.3:0/791401981 shutdown_connections 2024-09-10T23:25:23.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.943+0000 7fa9e8c00640 1 -- 172.21.15.3:0/791401981 >> 172.21.15.3:0/791401981 conn(0x7fa9e4078100 msgr2=0x7fa9e40ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:23.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.943+0000 7fa9e8c00640 1 -- 172.21.15.3:0/791401981 shutdown_connections 2024-09-10T23:25:23.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:22.943+0000 7fa9e8c00640 1 -- 172.21.15.3:0/791401981 wait complete. 2024-09-10T23:25:23.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:23 smithi003 ceph-mon[30348]: osdmap e90: 12 total, 12 up, 12 in 2024-09-10T23:25:23.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:23 smithi194 ceph-mon[33904]: osdmap e90: 12 total, 12 up, 12 in 2024-09-10T23:25:23.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:23 smithi038 ceph-mon[34225]: osdmap e90: 12 total, 12 up, 12 in 2024-09-10T23:25:23.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.766+0000 7f94ae600640 1 -- 172.21.15.3:0/353980823 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94a80776d0 msgr2=0x7f94a8077ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:23.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.766+0000 7f94ae600640 1 --2- 172.21.15.3:0/353980823 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94a80776d0 0x7f94a8077ab0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9498009900 tx=0x7f949802a410 comp rx=0 tx=0).stop 2024-09-10T23:25:23.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.766+0000 7f94ae600640 1 -- 172.21.15.3:0/353980823 shutdown_connections 2024-09-10T23:25:23.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.766+0000 7f94ae600640 1 --2- 172.21.15.3:0/353980823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94a8113990 0x7f94a8115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.766+0000 7f94ae600640 1 --2- 172.21.15.3:0/353980823 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94a8077ff0 0x7f94a8113450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.766+0000 7f94ae600640 1 --2- 172.21.15.3:0/353980823 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94a80776d0 0x7f94a8077ab0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.766+0000 7f94ae600640 1 -- 172.21.15.3:0/353980823 >> 172.21.15.3:0/353980823 conn(0x7f94a8100a50 msgr2=0x7f94a8102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:23.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.766+0000 7f94ae600640 1 -- 172.21.15.3:0/353980823 shutdown_connections 2024-09-10T23:25:23.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.766+0000 7f94ae600640 1 -- 172.21.15.3:0/353980823 wait complete. 2024-09-10T23:25:23.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.767+0000 7f94ae600640 1 Processor -- start 2024-09-10T23:25:23.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.767+0000 7f94ae600640 1 -- start start 2024-09-10T23:25:23.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.767+0000 7f94ae600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94a80776d0 0x7f94a819f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.767+0000 7f94ae600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94a8077ff0 0x7f94a819fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.768+0000 7f94ae600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94a8113990 0x7f94a81a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.768+0000 7f94ae600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f94a8119240 con 0x7f94a80776d0 2024-09-10T23:25:23.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.768+0000 7f94ae600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f94a81190c0 con 0x7f94a8113990 2024-09-10T23:25:23.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.768+0000 7f94ae600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f94a81193c0 con 0x7f94a8077ff0 2024-09-10T23:25:23.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.768+0000 7f94a7400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94a80776d0 0x7f94a819f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.768+0000 7f94a7400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94a80776d0 0x7f94a819f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:46908/0 (socket says 172.21.15.3:46908) 2024-09-10T23:25:23.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.768+0000 7f94a7400640 1 -- 172.21.15.3:0/124924940 learned_addr learned my addr 172.21.15.3:0/124924940 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:23.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.768+0000 7f94a7e00640 1 --2- 172.21.15.3:0/124924940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94a8113990 0x7f94a81a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.768+0000 7f94a6a00640 1 --2- 172.21.15.3:0/124924940 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94a8077ff0 0x7f94a819fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.768+0000 7f94a7400640 1 -- 172.21.15.3:0/124924940 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94a8077ff0 msgr2=0x7f94a819fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:23.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.768+0000 7f94a7400640 1 --2- 172.21.15.3:0/124924940 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94a8077ff0 0x7f94a819fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.768+0000 7f94a7400640 1 -- 172.21.15.3:0/124924940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94a8113990 msgr2=0x7f94a81a50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:23.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.768+0000 7f94a7400640 1 --2- 172.21.15.3:0/124924940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94a8113990 0x7f94a81a50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.768+0000 7f94a7400640 1 -- 172.21.15.3:0/124924940 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94a81a58c0 con 0x7f94a80776d0 2024-09-10T23:25:23.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.769+0000 7f94a6a00640 1 --2- 172.21.15.3:0/124924940 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94a8077ff0 0x7f94a819fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:25:23.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.769+0000 7f94a7400640 1 --2- 172.21.15.3:0/124924940 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94a80776d0 0x7f94a819f810 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9498009230 tx=0x7f9498004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:23.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.769+0000 7f949fe00640 1 -- 172.21.15.3:0/124924940 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949803f030 con 0x7f94a80776d0 2024-09-10T23:25:23.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.769+0000 7f949fe00640 1 -- 172.21.15.3:0/124924940 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9498003a80 con 0x7f94a80776d0 2024-09-10T23:25:23.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.769+0000 7f94ae600640 1 -- 172.21.15.3:0/124924940 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94a81a5b50 con 0x7f94a80776d0 2024-09-10T23:25:23.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.769+0000 7f949fe00640 1 -- 172.21.15.3:0/124924940 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9498035070 con 0x7f94a80776d0 2024-09-10T23:25:23.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.769+0000 7f94ae600640 1 -- 172.21.15.3:0/124924940 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94a81ac270 con 0x7f94a80776d0 2024-09-10T23:25:23.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.771+0000 7f94ae600640 1 -- 172.21.15.3:0/124924940 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f94a80638a0 con 0x7f94a80776d0 2024-09-10T23:25:23.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.773+0000 7f949fe00640 1 -- 172.21.15.3:0/124924940 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7f9498003c30 con 0x7f94a80776d0 2024-09-10T23:25:23.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.775+0000 7f949fe00640 1 --2- 172.21.15.3:0/124924940 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f948c0b53c0 0x7f948c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.775+0000 7f949fe00640 1 -- 172.21.15.3:0/124924940 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f94981071c0 con 0x7f94a80776d0 2024-09-10T23:25:23.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.775+0000 7f94a6a00640 1 --2- 172.21.15.3:0/124924940 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f948c0b53c0 0x7f948c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.775+0000 7f949fe00640 1 --2- 172.21.15.3:0/124924940 >> [v2:172.21.15.194:6808/4117812658,v1:172.21.15.194:6809/4117812658] conn(0x7f948c0c0880 0x7f948c0c2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.775+0000 7f949fe00640 1 -- 172.21.15.3:0/124924940 --> [v2:172.21.15.194:6808/4117812658,v1:172.21.15.194:6809/4117812658] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f948c0c33f0 con 0x7f948c0c0880 2024-09-10T23:25:23.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.775+0000 7f949fe00640 1 -- 172.21.15.3:0/124924940 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f9498107570 con 0x7f94a80776d0 2024-09-10T23:25:23.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.776+0000 7f94a7e00640 1 --2- 172.21.15.3:0/124924940 >> [v2:172.21.15.194:6808/4117812658,v1:172.21.15.194:6809/4117812658] conn(0x7f948c0c0880 0x7f948c0c2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.776+0000 7f94a6a00640 1 --2- 172.21.15.3:0/124924940 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f948c0b53c0 0x7f948c0b7880 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f94a8116050 tx=0x7f9494005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:23.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.777+0000 7f94a7e00640 1 --2- 172.21.15.3:0/124924940 >> [v2:172.21.15.194:6808/4117812658,v1:172.21.15.194:6809/4117812658] conn(0x7f948c0c0880 0x7f948c0c2d20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:23.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.778+0000 7f949fe00640 1 -- 172.21.15.3:0/124924940 <== osd.5 v2:172.21.15.194:6808/4117812658 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f948c0c33f0 con 0x7f948c0c0880 2024-09-10T23:25:23.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.792+0000 7f94ae600640 1 -- 172.21.15.3:0/124924940 --> [v2:172.21.15.194:6808/4117812658,v1:172.21.15.194:6809/4117812658] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f94a8063d20 con 0x7f948c0c0880 2024-09-10T23:25:23.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.793+0000 7f949fe00640 1 -- 172.21.15.3:0/124924940 <== osd.5 v2:172.21.15.194:6808/4117812658 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f94a8063d20 con 0x7f948c0c0880 2024-09-10T23:25:23.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.793+0000 7f94ae600640 1 -- 172.21.15.3:0/124924940 >> [v2:172.21.15.194:6808/4117812658,v1:172.21.15.194:6809/4117812658] conn(0x7f948c0c0880 msgr2=0x7f948c0c2d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:23.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.793+0000 7f94ae600640 1 --2- 172.21.15.3:0/124924940 >> [v2:172.21.15.194:6808/4117812658,v1:172.21.15.194:6809/4117812658] conn(0x7f948c0c0880 0x7f948c0c2d20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.794+0000 7f94ae600640 1 -- 172.21.15.3:0/124924940 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f948c0b53c0 msgr2=0x7f948c0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:23.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.794+0000 7f94ae600640 1 --2- 172.21.15.3:0/124924940 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f948c0b53c0 0x7f948c0b7880 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f94a8116050 tx=0x7f9494005f90 comp rx=0 tx=0).stop 2024-09-10T23:25:23.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.794+0000 7f94ae600640 1 -- 172.21.15.3:0/124924940 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94a80776d0 msgr2=0x7f94a819f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:23.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.794+0000 7f94ae600640 1 --2- 172.21.15.3:0/124924940 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94a80776d0 0x7f94a819f810 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9498009230 tx=0x7f9498004270 comp rx=0 tx=0).stop 2024-09-10T23:25:23.796 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.794+0000 7f94a7e00640 1 -- 172.21.15.3:0/124924940 reap_dead start 2024-09-10T23:25:23.796 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.794+0000 7f94ae600640 1 -- 172.21.15.3:0/124924940 shutdown_connections 2024-09-10T23:25:23.796 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.794+0000 7f94ae600640 1 -- 172.21.15.3:0/124924940 >> 172.21.15.3:0/124924940 conn(0x7f94a8100a50 msgr2=0x7f94a8102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:23.796 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.794+0000 7f94ae600640 1 -- 172.21.15.3:0/124924940 shutdown_connections 2024-09-10T23:25:23.796 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:23.794+0000 7f94ae600640 1 -- 172.21.15.3:0/124924940 wait complete. 2024-09-10T23:25:24.268 INFO:teuthology.orchestra.run.smithi003.stdout:111669149776 2024-09-10T23:25:24.268 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-10T23:25:24.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:24 smithi194 ceph-mon[33904]: pgmap v349: 129 pgs: 1 peering, 128 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-10T23:25:24.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:24 smithi194 ceph-mon[33904]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-09-10T23:25:24.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:24 smithi003 ceph-mon[30348]: pgmap v349: 129 pgs: 1 peering, 128 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-10T23:25:24.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:24 smithi003 ceph-mon[30348]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-09-10T23:25:24.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:24 smithi038 ceph-mon[34225]: pgmap v349: 129 pgs: 1 peering, 128 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-10T23:25:24.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:24 smithi038 ceph-mon[34225]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-09-10T23:25:25.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.295+0000 7fc1d7200640 1 -- 172.21.15.3:0/2344275634 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1d810b1a0 msgr2=0x7fc1d81119a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:25.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.295+0000 7fc1d7200640 1 --2- 172.21.15.3:0/2344275634 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1d810b1a0 0x7fc1d81119a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0009ca0 tx=0x7fc1d002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.295+0000 7fc1d7200640 1 -- 172.21.15.3:0/2344275634 shutdown_connections 2024-09-10T23:25:25.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.295+0000 7fc1d7200640 1 --2- 172.21.15.3:0/2344275634 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1d810b1a0 0x7fc1d81119a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.295+0000 7fc1d7200640 1 --2- 172.21.15.3:0/2344275634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1d810a820 0x7fc1d810ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.295+0000 7fc1d7200640 1 --2- 172.21.15.3:0/2344275634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1d8104e10 0x7fc1d81051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.295+0000 7fc1d7200640 1 -- 172.21.15.3:0/2344275634 >> 172.21.15.3:0/2344275634 conn(0x7fc1d8100840 msgr2=0x7fc1d8102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:25.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.295+0000 7fc1d7200640 1 -- 172.21.15.3:0/2344275634 shutdown_connections 2024-09-10T23:25:25.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.295+0000 7fc1d7200640 1 -- 172.21.15.3:0/2344275634 wait complete. 2024-09-10T23:25:25.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.296+0000 7fc1d7200640 1 Processor -- start 2024-09-10T23:25:25.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.296+0000 7fc1d7200640 1 -- start start 2024-09-10T23:25:25.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.297+0000 7fc1d7200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1d8104e10 0x7fc1d819b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:25.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.297+0000 7fc1d7200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1d810a820 0x7fc1d819b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:25.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.297+0000 7fc1d7200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1d810b1a0 0x7fc1d81a0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:25.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.297+0000 7fc1d7200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d8114d60 con 0x7fc1d810b1a0 2024-09-10T23:25:25.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.297+0000 7fc1d7200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d8114be0 con 0x7fc1d8104e10 2024-09-10T23:25:25.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.297+0000 7fc1d7200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d8114ee0 con 0x7fc1d810a820 2024-09-10T23:25:25.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.297+0000 7fc1d6800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1d810b1a0 0x7fc1d81a0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:25.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.297+0000 7fc1d5e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1d8104e10 0x7fc1d819b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:25.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.297+0000 7fc1d5e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1d8104e10 0x7fc1d819b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.3:43216/0 (socket says 172.21.15.3:43216) 2024-09-10T23:25:25.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.297+0000 7fc1d6800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1d810b1a0 0x7fc1d81a0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:46916/0 (socket says 172.21.15.3:46916) 2024-09-10T23:25:25.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.297+0000 7fc1d5e00640 1 -- 172.21.15.3:0/3072785497 learned_addr learned my addr 172.21.15.3:0/3072785497 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:25.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.297+0000 7fc1d5400640 1 --2- 172.21.15.3:0/3072785497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1d810a820 0x7fc1d819b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:25.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.297+0000 7fc1d5e00640 1 -- 172.21.15.3:0/3072785497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1d810a820 msgr2=0x7fc1d819b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:25.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.297+0000 7fc1d5e00640 1 --2- 172.21.15.3:0/3072785497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1d810a820 0x7fc1d819b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.298+0000 7fc1d5e00640 1 -- 172.21.15.3:0/3072785497 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1d810b1a0 msgr2=0x7fc1d81a0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:25.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.298+0000 7fc1d5e00640 1 --2- 172.21.15.3:0/3072785497 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1d810b1a0 0x7fc1d81a0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.298+0000 7fc1d5e00640 1 -- 172.21.15.3:0/3072785497 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1d81a11e0 con 0x7fc1d8104e10 2024-09-10T23:25:25.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.298+0000 7fc1d6800640 1 --2- 172.21.15.3:0/3072785497 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1d810b1a0 0x7fc1d81a0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:25.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.298+0000 7fc1d5e00640 1 --2- 172.21.15.3:0/3072785497 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1d8104e10 0x7fc1d819b130 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc1c800d770 tx=0x7fc1c800dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:25.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.298+0000 7fc1cea00640 1 -- 172.21.15.3:0/3072785497 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c8017070 con 0x7fc1d8104e10 2024-09-10T23:25:25.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.298+0000 7fc1d7200640 1 -- 172.21.15.3:0/3072785497 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1d81a14d0 con 0x7fc1d8104e10 2024-09-10T23:25:25.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.298+0000 7fc1cea00640 1 -- 172.21.15.3:0/3072785497 <== mon.2 v2:172.21.15.38:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc1c80054b0 con 0x7fc1d8104e10 2024-09-10T23:25:25.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.298+0000 7fc1cea00640 1 -- 172.21.15.3:0/3072785497 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c8004c60 con 0x7fc1d8104e10 2024-09-10T23:25:25.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.298+0000 7fc1d7200640 1 -- 172.21.15.3:0/3072785497 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1d81a7b90 con 0x7fc1d8104e10 2024-09-10T23:25:25.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.299+0000 7fc1d7200640 1 -- 172.21.15.3:0/3072785497 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc1d80638e0 con 0x7fc1d8104e10 2024-09-10T23:25:25.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.302+0000 7fc1cea00640 1 -- 172.21.15.3:0/3072785497 <== mon.2 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7fc1c8004e00 con 0x7fc1d8104e10 2024-09-10T23:25:25.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.303+0000 7fc1cea00640 1 --2- 172.21.15.3:0/3072785497 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc1bc0b5460 0x7fc1bc0b7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:25.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.303+0000 7fc1cea00640 1 -- 172.21.15.3:0/3072785497 <== mon.2 v2:172.21.15.38:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7fc1c80e6140 con 0x7fc1d8104e10 2024-09-10T23:25:25.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.303+0000 7fc1d5400640 1 --2- 172.21.15.3:0/3072785497 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc1bc0b5460 0x7fc1bc0b7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:25.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.304+0000 7fc1cea00640 1 --2- 172.21.15.3:0/3072785497 >> [v2:172.21.15.194:6800/3191263316,v1:172.21.15.194:6801/3191263316] conn(0x7fc1bc0c0920 0x7fc1bc0c2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:25.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.304+0000 7fc1cea00640 1 -- 172.21.15.3:0/3072785497 --> [v2:172.21.15.194:6800/3191263316,v1:172.21.15.194:6801/3191263316] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc1c8021e50 con 0x7fc1bc0c0920 2024-09-10T23:25:25.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.304+0000 7fc1cea00640 1 -- 172.21.15.3:0/3072785497 <== mon.2 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fc1c80e64f0 con 0x7fc1d8104e10 2024-09-10T23:25:25.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.304+0000 7fc1d5400640 1 --2- 172.21.15.3:0/3072785497 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc1bc0b5460 0x7fc1bc0b7920 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc1d810a3c0 tx=0x7fc1c400b590 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:25.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.304+0000 7fc1d6800640 1 --2- 172.21.15.3:0/3072785497 >> [v2:172.21.15.194:6800/3191263316,v1:172.21.15.194:6801/3191263316] conn(0x7fc1bc0c0920 0x7fc1bc0c2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:25.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.305+0000 7fc1d6800640 1 --2- 172.21.15.3:0/3072785497 >> [v2:172.21.15.194:6800/3191263316,v1:172.21.15.194:6801/3191263316] conn(0x7fc1bc0c0920 0x7fc1bc0c2dc0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:25.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.306+0000 7fc1cea00640 1 -- 172.21.15.3:0/3072785497 <== osd.2 v2:172.21.15.194:6800/3191263316 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc1c8021e50 con 0x7fc1bc0c0920 2024-09-10T23:25:25.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.320+0000 7fc1d7200640 1 -- 172.21.15.3:0/3072785497 --> [v2:172.21.15.194:6800/3191263316,v1:172.21.15.194:6801/3191263316] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc1d8063d60 con 0x7fc1bc0c0920 2024-09-10T23:25:25.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.321+0000 7fc1cea00640 1 -- 172.21.15.3:0/3072785497 <== osd.2 v2:172.21.15.194:6800/3191263316 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc1d8063d60 con 0x7fc1bc0c0920 2024-09-10T23:25:25.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.322+0000 7fc1d7200640 1 -- 172.21.15.3:0/3072785497 >> [v2:172.21.15.194:6800/3191263316,v1:172.21.15.194:6801/3191263316] conn(0x7fc1bc0c0920 msgr2=0x7fc1bc0c2dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:25.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.322+0000 7fc1d7200640 1 --2- 172.21.15.3:0/3072785497 >> [v2:172.21.15.194:6800/3191263316,v1:172.21.15.194:6801/3191263316] conn(0x7fc1bc0c0920 0x7fc1bc0c2dc0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:25.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.322+0000 7fc1d7200640 1 -- 172.21.15.3:0/3072785497 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc1bc0b5460 msgr2=0x7fc1bc0b7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:25.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.322+0000 7fc1d7200640 1 --2- 172.21.15.3:0/3072785497 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc1bc0b5460 0x7fc1bc0b7920 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc1d810a3c0 tx=0x7fc1c400b590 comp rx=0 tx=0).stop 2024-09-10T23:25:25.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.322+0000 7fc1d7200640 1 -- 172.21.15.3:0/3072785497 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1d8104e10 msgr2=0x7fc1d819b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:25.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.322+0000 7fc1d7200640 1 --2- 172.21.15.3:0/3072785497 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1d8104e10 0x7fc1d819b130 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc1c800d770 tx=0x7fc1c800dc30 comp rx=0 tx=0).stop 2024-09-10T23:25:25.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.322+0000 7fc1d6800640 1 -- 172.21.15.3:0/3072785497 reap_dead start 2024-09-10T23:25:25.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.322+0000 7fc1d7200640 1 -- 172.21.15.3:0/3072785497 shutdown_connections 2024-09-10T23:25:25.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.322+0000 7fc1d7200640 1 -- 172.21.15.3:0/3072785497 >> 172.21.15.3:0/3072785497 conn(0x7fc1d8100840 msgr2=0x7fc1d8102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:25.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.322+0000 7fc1d7200640 1 -- 172.21.15.3:0/3072785497 shutdown_connections 2024-09-10T23:25:25.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.322+0000 7fc1d7200640 1 -- 172.21.15.3:0/3072785497 wait complete. 2024-09-10T23:25:26.023 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.498+0000 7fd36fc00640 1 -- 172.21.15.3:0/1209271296 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd36810a9b0 msgr2=0x7fd36810adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:26.023 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.498+0000 7fd36fc00640 1 --2- 172.21.15.3:0/1209271296 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd36810a9b0 0x7fd36810adf0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd350009900 tx=0x7fd35002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.023 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.499+0000 7fd36fc00640 1 -- 172.21.15.3:0/1209271296 shutdown_connections 2024-09-10T23:25:26.023 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.499+0000 7fd36fc00640 1 --2- 172.21.15.3:0/1209271296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd36810b330 0x7fd368111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.023 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.499+0000 7fd36fc00640 1 --2- 172.21.15.3:0/1209271296 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd36810a9b0 0x7fd36810adf0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.023 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.499+0000 7fd36fc00640 1 --2- 172.21.15.3:0/1209271296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd368104fa0 0x7fd368105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.023 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.499+0000 7fd36fc00640 1 -- 172.21.15.3:0/1209271296 >> 172.21.15.3:0/1209271296 conn(0x7fd368100a50 msgr2=0x7fd368102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:26.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.499+0000 7fd36fc00640 1 -- 172.21.15.3:0/1209271296 shutdown_connections 2024-09-10T23:25:26.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.499+0000 7fd36fc00640 1 -- 172.21.15.3:0/1209271296 wait complete. 2024-09-10T23:25:26.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.500+0000 7fd36fc00640 1 Processor -- start 2024-09-10T23:25:26.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.500+0000 7fd36fc00640 1 -- start start 2024-09-10T23:25:26.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.500+0000 7fd36fc00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd368104fa0 0x7fd36819b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:26.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.500+0000 7fd36fc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd36810a9b0 0x7fd36819b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:26.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.500+0000 7fd36fc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd36810b330 0x7fd3681a0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:26.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.500+0000 7fd36fc00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd368114e10 con 0x7fd36810a9b0 2024-09-10T23:25:26.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.500+0000 7fd36fc00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd368114c90 con 0x7fd368104fa0 2024-09-10T23:25:26.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.500+0000 7fd36fc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd368114f90 con 0x7fd36810b330 2024-09-10T23:25:26.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.500+0000 7fd35fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd36810a9b0 0x7fd36819b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:26.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.501+0000 7fd35fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd36810a9b0 0x7fd36819b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:46936/0 (socket says 172.21.15.3:46936) 2024-09-10T23:25:26.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.501+0000 7fd35fe00640 1 -- 172.21.15.3:0/3606123640 learned_addr learned my addr 172.21.15.3:0/3606123640 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:26.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.501+0000 7fd36d200640 1 --2- 172.21.15.3:0/3606123640 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd368104fa0 0x7fd36819b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:26.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.501+0000 7fd36dc00640 1 --2- 172.21.15.3:0/3606123640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd36810b330 0x7fd3681a0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:26.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.501+0000 7fd35fe00640 1 -- 172.21.15.3:0/3606123640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd36810b330 msgr2=0x7fd3681a0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:26.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.501+0000 7fd35fe00640 1 --2- 172.21.15.3:0/3606123640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd36810b330 0x7fd3681a0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.501+0000 7fd35fe00640 1 -- 172.21.15.3:0/3606123640 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd368104fa0 msgr2=0x7fd36819b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:26.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.501+0000 7fd35fe00640 1 --2- 172.21.15.3:0/3606123640 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd368104fa0 0x7fd36819b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.501+0000 7fd35fe00640 1 -- 172.21.15.3:0/3606123640 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3681a1470 con 0x7fd36810a9b0 2024-09-10T23:25:26.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.501+0000 7fd36dc00640 1 --2- 172.21.15.3:0/3606123640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd36810b330 0x7fd3681a0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:26.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.501+0000 7fd35fe00640 1 --2- 172.21.15.3:0/3606123640 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd36810a9b0 0x7fd36819b900 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd350009230 tx=0x7fd3500319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:26.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.502+0000 7fd366000640 1 -- 172.21.15.3:0/3606123640 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35003f030 con 0x7fd36810a9b0 2024-09-10T23:25:26.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.502+0000 7fd366000640 1 -- 172.21.15.3:0/3606123640 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd3500043d0 con 0x7fd36810a9b0 2024-09-10T23:25:26.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.502+0000 7fd366000640 1 -- 172.21.15.3:0/3606123640 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd350035070 con 0x7fd36810a9b0 2024-09-10T23:25:26.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.502+0000 7fd36fc00640 1 -- 172.21.15.3:0/3606123640 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3681a1700 con 0x7fd36810a9b0 2024-09-10T23:25:26.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.502+0000 7fd36fc00640 1 -- 172.21.15.3:0/3606123640 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3681a7e20 con 0x7fd36810a9b0 2024-09-10T23:25:26.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.503+0000 7fd36fc00640 1 -- 172.21.15.3:0/3606123640 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd3680638a0 con 0x7fd36810a9b0 2024-09-10T23:25:26.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.505+0000 7fd366000640 1 -- 172.21.15.3:0/3606123640 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7fd35003b880 con 0x7fd36810a9b0 2024-09-10T23:25:26.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.506+0000 7fd366000640 1 --2- 172.21.15.3:0/3606123640 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd34c0b5440 0x7fd34c0b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:26.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.507+0000 7fd366000640 1 -- 172.21.15.3:0/3606123640 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7fd350106d40 con 0x7fd36810a9b0 2024-09-10T23:25:26.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.507+0000 7fd36d200640 1 --2- 172.21.15.3:0/3606123640 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd34c0b5440 0x7fd34c0b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:26.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.507+0000 7fd366000640 1 --2- 172.21.15.3:0/3606123640 >> [v2:172.21.15.194:6824/1048859686,v1:172.21.15.194:6825/1048859686] conn(0x7fd34c0c0900 0x7fd34c0c2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:26.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.507+0000 7fd366000640 1 -- 172.21.15.3:0/3606123640 --> [v2:172.21.15.194:6824/1048859686,v1:172.21.15.194:6825/1048859686] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd34c0c3470 con 0x7fd34c0c0900 2024-09-10T23:25:26.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.507+0000 7fd366000640 1 -- 172.21.15.3:0/3606123640 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fd3501070f0 con 0x7fd36810a9b0 2024-09-10T23:25:26.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.507+0000 7fd36d200640 1 --2- 172.21.15.3:0/3606123640 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd34c0b5440 0x7fd34c0b7900 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd358009bd0 tx=0x7fd358005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:26.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.507+0000 7fd36dc00640 1 --2- 172.21.15.3:0/3606123640 >> [v2:172.21.15.194:6824/1048859686,v1:172.21.15.194:6825/1048859686] conn(0x7fd34c0c0900 0x7fd34c0c2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:26.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.508+0000 7fd36dc00640 1 --2- 172.21.15.3:0/3606123640 >> [v2:172.21.15.194:6824/1048859686,v1:172.21.15.194:6825/1048859686] conn(0x7fd34c0c0900 0x7fd34c0c2da0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:26.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.509+0000 7fd366000640 1 -- 172.21.15.3:0/3606123640 <== osd.11 v2:172.21.15.194:6824/1048859686 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd34c0c3470 con 0x7fd34c0c0900 2024-09-10T23:25:26.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.524+0000 7fd36fc00640 1 -- 172.21.15.3:0/3606123640 --> [v2:172.21.15.194:6824/1048859686,v1:172.21.15.194:6825/1048859686] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd368063ca0 con 0x7fd34c0c0900 2024-09-10T23:25:26.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.524+0000 7fd366000640 1 -- 172.21.15.3:0/3606123640 <== osd.11 v2:172.21.15.194:6824/1048859686 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd368063ca0 con 0x7fd34c0c0900 2024-09-10T23:25:26.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.525+0000 7fd36fc00640 1 -- 172.21.15.3:0/3606123640 >> [v2:172.21.15.194:6824/1048859686,v1:172.21.15.194:6825/1048859686] conn(0x7fd34c0c0900 msgr2=0x7fd34c0c2da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:26.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.525+0000 7fd36fc00640 1 --2- 172.21.15.3:0/3606123640 >> [v2:172.21.15.194:6824/1048859686,v1:172.21.15.194:6825/1048859686] conn(0x7fd34c0c0900 0x7fd34c0c2da0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.525+0000 7fd36fc00640 1 -- 172.21.15.3:0/3606123640 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd34c0b5440 msgr2=0x7fd34c0b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:26.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.525+0000 7fd36fc00640 1 --2- 172.21.15.3:0/3606123640 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd34c0b5440 0x7fd34c0b7900 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd358009bd0 tx=0x7fd358005f90 comp rx=0 tx=0).stop 2024-09-10T23:25:26.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.525+0000 7fd36fc00640 1 -- 172.21.15.3:0/3606123640 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd36810a9b0 msgr2=0x7fd36819b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:26.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.525+0000 7fd36fc00640 1 --2- 172.21.15.3:0/3606123640 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd36810a9b0 0x7fd36819b900 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd350009230 tx=0x7fd3500319a0 comp rx=0 tx=0).stop 2024-09-10T23:25:26.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.525+0000 7fd36dc00640 1 -- 172.21.15.3:0/3606123640 reap_dead start 2024-09-10T23:25:26.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.525+0000 7fd36fc00640 1 -- 172.21.15.3:0/3606123640 shutdown_connections 2024-09-10T23:25:26.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.525+0000 7fd36fc00640 1 -- 172.21.15.3:0/3606123640 >> 172.21.15.3:0/3606123640 conn(0x7fd368100a50 msgr2=0x7fd368102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:26.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.525+0000 7fd36fc00640 1 -- 172.21.15.3:0/3606123640 shutdown_connections 2024-09-10T23:25:26.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:25.525+0000 7fd36fc00640 1 -- 172.21.15.3:0/3606123640 wait complete. 2024-09-10T23:25:26.429 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:26 smithi003 ceph-mon[30348]: pgmap v350: 129 pgs: 1 peering, 128 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:25:26.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:26 smithi194 ceph-mon[33904]: pgmap v350: 129 pgs: 1 peering, 128 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:25:26.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:26 smithi038 ceph-mon[34225]: pgmap v350: 129 pgs: 1 peering, 128 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:25:27.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.282+0000 7f6809e00640 1 -- 172.21.15.3:0/915604576 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6804109150 msgr2=0x7f680410f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:27.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.282+0000 7f6809e00640 1 --2- 172.21.15.3:0/915604576 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6804109150 0x7f680410f950 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f67fc009ca0 tx=0x7f67fc02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:25:27.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.282+0000 7f6809e00640 1 -- 172.21.15.3:0/915604576 shutdown_connections 2024-09-10T23:25:27.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.282+0000 7f6809e00640 1 --2- 172.21.15.3:0/915604576 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6804109150 0x7f680410f950 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:27.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.282+0000 7f6809e00640 1 --2- 172.21.15.3:0/915604576 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68041087d0 0x7f6804108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:27.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.282+0000 7f6809e00640 1 --2- 172.21.15.3:0/915604576 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6804102dc0 0x7f68041031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:27.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.282+0000 7f6809e00640 1 -- 172.21.15.3:0/915604576 >> 172.21.15.3:0/915604576 conn(0x7f68040fe830 msgr2=0x7f6804100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:27.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.282+0000 7f6809e00640 1 -- 172.21.15.3:0/915604576 shutdown_connections 2024-09-10T23:25:27.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.283+0000 7f6809e00640 1 -- 172.21.15.3:0/915604576 wait complete. 2024-09-10T23:25:27.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.283+0000 7f6809e00640 1 Processor -- start 2024-09-10T23:25:27.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.284+0000 7f6809e00640 1 -- start start 2024-09-10T23:25:27.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.284+0000 7f6809e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6804102dc0 0x7f680419b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:27.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.284+0000 7f6809e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68041087d0 0x7f680419b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:27.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.284+0000 7f6809e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6804109150 0x7f68041a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:27.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.284+0000 7f6809e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6804112d10 con 0x7f6804109150 2024-09-10T23:25:27.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.284+0000 7f6809e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6804112b90 con 0x7f68041087d0 2024-09-10T23:25:27.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.284+0000 7f6809e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6804112e90 con 0x7f6804102dc0 2024-09-10T23:25:27.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.284+0000 7f6803400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6804109150 0x7f68041a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:27.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.284+0000 7f6802000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68041087d0 0x7f680419b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:27.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.285+0000 7f6803400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6804109150 0x7f68041a0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:46986/0 (socket says 172.21.15.3:46986) 2024-09-10T23:25:27.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.285+0000 7f6802000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68041087d0 0x7f680419b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.3:43294/0 (socket says 172.21.15.3:43294) 2024-09-10T23:25:27.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.285+0000 7f6803400640 1 -- 172.21.15.3:0/2352941074 learned_addr learned my addr 172.21.15.3:0/2352941074 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:27.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.285+0000 7f6802a00640 1 --2- 172.21.15.3:0/2352941074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6804102dc0 0x7f680419b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:27.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.285+0000 7f6803400640 1 -- 172.21.15.3:0/2352941074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6804102dc0 msgr2=0x7f680419b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:27.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.285+0000 7f6803400640 1 --2- 172.21.15.3:0/2352941074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6804102dc0 0x7f680419b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:27.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.285+0000 7f6803400640 1 -- 172.21.15.3:0/2352941074 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68041087d0 msgr2=0x7f680419b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:27.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.285+0000 7f6803400640 1 --2- 172.21.15.3:0/2352941074 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68041087d0 0x7f680419b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:27.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.285+0000 7f6803400640 1 -- 172.21.15.3:0/2352941074 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68041a1430 con 0x7f6804109150 2024-09-10T23:25:27.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.285+0000 7f6803400640 1 --2- 172.21.15.3:0/2352941074 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6804109150 0x7f68041a0c60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f67fc031040 tx=0x7f67fc003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:27.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.286+0000 7f6808a00640 1 -- 172.21.15.3:0/2352941074 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67fc032c90 con 0x7f6804109150 2024-09-10T23:25:27.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.286+0000 7f6808a00640 1 -- 172.21.15.3:0/2352941074 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67fc032e30 con 0x7f6804109150 2024-09-10T23:25:27.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.286+0000 7f6809e00640 1 -- 172.21.15.3:0/2352941074 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68041a16c0 con 0x7f6804109150 2024-09-10T23:25:27.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.286+0000 7f6808a00640 1 -- 172.21.15.3:0/2352941074 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67fc030af0 con 0x7f6804109150 2024-09-10T23:25:27.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.286+0000 7f6809e00640 1 -- 172.21.15.3:0/2352941074 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68041a7de0 con 0x7f6804109150 2024-09-10T23:25:27.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.287+0000 7f6809e00640 1 -- 172.21.15.3:0/2352941074 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f68040638e0 con 0x7f6804109150 2024-09-10T23:25:27.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.289+0000 7f6808a00640 1 -- 172.21.15.3:0/2352941074 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7f67fc030c90 con 0x7f6804109150 2024-09-10T23:25:27.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.291+0000 7f6808a00640 1 --2- 172.21.15.3:0/2352941074 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f67e80b5440 0x7f67e80b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:27.292 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:27 smithi003 ceph-mon[30348]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-09-10T23:25:27.292 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:27 smithi003 ceph-mon[30348]: Cluster is now healthy 2024-09-10T23:25:27.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.291+0000 7f6808a00640 1 -- 172.21.15.3:0/2352941074 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f67fc1074f0 con 0x7f6804109150 2024-09-10T23:25:27.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.291+0000 7f6802a00640 1 --2- 172.21.15.3:0/2352941074 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f67e80b5440 0x7f67e80b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:27.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.291+0000 7f6808a00640 1 --2- 172.21.15.3:0/2352941074 >> [v2:172.21.15.3:6818/3470543721,v1:172.21.15.3:6819/3470543721] conn(0x7f67e80c0900 0x7f67e80c2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:27.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.291+0000 7f6808a00640 1 -- 172.21.15.3:0/2352941074 --> [v2:172.21.15.3:6818/3470543721,v1:172.21.15.3:6819/3470543721] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f67e80c3470 con 0x7f67e80c0900 2024-09-10T23:25:27.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.291+0000 7f6808a00640 1 -- 172.21.15.3:0/2352941074 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f67fc1078a0 con 0x7f6804109150 2024-09-10T23:25:27.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.292+0000 7f6802000640 1 --2- 172.21.15.3:0/2352941074 >> [v2:172.21.15.3:6818/3470543721,v1:172.21.15.3:6819/3470543721] conn(0x7f67e80c0900 0x7f67e80c2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:27.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.292+0000 7f6802a00640 1 --2- 172.21.15.3:0/2352941074 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f67e80b5440 0x7f67e80b7900 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f67f4009bd0 tx=0x7f67f4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:27.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.292+0000 7f6802000640 1 --2- 172.21.15.3:0/2352941074 >> [v2:172.21.15.3:6818/3470543721,v1:172.21.15.3:6819/3470543721] conn(0x7f67e80c0900 0x7f67e80c2da0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:27.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.293+0000 7f6808a00640 1 -- 172.21.15.3:0/2352941074 <== osd.6 v2:172.21.15.3:6818/3470543721 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f67e80c3470 con 0x7f67e80c0900 2024-09-10T23:25:27.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.308+0000 7f6809e00640 1 -- 172.21.15.3:0/2352941074 --> [v2:172.21.15.3:6818/3470543721,v1:172.21.15.3:6819/3470543721] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6804063ce0 con 0x7f67e80c0900 2024-09-10T23:25:27.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.308+0000 7f6808a00640 1 -- 172.21.15.3:0/2352941074 <== osd.6 v2:172.21.15.3:6818/3470543721 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6804063ce0 con 0x7f67e80c0900 2024-09-10T23:25:27.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.309+0000 7f6809e00640 1 -- 172.21.15.3:0/2352941074 >> [v2:172.21.15.3:6818/3470543721,v1:172.21.15.3:6819/3470543721] conn(0x7f67e80c0900 msgr2=0x7f67e80c2da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:27.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.309+0000 7f6809e00640 1 --2- 172.21.15.3:0/2352941074 >> [v2:172.21.15.3:6818/3470543721,v1:172.21.15.3:6819/3470543721] conn(0x7f67e80c0900 0x7f67e80c2da0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:27.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.309+0000 7f6809e00640 1 -- 172.21.15.3:0/2352941074 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f67e80b5440 msgr2=0x7f67e80b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:27.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.309+0000 7f6809e00640 1 --2- 172.21.15.3:0/2352941074 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f67e80b5440 0x7f67e80b7900 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f67f4009bd0 tx=0x7f67f4005f90 comp rx=0 tx=0).stop 2024-09-10T23:25:27.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.309+0000 7f6809e00640 1 -- 172.21.15.3:0/2352941074 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6804109150 msgr2=0x7f68041a0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:27.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.309+0000 7f6809e00640 1 --2- 172.21.15.3:0/2352941074 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6804109150 0x7f68041a0c60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f67fc031040 tx=0x7f67fc003f80 comp rx=0 tx=0).stop 2024-09-10T23:25:27.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.309+0000 7f6803400640 1 -- 172.21.15.3:0/2352941074 reap_dead start 2024-09-10T23:25:27.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.309+0000 7f6809e00640 1 -- 172.21.15.3:0/2352941074 shutdown_connections 2024-09-10T23:25:27.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.309+0000 7f6809e00640 1 -- 172.21.15.3:0/2352941074 >> 172.21.15.3:0/2352941074 conn(0x7f68040fe830 msgr2=0x7f6804104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:27.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.309+0000 7f6809e00640 1 -- 172.21.15.3:0/2352941074 shutdown_connections 2024-09-10T23:25:27.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.309+0000 7f6809e00640 1 -- 172.21.15.3:0/2352941074 wait complete. 2024-09-10T23:25:27.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:27 smithi038 ceph-mon[34225]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-09-10T23:25:27.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:27 smithi038 ceph-mon[34225]: Cluster is now healthy 2024-09-10T23:25:27.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:27 smithi194 ceph-mon[33904]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-09-10T23:25:27.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:27 smithi194 ceph-mon[33904]: Cluster is now healthy 2024-09-10T23:25:27.749 INFO:teuthology.orchestra.run.smithi003.stdout:158913790021 2024-09-10T23:25:27.750 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-10T23:25:28.287 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:28 smithi003 ceph-mon[30348]: pgmap v351: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-10T23:25:28.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:28 smithi038 ceph-mon[34225]: pgmap v351: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-10T23:25:28.638 INFO:teuthology.orchestra.run.smithi003.stdout:304942678050 2024-09-10T23:25:28.638 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-10T23:25:28.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:28 smithi194 ceph-mon[33904]: pgmap v351: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-10T23:25:28.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.402+0000 7f7c7d600640 1 -- 172.21.15.3:0/2243367336 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c7810cf70 msgr2=0x7f7c7810f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:28.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.402+0000 7f7c7d600640 1 --2- 172.21.15.3:0/2243367336 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c7810cf70 0x7f7c7810f3d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7c70009ca0 tx=0x7f7c7002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.402+0000 7f7c7d600640 1 -- 172.21.15.3:0/2243367336 shutdown_connections 2024-09-10T23:25:28.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.402+0000 7f7c7d600640 1 --2- 172.21.15.3:0/2243367336 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c7810cf70 0x7f7c7810f3d0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.402+0000 7f7c7d600640 1 --2- 172.21.15.3:0/2243367336 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c78104430 0x7f7c7810c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.402+0000 7f7c7d600640 1 --2- 172.21.15.3:0/2243367336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c78103b10 0x7f7c78103ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.402+0000 7f7c7d600640 1 -- 172.21.15.3:0/2243367336 >> 172.21.15.3:0/2243367336 conn(0x7f7c780fd5b0 msgr2=0x7f7c780ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:28.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.402+0000 7f7c7d600640 1 -- 172.21.15.3:0/2243367336 shutdown_connections 2024-09-10T23:25:28.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.402+0000 7f7c7d600640 1 -- 172.21.15.3:0/2243367336 wait complete. 2024-09-10T23:25:28.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.403+0000 7f7c7d600640 1 Processor -- start 2024-09-10T23:25:28.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.403+0000 7f7c7d600640 1 -- start start 2024-09-10T23:25:28.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.403+0000 7f7c7d600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c78103b10 0x7f7c7819b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:28.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.403+0000 7f7c7d600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c78104430 0x7f7c7819b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:28.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.403+0000 7f7c7d600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c7810cf70 0x7f7c781a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:28.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.403+0000 7f7c7d600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7c78112ae0 con 0x7f7c7810cf70 2024-09-10T23:25:28.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.403+0000 7f7c7d600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7c78112960 con 0x7f7c78104430 2024-09-10T23:25:28.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.403+0000 7f7c7d600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7c78112c60 con 0x7f7c78103b10 2024-09-10T23:25:28.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.404+0000 7f7c7cc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c7810cf70 0x7f7c781a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:28.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.404+0000 7f7c77e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c78103b10 0x7f7c7819b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:28.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.404+0000 7f7c7cc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c7810cf70 0x7f7c781a0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47006/0 (socket says 172.21.15.3:47006) 2024-09-10T23:25:28.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.404+0000 7f7c7cc00640 1 -- 172.21.15.3:0/925256453 learned_addr learned my addr 172.21.15.3:0/925256453 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:28.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.404+0000 7f7c77400640 1 --2- 172.21.15.3:0/925256453 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c78104430 0x7f7c7819b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:28.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.404+0000 7f7c7cc00640 1 -- 172.21.15.3:0/925256453 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c78103b10 msgr2=0x7f7c7819b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:28.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.404+0000 7f7c7cc00640 1 --2- 172.21.15.3:0/925256453 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c78103b10 0x7f7c7819b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.404+0000 7f7c7cc00640 1 -- 172.21.15.3:0/925256453 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c78104430 msgr2=0x7f7c7819b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:28.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.404+0000 7f7c7cc00640 1 --2- 172.21.15.3:0/925256453 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c78104430 0x7f7c7819b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.404+0000 7f7c7cc00640 1 -- 172.21.15.3:0/925256453 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c781a1210 con 0x7f7c7810cf70 2024-09-10T23:25:28.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.405+0000 7f7c7cc00640 1 --2- 172.21.15.3:0/925256453 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c7810cf70 0x7f7c781a0a40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7c70005cc0 tx=0x7f7c70032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:28.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.405+0000 7f7c74c00640 1 -- 172.21.15.3:0/925256453 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c70032e00 con 0x7f7c7810cf70 2024-09-10T23:25:28.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.405+0000 7f7c7d600640 1 -- 172.21.15.3:0/925256453 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c781a14a0 con 0x7f7c7810cf70 2024-09-10T23:25:28.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.405+0000 7f7c74c00640 1 -- 172.21.15.3:0/925256453 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7c700044d0 con 0x7f7c7810cf70 2024-09-10T23:25:28.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.405+0000 7f7c74c00640 1 -- 172.21.15.3:0/925256453 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c70030b70 con 0x7f7c7810cf70 2024-09-10T23:25:28.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.405+0000 7f7c7d600640 1 -- 172.21.15.3:0/925256453 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c781a7bc0 con 0x7f7c7810cf70 2024-09-10T23:25:28.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.406+0000 7f7c7d600640 1 -- 172.21.15.3:0/925256453 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7c780ff3c0 con 0x7f7c7810cf70 2024-09-10T23:25:28.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.408+0000 7f7c74c00640 1 -- 172.21.15.3:0/925256453 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7f7c70004680 con 0x7f7c7810cf70 2024-09-10T23:25:28.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.410+0000 7f7c74c00640 1 --2- 172.21.15.3:0/925256453 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f7c5c0b5460 0x7f7c5c0b7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:28.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.410+0000 7f7c74c00640 1 -- 172.21.15.3:0/925256453 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f7c70107750 con 0x7f7c7810cf70 2024-09-10T23:25:28.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.410+0000 7f7c77e00640 1 --2- 172.21.15.3:0/925256453 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f7c5c0b5460 0x7f7c5c0b7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:28.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.410+0000 7f7c74c00640 1 --2- 172.21.15.3:0/925256453 >> [v2:172.21.15.38:6808/413294160,v1:172.21.15.38:6809/413294160] conn(0x7f7c5c0c0920 0x7f7c5c0c2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:28.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.410+0000 7f7c74c00640 1 -- 172.21.15.3:0/925256453 --> [v2:172.21.15.38:6808/413294160,v1:172.21.15.38:6809/413294160] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7c7003fec0 con 0x7f7c5c0c0920 2024-09-10T23:25:28.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.410+0000 7f7c74c00640 1 -- 172.21.15.3:0/925256453 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f7c70107b00 con 0x7f7c7810cf70 2024-09-10T23:25:28.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.410+0000 7f7c77400640 1 --2- 172.21.15.3:0/925256453 >> [v2:172.21.15.38:6808/413294160,v1:172.21.15.38:6809/413294160] conn(0x7f7c5c0c0920 0x7f7c5c0c2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:28.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.410+0000 7f7c77e00640 1 --2- 172.21.15.3:0/925256453 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f7c5c0b5460 0x7f7c5c0b7920 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7c68005d00 tx=0x7f7c6800b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:28.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.411+0000 7f7c77400640 1 --2- 172.21.15.3:0/925256453 >> [v2:172.21.15.38:6808/413294160,v1:172.21.15.38:6809/413294160] conn(0x7f7c5c0c0920 0x7f7c5c0c2dc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:28.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.412+0000 7f7c74c00640 1 -- 172.21.15.3:0/925256453 <== osd.4 v2:172.21.15.38:6808/413294160 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7c7003fec0 con 0x7f7c5c0c0920 2024-09-10T23:25:28.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.426+0000 7f7c7d600640 1 -- 172.21.15.3:0/925256453 --> [v2:172.21.15.38:6808/413294160,v1:172.21.15.38:6809/413294160] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7c7806b1b0 con 0x7f7c5c0c0920 2024-09-10T23:25:28.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.427+0000 7f7c74c00640 1 -- 172.21.15.3:0/925256453 <== osd.4 v2:172.21.15.38:6808/413294160 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7c7806b1b0 con 0x7f7c5c0c0920 2024-09-10T23:25:28.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.428+0000 7f7c7d600640 1 -- 172.21.15.3:0/925256453 >> [v2:172.21.15.38:6808/413294160,v1:172.21.15.38:6809/413294160] conn(0x7f7c5c0c0920 msgr2=0x7f7c5c0c2dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:28.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.428+0000 7f7c7d600640 1 --2- 172.21.15.3:0/925256453 >> [v2:172.21.15.38:6808/413294160,v1:172.21.15.38:6809/413294160] conn(0x7f7c5c0c0920 0x7f7c5c0c2dc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:28.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.428+0000 7f7c7d600640 1 -- 172.21.15.3:0/925256453 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f7c5c0b5460 msgr2=0x7f7c5c0b7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:28.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.428+0000 7f7c7d600640 1 --2- 172.21.15.3:0/925256453 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f7c5c0b5460 0x7f7c5c0b7920 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7c68005d00 tx=0x7f7c6800b410 comp rx=0 tx=0).stop 2024-09-10T23:25:28.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.428+0000 7f7c7d600640 1 -- 172.21.15.3:0/925256453 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c7810cf70 msgr2=0x7f7c781a0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:28.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.428+0000 7f7c7d600640 1 --2- 172.21.15.3:0/925256453 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c7810cf70 0x7f7c781a0a40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7c70005cc0 tx=0x7f7c70032a10 comp rx=0 tx=0).stop 2024-09-10T23:25:28.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.428+0000 7f7c7cc00640 1 -- 172.21.15.3:0/925256453 reap_dead start 2024-09-10T23:25:28.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.428+0000 7f7c7d600640 1 -- 172.21.15.3:0/925256453 shutdown_connections 2024-09-10T23:25:28.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.428+0000 7f7c7d600640 1 -- 172.21.15.3:0/925256453 >> 172.21.15.3:0/925256453 conn(0x7f7c780fd5b0 msgr2=0x7f7c780fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:28.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.428+0000 7f7c7d600640 1 -- 172.21.15.3:0/925256453 shutdown_connections 2024-09-10T23:25:28.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:28.428+0000 7f7c7d600640 1 -- 172.21.15.3:0/925256453 wait complete. 2024-09-10T23:25:29.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.054+0000 7f64edc00640 1 -- 172.21.15.3:0/3817716841 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64e810b330 msgr2=0x7f64e8111b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:29.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.054+0000 7f64edc00640 1 --2- 172.21.15.3:0/3817716841 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64e810b330 0x7f64e8111b30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f64e0009ca0 tx=0x7f64e002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.055+0000 7f64edc00640 1 -- 172.21.15.3:0/3817716841 shutdown_connections 2024-09-10T23:25:29.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.055+0000 7f64edc00640 1 --2- 172.21.15.3:0/3817716841 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64e810b330 0x7f64e8111b30 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.055+0000 7f64edc00640 1 --2- 172.21.15.3:0/3817716841 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64e810a9b0 0x7f64e810adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.055+0000 7f64edc00640 1 --2- 172.21.15.3:0/3817716841 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64e8104fa0 0x7f64e8105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.055+0000 7f64edc00640 1 -- 172.21.15.3:0/3817716841 >> 172.21.15.3:0/3817716841 conn(0x7f64e8100a50 msgr2=0x7f64e8102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:29.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.055+0000 7f64edc00640 1 -- 172.21.15.3:0/3817716841 shutdown_connections 2024-09-10T23:25:29.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.055+0000 7f64edc00640 1 -- 172.21.15.3:0/3817716841 wait complete. 2024-09-10T23:25:29.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.056+0000 7f64edc00640 1 Processor -- start 2024-09-10T23:25:29.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.056+0000 7f64edc00640 1 -- start start 2024-09-10T23:25:29.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.057+0000 7f64edc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64e8104fa0 0x7f64e819b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:29.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.057+0000 7f64edc00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64e810a9b0 0x7f64e819b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:29.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.057+0000 7f64edc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64e810b330 0x7f64e81a0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:29.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.057+0000 7f64edc00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f64e8114e60 con 0x7f64e8104fa0 2024-09-10T23:25:29.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.057+0000 7f64edc00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f64e8114ce0 con 0x7f64e810a9b0 2024-09-10T23:25:29.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.057+0000 7f64edc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f64e8114fe0 con 0x7f64e810b330 2024-09-10T23:25:29.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.057+0000 7f64e6a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64e8104fa0 0x7f64e819b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:29.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.057+0000 7f64e6a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64e8104fa0 0x7f64e819b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:46950/0 (socket says 172.21.15.3:46950) 2024-09-10T23:25:29.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.057+0000 7f64e6a00640 1 -- 172.21.15.3:0/1344207884 learned_addr learned my addr 172.21.15.3:0/1344207884 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:29.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.057+0000 7f64e6000640 1 --2- 172.21.15.3:0/1344207884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64e810a9b0 0x7f64e819b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:29.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.057+0000 7f64e7400640 1 --2- 172.21.15.3:0/1344207884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64e810b330 0x7f64e81a0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:29.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.058+0000 7f64e6a00640 1 -- 172.21.15.3:0/1344207884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64e810b330 msgr2=0x7f64e81a0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:29.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.058+0000 7f64e6a00640 1 --2- 172.21.15.3:0/1344207884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64e810b330 0x7f64e81a0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.058+0000 7f64e6a00640 1 -- 172.21.15.3:0/1344207884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64e810a9b0 msgr2=0x7f64e819b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:29.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.058+0000 7f64e6a00640 1 --2- 172.21.15.3:0/1344207884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64e810a9b0 0x7f64e819b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.058+0000 7f64e6a00640 1 -- 172.21.15.3:0/1344207884 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e81a14e0 con 0x7f64e8104fa0 2024-09-10T23:25:29.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.058+0000 7f64e6000640 1 --2- 172.21.15.3:0/1344207884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64e810a9b0 0x7f64e819b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:29.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.058+0000 7f64e6a00640 1 --2- 172.21.15.3:0/1344207884 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64e8104fa0 0x7f64e819b430 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f64d800e9f0 tx=0x7f64d800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:29.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.058+0000 7f64df400640 1 -- 172.21.15.3:0/1344207884 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d800cd80 con 0x7f64e8104fa0 2024-09-10T23:25:29.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.058+0000 7f64df400640 1 -- 172.21.15.3:0/1344207884 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f64d80054b0 con 0x7f64e8104fa0 2024-09-10T23:25:29.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.058+0000 7f64edc00640 1 -- 172.21.15.3:0/1344207884 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64e81a17d0 con 0x7f64e8104fa0 2024-09-10T23:25:29.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.058+0000 7f64df400640 1 -- 172.21.15.3:0/1344207884 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d8010430 con 0x7f64e8104fa0 2024-09-10T23:25:29.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.059+0000 7f64edc00640 1 -- 172.21.15.3:0/1344207884 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64e81a7e90 con 0x7f64e8104fa0 2024-09-10T23:25:29.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.059+0000 7f64edc00640 1 -- 172.21.15.3:0/1344207884 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f64e80638e0 con 0x7f64e8104fa0 2024-09-10T23:25:29.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.062+0000 7f64df400640 1 -- 172.21.15.3:0/1344207884 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7f64d8005000 con 0x7f64e8104fa0 2024-09-10T23:25:29.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.063+0000 7f64df400640 1 --2- 172.21.15.3:0/1344207884 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f64cc0b53c0 0x7f64cc0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:29.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.063+0000 7f64df400640 1 -- 172.21.15.3:0/1344207884 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f64d80e6a40 con 0x7f64e8104fa0 2024-09-10T23:25:29.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.063+0000 7f64e6000640 1 --2- 172.21.15.3:0/1344207884 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f64cc0b53c0 0x7f64cc0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:29.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.064+0000 7f64df400640 1 --2- 172.21.15.3:0/1344207884 >> [v2:172.21.15.38:6800/1447444485,v1:172.21.15.38:6801/1447444485] conn(0x7f64cc0c0880 0x7f64cc0c2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:29.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.064+0000 7f64df400640 1 -- 172.21.15.3:0/1344207884 --> [v2:172.21.15.38:6800/1447444485,v1:172.21.15.38:6801/1447444485] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f64d8011e50 con 0x7f64cc0c0880 2024-09-10T23:25:29.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.064+0000 7f64df400640 1 -- 172.21.15.3:0/1344207884 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f64d80e6df0 con 0x7f64e8104fa0 2024-09-10T23:25:29.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.064+0000 7f64e7400640 1 --2- 172.21.15.3:0/1344207884 >> [v2:172.21.15.38:6800/1447444485,v1:172.21.15.38:6801/1447444485] conn(0x7f64cc0c0880 0x7f64cc0c2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:29.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.064+0000 7f64e6000640 1 --2- 172.21.15.3:0/1344207884 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f64cc0b53c0 0x7f64cc0b7880 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f64e8107080 tx=0x7f64d4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:29.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.065+0000 7f64e7400640 1 --2- 172.21.15.3:0/1344207884 >> [v2:172.21.15.38:6800/1447444485,v1:172.21.15.38:6801/1447444485] conn(0x7f64cc0c0880 0x7f64cc0c2d20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:29.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.066+0000 7f64df400640 1 -- 172.21.15.3:0/1344207884 <== osd.1 v2:172.21.15.38:6800/1447444485 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f64d8011e50 con 0x7f64cc0c0880 2024-09-10T23:25:29.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.081+0000 7f64edc00640 1 -- 172.21.15.3:0/1344207884 --> [v2:172.21.15.38:6800/1447444485,v1:172.21.15.38:6801/1447444485] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f64e8063d60 con 0x7f64cc0c0880 2024-09-10T23:25:29.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.081+0000 7f64df400640 1 -- 172.21.15.3:0/1344207884 <== osd.1 v2:172.21.15.38:6800/1447444485 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f64e8063d60 con 0x7f64cc0c0880 2024-09-10T23:25:29.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.082+0000 7f64edc00640 1 -- 172.21.15.3:0/1344207884 >> [v2:172.21.15.38:6800/1447444485,v1:172.21.15.38:6801/1447444485] conn(0x7f64cc0c0880 msgr2=0x7f64cc0c2d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:29.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.082+0000 7f64edc00640 1 --2- 172.21.15.3:0/1344207884 >> [v2:172.21.15.38:6800/1447444485,v1:172.21.15.38:6801/1447444485] conn(0x7f64cc0c0880 0x7f64cc0c2d20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.082+0000 7f64edc00640 1 -- 172.21.15.3:0/1344207884 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f64cc0b53c0 msgr2=0x7f64cc0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:29.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.082+0000 7f64edc00640 1 --2- 172.21.15.3:0/1344207884 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f64cc0b53c0 0x7f64cc0b7880 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f64e8107080 tx=0x7f64d4005f90 comp rx=0 tx=0).stop 2024-09-10T23:25:29.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.082+0000 7f64edc00640 1 -- 172.21.15.3:0/1344207884 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64e8104fa0 msgr2=0x7f64e819b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:29.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.082+0000 7f64edc00640 1 --2- 172.21.15.3:0/1344207884 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64e8104fa0 0x7f64e819b430 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f64d800e9f0 tx=0x7f64d800edf0 comp rx=0 tx=0).stop 2024-09-10T23:25:29.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.082+0000 7f64e7400640 1 -- 172.21.15.3:0/1344207884 reap_dead start 2024-09-10T23:25:29.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.082+0000 7f64edc00640 1 -- 172.21.15.3:0/1344207884 shutdown_connections 2024-09-10T23:25:29.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.082+0000 7f64edc00640 1 -- 172.21.15.3:0/1344207884 >> 172.21.15.3:0/1344207884 conn(0x7f64e8100a50 msgr2=0x7f64e8101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:29.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.082+0000 7f64edc00640 1 -- 172.21.15.3:0/1344207884 shutdown_connections 2024-09-10T23:25:29.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.082+0000 7f64edc00640 1 -- 172.21.15.3:0/1344207884 wait complete. 2024-09-10T23:25:30.348 INFO:teuthology.orchestra.run.smithi003.stdout:184683593791 2024-09-10T23:25:30.348 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-10T23:25:30.535 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:30 smithi003 ceph-mon[30348]: pgmap v352: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:25:30.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.548+0000 7fb91f800640 1 -- 172.21.15.3:0/119575930 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb9180754c0 msgr2=0x7fb9180758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:30.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.548+0000 7fb91f800640 1 --2- 172.21.15.3:0/119575930 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb9180754c0 0x7fb9180758a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb90c009900 tx=0x7fb90c02a400 comp rx=0 tx=0).stop 2024-09-10T23:25:30.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.548+0000 7fb91f800640 1 -- 172.21.15.3:0/119575930 shutdown_connections 2024-09-10T23:25:30.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.548+0000 7fb91f800640 1 --2- 172.21.15.3:0/119575930 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb91810f3b0 0x7fb9181117a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:30.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.548+0000 7fb91f800640 1 --2- 172.21.15.3:0/119575930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb918075de0 0x7fb91810ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:30.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.548+0000 7fb91f800640 1 --2- 172.21.15.3:0/119575930 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb9180754c0 0x7fb9180758a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:30.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.548+0000 7fb91f800640 1 -- 172.21.15.3:0/119575930 >> 172.21.15.3:0/119575930 conn(0x7fb9180fe810 msgr2=0x7fb918100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:30.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.548+0000 7fb91f800640 1 -- 172.21.15.3:0/119575930 shutdown_connections 2024-09-10T23:25:30.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.548+0000 7fb91f800640 1 -- 172.21.15.3:0/119575930 wait complete. 2024-09-10T23:25:30.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.549+0000 7fb91f800640 1 Processor -- start 2024-09-10T23:25:30.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.550+0000 7fb91f800640 1 -- start start 2024-09-10T23:25:30.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.550+0000 7fb91f800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9180754c0 0x7fb91819b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:30.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.550+0000 7fb91f800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb918075de0 0x7fb91819b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:30.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.550+0000 7fb91f800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb91810f3b0 0x7fb9181a0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:30.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.550+0000 7fb91f800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb918114e90 con 0x7fb918075de0 2024-09-10T23:25:30.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.550+0000 7fb91f800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb918114d10 con 0x7fb9180754c0 2024-09-10T23:25:30.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.550+0000 7fb91f800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb918115010 con 0x7fb91810f3b0 2024-09-10T23:25:30.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.550+0000 7fb917e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb918075de0 0x7fb91819b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:30.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.550+0000 7fb917e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb918075de0 0x7fb91819b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47052/0 (socket says 172.21.15.3:47052) 2024-09-10T23:25:30.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.550+0000 7fb917e00640 1 -- 172.21.15.3:0/770550243 learned_addr learned my addr 172.21.15.3:0/770550243 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:30.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.550+0000 7fb91ce00640 1 --2- 172.21.15.3:0/770550243 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9180754c0 0x7fb91819b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:30.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.551+0000 7fb91d800640 1 --2- 172.21.15.3:0/770550243 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb91810f3b0 0x7fb9181a0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:30.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.551+0000 7fb917e00640 1 -- 172.21.15.3:0/770550243 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb91810f3b0 msgr2=0x7fb9181a0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:30.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.551+0000 7fb917e00640 1 --2- 172.21.15.3:0/770550243 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb91810f3b0 0x7fb9181a0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:30.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.551+0000 7fb917e00640 1 -- 172.21.15.3:0/770550243 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9180754c0 msgr2=0x7fb91819b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:30.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.551+0000 7fb917e00640 1 --2- 172.21.15.3:0/770550243 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9180754c0 0x7fb91819b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:30.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.551+0000 7fb917e00640 1 -- 172.21.15.3:0/770550243 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9181a1450 con 0x7fb918075de0 2024-09-10T23:25:30.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.551+0000 7fb917e00640 1 --2- 172.21.15.3:0/770550243 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb918075de0 0x7fb91819b8e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb90400c920 tx=0x7fb90400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:30.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.552+0000 7fb915600640 1 -- 172.21.15.3:0/770550243 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb904007c70 con 0x7fb918075de0 2024-09-10T23:25:30.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.552+0000 7fb915600640 1 -- 172.21.15.3:0/770550243 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb904007e10 con 0x7fb918075de0 2024-09-10T23:25:30.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.552+0000 7fb915600640 1 -- 172.21.15.3:0/770550243 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb904018710 con 0x7fb918075de0 2024-09-10T23:25:30.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.552+0000 7fb91f800640 1 -- 172.21.15.3:0/770550243 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9181a1740 con 0x7fb918075de0 2024-09-10T23:25:30.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.552+0000 7fb91f800640 1 -- 172.21.15.3:0/770550243 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9181a7e00 con 0x7fb918075de0 2024-09-10T23:25:30.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.553+0000 7fb91f800640 1 -- 172.21.15.3:0/770550243 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb9180638a0 con 0x7fb918075de0 2024-09-10T23:25:30.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.555+0000 7fb915600640 1 -- 172.21.15.3:0/770550243 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7fb90400f450 con 0x7fb918075de0 2024-09-10T23:25:30.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.557+0000 7fb915600640 1 --2- 172.21.15.3:0/770550243 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb9000b53c0 0x7fb9000b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:30.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.557+0000 7fb915600640 1 -- 172.21.15.3:0/770550243 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7fb9040e6400 con 0x7fb918075de0 2024-09-10T23:25:30.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.558+0000 7fb91ce00640 1 --2- 172.21.15.3:0/770550243 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb9000b53c0 0x7fb9000b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:30.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.558+0000 7fb915600640 1 --2- 172.21.15.3:0/770550243 >> [v2:172.21.15.38:6816/2054203924,v1:172.21.15.38:6817/2054203924] conn(0x7fb9000c0880 0x7fb9000c2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:30.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.558+0000 7fb915600640 1 -- 172.21.15.3:0/770550243 --> [v2:172.21.15.38:6816/2054203924,v1:172.21.15.38:6817/2054203924] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb904012ec0 con 0x7fb9000c0880 2024-09-10T23:25:30.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.558+0000 7fb915600640 1 -- 172.21.15.3:0/770550243 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fb9040ed050 con 0x7fb918075de0 2024-09-10T23:25:30.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.558+0000 7fb91d800640 1 --2- 172.21.15.3:0/770550243 >> [v2:172.21.15.38:6816/2054203924,v1:172.21.15.38:6817/2054203924] conn(0x7fb9000c0880 0x7fb9000c2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:30.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.558+0000 7fb91ce00640 1 --2- 172.21.15.3:0/770550243 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb9000b53c0 0x7fb9000b7880 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb90c006010 tx=0x7fb90c005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:30.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.559+0000 7fb91d800640 1 --2- 172.21.15.3:0/770550243 >> [v2:172.21.15.38:6816/2054203924,v1:172.21.15.38:6817/2054203924] conn(0x7fb9000c0880 0x7fb9000c2d20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:30.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.560+0000 7fb915600640 1 -- 172.21.15.3:0/770550243 <== osd.7 v2:172.21.15.38:6816/2054203924 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb904012ec0 con 0x7fb9000c0880 2024-09-10T23:25:30.592 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.591+0000 7fb91f800640 1 -- 172.21.15.3:0/770550243 --> [v2:172.21.15.38:6816/2054203924,v1:172.21.15.38:6817/2054203924] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb918063d20 con 0x7fb9000c0880 2024-09-10T23:25:30.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.592+0000 7fb915600640 1 -- 172.21.15.3:0/770550243 <== osd.7 v2:172.21.15.38:6816/2054203924 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb918063d20 con 0x7fb9000c0880 2024-09-10T23:25:30.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.593+0000 7fb91f800640 1 -- 172.21.15.3:0/770550243 >> [v2:172.21.15.38:6816/2054203924,v1:172.21.15.38:6817/2054203924] conn(0x7fb9000c0880 msgr2=0x7fb9000c2d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:30.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.593+0000 7fb91f800640 1 --2- 172.21.15.3:0/770550243 >> [v2:172.21.15.38:6816/2054203924,v1:172.21.15.38:6817/2054203924] conn(0x7fb9000c0880 0x7fb9000c2d20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:30.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.593+0000 7fb91f800640 1 -- 172.21.15.3:0/770550243 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb9000b53c0 msgr2=0x7fb9000b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:30.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.593+0000 7fb91f800640 1 --2- 172.21.15.3:0/770550243 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb9000b53c0 0x7fb9000b7880 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb90c006010 tx=0x7fb90c005e80 comp rx=0 tx=0).stop 2024-09-10T23:25:30.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.593+0000 7fb91f800640 1 -- 172.21.15.3:0/770550243 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb918075de0 msgr2=0x7fb91819b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:30.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.593+0000 7fb91f800640 1 --2- 172.21.15.3:0/770550243 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb918075de0 0x7fb91819b8e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb90400c920 tx=0x7fb90400cde0 comp rx=0 tx=0).stop 2024-09-10T23:25:30.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.593+0000 7fb91d800640 1 -- 172.21.15.3:0/770550243 reap_dead start 2024-09-10T23:25:30.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.593+0000 7fb91f800640 1 -- 172.21.15.3:0/770550243 shutdown_connections 2024-09-10T23:25:30.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.593+0000 7fb91f800640 1 -- 172.21.15.3:0/770550243 >> 172.21.15.3:0/770550243 conn(0x7fb9180fe810 msgr2=0x7fb9180ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:30.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.593+0000 7fb91f800640 1 -- 172.21.15.3:0/770550243 shutdown_connections 2024-09-10T23:25:30.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:30.593+0000 7fb91f800640 1 -- 172.21.15.3:0/770550243 wait complete. 2024-09-10T23:25:30.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:30 smithi038 ceph-mon[34225]: pgmap v352: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:25:30.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.162+0000 7f32e5c00640 1 -- 172.21.15.3:0/316997551 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f32e0113990 msgr2=0x7f32e0115d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:30.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.162+0000 7f32e5c00640 1 --2- 172.21.15.3:0/316997551 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f32e0113990 0x7f32e0115d80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f32d8009ca0 tx=0x7f32d802a8b0 comp rx=0 tx=0).stop 2024-09-10T23:25:30.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.162+0000 7f32e5c00640 1 -- 172.21.15.3:0/316997551 shutdown_connections 2024-09-10T23:25:30.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.162+0000 7f32e5c00640 1 --2- 172.21.15.3:0/316997551 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f32e0113990 0x7f32e0115d80 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:30.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.162+0000 7f32e5c00640 1 --2- 172.21.15.3:0/316997551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32e0077ff0 0x7f32e0113450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:30.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.162+0000 7f32e5c00640 1 --2- 172.21.15.3:0/316997551 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f32e00776d0 0x7f32e0077ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:30.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.162+0000 7f32e5c00640 1 -- 172.21.15.3:0/316997551 >> 172.21.15.3:0/316997551 conn(0x7f32e0100a50 msgr2=0x7f32e0102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:30.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.162+0000 7f32e5c00640 1 -- 172.21.15.3:0/316997551 shutdown_connections 2024-09-10T23:25:30.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.162+0000 7f32e5c00640 1 -- 172.21.15.3:0/316997551 wait complete. 2024-09-10T23:25:30.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.163+0000 7f32e5c00640 1 Processor -- start 2024-09-10T23:25:30.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.163+0000 7f32e5c00640 1 -- start start 2024-09-10T23:25:30.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.163+0000 7f32e5c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f32e00776d0 0x7f32e019f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:30.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.163+0000 7f32e5c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32e0077ff0 0x7f32e019fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:30.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.163+0000 7f32e5c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f32e0113990 0x7f32e01a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:30.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.163+0000 7f32e5c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f32e0119220 con 0x7f32e00776d0 2024-09-10T23:25:30.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.163+0000 7f32e5c00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f32e01190a0 con 0x7f32e0113990 2024-09-10T23:25:30.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.163+0000 7f32e5c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f32e01193a0 con 0x7f32e0077ff0 2024-09-10T23:25:30.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.164+0000 7f32dea00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f32e00776d0 0x7f32e019f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:30.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.164+0000 7f32dea00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f32e00776d0 0x7f32e019f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:46964/0 (socket says 172.21.15.3:46964) 2024-09-10T23:25:30.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.164+0000 7f32dea00640 1 -- 172.21.15.3:0/4086202159 learned_addr learned my addr 172.21.15.3:0/4086202159 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:30.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.164+0000 7f32df400640 1 --2- 172.21.15.3:0/4086202159 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f32e0113990 0x7f32e01a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:30.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.164+0000 7f32dea00640 1 -- 172.21.15.3:0/4086202159 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32e0077ff0 msgr2=0x7f32e019fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:30.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.164+0000 7f32de000640 1 --2- 172.21.15.3:0/4086202159 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32e0077ff0 0x7f32e019fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:30.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.164+0000 7f32dea00640 1 --2- 172.21.15.3:0/4086202159 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32e0077ff0 0x7f32e019fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:30.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.164+0000 7f32dea00640 1 -- 172.21.15.3:0/4086202159 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f32e0113990 msgr2=0x7f32e01a5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:30.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.164+0000 7f32dea00640 1 --2- 172.21.15.3:0/4086202159 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f32e0113990 0x7f32e01a5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:30.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.164+0000 7f32dea00640 1 -- 172.21.15.3:0/4086202159 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e01a5900 con 0x7f32e00776d0 2024-09-10T23:25:30.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.164+0000 7f32df400640 1 --2- 172.21.15.3:0/4086202159 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f32e0113990 0x7f32e01a5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:30.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.164+0000 7f32de000640 1 --2- 172.21.15.3:0/4086202159 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32e0077ff0 0x7f32e019fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:25:30.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.164+0000 7f32dea00640 1 --2- 172.21.15.3:0/4086202159 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f32e00776d0 0x7f32e019f850 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f32d000e9f0 tx=0x7f32d000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:30.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.165+0000 7f32d7400640 1 -- 172.21.15.3:0/4086202159 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d000cd80 con 0x7f32e00776d0 2024-09-10T23:25:30.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.165+0000 7f32e5c00640 1 -- 172.21.15.3:0/4086202159 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32e01a5bf0 con 0x7f32e00776d0 2024-09-10T23:25:30.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.165+0000 7f32e5c00640 1 -- 172.21.15.3:0/4086202159 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32e01ac480 con 0x7f32e00776d0 2024-09-10T23:25:30.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.165+0000 7f32d7400640 1 -- 172.21.15.3:0/4086202159 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32d00108c0 con 0x7f32e00776d0 2024-09-10T23:25:30.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.165+0000 7f32d7400640 1 -- 172.21.15.3:0/4086202159 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d0026060 con 0x7f32e00776d0 2024-09-10T23:25:30.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.166+0000 7f32e5c00640 1 -- 172.21.15.3:0/4086202159 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f32c0001060 con 0x7f32e00776d0 2024-09-10T23:25:30.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.169+0000 7f32d7400640 1 -- 172.21.15.3:0/4086202159 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7f32d0029050 con 0x7f32e00776d0 2024-09-10T23:25:30.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.170+0000 7f32d7400640 1 --2- 172.21.15.3:0/4086202159 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f32c40b53c0 0x7f32c40b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:30.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.171+0000 7f32d7400640 1 -- 172.21.15.3:0/4086202159 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f32d00e6ab0 con 0x7f32e00776d0 2024-09-10T23:25:30.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.171+0000 7f32de000640 1 --2- 172.21.15.3:0/4086202159 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f32c40b53c0 0x7f32c40b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:30.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.171+0000 7f32d7400640 1 --2- 172.21.15.3:0/4086202159 >> [v2:172.21.15.194:6816/170051722,v1:172.21.15.194:6817/170051722] conn(0x7f32c40c0880 0x7f32c40c2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:30.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.171+0000 7f32d7400640 1 -- 172.21.15.3:0/4086202159 --> [v2:172.21.15.194:6816/170051722,v1:172.21.15.194:6817/170051722] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f32d001bec0 con 0x7f32c40c0880 2024-09-10T23:25:30.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.171+0000 7f32d7400640 1 -- 172.21.15.3:0/4086202159 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f32d00e6e60 con 0x7f32e00776d0 2024-09-10T23:25:30.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.171+0000 7f32df400640 1 --2- 172.21.15.3:0/4086202159 >> [v2:172.21.15.194:6816/170051722,v1:172.21.15.194:6817/170051722] conn(0x7f32c40c0880 0x7f32c40c2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:30.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.172+0000 7f32de000640 1 --2- 172.21.15.3:0/4086202159 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f32c40b53c0 0x7f32c40b7880 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f32e0079e40 tx=0x7f32cc005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:30.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.172+0000 7f32df400640 1 --2- 172.21.15.3:0/4086202159 >> [v2:172.21.15.194:6816/170051722,v1:172.21.15.194:6817/170051722] conn(0x7f32c40c0880 0x7f32c40c2d20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:30.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.173+0000 7f32d7400640 1 -- 172.21.15.3:0/4086202159 <== osd.8 v2:172.21.15.194:6816/170051722 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f32d001bec0 con 0x7f32c40c0880 2024-09-10T23:25:30.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.204+0000 7f32e5c00640 1 -- 172.21.15.3:0/4086202159 --> [v2:172.21.15.194:6816/170051722,v1:172.21.15.194:6817/170051722] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f32c0002e00 con 0x7f32c40c0880 2024-09-10T23:25:30.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.204+0000 7f32d7400640 1 -- 172.21.15.3:0/4086202159 <== osd.8 v2:172.21.15.194:6816/170051722 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f32c0002e00 con 0x7f32c40c0880 2024-09-10T23:25:30.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.205+0000 7f32e5c00640 1 -- 172.21.15.3:0/4086202159 >> [v2:172.21.15.194:6816/170051722,v1:172.21.15.194:6817/170051722] conn(0x7f32c40c0880 msgr2=0x7f32c40c2d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:30.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.205+0000 7f32e5c00640 1 --2- 172.21.15.3:0/4086202159 >> [v2:172.21.15.194:6816/170051722,v1:172.21.15.194:6817/170051722] conn(0x7f32c40c0880 0x7f32c40c2d20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:30.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.205+0000 7f32e5c00640 1 -- 172.21.15.3:0/4086202159 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f32c40b53c0 msgr2=0x7f32c40b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:30.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.205+0000 7f32e5c00640 1 --2- 172.21.15.3:0/4086202159 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f32c40b53c0 0x7f32c40b7880 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f32e0079e40 tx=0x7f32cc005f90 comp rx=0 tx=0).stop 2024-09-10T23:25:30.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.205+0000 7f32e5c00640 1 -- 172.21.15.3:0/4086202159 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f32e00776d0 msgr2=0x7f32e019f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:30.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.205+0000 7f32e5c00640 1 --2- 172.21.15.3:0/4086202159 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f32e00776d0 0x7f32e019f850 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f32d000e9f0 tx=0x7f32d000eeb0 comp rx=0 tx=0).stop 2024-09-10T23:25:30.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.205+0000 7f32df400640 1 -- 172.21.15.3:0/4086202159 reap_dead start 2024-09-10T23:25:30.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.205+0000 7f32e5c00640 1 -- 172.21.15.3:0/4086202159 shutdown_connections 2024-09-10T23:25:30.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.205+0000 7f32e5c00640 1 -- 172.21.15.3:0/4086202159 >> 172.21.15.3:0/4086202159 conn(0x7f32e0100a50 msgr2=0x7f32e0102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:30.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.205+0000 7f32e5c00640 1 -- 172.21.15.3:0/4086202159 shutdown_connections 2024-09-10T23:25:30.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:27.205+0000 7f32e5c00640 1 -- 172.21.15.3:0/4086202159 wait complete. 2024-09-10T23:25:30.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:30 smithi194 ceph-mon[33904]: pgmap v352: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:25:30.900 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:30.901 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:31.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.267+0000 7f4925000640 1 -- 172.21.15.3:0/3965770923 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4920103cc0 msgr2=0x7f49201040a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:31.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.267+0000 7f4925000640 1 --2- 172.21.15.3:0/3965770923 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4920103cc0 0x7f49201040a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4910009900 tx=0x7f491002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.267+0000 7f4925000640 1 -- 172.21.15.3:0/3965770923 shutdown_connections 2024-09-10T23:25:31.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.267+0000 7f4925000640 1 --2- 172.21.15.3:0/3965770923 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f492010d120 0x7f492010f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.267+0000 7f4925000640 1 --2- 172.21.15.3:0/3965770923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49201045e0 0x7f492010cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.267+0000 7f4925000640 1 --2- 172.21.15.3:0/3965770923 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4920103cc0 0x7f49201040a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.267+0000 7f4925000640 1 -- 172.21.15.3:0/3965770923 >> 172.21.15.3:0/3965770923 conn(0x7f49200fd700 msgr2=0x7f49200ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:31.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.267+0000 7f4925000640 1 -- 172.21.15.3:0/3965770923 shutdown_connections 2024-09-10T23:25:31.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.267+0000 7f4925000640 1 -- 172.21.15.3:0/3965770923 wait complete. 2024-09-10T23:25:31.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.268+0000 7f4925000640 1 Processor -- start 2024-09-10T23:25:31.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.268+0000 7f4925000640 1 -- start start 2024-09-10T23:25:31.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.269+0000 7f4925000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4920103cc0 0x7f492019b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:31.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.269+0000 7f4925000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f49201045e0 0x7f492019b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:31.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.269+0000 7f4925000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f492010d120 0x7f49201a0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:31.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.269+0000 7f4925000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f4920112c90 con 0x7f49201045e0 2024-09-10T23:25:31.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.269+0000 7f4925000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4920112b10 con 0x7f4920103cc0 2024-09-10T23:25:31.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.269+0000 7f4925000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4920112e10 con 0x7f492010d120 2024-09-10T23:25:31.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.269+0000 7f491d400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f49201045e0 0x7f492019b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:31.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.269+0000 7f491d400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f49201045e0 0x7f492019b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47036/0 (socket says 172.21.15.3:47036) 2024-09-10T23:25:31.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.269+0000 7f491d400640 1 -- 172.21.15.3:0/4252590435 learned_addr learned my addr 172.21.15.3:0/4252590435 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:31.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.269+0000 7f491de00640 1 --2- 172.21.15.3:0/4252590435 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4920103cc0 0x7f492019b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:31.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.269+0000 7f491e800640 1 --2- 172.21.15.3:0/4252590435 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f492010d120 0x7f49201a0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:31.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.269+0000 7f491d400640 1 -- 172.21.15.3:0/4252590435 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f492010d120 msgr2=0x7f49201a0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:31.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.269+0000 7f491d400640 1 --2- 172.21.15.3:0/4252590435 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f492010d120 0x7f49201a0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.269+0000 7f491d400640 1 -- 172.21.15.3:0/4252590435 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4920103cc0 msgr2=0x7f492019b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:31.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.269+0000 7f491d400640 1 --2- 172.21.15.3:0/4252590435 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4920103cc0 0x7f492019b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.269+0000 7f491d400640 1 -- 172.21.15.3:0/4252590435 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49201a14b0 con 0x7f49201045e0 2024-09-10T23:25:31.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.269+0000 7f491e800640 1 --2- 172.21.15.3:0/4252590435 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f492010d120 0x7f49201a0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:31.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.270+0000 7f491d400640 1 --2- 172.21.15.3:0/4252590435 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f49201045e0 0x7f492019b940 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f490c00d750 tx=0x7f490c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:31.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.270+0000 7f4916a00640 1 -- 172.21.15.3:0/4252590435 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490c017070 con 0x7f49201045e0 2024-09-10T23:25:31.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.270+0000 7f4916a00640 1 -- 172.21.15.3:0/4252590435 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f490c004020 con 0x7f49201045e0 2024-09-10T23:25:31.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.270+0000 7f4925000640 1 -- 172.21.15.3:0/4252590435 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49201a17a0 con 0x7f49201045e0 2024-09-10T23:25:31.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.270+0000 7f4916a00640 1 -- 172.21.15.3:0/4252590435 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490c003ba0 con 0x7f49201045e0 2024-09-10T23:25:31.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.270+0000 7f4925000640 1 -- 172.21.15.3:0/4252590435 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49201a7e60 con 0x7f49201045e0 2024-09-10T23:25:31.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.271+0000 7f4925000640 1 -- 172.21.15.3:0/4252590435 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4920103370 con 0x7f49201045e0 2024-09-10T23:25:31.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.273+0000 7f4916a00640 1 -- 172.21.15.3:0/4252590435 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7f490c009a30 con 0x7f49201045e0 2024-09-10T23:25:31.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.275+0000 7f4916a00640 1 --2- 172.21.15.3:0/4252590435 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f49040b53c0 0x7f49040b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:31.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.275+0000 7f4916a00640 1 -- 172.21.15.3:0/4252590435 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f490c0e5f10 con 0x7f49201045e0 2024-09-10T23:25:31.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.275+0000 7f491de00640 1 --2- 172.21.15.3:0/4252590435 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f49040b53c0 0x7f49040b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:31.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.275+0000 7f4916a00640 1 --2- 172.21.15.3:0/4252590435 >> [v2:172.21.15.38:6824/1671957178,v1:172.21.15.38:6825/1671957178] conn(0x7f49040c0880 0x7f49040c2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:31.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.275+0000 7f4916a00640 1 -- 172.21.15.3:0/4252590435 --> [v2:172.21.15.38:6824/1671957178,v1:172.21.15.38:6825/1671957178] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f49040c33f0 con 0x7f49040c0880 2024-09-10T23:25:31.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.275+0000 7f4916a00640 1 -- 172.21.15.3:0/4252590435 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f490c0e62c0 con 0x7f49201045e0 2024-09-10T23:25:31.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.276+0000 7f491de00640 1 --2- 172.21.15.3:0/4252590435 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f49040b53c0 0x7f49040b7880 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4910006010 tx=0x7f4910005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:31.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.276+0000 7f491e800640 1 --2- 172.21.15.3:0/4252590435 >> [v2:172.21.15.38:6824/1671957178,v1:172.21.15.38:6825/1671957178] conn(0x7f49040c0880 0x7f49040c2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:31.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.277+0000 7f491e800640 1 --2- 172.21.15.3:0/4252590435 >> [v2:172.21.15.38:6824/1671957178,v1:172.21.15.38:6825/1671957178] conn(0x7f49040c0880 0x7f49040c2d20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:31.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.278+0000 7f4916a00640 1 -- 172.21.15.3:0/4252590435 <== osd.10 v2:172.21.15.38:6824/1671957178 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f49040c33f0 con 0x7f49040c0880 2024-09-10T23:25:31.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.292+0000 7f4925000640 1 -- 172.21.15.3:0/4252590435 --> [v2:172.21.15.38:6824/1671957178,v1:172.21.15.38:6825/1671957178] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f492006bb90 con 0x7f49040c0880 2024-09-10T23:25:31.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.292+0000 7f4916a00640 1 -- 172.21.15.3:0/4252590435 <== osd.10 v2:172.21.15.38:6824/1671957178 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f492006bb90 con 0x7f49040c0880 2024-09-10T23:25:31.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.293+0000 7f4925000640 1 -- 172.21.15.3:0/4252590435 >> [v2:172.21.15.38:6824/1671957178,v1:172.21.15.38:6825/1671957178] conn(0x7f49040c0880 msgr2=0x7f49040c2d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:31.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.293+0000 7f4925000640 1 --2- 172.21.15.3:0/4252590435 >> [v2:172.21.15.38:6824/1671957178,v1:172.21.15.38:6825/1671957178] conn(0x7f49040c0880 0x7f49040c2d20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:31.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.293+0000 7f4925000640 1 -- 172.21.15.3:0/4252590435 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f49040b53c0 msgr2=0x7f49040b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:31.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.293+0000 7f4925000640 1 --2- 172.21.15.3:0/4252590435 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f49040b53c0 0x7f49040b7880 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4910006010 tx=0x7f4910005e80 comp rx=0 tx=0).stop 2024-09-10T23:25:31.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.293+0000 7f4925000640 1 -- 172.21.15.3:0/4252590435 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f49201045e0 msgr2=0x7f492019b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:31.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.293+0000 7f4925000640 1 --2- 172.21.15.3:0/4252590435 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f49201045e0 0x7f492019b940 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f490c00d750 tx=0x7f490c00dc10 comp rx=0 tx=0).stop 2024-09-10T23:25:31.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.293+0000 7f491e800640 1 -- 172.21.15.3:0/4252590435 reap_dead start 2024-09-10T23:25:31.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.293+0000 7f4925000640 1 -- 172.21.15.3:0/4252590435 shutdown_connections 2024-09-10T23:25:31.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.293+0000 7f4925000640 1 -- 172.21.15.3:0/4252590435 >> 172.21.15.3:0/4252590435 conn(0x7f49200fd700 msgr2=0x7f49200ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:31.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.293+0000 7f4925000640 1 -- 172.21.15.3:0/4252590435 shutdown_connections 2024-09-10T23:25:31.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:29.293+0000 7f4925000640 1 -- 172.21.15.3:0/4252590435 wait complete. 2024-09-10T23:25:31.930 INFO:teuthology.orchestra.run.smithi003.stdout:60129542235 2024-09-10T23:25:31.931 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-10T23:25:32.463 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:32 smithi003 ceph-mon[30348]: pgmap v353: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-10T23:25:32.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:32 smithi038 ceph-mon[34225]: pgmap v353: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-10T23:25:32.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:32 smithi194 ceph-mon[33904]: pgmap v353: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-10T23:25:33.103 INFO:teuthology.orchestra.run.smithi003.stdout:231928234034 2024-09-10T23:25:33.104 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-10T23:25:33.444 INFO:teuthology.orchestra.run.smithi003.stdout:137438953548 2024-09-10T23:25:33.445 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-10T23:25:33.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.614+0000 7fcbac800640 1 -- 172.21.15.3:0/1605972846 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcba40776d0 msgr2=0x7fcba4077ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:33.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.614+0000 7fcbac800640 1 --2- 172.21.15.3:0/1605972846 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcba40776d0 0x7fcba4077ab0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fcb98009900 tx=0x7fcb9802a400 comp rx=0 tx=0).stop 2024-09-10T23:25:33.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.614+0000 7fcbac800640 1 -- 172.21.15.3:0/1605972846 shutdown_connections 2024-09-10T23:25:33.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.614+0000 7fcbac800640 1 --2- 172.21.15.3:0/1605972846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcba4113990 0x7fcba4115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.614+0000 7fcbac800640 1 --2- 172.21.15.3:0/1605972846 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcba4077ff0 0x7fcba4113450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.614+0000 7fcbac800640 1 --2- 172.21.15.3:0/1605972846 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcba40776d0 0x7fcba4077ab0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.614+0000 7fcbac800640 1 -- 172.21.15.3:0/1605972846 >> 172.21.15.3:0/1605972846 conn(0x7fcba4100a50 msgr2=0x7fcba4102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:33.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.614+0000 7fcbac800640 1 -- 172.21.15.3:0/1605972846 shutdown_connections 2024-09-10T23:25:33.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.614+0000 7fcbac800640 1 -- 172.21.15.3:0/1605972846 wait complete. 2024-09-10T23:25:33.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.615+0000 7fcbac800640 1 Processor -- start 2024-09-10T23:25:33.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.615+0000 7fcbac800640 1 -- start start 2024-09-10T23:25:33.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.615+0000 7fcbac800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcba40776d0 0x7fcba419f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:33.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.616+0000 7fcbac800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcba4077ff0 0x7fcba419fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:33.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.616+0000 7fcbac800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcba4113990 0x7fcba41a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:33.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.616+0000 7fcbac800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fcba4119280 con 0x7fcba4113990 2024-09-10T23:25:33.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.616+0000 7fcbac800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fcba4119100 con 0x7fcba4077ff0 2024-09-10T23:25:33.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.616+0000 7fcbac800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcba4119400 con 0x7fcba40776d0 2024-09-10T23:25:33.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.616+0000 7fcbaa800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcba4113990 0x7fcba41a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:33.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.616+0000 7fcbaa800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcba4113990 0x7fcba41a5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41522/0 (socket says 172.21.15.3:41522) 2024-09-10T23:25:33.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.616+0000 7fcbaa800640 1 -- 172.21.15.3:0/2125175248 learned_addr learned my addr 172.21.15.3:0/2125175248 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:33.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.616+0000 7fcba9400640 1 --2- 172.21.15.3:0/2125175248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcba4077ff0 0x7fcba419fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:33.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.616+0000 7fcba9e00640 1 --2- 172.21.15.3:0/2125175248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcba40776d0 0x7fcba419f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:33.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.616+0000 7fcba9400640 1 -- 172.21.15.3:0/2125175248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcba40776d0 msgr2=0x7fcba419f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:33.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.616+0000 7fcba9400640 1 --2- 172.21.15.3:0/2125175248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcba40776d0 0x7fcba419f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.616+0000 7fcba9400640 1 -- 172.21.15.3:0/2125175248 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcba4113990 msgr2=0x7fcba41a5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:33.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.616+0000 7fcba9400640 1 --2- 172.21.15.3:0/2125175248 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcba4113990 0x7fcba41a5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.616+0000 7fcba9400640 1 -- 172.21.15.3:0/2125175248 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba41a5820 con 0x7fcba4077ff0 2024-09-10T23:25:33.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.617+0000 7fcbaa800640 1 --2- 172.21.15.3:0/2125175248 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcba4113990 0x7fcba41a5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:33.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.617+0000 7fcba9400640 1 --2- 172.21.15.3:0/2125175248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcba4077ff0 0x7fcba419fcb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400d6d0 tx=0x7fcb9400db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:33.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.617+0000 7fcb9ea00640 1 -- 172.21.15.3:0/2125175248 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb94017070 con 0x7fcba4077ff0 2024-09-10T23:25:33.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.617+0000 7fcbac800640 1 -- 172.21.15.3:0/2125175248 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcba41a5b10 con 0x7fcba4077ff0 2024-09-10T23:25:33.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.617+0000 7fcb9ea00640 1 -- 172.21.15.3:0/2125175248 <== mon.2 v2:172.21.15.38:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcb94009820 con 0x7fcba4077ff0 2024-09-10T23:25:33.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.617+0000 7fcbac800640 1 -- 172.21.15.3:0/2125175248 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcba41ac3a0 con 0x7fcba4077ff0 2024-09-10T23:25:33.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.617+0000 7fcb9ea00640 1 -- 172.21.15.3:0/2125175248 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb94004b20 con 0x7fcba4077ff0 2024-09-10T23:25:33.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.618+0000 7fcbac800640 1 -- 172.21.15.3:0/2125175248 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcb88001060 con 0x7fcba4077ff0 2024-09-10T23:25:33.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.622+0000 7fcb9ea00640 1 -- 172.21.15.3:0/2125175248 <== mon.2 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7fcb94005220 con 0x7fcba4077ff0 2024-09-10T23:25:33.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.623+0000 7fcb9ea00640 1 --2- 172.21.15.3:0/2125175248 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcb8c0b5440 0x7fcb8c0b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:33.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.623+0000 7fcb9ea00640 1 -- 172.21.15.3:0/2125175248 <== mon.2 v2:172.21.15.38:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7fcb940e5f00 con 0x7fcba4077ff0 2024-09-10T23:25:33.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.623+0000 7fcba9e00640 1 --2- 172.21.15.3:0/2125175248 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcb8c0b5440 0x7fcb8c0b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:33.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.623+0000 7fcb9ea00640 1 --2- 172.21.15.3:0/2125175248 >> [v2:172.21.15.3:6802/824467747,v1:172.21.15.3:6803/824467747] conn(0x7fcb8c0c0900 0x7fcb8c0c2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:33.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.623+0000 7fcb9ea00640 1 -- 172.21.15.3:0/2125175248 --> [v2:172.21.15.3:6802/824467747,v1:172.21.15.3:6803/824467747] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcb9401ee70 con 0x7fcb8c0c0900 2024-09-10T23:25:33.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.624+0000 7fcb9ea00640 1 -- 172.21.15.3:0/2125175248 <== mon.2 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fcb940e62b0 con 0x7fcba4077ff0 2024-09-10T23:25:33.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.624+0000 7fcbaa800640 1 --2- 172.21.15.3:0/2125175248 >> [v2:172.21.15.3:6802/824467747,v1:172.21.15.3:6803/824467747] conn(0x7fcb8c0c0900 0x7fcb8c0c2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:33.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.624+0000 7fcba9e00640 1 --2- 172.21.15.3:0/2125175248 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcb8c0b5440 0x7fcb8c0b7900 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcb98006010 tx=0x7fcb98005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:33.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.625+0000 7fcbaa800640 1 --2- 172.21.15.3:0/2125175248 >> [v2:172.21.15.3:6802/824467747,v1:172.21.15.3:6803/824467747] conn(0x7fcb8c0c0900 0x7fcb8c0c2da0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:33.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.625+0000 7fcb9ea00640 1 -- 172.21.15.3:0/2125175248 <== osd.0 v2:172.21.15.3:6802/824467747 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcb9401ee70 con 0x7fcb8c0c0900 2024-09-10T23:25:33.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.645+0000 7fcbac800640 1 -- 172.21.15.3:0/2125175248 --> [v2:172.21.15.3:6802/824467747,v1:172.21.15.3:6803/824467747] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcb88002e00 con 0x7fcb8c0c0900 2024-09-10T23:25:33.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.645+0000 7fcb9ea00640 1 -- 172.21.15.3:0/2125175248 <== osd.0 v2:172.21.15.3:6802/824467747 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcb88002e00 con 0x7fcb8c0c0900 2024-09-10T23:25:33.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.646+0000 7fcbac800640 1 -- 172.21.15.3:0/2125175248 >> [v2:172.21.15.3:6802/824467747,v1:172.21.15.3:6803/824467747] conn(0x7fcb8c0c0900 msgr2=0x7fcb8c0c2da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:33.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.646+0000 7fcbac800640 1 --2- 172.21.15.3:0/2125175248 >> [v2:172.21.15.3:6802/824467747,v1:172.21.15.3:6803/824467747] conn(0x7fcb8c0c0900 0x7fcb8c0c2da0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:33.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.646+0000 7fcbac800640 1 -- 172.21.15.3:0/2125175248 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcb8c0b5440 msgr2=0x7fcb8c0b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:33.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.646+0000 7fcbac800640 1 --2- 172.21.15.3:0/2125175248 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcb8c0b5440 0x7fcb8c0b7900 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcb98006010 tx=0x7fcb98005e80 comp rx=0 tx=0).stop 2024-09-10T23:25:33.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.646+0000 7fcbac800640 1 -- 172.21.15.3:0/2125175248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcba4077ff0 msgr2=0x7fcba419fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:33.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.646+0000 7fcbac800640 1 --2- 172.21.15.3:0/2125175248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcba4077ff0 0x7fcba419fcb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400d6d0 tx=0x7fcb9400db90 comp rx=0 tx=0).stop 2024-09-10T23:25:33.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.646+0000 7fcbaa800640 1 -- 172.21.15.3:0/2125175248 reap_dead start 2024-09-10T23:25:33.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.646+0000 7fcbac800640 1 -- 172.21.15.3:0/2125175248 shutdown_connections 2024-09-10T23:25:33.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.646+0000 7fcbac800640 1 -- 172.21.15.3:0/2125175248 >> 172.21.15.3:0/2125175248 conn(0x7fcba4100a50 msgr2=0x7fcba4102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:33.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.647+0000 7fcbac800640 1 -- 172.21.15.3:0/2125175248 shutdown_connections 2024-09-10T23:25:33.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:33.647+0000 7fcbac800640 1 -- 172.21.15.3:0/2125175248 wait complete. 2024-09-10T23:25:34.083 INFO:teuthology.orchestra.run.smithi003.stdout:279172874280 2024-09-10T23:25:34.084 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-10T23:25:34.296 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:34 smithi003 ceph-mon[30348]: pgmap v354: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:25:34.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:34 smithi038 ceph-mon[34225]: pgmap v354: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:25:34.663 INFO:teuthology.orchestra.run.smithi003.stdout:206158430265 2024-09-10T23:25:34.664 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-10T23:25:34.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:34 smithi194 ceph-mon[33904]: pgmap v354: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:25:35.031 INFO:teuthology.orchestra.run.smithi003.stdout:81604378711 2024-09-10T23:25:35.031 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-10T23:25:35.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.816+0000 7f70eec00640 1 -- 172.21.15.3:0/52505563 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f70e810a9b0 msgr2=0x7f70e810adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:35.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.816+0000 7f70eec00640 1 --2- 172.21.15.3:0/52505563 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f70e810a9b0 0x7f70e810adf0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f70d0009900 tx=0x7f70d002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.816+0000 7f70eec00640 1 -- 172.21.15.3:0/52505563 shutdown_connections 2024-09-10T23:25:35.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.816+0000 7f70eec00640 1 --2- 172.21.15.3:0/52505563 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70e810b330 0x7f70e8111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.816+0000 7f70eec00640 1 --2- 172.21.15.3:0/52505563 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f70e810a9b0 0x7f70e810adf0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.816+0000 7f70eec00640 1 --2- 172.21.15.3:0/52505563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70e8104fa0 0x7f70e8105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.816+0000 7f70eec00640 1 -- 172.21.15.3:0/52505563 >> 172.21.15.3:0/52505563 conn(0x7f70e8100a50 msgr2=0x7f70e8102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:35.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.816+0000 7f70eec00640 1 -- 172.21.15.3:0/52505563 shutdown_connections 2024-09-10T23:25:35.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.816+0000 7f70eec00640 1 -- 172.21.15.3:0/52505563 wait complete. 2024-09-10T23:25:35.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.817+0000 7f70eec00640 1 Processor -- start 2024-09-10T23:25:35.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.817+0000 7f70eec00640 1 -- start start 2024-09-10T23:25:35.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.818+0000 7f70eec00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70e8104fa0 0x7f70e819b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:35.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.818+0000 7f70eec00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f70e810a9b0 0x7f70e819b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:35.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.818+0000 7f70eec00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70e810b330 0x7f70e81a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:35.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.818+0000 7f70eec00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f70e8114de0 con 0x7f70e810a9b0 2024-09-10T23:25:35.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.818+0000 7f70eec00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f70e8114c60 con 0x7f70e810b330 2024-09-10T23:25:35.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.818+0000 7f70eec00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f70e8114f60 con 0x7f70e8104fa0 2024-09-10T23:25:35.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.818+0000 7f70df400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f70e810a9b0 0x7f70e819b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:35.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.818+0000 7f70e7e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70e8104fa0 0x7f70e819b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:35.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.818+0000 7f70df400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f70e810a9b0 0x7f70e819b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41516/0 (socket says 172.21.15.3:41516) 2024-09-10T23:25:35.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.818+0000 7f70df400640 1 -- 172.21.15.3:0/3050732958 learned_addr learned my addr 172.21.15.3:0/3050732958 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:35.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.818+0000 7f70ecc00640 1 --2- 172.21.15.3:0/3050732958 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70e810b330 0x7f70e81a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:35.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.819+0000 7f70df400640 1 -- 172.21.15.3:0/3050732958 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70e8104fa0 msgr2=0x7f70e819b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:35.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.819+0000 7f70df400640 1 --2- 172.21.15.3:0/3050732958 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70e8104fa0 0x7f70e819b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.819+0000 7f70df400640 1 -- 172.21.15.3:0/3050732958 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70e810b330 msgr2=0x7f70e81a0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:35.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.819+0000 7f70df400640 1 --2- 172.21.15.3:0/3050732958 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70e810b330 0x7f70e81a0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.819+0000 7f70df400640 1 -- 172.21.15.3:0/3050732958 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e81a1460 con 0x7f70e810a9b0 2024-09-10T23:25:35.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.819+0000 7f70df400640 1 --2- 172.21.15.3:0/3050732958 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f70e810a9b0 0x7f70e819b8f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f70d0009230 tx=0x7f70d0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:35.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.820+0000 7f70e5600640 1 -- 172.21.15.3:0/3050732958 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d003f030 con 0x7f70e810a9b0 2024-09-10T23:25:35.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.820+0000 7f70e5600640 1 -- 172.21.15.3:0/3050732958 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f70d0003a80 con 0x7f70e810a9b0 2024-09-10T23:25:35.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.820+0000 7f70e5600640 1 -- 172.21.15.3:0/3050732958 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d0035070 con 0x7f70e810a9b0 2024-09-10T23:25:35.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.820+0000 7f70eec00640 1 -- 172.21.15.3:0/3050732958 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70e81a16f0 con 0x7f70e810a9b0 2024-09-10T23:25:35.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.820+0000 7f70eec00640 1 -- 172.21.15.3:0/3050732958 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70e81a7e10 con 0x7f70e810a9b0 2024-09-10T23:25:35.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.821+0000 7f70eec00640 1 -- 172.21.15.3:0/3050732958 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f70e80638e0 con 0x7f70e810a9b0 2024-09-10T23:25:35.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.824+0000 7f70e5600640 1 -- 172.21.15.3:0/3050732958 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7f70d003bc30 con 0x7f70e810a9b0 2024-09-10T23:25:35.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.825+0000 7f70e5600640 1 --2- 172.21.15.3:0/3050732958 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f70cc0b5440 0x7f70cc0b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:35.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.825+0000 7f70e5600640 1 -- 172.21.15.3:0/3050732958 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f70d0106fe0 con 0x7f70e810a9b0 2024-09-10T23:25:35.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.825+0000 7f70e7e00640 1 --2- 172.21.15.3:0/3050732958 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f70cc0b5440 0x7f70cc0b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:35.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.826+0000 7f70e5600640 1 --2- 172.21.15.3:0/3050732958 >> [v2:172.21.15.3:6826/3967749600,v1:172.21.15.3:6827/3967749600] conn(0x7f70cc0c0900 0x7f70cc0c2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:35.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.826+0000 7f70e5600640 1 -- 172.21.15.3:0/3050732958 --> [v2:172.21.15.3:6826/3967749600,v1:172.21.15.3:6827/3967749600] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f70cc0c3470 con 0x7f70cc0c0900 2024-09-10T23:25:35.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.826+0000 7f70e5600640 1 -- 172.21.15.3:0/3050732958 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f70d0107410 con 0x7f70e810a9b0 2024-09-10T23:25:35.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.826+0000 7f70ecc00640 1 --2- 172.21.15.3:0/3050732958 >> [v2:172.21.15.3:6826/3967749600,v1:172.21.15.3:6827/3967749600] conn(0x7f70cc0c0900 0x7f70cc0c2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:35.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.826+0000 7f70e7e00640 1 --2- 172.21.15.3:0/3050732958 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f70cc0b5440 0x7f70cc0b7900 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f70d800bbe0 tx=0x7f70d800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:35.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.826+0000 7f70ecc00640 1 --2- 172.21.15.3:0/3050732958 >> [v2:172.21.15.3:6826/3967749600,v1:172.21.15.3:6827/3967749600] conn(0x7f70cc0c0900 0x7f70cc0c2da0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:35.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.827+0000 7f70e5600640 1 -- 172.21.15.3:0/3050732958 <== osd.9 v2:172.21.15.3:6826/3967749600 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f70cc0c3470 con 0x7f70cc0c0900 2024-09-10T23:25:35.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.841+0000 7f70eec00640 1 -- 172.21.15.3:0/3050732958 --> [v2:172.21.15.3:6826/3967749600,v1:172.21.15.3:6827/3967749600] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f70e8063db0 con 0x7f70cc0c0900 2024-09-10T23:25:35.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.842+0000 7f70e5600640 1 -- 172.21.15.3:0/3050732958 <== osd.9 v2:172.21.15.3:6826/3967749600 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f70e8063db0 con 0x7f70cc0c0900 2024-09-10T23:25:35.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.842+0000 7f70eec00640 1 -- 172.21.15.3:0/3050732958 >> [v2:172.21.15.3:6826/3967749600,v1:172.21.15.3:6827/3967749600] conn(0x7f70cc0c0900 msgr2=0x7f70cc0c2da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:35.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.842+0000 7f70eec00640 1 --2- 172.21.15.3:0/3050732958 >> [v2:172.21.15.3:6826/3967749600,v1:172.21.15.3:6827/3967749600] conn(0x7f70cc0c0900 0x7f70cc0c2da0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:35.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.842+0000 7f70eec00640 1 -- 172.21.15.3:0/3050732958 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f70cc0b5440 msgr2=0x7f70cc0b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:35.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.842+0000 7f70eec00640 1 --2- 172.21.15.3:0/3050732958 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f70cc0b5440 0x7f70cc0b7900 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f70d800bbe0 tx=0x7f70d800b390 comp rx=0 tx=0).stop 2024-09-10T23:25:35.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.842+0000 7f70eec00640 1 -- 172.21.15.3:0/3050732958 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f70e810a9b0 msgr2=0x7f70e819b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:35.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.842+0000 7f70eec00640 1 --2- 172.21.15.3:0/3050732958 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f70e810a9b0 0x7f70e819b8f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f70d0009230 tx=0x7f70d0004270 comp rx=0 tx=0).stop 2024-09-10T23:25:35.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.843+0000 7f70ecc00640 1 -- 172.21.15.3:0/3050732958 reap_dead start 2024-09-10T23:25:35.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.843+0000 7f70eec00640 1 -- 172.21.15.3:0/3050732958 shutdown_connections 2024-09-10T23:25:35.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.843+0000 7f70eec00640 1 -- 172.21.15.3:0/3050732958 >> 172.21.15.3:0/3050732958 conn(0x7f70e8100a50 msgr2=0x7f70e8102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:35.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.843+0000 7f70eec00640 1 -- 172.21.15.3:0/3050732958 shutdown_connections 2024-09-10T23:25:35.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:32.843+0000 7f70eec00640 1 -- 172.21.15.3:0/3050732958 wait complete. 2024-09-10T23:25:35.880 INFO:teuthology.orchestra.run.smithi003.stdout:257698037806 2024-09-10T23:25:35.880 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-10T23:25:36.588 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:36 smithi003 ceph-mon[30348]: pgmap v355: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:25:36.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:36 smithi038 ceph-mon[34225]: pgmap v355: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:25:36.629 INFO:teuthology.orchestra.run.smithi003.stdout:38654705763 2024-09-10T23:25:36.630 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-10T23:25:36.676 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:36.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:36 smithi194 ceph-mon[33904]: pgmap v355: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:25:36.707 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:36.711 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:36.714 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:36.729 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:36.736 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:36.754 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:36.812 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:36.838 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:37.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.434+0000 7fa1f0e00640 1 -- 172.21.15.3:0/900740612 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa1ec102c10 msgr2=0x7fa1ec102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:37.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.434+0000 7fa1f0e00640 1 --2- 172.21.15.3:0/900740612 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa1ec102c10 0x7fa1ec102ff0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc009900 tx=0x7fa1dc02a410 comp rx=0 tx=0).stop 2024-09-10T23:25:37.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.434+0000 7fa1f0e00640 1 -- 172.21.15.3:0/900740612 shutdown_connections 2024-09-10T23:25:37.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.434+0000 7fa1f0e00640 1 --2- 172.21.15.3:0/900740612 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1ec108fa0 0x7fa1ec10f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.434+0000 7fa1f0e00640 1 --2- 172.21.15.3:0/900740612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ec108620 0x7fa1ec108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.434+0000 7fa1f0e00640 1 --2- 172.21.15.3:0/900740612 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa1ec102c10 0x7fa1ec102ff0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.434+0000 7fa1f0e00640 1 -- 172.21.15.3:0/900740612 >> 172.21.15.3:0/900740612 conn(0x7fa1ec0fe660 msgr2=0x7fa1ec100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:37.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.435+0000 7fa1f0e00640 1 -- 172.21.15.3:0/900740612 shutdown_connections 2024-09-10T23:25:37.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.435+0000 7fa1f0e00640 1 -- 172.21.15.3:0/900740612 wait complete. 2024-09-10T23:25:37.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.436+0000 7fa1f0e00640 1 Processor -- start 2024-09-10T23:25:37.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.436+0000 7fa1f0e00640 1 -- start start 2024-09-10T23:25:37.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.437+0000 7fa1f0e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ec102c10 0x7fa1ec0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:37.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.437+0000 7fa1f0e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1ec108620 0x7fa1ec0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:37.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.437+0000 7fa1f0e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa1ec108fa0 0x7fa1ec075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:37.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.437+0000 7fa1f0e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ec112b60 con 0x7fa1ec108fa0 2024-09-10T23:25:37.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.437+0000 7fa1f0e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ec1129e0 con 0x7fa1ec108620 2024-09-10T23:25:37.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.437+0000 7fa1f0e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ec112ce0 con 0x7fa1ec102c10 2024-09-10T23:25:37.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.437+0000 7fa1ebe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa1ec108fa0 0x7fa1ec075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:37.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.437+0000 7fa1ebe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa1ec108fa0 0x7fa1ec075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41538/0 (socket says 172.21.15.3:41538) 2024-09-10T23:25:37.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.437+0000 7fa1ebe00640 1 -- 172.21.15.3:0/2314118600 learned_addr learned my addr 172.21.15.3:0/2314118600 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:37.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.437+0000 7fa1eaa00640 1 --2- 172.21.15.3:0/2314118600 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1ec108620 0x7fa1ec0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:37.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.437+0000 7fa1eb400640 1 --2- 172.21.15.3:0/2314118600 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ec102c10 0x7fa1ec0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:37.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.437+0000 7fa1ebe00640 1 -- 172.21.15.3:0/2314118600 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ec102c10 msgr2=0x7fa1ec0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:37.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.438+0000 7fa1ebe00640 1 --2- 172.21.15.3:0/2314118600 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ec102c10 0x7fa1ec0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.438+0000 7fa1ebe00640 1 -- 172.21.15.3:0/2314118600 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1ec108620 msgr2=0x7fa1ec0759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:37.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.438+0000 7fa1ebe00640 1 --2- 172.21.15.3:0/2314118600 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1ec108620 0x7fa1ec0759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.438+0000 7fa1ebe00640 1 -- 172.21.15.3:0/2314118600 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1ec1a73d0 con 0x7fa1ec108fa0 2024-09-10T23:25:37.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.438+0000 7fa1ebe00640 1 --2- 172.21.15.3:0/2314118600 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa1ec108fa0 0x7fa1ec075f20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa1e400eaa0 tx=0x7fa1e400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:37.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.438+0000 7fa1e3e00640 1 -- 172.21.15.3:0/2314118600 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e400cdb0 con 0x7fa1ec108fa0 2024-09-10T23:25:37.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.438+0000 7fa1f0e00640 1 -- 172.21.15.3:0/2314118600 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1ec1a76c0 con 0x7fa1ec108fa0 2024-09-10T23:25:37.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.438+0000 7fa1e3e00640 1 -- 172.21.15.3:0/2314118600 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1e4005020 con 0x7fa1ec108fa0 2024-09-10T23:25:37.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.438+0000 7fa1e3e00640 1 -- 172.21.15.3:0/2314118600 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e40116d0 con 0x7fa1ec108fa0 2024-09-10T23:25:37.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.438+0000 7fa1f0e00640 1 -- 172.21.15.3:0/2314118600 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1ec1a7c00 con 0x7fa1ec108fa0 2024-09-10T23:25:37.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.439+0000 7fa1f0e00640 1 -- 172.21.15.3:0/2314118600 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1ec102ff0 con 0x7fa1ec108fa0 2024-09-10T23:25:37.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.442+0000 7fa1e3e00640 1 -- 172.21.15.3:0/2314118600 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7fa1e4022060 con 0x7fa1ec108fa0 2024-09-10T23:25:37.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.443+0000 7fa1e3e00640 1 --2- 172.21.15.3:0/2314118600 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fa1d00b54e0 0x7fa1d00b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:37.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.443+0000 7fa1e3e00640 1 -- 172.21.15.3:0/2314118600 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7fa1e40e60a0 con 0x7fa1ec108fa0 2024-09-10T23:25:37.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.444+0000 7fa1eb400640 1 --2- 172.21.15.3:0/2314118600 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fa1d00b54e0 0x7fa1d00b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:37.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.444+0000 7fa1eb400640 1 --2- 172.21.15.3:0/2314118600 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fa1d00b54e0 0x7fa1d00b79a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc006010 tx=0x7fa1dc005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:37.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.445+0000 7fa1e3e00640 1 -- 172.21.15.3:0/2314118600 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa1e4016030 con 0x7fa1ec108fa0 2024-09-10T23:25:37.569 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:37.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.661+0000 7fa1f0e00640 1 -- 172.21.15.3:0/2314118600 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fa1ec1a7fd0 con 0x7fa1ec108fa0 2024-09-10T23:25:37.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.661+0000 7fa1e3e00640 1 -- 172.21.15.3:0/2314118600 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fa1e40ac340 con 0x7fa1ec108fa0 2024-09-10T23:25:37.663 INFO:teuthology.orchestra.run.smithi003.stdout:304942678052 2024-09-10T23:25:37.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.664+0000 7fa1f0e00640 1 -- 172.21.15.3:0/2314118600 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fa1d00b54e0 msgr2=0x7fa1d00b79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:37.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.664+0000 7fa1f0e00640 1 --2- 172.21.15.3:0/2314118600 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fa1d00b54e0 0x7fa1d00b79a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc006010 tx=0x7fa1dc005e80 comp rx=0 tx=0).stop 2024-09-10T23:25:37.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.664+0000 7fa1f0e00640 1 -- 172.21.15.3:0/2314118600 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa1ec108fa0 msgr2=0x7fa1ec075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:37.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.664+0000 7fa1f0e00640 1 --2- 172.21.15.3:0/2314118600 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa1ec108fa0 0x7fa1ec075f20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa1e400eaa0 tx=0x7fa1e400ef60 comp rx=0 tx=0).stop 2024-09-10T23:25:37.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.664+0000 7fa1f0e00640 1 -- 172.21.15.3:0/2314118600 shutdown_connections 2024-09-10T23:25:37.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.664+0000 7fa1f0e00640 1 --2- 172.21.15.3:0/2314118600 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fa1d00b54e0 0x7fa1d00b79a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.664+0000 7fa1f0e00640 1 --2- 172.21.15.3:0/2314118600 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa1ec108fa0 0x7fa1ec075f20 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.664+0000 7fa1f0e00640 1 --2- 172.21.15.3:0/2314118600 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1ec108620 0x7fa1ec0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.664+0000 7fa1f0e00640 1 --2- 172.21.15.3:0/2314118600 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ec102c10 0x7fa1ec0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:37.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.664+0000 7fa1f0e00640 1 -- 172.21.15.3:0/2314118600 >> 172.21.15.3:0/2314118600 conn(0x7fa1ec0fe660 msgr2=0x7fa1ec100a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:37.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.664+0000 7fa1f0e00640 1 -- 172.21.15.3:0/2314118600 shutdown_connections 2024-09-10T23:25:37.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:37.664+0000 7fa1f0e00640 1 -- 172.21.15.3:0/2314118600 wait complete. 2024-09-10T23:25:38.490 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:38 smithi003 ceph-mon[30348]: pgmap v356: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:25:38.490 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:38 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2314118600' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-10T23:25:38.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:38 smithi038 ceph-mon[34225]: pgmap v356: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:25:38.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:38 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2314118600' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-10T23:25:38.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.486+0000 7f0ec6800640 1 -- 172.21.15.3:0/1705702302 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ec010a9b0 msgr2=0x7f0ec010adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:38.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.486+0000 7f0ec6800640 1 --2- 172.21.15.3:0/1705702302 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ec010a9b0 0x7f0ec010adf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0eac009900 tx=0x7f0eac02a400 comp rx=0 tx=0).stop 2024-09-10T23:25:38.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.486+0000 7f0ec6800640 1 -- 172.21.15.3:0/1705702302 shutdown_connections 2024-09-10T23:25:38.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.486+0000 7f0ec6800640 1 --2- 172.21.15.3:0/1705702302 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ec010b330 0x7f0ec0111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.486+0000 7f0ec6800640 1 --2- 172.21.15.3:0/1705702302 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ec010a9b0 0x7f0ec010adf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.486+0000 7f0ec6800640 1 --2- 172.21.15.3:0/1705702302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ec0104fa0 0x7f0ec0105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.486+0000 7f0ec6800640 1 -- 172.21.15.3:0/1705702302 >> 172.21.15.3:0/1705702302 conn(0x7f0ec0100a50 msgr2=0x7f0ec0102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:38.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.486+0000 7f0ec6800640 1 -- 172.21.15.3:0/1705702302 shutdown_connections 2024-09-10T23:25:38.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.486+0000 7f0ec6800640 1 -- 172.21.15.3:0/1705702302 wait complete. 2024-09-10T23:25:38.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.487+0000 7f0ec6800640 1 Processor -- start 2024-09-10T23:25:38.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.487+0000 7f0ec6800640 1 -- start start 2024-09-10T23:25:38.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.487+0000 7f0ec6800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ec0104fa0 0x7f0ec019b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:38.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.487+0000 7f0ec6800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ec010a9b0 0x7f0ec019b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:38.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.487+0000 7f0ec6800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ec010b330 0x7f0ec01a0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:38.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.488+0000 7f0ec6800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec0114e30 con 0x7f0ec0104fa0 2024-09-10T23:25:38.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.488+0000 7f0ec6800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec0114cb0 con 0x7f0ec010b330 2024-09-10T23:25:38.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.488+0000 7f0ec6800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec0114fb0 con 0x7f0ec010a9b0 2024-09-10T23:25:38.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.488+0000 7f0ebf400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ec0104fa0 0x7f0ec019b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:38.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.488+0000 7f0ebf400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ec0104fa0 0x7f0ec019b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41558/0 (socket says 172.21.15.3:41558) 2024-09-10T23:25:38.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.488+0000 7f0ebf400640 1 -- 172.21.15.3:0/4113433304 learned_addr learned my addr 172.21.15.3:0/4113433304 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:38.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.488+0000 7f0ebfe00640 1 --2- 172.21.15.3:0/4113433304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ec010b330 0x7f0ec01a0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:38.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.488+0000 7f0ebea00640 1 --2- 172.21.15.3:0/4113433304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ec010a9b0 0x7f0ec019b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:38.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.488+0000 7f0ebf400640 1 -- 172.21.15.3:0/4113433304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ec010a9b0 msgr2=0x7f0ec019b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:38.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.488+0000 7f0ebf400640 1 --2- 172.21.15.3:0/4113433304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ec010a9b0 0x7f0ec019b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.488+0000 7f0ebf400640 1 -- 172.21.15.3:0/4113433304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ec010b330 msgr2=0x7f0ec01a0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:38.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.488+0000 7f0ebf400640 1 --2- 172.21.15.3:0/4113433304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ec010b330 0x7f0ec01a0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.488+0000 7f0ebf400640 1 -- 172.21.15.3:0/4113433304 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ec01a1490 con 0x7f0ec0104fa0 2024-09-10T23:25:38.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.488+0000 7f0ebea00640 1 --2- 172.21.15.3:0/4113433304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ec010a9b0 0x7f0ec019b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:38.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.489+0000 7f0ebf400640 1 --2- 172.21.15.3:0/4113433304 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ec0104fa0 0x7f0ec019b3e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0eb000ea60 tx=0x7f0eb000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:38.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.489+0000 7f0eb7e00640 1 -- 172.21.15.3:0/4113433304 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb000cd20 con 0x7f0ec0104fa0 2024-09-10T23:25:38.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.489+0000 7f0eb7e00640 1 -- 172.21.15.3:0/4113433304 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0eb00035f0 con 0x7f0ec0104fa0 2024-09-10T23:25:38.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.489+0000 7f0ec6800640 1 -- 172.21.15.3:0/4113433304 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ec01a1780 con 0x7f0ec0104fa0 2024-09-10T23:25:38.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.489+0000 7f0eb7e00640 1 -- 172.21.15.3:0/4113433304 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0010690 con 0x7f0ec0104fa0 2024-09-10T23:25:38.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.490+0000 7f0ec6800640 1 -- 172.21.15.3:0/4113433304 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ec01a7e40 con 0x7f0ec0104fa0 2024-09-10T23:25:38.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.491+0000 7f0ec6800640 1 -- 172.21.15.3:0/4113433304 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ec0105380 con 0x7f0ec0104fa0 2024-09-10T23:25:38.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.495+0000 7f0eb7e00640 1 -- 172.21.15.3:0/4113433304 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7f0eb0004000 con 0x7f0ec0104fa0 2024-09-10T23:25:38.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.496+0000 7f0eb7e00640 1 --2- 172.21.15.3:0/4113433304 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0ea40b53c0 0x7f0ea40b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:38.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.496+0000 7f0eb7e00640 1 -- 172.21.15.3:0/4113433304 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f0eb00e6610 con 0x7f0ec0104fa0 2024-09-10T23:25:38.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.497+0000 7f0ebea00640 1 --2- 172.21.15.3:0/4113433304 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0ea40b53c0 0x7f0ea40b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:38.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.497+0000 7f0ebea00640 1 --2- 172.21.15.3:0/4113433304 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0ea40b53c0 0x7f0ea40b7880 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0eac006010 tx=0x7f0eac005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:38.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.500+0000 7f0eb7e00640 1 -- 172.21.15.3:0/4113433304 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0eb00ace80 con 0x7f0ec0104fa0 2024-09-10T23:25:38.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:38 smithi194 ceph-mon[33904]: pgmap v356: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:25:38.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:38 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2314118600' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-10T23:25:38.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.718+0000 7f0ec6800640 1 -- 172.21.15.3:0/4113433304 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f0ec002e5c0 con 0x7f0ec0104fa0 2024-09-10T23:25:38.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.719+0000 7f0eb7e00640 1 -- 172.21.15.3:0/4113433304 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f0eb00ac780 con 0x7f0ec0104fa0 2024-09-10T23:25:38.720 INFO:teuthology.orchestra.run.smithi003.stdout:184683593793 2024-09-10T23:25:38.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.721+0000 7f0ec6800640 1 -- 172.21.15.3:0/4113433304 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0ea40b53c0 msgr2=0x7f0ea40b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:38.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.721+0000 7f0ec6800640 1 --2- 172.21.15.3:0/4113433304 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0ea40b53c0 0x7f0ea40b7880 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0eac006010 tx=0x7f0eac005a20 comp rx=0 tx=0).stop 2024-09-10T23:25:38.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.721+0000 7f0ec6800640 1 -- 172.21.15.3:0/4113433304 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ec0104fa0 msgr2=0x7f0ec019b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:38.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.721+0000 7f0ec6800640 1 --2- 172.21.15.3:0/4113433304 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ec0104fa0 0x7f0ec019b3e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0eb000ea60 tx=0x7f0eb000ee60 comp rx=0 tx=0).stop 2024-09-10T23:25:38.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.721+0000 7f0ec6800640 1 -- 172.21.15.3:0/4113433304 shutdown_connections 2024-09-10T23:25:38.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.721+0000 7f0ec6800640 1 --2- 172.21.15.3:0/4113433304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ec010b330 0x7f0ec01a0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.721+0000 7f0ec6800640 1 --2- 172.21.15.3:0/4113433304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ec010a9b0 0x7f0ec019b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.721+0000 7f0ec6800640 1 --2- 172.21.15.3:0/4113433304 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0ea40b53c0 0x7f0ea40b7880 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.721+0000 7f0ec6800640 1 --2- 172.21.15.3:0/4113433304 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ec0104fa0 0x7f0ec019b3e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:38.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.721+0000 7f0ec6800640 1 -- 172.21.15.3:0/4113433304 >> 172.21.15.3:0/4113433304 conn(0x7f0ec0100a50 msgr2=0x7f0ec0102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:38.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.721+0000 7f0ec6800640 1 -- 172.21.15.3:0/4113433304 shutdown_connections 2024-09-10T23:25:38.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.721+0000 7f0ec6800640 1 -- 172.21.15.3:0/4113433304 wait complete. 2024-09-10T23:25:39.439 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:39 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/4113433304' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-10T23:25:39.439 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:39 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2049907980' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-10T23:25:39.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.597+0000 7f6fa3200640 1 -- 172.21.15.3:0/1165098198 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6fa4075e00 msgr2=0x7f6fa410ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:39.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.597+0000 7f6fa3200640 1 --2- 172.21.15.3:0/1165098198 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6fa4075e00 0x7f6fa410ecc0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c009900 tx=0x7f6f8c02a3f0 comp rx=0 tx=0).stop 2024-09-10T23:25:39.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.598+0000 7f6fa3200640 1 -- 172.21.15.3:0/1165098198 shutdown_connections 2024-09-10T23:25:39.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.598+0000 7f6fa3200640 1 --2- 172.21.15.3:0/1165098198 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fa410f200 0x7f6fa41115f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:39.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.598+0000 7f6fa3200640 1 --2- 172.21.15.3:0/1165098198 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6fa4075e00 0x7f6fa410ecc0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:39.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.598+0000 7f6fa3200640 1 --2- 172.21.15.3:0/1165098198 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fa40754e0 0x7f6fa40758c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:39.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.598+0000 7f6fa3200640 1 -- 172.21.15.3:0/1165098198 >> 172.21.15.3:0/1165098198 conn(0x7f6fa40fe660 msgr2=0x7f6fa4100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:39.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.598+0000 7f6fa3200640 1 -- 172.21.15.3:0/1165098198 shutdown_connections 2024-09-10T23:25:39.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.598+0000 7f6fa3200640 1 -- 172.21.15.3:0/1165098198 wait complete. 2024-09-10T23:25:39.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.598+0000 7f6fa3200640 1 Processor -- start 2024-09-10T23:25:39.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.599+0000 7f6fa3200640 1 -- start start 2024-09-10T23:25:39.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.599+0000 7f6fa3200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fa40754e0 0x7f6fa419b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:39.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.599+0000 7f6fa3200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6fa4075e00 0x7f6fa419b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:39.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.599+0000 7f6fa3200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fa410f200 0x7f6fa41a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:39.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.599+0000 7f6fa3200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa4114ce0 con 0x7f6fa4075e00 2024-09-10T23:25:39.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.599+0000 7f6fa3200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa4114b60 con 0x7f6fa40754e0 2024-09-10T23:25:39.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.599+0000 7f6fa3200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa4114e60 con 0x7f6fa410f200 2024-09-10T23:25:39.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.599+0000 7f6f9be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6fa4075e00 0x7f6fa419b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:39.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.599+0000 7f6f9be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6fa4075e00 0x7f6fa419b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41576/0 (socket says 172.21.15.3:41576) 2024-09-10T23:25:39.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.599+0000 7f6f9be00640 1 -- 172.21.15.3:0/2049907980 learned_addr learned my addr 172.21.15.3:0/2049907980 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:39.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.599+0000 7f6fa1e00640 1 --2- 172.21.15.3:0/2049907980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fa40754e0 0x7f6fa419b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:39.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.599+0000 7f6fa2800640 1 --2- 172.21.15.3:0/2049907980 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fa410f200 0x7f6fa41a0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:39.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.600+0000 7f6f9be00640 1 -- 172.21.15.3:0/2049907980 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fa410f200 msgr2=0x7f6fa41a0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:39.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.600+0000 7f6f9be00640 1 --2- 172.21.15.3:0/2049907980 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fa410f200 0x7f6fa41a0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:39.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.600+0000 7f6f9be00640 1 -- 172.21.15.3:0/2049907980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fa40754e0 msgr2=0x7f6fa419b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:39.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.600+0000 7f6f9be00640 1 --2- 172.21.15.3:0/2049907980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fa40754e0 0x7f6fa419b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:39.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.600+0000 7f6f9be00640 1 -- 172.21.15.3:0/2049907980 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa41a1260 con 0x7f6fa4075e00 2024-09-10T23:25:39.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.600+0000 7f6f9be00640 1 --2- 172.21.15.3:0/2049907980 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6fa4075e00 0x7f6fa419b6f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c02a910 tx=0x7f6f8c003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:39.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.600+0000 7f6f9aa00640 1 -- 172.21.15.3:0/2049907980 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c03f070 con 0x7f6fa4075e00 2024-09-10T23:25:39.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.600+0000 7f6f9aa00640 1 -- 172.21.15.3:0/2049907980 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6f8c03baf0 con 0x7f6fa4075e00 2024-09-10T23:25:39.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.600+0000 7f6f9aa00640 1 -- 172.21.15.3:0/2049907980 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c035030 con 0x7f6fa4075e00 2024-09-10T23:25:39.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.600+0000 7f6fa3200640 1 -- 172.21.15.3:0/2049907980 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fa41a14f0 con 0x7f6fa4075e00 2024-09-10T23:25:39.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.601+0000 7f6fa3200640 1 -- 172.21.15.3:0/2049907980 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fa41a7c10 con 0x7f6fa4075e00 2024-09-10T23:25:39.527 INFO:teuthology.orchestra.run.smithi003.stdout:158913790023 2024-09-10T23:25:39.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.602+0000 7f6fa3200640 1 -- 172.21.15.3:0/2049907980 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fa40758c0 con 0x7f6fa4075e00 2024-09-10T23:25:39.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.604+0000 7f6f9aa00640 1 -- 172.21.15.3:0/2049907980 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7f6f8c03b660 con 0x7f6fa4075e00 2024-09-10T23:25:39.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.606+0000 7f6f9aa00640 1 --2- 172.21.15.3:0/2049907980 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f6f880b54e0 0x7f6f880b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:39.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.606+0000 7f6f9aa00640 1 -- 172.21.15.3:0/2049907980 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f6f8c106b20 con 0x7f6fa4075e00 2024-09-10T23:25:39.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.606+0000 7f6fa1e00640 1 --2- 172.21.15.3:0/2049907980 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f6f880b54e0 0x7f6f880b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:39.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.607+0000 7f6fa1e00640 1 --2- 172.21.15.3:0/2049907980 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f6f880b54e0 0x7f6f880b79a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6f94009bd0 tx=0x7f6f94005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:39.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.613+0000 7f6f9aa00640 1 -- 172.21.15.3:0/2049907980 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6f8c0cd3f0 con 0x7f6fa4075e00 2024-09-10T23:25:39.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.819+0000 7f6fa3200640 1 -- 172.21.15.3:0/2049907980 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f6fa41a7e70 con 0x7f6fa4075e00 2024-09-10T23:25:39.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.819+0000 7f6f9aa00640 1 -- 172.21.15.3:0/2049907980 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6f8c0cccf0 con 0x7f6fa4075e00 2024-09-10T23:25:39.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.821+0000 7f6fa3200640 1 -- 172.21.15.3:0/2049907980 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f6f880b54e0 msgr2=0x7f6f880b79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:39.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.821+0000 7f6fa3200640 1 --2- 172.21.15.3:0/2049907980 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f6f880b54e0 0x7f6f880b79a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6f94009bd0 tx=0x7f6f94005f90 comp rx=0 tx=0).stop 2024-09-10T23:25:39.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.821+0000 7f6fa3200640 1 -- 172.21.15.3:0/2049907980 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6fa4075e00 msgr2=0x7f6fa419b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:39.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.821+0000 7f6fa3200640 1 --2- 172.21.15.3:0/2049907980 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6fa4075e00 0x7f6fa419b6f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c02a910 tx=0x7f6f8c003b90 comp rx=0 tx=0).stop 2024-09-10T23:25:39.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.821+0000 7f6fa3200640 1 -- 172.21.15.3:0/2049907980 shutdown_connections 2024-09-10T23:25:39.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.821+0000 7f6fa3200640 1 --2- 172.21.15.3:0/2049907980 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fa410f200 0x7f6fa41a0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:39.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.821+0000 7f6fa3200640 1 --2- 172.21.15.3:0/2049907980 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f6f880b54e0 0x7f6f880b79a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:39.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.821+0000 7f6fa3200640 1 --2- 172.21.15.3:0/2049907980 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6fa4075e00 0x7f6fa419b6f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:39.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.821+0000 7f6fa3200640 1 --2- 172.21.15.3:0/2049907980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fa40754e0 0x7f6fa419b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:39.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.822+0000 7f6fa3200640 1 -- 172.21.15.3:0/2049907980 >> 172.21.15.3:0/2049907980 conn(0x7f6fa40fe660 msgr2=0x7f6fa41113d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:39.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.822+0000 7f6fa3200640 1 -- 172.21.15.3:0/2049907980 shutdown_connections 2024-09-10T23:25:39.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:38.822+0000 7f6fa3200640 1 -- 172.21.15.3:0/2049907980 wait complete. 2024-09-10T23:25:39.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:39 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/4113433304' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-10T23:25:39.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:39 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2049907980' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-10T23:25:39.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:39 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/4113433304' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-10T23:25:39.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:39 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2049907980' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-10T23:25:39.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.931+0000 7f1b7a800640 1 -- 172.21.15.3:0/2405182124 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b7410b320 msgr2=0x7f1b74111b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:39.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.931+0000 7f1b7a800640 1 --2- 172.21.15.3:0/2405182124 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b7410b320 0x7f1b74111b20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c009ca0 tx=0x7f1b6c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:25:39.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.931+0000 7f1b7a800640 1 -- 172.21.15.3:0/2405182124 shutdown_connections 2024-09-10T23:25:39.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.931+0000 7f1b7a800640 1 --2- 172.21.15.3:0/2405182124 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b7410b320 0x7f1b74111b20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:39.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.931+0000 7f1b7a800640 1 --2- 172.21.15.3:0/2405182124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b7410a9a0 0x7f1b7410ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:39.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.931+0000 7f1b7a800640 1 --2- 172.21.15.3:0/2405182124 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b74104f90 0x7f1b74105370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:39.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.931+0000 7f1b7a800640 1 -- 172.21.15.3:0/2405182124 >> 172.21.15.3:0/2405182124 conn(0x7f1b74100a00 msgr2=0x7f1b74102e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:39.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.932+0000 7f1b7a800640 1 -- 172.21.15.3:0/2405182124 shutdown_connections 2024-09-10T23:25:39.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.932+0000 7f1b7a800640 1 -- 172.21.15.3:0/2405182124 wait complete. 2024-09-10T23:25:39.936 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.933+0000 7f1b7a800640 1 Processor -- start 2024-09-10T23:25:39.936 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.933+0000 7f1b7a800640 1 -- start start 2024-09-10T23:25:39.936 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.933+0000 7f1b7a800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b74104f90 0x7f1b7419b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:39.936 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.933+0000 7f1b7a800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b7410a9a0 0x7f1b7419b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:39.936 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.933+0000 7f1b7a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b7410b320 0x7f1b741a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:39.936 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.933+0000 7f1b7a800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1b74114e50 con 0x7f1b7410a9a0 2024-09-10T23:25:39.936 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.933+0000 7f1b7a800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f1b74114cd0 con 0x7f1b74104f90 2024-09-10T23:25:39.936 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.933+0000 7f1b7a800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1b74114fd0 con 0x7f1b7410b320 2024-09-10T23:25:39.936 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.933+0000 7f1b6aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b7410a9a0 0x7f1b7419b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:39.936 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.933+0000 7f1b6aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b7410a9a0 0x7f1b7419b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41594/0 (socket says 172.21.15.3:41594) 2024-09-10T23:25:39.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.933+0000 7f1b6aa00640 1 -- 172.21.15.3:0/352788294 learned_addr learned my addr 172.21.15.3:0/352788294 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:39.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.934+0000 7f1b73400640 1 --2- 172.21.15.3:0/352788294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b74104f90 0x7f1b7419b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:39.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.934+0000 7f1b73e00640 1 --2- 172.21.15.3:0/352788294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b7410b320 0x7f1b741a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:39.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.934+0000 7f1b6aa00640 1 -- 172.21.15.3:0/352788294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b7410b320 msgr2=0x7f1b741a0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:39.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.934+0000 7f1b6aa00640 1 --2- 172.21.15.3:0/352788294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b7410b320 0x7f1b741a0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:39.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.934+0000 7f1b6aa00640 1 -- 172.21.15.3:0/352788294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b74104f90 msgr2=0x7f1b7419b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:39.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.934+0000 7f1b6aa00640 1 --2- 172.21.15.3:0/352788294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b74104f90 0x7f1b7419b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:39.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.934+0000 7f1b6aa00640 1 -- 172.21.15.3:0/352788294 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b741a1410 con 0x7f1b7410a9a0 2024-09-10T23:25:39.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.934+0000 7f1b6aa00640 1 --2- 172.21.15.3:0/352788294 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b7410a9a0 0x7f1b7419b8a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00d950 tx=0x7f1b5c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:39.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.935+0000 7f1b70c00640 1 -- 172.21.15.3:0/352788294 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c017070 con 0x7f1b7410a9a0 2024-09-10T23:25:39.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.935+0000 7f1b70c00640 1 -- 172.21.15.3:0/352788294 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b5c009c30 con 0x7f1b7410a9a0 2024-09-10T23:25:39.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.935+0000 7f1b7a800640 1 -- 172.21.15.3:0/352788294 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b741a1700 con 0x7f1b7410a9a0 2024-09-10T23:25:39.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.935+0000 7f1b70c00640 1 -- 172.21.15.3:0/352788294 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c00f620 con 0x7f1b7410a9a0 2024-09-10T23:25:39.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.935+0000 7f1b7a800640 1 -- 172.21.15.3:0/352788294 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b741a7dc0 con 0x7f1b7410a9a0 2024-09-10T23:25:39.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.936+0000 7f1b7a800640 1 -- 172.21.15.3:0/352788294 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b74105370 con 0x7f1b7410a9a0 2024-09-10T23:25:39.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.940+0000 7f1b70c00640 1 -- 172.21.15.3:0/352788294 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7f1b5c005070 con 0x7f1b7410a9a0 2024-09-10T23:25:39.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.942+0000 7f1b70c00640 1 --2- 172.21.15.3:0/352788294 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f1b580b53c0 0x7f1b580b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:39.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.942+0000 7f1b70c00640 1 -- 172.21.15.3:0/352788294 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f1b5c0e57e0 con 0x7f1b7410a9a0 2024-09-10T23:25:39.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.942+0000 7f1b73400640 1 --2- 172.21.15.3:0/352788294 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f1b580b53c0 0x7f1b580b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:39.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.943+0000 7f1b73400640 1 --2- 172.21.15.3:0/352788294 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f1b580b53c0 0x7f1b580b7880 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1b64005d00 tx=0x7f1b6400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:39.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:39.946+0000 7f1b70c00640 1 -- 172.21.15.3:0/352788294 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1b5c0ac050 con 0x7f1b7410a9a0 2024-09-10T23:25:40.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.147+0000 7f1b7a800640 1 -- 172.21.15.3:0/352788294 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f1b7410d100 con 0x7f1b7410a9a0 2024-09-10T23:25:40.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.148+0000 7f1b70c00640 1 -- 172.21.15.3:0/352788294 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f1b5c009de0 con 0x7f1b7410a9a0 2024-09-10T23:25:40.149 INFO:teuthology.orchestra.run.smithi003.stdout:231928234037 2024-09-10T23:25:40.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.151+0000 7f1b7a800640 1 -- 172.21.15.3:0/352788294 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f1b580b53c0 msgr2=0x7f1b580b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:40.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.151+0000 7f1b7a800640 1 --2- 172.21.15.3:0/352788294 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f1b580b53c0 0x7f1b580b7880 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1b64005d00 tx=0x7f1b6400b410 comp rx=0 tx=0).stop 2024-09-10T23:25:40.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.151+0000 7f1b7a800640 1 -- 172.21.15.3:0/352788294 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b7410a9a0 msgr2=0x7f1b7419b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:40.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.151+0000 7f1b7a800640 1 --2- 172.21.15.3:0/352788294 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b7410a9a0 0x7f1b7419b8a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00d950 tx=0x7f1b5c00de10 comp rx=0 tx=0).stop 2024-09-10T23:25:40.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.151+0000 7f1b7a800640 1 -- 172.21.15.3:0/352788294 shutdown_connections 2024-09-10T23:25:40.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.151+0000 7f1b7a800640 1 --2- 172.21.15.3:0/352788294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b7410b320 0x7f1b741a0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:40.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.151+0000 7f1b7a800640 1 --2- 172.21.15.3:0/352788294 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f1b580b53c0 0x7f1b580b7880 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:40.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.151+0000 7f1b7a800640 1 --2- 172.21.15.3:0/352788294 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b7410a9a0 0x7f1b7419b8a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:40.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.151+0000 7f1b7a800640 1 --2- 172.21.15.3:0/352788294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b74104f90 0x7f1b7419b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:40.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.151+0000 7f1b7a800640 1 -- 172.21.15.3:0/352788294 >> 172.21.15.3:0/352788294 conn(0x7f1b74100a00 msgr2=0x7f1b74102df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:40.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.151+0000 7f1b7a800640 1 -- 172.21.15.3:0/352788294 shutdown_connections 2024-09-10T23:25:40.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.151+0000 7f1b7a800640 1 -- 172.21.15.3:0/352788294 wait complete. 2024-09-10T23:25:40.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:40 smithi003 ceph-mon[30348]: pgmap v357: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:25:40.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:40 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/352788294' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-10T23:25:40.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:40 smithi038 ceph-mon[34225]: pgmap v357: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:25:40.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:40 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/352788294' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-10T23:25:40.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:40 smithi194 ceph-mon[33904]: pgmap v357: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:25:40.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:40 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/352788294' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-10T23:25:41.101 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.075+0000 7fe68ce00640 1 -- 172.21.15.3:0/3978942296 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe688103cc0 msgr2=0x7fe6881040a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:41.101 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.075+0000 7fe68ce00640 1 --2- 172.21.15.3:0/3978942296 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe688103cc0 0x7fe6881040a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe678009900 tx=0x7fe67802a410 comp rx=0 tx=0).stop 2024-09-10T23:25:41.101 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.075+0000 7fe68ce00640 1 -- 172.21.15.3:0/3978942296 shutdown_connections 2024-09-10T23:25:41.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.075+0000 7fe68ce00640 1 --2- 172.21.15.3:0/3978942296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe68810d120 0x7fe68810f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:41.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.075+0000 7fe68ce00640 1 --2- 172.21.15.3:0/3978942296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6881045e0 0x7fe68810cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:41.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.075+0000 7fe68ce00640 1 --2- 172.21.15.3:0/3978942296 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe688103cc0 0x7fe6881040a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:41.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.075+0000 7fe68ce00640 1 -- 172.21.15.3:0/3978942296 >> 172.21.15.3:0/3978942296 conn(0x7fe6880fd700 msgr2=0x7fe6880ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:41.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.075+0000 7fe68ce00640 1 -- 172.21.15.3:0/3978942296 shutdown_connections 2024-09-10T23:25:41.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.075+0000 7fe68ce00640 1 -- 172.21.15.3:0/3978942296 wait complete. 2024-09-10T23:25:41.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.077+0000 7fe68ce00640 1 Processor -- start 2024-09-10T23:25:41.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.077+0000 7fe68ce00640 1 -- start start 2024-09-10T23:25:41.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.077+0000 7fe68ce00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe688103cc0 0x7fe6881991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:41.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.077+0000 7fe68ce00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6881045e0 0x7fe688199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:41.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.077+0000 7fe68ce00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe68810d120 0x7fe68819eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:41.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.077+0000 7fe68ce00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe688112c40 con 0x7fe688103cc0 2024-09-10T23:25:41.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.077+0000 7fe68ce00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe688112ac0 con 0x7fe68810d120 2024-09-10T23:25:41.104 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.077+0000 7fe68ce00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe688112dc0 con 0x7fe6881045e0 2024-09-10T23:25:41.104 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.077+0000 7fe685e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe688103cc0 0x7fe6881991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:41.104 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.077+0000 7fe685e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe688103cc0 0x7fe6881991d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43324/0 (socket says 172.21.15.3:43324) 2024-09-10T23:25:41.104 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.078+0000 7fe685e00640 1 -- 172.21.15.3:0/1116010084 learned_addr learned my addr 172.21.15.3:0/1116010084 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:41.104 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.078+0000 7fe685400640 1 --2- 172.21.15.3:0/1116010084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6881045e0 0x7fe688199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:41.104 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.078+0000 7fe686800640 1 --2- 172.21.15.3:0/1116010084 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe68810d120 0x7fe68819eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:41.104 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.078+0000 7fe685e00640 1 -- 172.21.15.3:0/1116010084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6881045e0 msgr2=0x7fe688199710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:41.104 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.078+0000 7fe685e00640 1 --2- 172.21.15.3:0/1116010084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6881045e0 0x7fe688199710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:41.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.078+0000 7fe685e00640 1 -- 172.21.15.3:0/1116010084 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe68810d120 msgr2=0x7fe68819eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:41.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.078+0000 7fe685e00640 1 --2- 172.21.15.3:0/1116010084 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe68810d120 0x7fe68819eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:41.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.078+0000 7fe685e00640 1 -- 172.21.15.3:0/1116010084 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe68819f280 con 0x7fe688103cc0 2024-09-10T23:25:41.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.078+0000 7fe685e00640 1 --2- 172.21.15.3:0/1116010084 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe688103cc0 0x7fe6881991d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe678009230 tx=0x7fe6780319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:41.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.079+0000 7fe67ea00640 1 -- 172.21.15.3:0/1116010084 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67803f030 con 0x7fe688103cc0 2024-09-10T23:25:41.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.079+0000 7fe67ea00640 1 -- 172.21.15.3:0/1116010084 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6780043d0 con 0x7fe688103cc0 2024-09-10T23:25:41.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.079+0000 7fe68ce00640 1 -- 172.21.15.3:0/1116010084 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe68819f510 con 0x7fe688103cc0 2024-09-10T23:25:41.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.079+0000 7fe67ea00640 1 -- 172.21.15.3:0/1116010084 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe678035070 con 0x7fe688103cc0 2024-09-10T23:25:41.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.079+0000 7fe68ce00640 1 -- 172.21.15.3:0/1116010084 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6881a5c30 con 0x7fe688103cc0 2024-09-10T23:25:41.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.080+0000 7fe68ce00640 1 -- 172.21.15.3:0/1116010084 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6881040a0 con 0x7fe688103cc0 2024-09-10T23:25:41.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.082+0000 7fe67ea00640 1 -- 172.21.15.3:0/1116010084 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7fe67803b8a0 con 0x7fe688103cc0 2024-09-10T23:25:41.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.084+0000 7fe67ea00640 1 --2- 172.21.15.3:0/1116010084 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fe66c0b5440 0x7fe66c0b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:41.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.084+0000 7fe67ea00640 1 -- 172.21.15.3:0/1116010084 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7fe678106850 con 0x7fe688103cc0 2024-09-10T23:25:41.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.084+0000 7fe685400640 1 --2- 172.21.15.3:0/1116010084 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fe66c0b5440 0x7fe66c0b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:41.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.085+0000 7fe685400640 1 --2- 172.21.15.3:0/1116010084 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fe66c0b5440 0x7fe66c0b7900 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe68810f6f0 tx=0x7fe674005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:41.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.088+0000 7fe67ea00640 1 -- 172.21.15.3:0/1116010084 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe6780cca70 con 0x7fe688103cc0 2024-09-10T23:25:41.250 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593791 got 184683593793 for osd.6 2024-09-10T23:25:41.250 DEBUG:teuthology.parallel:result is None 2024-09-10T23:25:41.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.289+0000 7fe68ce00640 1 -- 172.21.15.3:0/1116010084 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fe688107c00 con 0x7fe688103cc0 2024-09-10T23:25:41.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.290+0000 7fe67ea00640 1 -- 172.21.15.3:0/1116010084 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe6780d14a0 con 0x7fe688103cc0 2024-09-10T23:25:41.291 INFO:teuthology.orchestra.run.smithi003.stdout:111669149779 2024-09-10T23:25:41.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.292+0000 7fe68ce00640 1 -- 172.21.15.3:0/1116010084 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fe66c0b5440 msgr2=0x7fe66c0b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:41.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.292+0000 7fe68ce00640 1 --2- 172.21.15.3:0/1116010084 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fe66c0b5440 0x7fe66c0b7900 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe68810f6f0 tx=0x7fe674005f90 comp rx=0 tx=0).stop 2024-09-10T23:25:41.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.292+0000 7fe68ce00640 1 -- 172.21.15.3:0/1116010084 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe688103cc0 msgr2=0x7fe6881991d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:41.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.292+0000 7fe68ce00640 1 --2- 172.21.15.3:0/1116010084 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe688103cc0 0x7fe6881991d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe678009230 tx=0x7fe6780319a0 comp rx=0 tx=0).stop 2024-09-10T23:25:41.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.292+0000 7fe68ce00640 1 -- 172.21.15.3:0/1116010084 shutdown_connections 2024-09-10T23:25:41.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.292+0000 7fe68ce00640 1 --2- 172.21.15.3:0/1116010084 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe68810d120 0x7fe68819eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:41.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.292+0000 7fe68ce00640 1 --2- 172.21.15.3:0/1116010084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6881045e0 0x7fe688199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:41.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.292+0000 7fe68ce00640 1 --2- 172.21.15.3:0/1116010084 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fe66c0b5440 0x7fe66c0b7900 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:41.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.292+0000 7fe68ce00640 1 --2- 172.21.15.3:0/1116010084 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe688103cc0 0x7fe6881991d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:41.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.292+0000 7fe68ce00640 1 -- 172.21.15.3:0/1116010084 >> 172.21.15.3:0/1116010084 conn(0x7fe6880fd700 msgr2=0x7fe6880fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:41.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.292+0000 7fe68ce00640 1 -- 172.21.15.3:0/1116010084 shutdown_connections 2024-09-10T23:25:41.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:41.292+0000 7fe68ce00640 1 -- 172.21.15.3:0/1116010084 wait complete. 2024-09-10T23:25:41.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:41 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3967344618' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-10T23:25:41.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:41 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3967344618' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-10T23:25:41.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:41 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3967344618' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-10T23:25:42.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.265+0000 7f4d7b600640 1 -- 172.21.15.3:0/687376265 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4d74104fa0 msgr2=0x7f4d74105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:42.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.265+0000 7f4d7b600640 1 --2- 172.21.15.3:0/687376265 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4d74104fa0 0x7f4d74105380 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4d68009900 tx=0x7f4d6802a410 comp rx=0 tx=0).stop 2024-09-10T23:25:42.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.266+0000 7f4d7b600640 1 -- 172.21.15.3:0/687376265 shutdown_connections 2024-09-10T23:25:42.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.266+0000 7f4d7b600640 1 --2- 172.21.15.3:0/687376265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d7410b330 0x7f4d74111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:42.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.266+0000 7f4d7b600640 1 --2- 172.21.15.3:0/687376265 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d7410a9b0 0x7f4d7410adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:42.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.266+0000 7f4d7b600640 1 --2- 172.21.15.3:0/687376265 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4d74104fa0 0x7f4d74105380 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:42.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.266+0000 7f4d7b600640 1 -- 172.21.15.3:0/687376265 >> 172.21.15.3:0/687376265 conn(0x7f4d74100a50 msgr2=0x7f4d74102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:42.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.266+0000 7f4d7b600640 1 -- 172.21.15.3:0/687376265 shutdown_connections 2024-09-10T23:25:42.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.266+0000 7f4d7b600640 1 -- 172.21.15.3:0/687376265 wait complete. 2024-09-10T23:25:42.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.267+0000 7f4d7b600640 1 Processor -- start 2024-09-10T23:25:42.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.267+0000 7f4d7b600640 1 -- start start 2024-09-10T23:25:42.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.267+0000 7f4d7b600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d74104fa0 0x7f4d7419b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:42.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.267+0000 7f4d7b600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d7410a9b0 0x7f4d7419b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:42.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.267+0000 7f4d7b600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4d7410b330 0x7f4d741a0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:42.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.267+0000 7f4d7b600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f4d74114e60 con 0x7f4d7410b330 2024-09-10T23:25:42.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.267+0000 7f4d7b600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4d74114ce0 con 0x7f4d74104fa0 2024-09-10T23:25:42.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.267+0000 7f4d7b600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4d74114fe0 con 0x7f4d7410a9b0 2024-09-10T23:25:42.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.267+0000 7f4d79600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4d7410b330 0x7f4d741a0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:42.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.268+0000 7f4d79600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4d7410b330 0x7f4d741a0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43348/0 (socket says 172.21.15.3:43348) 2024-09-10T23:25:42.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.268+0000 7f4d79600640 1 -- 172.21.15.3:0/2972322764 learned_addr learned my addr 172.21.15.3:0/2972322764 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:42.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.268+0000 7f4d78c00640 1 --2- 172.21.15.3:0/2972322764 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d74104fa0 0x7f4d7419b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:42.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.268+0000 7f4d73e00640 1 --2- 172.21.15.3:0/2972322764 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d7410a9b0 0x7f4d7419b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:42.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.268+0000 7f4d79600640 1 -- 172.21.15.3:0/2972322764 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d7410a9b0 msgr2=0x7f4d7419b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:42.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.268+0000 7f4d79600640 1 --2- 172.21.15.3:0/2972322764 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d7410a9b0 0x7f4d7419b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:42.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.268+0000 7f4d79600640 1 -- 172.21.15.3:0/2972322764 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d74104fa0 msgr2=0x7f4d7419b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:42.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.268+0000 7f4d79600640 1 --2- 172.21.15.3:0/2972322764 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d74104fa0 0x7f4d7419b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:42.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.268+0000 7f4d79600640 1 -- 172.21.15.3:0/2972322764 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d741a1500 con 0x7f4d7410b330 2024-09-10T23:25:42.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.268+0000 7f4d79600640 1 --2- 172.21.15.3:0/2972322764 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4d7410b330 0x7f4d741a0d30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c009fd0 tx=0x7f4d6c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:42.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.269+0000 7f4d71600640 1 -- 172.21.15.3:0/2972322764 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c017070 con 0x7f4d7410b330 2024-09-10T23:25:42.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.269+0000 7f4d71600640 1 -- 172.21.15.3:0/2972322764 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d6c003e00 con 0x7f4d7410b330 2024-09-10T23:25:42.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.269+0000 7f4d71600640 1 -- 172.21.15.3:0/2972322764 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c010460 con 0x7f4d7410b330 2024-09-10T23:25:42.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.269+0000 7f4d7b600640 1 -- 172.21.15.3:0/2972322764 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d741a17f0 con 0x7f4d7410b330 2024-09-10T23:25:42.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.269+0000 7f4d7b600640 1 -- 172.21.15.3:0/2972322764 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d741a7eb0 con 0x7f4d7410b330 2024-09-10T23:25:42.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.270+0000 7f4d7b600640 1 -- 172.21.15.3:0/2972322764 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d74105380 con 0x7f4d7410b330 2024-09-10T23:25:42.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.272+0000 7f4d71600640 1 -- 172.21.15.3:0/2972322764 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7f4d6c003970 con 0x7f4d7410b330 2024-09-10T23:25:42.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.274+0000 7f4d71600640 1 --2- 172.21.15.3:0/2972322764 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f4d5c0b53c0 0x7f4d5c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:42.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.274+0000 7f4d71600640 1 -- 172.21.15.3:0/2972322764 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f4d6c0e6320 con 0x7f4d7410b330 2024-09-10T23:25:42.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.274+0000 7f4d78c00640 1 --2- 172.21.15.3:0/2972322764 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f4d5c0b53c0 0x7f4d5c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:42.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.275+0000 7f4d78c00640 1 --2- 172.21.15.3:0/2972322764 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f4d5c0b53c0 0x7f4d5c0b7880 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4d68006010 tx=0x7f4d68005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:42.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.277+0000 7f4d71600640 1 -- 172.21.15.3:0/2972322764 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4d6c0ac540 con 0x7f4d7410b330 2024-09-10T23:25:42.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.483+0000 7f4d7b600640 1 -- 172.21.15.3:0/2972322764 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f4d7402e5c0 con 0x7f4d7410b330 2024-09-10T23:25:42.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.483+0000 7f4d71600640 1 -- 172.21.15.3:0/2972322764 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f4d6c0b0f70 con 0x7f4d7410b330 2024-09-10T23:25:42.485 INFO:teuthology.orchestra.run.smithi003.stdout:279172874282 2024-09-10T23:25:42.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.486+0000 7f4d7b600640 1 -- 172.21.15.3:0/2972322764 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f4d5c0b53c0 msgr2=0x7f4d5c0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:42.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.486+0000 7f4d7b600640 1 --2- 172.21.15.3:0/2972322764 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f4d5c0b53c0 0x7f4d5c0b7880 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4d68006010 tx=0x7f4d68005e80 comp rx=0 tx=0).stop 2024-09-10T23:25:42.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.486+0000 7f4d7b600640 1 -- 172.21.15.3:0/2972322764 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4d7410b330 msgr2=0x7f4d741a0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:42.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.486+0000 7f4d7b600640 1 --2- 172.21.15.3:0/2972322764 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4d7410b330 0x7f4d741a0d30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c009fd0 tx=0x7f4d6c00b260 comp rx=0 tx=0).stop 2024-09-10T23:25:42.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.486+0000 7f4d7b600640 1 -- 172.21.15.3:0/2972322764 shutdown_connections 2024-09-10T23:25:42.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.486+0000 7f4d7b600640 1 --2- 172.21.15.3:0/2972322764 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f4d5c0b53c0 0x7f4d5c0b7880 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:42.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.486+0000 7f4d7b600640 1 --2- 172.21.15.3:0/2972322764 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4d7410b330 0x7f4d741a0d30 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:42.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.486+0000 7f4d7b600640 1 --2- 172.21.15.3:0/2972322764 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d7410a9b0 0x7f4d7419b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:42.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.486+0000 7f4d7b600640 1 --2- 172.21.15.3:0/2972322764 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d74104fa0 0x7f4d7419b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:42.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.486+0000 7f4d7b600640 1 -- 172.21.15.3:0/2972322764 >> 172.21.15.3:0/2972322764 conn(0x7f4d74100a50 msgr2=0x7f4d74102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:42.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.486+0000 7f4d7b600640 1 -- 172.21.15.3:0/2972322764 shutdown_connections 2024-09-10T23:25:42.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:42.486+0000 7f4d7b600640 1 -- 172.21.15.3:0/2972322764 wait complete. 2024-09-10T23:25:42.554 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:42 smithi003 ceph-mon[30348]: pgmap v358: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:25:42.554 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:42 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1116010084' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-10T23:25:42.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:42 smithi038 ceph-mon[34225]: pgmap v358: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:25:42.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:42 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/1116010084' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-10T23:25:42.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:42 smithi194 ceph-mon[33904]: pgmap v358: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:25:42.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:42 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/1116010084' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-10T23:25:43.225 INFO:tasks.cephadm.ceph_manager.ceph:need seq 304942678050 got 304942678052 for osd.11 2024-09-10T23:25:43.225 DEBUG:teuthology.parallel:result is None 2024-09-10T23:25:43.394 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:43 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2972322764' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-10T23:25:43.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:43 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2972322764' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-10T23:25:43.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.682+0000 7f938de00640 1 -- 172.21.15.3:0/529207893 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f938810a9b0 msgr2=0x7f938810adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:43.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.682+0000 7f938de00640 1 --2- 172.21.15.3:0/529207893 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f938810a9b0 0x7f938810adf0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9370009900 tx=0x7f937002a410 comp rx=0 tx=0).stop 2024-09-10T23:25:43.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.682+0000 7f938de00640 1 -- 172.21.15.3:0/529207893 shutdown_connections 2024-09-10T23:25:43.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.682+0000 7f938de00640 1 --2- 172.21.15.3:0/529207893 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f938810b330 0x7f9388111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:43.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.682+0000 7f938de00640 1 --2- 172.21.15.3:0/529207893 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f938810a9b0 0x7f938810adf0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:43.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.682+0000 7f938de00640 1 --2- 172.21.15.3:0/529207893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9388104fa0 0x7f9388105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:43.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.682+0000 7f938de00640 1 -- 172.21.15.3:0/529207893 >> 172.21.15.3:0/529207893 conn(0x7f9388100a50 msgr2=0x7f9388102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:43.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.682+0000 7f938de00640 1 -- 172.21.15.3:0/529207893 shutdown_connections 2024-09-10T23:25:43.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.682+0000 7f938de00640 1 -- 172.21.15.3:0/529207893 wait complete. 2024-09-10T23:25:43.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.683+0000 7f938de00640 1 Processor -- start 2024-09-10T23:25:43.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.684+0000 7f938de00640 1 -- start start 2024-09-10T23:25:43.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.684+0000 7f938de00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9388104fa0 0x7f938819b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:43.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.684+0000 7f938de00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f938810a9b0 0x7f938819b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:43.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.684+0000 7f938de00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f938810b330 0x7f93881a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:43.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.684+0000 7f938de00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9388114e50 con 0x7f938810b330 2024-09-10T23:25:43.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.684+0000 7f938de00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9388114cd0 con 0x7f9388104fa0 2024-09-10T23:25:43.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.684+0000 7f938de00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9388114fd0 con 0x7f938810a9b0 2024-09-10T23:25:43.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.684+0000 7f9387400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f938810b330 0x7f93881a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:43.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.684+0000 7f9387400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f938810b330 0x7f93881a0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43384/0 (socket says 172.21.15.3:43384) 2024-09-10T23:25:43.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.684+0000 7f9387400640 1 -- 172.21.15.3:0/2071865892 learned_addr learned my addr 172.21.15.3:0/2071865892 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:43.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.684+0000 7f937fe00640 1 --2- 172.21.15.3:0/2071865892 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f938810a9b0 0x7f938819b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:43.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.685+0000 7f9386a00640 1 --2- 172.21.15.3:0/2071865892 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9388104fa0 0x7f938819b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:43.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.685+0000 7f9387400640 1 -- 172.21.15.3:0/2071865892 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f938810a9b0 msgr2=0x7f938819b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:43.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.685+0000 7f9387400640 1 --2- 172.21.15.3:0/2071865892 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f938810a9b0 0x7f938819b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:43.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.685+0000 7f9387400640 1 -- 172.21.15.3:0/2071865892 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9388104fa0 msgr2=0x7f938819b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:43.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.685+0000 7f9387400640 1 --2- 172.21.15.3:0/2071865892 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9388104fa0 0x7f938819b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:43.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.685+0000 7f9387400640 1 -- 172.21.15.3:0/2071865892 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93881a1510 con 0x7f938810b330 2024-09-10T23:25:43.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.685+0000 7f9386a00640 1 --2- 172.21.15.3:0/2071865892 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9388104fa0 0x7f938819b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:43.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.685+0000 7f9387400640 1 --2- 172.21.15.3:0/2071865892 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f938810b330 0x7f93881a0d40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9380009fd0 tx=0x7f938000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:43.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.685+0000 7f938ca00640 1 -- 172.21.15.3:0/2071865892 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9380017070 con 0x7f938810b330 2024-09-10T23:25:43.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.686+0000 7f938ca00640 1 -- 172.21.15.3:0/2071865892 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9380003e00 con 0x7f938810b330 2024-09-10T23:25:43.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.686+0000 7f938de00640 1 -- 172.21.15.3:0/2071865892 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93881a1800 con 0x7f938810b330 2024-09-10T23:25:43.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.686+0000 7f938ca00640 1 -- 172.21.15.3:0/2071865892 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9380010460 con 0x7f938810b330 2024-09-10T23:25:43.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.686+0000 7f938de00640 1 -- 172.21.15.3:0/2071865892 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93881a7ec0 con 0x7f938810b330 2024-09-10T23:25:43.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.687+0000 7f938de00640 1 -- 172.21.15.3:0/2071865892 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9388105380 con 0x7f938810b330 2024-09-10T23:25:43.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.689+0000 7f938ca00640 1 -- 172.21.15.3:0/2071865892 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7f9380003970 con 0x7f938810b330 2024-09-10T23:25:43.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.690+0000 7f938ca00640 1 --2- 172.21.15.3:0/2071865892 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f936c0b5440 0x7f936c0b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:43.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.691+0000 7f938ca00640 1 -- 172.21.15.3:0/2071865892 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f93800e6340 con 0x7f938810b330 2024-09-10T23:25:43.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.691+0000 7f9386a00640 1 --2- 172.21.15.3:0/2071865892 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f936c0b5440 0x7f936c0b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:43.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.692+0000 7f9386a00640 1 --2- 172.21.15.3:0/2071865892 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f936c0b5440 0x7f936c0b7900 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f93780058c0 tx=0x7f9378005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:43.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.694+0000 7f938ca00640 1 -- 172.21.15.3:0/2071865892 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f93800acbb0 con 0x7f938810b330 2024-09-10T23:25:43.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:43 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2972322764' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-10T23:25:43.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.893+0000 7f938de00640 1 -- 172.21.15.3:0/2071865892 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f938810cb80 con 0x7f938810b330 2024-09-10T23:25:43.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.894+0000 7f938ca00640 1 -- 172.21.15.3:0/2071865892 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f93800ac4b0 con 0x7f938810b330 2024-09-10T23:25:43.895 INFO:teuthology.orchestra.run.smithi003.stdout:137438953550 2024-09-10T23:25:43.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.896+0000 7f938de00640 1 -- 172.21.15.3:0/2071865892 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f936c0b5440 msgr2=0x7f936c0b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:43.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.896+0000 7f938de00640 1 --2- 172.21.15.3:0/2071865892 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f936c0b5440 0x7f936c0b7900 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f93780058c0 tx=0x7f9378005850 comp rx=0 tx=0).stop 2024-09-10T23:25:43.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.896+0000 7f938de00640 1 -- 172.21.15.3:0/2071865892 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f938810b330 msgr2=0x7f93881a0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:43.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.896+0000 7f938de00640 1 --2- 172.21.15.3:0/2071865892 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f938810b330 0x7f93881a0d40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9380009fd0 tx=0x7f938000b260 comp rx=0 tx=0).stop 2024-09-10T23:25:43.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.896+0000 7f938de00640 1 -- 172.21.15.3:0/2071865892 shutdown_connections 2024-09-10T23:25:43.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.896+0000 7f938de00640 1 --2- 172.21.15.3:0/2071865892 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f936c0b5440 0x7f936c0b7900 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:43.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.896+0000 7f938de00640 1 --2- 172.21.15.3:0/2071865892 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f938810b330 0x7f93881a0d40 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:43.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.896+0000 7f938de00640 1 --2- 172.21.15.3:0/2071865892 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f938810a9b0 0x7f938819b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:43.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.896+0000 7f938de00640 1 --2- 172.21.15.3:0/2071865892 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9388104fa0 0x7f938819b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:43.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.896+0000 7f938de00640 1 -- 172.21.15.3:0/2071865892 >> 172.21.15.3:0/2071865892 conn(0x7f9388100a50 msgr2=0x7f9388102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:43.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.896+0000 7f938de00640 1 -- 172.21.15.3:0/2071865892 shutdown_connections 2024-09-10T23:25:43.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.896+0000 7f938de00640 1 -- 172.21.15.3:0/2071865892 wait complete. 2024-09-10T23:25:44.147 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149776 got 111669149779 for osd.3 2024-09-10T23:25:44.147 DEBUG:teuthology.parallel:result is None 2024-09-10T23:25:44.440 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:44 smithi003 ceph-mon[30348]: pgmap v359: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-09-10T23:25:44.441 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:44 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2501131628' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-10T23:25:44.441 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:44 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2071865892' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-10T23:25:44.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:44 smithi038 ceph-mon[34225]: pgmap v359: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-09-10T23:25:44.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:44 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2501131628' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-10T23:25:44.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:44 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2071865892' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-10T23:25:44.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:44 smithi194 ceph-mon[33904]: pgmap v359: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-09-10T23:25:44.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:44 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2501131628' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-10T23:25:44.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:44 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2071865892' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-10T23:25:44.920 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790021 got 158913790023 for osd.5 2024-09-10T23:25:44.920 DEBUG:teuthology.parallel:result is None 2024-09-10T23:25:45.264 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234034 got 231928234037 for osd.8 2024-09-10T23:25:45.264 DEBUG:teuthology.parallel:result is None 2024-09-10T23:25:45.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.440+0000 7f0e0f200640 1 -- 172.21.15.3:0/523188452 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e0810a820 msgr2=0x7f0e0810ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.440+0000 7f0e0f200640 1 --2- 172.21.15.3:0/523188452 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e0810a820 0x7f0e0810ac60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0df8009900 tx=0x7f0df802a410 comp rx=0 tx=0).stop 2024-09-10T23:25:45.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.440+0000 7f0e0f200640 1 -- 172.21.15.3:0/523188452 shutdown_connections 2024-09-10T23:25:45.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.440+0000 7f0e0f200640 1 --2- 172.21.15.3:0/523188452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e0810b1a0 0x7f0e081119a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.440+0000 7f0e0f200640 1 --2- 172.21.15.3:0/523188452 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e0810a820 0x7f0e0810ac60 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.440+0000 7f0e0f200640 1 --2- 172.21.15.3:0/523188452 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e08104e10 0x7f0e081051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.440+0000 7f0e0f200640 1 -- 172.21.15.3:0/523188452 >> 172.21.15.3:0/523188452 conn(0x7f0e08100840 msgr2=0x7f0e08102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:45.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.440+0000 7f0e0f200640 1 -- 172.21.15.3:0/523188452 shutdown_connections 2024-09-10T23:25:45.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.440+0000 7f0e0f200640 1 -- 172.21.15.3:0/523188452 wait complete. 2024-09-10T23:25:45.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.441+0000 7f0e0f200640 1 Processor -- start 2024-09-10T23:25:45.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.441+0000 7f0e0f200640 1 -- start start 2024-09-10T23:25:45.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.442+0000 7f0e0f200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e08104e10 0x7f0e0819b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.442+0000 7f0e0f200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e0810a820 0x7f0e0819b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.442+0000 7f0e0f200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e0810b1a0 0x7f0e081a0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.442+0000 7f0e0f200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0e08114ca0 con 0x7f0e0810a820 2024-09-10T23:25:45.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.442+0000 7f0e0f200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0e08114b20 con 0x7f0e08104e10 2024-09-10T23:25:45.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.442+0000 7f0e0f200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0e08114e20 con 0x7f0e0810b1a0 2024-09-10T23:25:45.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.442+0000 7f0e0d400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e0810a820 0x7f0e0819b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.442+0000 7f0e0d400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e0810a820 0x7f0e0819b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43412/0 (socket says 172.21.15.3:43412) 2024-09-10T23:25:45.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.442+0000 7f0e0d400640 1 -- 172.21.15.3:0/614454034 learned_addr learned my addr 172.21.15.3:0/614454034 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:45.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.442+0000 7f0e0de00640 1 --2- 172.21.15.3:0/614454034 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e08104e10 0x7f0e0819b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.442+0000 7f0e0e800640 1 --2- 172.21.15.3:0/614454034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e0810b1a0 0x7f0e081a0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.443+0000 7f0e0d400640 1 -- 172.21.15.3:0/614454034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e0810b1a0 msgr2=0x7f0e081a0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.443+0000 7f0e0d400640 1 --2- 172.21.15.3:0/614454034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e0810b1a0 0x7f0e081a0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.443+0000 7f0e0d400640 1 -- 172.21.15.3:0/614454034 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e08104e10 msgr2=0x7f0e0819b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.443+0000 7f0e0d400640 1 --2- 172.21.15.3:0/614454034 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e08104e10 0x7f0e0819b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.443+0000 7f0e0d400640 1 -- 172.21.15.3:0/614454034 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e081a11d0 con 0x7f0e0810a820 2024-09-10T23:25:45.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.443+0000 7f0e0d400640 1 --2- 172.21.15.3:0/614454034 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e0810a820 0x7f0e0819b660 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0df8009230 tx=0x7f0df8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:45.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.443+0000 7f0e02a00640 1 -- 172.21.15.3:0/614454034 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df803f030 con 0x7f0e0810a820 2024-09-10T23:25:45.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.443+0000 7f0e02a00640 1 -- 172.21.15.3:0/614454034 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0df8003a80 con 0x7f0e0810a820 2024-09-10T23:25:45.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.443+0000 7f0e0f200640 1 -- 172.21.15.3:0/614454034 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e081a1460 con 0x7f0e0810a820 2024-09-10T23:25:45.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.443+0000 7f0e02a00640 1 -- 172.21.15.3:0/614454034 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df8035070 con 0x7f0e0810a820 2024-09-10T23:25:45.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.443+0000 7f0e0f200640 1 -- 172.21.15.3:0/614454034 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e081a7b80 con 0x7f0e0810a820 2024-09-10T23:25:45.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.445+0000 7f0e0f200640 1 -- 172.21.15.3:0/614454034 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e081051f0 con 0x7f0e0810a820 2024-09-10T23:25:45.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.447+0000 7f0e02a00640 1 -- 172.21.15.3:0/614454034 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7f0df803bc30 con 0x7f0e0810a820 2024-09-10T23:25:45.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.448+0000 7f0e02a00640 1 --2- 172.21.15.3:0/614454034 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0df00b5460 0x7f0df00b7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.448+0000 7f0e02a00640 1 -- 172.21.15.3:0/614454034 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f0df8106c40 con 0x7f0e0810a820 2024-09-10T23:25:45.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.449+0000 7f0e0de00640 1 --2- 172.21.15.3:0/614454034 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0df00b5460 0x7f0df00b7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.449+0000 7f0e0de00640 1 --2- 172.21.15.3:0/614454034 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0df00b5460 0x7f0df00b7920 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc005d00 tx=0x7f0dfc00b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:45.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.452+0000 7f0e02a00640 1 -- 172.21.15.3:0/614454034 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0df80cce60 con 0x7f0e0810a820 2024-09-10T23:25:45.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.664+0000 7f0e0f200640 1 -- 172.21.15.3:0/614454034 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f0e0810c9f0 con 0x7f0e0810a820 2024-09-10T23:25:45.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.664+0000 7f0e02a00640 1 -- 172.21.15.3:0/614454034 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f0df80d1890 con 0x7f0e0810a820 2024-09-10T23:25:45.665 INFO:teuthology.orchestra.run.smithi003.stdout:206158430268 2024-09-10T23:25:45.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.666+0000 7f0e0f200640 1 -- 172.21.15.3:0/614454034 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0df00b5460 msgr2=0x7f0df00b7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.666+0000 7f0e0f200640 1 --2- 172.21.15.3:0/614454034 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0df00b5460 0x7f0df00b7920 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc005d00 tx=0x7f0dfc00b410 comp rx=0 tx=0).stop 2024-09-10T23:25:45.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.666+0000 7f0e0f200640 1 -- 172.21.15.3:0/614454034 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e0810a820 msgr2=0x7f0e0819b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.666+0000 7f0e0f200640 1 --2- 172.21.15.3:0/614454034 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e0810a820 0x7f0e0819b660 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0df8009230 tx=0x7f0df8004270 comp rx=0 tx=0).stop 2024-09-10T23:25:45.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.666+0000 7f0e0f200640 1 -- 172.21.15.3:0/614454034 shutdown_connections 2024-09-10T23:25:45.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.666+0000 7f0e0f200640 1 --2- 172.21.15.3:0/614454034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e0810b1a0 0x7f0e081a0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.666+0000 7f0e0f200640 1 --2- 172.21.15.3:0/614454034 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0df00b5460 0x7f0df00b7920 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.666+0000 7f0e0f200640 1 --2- 172.21.15.3:0/614454034 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e0810a820 0x7f0e0819b660 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.666+0000 7f0e0f200640 1 --2- 172.21.15.3:0/614454034 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e08104e10 0x7f0e0819b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.666+0000 7f0e0f200640 1 -- 172.21.15.3:0/614454034 >> 172.21.15.3:0/614454034 conn(0x7f0e08100840 msgr2=0x7f0e08102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:45.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.666+0000 7f0e0f200640 1 -- 172.21.15.3:0/614454034 shutdown_connections 2024-09-10T23:25:45.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:45.667+0000 7f0e0f200640 1 -- 172.21.15.3:0/614454034 wait complete. 2024-09-10T23:25:46.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.181+0000 7fae19c00640 1 -- 172.21.15.3:0/2308106835 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae140776d0 msgr2=0x7fae14077ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:46.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.181+0000 7fae19c00640 1 --2- 172.21.15.3:0/2308106835 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae140776d0 0x7fae14077ab0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fae04009900 tx=0x7fae0402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.181+0000 7fae19c00640 1 -- 172.21.15.3:0/2308106835 shutdown_connections 2024-09-10T23:25:46.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.181+0000 7fae19c00640 1 --2- 172.21.15.3:0/2308106835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae14113980 0x7fae14115d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.181+0000 7fae19c00640 1 --2- 172.21.15.3:0/2308106835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae14077ff0 0x7fae14113440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.181+0000 7fae19c00640 1 --2- 172.21.15.3:0/2308106835 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae140776d0 0x7fae14077ab0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.181+0000 7fae19c00640 1 -- 172.21.15.3:0/2308106835 >> 172.21.15.3:0/2308106835 conn(0x7fae14100a00 msgr2=0x7fae14102e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:46.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.181+0000 7fae19c00640 1 -- 172.21.15.3:0/2308106835 shutdown_connections 2024-09-10T23:25:46.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.181+0000 7fae19c00640 1 -- 172.21.15.3:0/2308106835 wait complete. 2024-09-10T23:25:46.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.182+0000 7fae19c00640 1 Processor -- start 2024-09-10T23:25:46.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.182+0000 7fae19c00640 1 -- start start 2024-09-10T23:25:46.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.183+0000 7fae19c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae140776d0 0x7fae1419f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:46.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.183+0000 7fae19c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae14077ff0 0x7fae1419fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:46.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.183+0000 7fae19c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae14113980 0x7fae141a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:46.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.183+0000 7fae19c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fae14119290 con 0x7fae140776d0 2024-09-10T23:25:46.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.183+0000 7fae19c00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fae14119110 con 0x7fae14077ff0 2024-09-10T23:25:46.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.183+0000 7fae19c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fae14119410 con 0x7fae14113980 2024-09-10T23:25:46.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.183+0000 7fae12a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae140776d0 0x7fae1419f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:46.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.183+0000 7fae12a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae140776d0 0x7fae1419f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43374/0 (socket says 172.21.15.3:43374) 2024-09-10T23:25:46.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.183+0000 7fae12a00640 1 -- 172.21.15.3:0/2501131628 learned_addr learned my addr 172.21.15.3:0/2501131628 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:46.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.183+0000 7fae13400640 1 --2- 172.21.15.3:0/2501131628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae14113980 0x7fae141a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:46.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.183+0000 7fae12000640 1 --2- 172.21.15.3:0/2501131628 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae14077ff0 0x7fae1419fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:46.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.183+0000 7fae12a00640 1 -- 172.21.15.3:0/2501131628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae14113980 msgr2=0x7fae141a50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:46.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.184+0000 7fae12a00640 1 --2- 172.21.15.3:0/2501131628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae14113980 0x7fae141a50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.184+0000 7fae12a00640 1 -- 172.21.15.3:0/2501131628 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae14077ff0 msgr2=0x7fae1419fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:46.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.184+0000 7fae12a00640 1 --2- 172.21.15.3:0/2501131628 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae14077ff0 0x7fae1419fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.184+0000 7fae12a00640 1 -- 172.21.15.3:0/2501131628 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae141a58b0 con 0x7fae140776d0 2024-09-10T23:25:46.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.184+0000 7fae13400640 1 --2- 172.21.15.3:0/2501131628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae14113980 0x7fae141a50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:46.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.184+0000 7fae12a00640 1 --2- 172.21.15.3:0/2501131628 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae140776d0 0x7fae1419f800 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fae0402a910 tx=0x7fae04003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:46.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.184+0000 7fae0b400640 1 -- 172.21.15.3:0/2501131628 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0403f070 con 0x7fae140776d0 2024-09-10T23:25:46.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.184+0000 7fae0b400640 1 -- 172.21.15.3:0/2501131628 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fae04003e40 con 0x7fae140776d0 2024-09-10T23:25:46.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.184+0000 7fae0b400640 1 -- 172.21.15.3:0/2501131628 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae04035030 con 0x7fae140776d0 2024-09-10T23:25:46.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.184+0000 7fae19c00640 1 -- 172.21.15.3:0/2501131628 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae141a5b40 con 0x7fae140776d0 2024-09-10T23:25:46.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.185+0000 7fae19c00640 1 -- 172.21.15.3:0/2501131628 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae141ac260 con 0x7fae140776d0 2024-09-10T23:25:46.092 INFO:teuthology.orchestra.run.smithi003.stdout:81604378715 2024-09-10T23:25:46.093 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.186+0000 7fae19c00640 1 -- 172.21.15.3:0/2501131628 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae14077ab0 con 0x7fae140776d0 2024-09-10T23:25:46.093 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.188+0000 7fae0b400640 1 -- 172.21.15.3:0/2501131628 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7fae04031400 con 0x7fae140776d0 2024-09-10T23:25:46.093 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.190+0000 7fae0b400640 1 --2- 172.21.15.3:0/2501131628 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fadf80b53c0 0x7fadf80b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:46.093 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.190+0000 7fae0b400640 1 -- 172.21.15.3:0/2501131628 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7fae04107160 con 0x7fae140776d0 2024-09-10T23:25:46.093 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.190+0000 7fae12000640 1 --2- 172.21.15.3:0/2501131628 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fadf80b53c0 0x7fadf80b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:46.093 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.191+0000 7fae12000640 1 --2- 172.21.15.3:0/2501131628 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fadf80b53c0 0x7fadf80b7880 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fae1407a260 tx=0x7fae0000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:46.093 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.192+0000 7fae0b400640 1 -- 172.21.15.3:0/2501131628 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fae040cd9d0 con 0x7fae140776d0 2024-09-10T23:25:46.093 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.393+0000 7fae19c00640 1 -- 172.21.15.3:0/2501131628 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fae1410eb10 con 0x7fae140776d0 2024-09-10T23:25:46.093 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.394+0000 7fae0b400640 1 -- 172.21.15.3:0/2501131628 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fae040cd2d0 con 0x7fae140776d0 2024-09-10T23:25:46.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.396+0000 7fae19c00640 1 -- 172.21.15.3:0/2501131628 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fadf80b53c0 msgr2=0x7fadf80b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:46.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.396+0000 7fae19c00640 1 --2- 172.21.15.3:0/2501131628 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fadf80b53c0 0x7fadf80b7880 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fae1407a260 tx=0x7fae0000b390 comp rx=0 tx=0).stop 2024-09-10T23:25:46.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.396+0000 7fae19c00640 1 -- 172.21.15.3:0/2501131628 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae140776d0 msgr2=0x7fae1419f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:46.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.396+0000 7fae19c00640 1 --2- 172.21.15.3:0/2501131628 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae140776d0 0x7fae1419f800 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fae0402a910 tx=0x7fae04003c20 comp rx=0 tx=0).stop 2024-09-10T23:25:46.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.396+0000 7fae19c00640 1 -- 172.21.15.3:0/2501131628 shutdown_connections 2024-09-10T23:25:46.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.396+0000 7fae19c00640 1 --2- 172.21.15.3:0/2501131628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae14113980 0x7fae141a50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.396+0000 7fae19c00640 1 --2- 172.21.15.3:0/2501131628 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae14077ff0 0x7fae1419fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.396+0000 7fae19c00640 1 --2- 172.21.15.3:0/2501131628 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fadf80b53c0 0x7fadf80b7880 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.396+0000 7fae19c00640 1 --2- 172.21.15.3:0/2501131628 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae140776d0 0x7fae1419f800 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.396+0000 7fae19c00640 1 -- 172.21.15.3:0/2501131628 >> 172.21.15.3:0/2501131628 conn(0x7fae14100a00 msgr2=0x7fae14114580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:46.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.397+0000 7fae19c00640 1 -- 172.21.15.3:0/2501131628 shutdown_connections 2024-09-10T23:25:46.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:43.397+0000 7fae19c00640 1 -- 172.21.15.3:0/2501131628 wait complete. 2024-09-10T23:25:46.465 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:46 smithi003 ceph-mon[30348]: pgmap v360: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:25:46.466 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:46 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/614454034' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-10T23:25:46.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:46 smithi038 ceph-mon[34225]: pgmap v360: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:25:46.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:46 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/614454034' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-10T23:25:46.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.161+0000 7f76a2200640 1 -- 172.21.15.3:0/1407171632 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f769c102c10 msgr2=0x7f769c102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:46.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.161+0000 7f76a2200640 1 --2- 172.21.15.3:0/1407171632 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f769c102c10 0x7f769c102ff0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7690009900 tx=0x7f769002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.161+0000 7f76a2200640 1 -- 172.21.15.3:0/1407171632 shutdown_connections 2024-09-10T23:25:46.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.161+0000 7f76a2200640 1 --2- 172.21.15.3:0/1407171632 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f769c108fa0 0x7f769c10f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.161+0000 7f76a2200640 1 --2- 172.21.15.3:0/1407171632 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f769c108620 0x7f769c108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.161+0000 7f76a2200640 1 --2- 172.21.15.3:0/1407171632 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f769c102c10 0x7f769c102ff0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.161+0000 7f76a2200640 1 -- 172.21.15.3:0/1407171632 >> 172.21.15.3:0/1407171632 conn(0x7f769c0fe660 msgr2=0x7f769c100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:46.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.162+0000 7f76a2200640 1 -- 172.21.15.3:0/1407171632 shutdown_connections 2024-09-10T23:25:46.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.162+0000 7f76a2200640 1 -- 172.21.15.3:0/1407171632 wait complete. 2024-09-10T23:25:46.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.163+0000 7f76a2200640 1 Processor -- start 2024-09-10T23:25:46.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.163+0000 7f76a2200640 1 -- start start 2024-09-10T23:25:46.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.164+0000 7f76a2200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f769c102c10 0x7f769c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:46.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.164+0000 7f76a2200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f769c108620 0x7f769c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:46.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.164+0000 7f76a2200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f769c108fa0 0x7f769c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:46.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.164+0000 7f76a2200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f769c112b10 con 0x7f769c102c10 2024-09-10T23:25:46.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.164+0000 7f76a2200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f769c112990 con 0x7f769c108fa0 2024-09-10T23:25:46.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.164+0000 7f76a2200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f769c112c90 con 0x7f769c108620 2024-09-10T23:25:46.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.164+0000 7f76a0e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f769c102c10 0x7f769c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:46.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.164+0000 7f76a0e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f769c102c10 0x7f769c0754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41610/0 (socket says 172.21.15.3:41610) 2024-09-10T23:25:46.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.164+0000 7f76a0e00640 1 -- 172.21.15.3:0/3967344618 learned_addr learned my addr 172.21.15.3:0/3967344618 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:46.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.164+0000 7f769be00640 1 --2- 172.21.15.3:0/3967344618 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f769c108620 0x7f769c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:46.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.164+0000 7f76a1800640 1 --2- 172.21.15.3:0/3967344618 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f769c108fa0 0x7f769c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:46.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.165+0000 7f76a0e00640 1 -- 172.21.15.3:0/3967344618 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f769c108620 msgr2=0x7f769c0759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:46.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.165+0000 7f76a0e00640 1 --2- 172.21.15.3:0/3967344618 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f769c108620 0x7f769c0759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.165+0000 7f76a0e00640 1 -- 172.21.15.3:0/3967344618 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f769c108fa0 msgr2=0x7f769c075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:46.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.165+0000 7f76a0e00640 1 --2- 172.21.15.3:0/3967344618 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f769c108fa0 0x7f769c075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.165+0000 7f76a0e00640 1 -- 172.21.15.3:0/3967344618 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f769c1a7380 con 0x7f769c102c10 2024-09-10T23:25:46.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.165+0000 7f76a0e00640 1 --2- 172.21.15.3:0/3967344618 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f769c102c10 0x7f769c0754a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7690009230 tx=0x7f76900319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:46.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.165+0000 7f7699600640 1 -- 172.21.15.3:0/3967344618 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769003f030 con 0x7f769c102c10 2024-09-10T23:25:46.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.165+0000 7f7699600640 1 -- 172.21.15.3:0/3967344618 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f76900043d0 con 0x7f769c102c10 2024-09-10T23:25:46.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.165+0000 7f7699600640 1 -- 172.21.15.3:0/3967344618 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7690035070 con 0x7f769c102c10 2024-09-10T23:25:46.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.165+0000 7f76a2200640 1 -- 172.21.15.3:0/3967344618 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f769c1a7610 con 0x7f769c102c10 2024-09-10T23:25:46.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.166+0000 7f76a2200640 1 -- 172.21.15.3:0/3967344618 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f769c1a7aa0 con 0x7f769c102c10 2024-09-10T23:25:46.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.167+0000 7f76a2200640 1 -- 172.21.15.3:0/3967344618 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f769c102ff0 con 0x7f769c102c10 2024-09-10T23:25:46.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.170+0000 7f7699600640 1 -- 172.21.15.3:0/3967344618 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7f769003b880 con 0x7f769c102c10 2024-09-10T23:25:46.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.173+0000 7f7699600640 1 --2- 172.21.15.3:0/3967344618 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f76840b5460 0x7f76840b7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:46.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.174+0000 7f7699600640 1 -- 172.21.15.3:0/3967344618 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f7690106cb0 con 0x7f769c102c10 2024-09-10T23:25:46.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.174+0000 7f769be00640 1 --2- 172.21.15.3:0/3967344618 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f76840b5460 0x7f76840b7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:46.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.174+0000 7f7699600640 1 -- 172.21.15.3:0/3967344618 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7690107130 con 0x7f769c102c10 2024-09-10T23:25:46.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.175+0000 7f769be00640 1 --2- 172.21.15.3:0/3967344618 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f76840b5460 0x7f76840b7920 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f769c076f90 tx=0x7f7688005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:46.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.380+0000 7f76a2200640 1 -- 172.21.15.3:0/3967344618 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f769c0767a0 con 0x7f769c102c10 2024-09-10T23:25:46.607 INFO:teuthology.orchestra.run.smithi003.stdout:60129542237 2024-09-10T23:25:46.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.380+0000 7f7699600640 1 -- 172.21.15.3:0/3967344618 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f769c0767a0 con 0x7f769c102c10 2024-09-10T23:25:46.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.383+0000 7f76a2200640 1 -- 172.21.15.3:0/3967344618 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f76840b5460 msgr2=0x7f76840b7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:46.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.383+0000 7f76a2200640 1 --2- 172.21.15.3:0/3967344618 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f76840b5460 0x7f76840b7920 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f769c076f90 tx=0x7f7688005f90 comp rx=0 tx=0).stop 2024-09-10T23:25:46.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.383+0000 7f76a2200640 1 -- 172.21.15.3:0/3967344618 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f769c102c10 msgr2=0x7f769c0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:46.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.383+0000 7f76a2200640 1 --2- 172.21.15.3:0/3967344618 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f769c102c10 0x7f769c0754a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7690009230 tx=0x7f76900319a0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.383+0000 7f76a2200640 1 -- 172.21.15.3:0/3967344618 shutdown_connections 2024-09-10T23:25:46.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.383+0000 7f76a2200640 1 --2- 172.21.15.3:0/3967344618 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f769c108fa0 0x7f769c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.383+0000 7f76a2200640 1 --2- 172.21.15.3:0/3967344618 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f769c108620 0x7f769c0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.383+0000 7f76a2200640 1 --2- 172.21.15.3:0/3967344618 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f76840b5460 0x7f76840b7920 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.383+0000 7f76a2200640 1 --2- 172.21.15.3:0/3967344618 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f769c102c10 0x7f769c0754a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.383+0000 7f76a2200640 1 -- 172.21.15.3:0/3967344618 >> 172.21.15.3:0/3967344618 conn(0x7f769c0fe660 msgr2=0x7f769c0fff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:46.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.383+0000 7f76a2200640 1 -- 172.21.15.3:0/3967344618 shutdown_connections 2024-09-10T23:25:46.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:40.383+0000 7f76a2200640 1 -- 172.21.15.3:0/3967344618 wait complete. 2024-09-10T23:25:46.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:46 smithi194 ceph-mon[33904]: pgmap v360: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:25:46.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:46 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/614454034' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-10T23:25:46.938 INFO:tasks.cephadm.ceph_manager.ceph:need seq 279172874280 got 279172874282 for osd.10 2024-09-10T23:25:46.938 DEBUG:teuthology.parallel:result is None 2024-09-10T23:25:47.053 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378711 got 81604378715 for osd.2 2024-09-10T23:25:47.053 DEBUG:teuthology.parallel:result is None 2024-09-10T23:25:47.348 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:47.946 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953548 got 137438953550 for osd.4 2024-09-10T23:25:47.946 DEBUG:teuthology.parallel:result is None 2024-09-10T23:25:48.402 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542235 got 60129542237 for osd.1 2024-09-10T23:25:48.402 DEBUG:teuthology.parallel:result is None 2024-09-10T23:25:48.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:48 smithi003 ceph-mon[30348]: pgmap v361: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:25:48.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:48 smithi038 ceph-mon[34225]: pgmap v361: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:25:48.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:48 smithi194 ceph-mon[33904]: pgmap v361: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:25:48.746 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430265 got 206158430268 for osd.7 2024-09-10T23:25:48.746 DEBUG:teuthology.parallel:result is None 2024-09-10T23:25:49.018 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:49.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.283+0000 7ff8a9e00640 1 -- 172.21.15.3:0/457317301 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff8a410a800 msgr2=0x7ff8a410ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:49.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.283+0000 7ff8a9e00640 1 --2- 172.21.15.3:0/457317301 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff8a410a800 0x7ff8a410ac40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff88c009900 tx=0x7ff88c02a410 comp rx=0 tx=0).stop 2024-09-10T23:25:49.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.283+0000 7ff8a9e00640 1 -- 172.21.15.3:0/457317301 shutdown_connections 2024-09-10T23:25:49.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.283+0000 7ff8a9e00640 1 --2- 172.21.15.3:0/457317301 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8a410b180 0x7ff8a4111980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:49.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.283+0000 7ff8a9e00640 1 --2- 172.21.15.3:0/457317301 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff8a410a800 0x7ff8a410ac40 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:49.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.283+0000 7ff8a9e00640 1 --2- 172.21.15.3:0/457317301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8a4104df0 0x7ff8a41051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:49.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.283+0000 7ff8a9e00640 1 -- 172.21.15.3:0/457317301 >> 172.21.15.3:0/457317301 conn(0x7ff8a4100840 msgr2=0x7ff8a4102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:49.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.284+0000 7ff8a9e00640 1 -- 172.21.15.3:0/457317301 shutdown_connections 2024-09-10T23:25:49.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.284+0000 7ff8a9e00640 1 -- 172.21.15.3:0/457317301 wait complete. 2024-09-10T23:25:49.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.285+0000 7ff8a9e00640 1 Processor -- start 2024-09-10T23:25:49.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.285+0000 7ff8a9e00640 1 -- start start 2024-09-10T23:25:49.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.285+0000 7ff8a9e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff8a4104df0 0x7ff8a419b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:49.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.285+0000 7ff8a9e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8a410a800 0x7ff8a419b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:49.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.285+0000 7ff8a9e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8a410b180 0x7ff8a41a0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:49.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.285+0000 7ff8a9e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a4114c80 con 0x7ff8a4104df0 2024-09-10T23:25:49.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.285+0000 7ff8a9e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a4114b00 con 0x7ff8a410a800 2024-09-10T23:25:49.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.285+0000 7ff8a9e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a4114e00 con 0x7ff8a410b180 2024-09-10T23:25:49.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.286+0000 7ff8a8a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff8a4104df0 0x7ff8a419b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:49.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.286+0000 7ff8a8a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff8a4104df0 0x7ff8a419b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43430/0 (socket says 172.21.15.3:43430) 2024-09-10T23:25:49.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.286+0000 7ff8a8a00640 1 -- 172.21.15.3:0/2220146043 learned_addr learned my addr 172.21.15.3:0/2220146043 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:49.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.286+0000 7ff89be00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8a410a800 0x7ff8a419b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:49.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.286+0000 7ff8a9400640 1 --2- 172.21.15.3:0/2220146043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8a410b180 0x7ff8a41a0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:49.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.286+0000 7ff8a8a00640 1 -- 172.21.15.3:0/2220146043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8a410b180 msgr2=0x7ff8a41a0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:49.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.286+0000 7ff8a8a00640 1 --2- 172.21.15.3:0/2220146043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8a410b180 0x7ff8a41a0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:49.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.286+0000 7ff8a8a00640 1 -- 172.21.15.3:0/2220146043 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8a410a800 msgr2=0x7ff8a419b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:49.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.286+0000 7ff8a8a00640 1 --2- 172.21.15.3:0/2220146043 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8a410a800 0x7ff8a419b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:49.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.286+0000 7ff8a8a00640 1 -- 172.21.15.3:0/2220146043 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8a41a11e0 con 0x7ff8a4104df0 2024-09-10T23:25:49.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.287+0000 7ff8a8a00640 1 --2- 172.21.15.3:0/2220146043 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff8a4104df0 0x7ff8a419b130 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff89400d950 tx=0x7ff89400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:49.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.287+0000 7ff8a2000640 1 -- 172.21.15.3:0/2220146043 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff894017030 con 0x7ff8a4104df0 2024-09-10T23:25:49.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.287+0000 7ff8a2000640 1 -- 172.21.15.3:0/2220146043 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff894004020 con 0x7ff8a4104df0 2024-09-10T23:25:49.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.287+0000 7ff8a9e00640 1 -- 172.21.15.3:0/2220146043 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8a41a14d0 con 0x7ff8a4104df0 2024-09-10T23:25:49.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.287+0000 7ff8a2000640 1 -- 172.21.15.3:0/2220146043 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8940055d0 con 0x7ff8a4104df0 2024-09-10T23:25:49.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.287+0000 7ff8a9e00640 1 -- 172.21.15.3:0/2220146043 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8a41a7b90 con 0x7ff8a4104df0 2024-09-10T23:25:49.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.289+0000 7ff8a9e00640 1 -- 172.21.15.3:0/2220146043 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8a41051d0 con 0x7ff8a4104df0 2024-09-10T23:25:49.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.291+0000 7ff8a2000640 1 -- 172.21.15.3:0/2220146043 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7ff894009a30 con 0x7ff8a4104df0 2024-09-10T23:25:49.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.293+0000 7ff8a2000640 1 --2- 172.21.15.3:0/2220146043 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff8880b5460 0x7ff8880b7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:49.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.293+0000 7ff8a2000640 1 -- 172.21.15.3:0/2220146043 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7ff8940e62f0 con 0x7ff8a4104df0 2024-09-10T23:25:49.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.294+0000 7ff89be00640 1 --2- 172.21.15.3:0/2220146043 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff8880b5460 0x7ff8880b7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:49.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.294+0000 7ff8a2000640 1 -- 172.21.15.3:0/2220146043 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff8940acb60 con 0x7ff8a4104df0 2024-09-10T23:25:49.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.295+0000 7ff89be00640 1 --2- 172.21.15.3:0/2220146043 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff8880b5460 0x7ff8880b7920 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff88c0057c0 tx=0x7ff88c0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:49.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.500+0000 7ff8a9e00640 1 -- 172.21.15.3:0/2220146043 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7ff8a419c260 con 0x7ff8a4104df0 2024-09-10T23:25:49.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.500+0000 7ff8a2000640 1 -- 172.21.15.3:0/2220146043 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff8a419c260 con 0x7ff8a4104df0 2024-09-10T23:25:49.502 INFO:teuthology.orchestra.run.smithi003.stdout:257698037809 2024-09-10T23:25:49.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.503+0000 7ff8a9e00640 1 -- 172.21.15.3:0/2220146043 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff8880b5460 msgr2=0x7ff8880b7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:49.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.503+0000 7ff8a9e00640 1 --2- 172.21.15.3:0/2220146043 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff8880b5460 0x7ff8880b7920 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff88c0057c0 tx=0x7ff88c0058d0 comp rx=0 tx=0).stop 2024-09-10T23:25:49.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.503+0000 7ff8a9e00640 1 -- 172.21.15.3:0/2220146043 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff8a4104df0 msgr2=0x7ff8a419b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:49.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.503+0000 7ff8a9e00640 1 --2- 172.21.15.3:0/2220146043 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff8a4104df0 0x7ff8a419b130 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff89400d950 tx=0x7ff89400de10 comp rx=0 tx=0).stop 2024-09-10T23:25:49.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.503+0000 7ff8a9e00640 1 -- 172.21.15.3:0/2220146043 shutdown_connections 2024-09-10T23:25:49.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.503+0000 7ff8a9e00640 1 --2- 172.21.15.3:0/2220146043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8a410b180 0x7ff8a41a0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:49.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.503+0000 7ff8a9e00640 1 --2- 172.21.15.3:0/2220146043 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8a410a800 0x7ff8a419b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:49.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.503+0000 7ff8a9e00640 1 --2- 172.21.15.3:0/2220146043 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff8880b5460 0x7ff8880b7920 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:49.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.503+0000 7ff8a9e00640 1 --2- 172.21.15.3:0/2220146043 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff8a4104df0 0x7ff8a419b130 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:49.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.503+0000 7ff8a9e00640 1 -- 172.21.15.3:0/2220146043 >> 172.21.15.3:0/2220146043 conn(0x7ff8a4100840 msgr2=0x7ff8a4102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:49.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.503+0000 7ff8a9e00640 1 -- 172.21.15.3:0/2220146043 shutdown_connections 2024-09-10T23:25:49.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.503+0000 7ff8a9e00640 1 -- 172.21.15.3:0/2220146043 wait complete. 2024-09-10T23:25:49.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.967+0000 7faa4d600640 1 -- 172.21.15.3:0/316605769 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa48104df0 msgr2=0x7faa481051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:49.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.967+0000 7faa4d600640 1 --2- 172.21.15.3:0/316605769 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa48104df0 0x7faa481051d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7faa38009900 tx=0x7faa3802a3f0 comp rx=0 tx=0).stop 2024-09-10T23:25:49.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.968+0000 7faa4d600640 1 -- 172.21.15.3:0/316605769 shutdown_connections 2024-09-10T23:25:49.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.968+0000 7faa4d600640 1 --2- 172.21.15.3:0/316605769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa4810b180 0x7faa48111980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:49.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.968+0000 7faa4d600640 1 --2- 172.21.15.3:0/316605769 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa4810a800 0x7faa4810ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:49.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.968+0000 7faa4d600640 1 --2- 172.21.15.3:0/316605769 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa48104df0 0x7faa481051d0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:49.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.968+0000 7faa4d600640 1 -- 172.21.15.3:0/316605769 >> 172.21.15.3:0/316605769 conn(0x7faa48100840 msgr2=0x7faa48102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:49.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.968+0000 7faa4d600640 1 -- 172.21.15.3:0/316605769 shutdown_connections 2024-09-10T23:25:49.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.968+0000 7faa4d600640 1 -- 172.21.15.3:0/316605769 wait complete. 2024-09-10T23:25:49.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.969+0000 7faa4d600640 1 Processor -- start 2024-09-10T23:25:49.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.969+0000 7faa4d600640 1 -- start start 2024-09-10T23:25:49.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.969+0000 7faa4d600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa48104df0 0x7faa4819b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:49.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.969+0000 7faa4d600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa4810a800 0x7faa4819b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:49.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.969+0000 7faa4d600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa4810b180 0x7faa481a09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:49.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.969+0000 7faa4d600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7faa48114cf0 con 0x7faa4810a800 2024-09-10T23:25:49.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.969+0000 7faa4d600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7faa48114b70 con 0x7faa4810b180 2024-09-10T23:25:49.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.969+0000 7faa4d600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7faa48114e70 con 0x7faa48104df0 2024-09-10T23:25:49.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.970+0000 7faa3f400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa4810a800 0x7faa4819b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:49.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.970+0000 7faa3f400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa4810a800 0x7faa4819b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43454/0 (socket says 172.21.15.3:43454) 2024-09-10T23:25:49.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.970+0000 7faa3f400640 1 -- 172.21.15.3:0/223295938 learned_addr learned my addr 172.21.15.3:0/223295938 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:49.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.970+0000 7faa47e00640 1 --2- 172.21.15.3:0/223295938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa48104df0 0x7faa4819b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:49.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.970+0000 7faa4cc00640 1 --2- 172.21.15.3:0/223295938 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa4810b180 0x7faa481a09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:49.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.970+0000 7faa3f400640 1 -- 172.21.15.3:0/223295938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa48104df0 msgr2=0x7faa4819b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:49.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.970+0000 7faa3f400640 1 --2- 172.21.15.3:0/223295938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa48104df0 0x7faa4819b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:49.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.970+0000 7faa3f400640 1 -- 172.21.15.3:0/223295938 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa4810b180 msgr2=0x7faa481a09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:49.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.970+0000 7faa3f400640 1 --2- 172.21.15.3:0/223295938 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa4810b180 0x7faa481a09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:49.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.970+0000 7faa3f400640 1 -- 172.21.15.3:0/223295938 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa481a11b0 con 0x7faa4810a800 2024-09-10T23:25:49.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.970+0000 7faa4cc00640 1 --2- 172.21.15.3:0/223295938 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa4810b180 0x7faa481a09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:49.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.971+0000 7faa3f400640 1 --2- 172.21.15.3:0/223295938 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa4810a800 0x7faa4819b640 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7faa3000d950 tx=0x7faa3000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:49.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.971+0000 7faa45600640 1 -- 172.21.15.3:0/223295938 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa30017070 con 0x7faa4810a800 2024-09-10T23:25:49.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.971+0000 7faa4d600640 1 -- 172.21.15.3:0/223295938 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa481a14a0 con 0x7faa4810a800 2024-09-10T23:25:49.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.971+0000 7faa45600640 1 -- 172.21.15.3:0/223295938 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa30009c30 con 0x7faa4810a800 2024-09-10T23:25:49.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.971+0000 7faa45600640 1 -- 172.21.15.3:0/223295938 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa30020060 con 0x7faa4810a800 2024-09-10T23:25:49.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.971+0000 7faa4d600640 1 -- 172.21.15.3:0/223295938 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa481a7d30 con 0x7faa4810a800 2024-09-10T23:25:49.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.972+0000 7faa4d600640 1 -- 172.21.15.3:0/223295938 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa481060a0 con 0x7faa4810a800 2024-09-10T23:25:49.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.977+0000 7faa45600640 1 -- 172.21.15.3:0/223295938 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7faa30010460 con 0x7faa4810a800 2024-09-10T23:25:49.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.979+0000 7faa45600640 1 --2- 172.21.15.3:0/223295938 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7faa2c0b54e0 0x7faa2c0b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:49.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.980+0000 7faa45600640 1 -- 172.21.15.3:0/223295938 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7faa300e6540 con 0x7faa4810a800 2024-09-10T23:25:49.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.980+0000 7faa47e00640 1 --2- 172.21.15.3:0/223295938 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7faa2c0b54e0 0x7faa2c0b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:49.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.980+0000 7faa45600640 1 -- 172.21.15.3:0/223295938 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7faa300e6960 con 0x7faa4810a800 2024-09-10T23:25:49.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:49.980+0000 7faa47e00640 1 --2- 172.21.15.3:0/223295938 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7faa2c0b54e0 0x7faa2c0b79a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7faa380057c0 tx=0x7faa380058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:50.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:50.179+0000 7faa4d600640 1 -- 172.21.15.3:0/223295938 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7faa481a7f00 con 0x7faa4810a800 2024-09-10T23:25:50.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:50.180+0000 7faa45600640 1 -- 172.21.15.3:0/223295938 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faa300acdb0 con 0x7faa4810a800 2024-09-10T23:25:50.181 INFO:teuthology.orchestra.run.smithi003.stdout:38654705766 2024-09-10T23:25:50.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:50.182+0000 7faa4d600640 1 -- 172.21.15.3:0/223295938 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7faa2c0b54e0 msgr2=0x7faa2c0b79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:50.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:50.182+0000 7faa4d600640 1 --2- 172.21.15.3:0/223295938 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7faa2c0b54e0 0x7faa2c0b79a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7faa380057c0 tx=0x7faa380058d0 comp rx=0 tx=0).stop 2024-09-10T23:25:50.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:50.182+0000 7faa4d600640 1 -- 172.21.15.3:0/223295938 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa4810a800 msgr2=0x7faa4819b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:50.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:50.182+0000 7faa4d600640 1 --2- 172.21.15.3:0/223295938 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa4810a800 0x7faa4819b640 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7faa3000d950 tx=0x7faa3000de10 comp rx=0 tx=0).stop 2024-09-10T23:25:50.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:50.182+0000 7faa4d600640 1 -- 172.21.15.3:0/223295938 shutdown_connections 2024-09-10T23:25:50.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:50.182+0000 7faa4d600640 1 --2- 172.21.15.3:0/223295938 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa4810b180 0x7faa481a09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:50.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:50.182+0000 7faa4d600640 1 --2- 172.21.15.3:0/223295938 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7faa2c0b54e0 0x7faa2c0b79a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:50.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:50.182+0000 7faa4d600640 1 --2- 172.21.15.3:0/223295938 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa4810a800 0x7faa4819b640 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:50.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:50.182+0000 7faa4d600640 1 --2- 172.21.15.3:0/223295938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa48104df0 0x7faa4819b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:50.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:50.182+0000 7faa4d600640 1 -- 172.21.15.3:0/223295938 >> 172.21.15.3:0/223295938 conn(0x7faa48100840 msgr2=0x7faa48102090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:50.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:50.183+0000 7faa4d600640 1 -- 172.21.15.3:0/223295938 shutdown_connections 2024-09-10T23:25:50.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:50.183+0000 7faa4d600640 1 -- 172.21.15.3:0/223295938 wait complete. 2024-09-10T23:25:50.430 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:50 smithi003 ceph-mon[30348]: pgmap v362: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:25:50.430 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:50 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2220146043' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-10T23:25:50.430 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:50 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/223295938' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-10T23:25:50.465 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037806 got 257698037809 for osd.9 2024-09-10T23:25:50.465 DEBUG:teuthology.parallel:result is None 2024-09-10T23:25:50.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:50 smithi038 ceph-mon[34225]: pgmap v362: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:25:50.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:50 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2220146043' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-10T23:25:50.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:50 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/223295938' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-10T23:25:50.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:50 smithi194 ceph-mon[33904]: pgmap v362: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:25:50.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:50 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2220146043' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-10T23:25:50.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:50 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/223295938' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-10T23:25:51.241 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705763 got 38654705766 for osd.0 2024-09-10T23:25:51.241 DEBUG:teuthology.parallel:result is None 2024-09-10T23:25:51.241 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T23:25:51.242 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T23:25:51.626 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:52.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.202+0000 7f2905600640 1 -- 172.21.15.3:0/125868427 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2900075f40 msgr2=0x7f290010ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:52.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.202+0000 7f2905600640 1 --2- 172.21.15.3:0/125868427 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2900075f40 0x7f290010ee10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f28e8009900 tx=0x7f28e802a410 comp rx=0 tx=0).stop 2024-09-10T23:25:52.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.202+0000 7f2905600640 1 -- 172.21.15.3:0/125868427 shutdown_connections 2024-09-10T23:25:52.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.202+0000 7f2905600640 1 --2- 172.21.15.3:0/125868427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f290010f3e0 0x7f29001117d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:52.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.202+0000 7f2905600640 1 --2- 172.21.15.3:0/125868427 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2900075f40 0x7f290010ee10 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:52.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.202+0000 7f2905600640 1 --2- 172.21.15.3:0/125868427 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2900075540 0x7f2900075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:52.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.202+0000 7f2905600640 1 -- 172.21.15.3:0/125868427 >> 172.21.15.3:0/125868427 conn(0x7f29000fe830 msgr2=0x7f2900100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:52.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.202+0000 7f2905600640 1 -- 172.21.15.3:0/125868427 shutdown_connections 2024-09-10T23:25:52.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.202+0000 7f2905600640 1 -- 172.21.15.3:0/125868427 wait complete. 2024-09-10T23:25:52.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.203+0000 7f2905600640 1 Processor -- start 2024-09-10T23:25:52.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.203+0000 7f2905600640 1 -- start start 2024-09-10T23:25:52.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.203+0000 7f2905600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2900075540 0x7f290019b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:52.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.203+0000 7f2905600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2900075f40 0x7f290019b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:52.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.203+0000 7f2905600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f290010f3e0 0x7f29001a0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:52.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.203+0000 7f2905600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2900114e80 con 0x7f290010f3e0 2024-09-10T23:25:52.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.203+0000 7f2905600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2900114d00 con 0x7f2900075f40 2024-09-10T23:25:52.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.203+0000 7f2905600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2900115000 con 0x7f2900075540 2024-09-10T23:25:52.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.204+0000 7f28ff400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f290010f3e0 0x7f29001a0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:52.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.204+0000 7f28ff400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f290010f3e0 0x7f29001a0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38754/0 (socket says 172.21.15.3:38754) 2024-09-10T23:25:52.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.204+0000 7f28ff400640 1 -- 172.21.15.3:0/3825664381 learned_addr learned my addr 172.21.15.3:0/3825664381 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:52.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.204+0000 7f28fea00640 1 --2- 172.21.15.3:0/3825664381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2900075540 0x7f290019b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:52.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.204+0000 7f28f7e00640 1 --2- 172.21.15.3:0/3825664381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2900075f40 0x7f290019b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:52.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.204+0000 7f28ff400640 1 -- 172.21.15.3:0/3825664381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2900075540 msgr2=0x7f290019b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:52.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.204+0000 7f28ff400640 1 --2- 172.21.15.3:0/3825664381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2900075540 0x7f290019b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:52.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.204+0000 7f28ff400640 1 -- 172.21.15.3:0/3825664381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2900075f40 msgr2=0x7f290019b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:52.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.204+0000 7f28ff400640 1 --2- 172.21.15.3:0/3825664381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2900075f40 0x7f290019b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:52.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.204+0000 7f28ff400640 1 -- 172.21.15.3:0/3825664381 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29001a14e0 con 0x7f290010f3e0 2024-09-10T23:25:52.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.204+0000 7f28ff400640 1 --2- 172.21.15.3:0/3825664381 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f290010f3e0 0x7f29001a0d10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f28f800e9d0 tx=0x7f28f800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:52.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.205+0000 7f28f7400640 1 -- 172.21.15.3:0/3825664381 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f800cd80 con 0x7f290010f3e0 2024-09-10T23:25:52.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.205+0000 7f28f7400640 1 -- 172.21.15.3:0/3825664381 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f28f8005020 con 0x7f290010f3e0 2024-09-10T23:25:52.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.205+0000 7f28f7400640 1 -- 172.21.15.3:0/3825664381 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f80116d0 con 0x7f290010f3e0 2024-09-10T23:25:52.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.205+0000 7f2905600640 1 -- 172.21.15.3:0/3825664381 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29001a17d0 con 0x7f290010f3e0 2024-09-10T23:25:52.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.205+0000 7f2905600640 1 -- 172.21.15.3:0/3825664381 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29001a7e90 con 0x7f290010f3e0 2024-09-10T23:25:52.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.206+0000 7f2905600640 1 -- 172.21.15.3:0/3825664381 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2900075920 con 0x7f290010f3e0 2024-09-10T23:25:52.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.208+0000 7f28f7400640 1 -- 172.21.15.3:0/3825664381 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7f28f800f040 con 0x7f290010f3e0 2024-09-10T23:25:52.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.209+0000 7f28f7400640 1 --2- 172.21.15.3:0/3825664381 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f28e40b53c0 0x7f28e40b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:52.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.210+0000 7f28f7400640 1 -- 172.21.15.3:0/3825664381 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f28f80e6480 con 0x7f290010f3e0 2024-09-10T23:25:52.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.210+0000 7f28fea00640 1 --2- 172.21.15.3:0/3825664381 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f28e40b53c0 0x7f28e40b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:52.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.210+0000 7f28fea00640 1 --2- 172.21.15.3:0/3825664381 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f28e40b53c0 0x7f28e40b7880 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f28f0009bd0 tx=0x7f28f0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:52.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.213+0000 7f28f7400640 1 -- 172.21.15.3:0/3825664381 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f28f8016030 con 0x7f290010f3e0 2024-09-10T23:25:52.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.408+0000 7f2905600640 1 -- 172.21.15.3:0/3825664381 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2900063590 con 0x7f28e40b53c0 2024-09-10T23:25:52.410 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:52 smithi003 ceph-mon[30348]: pgmap v363: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:25:52.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.415+0000 7f28f7400640 1 -- 172.21.15.3:0/3825664381 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340675 (secure 0 0 0) 0x7f2900063590 con 0x7f28e40b53c0 2024-09-10T23:25:52.417 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:25:52.424 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-10T23:25:52.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.419+0000 7f2905600640 1 -- 172.21.15.3:0/3825664381 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f28e40b53c0 msgr2=0x7f28e40b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:52.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.419+0000 7f2905600640 1 --2- 172.21.15.3:0/3825664381 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f28e40b53c0 0x7f28e40b7880 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f28f0009bd0 tx=0x7f28f0005f90 comp rx=0 tx=0).stop 2024-09-10T23:25:52.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.419+0000 7f2905600640 1 -- 172.21.15.3:0/3825664381 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f290010f3e0 msgr2=0x7f29001a0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:52.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.419+0000 7f2905600640 1 --2- 172.21.15.3:0/3825664381 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f290010f3e0 0x7f29001a0d10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f28f800e9d0 tx=0x7f28f800ee90 comp rx=0 tx=0).stop 2024-09-10T23:25:52.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.419+0000 7f2905600640 1 -- 172.21.15.3:0/3825664381 shutdown_connections 2024-09-10T23:25:52.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.419+0000 7f2905600640 1 --2- 172.21.15.3:0/3825664381 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f28e40b53c0 0x7f28e40b7880 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:52.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.419+0000 7f2905600640 1 --2- 172.21.15.3:0/3825664381 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f290010f3e0 0x7f29001a0d10 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:52.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.419+0000 7f2905600640 1 --2- 172.21.15.3:0/3825664381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2900075f40 0x7f290019b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:52.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.419+0000 7f2905600640 1 --2- 172.21.15.3:0/3825664381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2900075540 0x7f290019b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:52.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.419+0000 7f2905600640 1 -- 172.21.15.3:0/3825664381 >> 172.21.15.3:0/3825664381 conn(0x7f29000fe830 msgr2=0x7f29000ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:52.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.419+0000 7f2905600640 1 -- 172.21.15.3:0/3825664381 shutdown_connections 2024-09-10T23:25:52.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:52.419+0000 7f2905600640 1 -- 172.21.15.3:0/3825664381 wait complete. 2024-09-10T23:25:52.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:52 smithi038 ceph-mon[34225]: pgmap v363: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:25:52.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:52 smithi194 ceph-mon[33904]: pgmap v363: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:25:53.243 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":363,"stamp":"2024-09-10T23:25:50.778345+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656122,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":458,"num_read_kb":326,"num_write":288,"num_write_kb":2266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2951874,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":234,"ondisk_log_size":234,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365612,"kb_used_data":12140,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576212,"statfs":{"total":1151940427776,"available":1151566041088,"internally_reserved":0,"allocated":12431360,"data_stored":8366204,"data_compressed":505110,"data_compressed_allocated":688128,"data_compressed_original":2875392,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003310"},"pg_stats":[{"pgid":"2.1f","version":"88'9","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.145829+0000","last_change":"2024-09-10T23:23:54.796561+0000","last_active":"2024-09-10T23:25:22.145829+0000","last_peered":"2024-09-10T23:25:22.145829+0000","last_clean":"2024-09-10T23:25:22.145829+0000","last_became_active":"2024-09-10T23:23:54.796058+0000","last_became_peered":"2024-09-10T23:23:54.796058+0000","last_unstale":"2024-09-10T23:25:22.145829+0000","last_undegraded":"2024-09-10T23:25:22.145829+0000","last_fullsized":"2024-09-10T23:25:22.145829+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:27.790990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480812+0000","last_change":"2024-09-10T23:23:57.828660+0000","last_active":"2024-09-10T23:25:22.480812+0000","last_peered":"2024-09-10T23:25:22.480812+0000","last_clean":"2024-09-10T23:25:22.480812+0000","last_became_active":"2024-09-10T23:23:57.828287+0000","last_became_peered":"2024-09-10T23:23:57.828287+0000","last_unstale":"2024-09-10T23:25:22.480812+0000","last_undegraded":"2024-09-10T23:25:22.480812+0000","last_fullsized":"2024-09-10T23:25:22.480812+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:13.085003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.140355+0000","last_change":"2024-09-10T23:24:05.886167+0000","last_active":"2024-09-10T23:25:22.140355+0000","last_peered":"2024-09-10T23:25:22.140355+0000","last_clean":"2024-09-10T23:25:22.140355+0000","last_became_active":"2024-09-10T23:24:05.885706+0000","last_became_peered":"2024-09-10T23:24:05.885706+0000","last_unstale":"2024-09-10T23:25:22.140355+0000","last_undegraded":"2024-09-10T23:25:22.140355+0000","last_fullsized":"2024-09-10T23:25:22.140355+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:42.337384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480952+0000","last_change":"2024-09-10T23:23:54.791770+0000","last_active":"2024-09-10T23:25:22.480952+0000","last_peered":"2024-09-10T23:25:22.480952+0000","last_clean":"2024-09-10T23:25:22.480952+0000","last_became_active":"2024-09-10T23:23:54.791476+0000","last_became_peered":"2024-09-10T23:23:54.791476+0000","last_unstale":"2024-09-10T23:25:22.480952+0000","last_undegraded":"2024-09-10T23:25:22.480952+0000","last_fullsized":"2024-09-10T23:25:22.480952+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:07.493654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.479925+0000","last_change":"2024-09-10T23:23:57.833858+0000","last_active":"2024-09-10T23:25:22.479925+0000","last_peered":"2024-09-10T23:25:22.479925+0000","last_clean":"2024-09-10T23:25:22.479925+0000","last_became_active":"2024-09-10T23:23:57.833496+0000","last_became_peered":"2024-09-10T23:23:57.833496+0000","last_unstale":"2024-09-10T23:25:22.479925+0000","last_undegraded":"2024-09-10T23:25:22.479925+0000","last_fullsized":"2024-09-10T23:25:22.479925+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:48:50.293342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147289+0000","last_change":"2024-09-10T23:24:05.878733+0000","last_active":"2024-09-10T23:25:22.147289+0000","last_peered":"2024-09-10T23:25:22.147289+0000","last_clean":"2024-09-10T23:25:22.147289+0000","last_became_active":"2024-09-10T23:24:05.878285+0000","last_became_peered":"2024-09-10T23:24:05.878285+0000","last_unstale":"2024-09-10T23:25:22.147289+0000","last_undegraded":"2024-09-10T23:25:22.147289+0000","last_fullsized":"2024-09-10T23:25:22.147289+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:21:11.636292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.181551+0000","last_change":"2024-09-10T23:23:54.792253+0000","last_active":"2024-09-10T23:25:22.181551+0000","last_peered":"2024-09-10T23:25:22.181551+0000","last_clean":"2024-09-10T23:25:22.181551+0000","last_became_active":"2024-09-10T23:23:54.791847+0000","last_became_peered":"2024-09-10T23:23:54.791847+0000","last_unstale":"2024-09-10T23:25:22.181551+0000","last_undegraded":"2024-09-10T23:25:22.181551+0000","last_fullsized":"2024-09-10T23:25:22.181551+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:03.563741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481459+0000","last_change":"2024-09-10T23:23:57.837009+0000","last_active":"2024-09-10T23:25:22.481459+0000","last_peered":"2024-09-10T23:25:22.481459+0000","last_clean":"2024-09-10T23:25:22.481459+0000","last_became_active":"2024-09-10T23:23:57.835152+0000","last_became_peered":"2024-09-10T23:23:57.835152+0000","last_unstale":"2024-09-10T23:25:22.481459+0000","last_undegraded":"2024-09-10T23:25:22.481459+0000","last_fullsized":"2024-09-10T23:25:22.481459+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:25.345514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147405+0000","last_change":"2024-09-10T23:24:05.882593+0000","last_active":"2024-09-10T23:25:22.147405+0000","last_peered":"2024-09-10T23:25:22.147405+0000","last_clean":"2024-09-10T23:25:22.147405+0000","last_became_active":"2024-09-10T23:24:05.882123+0000","last_became_peered":"2024-09-10T23:24:05.882123+0000","last_unstale":"2024-09-10T23:25:22.147405+0000","last_undegraded":"2024-09-10T23:25:22.147405+0000","last_fullsized":"2024-09-10T23:25:22.147405+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:22:30.103412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.142081+0000","last_change":"2024-09-10T23:24:21.980433+0000","last_active":"2024-09-10T23:25:22.142081+0000","last_peered":"2024-09-10T23:25:22.142081+0000","last_clean":"2024-09-10T23:25:22.142081+0000","last_became_active":"2024-09-10T23:24:21.974096+0000","last_became_peered":"2024-09-10T23:24:21.974096+0000","last_unstale":"2024-09-10T23:25:22.142081+0000","last_undegraded":"2024-09-10T23:25:22.142081+0000","last_fullsized":"2024-09-10T23:25:22.142081+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:33.430921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144871+0000","last_change":"2024-09-10T23:24:21.978526+0000","last_active":"2024-09-10T23:25:22.144871+0000","last_peered":"2024-09-10T23:25:22.144871+0000","last_clean":"2024-09-10T23:25:22.144871+0000","last_became_active":"2024-09-10T23:24:21.978137+0000","last_became_peered":"2024-09-10T23:24:21.978137+0000","last_unstale":"2024-09-10T23:25:22.144871+0000","last_undegraded":"2024-09-10T23:25:22.144871+0000","last_fullsized":"2024-09-10T23:25:22.144871+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:53:31.785033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147243+0000","last_change":"2024-09-10T23:24:05.889983+0000","last_active":"2024-09-10T23:25:22.147243+0000","last_peered":"2024-09-10T23:25:22.147243+0000","last_clean":"2024-09-10T23:25:22.147243+0000","last_became_active":"2024-09-10T23:24:05.889003+0000","last_became_peered":"2024-09-10T23:24:05.889003+0000","last_unstale":"2024-09-10T23:25:22.147243+0000","last_undegraded":"2024-09-10T23:25:22.147243+0000","last_fullsized":"2024-09-10T23:25:22.147243+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:19:13.555187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480869+0000","last_change":"2024-09-10T23:23:57.831433+0000","last_active":"2024-09-10T23:25:22.480869+0000","last_peered":"2024-09-10T23:25:22.480869+0000","last_clean":"2024-09-10T23:25:22.480869+0000","last_became_active":"2024-09-10T23:23:57.831108+0000","last_became_peered":"2024-09-10T23:23:57.831108+0000","last_unstale":"2024-09-10T23:25:22.480869+0000","last_undegraded":"2024-09-10T23:25:22.480869+0000","last_fullsized":"2024-09-10T23:25:22.480869+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:50:20.160455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.181201+0000","last_change":"2024-09-10T23:23:54.792269+0000","last_active":"2024-09-10T23:25:22.181201+0000","last_peered":"2024-09-10T23:25:22.181201+0000","last_clean":"2024-09-10T23:25:22.181201+0000","last_became_active":"2024-09-10T23:23:54.791853+0000","last_became_peered":"2024-09-10T23:23:54.791853+0000","last_unstale":"2024-09-10T23:25:22.181201+0000","last_undegraded":"2024-09-10T23:25:22.181201+0000","last_fullsized":"2024-09-10T23:25:22.181201+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:43.020267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147560+0000","last_change":"2024-09-10T23:24:05.886155+0000","last_active":"2024-09-10T23:25:22.147560+0000","last_peered":"2024-09-10T23:25:22.147560+0000","last_clean":"2024-09-10T23:25:22.147560+0000","last_became_active":"2024-09-10T23:24:05.885674+0000","last_became_peered":"2024-09-10T23:24:05.885674+0000","last_unstale":"2024-09-10T23:25:22.147560+0000","last_undegraded":"2024-09-10T23:25:22.147560+0000","last_fullsized":"2024-09-10T23:25:22.147560+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:46:00.891311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480612+0000","last_change":"2024-09-10T23:23:57.830440+0000","last_active":"2024-09-10T23:25:22.480612+0000","last_peered":"2024-09-10T23:25:22.480612+0000","last_clean":"2024-09-10T23:25:22.480612+0000","last_became_active":"2024-09-10T23:23:57.829219+0000","last_became_peered":"2024-09-10T23:23:57.829219+0000","last_unstale":"2024-09-10T23:25:22.480612+0000","last_undegraded":"2024-09-10T23:25:22.480612+0000","last_fullsized":"2024-09-10T23:25:22.480612+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:28:15.696684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"88'1","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.141098+0000","last_change":"2024-09-10T23:23:54.796493+0000","last_active":"2024-09-10T23:25:22.141098+0000","last_peered":"2024-09-10T23:25:22.141098+0000","last_clean":"2024-09-10T23:25:22.141098+0000","last_became_active":"2024-09-10T23:23:54.796077+0000","last_became_peered":"2024-09-10T23:23:54.796077+0000","last_unstale":"2024-09-10T23:25:22.141098+0000","last_undegraded":"2024-09-10T23:25:22.141098+0000","last_fullsized":"2024-09-10T23:25:22.141098+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:13.054307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147642+0000","last_change":"2024-09-10T23:24:05.885557+0000","last_active":"2024-09-10T23:25:22.147642+0000","last_peered":"2024-09-10T23:25:22.147642+0000","last_clean":"2024-09-10T23:25:22.147642+0000","last_became_active":"2024-09-10T23:24:05.884773+0000","last_became_peered":"2024-09-10T23:24:05.884773+0000","last_unstale":"2024-09-10T23:25:22.147642+0000","last_undegraded":"2024-09-10T23:25:22.147642+0000","last_fullsized":"2024-09-10T23:25:22.147642+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:52.596822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.141743+0000","last_change":"2024-09-10T23:23:57.816395+0000","last_active":"2024-09-10T23:25:22.141743+0000","last_peered":"2024-09-10T23:25:22.141743+0000","last_clean":"2024-09-10T23:25:22.141743+0000","last_became_active":"2024-09-10T23:23:57.816047+0000","last_became_peered":"2024-09-10T23:23:57.816047+0000","last_unstale":"2024-09-10T23:25:22.141743+0000","last_undegraded":"2024-09-10T23:25:22.141743+0000","last_fullsized":"2024-09-10T23:25:22.141743+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:08:11.535738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480232+0000","last_change":"2024-09-10T23:23:54.795827+0000","last_active":"2024-09-10T23:25:22.480232+0000","last_peered":"2024-09-10T23:25:22.480232+0000","last_clean":"2024-09-10T23:25:22.480232+0000","last_became_active":"2024-09-10T23:23:54.794253+0000","last_became_peered":"2024-09-10T23:23:54.794253+0000","last_unstale":"2024-09-10T23:25:22.480232+0000","last_undegraded":"2024-09-10T23:25:22.480232+0000","last_fullsized":"2024-09-10T23:25:22.480232+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:27:27.988380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.145437+0000","last_change":"2024-09-10T23:24:05.889120+0000","last_active":"2024-09-10T23:25:22.145437+0000","last_peered":"2024-09-10T23:25:22.145437+0000","last_clean":"2024-09-10T23:25:22.145437+0000","last_became_active":"2024-09-10T23:24:05.888771+0000","last_became_peered":"2024-09-10T23:24:05.888771+0000","last_unstale":"2024-09-10T23:25:22.145437+0000","last_undegraded":"2024-09-10T23:25:22.145437+0000","last_fullsized":"2024-09-10T23:25:22.145437+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:55.414786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.180983+0000","last_change":"2024-09-10T23:23:57.814073+0000","last_active":"2024-09-10T23:25:22.180983+0000","last_peered":"2024-09-10T23:25:22.180983+0000","last_clean":"2024-09-10T23:25:22.180983+0000","last_became_active":"2024-09-10T23:23:57.813681+0000","last_became_peered":"2024-09-10T23:23:57.813681+0000","last_unstale":"2024-09-10T23:25:22.180983+0000","last_undegraded":"2024-09-10T23:25:22.180983+0000","last_fullsized":"2024-09-10T23:25:22.180983+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:44.129174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480329+0000","last_change":"2024-09-10T23:23:54.791119+0000","last_active":"2024-09-10T23:25:22.480329+0000","last_peered":"2024-09-10T23:25:22.480329+0000","last_clean":"2024-09-10T23:25:22.480329+0000","last_became_active":"2024-09-10T23:23:54.790770+0000","last_became_peered":"2024-09-10T23:23:54.790770+0000","last_unstale":"2024-09-10T23:25:22.480329+0000","last_undegraded":"2024-09-10T23:25:22.480329+0000","last_fullsized":"2024-09-10T23:25:22.480329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:35.015104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.183378+0000","last_change":"2024-09-10T23:25:22.183216+0000","last_active":"2024-09-10T23:25:22.183378+0000","last_peered":"2024-09-10T23:25:22.183378+0000","last_clean":"2024-09-10T23:25:22.183378+0000","last_became_active":"2024-09-10T23:25:22.182735+0000","last_became_peered":"2024-09-10T23:25:22.182735+0000","last_unstale":"2024-09-10T23:25:22.183378+0000","last_undegraded":"2024-09-10T23:25:22.183378+0000","last_fullsized":"2024-09-10T23:25:22.183378+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:39:53.143633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480325+0000","last_change":"2024-09-10T23:24:21.976169+0000","last_active":"2024-09-10T23:25:22.480325+0000","last_peered":"2024-09-10T23:25:22.480325+0000","last_clean":"2024-09-10T23:25:22.480325+0000","last_became_active":"2024-09-10T23:24:21.975330+0000","last_became_peered":"2024-09-10T23:24:21.975330+0000","last_unstale":"2024-09-10T23:25:22.480325+0000","last_undegraded":"2024-09-10T23:25:22.480325+0000","last_fullsized":"2024-09-10T23:25:22.480325+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:54:59.422630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147985+0000","last_change":"2024-09-10T23:23:55.082093+0000","last_active":"2024-09-10T23:25:22.147985+0000","last_peered":"2024-09-10T23:25:22.147985+0000","last_clean":"2024-09-10T23:25:22.147985+0000","last_became_active":"2024-09-10T23:23:55.081705+0000","last_became_peered":"2024-09-10T23:23:55.081705+0000","last_unstale":"2024-09-10T23:25:22.147985+0000","last_undegraded":"2024-09-10T23:25:22.147985+0000","last_fullsized":"2024-09-10T23:25:22.147985+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:01:04.150153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.140618+0000","last_change":"2024-09-10T23:24:05.880084+0000","last_active":"2024-09-10T23:25:22.140618+0000","last_peered":"2024-09-10T23:25:22.140618+0000","last_clean":"2024-09-10T23:25:22.140618+0000","last_became_active":"2024-09-10T23:24:05.879655+0000","last_became_peered":"2024-09-10T23:24:05.879655+0000","last_unstale":"2024-09-10T23:25:22.140618+0000","last_undegraded":"2024-09-10T23:25:22.140618+0000","last_fullsized":"2024-09-10T23:25:22.140618+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:01.473494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480176+0000","last_change":"2024-09-10T23:23:57.836207+0000","last_active":"2024-09-10T23:25:22.480176+0000","last_peered":"2024-09-10T23:25:22.480176+0000","last_clean":"2024-09-10T23:25:22.480176+0000","last_became_active":"2024-09-10T23:23:57.835801+0000","last_became_peered":"2024-09-10T23:23:57.835801+0000","last_unstale":"2024-09-10T23:25:22.480176+0000","last_undegraded":"2024-09-10T23:25:22.480176+0000","last_fullsized":"2024-09-10T23:25:22.480176+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:48:18.246508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'10","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.145745+0000","last_change":"2024-09-10T23:23:54.798126+0000","last_active":"2024-09-10T23:25:22.145745+0000","last_peered":"2024-09-10T23:25:22.145745+0000","last_clean":"2024-09-10T23:25:22.145745+0000","last_became_active":"2024-09-10T23:23:54.797755+0000","last_became_peered":"2024-09-10T23:23:54.797755+0000","last_unstale":"2024-09-10T23:25:22.145745+0000","last_undegraded":"2024-09-10T23:25:22.145745+0000","last_fullsized":"2024-09-10T23:25:22.145745+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:54.474382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.479704+0000","last_change":"2024-09-10T23:24:05.886431+0000","last_active":"2024-09-10T23:25:22.479704+0000","last_peered":"2024-09-10T23:25:22.479704+0000","last_clean":"2024-09-10T23:25:22.479704+0000","last_became_active":"2024-09-10T23:24:05.885962+0000","last_became_peered":"2024-09-10T23:24:05.885962+0000","last_unstale":"2024-09-10T23:25:22.479704+0000","last_undegraded":"2024-09-10T23:25:22.479704+0000","last_fullsized":"2024-09-10T23:25:22.479704+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:32.568553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.139683+0000","last_change":"2024-09-10T23:23:57.825790+0000","last_active":"2024-09-10T23:25:22.139683+0000","last_peered":"2024-09-10T23:25:22.139683+0000","last_clean":"2024-09-10T23:25:22.139683+0000","last_became_active":"2024-09-10T23:23:57.825510+0000","last_became_peered":"2024-09-10T23:23:57.825510+0000","last_unstale":"2024-09-10T23:25:22.139683+0000","last_undegraded":"2024-09-10T23:25:22.139683+0000","last_fullsized":"2024-09-10T23:25:22.139683+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:43.816144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.181604+0000","last_change":"2024-09-10T23:23:54.791957+0000","last_active":"2024-09-10T23:25:22.181604+0000","last_peered":"2024-09-10T23:25:22.181604+0000","last_clean":"2024-09-10T23:25:22.181604+0000","last_became_active":"2024-09-10T23:23:54.791607+0000","last_became_peered":"2024-09-10T23:23:54.791607+0000","last_unstale":"2024-09-10T23:25:22.181604+0000","last_undegraded":"2024-09-10T23:25:22.181604+0000","last_fullsized":"2024-09-10T23:25:22.181604+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:00:47.600299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.142008+0000","last_change":"2024-09-10T23:24:05.884275+0000","last_active":"2024-09-10T23:25:22.142008+0000","last_peered":"2024-09-10T23:25:22.142008+0000","last_clean":"2024-09-10T23:25:22.142008+0000","last_became_active":"2024-09-10T23:24:05.882340+0000","last_became_peered":"2024-09-10T23:24:05.882340+0000","last_unstale":"2024-09-10T23:25:22.142008+0000","last_undegraded":"2024-09-10T23:25:22.142008+0000","last_fullsized":"2024-09-10T23:25:22.142008+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:15.243993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.149679+0000","last_change":"2024-09-10T23:23:57.828322+0000","last_active":"2024-09-10T23:25:22.149679+0000","last_peered":"2024-09-10T23:25:22.149679+0000","last_clean":"2024-09-10T23:25:22.149679+0000","last_became_active":"2024-09-10T23:23:57.827925+0000","last_became_peered":"2024-09-10T23:23:57.827925+0000","last_unstale":"2024-09-10T23:25:22.149679+0000","last_undegraded":"2024-09-10T23:25:22.149679+0000","last_fullsized":"2024-09-10T23:25:22.149679+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:55.214207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144951+0000","last_change":"2024-09-10T23:23:54.789507+0000","last_active":"2024-09-10T23:25:22.144951+0000","last_peered":"2024-09-10T23:25:22.144951+0000","last_clean":"2024-09-10T23:25:22.144951+0000","last_became_active":"2024-09-10T23:23:54.789120+0000","last_became_peered":"2024-09-10T23:23:54.789120+0000","last_unstale":"2024-09-10T23:25:22.144951+0000","last_undegraded":"2024-09-10T23:25:22.144951+0000","last_fullsized":"2024-09-10T23:25:22.144951+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:58.033953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.181053+0000","last_change":"2024-09-10T23:24:05.881015+0000","last_active":"2024-09-10T23:25:22.181053+0000","last_peered":"2024-09-10T23:25:22.181053+0000","last_clean":"2024-09-10T23:25:22.181053+0000","last_became_active":"2024-09-10T23:24:05.880261+0000","last_became_peered":"2024-09-10T23:24:05.880261+0000","last_unstale":"2024-09-10T23:25:22.181053+0000","last_undegraded":"2024-09-10T23:25:22.181053+0000","last_fullsized":"2024-09-10T23:25:22.181053+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:13:36.937503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.149320+0000","last_change":"2024-09-10T23:23:57.842018+0000","last_active":"2024-09-10T23:25:22.149320+0000","last_peered":"2024-09-10T23:25:22.149320+0000","last_clean":"2024-09-10T23:25:22.149320+0000","last_became_active":"2024-09-10T23:23:57.841669+0000","last_became_peered":"2024-09-10T23:23:57.841669+0000","last_unstale":"2024-09-10T23:25:22.149320+0000","last_undegraded":"2024-09-10T23:25:22.149320+0000","last_fullsized":"2024-09-10T23:25:22.149320+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:11.619741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481048+0000","last_change":"2024-09-10T23:23:54.794565+0000","last_active":"2024-09-10T23:25:22.481048+0000","last_peered":"2024-09-10T23:25:22.481048+0000","last_clean":"2024-09-10T23:25:22.481048+0000","last_became_active":"2024-09-10T23:23:54.793794+0000","last_became_peered":"2024-09-10T23:23:54.793794+0000","last_unstale":"2024-09-10T23:25:22.481048+0000","last_undegraded":"2024-09-10T23:25:22.481048+0000","last_fullsized":"2024-09-10T23:25:22.481048+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:42.665924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.139440+0000","last_change":"2024-09-10T23:24:05.883706+0000","last_active":"2024-09-10T23:25:22.139440+0000","last_peered":"2024-09-10T23:25:22.139440+0000","last_clean":"2024-09-10T23:25:22.139440+0000","last_became_active":"2024-09-10T23:24:05.881621+0000","last_became_peered":"2024-09-10T23:24:05.881621+0000","last_unstale":"2024-09-10T23:25:22.139440+0000","last_undegraded":"2024-09-10T23:25:22.139440+0000","last_fullsized":"2024-09-10T23:25:22.139440+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:23.468331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.143529+0000","last_change":"2024-09-10T23:23:57.834504+0000","last_active":"2024-09-10T23:25:22.143529+0000","last_peered":"2024-09-10T23:25:22.143529+0000","last_clean":"2024-09-10T23:25:22.143529+0000","last_became_active":"2024-09-10T23:23:57.834105+0000","last_became_peered":"2024-09-10T23:23:57.834105+0000","last_unstale":"2024-09-10T23:25:22.143529+0000","last_undegraded":"2024-09-10T23:25:22.143529+0000","last_fullsized":"2024-09-10T23:25:22.143529+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:03.539763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'4","reported_seq":108,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:46.351812+0000","last_change":"2024-09-10T23:23:54.796519+0000","last_active":"2024-09-10T23:25:46.351812+0000","last_peered":"2024-09-10T23:25:46.351812+0000","last_clean":"2024-09-10T23:25:46.351812+0000","last_became_active":"2024-09-10T23:23:54.795174+0000","last_became_peered":"2024-09-10T23:23:54.795174+0000","last_unstale":"2024-09-10T23:25:46.351812+0000","last_undegraded":"2024-09-10T23:25:46.351812+0000","last_fullsized":"2024-09-10T23:25:46.351812+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:53.622935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":59,"num_read_kb":59,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.140492+0000","last_change":"2024-09-10T23:24:05.884496+0000","last_active":"2024-09-10T23:25:22.140492+0000","last_peered":"2024-09-10T23:25:22.140492+0000","last_clean":"2024-09-10T23:25:22.140492+0000","last_became_active":"2024-09-10T23:24:05.883659+0000","last_became_peered":"2024-09-10T23:24:05.883659+0000","last_unstale":"2024-09-10T23:25:22.140492+0000","last_undegraded":"2024-09-10T23:25:22.140492+0000","last_fullsized":"2024-09-10T23:25:22.140492+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:23.449830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.138936+0000","last_change":"2024-09-10T23:23:57.842436+0000","last_active":"2024-09-10T23:25:22.138936+0000","last_peered":"2024-09-10T23:25:22.138936+0000","last_clean":"2024-09-10T23:25:22.138936+0000","last_became_active":"2024-09-10T23:23:57.842054+0000","last_became_peered":"2024-09-10T23:23:57.842054+0000","last_unstale":"2024-09-10T23:25:22.138936+0000","last_undegraded":"2024-09-10T23:25:22.138936+0000","last_fullsized":"2024-09-10T23:25:22.138936+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:07.234201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481584+0000","last_change":"2024-09-10T23:24:21.974615+0000","last_active":"2024-09-10T23:25:22.481584+0000","last_peered":"2024-09-10T23:25:22.481584+0000","last_clean":"2024-09-10T23:25:22.481584+0000","last_became_active":"2024-09-10T23:24:21.974129+0000","last_became_peered":"2024-09-10T23:24:21.974129+0000","last_unstale":"2024-09-10T23:25:22.481584+0000","last_undegraded":"2024-09-10T23:25:22.481584+0000","last_fullsized":"2024-09-10T23:25:22.481584+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:11.510005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.151414+0000","last_change":"2024-09-10T23:25:22.151288+0000","last_active":"2024-09-10T23:25:22.151414+0000","last_peered":"2024-09-10T23:25:22.151414+0000","last_clean":"2024-09-10T23:25:22.151414+0000","last_became_active":"2024-09-10T23:25:22.150800+0000","last_became_peered":"2024-09-10T23:25:22.150800+0000","last_unstale":"2024-09-10T23:25:22.151414+0000","last_undegraded":"2024-09-10T23:25:22.151414+0000","last_fullsized":"2024-09-10T23:25:22.151414+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:56.974242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480432+0000","last_change":"2024-09-10T23:23:57.828722+0000","last_active":"2024-09-10T23:25:22.480432+0000","last_peered":"2024-09-10T23:25:22.480432+0000","last_clean":"2024-09-10T23:25:22.480432+0000","last_became_active":"2024-09-10T23:23:57.828373+0000","last_became_peered":"2024-09-10T23:23:57.828373+0000","last_unstale":"2024-09-10T23:25:22.480432+0000","last_undegraded":"2024-09-10T23:25:22.480432+0000","last_fullsized":"2024-09-10T23:25:22.480432+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:19.891684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147833+0000","last_change":"2024-09-10T23:23:54.789584+0000","last_active":"2024-09-10T23:25:22.147833+0000","last_peered":"2024-09-10T23:25:22.147833+0000","last_clean":"2024-09-10T23:25:22.147833+0000","last_became_active":"2024-09-10T23:23:54.789166+0000","last_became_peered":"2024-09-10T23:23:54.789166+0000","last_unstale":"2024-09-10T23:25:22.147833+0000","last_undegraded":"2024-09-10T23:25:22.147833+0000","last_fullsized":"2024-09-10T23:25:22.147833+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:02.292384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":121,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481682+0000","last_change":"2024-09-10T23:22:28.076475+0000","last_active":"2024-09-10T23:25:22.481682+0000","last_peered":"2024-09-10T23:25:22.481682+0000","last_clean":"2024-09-10T23:25:22.481682+0000","last_became_active":"2024-09-10T23:22:28.070622+0000","last_became_peered":"2024-09-10T23:22:28.070622+0000","last_unstale":"2024-09-10T23:25:22.481682+0000","last_undegraded":"2024-09-10T23:25:22.481682+0000","last_fullsized":"2024-09-10T23:25:22.481682+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:28.022462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:28.022462+0000","last_clean_scrub_stamp":"2024-09-10T23:18:28.022462+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:46:16.329399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481348+0000","last_change":"2024-09-10T23:24:05.884647+0000","last_active":"2024-09-10T23:25:22.481348+0000","last_peered":"2024-09-10T23:25:22.481348+0000","last_clean":"2024-09-10T23:25:22.481348+0000","last_became_active":"2024-09-10T23:24:05.883476+0000","last_became_peered":"2024-09-10T23:24:05.883476+0000","last_unstale":"2024-09-10T23:25:22.481348+0000","last_undegraded":"2024-09-10T23:25:22.481348+0000","last_fullsized":"2024-09-10T23:25:22.481348+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:02.524767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481749+0000","last_change":"2024-09-10T23:23:57.840835+0000","last_active":"2024-09-10T23:25:22.481749+0000","last_peered":"2024-09-10T23:25:22.481749+0000","last_clean":"2024-09-10T23:25:22.481749+0000","last_became_active":"2024-09-10T23:23:57.840472+0000","last_became_peered":"2024-09-10T23:23:57.840472+0000","last_unstale":"2024-09-10T23:25:22.481749+0000","last_undegraded":"2024-09-10T23:25:22.481749+0000","last_fullsized":"2024-09-10T23:25:22.481749+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:18.050686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.141231+0000","last_change":"2024-09-10T23:23:55.081669+0000","last_active":"2024-09-10T23:25:22.141231+0000","last_peered":"2024-09-10T23:25:22.141231+0000","last_clean":"2024-09-10T23:25:22.141231+0000","last_became_active":"2024-09-10T23:23:55.081306+0000","last_became_peered":"2024-09-10T23:23:55.081306+0000","last_unstale":"2024-09-10T23:25:22.141231+0000","last_undegraded":"2024-09-10T23:25:22.141231+0000","last_fullsized":"2024-09-10T23:25:22.141231+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:54.968431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480474+0000","last_change":"2024-09-10T23:24:05.880876+0000","last_active":"2024-09-10T23:25:22.480474+0000","last_peered":"2024-09-10T23:25:22.480474+0000","last_clean":"2024-09-10T23:25:22.480474+0000","last_became_active":"2024-09-10T23:24:05.880504+0000","last_became_peered":"2024-09-10T23:24:05.880504+0000","last_unstale":"2024-09-10T23:25:22.480474+0000","last_undegraded":"2024-09-10T23:25:22.480474+0000","last_fullsized":"2024-09-10T23:25:22.480474+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:17:55.689134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480659+0000","last_change":"2024-09-10T23:23:57.826637+0000","last_active":"2024-09-10T23:25:22.480659+0000","last_peered":"2024-09-10T23:25:22.480659+0000","last_clean":"2024-09-10T23:25:22.480659+0000","last_became_active":"2024-09-10T23:23:57.825915+0000","last_became_peered":"2024-09-10T23:23:57.825915+0000","last_unstale":"2024-09-10T23:25:22.480659+0000","last_undegraded":"2024-09-10T23:25:22.480659+0000","last_fullsized":"2024-09-10T23:25:22.480659+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:55.281687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.145088+0000","last_change":"2024-09-10T23:23:54.789847+0000","last_active":"2024-09-10T23:25:22.145088+0000","last_peered":"2024-09-10T23:25:22.145088+0000","last_clean":"2024-09-10T23:25:22.145088+0000","last_became_active":"2024-09-10T23:23:54.789082+0000","last_became_peered":"2024-09-10T23:23:54.789082+0000","last_unstale":"2024-09-10T23:25:22.145088+0000","last_undegraded":"2024-09-10T23:25:22.145088+0000","last_fullsized":"2024-09-10T23:25:22.145088+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:39:16.162317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.479703+0000","last_change":"2024-09-10T23:24:05.895799+0000","last_active":"2024-09-10T23:25:22.479703+0000","last_peered":"2024-09-10T23:25:22.479703+0000","last_clean":"2024-09-10T23:25:22.479703+0000","last_became_active":"2024-09-10T23:24:05.895361+0000","last_became_peered":"2024-09-10T23:24:05.895361+0000","last_unstale":"2024-09-10T23:25:22.479703+0000","last_undegraded":"2024-09-10T23:25:22.479703+0000","last_fullsized":"2024-09-10T23:25:22.479703+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:10.893000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480931+0000","last_change":"2024-09-10T23:23:57.834954+0000","last_active":"2024-09-10T23:25:22.480931+0000","last_peered":"2024-09-10T23:25:22.480931+0000","last_clean":"2024-09-10T23:25:22.480931+0000","last_became_active":"2024-09-10T23:23:57.834215+0000","last_became_peered":"2024-09-10T23:23:57.834215+0000","last_unstale":"2024-09-10T23:25:22.480931+0000","last_undegraded":"2024-09-10T23:25:22.480931+0000","last_fullsized":"2024-09-10T23:25:22.480931+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:19:42.051352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":58,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.140237+0000","last_change":"2024-09-10T23:24:22.301029+0000","last_active":"2024-09-10T23:25:22.140237+0000","last_peered":"2024-09-10T23:25:22.140237+0000","last_clean":"2024-09-10T23:25:22.140237+0000","last_became_active":"2024-09-10T23:24:22.297759+0000","last_became_peered":"2024-09-10T23:24:22.297759+0000","last_unstale":"2024-09-10T23:25:22.140237+0000","last_undegraded":"2024-09-10T23:25:22.140237+0000","last_fullsized":"2024-09-10T23:25:22.140237+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:05.364737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.143389+0000","last_change":"2024-09-10T23:24:05.884172+0000","last_active":"2024-09-10T23:25:22.143389+0000","last_peered":"2024-09-10T23:25:22.143389+0000","last_clean":"2024-09-10T23:25:22.143389+0000","last_became_active":"2024-09-10T23:24:05.881918+0000","last_became_peered":"2024-09-10T23:24:05.881918+0000","last_unstale":"2024-09-10T23:25:22.143389+0000","last_undegraded":"2024-09-10T23:25:22.143389+0000","last_fullsized":"2024-09-10T23:25:22.143389+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:19:15.250926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.142130+0000","last_change":"2024-09-10T23:24:22.297163+0000","last_active":"2024-09-10T23:25:22.142130+0000","last_peered":"2024-09-10T23:25:22.142130+0000","last_clean":"2024-09-10T23:25:22.142130+0000","last_became_active":"2024-09-10T23:24:22.296751+0000","last_became_peered":"2024-09-10T23:24:22.296751+0000","last_unstale":"2024-09-10T23:25:22.142130+0000","last_undegraded":"2024-09-10T23:25:22.142130+0000","last_fullsized":"2024-09-10T23:25:22.142130+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:37:50.379101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.181396+0000","last_change":"2024-09-10T23:23:54.788008+0000","last_active":"2024-09-10T23:25:22.181396+0000","last_peered":"2024-09-10T23:25:22.181396+0000","last_clean":"2024-09-10T23:25:22.181396+0000","last_became_active":"2024-09-10T23:23:54.787702+0000","last_became_peered":"2024-09-10T23:23:54.787702+0000","last_unstale":"2024-09-10T23:25:22.181396+0000","last_undegraded":"2024-09-10T23:25:22.181396+0000","last_fullsized":"2024-09-10T23:25:22.181396+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:45.997467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144427+0000","last_change":"2024-09-10T23:24:05.887208+0000","last_active":"2024-09-10T23:25:22.144427+0000","last_peered":"2024-09-10T23:25:22.144427+0000","last_clean":"2024-09-10T23:25:22.144427+0000","last_became_active":"2024-09-10T23:24:05.885556+0000","last_became_peered":"2024-09-10T23:24:05.885556+0000","last_unstale":"2024-09-10T23:25:22.144427+0000","last_undegraded":"2024-09-10T23:25:22.144427+0000","last_fullsized":"2024-09-10T23:25:22.144427+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:21.843558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144204+0000","last_change":"2024-09-10T23:23:57.842937+0000","last_active":"2024-09-10T23:25:22.144204+0000","last_peered":"2024-09-10T23:25:22.144204+0000","last_clean":"2024-09-10T23:25:22.144204+0000","last_became_active":"2024-09-10T23:23:57.842158+0000","last_became_peered":"2024-09-10T23:23:57.842158+0000","last_unstale":"2024-09-10T23:25:22.144204+0000","last_undegraded":"2024-09-10T23:25:22.144204+0000","last_fullsized":"2024-09-10T23:25:22.144204+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:49:58.716816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.180981+0000","last_change":"2024-09-10T23:23:54.787515+0000","last_active":"2024-09-10T23:25:22.180981+0000","last_peered":"2024-09-10T23:25:22.180981+0000","last_clean":"2024-09-10T23:25:22.180981+0000","last_became_active":"2024-09-10T23:23:54.786950+0000","last_became_peered":"2024-09-10T23:23:54.786950+0000","last_unstale":"2024-09-10T23:25:22.180981+0000","last_undegraded":"2024-09-10T23:25:22.180981+0000","last_fullsized":"2024-09-10T23:25:22.180981+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:12.546459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.140060+0000","last_change":"2024-09-10T23:24:05.882784+0000","last_active":"2024-09-10T23:25:22.140060+0000","last_peered":"2024-09-10T23:25:22.140060+0000","last_clean":"2024-09-10T23:25:22.140060+0000","last_became_active":"2024-09-10T23:24:05.882331+0000","last_became_peered":"2024-09-10T23:24:05.882331+0000","last_unstale":"2024-09-10T23:25:22.140060+0000","last_undegraded":"2024-09-10T23:25:22.140060+0000","last_fullsized":"2024-09-10T23:25:22.140060+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:51:42.519144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481464+0000","last_change":"2024-09-10T23:23:57.827896+0000","last_active":"2024-09-10T23:25:22.481464+0000","last_peered":"2024-09-10T23:25:22.481464+0000","last_clean":"2024-09-10T23:25:22.481464+0000","last_became_active":"2024-09-10T23:23:57.827572+0000","last_became_peered":"2024-09-10T23:23:57.827572+0000","last_unstale":"2024-09-10T23:25:22.481464+0000","last_undegraded":"2024-09-10T23:25:22.481464+0000","last_fullsized":"2024-09-10T23:25:22.481464+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:11.126594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'4","reported_seq":111,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:46.352483+0000","last_change":"2024-09-10T23:23:54.795582+0000","last_active":"2024-09-10T23:25:46.352483+0000","last_peered":"2024-09-10T23:25:46.352483+0000","last_clean":"2024-09-10T23:25:46.352483+0000","last_became_active":"2024-09-10T23:23:54.795225+0000","last_became_peered":"2024-09-10T23:23:54.795225+0000","last_unstale":"2024-09-10T23:25:46.352483+0000","last_undegraded":"2024-09-10T23:25:46.352483+0000","last_fullsized":"2024-09-10T23:25:46.352483+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:11.827090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":63,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.483416+0000","last_change":"2024-09-10T23:25:22.483250+0000","last_active":"2024-09-10T23:25:22.483416+0000","last_peered":"2024-09-10T23:25:22.483416+0000","last_clean":"2024-09-10T23:25:22.483416+0000","last_became_active":"2024-09-10T23:25:22.482721+0000","last_became_peered":"2024-09-10T23:25:22.482721+0000","last_unstale":"2024-09-10T23:25:22.483416+0000","last_undegraded":"2024-09-10T23:25:22.483416+0000","last_fullsized":"2024-09-10T23:25:22.483416+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:41:31.732139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,7,0,3],"acting":[10,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480824+0000","last_change":"2024-09-10T23:23:57.843899+0000","last_active":"2024-09-10T23:25:22.480824+0000","last_peered":"2024-09-10T23:25:22.480824+0000","last_clean":"2024-09-10T23:25:22.480824+0000","last_became_active":"2024-09-10T23:23:57.843590+0000","last_became_peered":"2024-09-10T23:23:57.843590+0000","last_unstale":"2024-09-10T23:25:22.480824+0000","last_undegraded":"2024-09-10T23:25:22.480824+0000","last_fullsized":"2024-09-10T23:25:22.480824+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:32:17.919904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144367+0000","last_change":"2024-09-10T23:23:54.795091+0000","last_active":"2024-09-10T23:25:22.144367+0000","last_peered":"2024-09-10T23:25:22.144367+0000","last_clean":"2024-09-10T23:25:22.144367+0000","last_became_active":"2024-09-10T23:23:54.794726+0000","last_became_peered":"2024-09-10T23:23:54.794726+0000","last_unstale":"2024-09-10T23:25:22.144367+0000","last_undegraded":"2024-09-10T23:25:22.144367+0000","last_fullsized":"2024-09-10T23:25:22.144367+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:56:20.322532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.483398+0000","last_change":"2024-09-10T23:25:22.483252+0000","last_active":"2024-09-10T23:25:22.483398+0000","last_peered":"2024-09-10T23:25:22.483398+0000","last_clean":"2024-09-10T23:25:22.483398+0000","last_became_active":"2024-09-10T23:25:22.482719+0000","last_became_peered":"2024-09-10T23:25:22.482719+0000","last_unstale":"2024-09-10T23:25:22.483398+0000","last_undegraded":"2024-09-10T23:25:22.483398+0000","last_fullsized":"2024-09-10T23:25:22.483398+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:36.281256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.139402+0000","last_change":"2024-09-10T23:23:57.823729+0000","last_active":"2024-09-10T23:25:22.139402+0000","last_peered":"2024-09-10T23:25:22.139402+0000","last_clean":"2024-09-10T23:25:22.139402+0000","last_became_active":"2024-09-10T23:23:57.822797+0000","last_became_peered":"2024-09-10T23:23:57.822797+0000","last_unstale":"2024-09-10T23:25:22.139402+0000","last_undegraded":"2024-09-10T23:25:22.139402+0000","last_fullsized":"2024-09-10T23:25:22.139402+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:09.646543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.141877+0000","last_change":"2024-09-10T23:24:21.985389+0000","last_active":"2024-09-10T23:25:22.141877+0000","last_peered":"2024-09-10T23:25:22.141877+0000","last_clean":"2024-09-10T23:25:22.141877+0000","last_became_active":"2024-09-10T23:24:21.976084+0000","last_became_peered":"2024-09-10T23:24:21.976084+0000","last_unstale":"2024-09-10T23:25:22.141877+0000","last_undegraded":"2024-09-10T23:25:22.141877+0000","last_fullsized":"2024-09-10T23:25:22.141877+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:33.284211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144855+0000","last_change":"2024-09-10T23:24:05.890656+0000","last_active":"2024-09-10T23:25:22.144855+0000","last_peered":"2024-09-10T23:25:22.144855+0000","last_clean":"2024-09-10T23:25:22.144855+0000","last_became_active":"2024-09-10T23:24:05.889827+0000","last_became_peered":"2024-09-10T23:24:05.889827+0000","last_unstale":"2024-09-10T23:25:22.144855+0000","last_undegraded":"2024-09-10T23:25:22.144855+0000","last_fullsized":"2024-09-10T23:25:22.144855+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:15.301567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.181398+0000","last_change":"2024-09-10T23:23:57.827348+0000","last_active":"2024-09-10T23:25:22.181398+0000","last_peered":"2024-09-10T23:25:22.181398+0000","last_clean":"2024-09-10T23:25:22.181398+0000","last_became_active":"2024-09-10T23:23:57.826670+0000","last_became_peered":"2024-09-10T23:23:57.826670+0000","last_unstale":"2024-09-10T23:25:22.181398+0000","last_undegraded":"2024-09-10T23:25:22.181398+0000","last_fullsized":"2024-09-10T23:25:22.181398+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:19.268930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"88'31","reported_seq":199,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:46.351643+0000","last_change":"2024-09-10T23:23:54.789603+0000","last_active":"2024-09-10T23:25:46.351643+0000","last_peered":"2024-09-10T23:25:46.351643+0000","last_clean":"2024-09-10T23:25:46.351643+0000","last_became_active":"2024-09-10T23:23:54.789136+0000","last_became_peered":"2024-09-10T23:23:54.789136+0000","last_unstale":"2024-09-10T23:25:46.351643+0000","last_undegraded":"2024-09-10T23:25:46.351643+0000","last_fullsized":"2024-09-10T23:25:46.351643+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:47.648232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61519,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":121,"num_write":32,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144472+0000","last_change":"2024-09-10T23:24:05.883758+0000","last_active":"2024-09-10T23:25:22.144472+0000","last_peered":"2024-09-10T23:25:22.144472+0000","last_clean":"2024-09-10T23:25:22.144472+0000","last_became_active":"2024-09-10T23:24:05.883401+0000","last_became_peered":"2024-09-10T23:24:05.883401+0000","last_unstale":"2024-09-10T23:25:22.144472+0000","last_undegraded":"2024-09-10T23:25:22.144472+0000","last_fullsized":"2024-09-10T23:25:22.144472+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:52.862088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481581+0000","last_change":"2024-09-10T23:23:57.846524+0000","last_active":"2024-09-10T23:25:22.481581+0000","last_peered":"2024-09-10T23:25:22.481581+0000","last_clean":"2024-09-10T23:25:22.481581+0000","last_became_active":"2024-09-10T23:23:57.846036+0000","last_became_peered":"2024-09-10T23:23:57.846036+0000","last_unstale":"2024-09-10T23:25:22.481581+0000","last_undegraded":"2024-09-10T23:25:22.481581+0000","last_fullsized":"2024-09-10T23:25:22.481581+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:13.866827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.145087+0000","last_change":"2024-09-10T23:23:54.789925+0000","last_active":"2024-09-10T23:25:22.145087+0000","last_peered":"2024-09-10T23:25:22.145087+0000","last_clean":"2024-09-10T23:25:22.145087+0000","last_became_active":"2024-09-10T23:23:54.789600+0000","last_became_peered":"2024-09-10T23:23:54.789600+0000","last_unstale":"2024-09-10T23:25:22.145087+0000","last_undegraded":"2024-09-10T23:25:22.145087+0000","last_fullsized":"2024-09-10T23:25:22.145087+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:54.937422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147657+0000","last_change":"2024-09-10T23:24:05.882530+0000","last_active":"2024-09-10T23:25:22.147657+0000","last_peered":"2024-09-10T23:25:22.147657+0000","last_clean":"2024-09-10T23:25:22.147657+0000","last_became_active":"2024-09-10T23:24:05.881092+0000","last_became_peered":"2024-09-10T23:24:05.881092+0000","last_unstale":"2024-09-10T23:25:22.147657+0000","last_undegraded":"2024-09-10T23:25:22.147657+0000","last_fullsized":"2024-09-10T23:25:22.147657+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:54.954300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480022+0000","last_change":"2024-09-10T23:23:57.837341+0000","last_active":"2024-09-10T23:25:22.480022+0000","last_peered":"2024-09-10T23:25:22.480022+0000","last_clean":"2024-09-10T23:25:22.480022+0000","last_became_active":"2024-09-10T23:23:57.837024+0000","last_became_peered":"2024-09-10T23:23:57.837024+0000","last_unstale":"2024-09-10T23:25:22.480022+0000","last_undegraded":"2024-09-10T23:25:22.480022+0000","last_fullsized":"2024-09-10T23:25:22.480022+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:22:48.241471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481336+0000","last_change":"2024-09-10T23:23:54.792028+0000","last_active":"2024-09-10T23:25:22.481336+0000","last_peered":"2024-09-10T23:25:22.481336+0000","last_clean":"2024-09-10T23:25:22.481336+0000","last_became_active":"2024-09-10T23:23:54.791589+0000","last_became_peered":"2024-09-10T23:23:54.791589+0000","last_unstale":"2024-09-10T23:25:22.481336+0000","last_undegraded":"2024-09-10T23:25:22.481336+0000","last_fullsized":"2024-09-10T23:25:22.481336+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:48.589441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144159+0000","last_change":"2024-09-10T23:24:05.888627+0000","last_active":"2024-09-10T23:25:22.144159+0000","last_peered":"2024-09-10T23:25:22.144159+0000","last_clean":"2024-09-10T23:25:22.144159+0000","last_became_active":"2024-09-10T23:24:05.887925+0000","last_became_peered":"2024-09-10T23:24:05.887925+0000","last_unstale":"2024-09-10T23:25:22.144159+0000","last_undegraded":"2024-09-10T23:25:22.144159+0000","last_fullsized":"2024-09-10T23:25:22.144159+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:15.956333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481174+0000","last_change":"2024-09-10T23:23:57.833009+0000","last_active":"2024-09-10T23:25:22.481174+0000","last_peered":"2024-09-10T23:25:22.481174+0000","last_clean":"2024-09-10T23:25:22.481174+0000","last_became_active":"2024-09-10T23:23:57.830782+0000","last_became_peered":"2024-09-10T23:23:57.830782+0000","last_unstale":"2024-09-10T23:25:22.481174+0000","last_undegraded":"2024-09-10T23:25:22.481174+0000","last_fullsized":"2024-09-10T23:25:22.481174+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:42.520461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"88'3","reported_seq":106,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:45.350205+0000","last_change":"2024-09-10T23:23:54.789322+0000","last_active":"2024-09-10T23:25:45.350205+0000","last_peered":"2024-09-10T23:25:45.350205+0000","last_clean":"2024-09-10T23:25:45.350205+0000","last_became_active":"2024-09-10T23:23:54.788879+0000","last_became_peered":"2024-09-10T23:23:54.788879+0000","last_unstale":"2024-09-10T23:25:45.350205+0000","last_undegraded":"2024-09-10T23:25:45.350205+0000","last_fullsized":"2024-09-10T23:25:45.350205+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:37.276413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480113+0000","last_change":"2024-09-10T23:24:05.886626+0000","last_active":"2024-09-10T23:25:22.480113+0000","last_peered":"2024-09-10T23:25:22.480113+0000","last_clean":"2024-09-10T23:25:22.480113+0000","last_became_active":"2024-09-10T23:24:05.886076+0000","last_became_peered":"2024-09-10T23:24:05.886076+0000","last_unstale":"2024-09-10T23:25:22.480113+0000","last_undegraded":"2024-09-10T23:25:22.480113+0000","last_fullsized":"2024-09-10T23:25:22.480113+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:44.987664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480106+0000","last_change":"2024-09-10T23:24:05.891242+0000","last_active":"2024-09-10T23:25:22.480106+0000","last_peered":"2024-09-10T23:25:22.480106+0000","last_clean":"2024-09-10T23:25:22.480106+0000","last_became_active":"2024-09-10T23:24:05.889513+0000","last_became_peered":"2024-09-10T23:24:05.889513+0000","last_unstale":"2024-09-10T23:25:22.480106+0000","last_undegraded":"2024-09-10T23:25:22.480106+0000","last_fullsized":"2024-09-10T23:25:22.480106+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:07.774304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144384+0000","last_change":"2024-09-10T23:23:57.831698+0000","last_active":"2024-09-10T23:25:22.144384+0000","last_peered":"2024-09-10T23:25:22.144384+0000","last_clean":"2024-09-10T23:25:22.144384+0000","last_became_active":"2024-09-10T23:23:57.829348+0000","last_became_peered":"2024-09-10T23:23:57.829348+0000","last_unstale":"2024-09-10T23:25:22.144384+0000","last_undegraded":"2024-09-10T23:25:22.144384+0000","last_fullsized":"2024-09-10T23:25:22.144384+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:09.636786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.143664+0000","last_change":"2024-09-10T23:23:54.795380+0000","last_active":"2024-09-10T23:25:22.143664+0000","last_peered":"2024-09-10T23:25:22.143664+0000","last_clean":"2024-09-10T23:25:22.143664+0000","last_became_active":"2024-09-10T23:23:54.794465+0000","last_became_peered":"2024-09-10T23:23:54.794465+0000","last_unstale":"2024-09-10T23:25:22.143664+0000","last_undegraded":"2024-09-10T23:25:22.143664+0000","last_fullsized":"2024-09-10T23:25:22.143664+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:32.082020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.142405+0000","last_change":"2024-09-10T23:24:05.886531+0000","last_active":"2024-09-10T23:25:22.142405+0000","last_peered":"2024-09-10T23:25:22.142405+0000","last_clean":"2024-09-10T23:25:22.142405+0000","last_became_active":"2024-09-10T23:24:05.885762+0000","last_became_peered":"2024-09-10T23:24:05.885762+0000","last_unstale":"2024-09-10T23:25:22.142405+0000","last_undegraded":"2024-09-10T23:25:22.142405+0000","last_fullsized":"2024-09-10T23:25:22.142405+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:35.407364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.479904+0000","last_change":"2024-09-10T23:23:57.828052+0000","last_active":"2024-09-10T23:25:22.479904+0000","last_peered":"2024-09-10T23:25:22.479904+0000","last_clean":"2024-09-10T23:25:22.479904+0000","last_became_active":"2024-09-10T23:23:57.827653+0000","last_became_peered":"2024-09-10T23:23:57.827653+0000","last_unstale":"2024-09-10T23:25:22.479904+0000","last_undegraded":"2024-09-10T23:25:22.479904+0000","last_fullsized":"2024-09-10T23:25:22.479904+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:33.605054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.139046+0000","last_change":"2024-09-10T23:23:54.791375+0000","last_active":"2024-09-10T23:25:22.139046+0000","last_peered":"2024-09-10T23:25:22.139046+0000","last_clean":"2024-09-10T23:25:22.139046+0000","last_became_active":"2024-09-10T23:23:54.790974+0000","last_became_peered":"2024-09-10T23:23:54.790974+0000","last_unstale":"2024-09-10T23:25:22.139046+0000","last_undegraded":"2024-09-10T23:25:22.139046+0000","last_fullsized":"2024-09-10T23:25:22.139046+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:23:44.066787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.149262+0000","last_change":"2024-09-10T23:23:54.792056+0000","last_active":"2024-09-10T23:25:22.149262+0000","last_peered":"2024-09-10T23:25:22.149262+0000","last_clean":"2024-09-10T23:25:22.149262+0000","last_became_active":"2024-09-10T23:23:54.791665+0000","last_became_peered":"2024-09-10T23:23:54.791665+0000","last_unstale":"2024-09-10T23:25:22.149262+0000","last_undegraded":"2024-09-10T23:25:22.149262+0000","last_fullsized":"2024-09-10T23:25:22.149262+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:34:38.517066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.143515+0000","last_change":"2024-09-10T23:23:57.842524+0000","last_active":"2024-09-10T23:25:22.143515+0000","last_peered":"2024-09-10T23:25:22.143515+0000","last_clean":"2024-09-10T23:25:22.143515+0000","last_became_active":"2024-09-10T23:23:57.842033+0000","last_became_peered":"2024-09-10T23:23:57.842033+0000","last_unstale":"2024-09-10T23:25:22.143515+0000","last_undegraded":"2024-09-10T23:25:22.143515+0000","last_fullsized":"2024-09-10T23:25:22.143515+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:39.431115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.140894+0000","last_change":"2024-09-10T23:24:05.891676+0000","last_active":"2024-09-10T23:25:22.140894+0000","last_peered":"2024-09-10T23:25:22.140894+0000","last_clean":"2024-09-10T23:25:22.140894+0000","last_became_active":"2024-09-10T23:24:05.891224+0000","last_became_peered":"2024-09-10T23:24:05.891224+0000","last_unstale":"2024-09-10T23:25:22.140894+0000","last_undegraded":"2024-09-10T23:25:22.140894+0000","last_fullsized":"2024-09-10T23:25:22.140894+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:16:50.384745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'5","reported_seq":111,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:46.352338+0000","last_change":"2024-09-10T23:23:54.795126+0000","last_active":"2024-09-10T23:25:46.352338+0000","last_peered":"2024-09-10T23:25:46.352338+0000","last_clean":"2024-09-10T23:25:46.352338+0000","last_became_active":"2024-09-10T23:23:54.794553+0000","last_became_peered":"2024-09-10T23:23:54.794553+0000","last_unstale":"2024-09-10T23:25:46.352338+0000","last_undegraded":"2024-09-10T23:25:46.352338+0000","last_fullsized":"2024-09-10T23:25:46.352338+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:15:43.181180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":61,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.181152+0000","last_change":"2024-09-10T23:23:57.826827+0000","last_active":"2024-09-10T23:25:22.181152+0000","last_peered":"2024-09-10T23:25:22.181152+0000","last_clean":"2024-09-10T23:25:22.181152+0000","last_became_active":"2024-09-10T23:23:57.826457+0000","last_became_peered":"2024-09-10T23:23:57.826457+0000","last_unstale":"2024-09-10T23:25:22.181152+0000","last_undegraded":"2024-09-10T23:25:22.181152+0000","last_fullsized":"2024-09-10T23:25:22.181152+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:13.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.141320+0000","last_change":"2024-09-10T23:24:05.888774+0000","last_active":"2024-09-10T23:25:22.141320+0000","last_peered":"2024-09-10T23:25:22.141320+0000","last_clean":"2024-09-10T23:25:22.141320+0000","last_became_active":"2024-09-10T23:24:05.888267+0000","last_became_peered":"2024-09-10T23:24:05.888267+0000","last_unstale":"2024-09-10T23:25:22.141320+0000","last_undegraded":"2024-09-10T23:25:22.141320+0000","last_fullsized":"2024-09-10T23:25:22.141320+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:29.283509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.141613+0000","last_change":"2024-09-10T23:23:57.819178+0000","last_active":"2024-09-10T23:25:22.141613+0000","last_peered":"2024-09-10T23:25:22.141613+0000","last_clean":"2024-09-10T23:25:22.141613+0000","last_became_active":"2024-09-10T23:23:57.817029+0000","last_became_peered":"2024-09-10T23:23:57.817029+0000","last_unstale":"2024-09-10T23:25:22.141613+0000","last_undegraded":"2024-09-10T23:25:22.141613+0000","last_fullsized":"2024-09-10T23:25:22.141613+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:28:51.491402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.140838+0000","last_change":"2024-09-10T23:24:21.978215+0000","last_active":"2024-09-10T23:25:22.140838+0000","last_peered":"2024-09-10T23:25:22.140838+0000","last_clean":"2024-09-10T23:25:22.140838+0000","last_became_active":"2024-09-10T23:24:21.977811+0000","last_became_peered":"2024-09-10T23:24:21.977811+0000","last_unstale":"2024-09-10T23:25:22.140838+0000","last_undegraded":"2024-09-10T23:25:22.140838+0000","last_fullsized":"2024-09-10T23:25:22.140838+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:41.769216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.140739+0000","last_change":"2024-09-10T23:23:57.824147+0000","last_active":"2024-09-10T23:25:22.140739+0000","last_peered":"2024-09-10T23:25:22.140739+0000","last_clean":"2024-09-10T23:25:22.140739+0000","last_became_active":"2024-09-10T23:23:57.823503+0000","last_became_peered":"2024-09-10T23:23:57.823503+0000","last_unstale":"2024-09-10T23:25:22.140739+0000","last_undegraded":"2024-09-10T23:25:22.140739+0000","last_fullsized":"2024-09-10T23:25:22.140739+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:12:34.310648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.479737+0000","last_change":"2024-09-10T23:23:57.841413+0000","last_active":"2024-09-10T23:25:22.479737+0000","last_peered":"2024-09-10T23:25:22.479737+0000","last_clean":"2024-09-10T23:25:22.479737+0000","last_became_active":"2024-09-10T23:23:57.840889+0000","last_became_peered":"2024-09-10T23:23:57.840889+0000","last_unstale":"2024-09-10T23:25:22.479737+0000","last_undegraded":"2024-09-10T23:25:22.479737+0000","last_fullsized":"2024-09-10T23:25:22.479737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:10:08.757628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.139595+0000","last_change":"2024-09-10T23:23:57.837267+0000","last_active":"2024-09-10T23:25:22.139595+0000","last_peered":"2024-09-10T23:25:22.139595+0000","last_clean":"2024-09-10T23:25:22.139595+0000","last_became_active":"2024-09-10T23:23:57.836911+0000","last_became_peered":"2024-09-10T23:23:57.836911+0000","last_unstale":"2024-09-10T23:25:22.139595+0000","last_undegraded":"2024-09-10T23:25:22.139595+0000","last_fullsized":"2024-09-10T23:25:22.139595+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:24.969215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.142650+0000","last_change":"2024-09-10T23:23:57.813855+0000","last_active":"2024-09-10T23:25:22.142650+0000","last_peered":"2024-09-10T23:25:22.142650+0000","last_clean":"2024-09-10T23:25:22.142650+0000","last_became_active":"2024-09-10T23:23:57.812862+0000","last_became_peered":"2024-09-10T23:23:57.812862+0000","last_unstale":"2024-09-10T23:25:22.142650+0000","last_undegraded":"2024-09-10T23:25:22.142650+0000","last_fullsized":"2024-09-10T23:25:22.142650+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:21.542499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.141023+0000","last_change":"2024-09-10T23:23:57.826082+0000","last_active":"2024-09-10T23:25:22.141023+0000","last_peered":"2024-09-10T23:25:22.141023+0000","last_clean":"2024-09-10T23:25:22.141023+0000","last_became_active":"2024-09-10T23:23:57.825695+0000","last_became_peered":"2024-09-10T23:23:57.825695+0000","last_unstale":"2024-09-10T23:25:22.141023+0000","last_undegraded":"2024-09-10T23:25:22.141023+0000","last_fullsized":"2024-09-10T23:25:22.141023+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:08.518084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480001+0000","last_change":"2024-09-10T23:23:57.835147+0000","last_active":"2024-09-10T23:25:22.480001+0000","last_peered":"2024-09-10T23:25:22.480001+0000","last_clean":"2024-09-10T23:25:22.480001+0000","last_became_active":"2024-09-10T23:23:57.834739+0000","last_became_peered":"2024-09-10T23:23:57.834739+0000","last_unstale":"2024-09-10T23:25:22.480001+0000","last_undegraded":"2024-09-10T23:25:22.480001+0000","last_fullsized":"2024-09-10T23:25:22.480001+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:06:27.023088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.143513+0000","last_change":"2024-09-10T23:23:57.825996+0000","last_active":"2024-09-10T23:25:22.143513+0000","last_peered":"2024-09-10T23:25:22.143513+0000","last_clean":"2024-09-10T23:25:22.143513+0000","last_became_active":"2024-09-10T23:23:57.824168+0000","last_became_peered":"2024-09-10T23:23:57.824168+0000","last_unstale":"2024-09-10T23:25:22.143513+0000","last_undegraded":"2024-09-10T23:25:22.143513+0000","last_fullsized":"2024-09-10T23:25:22.143513+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:36.396179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144233+0000","last_change":"2024-09-10T23:24:21.976841+0000","last_active":"2024-09-10T23:25:22.144233+0000","last_peered":"2024-09-10T23:25:22.144233+0000","last_clean":"2024-09-10T23:25:22.144233+0000","last_became_active":"2024-09-10T23:24:21.976461+0000","last_became_peered":"2024-09-10T23:24:21.976461+0000","last_unstale":"2024-09-10T23:25:22.144233+0000","last_undegraded":"2024-09-10T23:25:22.144233+0000","last_fullsized":"2024-09-10T23:25:22.144233+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:04:00.000274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480800+0000","last_change":"2024-09-10T23:23:57.840477+0000","last_active":"2024-09-10T23:25:22.480800+0000","last_peered":"2024-09-10T23:25:22.480800+0000","last_clean":"2024-09-10T23:25:22.480800+0000","last_became_active":"2024-09-10T23:23:57.840113+0000","last_became_peered":"2024-09-10T23:23:57.840113+0000","last_unstale":"2024-09-10T23:25:22.480800+0000","last_undegraded":"2024-09-10T23:25:22.480800+0000","last_fullsized":"2024-09-10T23:25:22.480800+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:27:23.913802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.139498+0000","last_change":"2024-09-10T23:23:57.837416+0000","last_active":"2024-09-10T23:25:22.139498+0000","last_peered":"2024-09-10T23:25:22.139498+0000","last_clean":"2024-09-10T23:25:22.139498+0000","last_became_active":"2024-09-10T23:23:57.837104+0000","last_became_peered":"2024-09-10T23:23:57.837104+0000","last_unstale":"2024-09-10T23:25:22.139498+0000","last_undegraded":"2024-09-10T23:25:22.139498+0000","last_fullsized":"2024-09-10T23:25:22.139498+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:00.712148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.142226+0000","last_change":"2024-09-10T23:23:57.838304+0000","last_active":"2024-09-10T23:25:22.142226+0000","last_peered":"2024-09-10T23:25:22.142226+0000","last_clean":"2024-09-10T23:25:22.142226+0000","last_became_active":"2024-09-10T23:23:57.837677+0000","last_became_peered":"2024-09-10T23:23:57.837677+0000","last_unstale":"2024-09-10T23:25:22.142226+0000","last_undegraded":"2024-09-10T23:25:22.142226+0000","last_fullsized":"2024-09-10T23:25:22.142226+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:40.862950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.141412+0000","last_change":"2024-09-10T23:23:57.825579+0000","last_active":"2024-09-10T23:25:22.141412+0000","last_peered":"2024-09-10T23:25:22.141412+0000","last_clean":"2024-09-10T23:25:22.141412+0000","last_became_active":"2024-09-10T23:23:57.824840+0000","last_became_peered":"2024-09-10T23:23:57.824840+0000","last_unstale":"2024-09-10T23:25:22.141412+0000","last_undegraded":"2024-09-10T23:25:22.141412+0000","last_fullsized":"2024-09-10T23:25:22.141412+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:53:35.150858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.145649+0000","last_change":"2024-09-10T23:23:57.833479+0000","last_active":"2024-09-10T23:25:22.145649+0000","last_peered":"2024-09-10T23:25:22.145649+0000","last_clean":"2024-09-10T23:25:22.145649+0000","last_became_active":"2024-09-10T23:23:57.833124+0000","last_became_peered":"2024-09-10T23:23:57.833124+0000","last_unstale":"2024-09-10T23:25:22.145649+0000","last_undegraded":"2024-09-10T23:25:22.145649+0000","last_fullsized":"2024-09-10T23:25:22.145649+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:02.869308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.142799+0000","last_change":"2024-09-10T23:23:57.831610+0000","last_active":"2024-09-10T23:25:22.142799+0000","last_peered":"2024-09-10T23:25:22.142799+0000","last_clean":"2024-09-10T23:25:22.142799+0000","last_became_active":"2024-09-10T23:23:57.831227+0000","last_became_peered":"2024-09-10T23:23:57.831227+0000","last_unstale":"2024-09-10T23:25:22.142799+0000","last_undegraded":"2024-09-10T23:25:22.142799+0000","last_fullsized":"2024-09-10T23:25:22.142799+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:45.735286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481100+0000","last_change":"2024-09-10T23:23:57.839295+0000","last_active":"2024-09-10T23:25:22.481100+0000","last_peered":"2024-09-10T23:25:22.481100+0000","last_clean":"2024-09-10T23:25:22.481100+0000","last_became_active":"2024-09-10T23:23:57.838857+0000","last_became_peered":"2024-09-10T23:23:57.838857+0000","last_unstale":"2024-09-10T23:25:22.481100+0000","last_undegraded":"2024-09-10T23:25:22.481100+0000","last_fullsized":"2024-09-10T23:25:22.481100+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:20:13.203324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.479402+0000","last_change":"2024-09-10T23:23:57.841459+0000","last_active":"2024-09-10T23:25:22.479402+0000","last_peered":"2024-09-10T23:25:22.479402+0000","last_clean":"2024-09-10T23:25:22.479402+0000","last_became_active":"2024-09-10T23:23:57.841049+0000","last_became_peered":"2024-09-10T23:23:57.841049+0000","last_unstale":"2024-09-10T23:25:22.479402+0000","last_undegraded":"2024-09-10T23:25:22.479402+0000","last_fullsized":"2024-09-10T23:25:22.479402+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:39:51.372657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.479546+0000","last_change":"2024-09-10T23:23:57.813028+0000","last_active":"2024-09-10T23:25:22.479546+0000","last_peered":"2024-09-10T23:25:22.479546+0000","last_clean":"2024-09-10T23:25:22.479546+0000","last_became_active":"2024-09-10T23:23:57.812648+0000","last_became_peered":"2024-09-10T23:23:57.812648+0000","last_unstale":"2024-09-10T23:25:22.479546+0000","last_undegraded":"2024-09-10T23:25:22.479546+0000","last_fullsized":"2024-09-10T23:25:22.479546+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:57.691811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.139420+0000","last_change":"2024-09-10T23:23:57.814467+0000","last_active":"2024-09-10T23:25:22.139420+0000","last_peered":"2024-09-10T23:25:22.139420+0000","last_clean":"2024-09-10T23:25:22.139420+0000","last_became_active":"2024-09-10T23:23:57.812286+0000","last_became_peered":"2024-09-10T23:23:57.812286+0000","last_unstale":"2024-09-10T23:25:22.139420+0000","last_undegraded":"2024-09-10T23:25:22.139420+0000","last_fullsized":"2024-09-10T23:25:22.139420+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:42.044495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.148215+0000","last_change":"2024-09-10T23:23:57.834679+0000","last_active":"2024-09-10T23:25:22.148215+0000","last_peered":"2024-09-10T23:25:22.148215+0000","last_clean":"2024-09-10T23:25:22.148215+0000","last_became_active":"2024-09-10T23:23:57.833964+0000","last_became_peered":"2024-09-10T23:23:57.833964+0000","last_unstale":"2024-09-10T23:25:22.148215+0000","last_undegraded":"2024-09-10T23:25:22.148215+0000","last_fullsized":"2024-09-10T23:25:22.148215+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:29.160280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481645+0000","last_change":"2024-09-10T23:23:57.840788+0000","last_active":"2024-09-10T23:25:22.481645+0000","last_peered":"2024-09-10T23:25:22.481645+0000","last_clean":"2024-09-10T23:25:22.481645+0000","last_became_active":"2024-09-10T23:23:57.839946+0000","last_became_peered":"2024-09-10T23:23:57.839946+0000","last_unstale":"2024-09-10T23:25:22.481645+0000","last_undegraded":"2024-09-10T23:25:22.481645+0000","last_fullsized":"2024-09-10T23:25:22.481645+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:14.354925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.149997+0000","last_change":"2024-09-10T23:23:57.843454+0000","last_active":"2024-09-10T23:25:22.149997+0000","last_peered":"2024-09-10T23:25:22.149997+0000","last_clean":"2024-09-10T23:25:22.149997+0000","last_became_active":"2024-09-10T23:23:57.841623+0000","last_became_peered":"2024-09-10T23:23:57.841623+0000","last_unstale":"2024-09-10T23:25:22.149997+0000","last_undegraded":"2024-09-10T23:25:22.149997+0000","last_fullsized":"2024-09-10T23:25:22.149997+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:03:03.957444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480820+0000","last_change":"2024-09-10T23:23:57.834196+0000","last_active":"2024-09-10T23:25:22.480820+0000","last_peered":"2024-09-10T23:25:22.480820+0000","last_clean":"2024-09-10T23:25:22.480820+0000","last_became_active":"2024-09-10T23:23:57.833692+0000","last_became_peered":"2024-09-10T23:23:57.833692+0000","last_unstale":"2024-09-10T23:25:22.480820+0000","last_undegraded":"2024-09-10T23:25:22.480820+0000","last_fullsized":"2024-09-10T23:25:22.480820+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:49.814475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.479861+0000","last_change":"2024-09-10T23:23:57.831457+0000","last_active":"2024-09-10T23:25:22.479861+0000","last_peered":"2024-09-10T23:25:22.479861+0000","last_clean":"2024-09-10T23:25:22.479861+0000","last_became_active":"2024-09-10T23:23:57.829686+0000","last_became_peered":"2024-09-10T23:23:57.829686+0000","last_unstale":"2024-09-10T23:25:22.479861+0000","last_undegraded":"2024-09-10T23:25:22.479861+0000","last_fullsized":"2024-09-10T23:25:22.479861+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:39.204501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480513+0000","last_change":"2024-09-10T23:23:57.829437+0000","last_active":"2024-09-10T23:25:22.480513+0000","last_peered":"2024-09-10T23:25:22.480513+0000","last_clean":"2024-09-10T23:25:22.480513+0000","last_became_active":"2024-09-10T23:23:57.828956+0000","last_became_peered":"2024-09-10T23:23:57.828956+0000","last_unstale":"2024-09-10T23:25:22.480513+0000","last_undegraded":"2024-09-10T23:25:22.480513+0000","last_fullsized":"2024-09-10T23:25:22.480513+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:18.191002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.149220+0000","last_change":"2024-09-10T23:23:57.839661+0000","last_active":"2024-09-10T23:25:22.149220+0000","last_peered":"2024-09-10T23:25:22.149220+0000","last_clean":"2024-09-10T23:25:22.149220+0000","last_became_active":"2024-09-10T23:23:57.839197+0000","last_became_peered":"2024-09-10T23:23:57.839197+0000","last_unstale":"2024-09-10T23:25:22.149220+0000","last_undegraded":"2024-09-10T23:25:22.149220+0000","last_fullsized":"2024-09-10T23:25:22.149220+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:33.599860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.181048+0000","last_change":"2024-09-10T23:23:57.820968+0000","last_active":"2024-09-10T23:25:22.181048+0000","last_peered":"2024-09-10T23:25:22.181048+0000","last_clean":"2024-09-10T23:25:22.181048+0000","last_became_active":"2024-09-10T23:23:57.820108+0000","last_became_peered":"2024-09-10T23:23:57.820108+0000","last_unstale":"2024-09-10T23:25:22.181048+0000","last_undegraded":"2024-09-10T23:25:22.181048+0000","last_fullsized":"2024-09-10T23:25:22.181048+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:23.864751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.148127+0000","last_change":"2024-09-10T23:23:57.842302+0000","last_active":"2024-09-10T23:25:22.148127+0000","last_peered":"2024-09-10T23:25:22.148127+0000","last_clean":"2024-09-10T23:25:22.148127+0000","last_became_active":"2024-09-10T23:23:57.838460+0000","last_became_peered":"2024-09-10T23:23:57.838460+0000","last_unstale":"2024-09-10T23:25:22.148127+0000","last_undegraded":"2024-09-10T23:25:22.148127+0000","last_fullsized":"2024-09-10T23:25:22.148127+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:54.731481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.479921+0000","last_change":"2024-09-10T23:23:57.837749+0000","last_active":"2024-09-10T23:25:22.479921+0000","last_peered":"2024-09-10T23:25:22.479921+0000","last_clean":"2024-09-10T23:25:22.479921+0000","last_became_active":"2024-09-10T23:23:57.836195+0000","last_became_peered":"2024-09-10T23:23:57.836195+0000","last_unstale":"2024-09-10T23:25:22.479921+0000","last_undegraded":"2024-09-10T23:25:22.479921+0000","last_fullsized":"2024-09-10T23:25:22.479921+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:10.064725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480238+0000","last_change":"2024-09-10T23:23:57.812182+0000","last_active":"2024-09-10T23:25:22.480238+0000","last_peered":"2024-09-10T23:25:22.480238+0000","last_clean":"2024-09-10T23:25:22.480238+0000","last_became_active":"2024-09-10T23:23:57.811853+0000","last_became_peered":"2024-09-10T23:23:57.811853+0000","last_unstale":"2024-09-10T23:25:22.480238+0000","last_undegraded":"2024-09-10T23:25:22.480238+0000","last_fullsized":"2024-09-10T23:25:22.480238+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:03.389054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.142703+0000","last_change":"2024-09-10T23:23:57.833957+0000","last_active":"2024-09-10T23:25:22.142703+0000","last_peered":"2024-09-10T23:25:22.142703+0000","last_clean":"2024-09-10T23:25:22.142703+0000","last_became_active":"2024-09-10T23:23:57.833547+0000","last_became_peered":"2024-09-10T23:23:57.833547+0000","last_unstale":"2024-09-10T23:25:22.142703+0000","last_undegraded":"2024-09-10T23:25:22.142703+0000","last_fullsized":"2024-09-10T23:25:22.142703+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:30.917801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65520,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":377,"num_read_kb":257,"num_write":163,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":196560,"data_compressed":5592,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":288697,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678055,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32164,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712988,"statfs":{"total":95995035648,"available":95962099712,"internally_reserved":0,"allocated":999424,"data_stored":535193,"data_compressed":32452,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874284,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28140,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717012,"statfs":{"total":95995035648,"available":95966220288,"internally_reserved":0,"allocated":1134592,"data_stored":1184337,"data_compressed":71014,"data_compressed_allocated":94208,"data_compressed_original":688128,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037809,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1015808,"data_stored":539491,"data_compressed":32452,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234039,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1011712,"data_stored":535315,"data_compressed":32452,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430269,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1060864,"data_stored":1131224,"data_compressed":69150,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593796,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":530571,"data_compressed":32452,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790026,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32236,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712916,"statfs":{"total":95995035648,"available":95962025984,"internally_reserved":0,"allocated":1069056,"data_stored":1126421,"data_compressed":69150,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953552,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1003520,"data_stored":535612,"data_compressed":32452,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149781,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1003520,"data_stored":530765,"data_compressed":32452,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378716,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32240,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712912,"statfs":{"total":95995035648,"available":95962021888,"internally_reserved":0,"allocated":1073152,"data_stored":593316,"data_compressed":34316,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542240,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1052672,"data_stored":592000,"data_compressed":34316,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705767,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1015808,"data_stored":531959,"data_compressed":32452,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":61519,"data_compressed":1864,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":62835,"data_compressed":1864,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":63488,"data_compressed":1864,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:25:53.249 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T23:25:53.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:53 smithi003 ceph-mon[30348]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:25:53.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:53 smithi038 ceph-mon[34225]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:25:53.639 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:53.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:53 smithi194 ceph-mon[33904]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:25:54.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.237+0000 7f14d0c00640 1 -- 172.21.15.3:0/4090710270 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14cc104fa0 msgr2=0x7f14cc105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:54.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.237+0000 7f14d0c00640 1 --2- 172.21.15.3:0/4090710270 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14cc104fa0 0x7f14cc105380 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f14bc009900 tx=0x7f14bc02a410 comp rx=0 tx=0).stop 2024-09-10T23:25:54.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.237+0000 7f14d0c00640 1 -- 172.21.15.3:0/4090710270 shutdown_connections 2024-09-10T23:25:54.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.237+0000 7f14d0c00640 1 --2- 172.21.15.3:0/4090710270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14cc10b330 0x7f14cc111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.237+0000 7f14d0c00640 1 --2- 172.21.15.3:0/4090710270 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14cc10a9b0 0x7f14cc10adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.237+0000 7f14d0c00640 1 --2- 172.21.15.3:0/4090710270 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14cc104fa0 0x7f14cc105380 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.237+0000 7f14d0c00640 1 -- 172.21.15.3:0/4090710270 >> 172.21.15.3:0/4090710270 conn(0x7f14cc100a50 msgr2=0x7f14cc102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:54.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.237+0000 7f14d0c00640 1 -- 172.21.15.3:0/4090710270 shutdown_connections 2024-09-10T23:25:54.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.237+0000 7f14d0c00640 1 -- 172.21.15.3:0/4090710270 wait complete. 2024-09-10T23:25:54.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.238+0000 7f14d0c00640 1 Processor -- start 2024-09-10T23:25:54.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.238+0000 7f14d0c00640 1 -- start start 2024-09-10T23:25:54.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.239+0000 7f14d0c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14cc104fa0 0x7f14cc19b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.239+0000 7f14d0c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14cc10a9b0 0x7f14cc19b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.239+0000 7f14d0c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14cc10b330 0x7f14cc1a0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.239+0000 7f14d0c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f14cc114e10 con 0x7f14cc10b330 2024-09-10T23:25:54.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.239+0000 7f14d0c00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f14cc114c90 con 0x7f14cc10a9b0 2024-09-10T23:25:54.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.239+0000 7f14d0c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f14cc114f90 con 0x7f14cc104fa0 2024-09-10T23:25:54.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.239+0000 7f14c9e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14cc104fa0 0x7f14cc19b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.239+0000 7f14c9e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14cc104fa0 0x7f14cc19b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.3:40424/0 (socket says 172.21.15.3:40424) 2024-09-10T23:25:54.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.239+0000 7f14c9e00640 1 -- 172.21.15.3:0/2750162298 learned_addr learned my addr 172.21.15.3:0/2750162298 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:54.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.239+0000 7f14c1400640 1 --2- 172.21.15.3:0/2750162298 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14cc10a9b0 0x7f14cc19b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.239+0000 7f14ca800640 1 --2- 172.21.15.3:0/2750162298 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14cc10b330 0x7f14cc1a0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.240+0000 7f14c9e00640 1 -- 172.21.15.3:0/2750162298 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14cc10a9b0 msgr2=0x7f14cc19b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:54.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.240+0000 7f14c9e00640 1 --2- 172.21.15.3:0/2750162298 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14cc10a9b0 0x7f14cc19b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.240+0000 7f14c9e00640 1 -- 172.21.15.3:0/2750162298 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14cc10b330 msgr2=0x7f14cc1a0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:54.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.240+0000 7f14c9e00640 1 --2- 172.21.15.3:0/2750162298 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14cc10b330 0x7f14cc1a0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.240+0000 7f14c9e00640 1 -- 172.21.15.3:0/2750162298 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14cc1a14d0 con 0x7f14cc104fa0 2024-09-10T23:25:54.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.240+0000 7f14ca800640 1 --2- 172.21.15.3:0/2750162298 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14cc10b330 0x7f14cc1a0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:54.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.240+0000 7f14c1400640 1 --2- 172.21.15.3:0/2750162298 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14cc10a9b0 0x7f14cc19b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:54.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.240+0000 7f14c9e00640 1 --2- 172.21.15.3:0/2750162298 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14cc104fa0 0x7f14cc19b420 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f14bc009230 tx=0x7f14bc004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:54.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.241+0000 7f14c3400640 1 -- 172.21.15.3:0/2750162298 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14bc03f030 con 0x7f14cc104fa0 2024-09-10T23:25:54.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.241+0000 7f14c3400640 1 -- 172.21.15.3:0/2750162298 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f14bc003a80 con 0x7f14cc104fa0 2024-09-10T23:25:54.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.241+0000 7f14d0c00640 1 -- 172.21.15.3:0/2750162298 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14cc1a1760 con 0x7f14cc104fa0 2024-09-10T23:25:54.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.241+0000 7f14c3400640 1 -- 172.21.15.3:0/2750162298 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14bc035070 con 0x7f14cc104fa0 2024-09-10T23:25:54.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.241+0000 7f14d0c00640 1 -- 172.21.15.3:0/2750162298 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14cc1a7e80 con 0x7f14cc104fa0 2024-09-10T23:25:54.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.242+0000 7f14d0c00640 1 -- 172.21.15.3:0/2750162298 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14cc105380 con 0x7f14cc104fa0 2024-09-10T23:25:54.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.244+0000 7f14c3400640 1 -- 172.21.15.3:0/2750162298 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7f14bc003c30 con 0x7f14cc104fa0 2024-09-10T23:25:54.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.246+0000 7f14c3400640 1 --2- 172.21.15.3:0/2750162298 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f14b00b53c0 0x7f14b00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.246+0000 7f14c3400640 1 -- 172.21.15.3:0/2750162298 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f14bc106ee0 con 0x7f14cc104fa0 2024-09-10T23:25:54.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.246+0000 7f14c1400640 1 --2- 172.21.15.3:0/2750162298 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f14b00b53c0 0x7f14b00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.247+0000 7f14c1400640 1 --2- 172.21.15.3:0/2750162298 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f14b00b53c0 0x7f14b00b7880 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f14cc10a670 tx=0x7f14b4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:54.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.248+0000 7f14c3400640 1 -- 172.21.15.3:0/2750162298 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f14bc0cd100 con 0x7f14cc104fa0 2024-09-10T23:25:54.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.444+0000 7f14d0c00640 1 -- 172.21.15.3:0/2750162298 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f14cc063590 con 0x7f14b00b53c0 2024-09-10T23:25:54.446 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:54 smithi003 ceph-mon[30348]: pgmap v364: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:25:54.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.453+0000 7f14c3400640 1 -- 172.21.15.3:0/2750162298 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340675 (secure 0 0 0) 0x7f14cc063590 con 0x7f14b00b53c0 2024-09-10T23:25:54.457 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:25:54.459 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-10T23:25:54.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.457+0000 7f14d0c00640 1 -- 172.21.15.3:0/2750162298 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f14b00b53c0 msgr2=0x7f14b00b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:54.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.457+0000 7f14d0c00640 1 --2- 172.21.15.3:0/2750162298 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f14b00b53c0 0x7f14b00b7880 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f14cc10a670 tx=0x7f14b4005f90 comp rx=0 tx=0).stop 2024-09-10T23:25:54.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.457+0000 7f14d0c00640 1 -- 172.21.15.3:0/2750162298 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14cc104fa0 msgr2=0x7f14cc19b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:54.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.457+0000 7f14d0c00640 1 --2- 172.21.15.3:0/2750162298 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14cc104fa0 0x7f14cc19b420 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f14bc009230 tx=0x7f14bc004270 comp rx=0 tx=0).stop 2024-09-10T23:25:54.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.457+0000 7f14d0c00640 1 -- 172.21.15.3:0/2750162298 shutdown_connections 2024-09-10T23:25:54.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.457+0000 7f14d0c00640 1 --2- 172.21.15.3:0/2750162298 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f14b00b53c0 0x7f14b00b7880 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.457+0000 7f14d0c00640 1 --2- 172.21.15.3:0/2750162298 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14cc10b330 0x7f14cc1a0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.457+0000 7f14d0c00640 1 --2- 172.21.15.3:0/2750162298 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14cc10a9b0 0x7f14cc19b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.457+0000 7f14d0c00640 1 --2- 172.21.15.3:0/2750162298 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14cc104fa0 0x7f14cc19b420 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.457+0000 7f14d0c00640 1 -- 172.21.15.3:0/2750162298 >> 172.21.15.3:0/2750162298 conn(0x7f14cc100a50 msgr2=0x7f14cc101550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:54.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.458+0000 7f14d0c00640 1 -- 172.21.15.3:0/2750162298 shutdown_connections 2024-09-10T23:25:54.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:54.458+0000 7f14d0c00640 1 -- 172.21.15.3:0/2750162298 wait complete. 2024-09-10T23:25:54.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:54 smithi038 ceph-mon[34225]: pgmap v364: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:25:54.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:54 smithi194 ceph-mon[33904]: pgmap v364: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:25:55.208 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":364,"stamp":"2024-09-10T23:25:52.778768+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656122,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":483,"num_read_kb":341,"num_write":288,"num_write_kb":2266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2951874,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":234,"ondisk_log_size":234,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365612,"kb_used_data":12140,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576212,"statfs":{"total":1151940427776,"available":1151566041088,"internally_reserved":0,"allocated":12431360,"data_stored":8366204,"data_compressed":505110,"data_compressed_allocated":688128,"data_compressed_original":2875392,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":45,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003152"},"pg_stats":[{"pgid":"2.1f","version":"88'9","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.145829+0000","last_change":"2024-09-10T23:23:54.796561+0000","last_active":"2024-09-10T23:25:22.145829+0000","last_peered":"2024-09-10T23:25:22.145829+0000","last_clean":"2024-09-10T23:25:22.145829+0000","last_became_active":"2024-09-10T23:23:54.796058+0000","last_became_peered":"2024-09-10T23:23:54.796058+0000","last_unstale":"2024-09-10T23:25:22.145829+0000","last_undegraded":"2024-09-10T23:25:22.145829+0000","last_fullsized":"2024-09-10T23:25:22.145829+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:27.790990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480812+0000","last_change":"2024-09-10T23:23:57.828660+0000","last_active":"2024-09-10T23:25:22.480812+0000","last_peered":"2024-09-10T23:25:22.480812+0000","last_clean":"2024-09-10T23:25:22.480812+0000","last_became_active":"2024-09-10T23:23:57.828287+0000","last_became_peered":"2024-09-10T23:23:57.828287+0000","last_unstale":"2024-09-10T23:25:22.480812+0000","last_undegraded":"2024-09-10T23:25:22.480812+0000","last_fullsized":"2024-09-10T23:25:22.480812+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:13.085003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.140355+0000","last_change":"2024-09-10T23:24:05.886167+0000","last_active":"2024-09-10T23:25:22.140355+0000","last_peered":"2024-09-10T23:25:22.140355+0000","last_clean":"2024-09-10T23:25:22.140355+0000","last_became_active":"2024-09-10T23:24:05.885706+0000","last_became_peered":"2024-09-10T23:24:05.885706+0000","last_unstale":"2024-09-10T23:25:22.140355+0000","last_undegraded":"2024-09-10T23:25:22.140355+0000","last_fullsized":"2024-09-10T23:25:22.140355+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:42.337384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480952+0000","last_change":"2024-09-10T23:23:54.791770+0000","last_active":"2024-09-10T23:25:22.480952+0000","last_peered":"2024-09-10T23:25:22.480952+0000","last_clean":"2024-09-10T23:25:22.480952+0000","last_became_active":"2024-09-10T23:23:54.791476+0000","last_became_peered":"2024-09-10T23:23:54.791476+0000","last_unstale":"2024-09-10T23:25:22.480952+0000","last_undegraded":"2024-09-10T23:25:22.480952+0000","last_fullsized":"2024-09-10T23:25:22.480952+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:07.493654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.479925+0000","last_change":"2024-09-10T23:23:57.833858+0000","last_active":"2024-09-10T23:25:22.479925+0000","last_peered":"2024-09-10T23:25:22.479925+0000","last_clean":"2024-09-10T23:25:22.479925+0000","last_became_active":"2024-09-10T23:23:57.833496+0000","last_became_peered":"2024-09-10T23:23:57.833496+0000","last_unstale":"2024-09-10T23:25:22.479925+0000","last_undegraded":"2024-09-10T23:25:22.479925+0000","last_fullsized":"2024-09-10T23:25:22.479925+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:48:50.293342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147289+0000","last_change":"2024-09-10T23:24:05.878733+0000","last_active":"2024-09-10T23:25:22.147289+0000","last_peered":"2024-09-10T23:25:22.147289+0000","last_clean":"2024-09-10T23:25:22.147289+0000","last_became_active":"2024-09-10T23:24:05.878285+0000","last_became_peered":"2024-09-10T23:24:05.878285+0000","last_unstale":"2024-09-10T23:25:22.147289+0000","last_undegraded":"2024-09-10T23:25:22.147289+0000","last_fullsized":"2024-09-10T23:25:22.147289+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:21:11.636292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.181551+0000","last_change":"2024-09-10T23:23:54.792253+0000","last_active":"2024-09-10T23:25:22.181551+0000","last_peered":"2024-09-10T23:25:22.181551+0000","last_clean":"2024-09-10T23:25:22.181551+0000","last_became_active":"2024-09-10T23:23:54.791847+0000","last_became_peered":"2024-09-10T23:23:54.791847+0000","last_unstale":"2024-09-10T23:25:22.181551+0000","last_undegraded":"2024-09-10T23:25:22.181551+0000","last_fullsized":"2024-09-10T23:25:22.181551+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:03.563741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481459+0000","last_change":"2024-09-10T23:23:57.837009+0000","last_active":"2024-09-10T23:25:22.481459+0000","last_peered":"2024-09-10T23:25:22.481459+0000","last_clean":"2024-09-10T23:25:22.481459+0000","last_became_active":"2024-09-10T23:23:57.835152+0000","last_became_peered":"2024-09-10T23:23:57.835152+0000","last_unstale":"2024-09-10T23:25:22.481459+0000","last_undegraded":"2024-09-10T23:25:22.481459+0000","last_fullsized":"2024-09-10T23:25:22.481459+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:25.345514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147405+0000","last_change":"2024-09-10T23:24:05.882593+0000","last_active":"2024-09-10T23:25:22.147405+0000","last_peered":"2024-09-10T23:25:22.147405+0000","last_clean":"2024-09-10T23:25:22.147405+0000","last_became_active":"2024-09-10T23:24:05.882123+0000","last_became_peered":"2024-09-10T23:24:05.882123+0000","last_unstale":"2024-09-10T23:25:22.147405+0000","last_undegraded":"2024-09-10T23:25:22.147405+0000","last_fullsized":"2024-09-10T23:25:22.147405+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:22:30.103412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.142081+0000","last_change":"2024-09-10T23:24:21.980433+0000","last_active":"2024-09-10T23:25:22.142081+0000","last_peered":"2024-09-10T23:25:22.142081+0000","last_clean":"2024-09-10T23:25:22.142081+0000","last_became_active":"2024-09-10T23:24:21.974096+0000","last_became_peered":"2024-09-10T23:24:21.974096+0000","last_unstale":"2024-09-10T23:25:22.142081+0000","last_undegraded":"2024-09-10T23:25:22.142081+0000","last_fullsized":"2024-09-10T23:25:22.142081+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:33.430921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144871+0000","last_change":"2024-09-10T23:24:21.978526+0000","last_active":"2024-09-10T23:25:22.144871+0000","last_peered":"2024-09-10T23:25:22.144871+0000","last_clean":"2024-09-10T23:25:22.144871+0000","last_became_active":"2024-09-10T23:24:21.978137+0000","last_became_peered":"2024-09-10T23:24:21.978137+0000","last_unstale":"2024-09-10T23:25:22.144871+0000","last_undegraded":"2024-09-10T23:25:22.144871+0000","last_fullsized":"2024-09-10T23:25:22.144871+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:53:31.785033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147243+0000","last_change":"2024-09-10T23:24:05.889983+0000","last_active":"2024-09-10T23:25:22.147243+0000","last_peered":"2024-09-10T23:25:22.147243+0000","last_clean":"2024-09-10T23:25:22.147243+0000","last_became_active":"2024-09-10T23:24:05.889003+0000","last_became_peered":"2024-09-10T23:24:05.889003+0000","last_unstale":"2024-09-10T23:25:22.147243+0000","last_undegraded":"2024-09-10T23:25:22.147243+0000","last_fullsized":"2024-09-10T23:25:22.147243+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:19:13.555187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480869+0000","last_change":"2024-09-10T23:23:57.831433+0000","last_active":"2024-09-10T23:25:22.480869+0000","last_peered":"2024-09-10T23:25:22.480869+0000","last_clean":"2024-09-10T23:25:22.480869+0000","last_became_active":"2024-09-10T23:23:57.831108+0000","last_became_peered":"2024-09-10T23:23:57.831108+0000","last_unstale":"2024-09-10T23:25:22.480869+0000","last_undegraded":"2024-09-10T23:25:22.480869+0000","last_fullsized":"2024-09-10T23:25:22.480869+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:50:20.160455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.181201+0000","last_change":"2024-09-10T23:23:54.792269+0000","last_active":"2024-09-10T23:25:22.181201+0000","last_peered":"2024-09-10T23:25:22.181201+0000","last_clean":"2024-09-10T23:25:22.181201+0000","last_became_active":"2024-09-10T23:23:54.791853+0000","last_became_peered":"2024-09-10T23:23:54.791853+0000","last_unstale":"2024-09-10T23:25:22.181201+0000","last_undegraded":"2024-09-10T23:25:22.181201+0000","last_fullsized":"2024-09-10T23:25:22.181201+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:43.020267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147560+0000","last_change":"2024-09-10T23:24:05.886155+0000","last_active":"2024-09-10T23:25:22.147560+0000","last_peered":"2024-09-10T23:25:22.147560+0000","last_clean":"2024-09-10T23:25:22.147560+0000","last_became_active":"2024-09-10T23:24:05.885674+0000","last_became_peered":"2024-09-10T23:24:05.885674+0000","last_unstale":"2024-09-10T23:25:22.147560+0000","last_undegraded":"2024-09-10T23:25:22.147560+0000","last_fullsized":"2024-09-10T23:25:22.147560+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:46:00.891311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480612+0000","last_change":"2024-09-10T23:23:57.830440+0000","last_active":"2024-09-10T23:25:22.480612+0000","last_peered":"2024-09-10T23:25:22.480612+0000","last_clean":"2024-09-10T23:25:22.480612+0000","last_became_active":"2024-09-10T23:23:57.829219+0000","last_became_peered":"2024-09-10T23:23:57.829219+0000","last_unstale":"2024-09-10T23:25:22.480612+0000","last_undegraded":"2024-09-10T23:25:22.480612+0000","last_fullsized":"2024-09-10T23:25:22.480612+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:28:15.696684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"88'1","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.141098+0000","last_change":"2024-09-10T23:23:54.796493+0000","last_active":"2024-09-10T23:25:22.141098+0000","last_peered":"2024-09-10T23:25:22.141098+0000","last_clean":"2024-09-10T23:25:22.141098+0000","last_became_active":"2024-09-10T23:23:54.796077+0000","last_became_peered":"2024-09-10T23:23:54.796077+0000","last_unstale":"2024-09-10T23:25:22.141098+0000","last_undegraded":"2024-09-10T23:25:22.141098+0000","last_fullsized":"2024-09-10T23:25:22.141098+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:13.054307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147642+0000","last_change":"2024-09-10T23:24:05.885557+0000","last_active":"2024-09-10T23:25:22.147642+0000","last_peered":"2024-09-10T23:25:22.147642+0000","last_clean":"2024-09-10T23:25:22.147642+0000","last_became_active":"2024-09-10T23:24:05.884773+0000","last_became_peered":"2024-09-10T23:24:05.884773+0000","last_unstale":"2024-09-10T23:25:22.147642+0000","last_undegraded":"2024-09-10T23:25:22.147642+0000","last_fullsized":"2024-09-10T23:25:22.147642+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:52.596822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.141743+0000","last_change":"2024-09-10T23:23:57.816395+0000","last_active":"2024-09-10T23:25:22.141743+0000","last_peered":"2024-09-10T23:25:22.141743+0000","last_clean":"2024-09-10T23:25:22.141743+0000","last_became_active":"2024-09-10T23:23:57.816047+0000","last_became_peered":"2024-09-10T23:23:57.816047+0000","last_unstale":"2024-09-10T23:25:22.141743+0000","last_undegraded":"2024-09-10T23:25:22.141743+0000","last_fullsized":"2024-09-10T23:25:22.141743+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:08:11.535738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480232+0000","last_change":"2024-09-10T23:23:54.795827+0000","last_active":"2024-09-10T23:25:22.480232+0000","last_peered":"2024-09-10T23:25:22.480232+0000","last_clean":"2024-09-10T23:25:22.480232+0000","last_became_active":"2024-09-10T23:23:54.794253+0000","last_became_peered":"2024-09-10T23:23:54.794253+0000","last_unstale":"2024-09-10T23:25:22.480232+0000","last_undegraded":"2024-09-10T23:25:22.480232+0000","last_fullsized":"2024-09-10T23:25:22.480232+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:27:27.988380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.145437+0000","last_change":"2024-09-10T23:24:05.889120+0000","last_active":"2024-09-10T23:25:22.145437+0000","last_peered":"2024-09-10T23:25:22.145437+0000","last_clean":"2024-09-10T23:25:22.145437+0000","last_became_active":"2024-09-10T23:24:05.888771+0000","last_became_peered":"2024-09-10T23:24:05.888771+0000","last_unstale":"2024-09-10T23:25:22.145437+0000","last_undegraded":"2024-09-10T23:25:22.145437+0000","last_fullsized":"2024-09-10T23:25:22.145437+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:55.414786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.180983+0000","last_change":"2024-09-10T23:23:57.814073+0000","last_active":"2024-09-10T23:25:22.180983+0000","last_peered":"2024-09-10T23:25:22.180983+0000","last_clean":"2024-09-10T23:25:22.180983+0000","last_became_active":"2024-09-10T23:23:57.813681+0000","last_became_peered":"2024-09-10T23:23:57.813681+0000","last_unstale":"2024-09-10T23:25:22.180983+0000","last_undegraded":"2024-09-10T23:25:22.180983+0000","last_fullsized":"2024-09-10T23:25:22.180983+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:44.129174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480329+0000","last_change":"2024-09-10T23:23:54.791119+0000","last_active":"2024-09-10T23:25:22.480329+0000","last_peered":"2024-09-10T23:25:22.480329+0000","last_clean":"2024-09-10T23:25:22.480329+0000","last_became_active":"2024-09-10T23:23:54.790770+0000","last_became_peered":"2024-09-10T23:23:54.790770+0000","last_unstale":"2024-09-10T23:25:22.480329+0000","last_undegraded":"2024-09-10T23:25:22.480329+0000","last_fullsized":"2024-09-10T23:25:22.480329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:35.015104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.183378+0000","last_change":"2024-09-10T23:25:22.183216+0000","last_active":"2024-09-10T23:25:22.183378+0000","last_peered":"2024-09-10T23:25:22.183378+0000","last_clean":"2024-09-10T23:25:22.183378+0000","last_became_active":"2024-09-10T23:25:22.182735+0000","last_became_peered":"2024-09-10T23:25:22.182735+0000","last_unstale":"2024-09-10T23:25:22.183378+0000","last_undegraded":"2024-09-10T23:25:22.183378+0000","last_fullsized":"2024-09-10T23:25:22.183378+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:39:53.143633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480325+0000","last_change":"2024-09-10T23:24:21.976169+0000","last_active":"2024-09-10T23:25:22.480325+0000","last_peered":"2024-09-10T23:25:22.480325+0000","last_clean":"2024-09-10T23:25:22.480325+0000","last_became_active":"2024-09-10T23:24:21.975330+0000","last_became_peered":"2024-09-10T23:24:21.975330+0000","last_unstale":"2024-09-10T23:25:22.480325+0000","last_undegraded":"2024-09-10T23:25:22.480325+0000","last_fullsized":"2024-09-10T23:25:22.480325+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:54:59.422630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147985+0000","last_change":"2024-09-10T23:23:55.082093+0000","last_active":"2024-09-10T23:25:22.147985+0000","last_peered":"2024-09-10T23:25:22.147985+0000","last_clean":"2024-09-10T23:25:22.147985+0000","last_became_active":"2024-09-10T23:23:55.081705+0000","last_became_peered":"2024-09-10T23:23:55.081705+0000","last_unstale":"2024-09-10T23:25:22.147985+0000","last_undegraded":"2024-09-10T23:25:22.147985+0000","last_fullsized":"2024-09-10T23:25:22.147985+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:01:04.150153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.140618+0000","last_change":"2024-09-10T23:24:05.880084+0000","last_active":"2024-09-10T23:25:22.140618+0000","last_peered":"2024-09-10T23:25:22.140618+0000","last_clean":"2024-09-10T23:25:22.140618+0000","last_became_active":"2024-09-10T23:24:05.879655+0000","last_became_peered":"2024-09-10T23:24:05.879655+0000","last_unstale":"2024-09-10T23:25:22.140618+0000","last_undegraded":"2024-09-10T23:25:22.140618+0000","last_fullsized":"2024-09-10T23:25:22.140618+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:01.473494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480176+0000","last_change":"2024-09-10T23:23:57.836207+0000","last_active":"2024-09-10T23:25:22.480176+0000","last_peered":"2024-09-10T23:25:22.480176+0000","last_clean":"2024-09-10T23:25:22.480176+0000","last_became_active":"2024-09-10T23:23:57.835801+0000","last_became_peered":"2024-09-10T23:23:57.835801+0000","last_unstale":"2024-09-10T23:25:22.480176+0000","last_undegraded":"2024-09-10T23:25:22.480176+0000","last_fullsized":"2024-09-10T23:25:22.480176+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:48:18.246508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'10","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.145745+0000","last_change":"2024-09-10T23:23:54.798126+0000","last_active":"2024-09-10T23:25:22.145745+0000","last_peered":"2024-09-10T23:25:22.145745+0000","last_clean":"2024-09-10T23:25:22.145745+0000","last_became_active":"2024-09-10T23:23:54.797755+0000","last_became_peered":"2024-09-10T23:23:54.797755+0000","last_unstale":"2024-09-10T23:25:22.145745+0000","last_undegraded":"2024-09-10T23:25:22.145745+0000","last_fullsized":"2024-09-10T23:25:22.145745+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:54.474382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.479704+0000","last_change":"2024-09-10T23:24:05.886431+0000","last_active":"2024-09-10T23:25:22.479704+0000","last_peered":"2024-09-10T23:25:22.479704+0000","last_clean":"2024-09-10T23:25:22.479704+0000","last_became_active":"2024-09-10T23:24:05.885962+0000","last_became_peered":"2024-09-10T23:24:05.885962+0000","last_unstale":"2024-09-10T23:25:22.479704+0000","last_undegraded":"2024-09-10T23:25:22.479704+0000","last_fullsized":"2024-09-10T23:25:22.479704+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:32.568553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.139683+0000","last_change":"2024-09-10T23:23:57.825790+0000","last_active":"2024-09-10T23:25:22.139683+0000","last_peered":"2024-09-10T23:25:22.139683+0000","last_clean":"2024-09-10T23:25:22.139683+0000","last_became_active":"2024-09-10T23:23:57.825510+0000","last_became_peered":"2024-09-10T23:23:57.825510+0000","last_unstale":"2024-09-10T23:25:22.139683+0000","last_undegraded":"2024-09-10T23:25:22.139683+0000","last_fullsized":"2024-09-10T23:25:22.139683+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:43.816144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.181604+0000","last_change":"2024-09-10T23:23:54.791957+0000","last_active":"2024-09-10T23:25:22.181604+0000","last_peered":"2024-09-10T23:25:22.181604+0000","last_clean":"2024-09-10T23:25:22.181604+0000","last_became_active":"2024-09-10T23:23:54.791607+0000","last_became_peered":"2024-09-10T23:23:54.791607+0000","last_unstale":"2024-09-10T23:25:22.181604+0000","last_undegraded":"2024-09-10T23:25:22.181604+0000","last_fullsized":"2024-09-10T23:25:22.181604+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:00:47.600299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.142008+0000","last_change":"2024-09-10T23:24:05.884275+0000","last_active":"2024-09-10T23:25:22.142008+0000","last_peered":"2024-09-10T23:25:22.142008+0000","last_clean":"2024-09-10T23:25:22.142008+0000","last_became_active":"2024-09-10T23:24:05.882340+0000","last_became_peered":"2024-09-10T23:24:05.882340+0000","last_unstale":"2024-09-10T23:25:22.142008+0000","last_undegraded":"2024-09-10T23:25:22.142008+0000","last_fullsized":"2024-09-10T23:25:22.142008+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:15.243993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.149679+0000","last_change":"2024-09-10T23:23:57.828322+0000","last_active":"2024-09-10T23:25:22.149679+0000","last_peered":"2024-09-10T23:25:22.149679+0000","last_clean":"2024-09-10T23:25:22.149679+0000","last_became_active":"2024-09-10T23:23:57.827925+0000","last_became_peered":"2024-09-10T23:23:57.827925+0000","last_unstale":"2024-09-10T23:25:22.149679+0000","last_undegraded":"2024-09-10T23:25:22.149679+0000","last_fullsized":"2024-09-10T23:25:22.149679+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:55.214207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144951+0000","last_change":"2024-09-10T23:23:54.789507+0000","last_active":"2024-09-10T23:25:22.144951+0000","last_peered":"2024-09-10T23:25:22.144951+0000","last_clean":"2024-09-10T23:25:22.144951+0000","last_became_active":"2024-09-10T23:23:54.789120+0000","last_became_peered":"2024-09-10T23:23:54.789120+0000","last_unstale":"2024-09-10T23:25:22.144951+0000","last_undegraded":"2024-09-10T23:25:22.144951+0000","last_fullsized":"2024-09-10T23:25:22.144951+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:58.033953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.181053+0000","last_change":"2024-09-10T23:24:05.881015+0000","last_active":"2024-09-10T23:25:22.181053+0000","last_peered":"2024-09-10T23:25:22.181053+0000","last_clean":"2024-09-10T23:25:22.181053+0000","last_became_active":"2024-09-10T23:24:05.880261+0000","last_became_peered":"2024-09-10T23:24:05.880261+0000","last_unstale":"2024-09-10T23:25:22.181053+0000","last_undegraded":"2024-09-10T23:25:22.181053+0000","last_fullsized":"2024-09-10T23:25:22.181053+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:13:36.937503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.149320+0000","last_change":"2024-09-10T23:23:57.842018+0000","last_active":"2024-09-10T23:25:22.149320+0000","last_peered":"2024-09-10T23:25:22.149320+0000","last_clean":"2024-09-10T23:25:22.149320+0000","last_became_active":"2024-09-10T23:23:57.841669+0000","last_became_peered":"2024-09-10T23:23:57.841669+0000","last_unstale":"2024-09-10T23:25:22.149320+0000","last_undegraded":"2024-09-10T23:25:22.149320+0000","last_fullsized":"2024-09-10T23:25:22.149320+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:11.619741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481048+0000","last_change":"2024-09-10T23:23:54.794565+0000","last_active":"2024-09-10T23:25:22.481048+0000","last_peered":"2024-09-10T23:25:22.481048+0000","last_clean":"2024-09-10T23:25:22.481048+0000","last_became_active":"2024-09-10T23:23:54.793794+0000","last_became_peered":"2024-09-10T23:23:54.793794+0000","last_unstale":"2024-09-10T23:25:22.481048+0000","last_undegraded":"2024-09-10T23:25:22.481048+0000","last_fullsized":"2024-09-10T23:25:22.481048+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:42.665924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.139440+0000","last_change":"2024-09-10T23:24:05.883706+0000","last_active":"2024-09-10T23:25:22.139440+0000","last_peered":"2024-09-10T23:25:22.139440+0000","last_clean":"2024-09-10T23:25:22.139440+0000","last_became_active":"2024-09-10T23:24:05.881621+0000","last_became_peered":"2024-09-10T23:24:05.881621+0000","last_unstale":"2024-09-10T23:25:22.139440+0000","last_undegraded":"2024-09-10T23:25:22.139440+0000","last_fullsized":"2024-09-10T23:25:22.139440+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:23.468331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.143529+0000","last_change":"2024-09-10T23:23:57.834504+0000","last_active":"2024-09-10T23:25:22.143529+0000","last_peered":"2024-09-10T23:25:22.143529+0000","last_clean":"2024-09-10T23:25:22.143529+0000","last_became_active":"2024-09-10T23:23:57.834105+0000","last_became_peered":"2024-09-10T23:23:57.834105+0000","last_unstale":"2024-09-10T23:25:22.143529+0000","last_undegraded":"2024-09-10T23:25:22.143529+0000","last_fullsized":"2024-09-10T23:25:22.143529+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:03.539763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'4","reported_seq":113,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:51.360074+0000","last_change":"2024-09-10T23:23:54.796519+0000","last_active":"2024-09-10T23:25:51.360074+0000","last_peered":"2024-09-10T23:25:51.360074+0000","last_clean":"2024-09-10T23:25:51.360074+0000","last_became_active":"2024-09-10T23:23:54.795174+0000","last_became_peered":"2024-09-10T23:23:54.795174+0000","last_unstale":"2024-09-10T23:25:51.360074+0000","last_undegraded":"2024-09-10T23:25:51.360074+0000","last_fullsized":"2024-09-10T23:25:51.360074+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:53.622935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":64,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.140492+0000","last_change":"2024-09-10T23:24:05.884496+0000","last_active":"2024-09-10T23:25:22.140492+0000","last_peered":"2024-09-10T23:25:22.140492+0000","last_clean":"2024-09-10T23:25:22.140492+0000","last_became_active":"2024-09-10T23:24:05.883659+0000","last_became_peered":"2024-09-10T23:24:05.883659+0000","last_unstale":"2024-09-10T23:25:22.140492+0000","last_undegraded":"2024-09-10T23:25:22.140492+0000","last_fullsized":"2024-09-10T23:25:22.140492+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:23.449830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.138936+0000","last_change":"2024-09-10T23:23:57.842436+0000","last_active":"2024-09-10T23:25:22.138936+0000","last_peered":"2024-09-10T23:25:22.138936+0000","last_clean":"2024-09-10T23:25:22.138936+0000","last_became_active":"2024-09-10T23:23:57.842054+0000","last_became_peered":"2024-09-10T23:23:57.842054+0000","last_unstale":"2024-09-10T23:25:22.138936+0000","last_undegraded":"2024-09-10T23:25:22.138936+0000","last_fullsized":"2024-09-10T23:25:22.138936+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:07.234201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481584+0000","last_change":"2024-09-10T23:24:21.974615+0000","last_active":"2024-09-10T23:25:22.481584+0000","last_peered":"2024-09-10T23:25:22.481584+0000","last_clean":"2024-09-10T23:25:22.481584+0000","last_became_active":"2024-09-10T23:24:21.974129+0000","last_became_peered":"2024-09-10T23:24:21.974129+0000","last_unstale":"2024-09-10T23:25:22.481584+0000","last_undegraded":"2024-09-10T23:25:22.481584+0000","last_fullsized":"2024-09-10T23:25:22.481584+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:11.510005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.151414+0000","last_change":"2024-09-10T23:25:22.151288+0000","last_active":"2024-09-10T23:25:22.151414+0000","last_peered":"2024-09-10T23:25:22.151414+0000","last_clean":"2024-09-10T23:25:22.151414+0000","last_became_active":"2024-09-10T23:25:22.150800+0000","last_became_peered":"2024-09-10T23:25:22.150800+0000","last_unstale":"2024-09-10T23:25:22.151414+0000","last_undegraded":"2024-09-10T23:25:22.151414+0000","last_fullsized":"2024-09-10T23:25:22.151414+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:56.974242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480432+0000","last_change":"2024-09-10T23:23:57.828722+0000","last_active":"2024-09-10T23:25:22.480432+0000","last_peered":"2024-09-10T23:25:22.480432+0000","last_clean":"2024-09-10T23:25:22.480432+0000","last_became_active":"2024-09-10T23:23:57.828373+0000","last_became_peered":"2024-09-10T23:23:57.828373+0000","last_unstale":"2024-09-10T23:25:22.480432+0000","last_undegraded":"2024-09-10T23:25:22.480432+0000","last_fullsized":"2024-09-10T23:25:22.480432+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:19.891684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147833+0000","last_change":"2024-09-10T23:23:54.789584+0000","last_active":"2024-09-10T23:25:22.147833+0000","last_peered":"2024-09-10T23:25:22.147833+0000","last_clean":"2024-09-10T23:25:22.147833+0000","last_became_active":"2024-09-10T23:23:54.789166+0000","last_became_peered":"2024-09-10T23:23:54.789166+0000","last_unstale":"2024-09-10T23:25:22.147833+0000","last_undegraded":"2024-09-10T23:25:22.147833+0000","last_fullsized":"2024-09-10T23:25:22.147833+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:02.292384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":121,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481682+0000","last_change":"2024-09-10T23:22:28.076475+0000","last_active":"2024-09-10T23:25:22.481682+0000","last_peered":"2024-09-10T23:25:22.481682+0000","last_clean":"2024-09-10T23:25:22.481682+0000","last_became_active":"2024-09-10T23:22:28.070622+0000","last_became_peered":"2024-09-10T23:22:28.070622+0000","last_unstale":"2024-09-10T23:25:22.481682+0000","last_undegraded":"2024-09-10T23:25:22.481682+0000","last_fullsized":"2024-09-10T23:25:22.481682+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:28.022462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:28.022462+0000","last_clean_scrub_stamp":"2024-09-10T23:18:28.022462+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:46:16.329399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481348+0000","last_change":"2024-09-10T23:24:05.884647+0000","last_active":"2024-09-10T23:25:22.481348+0000","last_peered":"2024-09-10T23:25:22.481348+0000","last_clean":"2024-09-10T23:25:22.481348+0000","last_became_active":"2024-09-10T23:24:05.883476+0000","last_became_peered":"2024-09-10T23:24:05.883476+0000","last_unstale":"2024-09-10T23:25:22.481348+0000","last_undegraded":"2024-09-10T23:25:22.481348+0000","last_fullsized":"2024-09-10T23:25:22.481348+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:02.524767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481749+0000","last_change":"2024-09-10T23:23:57.840835+0000","last_active":"2024-09-10T23:25:22.481749+0000","last_peered":"2024-09-10T23:25:22.481749+0000","last_clean":"2024-09-10T23:25:22.481749+0000","last_became_active":"2024-09-10T23:23:57.840472+0000","last_became_peered":"2024-09-10T23:23:57.840472+0000","last_unstale":"2024-09-10T23:25:22.481749+0000","last_undegraded":"2024-09-10T23:25:22.481749+0000","last_fullsized":"2024-09-10T23:25:22.481749+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:18.050686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.141231+0000","last_change":"2024-09-10T23:23:55.081669+0000","last_active":"2024-09-10T23:25:22.141231+0000","last_peered":"2024-09-10T23:25:22.141231+0000","last_clean":"2024-09-10T23:25:22.141231+0000","last_became_active":"2024-09-10T23:23:55.081306+0000","last_became_peered":"2024-09-10T23:23:55.081306+0000","last_unstale":"2024-09-10T23:25:22.141231+0000","last_undegraded":"2024-09-10T23:25:22.141231+0000","last_fullsized":"2024-09-10T23:25:22.141231+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:54.968431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480474+0000","last_change":"2024-09-10T23:24:05.880876+0000","last_active":"2024-09-10T23:25:22.480474+0000","last_peered":"2024-09-10T23:25:22.480474+0000","last_clean":"2024-09-10T23:25:22.480474+0000","last_became_active":"2024-09-10T23:24:05.880504+0000","last_became_peered":"2024-09-10T23:24:05.880504+0000","last_unstale":"2024-09-10T23:25:22.480474+0000","last_undegraded":"2024-09-10T23:25:22.480474+0000","last_fullsized":"2024-09-10T23:25:22.480474+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:17:55.689134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480659+0000","last_change":"2024-09-10T23:23:57.826637+0000","last_active":"2024-09-10T23:25:22.480659+0000","last_peered":"2024-09-10T23:25:22.480659+0000","last_clean":"2024-09-10T23:25:22.480659+0000","last_became_active":"2024-09-10T23:23:57.825915+0000","last_became_peered":"2024-09-10T23:23:57.825915+0000","last_unstale":"2024-09-10T23:25:22.480659+0000","last_undegraded":"2024-09-10T23:25:22.480659+0000","last_fullsized":"2024-09-10T23:25:22.480659+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:55.281687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.145088+0000","last_change":"2024-09-10T23:23:54.789847+0000","last_active":"2024-09-10T23:25:22.145088+0000","last_peered":"2024-09-10T23:25:22.145088+0000","last_clean":"2024-09-10T23:25:22.145088+0000","last_became_active":"2024-09-10T23:23:54.789082+0000","last_became_peered":"2024-09-10T23:23:54.789082+0000","last_unstale":"2024-09-10T23:25:22.145088+0000","last_undegraded":"2024-09-10T23:25:22.145088+0000","last_fullsized":"2024-09-10T23:25:22.145088+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:39:16.162317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.479703+0000","last_change":"2024-09-10T23:24:05.895799+0000","last_active":"2024-09-10T23:25:22.479703+0000","last_peered":"2024-09-10T23:25:22.479703+0000","last_clean":"2024-09-10T23:25:22.479703+0000","last_became_active":"2024-09-10T23:24:05.895361+0000","last_became_peered":"2024-09-10T23:24:05.895361+0000","last_unstale":"2024-09-10T23:25:22.479703+0000","last_undegraded":"2024-09-10T23:25:22.479703+0000","last_fullsized":"2024-09-10T23:25:22.479703+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:10.893000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480931+0000","last_change":"2024-09-10T23:23:57.834954+0000","last_active":"2024-09-10T23:25:22.480931+0000","last_peered":"2024-09-10T23:25:22.480931+0000","last_clean":"2024-09-10T23:25:22.480931+0000","last_became_active":"2024-09-10T23:23:57.834215+0000","last_became_peered":"2024-09-10T23:23:57.834215+0000","last_unstale":"2024-09-10T23:25:22.480931+0000","last_undegraded":"2024-09-10T23:25:22.480931+0000","last_fullsized":"2024-09-10T23:25:22.480931+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:19:42.051352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":58,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.140237+0000","last_change":"2024-09-10T23:24:22.301029+0000","last_active":"2024-09-10T23:25:22.140237+0000","last_peered":"2024-09-10T23:25:22.140237+0000","last_clean":"2024-09-10T23:25:22.140237+0000","last_became_active":"2024-09-10T23:24:22.297759+0000","last_became_peered":"2024-09-10T23:24:22.297759+0000","last_unstale":"2024-09-10T23:25:22.140237+0000","last_undegraded":"2024-09-10T23:25:22.140237+0000","last_fullsized":"2024-09-10T23:25:22.140237+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:05.364737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.143389+0000","last_change":"2024-09-10T23:24:05.884172+0000","last_active":"2024-09-10T23:25:22.143389+0000","last_peered":"2024-09-10T23:25:22.143389+0000","last_clean":"2024-09-10T23:25:22.143389+0000","last_became_active":"2024-09-10T23:24:05.881918+0000","last_became_peered":"2024-09-10T23:24:05.881918+0000","last_unstale":"2024-09-10T23:25:22.143389+0000","last_undegraded":"2024-09-10T23:25:22.143389+0000","last_fullsized":"2024-09-10T23:25:22.143389+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:19:15.250926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.142130+0000","last_change":"2024-09-10T23:24:22.297163+0000","last_active":"2024-09-10T23:25:22.142130+0000","last_peered":"2024-09-10T23:25:22.142130+0000","last_clean":"2024-09-10T23:25:22.142130+0000","last_became_active":"2024-09-10T23:24:22.296751+0000","last_became_peered":"2024-09-10T23:24:22.296751+0000","last_unstale":"2024-09-10T23:25:22.142130+0000","last_undegraded":"2024-09-10T23:25:22.142130+0000","last_fullsized":"2024-09-10T23:25:22.142130+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:37:50.379101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.181396+0000","last_change":"2024-09-10T23:23:54.788008+0000","last_active":"2024-09-10T23:25:22.181396+0000","last_peered":"2024-09-10T23:25:22.181396+0000","last_clean":"2024-09-10T23:25:22.181396+0000","last_became_active":"2024-09-10T23:23:54.787702+0000","last_became_peered":"2024-09-10T23:23:54.787702+0000","last_unstale":"2024-09-10T23:25:22.181396+0000","last_undegraded":"2024-09-10T23:25:22.181396+0000","last_fullsized":"2024-09-10T23:25:22.181396+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:45.997467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144427+0000","last_change":"2024-09-10T23:24:05.887208+0000","last_active":"2024-09-10T23:25:22.144427+0000","last_peered":"2024-09-10T23:25:22.144427+0000","last_clean":"2024-09-10T23:25:22.144427+0000","last_became_active":"2024-09-10T23:24:05.885556+0000","last_became_peered":"2024-09-10T23:24:05.885556+0000","last_unstale":"2024-09-10T23:25:22.144427+0000","last_undegraded":"2024-09-10T23:25:22.144427+0000","last_fullsized":"2024-09-10T23:25:22.144427+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:21.843558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144204+0000","last_change":"2024-09-10T23:23:57.842937+0000","last_active":"2024-09-10T23:25:22.144204+0000","last_peered":"2024-09-10T23:25:22.144204+0000","last_clean":"2024-09-10T23:25:22.144204+0000","last_became_active":"2024-09-10T23:23:57.842158+0000","last_became_peered":"2024-09-10T23:23:57.842158+0000","last_unstale":"2024-09-10T23:25:22.144204+0000","last_undegraded":"2024-09-10T23:25:22.144204+0000","last_fullsized":"2024-09-10T23:25:22.144204+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:49:58.716816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.180981+0000","last_change":"2024-09-10T23:23:54.787515+0000","last_active":"2024-09-10T23:25:22.180981+0000","last_peered":"2024-09-10T23:25:22.180981+0000","last_clean":"2024-09-10T23:25:22.180981+0000","last_became_active":"2024-09-10T23:23:54.786950+0000","last_became_peered":"2024-09-10T23:23:54.786950+0000","last_unstale":"2024-09-10T23:25:22.180981+0000","last_undegraded":"2024-09-10T23:25:22.180981+0000","last_fullsized":"2024-09-10T23:25:22.180981+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:12.546459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.140060+0000","last_change":"2024-09-10T23:24:05.882784+0000","last_active":"2024-09-10T23:25:22.140060+0000","last_peered":"2024-09-10T23:25:22.140060+0000","last_clean":"2024-09-10T23:25:22.140060+0000","last_became_active":"2024-09-10T23:24:05.882331+0000","last_became_peered":"2024-09-10T23:24:05.882331+0000","last_unstale":"2024-09-10T23:25:22.140060+0000","last_undegraded":"2024-09-10T23:25:22.140060+0000","last_fullsized":"2024-09-10T23:25:22.140060+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:51:42.519144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481464+0000","last_change":"2024-09-10T23:23:57.827896+0000","last_active":"2024-09-10T23:25:22.481464+0000","last_peered":"2024-09-10T23:25:22.481464+0000","last_clean":"2024-09-10T23:25:22.481464+0000","last_became_active":"2024-09-10T23:23:57.827572+0000","last_became_peered":"2024-09-10T23:23:57.827572+0000","last_unstale":"2024-09-10T23:25:22.481464+0000","last_undegraded":"2024-09-10T23:25:22.481464+0000","last_fullsized":"2024-09-10T23:25:22.481464+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:11.126594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'4","reported_seq":111,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:46.352483+0000","last_change":"2024-09-10T23:23:54.795582+0000","last_active":"2024-09-10T23:25:46.352483+0000","last_peered":"2024-09-10T23:25:46.352483+0000","last_clean":"2024-09-10T23:25:46.352483+0000","last_became_active":"2024-09-10T23:23:54.795225+0000","last_became_peered":"2024-09-10T23:23:54.795225+0000","last_unstale":"2024-09-10T23:25:46.352483+0000","last_undegraded":"2024-09-10T23:25:46.352483+0000","last_fullsized":"2024-09-10T23:25:46.352483+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:11.827090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":63,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.483416+0000","last_change":"2024-09-10T23:25:22.483250+0000","last_active":"2024-09-10T23:25:22.483416+0000","last_peered":"2024-09-10T23:25:22.483416+0000","last_clean":"2024-09-10T23:25:22.483416+0000","last_became_active":"2024-09-10T23:25:22.482721+0000","last_became_peered":"2024-09-10T23:25:22.482721+0000","last_unstale":"2024-09-10T23:25:22.483416+0000","last_undegraded":"2024-09-10T23:25:22.483416+0000","last_fullsized":"2024-09-10T23:25:22.483416+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:41:31.732139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,7,0,3],"acting":[10,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480824+0000","last_change":"2024-09-10T23:23:57.843899+0000","last_active":"2024-09-10T23:25:22.480824+0000","last_peered":"2024-09-10T23:25:22.480824+0000","last_clean":"2024-09-10T23:25:22.480824+0000","last_became_active":"2024-09-10T23:23:57.843590+0000","last_became_peered":"2024-09-10T23:23:57.843590+0000","last_unstale":"2024-09-10T23:25:22.480824+0000","last_undegraded":"2024-09-10T23:25:22.480824+0000","last_fullsized":"2024-09-10T23:25:22.480824+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:32:17.919904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144367+0000","last_change":"2024-09-10T23:23:54.795091+0000","last_active":"2024-09-10T23:25:22.144367+0000","last_peered":"2024-09-10T23:25:22.144367+0000","last_clean":"2024-09-10T23:25:22.144367+0000","last_became_active":"2024-09-10T23:23:54.794726+0000","last_became_peered":"2024-09-10T23:23:54.794726+0000","last_unstale":"2024-09-10T23:25:22.144367+0000","last_undegraded":"2024-09-10T23:25:22.144367+0000","last_fullsized":"2024-09-10T23:25:22.144367+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:56:20.322532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.483398+0000","last_change":"2024-09-10T23:25:22.483252+0000","last_active":"2024-09-10T23:25:22.483398+0000","last_peered":"2024-09-10T23:25:22.483398+0000","last_clean":"2024-09-10T23:25:22.483398+0000","last_became_active":"2024-09-10T23:25:22.482719+0000","last_became_peered":"2024-09-10T23:25:22.482719+0000","last_unstale":"2024-09-10T23:25:22.483398+0000","last_undegraded":"2024-09-10T23:25:22.483398+0000","last_fullsized":"2024-09-10T23:25:22.483398+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:36.281256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.139402+0000","last_change":"2024-09-10T23:23:57.823729+0000","last_active":"2024-09-10T23:25:22.139402+0000","last_peered":"2024-09-10T23:25:22.139402+0000","last_clean":"2024-09-10T23:25:22.139402+0000","last_became_active":"2024-09-10T23:23:57.822797+0000","last_became_peered":"2024-09-10T23:23:57.822797+0000","last_unstale":"2024-09-10T23:25:22.139402+0000","last_undegraded":"2024-09-10T23:25:22.139402+0000","last_fullsized":"2024-09-10T23:25:22.139402+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:09.646543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.141877+0000","last_change":"2024-09-10T23:24:21.985389+0000","last_active":"2024-09-10T23:25:22.141877+0000","last_peered":"2024-09-10T23:25:22.141877+0000","last_clean":"2024-09-10T23:25:22.141877+0000","last_became_active":"2024-09-10T23:24:21.976084+0000","last_became_peered":"2024-09-10T23:24:21.976084+0000","last_unstale":"2024-09-10T23:25:22.141877+0000","last_undegraded":"2024-09-10T23:25:22.141877+0000","last_fullsized":"2024-09-10T23:25:22.141877+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:33.284211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144855+0000","last_change":"2024-09-10T23:24:05.890656+0000","last_active":"2024-09-10T23:25:22.144855+0000","last_peered":"2024-09-10T23:25:22.144855+0000","last_clean":"2024-09-10T23:25:22.144855+0000","last_became_active":"2024-09-10T23:24:05.889827+0000","last_became_peered":"2024-09-10T23:24:05.889827+0000","last_unstale":"2024-09-10T23:25:22.144855+0000","last_undegraded":"2024-09-10T23:25:22.144855+0000","last_fullsized":"2024-09-10T23:25:22.144855+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:15.301567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.181398+0000","last_change":"2024-09-10T23:23:57.827348+0000","last_active":"2024-09-10T23:25:22.181398+0000","last_peered":"2024-09-10T23:25:22.181398+0000","last_clean":"2024-09-10T23:25:22.181398+0000","last_became_active":"2024-09-10T23:23:57.826670+0000","last_became_peered":"2024-09-10T23:23:57.826670+0000","last_unstale":"2024-09-10T23:25:22.181398+0000","last_undegraded":"2024-09-10T23:25:22.181398+0000","last_fullsized":"2024-09-10T23:25:22.181398+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:19.268930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"88'31","reported_seq":209,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:51.359938+0000","last_change":"2024-09-10T23:23:54.789603+0000","last_active":"2024-09-10T23:25:51.359938+0000","last_peered":"2024-09-10T23:25:51.359938+0000","last_clean":"2024-09-10T23:25:51.359938+0000","last_became_active":"2024-09-10T23:23:54.789136+0000","last_became_peered":"2024-09-10T23:23:54.789136+0000","last_unstale":"2024-09-10T23:25:51.359938+0000","last_undegraded":"2024-09-10T23:25:51.359938+0000","last_fullsized":"2024-09-10T23:25:51.359938+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:47.648232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61519,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":133,"num_read_kb":126,"num_write":32,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144472+0000","last_change":"2024-09-10T23:24:05.883758+0000","last_active":"2024-09-10T23:25:22.144472+0000","last_peered":"2024-09-10T23:25:22.144472+0000","last_clean":"2024-09-10T23:25:22.144472+0000","last_became_active":"2024-09-10T23:24:05.883401+0000","last_became_peered":"2024-09-10T23:24:05.883401+0000","last_unstale":"2024-09-10T23:25:22.144472+0000","last_undegraded":"2024-09-10T23:25:22.144472+0000","last_fullsized":"2024-09-10T23:25:22.144472+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:52.862088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481581+0000","last_change":"2024-09-10T23:23:57.846524+0000","last_active":"2024-09-10T23:25:22.481581+0000","last_peered":"2024-09-10T23:25:22.481581+0000","last_clean":"2024-09-10T23:25:22.481581+0000","last_became_active":"2024-09-10T23:23:57.846036+0000","last_became_peered":"2024-09-10T23:23:57.846036+0000","last_unstale":"2024-09-10T23:25:22.481581+0000","last_undegraded":"2024-09-10T23:25:22.481581+0000","last_fullsized":"2024-09-10T23:25:22.481581+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:13.866827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.145087+0000","last_change":"2024-09-10T23:23:54.789925+0000","last_active":"2024-09-10T23:25:22.145087+0000","last_peered":"2024-09-10T23:25:22.145087+0000","last_clean":"2024-09-10T23:25:22.145087+0000","last_became_active":"2024-09-10T23:23:54.789600+0000","last_became_peered":"2024-09-10T23:23:54.789600+0000","last_unstale":"2024-09-10T23:25:22.145087+0000","last_undegraded":"2024-09-10T23:25:22.145087+0000","last_fullsized":"2024-09-10T23:25:22.145087+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:54.937422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147657+0000","last_change":"2024-09-10T23:24:05.882530+0000","last_active":"2024-09-10T23:25:22.147657+0000","last_peered":"2024-09-10T23:25:22.147657+0000","last_clean":"2024-09-10T23:25:22.147657+0000","last_became_active":"2024-09-10T23:24:05.881092+0000","last_became_peered":"2024-09-10T23:24:05.881092+0000","last_unstale":"2024-09-10T23:25:22.147657+0000","last_undegraded":"2024-09-10T23:25:22.147657+0000","last_fullsized":"2024-09-10T23:25:22.147657+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:54.954300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480022+0000","last_change":"2024-09-10T23:23:57.837341+0000","last_active":"2024-09-10T23:25:22.480022+0000","last_peered":"2024-09-10T23:25:22.480022+0000","last_clean":"2024-09-10T23:25:22.480022+0000","last_became_active":"2024-09-10T23:23:57.837024+0000","last_became_peered":"2024-09-10T23:23:57.837024+0000","last_unstale":"2024-09-10T23:25:22.480022+0000","last_undegraded":"2024-09-10T23:25:22.480022+0000","last_fullsized":"2024-09-10T23:25:22.480022+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:22:48.241471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481336+0000","last_change":"2024-09-10T23:23:54.792028+0000","last_active":"2024-09-10T23:25:22.481336+0000","last_peered":"2024-09-10T23:25:22.481336+0000","last_clean":"2024-09-10T23:25:22.481336+0000","last_became_active":"2024-09-10T23:23:54.791589+0000","last_became_peered":"2024-09-10T23:23:54.791589+0000","last_unstale":"2024-09-10T23:25:22.481336+0000","last_undegraded":"2024-09-10T23:25:22.481336+0000","last_fullsized":"2024-09-10T23:25:22.481336+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:48.589441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144159+0000","last_change":"2024-09-10T23:24:05.888627+0000","last_active":"2024-09-10T23:25:22.144159+0000","last_peered":"2024-09-10T23:25:22.144159+0000","last_clean":"2024-09-10T23:25:22.144159+0000","last_became_active":"2024-09-10T23:24:05.887925+0000","last_became_peered":"2024-09-10T23:24:05.887925+0000","last_unstale":"2024-09-10T23:25:22.144159+0000","last_undegraded":"2024-09-10T23:25:22.144159+0000","last_fullsized":"2024-09-10T23:25:22.144159+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:15.956333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481174+0000","last_change":"2024-09-10T23:23:57.833009+0000","last_active":"2024-09-10T23:25:22.481174+0000","last_peered":"2024-09-10T23:25:22.481174+0000","last_clean":"2024-09-10T23:25:22.481174+0000","last_became_active":"2024-09-10T23:23:57.830782+0000","last_became_peered":"2024-09-10T23:23:57.830782+0000","last_unstale":"2024-09-10T23:25:22.481174+0000","last_undegraded":"2024-09-10T23:25:22.481174+0000","last_fullsized":"2024-09-10T23:25:22.481174+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:42.520461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"88'3","reported_seq":111,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:50.358470+0000","last_change":"2024-09-10T23:23:54.789322+0000","last_active":"2024-09-10T23:25:50.358470+0000","last_peered":"2024-09-10T23:25:50.358470+0000","last_clean":"2024-09-10T23:25:50.358470+0000","last_became_active":"2024-09-10T23:23:54.788879+0000","last_became_peered":"2024-09-10T23:23:54.788879+0000","last_unstale":"2024-09-10T23:25:50.358470+0000","last_undegraded":"2024-09-10T23:25:50.358470+0000","last_fullsized":"2024-09-10T23:25:50.358470+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:37.276413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480113+0000","last_change":"2024-09-10T23:24:05.886626+0000","last_active":"2024-09-10T23:25:22.480113+0000","last_peered":"2024-09-10T23:25:22.480113+0000","last_clean":"2024-09-10T23:25:22.480113+0000","last_became_active":"2024-09-10T23:24:05.886076+0000","last_became_peered":"2024-09-10T23:24:05.886076+0000","last_unstale":"2024-09-10T23:25:22.480113+0000","last_undegraded":"2024-09-10T23:25:22.480113+0000","last_fullsized":"2024-09-10T23:25:22.480113+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:44.987664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480106+0000","last_change":"2024-09-10T23:24:05.891242+0000","last_active":"2024-09-10T23:25:22.480106+0000","last_peered":"2024-09-10T23:25:22.480106+0000","last_clean":"2024-09-10T23:25:22.480106+0000","last_became_active":"2024-09-10T23:24:05.889513+0000","last_became_peered":"2024-09-10T23:24:05.889513+0000","last_unstale":"2024-09-10T23:25:22.480106+0000","last_undegraded":"2024-09-10T23:25:22.480106+0000","last_fullsized":"2024-09-10T23:25:22.480106+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:07.774304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144384+0000","last_change":"2024-09-10T23:23:57.831698+0000","last_active":"2024-09-10T23:25:22.144384+0000","last_peered":"2024-09-10T23:25:22.144384+0000","last_clean":"2024-09-10T23:25:22.144384+0000","last_became_active":"2024-09-10T23:23:57.829348+0000","last_became_peered":"2024-09-10T23:23:57.829348+0000","last_unstale":"2024-09-10T23:25:22.144384+0000","last_undegraded":"2024-09-10T23:25:22.144384+0000","last_fullsized":"2024-09-10T23:25:22.144384+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:09.636786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.143664+0000","last_change":"2024-09-10T23:23:54.795380+0000","last_active":"2024-09-10T23:25:22.143664+0000","last_peered":"2024-09-10T23:25:22.143664+0000","last_clean":"2024-09-10T23:25:22.143664+0000","last_became_active":"2024-09-10T23:23:54.794465+0000","last_became_peered":"2024-09-10T23:23:54.794465+0000","last_unstale":"2024-09-10T23:25:22.143664+0000","last_undegraded":"2024-09-10T23:25:22.143664+0000","last_fullsized":"2024-09-10T23:25:22.143664+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:32.082020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.142405+0000","last_change":"2024-09-10T23:24:05.886531+0000","last_active":"2024-09-10T23:25:22.142405+0000","last_peered":"2024-09-10T23:25:22.142405+0000","last_clean":"2024-09-10T23:25:22.142405+0000","last_became_active":"2024-09-10T23:24:05.885762+0000","last_became_peered":"2024-09-10T23:24:05.885762+0000","last_unstale":"2024-09-10T23:25:22.142405+0000","last_undegraded":"2024-09-10T23:25:22.142405+0000","last_fullsized":"2024-09-10T23:25:22.142405+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:35.407364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.479904+0000","last_change":"2024-09-10T23:23:57.828052+0000","last_active":"2024-09-10T23:25:22.479904+0000","last_peered":"2024-09-10T23:25:22.479904+0000","last_clean":"2024-09-10T23:25:22.479904+0000","last_became_active":"2024-09-10T23:23:57.827653+0000","last_became_peered":"2024-09-10T23:23:57.827653+0000","last_unstale":"2024-09-10T23:25:22.479904+0000","last_undegraded":"2024-09-10T23:25:22.479904+0000","last_fullsized":"2024-09-10T23:25:22.479904+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:33.605054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.139046+0000","last_change":"2024-09-10T23:23:54.791375+0000","last_active":"2024-09-10T23:25:22.139046+0000","last_peered":"2024-09-10T23:25:22.139046+0000","last_clean":"2024-09-10T23:25:22.139046+0000","last_became_active":"2024-09-10T23:23:54.790974+0000","last_became_peered":"2024-09-10T23:23:54.790974+0000","last_unstale":"2024-09-10T23:25:22.139046+0000","last_undegraded":"2024-09-10T23:25:22.139046+0000","last_fullsized":"2024-09-10T23:25:22.139046+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:23:44.066787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.149262+0000","last_change":"2024-09-10T23:23:54.792056+0000","last_active":"2024-09-10T23:25:22.149262+0000","last_peered":"2024-09-10T23:25:22.149262+0000","last_clean":"2024-09-10T23:25:22.149262+0000","last_became_active":"2024-09-10T23:23:54.791665+0000","last_became_peered":"2024-09-10T23:23:54.791665+0000","last_unstale":"2024-09-10T23:25:22.149262+0000","last_undegraded":"2024-09-10T23:25:22.149262+0000","last_fullsized":"2024-09-10T23:25:22.149262+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:34:38.517066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.143515+0000","last_change":"2024-09-10T23:23:57.842524+0000","last_active":"2024-09-10T23:25:22.143515+0000","last_peered":"2024-09-10T23:25:22.143515+0000","last_clean":"2024-09-10T23:25:22.143515+0000","last_became_active":"2024-09-10T23:23:57.842033+0000","last_became_peered":"2024-09-10T23:23:57.842033+0000","last_unstale":"2024-09-10T23:25:22.143515+0000","last_undegraded":"2024-09-10T23:25:22.143515+0000","last_fullsized":"2024-09-10T23:25:22.143515+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:39.431115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.140894+0000","last_change":"2024-09-10T23:24:05.891676+0000","last_active":"2024-09-10T23:25:22.140894+0000","last_peered":"2024-09-10T23:25:22.140894+0000","last_clean":"2024-09-10T23:25:22.140894+0000","last_became_active":"2024-09-10T23:24:05.891224+0000","last_became_peered":"2024-09-10T23:24:05.891224+0000","last_unstale":"2024-09-10T23:25:22.140894+0000","last_undegraded":"2024-09-10T23:25:22.140894+0000","last_fullsized":"2024-09-10T23:25:22.140894+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:16:50.384745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'5","reported_seq":116,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:51.360787+0000","last_change":"2024-09-10T23:23:54.795126+0000","last_active":"2024-09-10T23:25:51.360787+0000","last_peered":"2024-09-10T23:25:51.360787+0000","last_clean":"2024-09-10T23:25:51.360787+0000","last_became_active":"2024-09-10T23:23:54.794553+0000","last_became_peered":"2024-09-10T23:23:54.794553+0000","last_unstale":"2024-09-10T23:25:51.360787+0000","last_undegraded":"2024-09-10T23:25:51.360787+0000","last_fullsized":"2024-09-10T23:25:51.360787+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:15:43.181180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.181152+0000","last_change":"2024-09-10T23:23:57.826827+0000","last_active":"2024-09-10T23:25:22.181152+0000","last_peered":"2024-09-10T23:25:22.181152+0000","last_clean":"2024-09-10T23:25:22.181152+0000","last_became_active":"2024-09-10T23:23:57.826457+0000","last_became_peered":"2024-09-10T23:23:57.826457+0000","last_unstale":"2024-09-10T23:25:22.181152+0000","last_undegraded":"2024-09-10T23:25:22.181152+0000","last_fullsized":"2024-09-10T23:25:22.181152+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:13.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.141320+0000","last_change":"2024-09-10T23:24:05.888774+0000","last_active":"2024-09-10T23:25:22.141320+0000","last_peered":"2024-09-10T23:25:22.141320+0000","last_clean":"2024-09-10T23:25:22.141320+0000","last_became_active":"2024-09-10T23:24:05.888267+0000","last_became_peered":"2024-09-10T23:24:05.888267+0000","last_unstale":"2024-09-10T23:25:22.141320+0000","last_undegraded":"2024-09-10T23:25:22.141320+0000","last_fullsized":"2024-09-10T23:25:22.141320+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:29.283509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.141613+0000","last_change":"2024-09-10T23:23:57.819178+0000","last_active":"2024-09-10T23:25:22.141613+0000","last_peered":"2024-09-10T23:25:22.141613+0000","last_clean":"2024-09-10T23:25:22.141613+0000","last_became_active":"2024-09-10T23:23:57.817029+0000","last_became_peered":"2024-09-10T23:23:57.817029+0000","last_unstale":"2024-09-10T23:25:22.141613+0000","last_undegraded":"2024-09-10T23:25:22.141613+0000","last_fullsized":"2024-09-10T23:25:22.141613+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:28:51.491402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.140838+0000","last_change":"2024-09-10T23:24:21.978215+0000","last_active":"2024-09-10T23:25:22.140838+0000","last_peered":"2024-09-10T23:25:22.140838+0000","last_clean":"2024-09-10T23:25:22.140838+0000","last_became_active":"2024-09-10T23:24:21.977811+0000","last_became_peered":"2024-09-10T23:24:21.977811+0000","last_unstale":"2024-09-10T23:25:22.140838+0000","last_undegraded":"2024-09-10T23:25:22.140838+0000","last_fullsized":"2024-09-10T23:25:22.140838+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:41.769216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.140739+0000","last_change":"2024-09-10T23:23:57.824147+0000","last_active":"2024-09-10T23:25:22.140739+0000","last_peered":"2024-09-10T23:25:22.140739+0000","last_clean":"2024-09-10T23:25:22.140739+0000","last_became_active":"2024-09-10T23:23:57.823503+0000","last_became_peered":"2024-09-10T23:23:57.823503+0000","last_unstale":"2024-09-10T23:25:22.140739+0000","last_undegraded":"2024-09-10T23:25:22.140739+0000","last_fullsized":"2024-09-10T23:25:22.140739+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:12:34.310648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.479737+0000","last_change":"2024-09-10T23:23:57.841413+0000","last_active":"2024-09-10T23:25:22.479737+0000","last_peered":"2024-09-10T23:25:22.479737+0000","last_clean":"2024-09-10T23:25:22.479737+0000","last_became_active":"2024-09-10T23:23:57.840889+0000","last_became_peered":"2024-09-10T23:23:57.840889+0000","last_unstale":"2024-09-10T23:25:22.479737+0000","last_undegraded":"2024-09-10T23:25:22.479737+0000","last_fullsized":"2024-09-10T23:25:22.479737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:10:08.757628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.139595+0000","last_change":"2024-09-10T23:23:57.837267+0000","last_active":"2024-09-10T23:25:22.139595+0000","last_peered":"2024-09-10T23:25:22.139595+0000","last_clean":"2024-09-10T23:25:22.139595+0000","last_became_active":"2024-09-10T23:23:57.836911+0000","last_became_peered":"2024-09-10T23:23:57.836911+0000","last_unstale":"2024-09-10T23:25:22.139595+0000","last_undegraded":"2024-09-10T23:25:22.139595+0000","last_fullsized":"2024-09-10T23:25:22.139595+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:24.969215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.142650+0000","last_change":"2024-09-10T23:23:57.813855+0000","last_active":"2024-09-10T23:25:22.142650+0000","last_peered":"2024-09-10T23:25:22.142650+0000","last_clean":"2024-09-10T23:25:22.142650+0000","last_became_active":"2024-09-10T23:23:57.812862+0000","last_became_peered":"2024-09-10T23:23:57.812862+0000","last_unstale":"2024-09-10T23:25:22.142650+0000","last_undegraded":"2024-09-10T23:25:22.142650+0000","last_fullsized":"2024-09-10T23:25:22.142650+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:21.542499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.141023+0000","last_change":"2024-09-10T23:23:57.826082+0000","last_active":"2024-09-10T23:25:22.141023+0000","last_peered":"2024-09-10T23:25:22.141023+0000","last_clean":"2024-09-10T23:25:22.141023+0000","last_became_active":"2024-09-10T23:23:57.825695+0000","last_became_peered":"2024-09-10T23:23:57.825695+0000","last_unstale":"2024-09-10T23:25:22.141023+0000","last_undegraded":"2024-09-10T23:25:22.141023+0000","last_fullsized":"2024-09-10T23:25:22.141023+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:08.518084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480001+0000","last_change":"2024-09-10T23:23:57.835147+0000","last_active":"2024-09-10T23:25:22.480001+0000","last_peered":"2024-09-10T23:25:22.480001+0000","last_clean":"2024-09-10T23:25:22.480001+0000","last_became_active":"2024-09-10T23:23:57.834739+0000","last_became_peered":"2024-09-10T23:23:57.834739+0000","last_unstale":"2024-09-10T23:25:22.480001+0000","last_undegraded":"2024-09-10T23:25:22.480001+0000","last_fullsized":"2024-09-10T23:25:22.480001+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:06:27.023088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.143513+0000","last_change":"2024-09-10T23:23:57.825996+0000","last_active":"2024-09-10T23:25:22.143513+0000","last_peered":"2024-09-10T23:25:22.143513+0000","last_clean":"2024-09-10T23:25:22.143513+0000","last_became_active":"2024-09-10T23:23:57.824168+0000","last_became_peered":"2024-09-10T23:23:57.824168+0000","last_unstale":"2024-09-10T23:25:22.143513+0000","last_undegraded":"2024-09-10T23:25:22.143513+0000","last_fullsized":"2024-09-10T23:25:22.143513+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:36.396179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144233+0000","last_change":"2024-09-10T23:24:21.976841+0000","last_active":"2024-09-10T23:25:22.144233+0000","last_peered":"2024-09-10T23:25:22.144233+0000","last_clean":"2024-09-10T23:25:22.144233+0000","last_became_active":"2024-09-10T23:24:21.976461+0000","last_became_peered":"2024-09-10T23:24:21.976461+0000","last_unstale":"2024-09-10T23:25:22.144233+0000","last_undegraded":"2024-09-10T23:25:22.144233+0000","last_fullsized":"2024-09-10T23:25:22.144233+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:04:00.000274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480800+0000","last_change":"2024-09-10T23:23:57.840477+0000","last_active":"2024-09-10T23:25:22.480800+0000","last_peered":"2024-09-10T23:25:22.480800+0000","last_clean":"2024-09-10T23:25:22.480800+0000","last_became_active":"2024-09-10T23:23:57.840113+0000","last_became_peered":"2024-09-10T23:23:57.840113+0000","last_unstale":"2024-09-10T23:25:22.480800+0000","last_undegraded":"2024-09-10T23:25:22.480800+0000","last_fullsized":"2024-09-10T23:25:22.480800+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:27:23.913802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.139498+0000","last_change":"2024-09-10T23:23:57.837416+0000","last_active":"2024-09-10T23:25:22.139498+0000","last_peered":"2024-09-10T23:25:22.139498+0000","last_clean":"2024-09-10T23:25:22.139498+0000","last_became_active":"2024-09-10T23:23:57.837104+0000","last_became_peered":"2024-09-10T23:23:57.837104+0000","last_unstale":"2024-09-10T23:25:22.139498+0000","last_undegraded":"2024-09-10T23:25:22.139498+0000","last_fullsized":"2024-09-10T23:25:22.139498+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:00.712148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.142226+0000","last_change":"2024-09-10T23:23:57.838304+0000","last_active":"2024-09-10T23:25:22.142226+0000","last_peered":"2024-09-10T23:25:22.142226+0000","last_clean":"2024-09-10T23:25:22.142226+0000","last_became_active":"2024-09-10T23:23:57.837677+0000","last_became_peered":"2024-09-10T23:23:57.837677+0000","last_unstale":"2024-09-10T23:25:22.142226+0000","last_undegraded":"2024-09-10T23:25:22.142226+0000","last_fullsized":"2024-09-10T23:25:22.142226+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:40.862950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.141412+0000","last_change":"2024-09-10T23:23:57.825579+0000","last_active":"2024-09-10T23:25:22.141412+0000","last_peered":"2024-09-10T23:25:22.141412+0000","last_clean":"2024-09-10T23:25:22.141412+0000","last_became_active":"2024-09-10T23:23:57.824840+0000","last_became_peered":"2024-09-10T23:23:57.824840+0000","last_unstale":"2024-09-10T23:25:22.141412+0000","last_undegraded":"2024-09-10T23:25:22.141412+0000","last_fullsized":"2024-09-10T23:25:22.141412+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:53:35.150858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.145649+0000","last_change":"2024-09-10T23:23:57.833479+0000","last_active":"2024-09-10T23:25:22.145649+0000","last_peered":"2024-09-10T23:25:22.145649+0000","last_clean":"2024-09-10T23:25:22.145649+0000","last_became_active":"2024-09-10T23:23:57.833124+0000","last_became_peered":"2024-09-10T23:23:57.833124+0000","last_unstale":"2024-09-10T23:25:22.145649+0000","last_undegraded":"2024-09-10T23:25:22.145649+0000","last_fullsized":"2024-09-10T23:25:22.145649+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:02.869308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.142799+0000","last_change":"2024-09-10T23:23:57.831610+0000","last_active":"2024-09-10T23:25:22.142799+0000","last_peered":"2024-09-10T23:25:22.142799+0000","last_clean":"2024-09-10T23:25:22.142799+0000","last_became_active":"2024-09-10T23:23:57.831227+0000","last_became_peered":"2024-09-10T23:23:57.831227+0000","last_unstale":"2024-09-10T23:25:22.142799+0000","last_undegraded":"2024-09-10T23:25:22.142799+0000","last_fullsized":"2024-09-10T23:25:22.142799+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:45.735286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481100+0000","last_change":"2024-09-10T23:23:57.839295+0000","last_active":"2024-09-10T23:25:22.481100+0000","last_peered":"2024-09-10T23:25:22.481100+0000","last_clean":"2024-09-10T23:25:22.481100+0000","last_became_active":"2024-09-10T23:23:57.838857+0000","last_became_peered":"2024-09-10T23:23:57.838857+0000","last_unstale":"2024-09-10T23:25:22.481100+0000","last_undegraded":"2024-09-10T23:25:22.481100+0000","last_fullsized":"2024-09-10T23:25:22.481100+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:20:13.203324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.479402+0000","last_change":"2024-09-10T23:23:57.841459+0000","last_active":"2024-09-10T23:25:22.479402+0000","last_peered":"2024-09-10T23:25:22.479402+0000","last_clean":"2024-09-10T23:25:22.479402+0000","last_became_active":"2024-09-10T23:23:57.841049+0000","last_became_peered":"2024-09-10T23:23:57.841049+0000","last_unstale":"2024-09-10T23:25:22.479402+0000","last_undegraded":"2024-09-10T23:25:22.479402+0000","last_fullsized":"2024-09-10T23:25:22.479402+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:39:51.372657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.479546+0000","last_change":"2024-09-10T23:23:57.813028+0000","last_active":"2024-09-10T23:25:22.479546+0000","last_peered":"2024-09-10T23:25:22.479546+0000","last_clean":"2024-09-10T23:25:22.479546+0000","last_became_active":"2024-09-10T23:23:57.812648+0000","last_became_peered":"2024-09-10T23:23:57.812648+0000","last_unstale":"2024-09-10T23:25:22.479546+0000","last_undegraded":"2024-09-10T23:25:22.479546+0000","last_fullsized":"2024-09-10T23:25:22.479546+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:57.691811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.139420+0000","last_change":"2024-09-10T23:23:57.814467+0000","last_active":"2024-09-10T23:25:22.139420+0000","last_peered":"2024-09-10T23:25:22.139420+0000","last_clean":"2024-09-10T23:25:22.139420+0000","last_became_active":"2024-09-10T23:23:57.812286+0000","last_became_peered":"2024-09-10T23:23:57.812286+0000","last_unstale":"2024-09-10T23:25:22.139420+0000","last_undegraded":"2024-09-10T23:25:22.139420+0000","last_fullsized":"2024-09-10T23:25:22.139420+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:42.044495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.148215+0000","last_change":"2024-09-10T23:23:57.834679+0000","last_active":"2024-09-10T23:25:22.148215+0000","last_peered":"2024-09-10T23:25:22.148215+0000","last_clean":"2024-09-10T23:25:22.148215+0000","last_became_active":"2024-09-10T23:23:57.833964+0000","last_became_peered":"2024-09-10T23:23:57.833964+0000","last_unstale":"2024-09-10T23:25:22.148215+0000","last_undegraded":"2024-09-10T23:25:22.148215+0000","last_fullsized":"2024-09-10T23:25:22.148215+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:29.160280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481645+0000","last_change":"2024-09-10T23:23:57.840788+0000","last_active":"2024-09-10T23:25:22.481645+0000","last_peered":"2024-09-10T23:25:22.481645+0000","last_clean":"2024-09-10T23:25:22.481645+0000","last_became_active":"2024-09-10T23:23:57.839946+0000","last_became_peered":"2024-09-10T23:23:57.839946+0000","last_unstale":"2024-09-10T23:25:22.481645+0000","last_undegraded":"2024-09-10T23:25:22.481645+0000","last_fullsized":"2024-09-10T23:25:22.481645+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:14.354925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.149997+0000","last_change":"2024-09-10T23:23:57.843454+0000","last_active":"2024-09-10T23:25:22.149997+0000","last_peered":"2024-09-10T23:25:22.149997+0000","last_clean":"2024-09-10T23:25:22.149997+0000","last_became_active":"2024-09-10T23:23:57.841623+0000","last_became_peered":"2024-09-10T23:23:57.841623+0000","last_unstale":"2024-09-10T23:25:22.149997+0000","last_undegraded":"2024-09-10T23:25:22.149997+0000","last_fullsized":"2024-09-10T23:25:22.149997+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:03:03.957444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480820+0000","last_change":"2024-09-10T23:23:57.834196+0000","last_active":"2024-09-10T23:25:22.480820+0000","last_peered":"2024-09-10T23:25:22.480820+0000","last_clean":"2024-09-10T23:25:22.480820+0000","last_became_active":"2024-09-10T23:23:57.833692+0000","last_became_peered":"2024-09-10T23:23:57.833692+0000","last_unstale":"2024-09-10T23:25:22.480820+0000","last_undegraded":"2024-09-10T23:25:22.480820+0000","last_fullsized":"2024-09-10T23:25:22.480820+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:49.814475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.479861+0000","last_change":"2024-09-10T23:23:57.831457+0000","last_active":"2024-09-10T23:25:22.479861+0000","last_peered":"2024-09-10T23:25:22.479861+0000","last_clean":"2024-09-10T23:25:22.479861+0000","last_became_active":"2024-09-10T23:23:57.829686+0000","last_became_peered":"2024-09-10T23:23:57.829686+0000","last_unstale":"2024-09-10T23:25:22.479861+0000","last_undegraded":"2024-09-10T23:25:22.479861+0000","last_fullsized":"2024-09-10T23:25:22.479861+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:39.204501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480513+0000","last_change":"2024-09-10T23:23:57.829437+0000","last_active":"2024-09-10T23:25:22.480513+0000","last_peered":"2024-09-10T23:25:22.480513+0000","last_clean":"2024-09-10T23:25:22.480513+0000","last_became_active":"2024-09-10T23:23:57.828956+0000","last_became_peered":"2024-09-10T23:23:57.828956+0000","last_unstale":"2024-09-10T23:25:22.480513+0000","last_undegraded":"2024-09-10T23:25:22.480513+0000","last_fullsized":"2024-09-10T23:25:22.480513+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:18.191002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.149220+0000","last_change":"2024-09-10T23:23:57.839661+0000","last_active":"2024-09-10T23:25:22.149220+0000","last_peered":"2024-09-10T23:25:22.149220+0000","last_clean":"2024-09-10T23:25:22.149220+0000","last_became_active":"2024-09-10T23:23:57.839197+0000","last_became_peered":"2024-09-10T23:23:57.839197+0000","last_unstale":"2024-09-10T23:25:22.149220+0000","last_undegraded":"2024-09-10T23:25:22.149220+0000","last_fullsized":"2024-09-10T23:25:22.149220+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:33.599860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.181048+0000","last_change":"2024-09-10T23:23:57.820968+0000","last_active":"2024-09-10T23:25:22.181048+0000","last_peered":"2024-09-10T23:25:22.181048+0000","last_clean":"2024-09-10T23:25:22.181048+0000","last_became_active":"2024-09-10T23:23:57.820108+0000","last_became_peered":"2024-09-10T23:23:57.820108+0000","last_unstale":"2024-09-10T23:25:22.181048+0000","last_undegraded":"2024-09-10T23:25:22.181048+0000","last_fullsized":"2024-09-10T23:25:22.181048+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:23.864751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.148127+0000","last_change":"2024-09-10T23:23:57.842302+0000","last_active":"2024-09-10T23:25:22.148127+0000","last_peered":"2024-09-10T23:25:22.148127+0000","last_clean":"2024-09-10T23:25:22.148127+0000","last_became_active":"2024-09-10T23:23:57.838460+0000","last_became_peered":"2024-09-10T23:23:57.838460+0000","last_unstale":"2024-09-10T23:25:22.148127+0000","last_undegraded":"2024-09-10T23:25:22.148127+0000","last_fullsized":"2024-09-10T23:25:22.148127+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:54.731481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.479921+0000","last_change":"2024-09-10T23:23:57.837749+0000","last_active":"2024-09-10T23:25:22.479921+0000","last_peered":"2024-09-10T23:25:22.479921+0000","last_clean":"2024-09-10T23:25:22.479921+0000","last_became_active":"2024-09-10T23:23:57.836195+0000","last_became_peered":"2024-09-10T23:23:57.836195+0000","last_unstale":"2024-09-10T23:25:22.479921+0000","last_undegraded":"2024-09-10T23:25:22.479921+0000","last_fullsized":"2024-09-10T23:25:22.479921+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:10.064725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480238+0000","last_change":"2024-09-10T23:23:57.812182+0000","last_active":"2024-09-10T23:25:22.480238+0000","last_peered":"2024-09-10T23:25:22.480238+0000","last_clean":"2024-09-10T23:25:22.480238+0000","last_became_active":"2024-09-10T23:23:57.811853+0000","last_became_peered":"2024-09-10T23:23:57.811853+0000","last_unstale":"2024-09-10T23:25:22.480238+0000","last_undegraded":"2024-09-10T23:25:22.480238+0000","last_fullsized":"2024-09-10T23:25:22.480238+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:03.389054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.142703+0000","last_change":"2024-09-10T23:23:57.833957+0000","last_active":"2024-09-10T23:25:22.142703+0000","last_peered":"2024-09-10T23:25:22.142703+0000","last_clean":"2024-09-10T23:25:22.142703+0000","last_became_active":"2024-09-10T23:23:57.833547+0000","last_became_peered":"2024-09-10T23:23:57.833547+0000","last_unstale":"2024-09-10T23:25:22.142703+0000","last_undegraded":"2024-09-10T23:25:22.142703+0000","last_fullsized":"2024-09-10T23:25:22.142703+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:30.917801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65520,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":402,"num_read_kb":272,"num_write":163,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":196560,"data_compressed":5592,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":288697,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678055,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32164,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712988,"statfs":{"total":95995035648,"available":95962099712,"internally_reserved":0,"allocated":999424,"data_stored":535193,"data_compressed":32452,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874285,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28140,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717012,"statfs":{"total":95995035648,"available":95966220288,"internally_reserved":0,"allocated":1134592,"data_stored":1184337,"data_compressed":71014,"data_compressed_allocated":94208,"data_compressed_original":688128,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037810,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1015808,"data_stored":539491,"data_compressed":32452,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234040,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1011712,"data_stored":535315,"data_compressed":32452,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430270,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1060864,"data_stored":1131224,"data_compressed":69150,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593797,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":530571,"data_compressed":32452,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790027,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32236,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712916,"statfs":{"total":95995035648,"available":95962025984,"internally_reserved":0,"allocated":1069056,"data_stored":1126421,"data_compressed":69150,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953552,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1003520,"data_stored":535612,"data_compressed":32452,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149782,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1003520,"data_stored":530765,"data_compressed":32452,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378717,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32240,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712912,"statfs":{"total":95995035648,"available":95962021888,"internally_reserved":0,"allocated":1073152,"data_stored":593316,"data_compressed":34316,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542240,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1052672,"data_stored":592000,"data_compressed":34316,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705767,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1015808,"data_stored":531959,"data_compressed":32452,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":61519,"data_compressed":1864,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":62835,"data_compressed":1864,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":63488,"data_compressed":1864,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:25:55.213 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T23:25:55.213 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T23:25:55.213 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-10T23:25:55.213 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-10T23:25:55.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:55 smithi003 ceph-mon[30348]: from='client.25069 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:25:55.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:55 smithi038 ceph-mon[34225]: from='client.25069 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:25:55.598 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:55.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:55 smithi194 ceph-mon[33904]: from='client.25069 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:25:56.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.178+0000 7f22f8000640 1 -- 172.21.15.3:0/453800531 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f22f010a9b0 msgr2=0x7f22f010adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:56.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.178+0000 7f22f8000640 1 --2- 172.21.15.3:0/453800531 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f22f010a9b0 0x7f22f010adf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f22dc009900 tx=0x7f22dc02a3f0 comp rx=0 tx=0).stop 2024-09-10T23:25:56.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.178+0000 7f22f8000640 1 -- 172.21.15.3:0/453800531 shutdown_connections 2024-09-10T23:25:56.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.178+0000 7f22f8000640 1 --2- 172.21.15.3:0/453800531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22f010b330 0x7f22f0111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:56.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.178+0000 7f22f8000640 1 --2- 172.21.15.3:0/453800531 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f22f010a9b0 0x7f22f010adf0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:56.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.178+0000 7f22f8000640 1 --2- 172.21.15.3:0/453800531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22f0104fa0 0x7f22f0105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:56.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.178+0000 7f22f8000640 1 -- 172.21.15.3:0/453800531 >> 172.21.15.3:0/453800531 conn(0x7f22f0100a50 msgr2=0x7f22f0102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:56.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.178+0000 7f22f8000640 1 -- 172.21.15.3:0/453800531 shutdown_connections 2024-09-10T23:25:56.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.178+0000 7f22f8000640 1 -- 172.21.15.3:0/453800531 wait complete. 2024-09-10T23:25:56.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.179+0000 7f22f8000640 1 Processor -- start 2024-09-10T23:25:56.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.179+0000 7f22f8000640 1 -- start start 2024-09-10T23:25:56.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.179+0000 7f22f8000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f22f0104fa0 0x7f22f019b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:56.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.179+0000 7f22f8000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22f010a9b0 0x7f22f019b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:56.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.179+0000 7f22f8000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22f010b330 0x7f22f01a0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:56.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.179+0000 7f22f8000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f22f0114e30 con 0x7f22f0104fa0 2024-09-10T23:25:56.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.180+0000 7f22f8000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f22f0114cb0 con 0x7f22f010b330 2024-09-10T23:25:56.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.180+0000 7f22f8000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f22f0114fb0 con 0x7f22f010a9b0 2024-09-10T23:25:56.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.180+0000 7f22f5600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f22f0104fa0 0x7f22f019b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:56.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.180+0000 7f22f5600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f22f0104fa0 0x7f22f019b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38796/0 (socket says 172.21.15.3:38796) 2024-09-10T23:25:56.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.180+0000 7f22f5600640 1 -- 172.21.15.3:0/3994443409 learned_addr learned my addr 172.21.15.3:0/3994443409 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:56.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.180+0000 7f22f6000640 1 --2- 172.21.15.3:0/3994443409 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22f010b330 0x7f22f01a0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:56.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.180+0000 7f22f4c00640 1 --2- 172.21.15.3:0/3994443409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22f010a9b0 0x7f22f019b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:56.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.180+0000 7f22f5600640 1 -- 172.21.15.3:0/3994443409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22f010a9b0 msgr2=0x7f22f019b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:56.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.180+0000 7f22f5600640 1 --2- 172.21.15.3:0/3994443409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22f010a9b0 0x7f22f019b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:56.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.180+0000 7f22f5600640 1 -- 172.21.15.3:0/3994443409 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22f010b330 msgr2=0x7f22f01a0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:56.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.180+0000 7f22f5600640 1 --2- 172.21.15.3:0/3994443409 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22f010b330 0x7f22f01a0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:56.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.180+0000 7f22f5600640 1 -- 172.21.15.3:0/3994443409 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f01a1450 con 0x7f22f0104fa0 2024-09-10T23:25:56.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.181+0000 7f22f5600640 1 --2- 172.21.15.3:0/3994443409 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f22f0104fa0 0x7f22f019b3a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f22e400d950 tx=0x7f22e400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:56.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.181+0000 7f22ee000640 1 -- 172.21.15.3:0/3994443409 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e4017070 con 0x7f22f0104fa0 2024-09-10T23:25:56.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.181+0000 7f22ee000640 1 -- 172.21.15.3:0/3994443409 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f22e4009c30 con 0x7f22f0104fa0 2024-09-10T23:25:56.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.181+0000 7f22f8000640 1 -- 172.21.15.3:0/3994443409 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22f01a1740 con 0x7f22f0104fa0 2024-09-10T23:25:56.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.181+0000 7f22ee000640 1 -- 172.21.15.3:0/3994443409 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e400f620 con 0x7f22f0104fa0 2024-09-10T23:25:56.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.181+0000 7f22f8000640 1 -- 172.21.15.3:0/3994443409 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22f01a7fd0 con 0x7f22f0104fa0 2024-09-10T23:25:56.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.182+0000 7f22f8000640 1 -- 172.21.15.3:0/3994443409 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22f0106250 con 0x7f22f0104fa0 2024-09-10T23:25:56.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.184+0000 7f22ee000640 1 -- 172.21.15.3:0/3994443409 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7f22e4010460 con 0x7f22f0104fa0 2024-09-10T23:25:56.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.186+0000 7f22ee000640 1 --2- 172.21.15.3:0/3994443409 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f22d80b5440 0x7f22d80b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:56.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.186+0000 7f22ee000640 1 -- 172.21.15.3:0/3994443409 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f22e40e5e70 con 0x7f22f0104fa0 2024-09-10T23:25:56.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.186+0000 7f22f4c00640 1 --2- 172.21.15.3:0/3994443409 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f22d80b5440 0x7f22d80b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:56.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.187+0000 7f22f4c00640 1 --2- 172.21.15.3:0/3994443409 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f22d80b5440 0x7f22d80b7900 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f22dc006010 tx=0x7f22dc005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:56.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.188+0000 7f22ee000640 1 -- 172.21.15.3:0/3994443409 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f22e40ac760 con 0x7f22f0104fa0 2024-09-10T23:25:56.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.426+0000 7f22f8000640 1 -- 172.21.15.3:0/3994443409 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f22f0105380 con 0x7f22f0104fa0 2024-09-10T23:25:56.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.426+0000 7f22ee000640 1 -- 172.21.15.3:0/3994443409 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f22f0105380 con 0x7f22f0104fa0 2024-09-10T23:25:56.428 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:56 smithi003 ceph-mon[30348]: pgmap v365: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:25:56.428 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:25:56.428 INFO:teuthology.orchestra.run.smithi003.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T23:25:56.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.430+0000 7f22f8000640 1 -- 172.21.15.3:0/3994443409 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f22d80b5440 msgr2=0x7f22d80b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:56.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.430+0000 7f22f8000640 1 --2- 172.21.15.3:0/3994443409 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f22d80b5440 0x7f22d80b7900 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f22dc006010 tx=0x7f22dc005a20 comp rx=0 tx=0).stop 2024-09-10T23:25:56.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.430+0000 7f22f8000640 1 -- 172.21.15.3:0/3994443409 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f22f0104fa0 msgr2=0x7f22f019b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:56.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.430+0000 7f22f8000640 1 --2- 172.21.15.3:0/3994443409 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f22f0104fa0 0x7f22f019b3a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f22e400d950 tx=0x7f22e400de10 comp rx=0 tx=0).stop 2024-09-10T23:25:56.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.430+0000 7f22f8000640 1 -- 172.21.15.3:0/3994443409 shutdown_connections 2024-09-10T23:25:56.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.430+0000 7f22f8000640 1 --2- 172.21.15.3:0/3994443409 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22f010b330 0x7f22f01a0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:56.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.430+0000 7f22f8000640 1 --2- 172.21.15.3:0/3994443409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22f010a9b0 0x7f22f019b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:56.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.430+0000 7f22f8000640 1 --2- 172.21.15.3:0/3994443409 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f22d80b5440 0x7f22d80b7900 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:56.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.430+0000 7f22f8000640 1 --2- 172.21.15.3:0/3994443409 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f22f0104fa0 0x7f22f019b3a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:56.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.430+0000 7f22f8000640 1 -- 172.21.15.3:0/3994443409 >> 172.21.15.3:0/3994443409 conn(0x7f22f0100a50 msgr2=0x7f22f0102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:56.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.430+0000 7f22f8000640 1 -- 172.21.15.3:0/3994443409 shutdown_connections 2024-09-10T23:25:56.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:56.430+0000 7f22f8000640 1 -- 172.21.15.3:0/3994443409 wait complete. 2024-09-10T23:25:56.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:56 smithi038 ceph-mon[34225]: pgmap v365: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:25:56.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:56 smithi194 ceph-mon[33904]: pgmap v365: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:25:57.140 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-10T23:25:57.141 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:25:57.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:57 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3994443409' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-10T23:25:57.520 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:25:57.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:57 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3994443409' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-10T23:25:57.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:57 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3994443409' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-10T23:25:58.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.078+0000 7f5e43000640 1 -- 172.21.15.3:0/1576046922 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e3c10b180 msgr2=0x7f5e3c111980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:58.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.078+0000 7f5e43000640 1 --2- 172.21.15.3:0/1576046922 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e3c10b180 0x7f5e3c111980 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5e34009ca0 tx=0x7f5e3402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:25:58.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.078+0000 7f5e43000640 1 -- 172.21.15.3:0/1576046922 shutdown_connections 2024-09-10T23:25:58.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.078+0000 7f5e43000640 1 --2- 172.21.15.3:0/1576046922 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e3c10b180 0x7f5e3c111980 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:58.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.078+0000 7f5e43000640 1 --2- 172.21.15.3:0/1576046922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e3c10a800 0x7f5e3c10ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:58.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.078+0000 7f5e43000640 1 --2- 172.21.15.3:0/1576046922 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5e3c104df0 0x7f5e3c1051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:58.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.078+0000 7f5e43000640 1 -- 172.21.15.3:0/1576046922 >> 172.21.15.3:0/1576046922 conn(0x7f5e3c100840 msgr2=0x7f5e3c102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:58.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.078+0000 7f5e43000640 1 -- 172.21.15.3:0/1576046922 shutdown_connections 2024-09-10T23:25:58.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.078+0000 7f5e43000640 1 -- 172.21.15.3:0/1576046922 wait complete. 2024-09-10T23:25:58.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.079+0000 7f5e43000640 1 Processor -- start 2024-09-10T23:25:58.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.079+0000 7f5e43000640 1 -- start start 2024-09-10T23:25:58.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.080+0000 7f5e43000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5e3c104df0 0x7f5e3c19b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:58.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.080+0000 7f5e43000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e3c10a800 0x7f5e3c19b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:58.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.080+0000 7f5e43000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e3c10b180 0x7f5e3c1a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:58.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.080+0000 7f5e43000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c114d40 con 0x7f5e3c10b180 2024-09-10T23:25:58.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.080+0000 7f5e43000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c114bc0 con 0x7f5e3c104df0 2024-09-10T23:25:58.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.080+0000 7f5e43000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c114ec0 con 0x7f5e3c10a800 2024-09-10T23:25:58.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.080+0000 7f5e42600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e3c10b180 0x7f5e3c1a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:58.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.080+0000 7f5e41c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5e3c104df0 0x7f5e3c19b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:58.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.080+0000 7f5e42600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e3c10b180 0x7f5e3c1a0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38822/0 (socket says 172.21.15.3:38822) 2024-09-10T23:25:58.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.080+0000 7f5e42600640 1 -- 172.21.15.3:0/1629228139 learned_addr learned my addr 172.21.15.3:0/1629228139 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:25:58.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.080+0000 7f5e41200640 1 --2- 172.21.15.3:0/1629228139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e3c10a800 0x7f5e3c19b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:58.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.081+0000 7f5e41c00640 1 -- 172.21.15.3:0/1629228139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e3c10a800 msgr2=0x7f5e3c19b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:58.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.081+0000 7f5e41c00640 1 --2- 172.21.15.3:0/1629228139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e3c10a800 0x7f5e3c19b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:58.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.081+0000 7f5e41c00640 1 -- 172.21.15.3:0/1629228139 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e3c10b180 msgr2=0x7f5e3c1a0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:58.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.081+0000 7f5e41c00640 1 --2- 172.21.15.3:0/1629228139 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e3c10b180 0x7f5e3c1a0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:58.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.081+0000 7f5e41c00640 1 -- 172.21.15.3:0/1629228139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e3c1a1100 con 0x7f5e3c104df0 2024-09-10T23:25:58.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.081+0000 7f5e41c00640 1 --2- 172.21.15.3:0/1629228139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5e3c104df0 0x7f5e3c19b050 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5e3000e9f0 tx=0x7f5e3000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:58.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.081+0000 7f5e3a000640 1 -- 172.21.15.3:0/1629228139 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3000ccc0 con 0x7f5e3c104df0 2024-09-10T23:25:58.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.081+0000 7f5e43000640 1 -- 172.21.15.3:0/1629228139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e3c1a13f0 con 0x7f5e3c104df0 2024-09-10T23:25:58.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.081+0000 7f5e3a000640 1 -- 172.21.15.3:0/1629228139 <== mon.2 v2:172.21.15.38:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5e300108c0 con 0x7f5e3c104df0 2024-09-10T23:25:58.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.081+0000 7f5e3a000640 1 -- 172.21.15.3:0/1629228139 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e300187a0 con 0x7f5e3c104df0 2024-09-10T23:25:58.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.081+0000 7f5e43000640 1 -- 172.21.15.3:0/1629228139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e3c1a7c80 con 0x7f5e3c104df0 2024-09-10T23:25:58.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.082+0000 7f5e43000640 1 -- 172.21.15.3:0/1629228139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e3c1051d0 con 0x7f5e3c104df0 2024-09-10T23:25:58.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.085+0000 7f5e3a000640 1 -- 172.21.15.3:0/1629228139 <== mon.2 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7f5e30010430 con 0x7f5e3c104df0 2024-09-10T23:25:58.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.087+0000 7f5e3a000640 1 --2- 172.21.15.3:0/1629228139 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5e240b5460 0x7f5e240b7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:58.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.087+0000 7f5e3a000640 1 -- 172.21.15.3:0/1629228139 <== mon.2 v2:172.21.15.38:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f5e300e6a00 con 0x7f5e3c104df0 2024-09-10T23:25:58.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.087+0000 7f5e41200640 1 --2- 172.21.15.3:0/1629228139 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5e240b5460 0x7f5e240b7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:58.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.088+0000 7f5e41200640 1 --2- 172.21.15.3:0/1629228139 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5e240b5460 0x7f5e240b7920 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c1030e0 tx=0x7f5e2800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:58.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.089+0000 7f5e3a000640 1 -- 172.21.15.3:0/1629228139 <== mon.2 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5e300ad270 con 0x7f5e3c104df0 2024-09-10T23:25:58.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.327+0000 7f5e43000640 1 -- 172.21.15.3:0/1629228139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e3c19c180 con 0x7f5e3c104df0 2024-09-10T23:25:58.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.330+0000 7f5e3a000640 1 -- 172.21.15.3:0/1629228139 <== mon.2 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11891 (secure 0 0 0) 0x7f5e300acb70 con 0x7f5e3c104df0 2024-09-10T23:25:58.331 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:25:58.331 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":25,"btime":"2024-09-10T23:24:51:241992+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/1495411512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":1495411512},{"type":"v1","addr":"172.21.15.3:6835","nonce":1495411512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/1857372777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1857372777},{"type":"v1","addr":"172.21.15.3:6837","nonce":1857372777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14862,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6839/493850676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":493850676},{"type":"v1","addr":"172.21.15.3:6839","nonce":493850676}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14874,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6841/1580524358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":1580524358},{"type":"v1","addr":"172.21.15.3:6841","nonce":1580524358}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/352514665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":352514665},{"type":"v1","addr":"172.21.15.194:6833","nonce":352514665}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2380508105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2380508105},{"type":"v1","addr":"172.21.15.194:6835","nonce":2380508105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:23:58.866253+0000","modified":"2024-09-10T23:24:51.177863+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34724,"mds_1":34682,"mds_2":34652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24649":{"gid":24649,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/739730313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":739730313},{"type":"v1","addr":"172.21.15.194:6837","nonce":739730313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/3198777710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3198777710},{"type":"v1","addr":"172.21.15.194:6839","nonce":3198777710}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34619":{"gid":34619,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6833/1194099617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1194099617},{"type":"v1","addr":"172.21.15.38:6833","nonce":1194099617}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34652":{"gid":34652,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.38:6835/218783320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":218783320},{"type":"v1","addr":"172.21.15.38:6835","nonce":218783320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34682":{"gid":34682,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":21,"addr":"172.21.15.38:6837/1821839397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":1821839397},{"type":"v1","addr":"172.21.15.38:6837","nonce":1821839397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34724":{"gid":34724,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.38:6839/458259815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":458259815},{"type":"v1","addr":"172.21.15.38:6839","nonce":458259815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34724,"qdb_cluster":[34652,34682,34724]},"id":1}]} 2024-09-10T23:25:58.331 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 25 2024-09-10T23:25:58.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.332+0000 7f5e43000640 1 -- 172.21.15.3:0/1629228139 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5e240b5460 msgr2=0x7f5e240b7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:58.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.332+0000 7f5e43000640 1 --2- 172.21.15.3:0/1629228139 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5e240b5460 0x7f5e240b7920 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c1030e0 tx=0x7f5e2800a2d0 comp rx=0 tx=0).stop 2024-09-10T23:25:58.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.332+0000 7f5e43000640 1 -- 172.21.15.3:0/1629228139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5e3c104df0 msgr2=0x7f5e3c19b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:58.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.332+0000 7f5e43000640 1 --2- 172.21.15.3:0/1629228139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5e3c104df0 0x7f5e3c19b050 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5e3000e9f0 tx=0x7f5e3000edf0 comp rx=0 tx=0).stop 2024-09-10T23:25:58.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.332+0000 7f5e43000640 1 -- 172.21.15.3:0/1629228139 shutdown_connections 2024-09-10T23:25:58.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.332+0000 7f5e43000640 1 --2- 172.21.15.3:0/1629228139 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5e240b5460 0x7f5e240b7920 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:58.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.332+0000 7f5e43000640 1 --2- 172.21.15.3:0/1629228139 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e3c10b180 0x7f5e3c1a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:58.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.332+0000 7f5e43000640 1 --2- 172.21.15.3:0/1629228139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e3c10a800 0x7f5e3c19b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:58.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.332+0000 7f5e43000640 1 --2- 172.21.15.3:0/1629228139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5e3c104df0 0x7f5e3c19b050 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:58.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.332+0000 7f5e43000640 1 -- 172.21.15.3:0/1629228139 >> 172.21.15.3:0/1629228139 conn(0x7f5e3c100840 msgr2=0x7f5e3c103cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:58.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.332+0000 7f5e43000640 1 -- 172.21.15.3:0/1629228139 shutdown_connections 2024-09-10T23:25:58.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:25:58.332+0000 7f5e43000640 1 -- 172.21.15.3:0/1629228139 wait complete. 2024-09-10T23:25:58.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:58 smithi038 ceph-mon[34225]: pgmap v366: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:25:58.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:58 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:25:58.694 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:58 smithi003 ceph-mon[30348]: pgmap v366: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:25:58.694 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:58 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:25:58.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:58 smithi194 ceph-mon[33904]: pgmap v366: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:25:58.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:58 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:25:59.105 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:25:59.586 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:59 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/1629228139' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:25:59.586 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:59 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:25:59.587 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:59 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:25:59.587 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:59 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:25:59.587 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:59 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:25:59.587 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:59 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:25:59.587 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:25:59 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:25:59.632 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:59 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/1629228139' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:25:59.632 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:59 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:25:59.632 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:59 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:25:59.632 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:59 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:25:59.632 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:59 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:25:59.632 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:59 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:25:59.633 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:25:59 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:25:59.660 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:59 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1629228139' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:25:59.661 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:59 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:25:59.661 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:59 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:25:59.661 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:59 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:25:59.661 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:59 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:25:59.661 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:59 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:25:59.661 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:25:59 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:26:00.145 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:00.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.713+0000 7f1ecbe00640 1 -- 172.21.15.3:0/3827672068 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ecc10f230 msgr2=0x7f1ecc111620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:00.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.713+0000 7f1ecbe00640 1 --2- 172.21.15.3:0/3827672068 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ecc10f230 0x7f1ecc111620 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4009ca0 tx=0x7f1ec402a950 comp rx=0 tx=0).stop 2024-09-10T23:26:00.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.714+0000 7f1ecbe00640 1 -- 172.21.15.3:0/3827672068 shutdown_connections 2024-09-10T23:26:00.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.714+0000 7f1ecbe00640 1 --2- 172.21.15.3:0/3827672068 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ecc10f230 0x7f1ecc111620 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:00.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.714+0000 7f1ecbe00640 1 --2- 172.21.15.3:0/3827672068 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ecc101fa0 0x7f1ecc10ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:00.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.714+0000 7f1ecbe00640 1 --2- 172.21.15.3:0/3827672068 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ecc101680 0x7f1ecc101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:00.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.714+0000 7f1ecbe00640 1 -- 172.21.15.3:0/3827672068 >> 172.21.15.3:0/3827672068 conn(0x7f1ecc0fd5b0 msgr2=0x7f1ecc0ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:00.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.714+0000 7f1ecbe00640 1 -- 172.21.15.3:0/3827672068 shutdown_connections 2024-09-10T23:26:00.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.714+0000 7f1ecbe00640 1 -- 172.21.15.3:0/3827672068 wait complete. 2024-09-10T23:26:00.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.715+0000 7f1ecbe00640 1 Processor -- start 2024-09-10T23:26:00.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.715+0000 7f1ecbe00640 1 -- start start 2024-09-10T23:26:00.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.716+0000 7f1ecbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ecc101680 0x7f1ecc19b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:00.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.716+0000 7f1ecbe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ecc101fa0 0x7f1ecc19b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:00.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.716+0000 7f1ecbe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ecc10f230 0x7f1ecc1a09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:00.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.716+0000 7f1ecbe00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1ecc114c60 con 0x7f1ecc101680 2024-09-10T23:26:00.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.716+0000 7f1ecbe00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f1ecc114ae0 con 0x7f1ecc10f230 2024-09-10T23:26:00.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.716+0000 7f1ecbe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1ecc114de0 con 0x7f1ecc101fa0 2024-09-10T23:26:00.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.716+0000 7f1ecaa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ecc101680 0x7f1ecc19b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:00.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.716+0000 7f1ecaa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ecc101680 0x7f1ecc19b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38834/0 (socket says 172.21.15.3:38834) 2024-09-10T23:26:00.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.716+0000 7f1ecaa00640 1 -- 172.21.15.3:0/1951701599 learned_addr learned my addr 172.21.15.3:0/1951701599 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:00.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.716+0000 7f1eca000640 1 --2- 172.21.15.3:0/1951701599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ecc101fa0 0x7f1ecc19b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:00.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.716+0000 7f1ecb400640 1 --2- 172.21.15.3:0/1951701599 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ecc10f230 0x7f1ecc1a09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:00.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.717+0000 7f1ecaa00640 1 -- 172.21.15.3:0/1951701599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ecc101fa0 msgr2=0x7f1ecc19b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:00.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.717+0000 7f1ecaa00640 1 --2- 172.21.15.3:0/1951701599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ecc101fa0 0x7f1ecc19b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:00.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.717+0000 7f1ecaa00640 1 -- 172.21.15.3:0/1951701599 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ecc10f230 msgr2=0x7f1ecc1a09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:00.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.717+0000 7f1ecaa00640 1 --2- 172.21.15.3:0/1951701599 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ecc10f230 0x7f1ecc1a09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:00.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.717+0000 7f1ecaa00640 1 -- 172.21.15.3:0/1951701599 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ecc1a1180 con 0x7f1ecc101680 2024-09-10T23:26:00.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.717+0000 7f1ecaa00640 1 --2- 172.21.15.3:0/1951701599 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ecc101680 0x7f1ecc19b0d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00e9f0 tx=0x7f1ebc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:00.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.717+0000 7f1ed0a00640 1 -- 172.21.15.3:0/1951701599 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc00cd80 con 0x7f1ecc101680 2024-09-10T23:26:00.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.717+0000 7f1ed0a00640 1 -- 172.21.15.3:0/1951701599 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1ebc0054b0 con 0x7f1ecc101680 2024-09-10T23:26:00.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.717+0000 7f1ecbe00640 1 -- 172.21.15.3:0/1951701599 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ecc1a1470 con 0x7f1ecc101680 2024-09-10T23:26:00.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.717+0000 7f1ed0a00640 1 -- 172.21.15.3:0/1951701599 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc010430 con 0x7f1ecc101680 2024-09-10T23:26:00.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.718+0000 7f1ecbe00640 1 -- 172.21.15.3:0/1951701599 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ecc1a7b30 con 0x7f1ecc101680 2024-09-10T23:26:00.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.719+0000 7f1ecbe00640 1 -- 172.21.15.3:0/1951701599 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1eac0052c0 con 0x7f1ecc101680 2024-09-10T23:26:00.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.721+0000 7f1ed0a00640 1 -- 172.21.15.3:0/1951701599 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7f1ebc005020 con 0x7f1ecc101680 2024-09-10T23:26:00.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.723+0000 7f1ed0a00640 1 --2- 172.21.15.3:0/1951701599 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f1eb00b54e0 0x7f1eb00b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:00.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.723+0000 7f1ed0a00640 1 -- 172.21.15.3:0/1951701599 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f1ebc0e63f0 con 0x7f1ecc101680 2024-09-10T23:26:00.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.723+0000 7f1eca000640 1 --2- 172.21.15.3:0/1951701599 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f1eb00b54e0 0x7f1eb00b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:00.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.724+0000 7f1eca000640 1 --2- 172.21.15.3:0/1951701599 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f1eb00b54e0 0x7f1eb00b79a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1eb80095f0 tx=0x7f1eb8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:00.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.727+0000 7f1ed0a00640 1 -- 172.21.15.3:0/1951701599 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1ebc0acc60 con 0x7f1ecc101680 2024-09-10T23:26:00.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:00 smithi038 ceph-mon[34225]: pgmap v367: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:26:00.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:00 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:26:00.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:00 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:26:00.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:00 smithi194 ceph-mon[33904]: pgmap v367: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:26:00.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:00 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:26:00.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:00 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:26:00.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:00 smithi003 ceph-mon[30348]: pgmap v367: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:26:00.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:00 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:26:00.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:00 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:26:00.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.988+0000 7f1ecbe00640 1 -- 172.21.15.3:0/1951701599 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1eac005880 con 0x7f1ecc101680 2024-09-10T23:26:00.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.989+0000 7f1ed0a00640 1 -- 172.21.15.3:0/1951701599 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11891 (secure 0 0 0) 0x7f1ebc0ac560 con 0x7f1ecc101680 2024-09-10T23:26:00.990 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:26:00.990 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":25,"btime":"2024-09-10T23:24:51:241992+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/1495411512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":1495411512},{"type":"v1","addr":"172.21.15.3:6835","nonce":1495411512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/1857372777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1857372777},{"type":"v1","addr":"172.21.15.3:6837","nonce":1857372777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14862,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6839/493850676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":493850676},{"type":"v1","addr":"172.21.15.3:6839","nonce":493850676}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14874,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6841/1580524358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":1580524358},{"type":"v1","addr":"172.21.15.3:6841","nonce":1580524358}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/352514665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":352514665},{"type":"v1","addr":"172.21.15.194:6833","nonce":352514665}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2380508105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2380508105},{"type":"v1","addr":"172.21.15.194:6835","nonce":2380508105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:23:58.866253+0000","modified":"2024-09-10T23:24:51.177863+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34724,"mds_1":34682,"mds_2":34652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24649":{"gid":24649,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/739730313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":739730313},{"type":"v1","addr":"172.21.15.194:6837","nonce":739730313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/3198777710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3198777710},{"type":"v1","addr":"172.21.15.194:6839","nonce":3198777710}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34619":{"gid":34619,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6833/1194099617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1194099617},{"type":"v1","addr":"172.21.15.38:6833","nonce":1194099617}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34652":{"gid":34652,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.38:6835/218783320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":218783320},{"type":"v1","addr":"172.21.15.38:6835","nonce":218783320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34682":{"gid":34682,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":21,"addr":"172.21.15.38:6837/1821839397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":1821839397},{"type":"v1","addr":"172.21.15.38:6837","nonce":1821839397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34724":{"gid":34724,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.38:6839/458259815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":458259815},{"type":"v1","addr":"172.21.15.38:6839","nonce":458259815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34724,"qdb_cluster":[34652,34682,34724]},"id":1}]} 2024-09-10T23:26:00.990 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 25 2024-09-10T23:26:00.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.991+0000 7f1ecbe00640 1 -- 172.21.15.3:0/1951701599 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f1eb00b54e0 msgr2=0x7f1eb00b79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:00.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.991+0000 7f1ecbe00640 1 --2- 172.21.15.3:0/1951701599 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f1eb00b54e0 0x7f1eb00b79a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1eb80095f0 tx=0x7f1eb8005f90 comp rx=0 tx=0).stop 2024-09-10T23:26:00.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.991+0000 7f1ecbe00640 1 -- 172.21.15.3:0/1951701599 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ecc101680 msgr2=0x7f1ecc19b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:00.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.991+0000 7f1ecbe00640 1 --2- 172.21.15.3:0/1951701599 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ecc101680 0x7f1ecc19b0d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00e9f0 tx=0x7f1ebc00edf0 comp rx=0 tx=0).stop 2024-09-10T23:26:00.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.991+0000 7f1ecbe00640 1 -- 172.21.15.3:0/1951701599 shutdown_connections 2024-09-10T23:26:00.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.991+0000 7f1ecbe00640 1 --2- 172.21.15.3:0/1951701599 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ecc10f230 0x7f1ecc1a09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:00.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.991+0000 7f1ecbe00640 1 --2- 172.21.15.3:0/1951701599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ecc101fa0 0x7f1ecc19b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:00.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.991+0000 7f1ecbe00640 1 --2- 172.21.15.3:0/1951701599 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f1eb00b54e0 0x7f1eb00b79a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:00.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.991+0000 7f1ecbe00640 1 --2- 172.21.15.3:0/1951701599 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ecc101680 0x7f1ecc19b0d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:00.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.991+0000 7f1ecbe00640 1 -- 172.21.15.3:0/1951701599 >> 172.21.15.3:0/1951701599 conn(0x7f1ecc0fd5b0 msgr2=0x7f1ecc1113f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:00.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.992+0000 7f1ecbe00640 1 -- 172.21.15.3:0/1951701599 shutdown_connections 2024-09-10T23:26:00.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:00.992+0000 7f1ecbe00640 1 -- 172.21.15.3:0/1951701599 wait complete. 2024-09-10T23:26:01.733 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:26:01.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:01 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:26:01.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:01 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:26:01.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:01 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/1951701599' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:26:01.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:01 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:26:01.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:01 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:26:01.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:01 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1951701599' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:26:02.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:01 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:26:02.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:01 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:26:02.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:01 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/1951701599' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:26:02.127 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:02.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.680+0000 7f8037200640 1 -- 172.21.15.3:0/2363499217 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8038102c00 msgr2=0x7f8038102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:02.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.680+0000 7f8037200640 1 --2- 172.21.15.3:0/2363499217 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8038102c00 0x7f8038102fe0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8028009900 tx=0x7f802802a410 comp rx=0 tx=0).stop 2024-09-10T23:26:02.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.680+0000 7f8037200640 1 -- 172.21.15.3:0/2363499217 shutdown_connections 2024-09-10T23:26:02.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.680+0000 7f8037200640 1 --2- 172.21.15.3:0/2363499217 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8038108f90 0x7f803810f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:02.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.680+0000 7f8037200640 1 --2- 172.21.15.3:0/2363499217 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8038108610 0x7f8038108a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:02.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.680+0000 7f8037200640 1 --2- 172.21.15.3:0/2363499217 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8038102c00 0x7f8038102fe0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:02.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.680+0000 7f8037200640 1 -- 172.21.15.3:0/2363499217 >> 172.21.15.3:0/2363499217 conn(0x7f80380fe6d0 msgr2=0x7f8038100af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:02.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.680+0000 7f8037200640 1 -- 172.21.15.3:0/2363499217 shutdown_connections 2024-09-10T23:26:02.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.680+0000 7f8037200640 1 -- 172.21.15.3:0/2363499217 wait complete. 2024-09-10T23:26:02.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.681+0000 7f8037200640 1 Processor -- start 2024-09-10T23:26:02.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.681+0000 7f8037200640 1 -- start start 2024-09-10T23:26:02.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.681+0000 7f8037200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8038102c00 0x7f803819b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:02.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.681+0000 7f8037200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8038108610 0x7f803819b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:02.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.681+0000 7f8037200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8038108f90 0x7f80381a0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:02.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.681+0000 7f8037200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8038112b50 con 0x7f8038108610 2024-09-10T23:26:02.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.681+0000 7f8037200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f80381129d0 con 0x7f8038102c00 2024-09-10T23:26:02.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.681+0000 7f8037200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8038112cd0 con 0x7f8038108f90 2024-09-10T23:26:02.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.682+0000 7f802d400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8038108610 0x7f803819b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:02.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.682+0000 7f8035e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8038102c00 0x7f803819b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:02.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.682+0000 7f802d400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8038108610 0x7f803819b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49978/0 (socket says 172.21.15.3:49978) 2024-09-10T23:26:02.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.682+0000 7f802d400640 1 -- 172.21.15.3:0/3845110802 learned_addr learned my addr 172.21.15.3:0/3845110802 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:02.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.682+0000 7f8036800640 1 --2- 172.21.15.3:0/3845110802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8038108f90 0x7f80381a0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:02.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.682+0000 7f8035e00640 1 -- 172.21.15.3:0/3845110802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8038108f90 msgr2=0x7f80381a0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:02.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.682+0000 7f8035e00640 1 --2- 172.21.15.3:0/3845110802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8038108f90 0x7f80381a0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:02.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.682+0000 7f8035e00640 1 -- 172.21.15.3:0/3845110802 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8038108610 msgr2=0x7f803819b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:02.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.682+0000 7f8035e00640 1 --2- 172.21.15.3:0/3845110802 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8038108610 0x7f803819b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:02.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.682+0000 7f8035e00640 1 -- 172.21.15.3:0/3845110802 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80381a11e0 con 0x7f8038102c00 2024-09-10T23:26:02.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.682+0000 7f802d400640 1 --2- 172.21.15.3:0/3845110802 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8038108610 0x7f803819b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:26:02.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.683+0000 7f8035e00640 1 --2- 172.21.15.3:0/3845110802 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8038102c00 0x7f803819b130 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f802802a930 tx=0x7f8028003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:02.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.683+0000 7f802f400640 1 -- 172.21.15.3:0/3845110802 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f802803f070 con 0x7f8038102c00 2024-09-10T23:26:02.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.683+0000 7f8037200640 1 -- 172.21.15.3:0/3845110802 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80381a1470 con 0x7f8038102c00 2024-09-10T23:26:02.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.683+0000 7f802f400640 1 -- 172.21.15.3:0/3845110802 <== mon.2 v2:172.21.15.38:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f802803baf0 con 0x7f8038102c00 2024-09-10T23:26:02.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.683+0000 7f802f400640 1 -- 172.21.15.3:0/3845110802 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8028035030 con 0x7f8038102c00 2024-09-10T23:26:02.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.683+0000 7f8037200640 1 -- 172.21.15.3:0/3845110802 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80381a7b90 con 0x7f8038102c00 2024-09-10T23:26:02.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.684+0000 7f8037200640 1 -- 172.21.15.3:0/3845110802 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8038102fe0 con 0x7f8038102c00 2024-09-10T23:26:02.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.687+0000 7f802f400640 1 -- 172.21.15.3:0/3845110802 <== mon.2 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7f802803b660 con 0x7f8038102c00 2024-09-10T23:26:02.689 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.688+0000 7f802f400640 1 --2- 172.21.15.3:0/3845110802 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f801c0b5460 0x7f801c0b7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:02.689 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.688+0000 7f802f400640 1 -- 172.21.15.3:0/3845110802 <== mon.2 v2:172.21.15.38:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f8028107240 con 0x7f8038102c00 2024-09-10T23:26:02.689 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.688+0000 7f802d400640 1 --2- 172.21.15.3:0/3845110802 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f801c0b5460 0x7f801c0b7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:02.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.689+0000 7f802d400640 1 --2- 172.21.15.3:0/3845110802 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f801c0b5460 0x7f801c0b7920 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8038107f00 tx=0x7f802000b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:02.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.690+0000 7f802f400640 1 -- 172.21.15.3:0/3845110802 <== mon.2 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f80280cdab0 con 0x7f8038102c00 2024-09-10T23:26:02.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.891+0000 7f8037200640 1 -- 172.21.15.3:0/3845110802 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f803802e5c0 con 0x7f8038102c00 2024-09-10T23:26:02.892 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:02 smithi003 ceph-mon[30348]: pgmap v368: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:26:02.892 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:02 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:26:02.892 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:02 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:26:02.892 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:02 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:26:02.892 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:02 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:26:02.892 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:02 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:26:02.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.893+0000 7f802f400640 1 -- 172.21.15.3:0/3845110802 <== mon.2 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+25112 (secure 0 0 0) 0x7f80280cd3b0 con 0x7f8038102c00 2024-09-10T23:26:02.894 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:26:02.894 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":90,"fsid":"3f4e30d0-6fca-11ef-bcea-c7b262605968","created":"2024-09-10T23:14:12.377466+0000","modified":"2024-09-10T23:25:22.134690+0000","last_up_change":"2024-09-10T23:22:54.895554+0000","last_in_change":"2024-09-10T23:22:29.701108+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:18:27.131879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:23:53.689954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:23:55.864693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:24:03.869094+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a38330ed-a85b-4e61-b373-dd8f1d5f7ba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6803","nonce":824467747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6805","nonce":824467747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6809","nonce":824467747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6807","nonce":824467747}]},"public_addr":"172.21.15.3:6803/824467747","cluster_addr":"172.21.15.3:6805/824467747","heartbeat_back_addr":"172.21.15.3:6809/824467747","heartbeat_front_addr":"172.21.15.3:6807/824467747","state":["exists","up"]},{"osd":1,"uuid":"49bb1212-a83e-4f85-ad71-d863880d8268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6801","nonce":1447444485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6803","nonce":1447444485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6807","nonce":1447444485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6805","nonce":1447444485}]},"public_addr":"172.21.15.38:6801/1447444485","cluster_addr":"172.21.15.38:6803/1447444485","heartbeat_back_addr":"172.21.15.38:6807/1447444485","heartbeat_front_addr":"172.21.15.38:6805/1447444485","state":["exists","up"]},{"osd":2,"uuid":"ea53eb27-e7fa-4783-9a53-8b44b4e293ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6801","nonce":3191263316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6803","nonce":3191263316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6807","nonce":3191263316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6805","nonce":3191263316}]},"public_addr":"172.21.15.194:6801/3191263316","cluster_addr":"172.21.15.194:6803/3191263316","heartbeat_back_addr":"172.21.15.194:6807/3191263316","heartbeat_front_addr":"172.21.15.194:6805/3191263316","state":["exists","up"]},{"osd":3,"uuid":"75067769-7be5-4a99-9e02-f7735b2e69c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6811","nonce":2061990952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6813","nonce":2061990952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6817","nonce":2061990952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6815","nonce":2061990952}]},"public_addr":"172.21.15.3:6811/2061990952","cluster_addr":"172.21.15.3:6813/2061990952","heartbeat_back_addr":"172.21.15.3:6817/2061990952","heartbeat_front_addr":"172.21.15.3:6815/2061990952","state":["exists","up"]},{"osd":4,"uuid":"872e90ca-b711-4206-b586-e7fa41122199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6809","nonce":413294160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6811","nonce":413294160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6815","nonce":413294160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6813","nonce":413294160}]},"public_addr":"172.21.15.38:6809/413294160","cluster_addr":"172.21.15.38:6811/413294160","heartbeat_back_addr":"172.21.15.38:6815/413294160","heartbeat_front_addr":"172.21.15.38:6813/413294160","state":["exists","up"]},{"osd":5,"uuid":"2cfa107c-6dae-4c26-9e29-8175b1237b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6809","nonce":4117812658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6811","nonce":4117812658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6815","nonce":4117812658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6813","nonce":4117812658}]},"public_addr":"172.21.15.194:6809/4117812658","cluster_addr":"172.21.15.194:6811/4117812658","heartbeat_back_addr":"172.21.15.194:6815/4117812658","heartbeat_front_addr":"172.21.15.194:6813/4117812658","state":["exists","up"]},{"osd":6,"uuid":"d2e4e309-c587-4725-a5b3-cbc7b1226750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6819","nonce":3470543721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6821","nonce":3470543721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6825","nonce":3470543721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6823","nonce":3470543721}]},"public_addr":"172.21.15.3:6819/3470543721","cluster_addr":"172.21.15.3:6821/3470543721","heartbeat_back_addr":"172.21.15.3:6825/3470543721","heartbeat_front_addr":"172.21.15.3:6823/3470543721","state":["exists","up"]},{"osd":7,"uuid":"46ecaec5-29da-4e1d-ac2f-42bbbd77e949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6817","nonce":2054203924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6819","nonce":2054203924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6823","nonce":2054203924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6821","nonce":2054203924}]},"public_addr":"172.21.15.38:6817/2054203924","cluster_addr":"172.21.15.38:6819/2054203924","heartbeat_back_addr":"172.21.15.38:6823/2054203924","heartbeat_front_addr":"172.21.15.38:6821/2054203924","state":["exists","up"]},{"osd":8,"uuid":"57fd8e43-9612-4f74-8eb2-8bdbbf7c0417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6817","nonce":170051722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6819","nonce":170051722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6823","nonce":170051722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6821","nonce":170051722}]},"public_addr":"172.21.15.194:6817/170051722","cluster_addr":"172.21.15.194:6819/170051722","heartbeat_back_addr":"172.21.15.194:6823/170051722","heartbeat_front_addr":"172.21.15.194:6821/170051722","state":["exists","up"]},{"osd":9,"uuid":"aeaaf23b-d2e2-4e30-9a49-de4aaba53900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6827","nonce":3967749600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6829","nonce":3967749600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6833","nonce":3967749600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6831","nonce":3967749600}]},"public_addr":"172.21.15.3:6827/3967749600","cluster_addr":"172.21.15.3:6829/3967749600","heartbeat_back_addr":"172.21.15.3:6833/3967749600","heartbeat_front_addr":"172.21.15.3:6831/3967749600","state":["exists","up"]},{"osd":10,"uuid":"b0ece81b-1c5b-40da-b579-fb99bacb005d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6825","nonce":1671957178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6827","nonce":1671957178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6831","nonce":1671957178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6829","nonce":1671957178}]},"public_addr":"172.21.15.38:6825/1671957178","cluster_addr":"172.21.15.38:6827/1671957178","heartbeat_back_addr":"172.21.15.38:6831/1671957178","heartbeat_front_addr":"172.21.15.38:6829/1671957178","state":["exists","up"]},{"osd":11,"uuid":"a0036526-54bf-4e8b-95cc-e7b75725961c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6825","nonce":1048859686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6827","nonce":1048859686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6831","nonce":1048859686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6829","nonce":1048859686}]},"public_addr":"172.21.15.194:6825/1048859686","cluster_addr":"172.21.15.194:6827/1048859686","heartbeat_back_addr":"172.21.15.194:6831/1048859686","heartbeat_front_addr":"172.21.15.194:6829/1048859686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:27.013354+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:56.609046+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:24.878988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:55.218204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:25.224770+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:54.614336+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:25.385483+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:55.317137+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:25.064825+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:54.655361+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:22:24.080027+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:22:52.886412+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":4,"to":6},{"from":5,"to":9}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.3:0/776988825":"2024-09-11T23:16:20.647314+0000","172.21.15.3:0/2965090335":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/2364823868":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/3186881356":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/911991463":"2024-09-11T23:16:20.647314+0000","172.21.15.3:6800/2582365069":"2024-09-11T23:14:37.169991+0000","172.21.15.3:6801/2582365069":"2024-09-11T23:14:37.169991+0000","172.21.15.3:6801/1528153492":"2024-09-11T23:15:05.835734+0000","172.21.15.3:6800/1924113958":"2024-09-11T23:16:20.647314+0000","172.21.15.3:0/554479543":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/4238683346":"2024-09-11T23:15:05.835734+0000","172.21.15.3:6800/1528153492":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/285471483":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/1249510760":"2024-09-11T23:16:20.647314+0000","172.21.15.3:6801/1924113958":"2024-09-11T23:16:20.647314+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:26:02.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.895+0000 7f8037200640 1 -- 172.21.15.3:0/3845110802 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f801c0b5460 msgr2=0x7f801c0b7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:02.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.895+0000 7f8037200640 1 --2- 172.21.15.3:0/3845110802 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f801c0b5460 0x7f801c0b7920 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8038107f00 tx=0x7f802000b410 comp rx=0 tx=0).stop 2024-09-10T23:26:02.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.895+0000 7f8037200640 1 -- 172.21.15.3:0/3845110802 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8038102c00 msgr2=0x7f803819b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:02.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.895+0000 7f8037200640 1 --2- 172.21.15.3:0/3845110802 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8038102c00 0x7f803819b130 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f802802a930 tx=0x7f8028003b90 comp rx=0 tx=0).stop 2024-09-10T23:26:02.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.895+0000 7f8037200640 1 -- 172.21.15.3:0/3845110802 shutdown_connections 2024-09-10T23:26:02.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.895+0000 7f8037200640 1 --2- 172.21.15.3:0/3845110802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8038108f90 0x7f80381a0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:02.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.895+0000 7f8037200640 1 --2- 172.21.15.3:0/3845110802 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f801c0b5460 0x7f801c0b7920 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:02.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.895+0000 7f8037200640 1 --2- 172.21.15.3:0/3845110802 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8038108610 0x7f803819b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:02.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.895+0000 7f8037200640 1 --2- 172.21.15.3:0/3845110802 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8038102c00 0x7f803819b130 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:02.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.895+0000 7f8037200640 1 -- 172.21.15.3:0/3845110802 >> 172.21.15.3:0/3845110802 conn(0x7f80380fe6d0 msgr2=0x7f8038104bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:02.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.895+0000 7f8037200640 1 -- 172.21.15.3:0/3845110802 shutdown_connections 2024-09-10T23:26:02.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:02.896+0000 7f8037200640 1 -- 172.21.15.3:0/3845110802 wait complete. 2024-09-10T23:26:02.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:02 smithi194 ceph-mon[33904]: pgmap v368: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:26:02.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:02 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:26:02.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:02 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:26:02.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:02 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:26:02.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:02 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:26:02.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:02 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:26:03.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:02 smithi038 ceph-mon[34225]: pgmap v368: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:26:03.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:02 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:26:03.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:02 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:26:03.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:02 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:26:03.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:02 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:26:03.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:02 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:26:03.671 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:26:03.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:03 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3845110802' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:26:03.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:03 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3845110802' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:26:04.051 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:04.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:03 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3845110802' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:26:04.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.613+0000 7ffae4800640 1 -- 172.21.15.3:0/1588756801 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffadc102dc0 msgr2=0x7ffadc1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:04.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.613+0000 7ffae4800640 1 --2- 172.21.15.3:0/1588756801 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffadc102dc0 0x7ffadc1031a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ffad0009860 tx=0x7ffad002a340 comp rx=0 tx=0).stop 2024-09-10T23:26:04.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.613+0000 7ffae4800640 1 -- 172.21.15.3:0/1588756801 shutdown_connections 2024-09-10T23:26:04.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.613+0000 7ffae4800640 1 --2- 172.21.15.3:0/1588756801 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffadc109150 0x7ffadc10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.613+0000 7ffae4800640 1 --2- 172.21.15.3:0/1588756801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffadc1087d0 0x7ffadc108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.613+0000 7ffae4800640 1 --2- 172.21.15.3:0/1588756801 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffadc102dc0 0x7ffadc1031a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.613+0000 7ffae4800640 1 -- 172.21.15.3:0/1588756801 >> 172.21.15.3:0/1588756801 conn(0x7ffadc0fe830 msgr2=0x7ffadc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:04.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.613+0000 7ffae4800640 1 -- 172.21.15.3:0/1588756801 shutdown_connections 2024-09-10T23:26:04.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.613+0000 7ffae4800640 1 -- 172.21.15.3:0/1588756801 wait complete. 2024-09-10T23:26:04.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.614+0000 7ffae4800640 1 Processor -- start 2024-09-10T23:26:04.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.614+0000 7ffae4800640 1 -- start start 2024-09-10T23:26:04.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.614+0000 7ffae4800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffadc102dc0 0x7ffadc0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:04.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.615+0000 7ffae4800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffadc1087d0 0x7ffadc0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:04.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.615+0000 7ffae4800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffadc109150 0x7ffadc075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:04.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.615+0000 7ffae4800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ffadc112cc0 con 0x7ffadc102dc0 2024-09-10T23:26:04.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.615+0000 7ffae4800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ffadc112b40 con 0x7ffadc109150 2024-09-10T23:26:04.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.615+0000 7ffae4800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ffadc112e40 con 0x7ffadc1087d0 2024-09-10T23:26:04.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.615+0000 7ffae1e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffadc102dc0 0x7ffadc0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:04.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.615+0000 7ffae1e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffadc102dc0 0x7ffadc0754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49994/0 (socket says 172.21.15.3:49994) 2024-09-10T23:26:04.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.615+0000 7ffae1e00640 1 -- 172.21.15.3:0/4146105401 learned_addr learned my addr 172.21.15.3:0/4146105401 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:04.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.615+0000 7ffae1400640 1 --2- 172.21.15.3:0/4146105401 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffadc1087d0 0x7ffadc0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:04.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.615+0000 7ffae2800640 1 --2- 172.21.15.3:0/4146105401 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffadc109150 0x7ffadc075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:04.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.615+0000 7ffae1e00640 1 -- 172.21.15.3:0/4146105401 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffadc1087d0 msgr2=0x7ffadc0759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:04.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.615+0000 7ffae1e00640 1 --2- 172.21.15.3:0/4146105401 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffadc1087d0 0x7ffadc0759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.615+0000 7ffae1e00640 1 -- 172.21.15.3:0/4146105401 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffadc109150 msgr2=0x7ffadc075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:04.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.615+0000 7ffae1e00640 1 --2- 172.21.15.3:0/4146105401 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffadc109150 0x7ffadc075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.615+0000 7ffae1e00640 1 -- 172.21.15.3:0/4146105401 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffadc1a75f0 con 0x7ffadc102dc0 2024-09-10T23:26:04.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.616+0000 7ffae1e00640 1 --2- 172.21.15.3:0/4146105401 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffadc102dc0 0x7ffadc0754a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ffad00057c0 tx=0x7ffad002ae60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:04.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.616+0000 7ffad6a00640 1 -- 172.21.15.3:0/4146105401 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad0040020 con 0x7ffadc102dc0 2024-09-10T23:26:04.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.616+0000 7ffad6a00640 1 -- 172.21.15.3:0/4146105401 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffad00044d0 con 0x7ffadc102dc0 2024-09-10T23:26:04.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.616+0000 7ffae4800640 1 -- 172.21.15.3:0/4146105401 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffadc1a7880 con 0x7ffadc102dc0 2024-09-10T23:26:04.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.616+0000 7ffad6a00640 1 -- 172.21.15.3:0/4146105401 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad0037040 con 0x7ffadc102dc0 2024-09-10T23:26:04.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.616+0000 7ffae4800640 1 -- 172.21.15.3:0/4146105401 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffadc1a7d60 con 0x7ffadc102dc0 2024-09-10T23:26:04.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.617+0000 7ffae4800640 1 -- 172.21.15.3:0/4146105401 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffadc1031a0 con 0x7ffadc102dc0 2024-09-10T23:26:04.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.621+0000 7ffad6a00640 1 -- 172.21.15.3:0/4146105401 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7ffad00303d0 con 0x7ffadc102dc0 2024-09-10T23:26:04.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.623+0000 7ffad6a00640 1 --2- 172.21.15.3:0/4146105401 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ffac40b53c0 0x7ffac40b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:04.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.623+0000 7ffad6a00640 1 -- 172.21.15.3:0/4146105401 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7ffad0106940 con 0x7ffadc102dc0 2024-09-10T23:26:04.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.623+0000 7ffae1400640 1 --2- 172.21.15.3:0/4146105401 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ffac40b53c0 0x7ffac40b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:04.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.624+0000 7ffae1400640 1 --2- 172.21.15.3:0/4146105401 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ffac40b53c0 0x7ffac40b7880 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffadc076f90 tx=0x7ffacc005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:04.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.625+0000 7ffad6a00640 1 -- 172.21.15.3:0/4146105401 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ffad004a020 con 0x7ffadc102dc0 2024-09-10T23:26:04.859 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.858+0000 7ffae4800640 1 -- 172.21.15.3:0/4146105401 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffadc02e5c0 con 0x7ffadc102dc0 2024-09-10T23:26:04.859 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:04 smithi003 ceph-mon[30348]: pgmap v369: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:26:04.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.858+0000 7ffad6a00640 1 -- 172.21.15.3:0/4146105401 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11891 (secure 0 0 0) 0x7ffad00c8020 con 0x7ffadc102dc0 2024-09-10T23:26:04.860 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:26:04.860 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":25,"btime":"2024-09-10T23:24:51:241992+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/1495411512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":1495411512},{"type":"v1","addr":"172.21.15.3:6835","nonce":1495411512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/1857372777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1857372777},{"type":"v1","addr":"172.21.15.3:6837","nonce":1857372777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14862,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6839/493850676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":493850676},{"type":"v1","addr":"172.21.15.3:6839","nonce":493850676}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14874,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6841/1580524358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":1580524358},{"type":"v1","addr":"172.21.15.3:6841","nonce":1580524358}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/352514665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":352514665},{"type":"v1","addr":"172.21.15.194:6833","nonce":352514665}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2380508105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2380508105},{"type":"v1","addr":"172.21.15.194:6835","nonce":2380508105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:23:58.866253+0000","modified":"2024-09-10T23:24:51.177863+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34724,"mds_1":34682,"mds_2":34652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24649":{"gid":24649,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/739730313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":739730313},{"type":"v1","addr":"172.21.15.194:6837","nonce":739730313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/3198777710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3198777710},{"type":"v1","addr":"172.21.15.194:6839","nonce":3198777710}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34619":{"gid":34619,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6833/1194099617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1194099617},{"type":"v1","addr":"172.21.15.38:6833","nonce":1194099617}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34652":{"gid":34652,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.38:6835/218783320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":218783320},{"type":"v1","addr":"172.21.15.38:6835","nonce":218783320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34682":{"gid":34682,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":21,"addr":"172.21.15.38:6837/1821839397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":1821839397},{"type":"v1","addr":"172.21.15.38:6837","nonce":1821839397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34724":{"gid":34724,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.38:6839/458259815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":458259815},{"type":"v1","addr":"172.21.15.38:6839","nonce":458259815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34724,"qdb_cluster":[34652,34682,34724]},"id":1}]} 2024-09-10T23:26:04.860 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 25 2024-09-10T23:26:04.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.862+0000 7ffae4800640 1 -- 172.21.15.3:0/4146105401 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ffac40b53c0 msgr2=0x7ffac40b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:04.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.862+0000 7ffae4800640 1 --2- 172.21.15.3:0/4146105401 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ffac40b53c0 0x7ffac40b7880 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffadc076f90 tx=0x7ffacc005f90 comp rx=0 tx=0).stop 2024-09-10T23:26:04.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.862+0000 7ffae4800640 1 -- 172.21.15.3:0/4146105401 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffadc102dc0 msgr2=0x7ffadc0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:04.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.862+0000 7ffae4800640 1 --2- 172.21.15.3:0/4146105401 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffadc102dc0 0x7ffadc0754a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ffad00057c0 tx=0x7ffad002ae60 comp rx=0 tx=0).stop 2024-09-10T23:26:04.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.862+0000 7ffae4800640 1 -- 172.21.15.3:0/4146105401 shutdown_connections 2024-09-10T23:26:04.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.862+0000 7ffae4800640 1 --2- 172.21.15.3:0/4146105401 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffadc109150 0x7ffadc075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.862+0000 7ffae4800640 1 --2- 172.21.15.3:0/4146105401 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffadc1087d0 0x7ffadc0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.862+0000 7ffae4800640 1 --2- 172.21.15.3:0/4146105401 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ffac40b53c0 0x7ffac40b7880 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.862+0000 7ffae4800640 1 --2- 172.21.15.3:0/4146105401 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffadc102dc0 0x7ffadc0754a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.862+0000 7ffae4800640 1 -- 172.21.15.3:0/4146105401 >> 172.21.15.3:0/4146105401 conn(0x7ffadc0fe830 msgr2=0x7ffadc1001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:04.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.863+0000 7ffae4800640 1 -- 172.21.15.3:0/4146105401 shutdown_connections 2024-09-10T23:26:04.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:04.863+0000 7ffae4800640 1 -- 172.21.15.3:0/4146105401 wait complete. 2024-09-10T23:26:04.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:04 smithi194 ceph-mon[33904]: pgmap v369: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:26:05.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:04 smithi038 ceph-mon[34225]: pgmap v369: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:26:05.626 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T23:23:58.866253+0000', 'modified': '2024-09-10T23:24:51.177863+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 34724, 'mds_1': 34682, 'mds_2': 34652}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24649': {'gid': 24649, 'name': 'c', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.194:6837/739730313', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6836', 'nonce': 739730313}, {'type': 'v1', 'addr': '172.21.15.194:6837', 'nonce': 739730313}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24673': {'gid': 24673, 'name': 'i', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.194:6839/3198777710', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6838', 'nonce': 3198777710}, {'type': 'v1', 'addr': '172.21.15.194:6839', 'nonce': 3198777710}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34619': {'gid': 34619, 'name': 'k', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.38:6833/1194099617', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6832', 'nonce': 1194099617}, {'type': 'v1', 'addr': '172.21.15.38:6833', 'nonce': 1194099617}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34652': {'gid': 34652, 'name': 'e', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 24, 'addr': '172.21.15.38:6835/218783320', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6834', 'nonce': 218783320}, {'type': 'v1', 'addr': '172.21.15.38:6835', 'nonce': 218783320}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34682': {'gid': 34682, 'name': 'h', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 21, 'addr': '172.21.15.38:6837/1821839397', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6836', 'nonce': 1821839397}, {'type': 'v1', 'addr': '172.21.15.38:6837', 'nonce': 1821839397}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34724': {'gid': 34724, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.38:6839/458259815', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6838', 'nonce': 458259815}, {'type': 'v1', 'addr': '172.21.15.38:6839', 'nonce': 458259815}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34724, 'qdb_cluster': [34652, 34682, 34724]} 2024-09-10T23:26:05.626 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-10T23:26:05.627 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.e status 2024-09-10T23:26:05.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:05 smithi194 ceph-mon[33904]: pgmap v370: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:26:05.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:05 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/4146105401' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:26:05.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:05 smithi003 ceph-mon[30348]: pgmap v370: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:26:05.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:05 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/4146105401' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:26:06.011 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:06.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:05 smithi038 ceph-mon[34225]: pgmap v370: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:26:06.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:05 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/4146105401' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:26:06.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.596+0000 7ff908a00640 1 -- 172.21.15.3:0/868082456 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff904104e10 msgr2=0x7ff9041051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:06.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.596+0000 7ff908a00640 1 --2- 172.21.15.3:0/868082456 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff904104e10 0x7ff9041051f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4009900 tx=0x7ff8f402a410 comp rx=0 tx=0).stop 2024-09-10T23:26:06.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.596+0000 7ff908a00640 1 -- 172.21.15.3:0/868082456 shutdown_connections 2024-09-10T23:26:06.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.596+0000 7ff908a00640 1 --2- 172.21.15.3:0/868082456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff90410b1a0 0x7ff9041119a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.596+0000 7ff908a00640 1 --2- 172.21.15.3:0/868082456 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff90410a820 0x7ff90410ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.596+0000 7ff908a00640 1 --2- 172.21.15.3:0/868082456 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff904104e10 0x7ff9041051f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.596+0000 7ff908a00640 1 -- 172.21.15.3:0/868082456 >> 172.21.15.3:0/868082456 conn(0x7ff904100840 msgr2=0x7ff904102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:06.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.596+0000 7ff908a00640 1 -- 172.21.15.3:0/868082456 shutdown_connections 2024-09-10T23:26:06.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.596+0000 7ff908a00640 1 -- 172.21.15.3:0/868082456 wait complete. 2024-09-10T23:26:06.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.598+0000 7ff908a00640 1 Processor -- start 2024-09-10T23:26:06.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.598+0000 7ff908a00640 1 -- start start 2024-09-10T23:26:06.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.598+0000 7ff908a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff904104e10 0x7ff90419b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:06.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.599+0000 7ff908a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff90410a820 0x7ff90419b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:06.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.599+0000 7ff908a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff90410b1a0 0x7ff9041a0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:06.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.599+0000 7ff908a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff904114d20 con 0x7ff90410b1a0 2024-09-10T23:26:06.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.599+0000 7ff908a00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff904114ba0 con 0x7ff904104e10 2024-09-10T23:26:06.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.599+0000 7ff908a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff904114ea0 con 0x7ff90410a820 2024-09-10T23:26:06.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.599+0000 7ff903200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff90410b1a0 0x7ff9041a0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:06.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.599+0000 7ff903200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff90410b1a0 0x7ff9041a0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50006/0 (socket says 172.21.15.3:50006) 2024-09-10T23:26:06.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.599+0000 7ff903200640 1 -- 172.21.15.3:0/2891640667 learned_addr learned my addr 172.21.15.3:0/2891640667 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:06.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.599+0000 7ff8fbe00640 1 --2- 172.21.15.3:0/2891640667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff90410a820 0x7ff90419b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:06.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.599+0000 7ff902800640 1 --2- 172.21.15.3:0/2891640667 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff904104e10 0x7ff90419b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:06.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.599+0000 7ff903200640 1 -- 172.21.15.3:0/2891640667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff90410a820 msgr2=0x7ff90419b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:06.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.599+0000 7ff903200640 1 --2- 172.21.15.3:0/2891640667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff90410a820 0x7ff90419b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.599+0000 7ff903200640 1 -- 172.21.15.3:0/2891640667 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff904104e10 msgr2=0x7ff90419b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:06.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.599+0000 7ff903200640 1 --2- 172.21.15.3:0/2891640667 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff904104e10 0x7ff90419b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.599+0000 7ff903200640 1 -- 172.21.15.3:0/2891640667 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9041a11e0 con 0x7ff90410b1a0 2024-09-10T23:26:06.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.599+0000 7ff902800640 1 --2- 172.21.15.3:0/2891640667 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff904104e10 0x7ff90419b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:06.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.600+0000 7ff903200640 1 --2- 172.21.15.3:0/2891640667 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff90410b1a0 0x7ff9041a0a10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc00eaa0 tx=0x7ff8fc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:06.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.600+0000 7ff8fb400640 1 -- 172.21.15.3:0/2891640667 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc00cdb0 con 0x7ff90410b1a0 2024-09-10T23:26:06.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.600+0000 7ff8fb400640 1 -- 172.21.15.3:0/2891640667 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff8fc005020 con 0x7ff90410b1a0 2024-09-10T23:26:06.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.600+0000 7ff908a00640 1 -- 172.21.15.3:0/2891640667 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9041a14d0 con 0x7ff90410b1a0 2024-09-10T23:26:06.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.600+0000 7ff8fb400640 1 -- 172.21.15.3:0/2891640667 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc0116d0 con 0x7ff90410b1a0 2024-09-10T23:26:06.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.600+0000 7ff908a00640 1 -- 172.21.15.3:0/2891640667 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9041a7b90 con 0x7ff90410b1a0 2024-09-10T23:26:06.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.603+0000 7ff90be45740 1 Processor -- start 2024-09-10T23:26:06.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.604+0000 7ff8fb400640 1 -- 172.21.15.3:0/2891640667 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7ff8fc00f040 con 0x7ff90410b1a0 2024-09-10T23:26:06.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.604+0000 7ff90be45740 1 -- start start 2024-09-10T23:26:06.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.604+0000 7ff90be45740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d0e7146400 0x55d0e71467e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:06.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.604+0000 7ff90be45740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0e7146d20 0x55d0e7152770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:06.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.604+0000 7ff90be45740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0e7152cb0 0x55d0e71550a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:06.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.604+0000 7ff90be45740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d0e70bdd50 con 0x55d0e7146400 2024-09-10T23:26:06.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.604+0000 7ff90be45740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55d0e70ad180 con 0x55d0e7152cb0 2024-09-10T23:26:06.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.604+0000 7ff90be45740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55d0e70b0f90 con 0x55d0e7146d20 2024-09-10T23:26:06.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.604+0000 7ff8fbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d0e7146400 0x55d0e71467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:06.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.605+0000 7ff8fbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d0e7146400 0x55d0e71467e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50014/0 (socket says 172.21.15.3:50014) 2024-09-10T23:26:06.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.605+0000 7ff8fbe00640 1 -- 172.21.15.3:0/3706849000 learned_addr learned my addr 172.21.15.3:0/3706849000 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:06.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.605+0000 7ff8fbe00640 1 --2- 172.21.15.3:0/3706849000 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0e7152cb0 0x55d0e71550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:06.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.605+0000 7ff902800640 1 --2- 172.21.15.3:0/3706849000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0e7146d20 0x55d0e7152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:06.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.605+0000 7ff8fbe00640 1 -- 172.21.15.3:0/3706849000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0e7146d20 msgr2=0x55d0e7152770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:06.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.605+0000 7ff8fbe00640 1 --2- 172.21.15.3:0/3706849000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0e7146d20 0x55d0e7152770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.605+0000 7ff8fbe00640 1 -- 172.21.15.3:0/3706849000 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0e7152cb0 msgr2=0x55d0e71550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:06.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.605+0000 7ff8fbe00640 1 --2- 172.21.15.3:0/3706849000 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0e7152cb0 0x55d0e71550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.605+0000 7ff8fbe00640 1 -- 172.21.15.3:0/3706849000 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0e7077a70 con 0x55d0e7146400 2024-09-10T23:26:06.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.605+0000 7ff8fbe00640 1 --2- 172.21.15.3:0/3706849000 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d0e7146400 0x55d0e71467e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec013650 tx=0x7ff8ec009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e15062eb45f6ca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:06.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.606+0000 7ff8f3400640 1 -- 172.21.15.3:0/3706849000 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec004050 con 0x55d0e7146400 2024-09-10T23:26:06.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.606+0000 7ff8f3400640 1 -- 172.21.15.3:0/3706849000 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff8ec0035f0 con 0x55d0e7146400 2024-09-10T23:26:06.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.606+0000 7ff8f3400640 1 -- 172.21.15.3:0/3706849000 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec00f7c0 con 0x55d0e7146400 2024-09-10T23:26:06.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.606+0000 7ff8fb400640 1 --2- 172.21.15.3:0/2891640667 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff8e80b5460 0x7ff8e80b7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:06.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.606+0000 7ff90be45740 1 -- 172.21.15.3:0/3706849000 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d0e7146400 msgr2=0x55d0e71467e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:06.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.606+0000 7ff8fb400640 1 -- 172.21.15.3:0/2891640667 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7ff8fc0e6160 con 0x7ff90410b1a0 2024-09-10T23:26:06.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.606+0000 7ff90be45740 1 --2- 172.21.15.3:0/3706849000 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d0e7146400 0x55d0e71467e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec013650 tx=0x7ff8ec009850 comp rx=0 tx=0).stop 2024-09-10T23:26:06.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.606+0000 7ff902800640 1 --2- 172.21.15.3:0/2891640667 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff8e80b5460 0x7ff8e80b7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:06.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.607+0000 7ff90be45740 1 -- 172.21.15.3:0/3706849000 shutdown_connections 2024-09-10T23:26:06.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.607+0000 7ff90be45740 1 --2- 172.21.15.3:0/3706849000 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0e7152cb0 0x55d0e71550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.607+0000 7ff90be45740 1 --2- 172.21.15.3:0/3706849000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0e7146d20 0x55d0e7152770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.607+0000 7ff90be45740 1 --2- 172.21.15.3:0/3706849000 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d0e7146400 0x55d0e71467e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.607+0000 7ff90be45740 1 -- 172.21.15.3:0/3706849000 >> 172.21.15.3:0/3706849000 conn(0x55d0e7144230 msgr2=0x55d0e71453d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:06.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.607+0000 7ff90be45740 1 -- 172.21.15.3:0/3706849000 shutdown_connections 2024-09-10T23:26:06.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.607+0000 7ff90be45740 1 -- 172.21.15.3:0/3706849000 wait complete. 2024-09-10T23:26:06.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.607+0000 7ff902800640 1 --2- 172.21.15.3:0/2891640667 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff8e80b5460 0x7ff8e80b7920 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4006010 tx=0x7ff8f4005b50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:06.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.607+0000 7ff90be45740 1 -- start start 2024-09-10T23:26:06.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.607+0000 7ff90be45740 1 Processor -- start 2024-09-10T23:26:06.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.608+0000 7ff90be45740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0e7146400 0x55d0e714fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:06.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.608+0000 7ff90be45740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0e7146d20 0x55d0e71501c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:06.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.608+0000 7ff90be45740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d0e7152cb0 0x55d0e7150700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:06.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.608+0000 7ff90be45740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d0e6f0e5f0 con 0x55d0e7152cb0 2024-09-10T23:26:06.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.608+0000 7ff90be45740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55d0e7048460 con 0x55d0e7146400 2024-09-10T23:26:06.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.608+0000 7ff90be45740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55d0e7155a00 con 0x55d0e7146d20 2024-09-10T23:26:06.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.608+0000 7ff90be45740 10 client.0 _ll_register_callbacks cb 0x55d0e7058210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:06.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.608+0000 7ff903200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d0e7152cb0 0x55d0e7150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:06.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.608+0000 7ff8fbe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0e7146d20 0x55d0e71501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:06.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.608+0000 7ff903200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d0e7152cb0 0x55d0e7150700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50020/0 (socket says 172.21.15.3:50020) 2024-09-10T23:26:06.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.608+0000 7ff903200640 1 -- 172.21.15.3:0/3520277368 learned_addr learned my addr 172.21.15.3:0/3520277368 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:06.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.609+0000 7ff902800640 1 --2- 172.21.15.3:0/3520277368 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0e7146400 0x55d0e714fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:06.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.609+0000 7ff903200640 1 -- 172.21.15.3:0/3520277368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0e7146d20 msgr2=0x55d0e71501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:06.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.609+0000 7ff903200640 1 --2- 172.21.15.3:0/3520277368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0e7146d20 0x55d0e71501c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.609+0000 7ff903200640 1 -- 172.21.15.3:0/3520277368 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0e7146400 msgr2=0x55d0e714fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:06.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.609+0000 7ff903200640 1 --2- 172.21.15.3:0/3520277368 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0e7146400 0x55d0e714fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.609+0000 7ff903200640 1 -- 172.21.15.3:0/3520277368 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0e6e0b540 con 0x55d0e7152cb0 2024-09-10T23:26:06.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.609+0000 7ff903200640 1 --2- 172.21.15.3:0/3520277368 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d0e7152cb0 0x55d0e7150700 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0a88a0 tx=0x7ff8fc005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e745155733e76f82 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:06.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.609+0000 7ff8e7e00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-10T23:26:06.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.610+0000 7ff8e7e00640 1 -- 172.21.15.3:0/3520277368 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc01f030 con 0x55d0e7152cb0 2024-09-10T23:26:06.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.610+0000 7ff8e7e00640 1 -- 172.21.15.3:0/3520277368 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7ff8fc0cf070 con 0x55d0e7152cb0 2024-09-10T23:26:06.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.610+0000 7ff90be45740 1 -- 172.21.15.3:0/3520277368 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d0e704aa70 con 0x55d0e7152cb0 2024-09-10T23:26:06.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.610+0000 7ff8e7e00640 1 -- 172.21.15.3:0/3520277368 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff8fc0b0db0 con 0x55d0e7152cb0 2024-09-10T23:26:06.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.610+0000 7ff90be45740 10 client.15336 fetch_fsmap learned FSMap version 25 2024-09-10T23:26:06.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.610+0000 7ff90be45740 1 -- 172.21.15.3:0/3520277368 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d0e70656f0 con 0x55d0e7152cb0 2024-09-10T23:26:06.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.610+0000 7ff8e7e00640 1 -- 172.21.15.3:0/3520277368 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff8fc0c1e50 con 0x55d0e7152cb0 2024-09-10T23:26:06.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.610+0000 7ff8e7e00640 1 -- 172.21.15.3:0/3520277368 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7ff8fc0a7c20 con 0x55d0e7152cb0 2024-09-10T23:26:06.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.610+0000 7ff90be45740 10 client.15336 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:26:06.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.610+0000 7ff90be45740 10 client.15336 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-10T23:26:06.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.610+0000 7ff90be45740 20 client.15336 populate_metadata read hostname 'smithi003' 2024-09-10T23:26:06.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.611+0000 7ff90be45740 1 --2- 172.21.15.3:0/3520277368 >> [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] conn(0x55d0e7163a40 0x55d0e7164eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:06.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.611+0000 7ff90be45740 4 client.15336 mds_command: new command op to 34652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:26:06.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.611+0000 7ff90be45740 1 -- 172.21.15.3:0/3520277368 --> [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0e70bfca0 con 0x55d0e7163a40 2024-09-10T23:26:06.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.611+0000 7ff902800640 1 --2- 172.21.15.3:0/3520277368 >> [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] conn(0x55d0e7163a40 0x55d0e7164eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:06.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.612+0000 7ff902800640 1 --2- 172.21.15.3:0/3520277368 >> [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] conn(0x55d0e7163a40 0x55d0e7164eb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=edfcbe39a06a2f5f server_cookie=f42b3d7234f52731 in_seq=0 out_seq=0 2024-09-10T23:26:06.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.612+0000 7ff8e7e00640 10 client.15336 ms_handle_connect on v2:172.21.15.38:6834/218783320 2024-09-10T23:26:06.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.613+0000 7ff8e7e00640 1 -- 172.21.15.3:0/3520277368 <== mds.2 v2:172.21.15.38:6834/218783320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d0e70bfca0 con 0x55d0e7163a40 2024-09-10T23:26:06.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.613+0000 7ff8e7e00640 10 client.15336 handle_command_reply: tid=0 2024-09-10T23:26:06.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.613+0000 7ff90be45740 1 client.15336 shutdown 2024-09-10T23:26:06.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.613+0000 7ff90be45740 1 -- 172.21.15.3:0/3520277368 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d0e7152cb0 msgr2=0x55d0e7150700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:06.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.613+0000 7ff90be45740 1 --2- 172.21.15.3:0/3520277368 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d0e7152cb0 0x55d0e7150700 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0a88a0 tx=0x7ff8fc005720 comp rx=0 tx=0).stop 2024-09-10T23:26:06.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.613+0000 7ff90be45740 1 -- 172.21.15.3:0/3520277368 shutdown_connections 2024-09-10T23:26:06.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.613+0000 7ff90be45740 1 --2- 172.21.15.3:0/3520277368 >> [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] conn(0x55d0e7163a40 0x55d0e7164eb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.613+0000 7ff90be45740 1 --2- 172.21.15.3:0/3520277368 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d0e7152cb0 0x55d0e7150700 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.613+0000 7ff8e7e00640 0 client.15336 ms_handle_reset on v2:172.21.15.38:6834/218783320 2024-09-10T23:26:06.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.613+0000 7ff90be45740 1 --2- 172.21.15.3:0/3520277368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0e7146d20 0x55d0e71501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.613+0000 7ff90be45740 1 --2- 172.21.15.3:0/3520277368 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0e7146400 0x55d0e714fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.613+0000 7ff90be45740 1 -- 172.21.15.3:0/3520277368 >> 172.21.15.3:0/3520277368 conn(0x55d0e7144230 msgr2=0x55d0e7149da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:06.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.613+0000 7ff90be45740 1 -- 172.21.15.3:0/3520277368 shutdown_connections 2024-09-10T23:26:06.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.613+0000 7ff90be45740 1 -- 172.21.15.3:0/3520277368 wait complete. 2024-09-10T23:26:06.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.613+0000 7ff90be45740 20 client.15336 trim_cache size 0 max 16384 2024-09-10T23:26:06.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.632+0000 7ff90be45740 1 Processor -- start 2024-09-10T23:26:06.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.632+0000 7ff90be45740 1 -- start start 2024-09-10T23:26:06.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.633+0000 7ff90be45740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0e7146400 0x55d0e714a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:06.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.633+0000 7ff90be45740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0e7146d20 0x55d0e714ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:06.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.633+0000 7ff90be45740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d0e7152cb0 0x55d0e714d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:06.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.633+0000 7ff90be45740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d0e71631f0 con 0x55d0e7152cb0 2024-09-10T23:26:06.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.633+0000 7ff90be45740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55d0e71638c0 con 0x55d0e7146400 2024-09-10T23:26:06.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.633+0000 7ff90be45740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55d0e7163f90 con 0x55d0e7146d20 2024-09-10T23:26:06.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.633+0000 7ff903200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d0e7152cb0 0x55d0e714d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:06.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.633+0000 7ff902800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0e7146400 0x55d0e714a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:06.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.633+0000 7ff902800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0e7146400 0x55d0e714a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.3:47554/0 (socket says 172.21.15.3:47554) 2024-09-10T23:26:06.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.633+0000 7ff903200640 1 --2- 172.21.15.3:0/1281419795 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d0e7152cb0 0x55d0e714d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50022/0 (socket says 172.21.15.3:50022) 2024-09-10T23:26:06.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.633+0000 7ff8fbe00640 1 --2- 172.21.15.3:0/1281419795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0e7146d20 0x55d0e714ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:06.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.633+0000 7ff902800640 1 -- 172.21.15.3:0/1281419795 learned_addr learned my addr 172.21.15.3:0/1281419795 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:06.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.633+0000 7ff903200640 1 -- 172.21.15.3:0/1281419795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0e7146d20 msgr2=0x55d0e714ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:06.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.633+0000 7ff903200640 1 --2- 172.21.15.3:0/1281419795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0e7146d20 0x55d0e714ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.633+0000 7ff903200640 1 -- 172.21.15.3:0/1281419795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0e7146400 msgr2=0x55d0e714a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:06.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.633+0000 7ff903200640 1 --2- 172.21.15.3:0/1281419795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0e7146400 0x55d0e714a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.633+0000 7ff903200640 1 -- 172.21.15.3:0/1281419795 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0e7144cb0 con 0x55d0e7152cb0 2024-09-10T23:26:06.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.634+0000 7ff902800640 1 --2- 172.21.15.3:0/1281419795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0e7146400 0x55d0e714a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:26:06.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.634+0000 7ff903200640 1 --2- 172.21.15.3:0/1281419795 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d0e7152cb0 0x55d0e714d3d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0a8850 tx=0x7ff8fc0e3a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700a304519a6fe1d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:06.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.634+0000 7ff8f2a00640 1 -- 172.21.15.3:0/1281419795 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc0c5070 con 0x55d0e7152cb0 2024-09-10T23:26:06.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.634+0000 7ff8f2a00640 1 -- 172.21.15.3:0/1281419795 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55d0e704aa70 con 0x55d0e7152cb0 2024-09-10T23:26:06.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.634+0000 7ff8f2a00640 1 -- 172.21.15.3:0/1281419795 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc01f070 con 0x55d0e7152cb0 2024-09-10T23:26:06.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.635+0000 7ff90be45740 1 -- 172.21.15.3:0/1281419795 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d0e7152cb0 msgr2=0x55d0e714d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:06.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.635+0000 7ff90be45740 1 --2- 172.21.15.3:0/1281419795 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d0e7152cb0 0x55d0e714d3d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0a8850 tx=0x7ff8fc0e3a80 comp rx=0 tx=0).stop 2024-09-10T23:26:06.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.635+0000 7ff90be45740 1 -- 172.21.15.3:0/1281419795 shutdown_connections 2024-09-10T23:26:06.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.635+0000 7ff90be45740 1 --2- 172.21.15.3:0/1281419795 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d0e7152cb0 0x55d0e714d3d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.635+0000 7ff90be45740 1 --2- 172.21.15.3:0/1281419795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0e7146d20 0x55d0e714ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.635+0000 7ff90be45740 1 --2- 172.21.15.3:0/1281419795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0e7146400 0x55d0e714a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.635+0000 7ff90be45740 1 -- 172.21.15.3:0/1281419795 >> 172.21.15.3:0/1281419795 conn(0x55d0e7144230 msgr2=0x55d0e714e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:06.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.635+0000 7ff90be45740 1 -- 172.21.15.3:0/1281419795 shutdown_connections 2024-09-10T23:26:06.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.635+0000 7ff90be45740 1 -- 172.21.15.3:0/1281419795 wait complete. 2024-09-10T23:26:06.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.635+0000 7ff90be45740 1 -- start start 2024-09-10T23:26:06.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.635+0000 7ff90be45740 1 Processor -- start 2024-09-10T23:26:06.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.636+0000 7ff90be45740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0e7146400 0x55d0e716d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:06.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.636+0000 7ff90be45740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0e7146d20 0x55d0e7167b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:06.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.636+0000 7ff90be45740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d0e7152cb0 0x55d0e7168050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:06.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.636+0000 7ff90be45740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d0e7164d30 con 0x55d0e7152cb0 2024-09-10T23:26:06.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.636+0000 7ff90be45740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55d0e7164660 con 0x55d0e7146d20 2024-09-10T23:26:06.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.636+0000 7ff90be45740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55d0e7165400 con 0x55d0e7146400 2024-09-10T23:26:06.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.636+0000 7ff90be45740 10 client.0 _ll_register_callbacks cb 0x7ff8fc0aba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:06.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.636+0000 7ff903200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d0e7152cb0 0x55d0e7168050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:06.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.636+0000 7ff903200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d0e7152cb0 0x55d0e7168050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50030/0 (socket says 172.21.15.3:50030) 2024-09-10T23:26:06.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.636+0000 7ff903200640 1 -- 172.21.15.3:0/3198878582 learned_addr learned my addr 172.21.15.3:0/3198878582 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:06.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.636+0000 7ff902800640 1 --2- 172.21.15.3:0/3198878582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0e7146400 0x55d0e716d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:06.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.637+0000 7ff8fbe00640 1 --2- 172.21.15.3:0/3198878582 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0e7146d20 0x55d0e7167b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:06.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.637+0000 7ff903200640 1 -- 172.21.15.3:0/3198878582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0e7146400 msgr2=0x55d0e716d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:06.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.637+0000 7ff903200640 1 --2- 172.21.15.3:0/3198878582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0e7146400 0x55d0e716d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.637+0000 7ff903200640 1 -- 172.21.15.3:0/3198878582 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0e7146d20 msgr2=0x55d0e7167b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:06.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.637+0000 7ff903200640 1 --2- 172.21.15.3:0/3198878582 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0e7146d20 0x55d0e7167b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.637+0000 7ff903200640 1 -- 172.21.15.3:0/3198878582 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0e71685c0 con 0x55d0e7152cb0 2024-09-10T23:26:06.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.637+0000 7ff8fbe00640 1 --2- 172.21.15.3:0/3198878582 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0e7146d20 0x55d0e7167b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:06.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.637+0000 7ff903200640 1 --2- 172.21.15.3:0/3198878582 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d0e7152cb0 0x55d0e7168050 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0abcc0 tx=0x7ff8fc00c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8147d56220f7247b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:06.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.637+0000 7ff8e7e00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-10T23:26:06.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.637+0000 7ff8e7e00640 1 -- 172.21.15.3:0/3198878582 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc0c5020 con 0x55d0e7152cb0 2024-09-10T23:26:06.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.637+0000 7ff8e7e00640 1 -- 172.21.15.3:0/3198878582 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7ff8fc0ab130 con 0x55d0e7152cb0 2024-09-10T23:26:06.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.637+0000 7ff90be45740 1 -- 172.21.15.3:0/3198878582 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d0e704aa70 con 0x55d0e7152cb0 2024-09-10T23:26:06.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.638+0000 7ff8e7e00640 1 -- 172.21.15.3:0/3198878582 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff8fc01f030 con 0x55d0e7152cb0 2024-09-10T23:26:06.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.638+0000 7ff90be45740 10 client.15342 fetch_fsmap learned FSMap version 25 2024-09-10T23:26:06.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.638+0000 7ff90be45740 1 -- 172.21.15.3:0/3198878582 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d0e71d1120 con 0x55d0e7152cb0 2024-09-10T23:26:06.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.638+0000 7ff8e7e00640 1 -- 172.21.15.3:0/3198878582 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55d0e704aa70 con 0x55d0e7152cb0 2024-09-10T23:26:06.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.638+0000 7ff8e7e00640 1 -- 172.21.15.3:0/3198878582 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7ff8fc0c8070 con 0x55d0e7152cb0 2024-09-10T23:26:06.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.638+0000 7ff90be45740 10 client.15342 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:26:06.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.638+0000 7ff90be45740 10 client.15342 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-10T23:26:06.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.638+0000 7ff90be45740 20 client.15342 populate_metadata read hostname 'smithi003' 2024-09-10T23:26:06.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.638+0000 7ff90be45740 1 --2- 172.21.15.3:0/3198878582 >> [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] conn(0x55d0e71d5750 0x55d0e71d4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:06.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.638+0000 7ff90be45740 4 client.15342 mds_command: new command op to 34652 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:26:06.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.638+0000 7ff90be45740 1 -- 172.21.15.3:0/3198878582 --> [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] -- command(tid 0: {"prefix": "status"}) -- 0x55d0e70bb750 con 0x55d0e71d5750 2024-09-10T23:26:06.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.639+0000 7ff902800640 1 --2- 172.21.15.3:0/3198878582 >> [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] conn(0x55d0e71d5750 0x55d0e71d4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:06.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.639+0000 7ff902800640 1 --2- 172.21.15.3:0/3198878582 >> [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] conn(0x55d0e71d5750 0x55d0e71d4460 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=62b521613871f688 server_cookie=ef3a88561ab33262 in_seq=0 out_seq=0 2024-09-10T23:26:06.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.639+0000 7ff8e7e00640 10 client.15342 ms_handle_connect on v2:172.21.15.38:6834/218783320 2024-09-10T23:26:06.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.640+0000 7ff8e7e00640 1 -- 172.21.15.3:0/3198878582 <== mds.2 v2:172.21.15.38:6834/218783320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55d0e70bb750 con 0x55d0e71d5750 2024-09-10T23:26:06.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.640+0000 7ff8e7e00640 10 client.15342 handle_command_reply: tid=0 2024-09-10T23:26:06.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.640+0000 7ff90be45740 1 client.15342 shutdown 2024-09-10T23:26:06.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.640+0000 7ff90be45740 1 -- 172.21.15.3:0/3198878582 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d0e7152cb0 msgr2=0x55d0e7168050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:06.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.640+0000 7ff90be45740 1 --2- 172.21.15.3:0/3198878582 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d0e7152cb0 0x55d0e7168050 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0abcc0 tx=0x7ff8fc00c870 comp rx=0 tx=0).stop 2024-09-10T23:26:06.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.640+0000 7ff90be45740 1 -- 172.21.15.3:0/3198878582 shutdown_connections 2024-09-10T23:26:06.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.640+0000 7ff90be45740 1 --2- 172.21.15.3:0/3198878582 >> [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] conn(0x55d0e71d5750 0x55d0e71d4460 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.640+0000 7ff90be45740 1 --2- 172.21.15.3:0/3198878582 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d0e7152cb0 0x55d0e7168050 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.640+0000 7ff90be45740 1 --2- 172.21.15.3:0/3198878582 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0e7146d20 0x55d0e7167b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.640+0000 7ff90be45740 1 --2- 172.21.15.3:0/3198878582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0e7146400 0x55d0e716d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.640+0000 7ff8e7e00640 0 client.15342 ms_handle_reset on v2:172.21.15.38:6834/218783320 2024-09-10T23:26:06.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.640+0000 7ff90be45740 1 -- 172.21.15.3:0/3198878582 >> 172.21.15.3:0/3198878582 conn(0x55d0e7144230 msgr2=0x55d0e71512b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:06.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.640+0000 7ff90be45740 1 -- 172.21.15.3:0/3198878582 shutdown_connections 2024-09-10T23:26:06.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.640+0000 7ff90be45740 1 -- 172.21.15.3:0/3198878582 wait complete. 2024-09-10T23:26:06.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.640+0000 7ff90be45740 20 client.15342 trim_cache size 0 max 16384 2024-09-10T23:26:06.645 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-10T23:26:06.645 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_fsid": "3f4e30d0-6fca-11ef-bcea-c7b262605968", 2024-09-10T23:26:06.646 INFO:teuthology.orchestra.run.smithi003.stdout: "whoami": 2, 2024-09-10T23:26:06.646 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 34652, 2024-09-10T23:26:06.646 INFO:teuthology.orchestra.run.smithi003.stdout: "want_state": "up:active", 2024-09-10T23:26:06.646 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "up:active", 2024-09-10T23:26:06.646 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs", 2024-09-10T23:26:06.646 INFO:teuthology.orchestra.run.smithi003.stdout: "rank_uptime": 78.406017828000003, 2024-09-10T23:26:06.646 INFO:teuthology.orchestra.run.smithi003.stdout: "mdsmap_epoch": 25, 2024-09-10T23:26:06.646 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch": 90, 2024-09-10T23:26:06.646 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch_barrier": 88, 2024-09-10T23:26:06.646 INFO:teuthology.orchestra.run.smithi003.stdout: "uptime": 166.644290947 2024-09-10T23:26:06.646 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-10T23:26:06.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.641+0000 7ff908a00640 1 -- 172.21.15.3:0/2891640667 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff8e80b5460 msgr2=0x7ff8e80b7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:06.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.641+0000 7ff908a00640 1 --2- 172.21.15.3:0/2891640667 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff8e80b5460 0x7ff8e80b7920 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4006010 tx=0x7ff8f4005b50 comp rx=0 tx=0).stop 2024-09-10T23:26:06.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.641+0000 7ff908a00640 1 -- 172.21.15.3:0/2891640667 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff90410b1a0 msgr2=0x7ff9041a0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:06.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.641+0000 7ff908a00640 1 --2- 172.21.15.3:0/2891640667 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff90410b1a0 0x7ff9041a0a10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc00eaa0 tx=0x7ff8fc00ef60 comp rx=0 tx=0).stop 2024-09-10T23:26:06.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.641+0000 7ff908a00640 1 -- 172.21.15.3:0/2891640667 shutdown_connections 2024-09-10T23:26:06.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.641+0000 7ff908a00640 1 --2- 172.21.15.3:0/2891640667 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff8e80b5460 0x7ff8e80b7920 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.641+0000 7ff908a00640 1 --2- 172.21.15.3:0/2891640667 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff90410b1a0 0x7ff9041a0a10 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.641+0000 7ff908a00640 1 --2- 172.21.15.3:0/2891640667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff90410a820 0x7ff90419b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.641+0000 7ff908a00640 1 --2- 172.21.15.3:0/2891640667 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff904104e10 0x7ff90419b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.641+0000 7ff908a00640 1 -- 172.21.15.3:0/2891640667 >> 172.21.15.3:0/2891640667 conn(0x7ff904100840 msgr2=0x7ff904102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:06.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.641+0000 7ff908a00640 1 -- 172.21.15.3:0/2891640667 shutdown_connections 2024-09-10T23:26:06.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:06.641+0000 7ff908a00640 1 -- 172.21.15.3:0/2891640667 wait complete. 2024-09-10T23:26:07.402 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-10T23:26:07.779 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:08.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:07 smithi038 ceph-mon[34225]: pgmap v371: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:26:08.108 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:07 smithi003 ceph-mon[30348]: pgmap v371: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:26:08.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:07 smithi194 ceph-mon[33904]: pgmap v371: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:26:08.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.498+0000 7f017be00640 1 -- 172.21.15.3:0/2909337057 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f017c10b1a0 msgr2=0x7f017c1119a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:08.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.498+0000 7f017be00640 1 --2- 172.21.15.3:0/2909337057 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f017c10b1a0 0x7f017c1119a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0174009ca0 tx=0x7f017402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.498+0000 7f017be00640 1 -- 172.21.15.3:0/2909337057 shutdown_connections 2024-09-10T23:26:08.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.498+0000 7f017be00640 1 --2- 172.21.15.3:0/2909337057 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f017c10b1a0 0x7f017c1119a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.498+0000 7f017be00640 1 --2- 172.21.15.3:0/2909337057 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f017c10a820 0x7f017c10ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.498+0000 7f017be00640 1 --2- 172.21.15.3:0/2909337057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f017c104e10 0x7f017c1051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.498+0000 7f017be00640 1 -- 172.21.15.3:0/2909337057 >> 172.21.15.3:0/2909337057 conn(0x7f017c100840 msgr2=0x7f017c102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:08.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.498+0000 7f017be00640 1 -- 172.21.15.3:0/2909337057 shutdown_connections 2024-09-10T23:26:08.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.498+0000 7f017be00640 1 -- 172.21.15.3:0/2909337057 wait complete. 2024-09-10T23:26:08.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.499+0000 7f017be00640 1 Processor -- start 2024-09-10T23:26:08.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.499+0000 7f017be00640 1 -- start start 2024-09-10T23:26:08.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.500+0000 7f017be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f017c104e10 0x7f017c19b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.500+0000 7f017be00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f017c10a820 0x7f017c19b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.500+0000 7f017be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f017c10b1a0 0x7f017c1a09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.500+0000 7f017be00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f017c114d60 con 0x7f017c104e10 2024-09-10T23:26:08.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.500+0000 7f017be00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f017c114be0 con 0x7f017c10a820 2024-09-10T23:26:08.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.500+0000 7f017be00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f017c114ee0 con 0x7f017c10b1a0 2024-09-10T23:26:08.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.500+0000 7f017aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f017c104e10 0x7f017c19b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.500+0000 7f017aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f017c104e10 0x7f017c19b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50062/0 (socket says 172.21.15.3:50062) 2024-09-10T23:26:08.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.500+0000 7f017aa00640 1 -- 172.21.15.3:0/132325329 learned_addr learned my addr 172.21.15.3:0/132325329 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:08.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.500+0000 7f017b400640 1 --2- 172.21.15.3:0/132325329 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f017c10b1a0 0x7f017c1a09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.500+0000 7f017a000640 1 --2- 172.21.15.3:0/132325329 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f017c10a820 0x7f017c19b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.501+0000 7f017aa00640 1 -- 172.21.15.3:0/132325329 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f017c10b1a0 msgr2=0x7f017c1a09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:08.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.501+0000 7f017aa00640 1 --2- 172.21.15.3:0/132325329 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f017c10b1a0 0x7f017c1a09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.501+0000 7f017aa00640 1 -- 172.21.15.3:0/132325329 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f017c10a820 msgr2=0x7f017c19b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:08.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.501+0000 7f017aa00640 1 --2- 172.21.15.3:0/132325329 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f017c10a820 0x7f017c19b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.501+0000 7f017aa00640 1 -- 172.21.15.3:0/132325329 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f017c1a11a0 con 0x7f017c104e10 2024-09-10T23:26:08.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.501+0000 7f017aa00640 1 --2- 172.21.15.3:0/132325329 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f017c104e10 0x7f017c19b0f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f016c00c920 tx=0x7f016c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:08.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.501+0000 7f0173400640 1 -- 172.21.15.3:0/132325329 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016c007c70 con 0x7f017c104e10 2024-09-10T23:26:08.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.501+0000 7f0173400640 1 -- 172.21.15.3:0/132325329 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f016c007e10 con 0x7f017c104e10 2024-09-10T23:26:08.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.501+0000 7f017be00640 1 -- 172.21.15.3:0/132325329 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f017c1a1490 con 0x7f017c104e10 2024-09-10T23:26:08.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.501+0000 7f0173400640 1 -- 172.21.15.3:0/132325329 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016c018710 con 0x7f017c104e10 2024-09-10T23:26:08.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.502+0000 7f017be00640 1 -- 172.21.15.3:0/132325329 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f017c1a7d20 con 0x7f017c104e10 2024-09-10T23:26:08.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.505+0000 7f018460a740 1 Processor -- start 2024-09-10T23:26:08.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.505+0000 7f018460a740 1 -- start start 2024-09-10T23:26:08.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.505+0000 7f0173400640 1 -- 172.21.15.3:0/132325329 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7f016c00f450 con 0x7f017c104e10 2024-09-10T23:26:08.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.505+0000 7f018460a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bfa80d0400 0x55bfa80d07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.505+0000 7f018460a740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bfa80d0d20 0x55bfa80dc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.505+0000 7f018460a740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bfa80dccb0 0x55bfa80df0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.505+0000 7f018460a740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55bfa8047d50 con 0x55bfa80d0d20 2024-09-10T23:26:08.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.505+0000 7f018460a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55bfa8037180 con 0x55bfa80d0400 2024-09-10T23:26:08.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.505+0000 7f018460a740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55bfa803af90 con 0x55bfa80dccb0 2024-09-10T23:26:08.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.505+0000 7f017aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bfa80d0d20 0x55bfa80dc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.506+0000 7f017aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bfa80d0d20 0x55bfa80dc770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50074/0 (socket says 172.21.15.3:50074) 2024-09-10T23:26:08.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.506+0000 7f017aa00640 1 -- 172.21.15.3:0/127036840 learned_addr learned my addr 172.21.15.3:0/127036840 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:08.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.506+0000 7f017b400640 1 --2- 172.21.15.3:0/127036840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bfa80d0400 0x55bfa80d07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.506+0000 7f017a000640 1 --2- 172.21.15.3:0/127036840 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bfa80dccb0 0x55bfa80df0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.506+0000 7f017aa00640 1 -- 172.21.15.3:0/127036840 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bfa80dccb0 msgr2=0x55bfa80df0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:08.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.506+0000 7f017aa00640 1 --2- 172.21.15.3:0/127036840 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bfa80dccb0 0x55bfa80df0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.506+0000 7f017aa00640 1 -- 172.21.15.3:0/127036840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bfa80d0400 msgr2=0x55bfa80d07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:08.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.506+0000 7f017aa00640 1 --2- 172.21.15.3:0/127036840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bfa80d0400 0x55bfa80d07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.506+0000 7f017aa00640 1 -- 172.21.15.3:0/127036840 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfa8001a70 con 0x55bfa80d0d20 2024-09-10T23:26:08.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.506+0000 7f017b400640 1 --2- 172.21.15.3:0/127036840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bfa80d0400 0x55bfa80d07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:08.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.506+0000 7f017aa00640 1 --2- 172.21.15.3:0/127036840 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bfa80d0d20 0x55bfa80dc770 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f016c0ee530 tx=0x7f016c0ee620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a1de16fb7008b5a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:08.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.507+0000 7f0167e00640 1 -- 172.21.15.3:0/127036840 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016c0e8520 con 0x55bfa80d0d20 2024-09-10T23:26:08.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.507+0000 7f0167e00640 1 -- 172.21.15.3:0/127036840 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f016c0eee50 con 0x55bfa80d0d20 2024-09-10T23:26:08.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.507+0000 7f0167e00640 1 -- 172.21.15.3:0/127036840 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016c0f59c0 con 0x55bfa80d0d20 2024-09-10T23:26:08.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.507+0000 7f0173400640 1 --2- 172.21.15.3:0/132325329 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f01600b54e0 0x7f01600b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.507+0000 7f0173400640 1 -- 172.21.15.3:0/132325329 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f016c0e6340 con 0x7f017c104e10 2024-09-10T23:26:08.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.507+0000 7f017b400640 1 --2- 172.21.15.3:0/132325329 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f01600b54e0 0x7f01600b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.508+0000 7f018460a740 1 -- 172.21.15.3:0/127036840 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bfa80d0d20 msgr2=0x55bfa80dc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:08.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.508+0000 7f018460a740 1 --2- 172.21.15.3:0/127036840 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bfa80d0d20 0x55bfa80dc770 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f016c0ee530 tx=0x7f016c0ee620 comp rx=0 tx=0).stop 2024-09-10T23:26:08.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.508+0000 7f018460a740 1 -- 172.21.15.3:0/127036840 shutdown_connections 2024-09-10T23:26:08.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.508+0000 7f018460a740 1 --2- 172.21.15.3:0/127036840 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bfa80dccb0 0x55bfa80df0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.508+0000 7f018460a740 1 --2- 172.21.15.3:0/127036840 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bfa80d0d20 0x55bfa80dc770 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.508+0000 7f018460a740 1 --2- 172.21.15.3:0/127036840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bfa80d0400 0x55bfa80d07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.508+0000 7f018460a740 1 -- 172.21.15.3:0/127036840 >> 172.21.15.3:0/127036840 conn(0x55bfa80ce230 msgr2=0x55bfa80cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:08.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.508+0000 7f018460a740 1 -- 172.21.15.3:0/127036840 shutdown_connections 2024-09-10T23:26:08.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.508+0000 7f018460a740 1 -- 172.21.15.3:0/127036840 wait complete. 2024-09-10T23:26:08.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.508+0000 7f017b400640 1 --2- 172.21.15.3:0/132325329 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f01600b54e0 0x7f01600b79a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0174006010 tx=0x7f01740098a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:08.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.509+0000 7f018460a740 1 -- start start 2024-09-10T23:26:08.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.509+0000 7f018460a740 1 Processor -- start 2024-09-10T23:26:08.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.509+0000 7f018460a740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bfa80d0400 0x55bfa80d9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.509+0000 7f018460a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bfa80d0d20 0x55bfa80da200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.509+0000 7f018460a740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bfa80dccb0 0x55bfa80da740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.509+0000 7f018460a740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55bfa7e985f0 con 0x55bfa80d0400 2024-09-10T23:26:08.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.509+0000 7f018460a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55bfa7fd2460 con 0x55bfa80d0d20 2024-09-10T23:26:08.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.509+0000 7f018460a740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55bfa80dfa00 con 0x55bfa80dccb0 2024-09-10T23:26:08.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.509+0000 7f018460a740 10 client.0 _ll_register_callbacks cb 0x55bfa7fe2210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:08.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.510+0000 7f017aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bfa80d0400 0x55bfa80d9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.510+0000 7f017aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bfa80d0400 0x55bfa80d9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50078/0 (socket says 172.21.15.3:50078) 2024-09-10T23:26:08.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.510+0000 7f017aa00640 1 -- 172.21.15.3:0/3571766879 learned_addr learned my addr 172.21.15.3:0/3571766879 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:08.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.510+0000 7f017a000640 1 --2- 172.21.15.3:0/3571766879 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bfa80d0d20 0x55bfa80da200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.510+0000 7f017b400640 1 --2- 172.21.15.3:0/3571766879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bfa80dccb0 0x55bfa80da740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.510+0000 7f017aa00640 1 -- 172.21.15.3:0/3571766879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bfa80dccb0 msgr2=0x55bfa80da740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:08.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.510+0000 7f017aa00640 1 --2- 172.21.15.3:0/3571766879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bfa80dccb0 0x55bfa80da740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.510+0000 7f017aa00640 1 -- 172.21.15.3:0/3571766879 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bfa80d0d20 msgr2=0x55bfa80da200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:08.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.510+0000 7f017aa00640 1 --2- 172.21.15.3:0/3571766879 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bfa80d0d20 0x55bfa80da200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.510+0000 7f017aa00640 1 -- 172.21.15.3:0/3571766879 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfa7d95540 con 0x55bfa80d0400 2024-09-10T23:26:08.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.510+0000 7f017a000640 1 --2- 172.21.15.3:0/3571766879 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bfa80d0d20 0x55bfa80da200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:08.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.510+0000 7f017aa00640 1 --2- 172.21.15.3:0/3571766879 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bfa80d0400 0x55bfa80d9cc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f016c0a8a80 tx=0x7f016c0e9bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d46adecd96eafa47 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:08.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.510+0000 7f0164c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-10T23:26:08.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.510+0000 7f0164c00640 1 -- 172.21.15.3:0/3571766879 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016c0a8b00 con 0x55bfa80d0400 2024-09-10T23:26:08.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.511+0000 7f0164c00640 1 -- 172.21.15.3:0/3571766879 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f016c0ac710 con 0x55bfa80d0400 2024-09-10T23:26:08.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.511+0000 7f018460a740 1 -- 172.21.15.3:0/3571766879 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bfa7fd4a70 con 0x55bfa80d0400 2024-09-10T23:26:08.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.511+0000 7f0164c00640 1 -- 172.21.15.3:0/3571766879 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f016c0abc20 con 0x55bfa80d0400 2024-09-10T23:26:08.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.511+0000 7f018460a740 10 client.15354 fetch_fsmap learned FSMap version 25 2024-09-10T23:26:08.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.511+0000 7f018460a740 1 -- 172.21.15.3:0/3571766879 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bfa7fef6f0 con 0x55bfa80d0400 2024-09-10T23:26:08.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.511+0000 7f0164c00640 1 -- 172.21.15.3:0/3571766879 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55bfa7fd4a70 con 0x55bfa80d0400 2024-09-10T23:26:08.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.511+0000 7f0164c00640 1 -- 172.21.15.3:0/3571766879 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f016c0e8320 con 0x55bfa80d0400 2024-09-10T23:26:08.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.511+0000 7f018460a740 10 client.15354 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:26:08.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.511+0000 7f018460a740 10 client.15354 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T23:26:08.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.511+0000 7f018460a740 20 client.15354 populate_metadata read hostname 'smithi003' 2024-09-10T23:26:08.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.511+0000 7f018460a740 1 --2- 172.21.15.3:0/3571766879 >> [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] conn(0x55bfa80ec7c0 0x55bfa80ee940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.511+0000 7f018460a740 4 client.15354 mds_command: new command op to 34682 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:26:08.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.511+0000 7f018460a740 1 -- 172.21.15.3:0/3571766879 --> [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bfa8049ca0 con 0x55bfa80ec7c0 2024-09-10T23:26:08.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.512+0000 7f017a000640 1 --2- 172.21.15.3:0/3571766879 >> [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] conn(0x55bfa80ec7c0 0x55bfa80ee940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.513+0000 7f017a000640 1 --2- 172.21.15.3:0/3571766879 >> [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] conn(0x55bfa80ec7c0 0x55bfa80ee940 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c68ea40ae33026b1 server_cookie=867f42d1fffe648 in_seq=0 out_seq=0 2024-09-10T23:26:08.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.513+0000 7f0164c00640 10 client.15354 ms_handle_connect on v2:172.21.15.38:6836/1821839397 2024-09-10T23:26:08.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.514+0000 7f0164c00640 1 -- 172.21.15.3:0/3571766879 <== mds.1 v2:172.21.15.38:6836/1821839397 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bfa8049ca0 con 0x55bfa80ec7c0 2024-09-10T23:26:08.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.514+0000 7f0164c00640 10 client.15354 handle_command_reply: tid=0 2024-09-10T23:26:08.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.514+0000 7f018460a740 1 client.15354 shutdown 2024-09-10T23:26:08.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.514+0000 7f018460a740 1 -- 172.21.15.3:0/3571766879 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bfa80d0400 msgr2=0x55bfa80d9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:08.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.514+0000 7f018460a740 1 --2- 172.21.15.3:0/3571766879 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bfa80d0400 0x55bfa80d9cc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f016c0a8a80 tx=0x7f016c0e9bc0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.514+0000 7f018460a740 1 -- 172.21.15.3:0/3571766879 shutdown_connections 2024-09-10T23:26:08.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.514+0000 7f018460a740 1 --2- 172.21.15.3:0/3571766879 >> [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] conn(0x55bfa80ec7c0 0x55bfa80ee940 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.514+0000 7f018460a740 1 --2- 172.21.15.3:0/3571766879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bfa80dccb0 0x55bfa80da740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.514+0000 7f018460a740 1 --2- 172.21.15.3:0/3571766879 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bfa80d0d20 0x55bfa80da200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.514+0000 7f018460a740 1 --2- 172.21.15.3:0/3571766879 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bfa80d0400 0x55bfa80d9cc0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.514+0000 7f018460a740 1 -- 172.21.15.3:0/3571766879 >> 172.21.15.3:0/3571766879 conn(0x55bfa80ce230 msgr2=0x55bfa80d3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:08.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.514+0000 7f0164c00640 0 client.15354 ms_handle_reset on v2:172.21.15.38:6836/1821839397 2024-09-10T23:26:08.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.514+0000 7f018460a740 1 -- 172.21.15.3:0/3571766879 shutdown_connections 2024-09-10T23:26:08.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.514+0000 7f018460a740 1 -- 172.21.15.3:0/3571766879 wait complete. 2024-09-10T23:26:08.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.514+0000 7f018460a740 20 client.15354 trim_cache size 0 max 16384 2024-09-10T23:26:08.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.534+0000 7f018460a740 1 Processor -- start 2024-09-10T23:26:08.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.534+0000 7f018460a740 1 -- start start 2024-09-10T23:26:08.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.534+0000 7f018460a740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bfa80d0400 0x55bfa80d44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.534+0000 7f018460a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bfa80d0d20 0x55bfa80d6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.534+0000 7f018460a740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bfa80dccb0 0x55bfa80d7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.534+0000 7f018460a740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55bfa80ecc80 con 0x55bfa80d0400 2024-09-10T23:26:08.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.534+0000 7f018460a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55bfa80ed350 con 0x55bfa80d0d20 2024-09-10T23:26:08.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.534+0000 7f018460a740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55bfa80eda20 con 0x55bfa80dccb0 2024-09-10T23:26:08.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.534+0000 7f017aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bfa80d0400 0x55bfa80d44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.534+0000 7f017aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bfa80d0400 0x55bfa80d44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50092/0 (socket says 172.21.15.3:50092) 2024-09-10T23:26:08.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.534+0000 7f017aa00640 1 -- 172.21.15.3:0/2010213655 learned_addr learned my addr 172.21.15.3:0/2010213655 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:08.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.534+0000 7f017a000640 1 --2- 172.21.15.3:0/2010213655 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bfa80d0d20 0x55bfa80d6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.535+0000 7f017b400640 1 --2- 172.21.15.3:0/2010213655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bfa80dccb0 0x55bfa80d7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.535+0000 7f017aa00640 1 -- 172.21.15.3:0/2010213655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bfa80dccb0 msgr2=0x55bfa80d7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:08.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.535+0000 7f017aa00640 1 --2- 172.21.15.3:0/2010213655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bfa80dccb0 0x55bfa80d7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.535+0000 7f017aa00640 1 -- 172.21.15.3:0/2010213655 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bfa80d0d20 msgr2=0x55bfa80d6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:08.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.535+0000 7f017aa00640 1 --2- 172.21.15.3:0/2010213655 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bfa80d0d20 0x55bfa80d6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.535+0000 7f017aa00640 1 -- 172.21.15.3:0/2010213655 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfa80cecb0 con 0x55bfa80d0400 2024-09-10T23:26:08.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.535+0000 7f017a000640 1 --2- 172.21.15.3:0/2010213655 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bfa80d0d20 0x55bfa80d6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:26:08.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.535+0000 7f017aa00640 1 --2- 172.21.15.3:0/2010213655 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bfa80d0400 0x55bfa80d44a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f016c0eeb20 tx=0x7f016c0ac090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7500986da02dd869 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:08.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.535+0000 7f0167400640 1 -- 172.21.15.3:0/2010213655 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016c0abe00 con 0x55bfa80d0400 2024-09-10T23:26:08.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.535+0000 7f0167400640 1 -- 172.21.15.3:0/2010213655 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f016c0b0f90 con 0x55bfa80d0400 2024-09-10T23:26:08.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.535+0000 7f0167400640 1 -- 172.21.15.3:0/2010213655 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016c0ac280 con 0x55bfa80d0400 2024-09-10T23:26:08.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.536+0000 7f018460a740 1 -- 172.21.15.3:0/2010213655 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bfa80d0400 msgr2=0x55bfa80d44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:08.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.536+0000 7f018460a740 1 --2- 172.21.15.3:0/2010213655 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bfa80d0400 0x55bfa80d44a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f016c0eeb20 tx=0x7f016c0ac090 comp rx=0 tx=0).stop 2024-09-10T23:26:08.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.536+0000 7f018460a740 1 -- 172.21.15.3:0/2010213655 shutdown_connections 2024-09-10T23:26:08.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.536+0000 7f018460a740 1 --2- 172.21.15.3:0/2010213655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bfa80dccb0 0x55bfa80d7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.536+0000 7f018460a740 1 --2- 172.21.15.3:0/2010213655 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bfa80d0d20 0x55bfa80d6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.536+0000 7f018460a740 1 --2- 172.21.15.3:0/2010213655 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bfa80d0400 0x55bfa80d44a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.536+0000 7f018460a740 1 -- 172.21.15.3:0/2010213655 >> 172.21.15.3:0/2010213655 conn(0x55bfa80ce230 msgr2=0x55bfa80d4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:08.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.536+0000 7f018460a740 1 -- 172.21.15.3:0/2010213655 shutdown_connections 2024-09-10T23:26:08.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.536+0000 7f018460a740 1 -- 172.21.15.3:0/2010213655 wait complete. 2024-09-10T23:26:08.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.537+0000 7f018460a740 1 -- start start 2024-09-10T23:26:08.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.537+0000 7f018460a740 1 Processor -- start 2024-09-10T23:26:08.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.537+0000 7f018460a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bfa80d0400 0x55bfa80f75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.537+0000 7f018460a740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bfa80d0d20 0x55bfa80f0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.537+0000 7f018460a740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bfa80dccb0 0x55bfa80f1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.537+0000 7f018460a740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55bfa80ee7c0 con 0x55bfa80dccb0 2024-09-10T23:26:08.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.537+0000 7f018460a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55bfa80ee0f0 con 0x55bfa80d0400 2024-09-10T23:26:08.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.537+0000 7f018460a740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55bfa80eee90 con 0x55bfa80d0d20 2024-09-10T23:26:08.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.538+0000 7f018460a740 10 client.0 _ll_register_callbacks cb 0x7f016c00cf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:08.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.538+0000 7f017b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bfa80dccb0 0x55bfa80f1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.538+0000 7f017b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bfa80dccb0 0x55bfa80f1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50100/0 (socket says 172.21.15.3:50100) 2024-09-10T23:26:08.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.538+0000 7f017b400640 1 -- 172.21.15.3:0/1908373932 learned_addr learned my addr 172.21.15.3:0/1908373932 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:08.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.538+0000 7f017aa00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bfa80d0400 0x55bfa80f75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.538+0000 7f017a000640 1 --2- 172.21.15.3:0/1908373932 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bfa80d0d20 0x55bfa80f0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.538+0000 7f017b400640 1 -- 172.21.15.3:0/1908373932 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bfa80d0d20 msgr2=0x55bfa80f0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:08.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.538+0000 7f017b400640 1 --2- 172.21.15.3:0/1908373932 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bfa80d0d20 0x55bfa80f0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.538+0000 7f017b400640 1 -- 172.21.15.3:0/1908373932 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bfa80d0400 msgr2=0x55bfa80f75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:08.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.538+0000 7f017b400640 1 --2- 172.21.15.3:0/1908373932 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bfa80d0400 0x55bfa80f75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.538+0000 7f017b400640 1 -- 172.21.15.3:0/1908373932 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfa80d49e0 con 0x55bfa80dccb0 2024-09-10T23:26:08.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.538+0000 7f017aa00640 1 --2- 172.21.15.3:0/1908373932 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bfa80d0400 0x55bfa80f75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:26:08.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.539+0000 7f017b400640 1 --2- 172.21.15.3:0/1908373932 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bfa80dccb0 0x55bfa80f1210 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0174009ca0 tx=0x7f01740095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc2d68a641b3247 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:08.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.539+0000 7f0164c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-10T23:26:08.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.539+0000 7f0164c00640 1 -- 172.21.15.3:0/1908373932 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0174059060 con 0x55bfa80dccb0 2024-09-10T23:26:08.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.539+0000 7f0164c00640 1 -- 172.21.15.3:0/1908373932 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f0174004250 con 0x55bfa80dccb0 2024-09-10T23:26:08.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.539+0000 7f018460a740 1 -- 172.21.15.3:0/1908373932 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f016c0b0f90 con 0x55bfa80dccb0 2024-09-10T23:26:08.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.539+0000 7f0164c00640 1 -- 172.21.15.3:0/1908373932 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0174060050 con 0x55bfa80dccb0 2024-09-10T23:26:08.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.539+0000 7f018460a740 10 client.15360 fetch_fsmap learned FSMap version 25 2024-09-10T23:26:08.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.539+0000 7f018460a740 1 -- 172.21.15.3:0/1908373932 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bfa8159f00 con 0x55bfa80dccb0 2024-09-10T23:26:08.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.540+0000 7f0164c00640 1 -- 172.21.15.3:0/1908373932 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f016c0b0f90 con 0x55bfa80dccb0 2024-09-10T23:26:08.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.540+0000 7f0164c00640 1 -- 172.21.15.3:0/1908373932 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f0174030b30 con 0x55bfa80dccb0 2024-09-10T23:26:08.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.540+0000 7f018460a740 10 client.15360 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:26:08.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.540+0000 7f018460a740 10 client.15360 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T23:26:08.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.540+0000 7f018460a740 20 client.15360 populate_metadata read hostname 'smithi003' 2024-09-10T23:26:08.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.540+0000 7f018460a740 1 --2- 172.21.15.3:0/1908373932 >> [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] conn(0x55bfa815eb10 0x55bfa815d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.540+0000 7f018460a740 4 client.15360 mds_command: new command op to 34682 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:26:08.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.540+0000 7f018460a740 1 -- 172.21.15.3:0/1908373932 --> [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] -- command(tid 0: {"prefix": "status"}) -- 0x55bfa8045750 con 0x55bfa815eb10 2024-09-10T23:26:08.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.541+0000 7f017aa00640 1 --2- 172.21.15.3:0/1908373932 >> [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] conn(0x55bfa815eb10 0x55bfa815d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.541+0000 7f017aa00640 1 --2- 172.21.15.3:0/1908373932 >> [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] conn(0x55bfa815eb10 0x55bfa815d820 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1684dcdaff6c410e server_cookie=db0d13a602d9112a in_seq=0 out_seq=0 2024-09-10T23:26:08.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.541+0000 7f0164c00640 10 client.15360 ms_handle_connect on v2:172.21.15.38:6836/1821839397 2024-09-10T23:26:08.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.541+0000 7f0164c00640 1 -- 172.21.15.3:0/1908373932 <== mds.1 v2:172.21.15.38:6836/1821839397 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55bfa8045750 con 0x55bfa815eb10 2024-09-10T23:26:08.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.541+0000 7f0164c00640 10 client.15360 handle_command_reply: tid=0 2024-09-10T23:26:08.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.541+0000 7f018460a740 1 client.15360 shutdown 2024-09-10T23:26:08.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.542+0000 7f018460a740 1 -- 172.21.15.3:0/1908373932 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bfa80dccb0 msgr2=0x55bfa80f1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:08.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.542+0000 7f018460a740 1 --2- 172.21.15.3:0/1908373932 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bfa80dccb0 0x55bfa80f1210 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0174009ca0 tx=0x7f01740095c0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.542+0000 7f018460a740 1 -- 172.21.15.3:0/1908373932 shutdown_connections 2024-09-10T23:26:08.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.542+0000 7f018460a740 1 --2- 172.21.15.3:0/1908373932 >> [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] conn(0x55bfa815eb10 0x55bfa815d820 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.542+0000 7f018460a740 1 --2- 172.21.15.3:0/1908373932 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bfa80dccb0 0x55bfa80f1210 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.542+0000 7f018460a740 1 --2- 172.21.15.3:0/1908373932 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bfa80d0d20 0x55bfa80f0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.542+0000 7f018460a740 1 --2- 172.21.15.3:0/1908373932 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bfa80d0400 0x55bfa80f75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.542+0000 7f0164c00640 0 client.15360 ms_handle_reset on v2:172.21.15.38:6836/1821839397 2024-09-10T23:26:08.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.542+0000 7f018460a740 1 -- 172.21.15.3:0/1908373932 >> 172.21.15.3:0/1908373932 conn(0x55bfa80ce230 msgr2=0x55bfa80db2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:08.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.542+0000 7f018460a740 1 -- 172.21.15.3:0/1908373932 shutdown_connections 2024-09-10T23:26:08.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.542+0000 7f018460a740 1 -- 172.21.15.3:0/1908373932 wait complete. 2024-09-10T23:26:08.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.542+0000 7f018460a740 20 client.15360 trim_cache size 0 max 16384 2024-09-10T23:26:08.547 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-10T23:26:08.547 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_fsid": "3f4e30d0-6fca-11ef-bcea-c7b262605968", 2024-09-10T23:26:08.547 INFO:teuthology.orchestra.run.smithi003.stdout: "whoami": 1, 2024-09-10T23:26:08.547 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 34682, 2024-09-10T23:26:08.547 INFO:teuthology.orchestra.run.smithi003.stdout: "want_state": "up:active", 2024-09-10T23:26:08.547 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "up:active", 2024-09-10T23:26:08.547 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs", 2024-09-10T23:26:08.547 INFO:teuthology.orchestra.run.smithi003.stdout: "rank_uptime": 81.318018946999999, 2024-09-10T23:26:08.547 INFO:teuthology.orchestra.run.smithi003.stdout: "mdsmap_epoch": 25, 2024-09-10T23:26:08.547 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch": 90, 2024-09-10T23:26:08.547 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch_barrier": 88, 2024-09-10T23:26:08.547 INFO:teuthology.orchestra.run.smithi003.stdout: "uptime": 158.53123511999999 2024-09-10T23:26:08.548 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-10T23:26:08.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.543+0000 7f017be00640 1 -- 172.21.15.3:0/132325329 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f01600b54e0 msgr2=0x7f01600b79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:08.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.543+0000 7f017be00640 1 --2- 172.21.15.3:0/132325329 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f01600b54e0 0x7f01600b79a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0174006010 tx=0x7f01740098a0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.543+0000 7f017be00640 1 -- 172.21.15.3:0/132325329 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f017c104e10 msgr2=0x7f017c19b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:08.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.543+0000 7f017be00640 1 --2- 172.21.15.3:0/132325329 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f017c104e10 0x7f017c19b0f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f016c00c920 tx=0x7f016c00cde0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.543+0000 7f017be00640 1 -- 172.21.15.3:0/132325329 shutdown_connections 2024-09-10T23:26:08.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.543+0000 7f017be00640 1 --2- 172.21.15.3:0/132325329 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f017c10b1a0 0x7f017c1a09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.543+0000 7f017be00640 1 --2- 172.21.15.3:0/132325329 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f017c10a820 0x7f017c19b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.543+0000 7f017be00640 1 --2- 172.21.15.3:0/132325329 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f01600b54e0 0x7f01600b79a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.543+0000 7f017be00640 1 --2- 172.21.15.3:0/132325329 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f017c104e10 0x7f017c19b0f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.543+0000 7f017be00640 1 -- 172.21.15.3:0/132325329 >> 172.21.15.3:0/132325329 conn(0x7f017c100840 msgr2=0x7f017c103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:08.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.543+0000 7f017be00640 1 -- 172.21.15.3:0/132325329 shutdown_connections 2024-09-10T23:26:08.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:08.543+0000 7f017be00640 1 -- 172.21.15.3:0/132325329 wait complete. 2024-09-10T23:26:09.336 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T23:26:09.714 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:10.094 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:09 smithi003 ceph-mon[30348]: pgmap v372: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:26:10.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:09 smithi038 ceph-mon[34225]: pgmap v372: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:26:10.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:09 smithi194 ceph-mon[33904]: pgmap v372: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:26:10.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.431+0000 7f5722600640 1 -- 172.21.15.3:0/2199877889 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f571c100d30 msgr2=0x7f571c101110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:10.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.431+0000 7f5722600640 1 --2- 172.21.15.3:0/2199877889 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f571c100d30 0x7f571c101110 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f570c009900 tx=0x7f570c02a410 comp rx=0 tx=0).stop 2024-09-10T23:26:10.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.432+0000 7f5722600640 1 -- 172.21.15.3:0/2199877889 shutdown_connections 2024-09-10T23:26:10.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.432+0000 7f5722600640 1 --2- 172.21.15.3:0/2199877889 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f571c108030 0x7f571c10f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.432+0000 7f5722600640 1 --2- 172.21.15.3:0/2199877889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f571c1076b0 0x7f571c107af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.432+0000 7f5722600640 1 --2- 172.21.15.3:0/2199877889 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f571c100d30 0x7f571c101110 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.432+0000 7f5722600640 1 -- 172.21.15.3:0/2199877889 >> 172.21.15.3:0/2199877889 conn(0x7f571c0fca20 msgr2=0x7f571c0fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:10.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.432+0000 7f5722600640 1 -- 172.21.15.3:0/2199877889 shutdown_connections 2024-09-10T23:26:10.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.432+0000 7f5722600640 1 -- 172.21.15.3:0/2199877889 wait complete. 2024-09-10T23:26:10.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.433+0000 7f5722600640 1 Processor -- start 2024-09-10T23:26:10.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.433+0000 7f5722600640 1 -- start start 2024-09-10T23:26:10.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.434+0000 7f5722600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f571c100d30 0x7f571c19b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:10.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.434+0000 7f5722600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f571c1076b0 0x7f571c19b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:10.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.434+0000 7f5722600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f571c108030 0x7f571c1a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:10.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.434+0000 7f5722600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f571c112c90 con 0x7f571c1076b0 2024-09-10T23:26:10.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.434+0000 7f5722600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f571c112b10 con 0x7f571c100d30 2024-09-10T23:26:10.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.434+0000 7f5722600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f571c112e10 con 0x7f571c108030 2024-09-10T23:26:10.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.434+0000 7f5712a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f571c1076b0 0x7f571c19b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:10.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.434+0000 7f571b400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f571c100d30 0x7f571c19b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:10.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.434+0000 7f571b400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f571c100d30 0x7f571c19b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.3:47634/0 (socket says 172.21.15.3:47634) 2024-09-10T23:26:10.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.434+0000 7f571b400640 1 -- 172.21.15.3:0/1280681733 learned_addr learned my addr 172.21.15.3:0/1280681733 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:10.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.434+0000 7f571be00640 1 --2- 172.21.15.3:0/1280681733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f571c108030 0x7f571c1a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:10.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.435+0000 7f5712a00640 1 -- 172.21.15.3:0/1280681733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f571c108030 msgr2=0x7f571c1a0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:10.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.435+0000 7f5712a00640 1 --2- 172.21.15.3:0/1280681733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f571c108030 0x7f571c1a0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.435+0000 7f5712a00640 1 -- 172.21.15.3:0/1280681733 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f571c100d30 msgr2=0x7f571c19b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:10.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.435+0000 7f5712a00640 1 --2- 172.21.15.3:0/1280681733 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f571c100d30 0x7f571c19b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.435+0000 7f5712a00640 1 -- 172.21.15.3:0/1280681733 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571c1a1460 con 0x7f571c1076b0 2024-09-10T23:26:10.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.435+0000 7f571b400640 1 --2- 172.21.15.3:0/1280681733 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f571c100d30 0x7f571c19b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:26:10.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.435+0000 7f5712a00640 1 --2- 172.21.15.3:0/1280681733 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f571c1076b0 0x7f571c19b8f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f570400e9f0 tx=0x7f570400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:10.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.435+0000 7f5718c00640 1 -- 172.21.15.3:0/1280681733 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570400ccc0 con 0x7f571c1076b0 2024-09-10T23:26:10.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.435+0000 7f5718c00640 1 -- 172.21.15.3:0/1280681733 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5704005020 con 0x7f571c1076b0 2024-09-10T23:26:10.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.435+0000 7f5722600640 1 -- 172.21.15.3:0/1280681733 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f571c1a1750 con 0x7f571c1076b0 2024-09-10T23:26:10.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.435+0000 7f5718c00640 1 -- 172.21.15.3:0/1280681733 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570400ce60 con 0x7f571c1076b0 2024-09-10T23:26:10.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.436+0000 7f5722600640 1 -- 172.21.15.3:0/1280681733 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f571c1a7e10 con 0x7f571c1076b0 2024-09-10T23:26:10.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.438+0000 7f572504f740 1 Processor -- start 2024-09-10T23:26:10.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.439+0000 7f572504f740 1 -- start start 2024-09-10T23:26:10.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.439+0000 7f5718c00640 1 -- 172.21.15.3:0/1280681733 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7f5704004a40 con 0x7f571c1076b0 2024-09-10T23:26:10.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.439+0000 7f572504f740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56176999c240 0x56176999c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:10.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.439+0000 7f572504f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56176999cb60 0x5617699a85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:10.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.439+0000 7f572504f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5617699a8af0 0x5617699aaee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:10.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.439+0000 7f572504f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x561769913d50 con 0x5617699a8af0 2024-09-10T23:26:10.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.439+0000 7f572504f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x561769903180 con 0x56176999cb60 2024-09-10T23:26:10.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.439+0000 7f572504f740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x561769906f90 con 0x56176999c240 2024-09-10T23:26:10.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.439+0000 7f571be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56176999c240 0x56176999c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:10.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.439+0000 7f5712a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5617699a8af0 0x5617699aaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:10.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.439+0000 7f571be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56176999c240 0x56176999c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.3:52724/0 (socket says 172.21.15.3:52724) 2024-09-10T23:26:10.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.439+0000 7f571be00640 1 -- 172.21.15.3:0/2385002065 learned_addr learned my addr 172.21.15.3:0/2385002065 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:10.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.440+0000 7f571b400640 1 --2- 172.21.15.3:0/2385002065 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56176999cb60 0x5617699a85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:10.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.440+0000 7f571be00640 1 -- 172.21.15.3:0/2385002065 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56176999cb60 msgr2=0x5617699a85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:10.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.440+0000 7f571be00640 1 --2- 172.21.15.3:0/2385002065 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56176999cb60 0x5617699a85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.440+0000 7f571be00640 1 -- 172.21.15.3:0/2385002065 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5617699a8af0 msgr2=0x5617699aaee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:10.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.440+0000 7f571be00640 1 --2- 172.21.15.3:0/2385002065 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5617699a8af0 0x5617699aaee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.440+0000 7f571be00640 1 -- 172.21.15.3:0/2385002065 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617698cda70 con 0x56176999c240 2024-09-10T23:26:10.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.440+0000 7f571be00640 1 --2- 172.21.15.3:0/2385002065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56176999c240 0x56176999c620 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5714011440 tx=0x7f5714011900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae6d880df84b3e28 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:10.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.441+0000 7f5710c00640 1 -- 172.21.15.3:0/2385002065 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5714004d20 con 0x56176999c240 2024-09-10T23:26:10.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.441+0000 7f5710c00640 1 -- 172.21.15.3:0/2385002065 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5714004050 con 0x56176999c240 2024-09-10T23:26:10.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.441+0000 7f5710c00640 1 -- 172.21.15.3:0/2385002065 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571400f780 con 0x56176999c240 2024-09-10T23:26:10.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.441+0000 7f5718c00640 1 --2- 172.21.15.3:0/1280681733 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f57000b53c0 0x7f57000b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:10.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.441+0000 7f5718c00640 1 -- 172.21.15.3:0/1280681733 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f57040e6270 con 0x7f571c1076b0 2024-09-10T23:26:10.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.441+0000 7f572504f740 1 -- 172.21.15.3:0/2385002065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56176999c240 msgr2=0x56176999c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:10.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.441+0000 7f571b400640 1 --2- 172.21.15.3:0/1280681733 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f57000b53c0 0x7f57000b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:10.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.441+0000 7f572504f740 1 --2- 172.21.15.3:0/2385002065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56176999c240 0x56176999c620 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5714011440 tx=0x7f5714011900 comp rx=0 tx=0).stop 2024-09-10T23:26:10.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.441+0000 7f572504f740 1 -- 172.21.15.3:0/2385002065 shutdown_connections 2024-09-10T23:26:10.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.441+0000 7f572504f740 1 --2- 172.21.15.3:0/2385002065 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5617699a8af0 0x5617699aaee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.442+0000 7f572504f740 1 --2- 172.21.15.3:0/2385002065 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56176999cb60 0x5617699a85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.442+0000 7f572504f740 1 --2- 172.21.15.3:0/2385002065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56176999c240 0x56176999c620 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.442+0000 7f572504f740 1 -- 172.21.15.3:0/2385002065 >> 172.21.15.3:0/2385002065 conn(0x56176999a020 msgr2=0x56176999b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:10.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.442+0000 7f572504f740 1 -- 172.21.15.3:0/2385002065 shutdown_connections 2024-09-10T23:26:10.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.442+0000 7f572504f740 1 -- 172.21.15.3:0/2385002065 wait complete. 2024-09-10T23:26:10.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.442+0000 7f571b400640 1 --2- 172.21.15.3:0/1280681733 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f57000b53c0 0x7f57000b7880 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f570c005e00 tx=0x7f570c005d50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:10.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.442+0000 7f572504f740 1 -- start start 2024-09-10T23:26:10.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.443+0000 7f572504f740 1 Processor -- start 2024-09-10T23:26:10.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.443+0000 7f572504f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56176999c240 0x5617699a5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:10.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.443+0000 7f572504f740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56176999cb60 0x5617699a6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:10.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.443+0000 7f572504f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5617699a8af0 0x5617699a6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:10.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.443+0000 7f572504f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5617697645f0 con 0x5617699a8af0 2024-09-10T23:26:10.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.443+0000 7f572504f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x56176989e460 con 0x56176999c240 2024-09-10T23:26:10.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.443+0000 7f572504f740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5617699ab840 con 0x56176999cb60 2024-09-10T23:26:10.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.443+0000 7f572504f740 10 client.0 _ll_register_callbacks cb 0x5617698ae210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:10.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.443+0000 7f571be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5617699a8af0 0x5617699a6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:10.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.444+0000 7f571be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5617699a8af0 0x5617699a6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50138/0 (socket says 172.21.15.3:50138) 2024-09-10T23:26:10.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.444+0000 7f571be00640 1 -- 172.21.15.3:0/3703534544 learned_addr learned my addr 172.21.15.3:0/3703534544 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:10.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.444+0000 7f571b400640 1 --2- 172.21.15.3:0/3703534544 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56176999c240 0x5617699a5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:10.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.444+0000 7f5712a00640 1 --2- 172.21.15.3:0/3703534544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56176999cb60 0x5617699a6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:10.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.444+0000 7f571be00640 1 -- 172.21.15.3:0/3703534544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56176999cb60 msgr2=0x5617699a6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:10.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.444+0000 7f571be00640 1 --2- 172.21.15.3:0/3703534544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56176999cb60 0x5617699a6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.444+0000 7f571be00640 1 -- 172.21.15.3:0/3703534544 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56176999c240 msgr2=0x5617699a5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:10.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.444+0000 7f571be00640 1 --2- 172.21.15.3:0/3703534544 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56176999c240 0x5617699a5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.444+0000 7f571be00640 1 -- 172.21.15.3:0/3703534544 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561769661540 con 0x5617699a8af0 2024-09-10T23:26:10.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.444+0000 7f5712a00640 1 --2- 172.21.15.3:0/3703534544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56176999cb60 0x5617699a6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:10.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.444+0000 7f571b400640 1 --2- 172.21.15.3:0/3703534544 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56176999c240 0x5617699a5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:26:10.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.444+0000 7f571be00640 1 --2- 172.21.15.3:0/3703534544 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5617699a8af0 0x5617699a6560 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f571400a010 tx=0x7f5714003f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24f958db488c6987 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:10.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.444+0000 7f5709600640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-10T23:26:10.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.445+0000 7f5709600640 1 -- 172.21.15.3:0/3703534544 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571401d040 con 0x5617699a8af0 2024-09-10T23:26:10.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.445+0000 7f572504f740 1 -- 172.21.15.3:0/3703534544 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5617698a0a70 con 0x5617699a8af0 2024-09-10T23:26:10.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.445+0000 7f5709600640 1 -- 172.21.15.3:0/3703534544 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f5714004050 con 0x5617699a8af0 2024-09-10T23:26:10.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.445+0000 7f5709600640 1 -- 172.21.15.3:0/3703534544 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f571402f050 con 0x5617699a8af0 2024-09-10T23:26:10.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.445+0000 7f572504f740 10 client.15372 fetch_fsmap learned FSMap version 25 2024-09-10T23:26:10.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.445+0000 7f572504f740 1 -- 172.21.15.3:0/3703534544 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5617698bb6f0 con 0x5617699a8af0 2024-09-10T23:26:10.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.445+0000 7f5709600640 1 -- 172.21.15.3:0/3703534544 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5617698a0a70 con 0x5617699a8af0 2024-09-10T23:26:10.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.446+0000 7f5709600640 1 -- 172.21.15.3:0/3703534544 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f571400fb10 con 0x5617699a8af0 2024-09-10T23:26:10.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.446+0000 7f572504f740 10 client.15372 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:26:10.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.446+0000 7f572504f740 10 client.15372 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T23:26:10.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.446+0000 7f572504f740 20 client.15372 populate_metadata read hostname 'smithi003' 2024-09-10T23:26:10.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.446+0000 7f572504f740 1 --2- 172.21.15.3:0/3703534544 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x5617699b95b0 0x5617699baa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:10.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.446+0000 7f572504f740 4 client.15372 mds_command: new command op to 34724 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:26:10.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.446+0000 7f572504f740 1 -- 172.21.15.3:0/3703534544 --> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561769915ca0 con 0x5617699b95b0 2024-09-10T23:26:10.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.446+0000 7f571b400640 1 --2- 172.21.15.3:0/3703534544 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x5617699b95b0 0x5617699baa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:10.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.447+0000 7f571b400640 1 --2- 172.21.15.3:0/3703534544 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x5617699b95b0 0x5617699baa20 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40dc1f7763bc4686 server_cookie=e80ac9721837511b in_seq=0 out_seq=0 2024-09-10T23:26:10.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.447+0000 7f5709600640 10 client.15372 ms_handle_connect on v2:172.21.15.38:6838/458259815 2024-09-10T23:26:10.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.448+0000 7f5709600640 1 -- 172.21.15.3:0/3703534544 <== mds.0 v2:172.21.15.38:6838/458259815 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561769915ca0 con 0x5617699b95b0 2024-09-10T23:26:10.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.448+0000 7f5709600640 10 client.15372 handle_command_reply: tid=0 2024-09-10T23:26:10.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.448+0000 7f572504f740 1 client.15372 shutdown 2024-09-10T23:26:10.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.448+0000 7f572504f740 1 -- 172.21.15.3:0/3703534544 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5617699a8af0 msgr2=0x5617699a6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:10.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.448+0000 7f572504f740 1 --2- 172.21.15.3:0/3703534544 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5617699a8af0 0x5617699a6560 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f571400a010 tx=0x7f5714003f00 comp rx=0 tx=0).stop 2024-09-10T23:26:10.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.448+0000 7f572504f740 1 -- 172.21.15.3:0/3703534544 shutdown_connections 2024-09-10T23:26:10.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.448+0000 7f572504f740 1 --2- 172.21.15.3:0/3703534544 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x5617699b95b0 0x5617699baa20 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.448+0000 7f572504f740 1 --2- 172.21.15.3:0/3703534544 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5617699a8af0 0x5617699a6560 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.448+0000 7f572504f740 1 --2- 172.21.15.3:0/3703534544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56176999cb60 0x5617699a6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.448+0000 7f572504f740 1 --2- 172.21.15.3:0/3703534544 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56176999c240 0x5617699a5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.448+0000 7f572504f740 1 -- 172.21.15.3:0/3703534544 >> 172.21.15.3:0/3703534544 conn(0x56176999a020 msgr2=0x56176999fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:10.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.448+0000 7f5709600640 0 client.15372 ms_handle_reset on v2:172.21.15.38:6838/458259815 2024-09-10T23:26:10.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.448+0000 7f572504f740 1 -- 172.21.15.3:0/3703534544 shutdown_connections 2024-09-10T23:26:10.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.448+0000 7f572504f740 1 -- 172.21.15.3:0/3703534544 wait complete. 2024-09-10T23:26:10.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.448+0000 7f572504f740 20 client.15372 trim_cache size 0 max 16384 2024-09-10T23:26:10.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.467+0000 7f572504f740 1 Processor -- start 2024-09-10T23:26:10.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.467+0000 7f572504f740 1 -- start start 2024-09-10T23:26:10.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.468+0000 7f572504f740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56176999c240 0x5617699ba350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:10.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.468+0000 7f572504f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56176999cb60 0x5617699a68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:10.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.468+0000 7f572504f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5617699a8af0 0x5617699a0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:10.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.468+0000 7f572504f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5617699b8d60 con 0x56176999cb60 2024-09-10T23:26:10.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.468+0000 7f572504f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5617699b9430 con 0x5617699a8af0 2024-09-10T23:26:10.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.468+0000 7f572504f740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5617699b9b00 con 0x56176999c240 2024-09-10T23:26:10.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.468+0000 7f5712a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56176999cb60 0x5617699a68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:10.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.468+0000 7f5712a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56176999cb60 0x5617699a68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50142/0 (socket says 172.21.15.3:50142) 2024-09-10T23:26:10.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.468+0000 7f5712a00640 1 -- 172.21.15.3:0/193956874 learned_addr learned my addr 172.21.15.3:0/193956874 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:10.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.468+0000 7f571b400640 1 --2- 172.21.15.3:0/193956874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56176999c240 0x5617699ba350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:10.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.468+0000 7f571be00640 1 --2- 172.21.15.3:0/193956874 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5617699a8af0 0x5617699a0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:10.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.468+0000 7f5712a00640 1 -- 172.21.15.3:0/193956874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56176999c240 msgr2=0x5617699ba350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:10.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.468+0000 7f5712a00640 1 --2- 172.21.15.3:0/193956874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56176999c240 0x5617699ba350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.468+0000 7f5712a00640 1 -- 172.21.15.3:0/193956874 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5617699a8af0 msgr2=0x5617699a0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:10.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.468+0000 7f5712a00640 1 --2- 172.21.15.3:0/193956874 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5617699a8af0 0x5617699a0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.468+0000 7f5712a00640 1 -- 172.21.15.3:0/193956874 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56176999c990 con 0x56176999cb60 2024-09-10T23:26:10.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.469+0000 7f5712a00640 1 --2- 172.21.15.3:0/193956874 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56176999cb60 0x5617699a68a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f57040ac0e0 tx=0x7f5704009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e108aa7a7bc16e3a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:10.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.469+0000 7f570be00640 1 -- 172.21.15.3:0/193956874 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570401c070 con 0x56176999cb60 2024-09-10T23:26:10.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.469+0000 7f570be00640 1 -- 172.21.15.3:0/193956874 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57040b52b0 con 0x56176999cb60 2024-09-10T23:26:10.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.469+0000 7f570be00640 1 -- 172.21.15.3:0/193956874 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57040ac3e0 con 0x56176999cb60 2024-09-10T23:26:10.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.470+0000 7f572504f740 1 -- 172.21.15.3:0/193956874 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56176999cb60 msgr2=0x5617699a68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:10.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.470+0000 7f572504f740 1 --2- 172.21.15.3:0/193956874 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56176999cb60 0x5617699a68a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f57040ac0e0 tx=0x7f5704009f60 comp rx=0 tx=0).stop 2024-09-10T23:26:10.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.470+0000 7f572504f740 1 -- 172.21.15.3:0/193956874 shutdown_connections 2024-09-10T23:26:10.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.470+0000 7f572504f740 1 --2- 172.21.15.3:0/193956874 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5617699a8af0 0x5617699a0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.470+0000 7f572504f740 1 --2- 172.21.15.3:0/193956874 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56176999cb60 0x5617699a68a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.470+0000 7f572504f740 1 --2- 172.21.15.3:0/193956874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56176999c240 0x5617699ba350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.470+0000 7f572504f740 1 -- 172.21.15.3:0/193956874 >> 172.21.15.3:0/193956874 conn(0x56176999a020 msgr2=0x5617699a0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:10.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.470+0000 7f572504f740 1 -- 172.21.15.3:0/193956874 shutdown_connections 2024-09-10T23:26:10.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.470+0000 7f572504f740 1 -- 172.21.15.3:0/193956874 wait complete. 2024-09-10T23:26:10.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.470+0000 7f572504f740 1 -- start start 2024-09-10T23:26:10.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.470+0000 7f572504f740 1 Processor -- start 2024-09-10T23:26:10.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.471+0000 7f572504f740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56176999c240 0x5617699c33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:10.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.471+0000 7f572504f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56176999cb60 0x5617699bc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:10.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.471+0000 7f572504f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5617699a8af0 0x5617699bcde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:10.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.471+0000 7f572504f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5617699ba8a0 con 0x5617699a8af0 2024-09-10T23:26:10.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.471+0000 7f572504f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5617699ba1d0 con 0x56176999cb60 2024-09-10T23:26:10.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.471+0000 7f572504f740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5617699baf70 con 0x56176999c240 2024-09-10T23:26:10.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.471+0000 7f572504f740 10 client.0 _ll_register_callbacks cb 0x7f5714009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:10.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.471+0000 7f571be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5617699a8af0 0x5617699bcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:10.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.471+0000 7f571be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5617699a8af0 0x5617699bcde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50158/0 (socket says 172.21.15.3:50158) 2024-09-10T23:26:10.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.471+0000 7f571be00640 1 -- 172.21.15.3:0/1631015594 learned_addr learned my addr 172.21.15.3:0/1631015594 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:10.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.471+0000 7f5712a00640 1 --2- 172.21.15.3:0/1631015594 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56176999cb60 0x5617699bc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:10.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.471+0000 7f571b400640 1 --2- 172.21.15.3:0/1631015594 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56176999c240 0x5617699c33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:10.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.472+0000 7f571be00640 1 -- 172.21.15.3:0/1631015594 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56176999c240 msgr2=0x5617699c33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:10.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.472+0000 7f571be00640 1 --2- 172.21.15.3:0/1631015594 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56176999c240 0x5617699c33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.472+0000 7f571be00640 1 -- 172.21.15.3:0/1631015594 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56176999cb60 msgr2=0x5617699bc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:10.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.472+0000 7f571be00640 1 --2- 172.21.15.3:0/1631015594 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56176999cb60 0x5617699bc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.472+0000 7f571be00640 1 -- 172.21.15.3:0/1631015594 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617699bd570 con 0x5617699a8af0 2024-09-10T23:26:10.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.472+0000 7f5712a00640 1 --2- 172.21.15.3:0/1631015594 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56176999cb60 0x5617699bc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:26:10.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.472+0000 7f571be00640 1 --2- 172.21.15.3:0/1631015594 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5617699a8af0 0x5617699bcde0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5714005c40 tx=0x7f5714004f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25b94a31b88770cd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:10.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.472+0000 7f5709600640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-10T23:26:10.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.472+0000 7f5709600640 1 -- 172.21.15.3:0/1631015594 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571401d030 con 0x5617699a8af0 2024-09-10T23:26:10.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.472+0000 7f572504f740 1 -- 172.21.15.3:0/1631015594 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561769911750 con 0x5617699a8af0 2024-09-10T23:26:10.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.472+0000 7f5709600640 1 -- 172.21.15.3:0/1631015594 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f5714005880 con 0x5617699a8af0 2024-09-10T23:26:10.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.473+0000 7f5709600640 1 -- 172.21.15.3:0/1631015594 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5714043050 con 0x5617699a8af0 2024-09-10T23:26:10.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.473+0000 7f572504f740 10 client.15378 fetch_fsmap learned FSMap version 25 2024-09-10T23:26:10.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.473+0000 7f572504f740 1 -- 172.21.15.3:0/1631015594 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561769a2e700 con 0x5617699a8af0 2024-09-10T23:26:10.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.473+0000 7f5709600640 1 -- 172.21.15.3:0/1631015594 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x561769911750 con 0x5617699a8af0 2024-09-10T23:26:10.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.473+0000 7f5709600640 1 -- 172.21.15.3:0/1631015594 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f571400faf0 con 0x5617699a8af0 2024-09-10T23:26:10.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.473+0000 7f572504f740 10 client.15378 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:26:10.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.473+0000 7f572504f740 10 client.15378 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T23:26:10.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.473+0000 7f572504f740 20 client.15378 populate_metadata read hostname 'smithi003' 2024-09-10T23:26:10.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.473+0000 7f572504f740 1 --2- 172.21.15.3:0/1631015594 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x561769a33280 0x561769a31f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:10.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.473+0000 7f572504f740 4 client.15378 mds_command: new command op to 34724 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:26:10.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.473+0000 7f572504f740 1 -- 172.21.15.3:0/1631015594 --> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] -- command(tid 0: {"prefix": "status"}) -- 0x56176990eb80 con 0x561769a33280 2024-09-10T23:26:10.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.474+0000 7f571b400640 1 --2- 172.21.15.3:0/1631015594 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x561769a33280 0x561769a31f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:10.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.475+0000 7f571b400640 1 --2- 172.21.15.3:0/1631015594 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x561769a33280 0x561769a31f90 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=703d2373bad21542 server_cookie=b442a024b337ffca in_seq=0 out_seq=0 2024-09-10T23:26:10.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.475+0000 7f5709600640 10 client.15378 ms_handle_connect on v2:172.21.15.38:6838/458259815 2024-09-10T23:26:10.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.475+0000 7f5709600640 1 -- 172.21.15.3:0/1631015594 <== mds.0 v2:172.21.15.38:6838/458259815 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x56176990eb80 con 0x561769a33280 2024-09-10T23:26:10.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.475+0000 7f5709600640 10 client.15378 handle_command_reply: tid=0 2024-09-10T23:26:10.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.475+0000 7f572504f740 1 client.15378 shutdown 2024-09-10T23:26:10.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.475+0000 7f572504f740 1 -- 172.21.15.3:0/1631015594 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5617699a8af0 msgr2=0x5617699bcde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:10.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.475+0000 7f572504f740 1 --2- 172.21.15.3:0/1631015594 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5617699a8af0 0x5617699bcde0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5714005c40 tx=0x7f5714004f00 comp rx=0 tx=0).stop 2024-09-10T23:26:10.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.475+0000 7f572504f740 1 -- 172.21.15.3:0/1631015594 shutdown_connections 2024-09-10T23:26:10.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.475+0000 7f572504f740 1 --2- 172.21.15.3:0/1631015594 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x561769a33280 0x561769a31f90 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.475+0000 7f572504f740 1 --2- 172.21.15.3:0/1631015594 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5617699a8af0 0x5617699bcde0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.475+0000 7f572504f740 1 --2- 172.21.15.3:0/1631015594 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56176999cb60 0x5617699bc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.475+0000 7f572504f740 1 --2- 172.21.15.3:0/1631015594 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56176999c240 0x5617699c33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.475+0000 7f572504f740 1 -- 172.21.15.3:0/1631015594 >> 172.21.15.3:0/1631015594 conn(0x56176999a020 msgr2=0x5617699a42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:10.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.475+0000 7f5709600640 0 client.15378 ms_handle_reset on v2:172.21.15.38:6838/458259815 2024-09-10T23:26:10.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.475+0000 7f572504f740 1 -- 172.21.15.3:0/1631015594 shutdown_connections 2024-09-10T23:26:10.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.475+0000 7f572504f740 1 -- 172.21.15.3:0/1631015594 wait complete. 2024-09-10T23:26:10.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.476+0000 7f572504f740 20 client.15378 trim_cache size 0 max 16384 2024-09-10T23:26:10.480 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-10T23:26:10.480 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_fsid": "3f4e30d0-6fca-11ef-bcea-c7b262605968", 2024-09-10T23:26:10.480 INFO:teuthology.orchestra.run.smithi003.stdout: "whoami": 0, 2024-09-10T23:26:10.480 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 34724, 2024-09-10T23:26:10.480 INFO:teuthology.orchestra.run.smithi003.stdout: "want_state": "up:active", 2024-09-10T23:26:10.480 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "up:active", 2024-09-10T23:26:10.480 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs", 2024-09-10T23:26:10.480 INFO:teuthology.orchestra.run.smithi003.stdout: "rank_uptime": 130.640035232, 2024-09-10T23:26:10.480 INFO:teuthology.orchestra.run.smithi003.stdout: "mdsmap_epoch": 25, 2024-09-10T23:26:10.480 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch": 90, 2024-09-10T23:26:10.480 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch_barrier": 88, 2024-09-10T23:26:10.481 INFO:teuthology.orchestra.run.smithi003.stdout: "uptime": 145.337533135 2024-09-10T23:26:10.481 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-10T23:26:10.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.476+0000 7f5722600640 1 -- 172.21.15.3:0/1280681733 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f57000b53c0 msgr2=0x7f57000b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:10.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.476+0000 7f5722600640 1 --2- 172.21.15.3:0/1280681733 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f57000b53c0 0x7f57000b7880 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f570c005e00 tx=0x7f570c005d50 comp rx=0 tx=0).stop 2024-09-10T23:26:10.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.476+0000 7f5722600640 1 -- 172.21.15.3:0/1280681733 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f571c1076b0 msgr2=0x7f571c19b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:10.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.476+0000 7f5722600640 1 --2- 172.21.15.3:0/1280681733 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f571c1076b0 0x7f571c19b8f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f570400e9f0 tx=0x7f570400eeb0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.476+0000 7f5722600640 1 -- 172.21.15.3:0/1280681733 shutdown_connections 2024-09-10T23:26:10.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.476+0000 7f5722600640 1 --2- 172.21.15.3:0/1280681733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f571c108030 0x7f571c1a0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.476+0000 7f5722600640 1 --2- 172.21.15.3:0/1280681733 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f57000b53c0 0x7f57000b7880 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.476+0000 7f5722600640 1 --2- 172.21.15.3:0/1280681733 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f571c1076b0 0x7f571c19b8f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.476+0000 7f5722600640 1 --2- 172.21.15.3:0/1280681733 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f571c100d30 0x7f571c19b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.476+0000 7f5722600640 1 -- 172.21.15.3:0/1280681733 >> 172.21.15.3:0/1280681733 conn(0x7f571c0fca20 msgr2=0x7f571c0fd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:10.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.477+0000 7f5722600640 1 -- 172.21.15.3:0/1280681733 shutdown_connections 2024-09-10T23:26:10.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:10.477+0000 7f5722600640 1 -- 172.21.15.3:0/1280681733 wait complete. 2024-09-10T23:26:11.261 INFO:tasks.cephadm:Setup complete, yielding 2024-09-10T23:26:11.261 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T23:26:11.272 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi003.front.sepia.ceph.com 2024-09-10T23:26:11.272 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-10T23:26:11.654 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:12.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:11 smithi038 ceph-mon[34225]: pgmap v373: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:26:12.144 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:11 smithi003 ceph-mon[30348]: pgmap v373: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:26:12.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:11 smithi194 ceph-mon[33904]: pgmap v373: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:26:12.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.258+0000 7f9d3f200640 1 -- 172.21.15.3:0/3050961821 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d40102c10 msgr2=0x7f9d40102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:12.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.258+0000 7f9d3f200640 1 --2- 172.21.15.3:0/3050961821 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d40102c10 0x7f9d40102ff0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9d30009900 tx=0x7f9d3002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.258+0000 7f9d3f200640 1 -- 172.21.15.3:0/3050961821 shutdown_connections 2024-09-10T23:26:12.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.258+0000 7f9d3f200640 1 --2- 172.21.15.3:0/3050961821 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d40108fa0 0x7f9d4010f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.258+0000 7f9d3f200640 1 --2- 172.21.15.3:0/3050961821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d40108620 0x7f9d40108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.258+0000 7f9d3f200640 1 --2- 172.21.15.3:0/3050961821 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d40102c10 0x7f9d40102ff0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.258+0000 7f9d3f200640 1 -- 172.21.15.3:0/3050961821 >> 172.21.15.3:0/3050961821 conn(0x7f9d400fe660 msgr2=0x7f9d40100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:12.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.258+0000 7f9d3f200640 1 -- 172.21.15.3:0/3050961821 shutdown_connections 2024-09-10T23:26:12.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.258+0000 7f9d3f200640 1 -- 172.21.15.3:0/3050961821 wait complete. 2024-09-10T23:26:12.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.259+0000 7f9d3f200640 1 Processor -- start 2024-09-10T23:26:12.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.259+0000 7f9d3f200640 1 -- start start 2024-09-10T23:26:12.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.260+0000 7f9d3f200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d40102c10 0x7f9d40199010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:12.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.260+0000 7f9d3f200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d40108620 0x7f9d40199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:12.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.260+0000 7f9d3f200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d40108fa0 0x7f9d4019e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:12.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.260+0000 7f9d3f200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9d40112b60 con 0x7f9d40108620 2024-09-10T23:26:12.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.260+0000 7f9d3f200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9d401129e0 con 0x7f9d40108fa0 2024-09-10T23:26:12.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.260+0000 7f9d3f200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9d40112ce0 con 0x7f9d40102c10 2024-09-10T23:26:12.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.260+0000 7f9d3d400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d40108620 0x7f9d40199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:12.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.260+0000 7f9d3d400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d40108620 0x7f9d40199550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60154/0 (socket says 172.21.15.3:60154) 2024-09-10T23:26:12.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.260+0000 7f9d3d400640 1 -- 172.21.15.3:0/1062219132 learned_addr learned my addr 172.21.15.3:0/1062219132 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:12.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.260+0000 7f9d3e800640 1 --2- 172.21.15.3:0/1062219132 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d40108fa0 0x7f9d4019e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:12.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.260+0000 7f9d3de00640 1 --2- 172.21.15.3:0/1062219132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d40102c10 0x7f9d40199010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:12.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.261+0000 7f9d3d400640 1 -- 172.21.15.3:0/1062219132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d40102c10 msgr2=0x7f9d40199010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:12.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.261+0000 7f9d3d400640 1 --2- 172.21.15.3:0/1062219132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d40102c10 0x7f9d40199010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.261+0000 7f9d3d400640 1 -- 172.21.15.3:0/1062219132 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d40108fa0 msgr2=0x7f9d4019e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:12.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.261+0000 7f9d3d400640 1 --2- 172.21.15.3:0/1062219132 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d40108fa0 0x7f9d4019e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.261+0000 7f9d3d400640 1 -- 172.21.15.3:0/1062219132 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d4019f0c0 con 0x7f9d40108620 2024-09-10T23:26:12.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.261+0000 7f9d3d400640 1 --2- 172.21.15.3:0/1062219132 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d40108620 0x7f9d40199550 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c00b4a0 tx=0x7f9d2c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:12.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.261+0000 7f9d36a00640 1 -- 172.21.15.3:0/1062219132 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c014070 con 0x7f9d40108620 2024-09-10T23:26:12.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.261+0000 7f9d36a00640 1 -- 172.21.15.3:0/1062219132 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d2c010aa0 con 0x7f9d40108620 2024-09-10T23:26:12.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.261+0000 7f9d36a00640 1 -- 172.21.15.3:0/1062219132 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c017b70 con 0x7f9d40108620 2024-09-10T23:26:12.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.261+0000 7f9d3f200640 1 -- 172.21.15.3:0/1062219132 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d4019f3b0 con 0x7f9d40108620 2024-09-10T23:26:12.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.261+0000 7f9d3f200640 1 -- 172.21.15.3:0/1062219132 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d401a5c40 con 0x7f9d40108620 2024-09-10T23:26:12.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.262+0000 7f9d3f200640 1 -- 172.21.15.3:0/1062219132 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d40102ff0 con 0x7f9d40108620 2024-09-10T23:26:12.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.265+0000 7f9d36a00640 1 -- 172.21.15.3:0/1062219132 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7f9d2c010610 con 0x7f9d40108620 2024-09-10T23:26:12.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.267+0000 7f9d36a00640 1 --2- 172.21.15.3:0/1062219132 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f9d240b54e0 0x7f9d240b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:12.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.267+0000 7f9d36a00640 1 -- 172.21.15.3:0/1062219132 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f9d2c0e5350 con 0x7f9d40108620 2024-09-10T23:26:12.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.267+0000 7f9d3de00640 1 --2- 172.21.15.3:0/1062219132 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f9d240b54e0 0x7f9d240b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:12.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.268+0000 7f9d3de00640 1 --2- 172.21.15.3:0/1062219132 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f9d240b54e0 0x7f9d240b79a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9d30006010 tx=0x7f9d30005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:12.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.270+0000 7f9d36a00640 1 -- 172.21.15.3:0/1062219132 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9d2c0ab5d0 con 0x7f9d40108620 2024-09-10T23:26:12.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.483+0000 7f9d3f200640 1 -- 172.21.15.3:0/1062219132 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f9d40063590 con 0x7f9d240b54e0 2024-09-10T23:26:12.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.484+0000 7f9d36a00640 1 -- 172.21.15.3:0/1062219132 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f9d40063590 con 0x7f9d240b54e0 2024-09-10T23:26:12.485 INFO:teuthology.orchestra.run.smithi003.stdout:Backend: cephadm 2024-09-10T23:26:12.485 INFO:teuthology.orchestra.run.smithi003.stdout:Available: Yes 2024-09-10T23:26:12.485 INFO:teuthology.orchestra.run.smithi003.stdout:Paused: No 2024-09-10T23:26:12.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.486+0000 7f9d3f200640 1 -- 172.21.15.3:0/1062219132 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f9d240b54e0 msgr2=0x7f9d240b79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:12.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.486+0000 7f9d3f200640 1 --2- 172.21.15.3:0/1062219132 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f9d240b54e0 0x7f9d240b79a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9d30006010 tx=0x7f9d30005e80 comp rx=0 tx=0).stop 2024-09-10T23:26:12.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.486+0000 7f9d3f200640 1 -- 172.21.15.3:0/1062219132 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d40108620 msgr2=0x7f9d40199550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:12.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.486+0000 7f9d3f200640 1 --2- 172.21.15.3:0/1062219132 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d40108620 0x7f9d40199550 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c00b4a0 tx=0x7f9d2c00b960 comp rx=0 tx=0).stop 2024-09-10T23:26:12.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.486+0000 7f9d3f200640 1 -- 172.21.15.3:0/1062219132 shutdown_connections 2024-09-10T23:26:12.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.486+0000 7f9d3f200640 1 --2- 172.21.15.3:0/1062219132 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d40108fa0 0x7f9d4019e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.486+0000 7f9d3f200640 1 --2- 172.21.15.3:0/1062219132 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f9d240b54e0 0x7f9d240b79a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.486+0000 7f9d3f200640 1 --2- 172.21.15.3:0/1062219132 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d40108620 0x7f9d40199550 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.486+0000 7f9d3f200640 1 --2- 172.21.15.3:0/1062219132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d40102c10 0x7f9d40199010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.487+0000 7f9d3f200640 1 -- 172.21.15.3:0/1062219132 >> 172.21.15.3:0/1062219132 conn(0x7f9d400fe660 msgr2=0x7f9d40100a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:12.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.487+0000 7f9d3f200640 1 -- 172.21.15.3:0/1062219132 shutdown_connections 2024-09-10T23:26:12.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:12.487+0000 7f9d3f200640 1 -- 172.21.15.3:0/1062219132 wait complete. 2024-09-10T23:26:13.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:12 smithi194 ceph-mon[33904]: from='client.15384 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:26:13.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:12 smithi003 ceph-mon[30348]: from='client.15384 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:26:13.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:12 smithi038 ceph-mon[34225]: from='client.15384 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:26:13.349 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-10T23:26:13.728 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:14.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.293+0000 7fcc6e800640 1 -- 172.21.15.3:0/3515825889 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc68102dc0 msgr2=0x7fcc681031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:14.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.293+0000 7fcc6e800640 1 --2- 172.21.15.3:0/3515825889 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc68102dc0 0x7fcc681031a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fcc58009900 tx=0x7fcc5802a3f0 comp rx=0 tx=0).stop 2024-09-10T23:26:14.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.293+0000 7fcc6e800640 1 -- 172.21.15.3:0/3515825889 shutdown_connections 2024-09-10T23:26:14.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.294+0000 7fcc6e800640 1 --2- 172.21.15.3:0/3515825889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc68109150 0x7fcc6810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:14.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.294+0000 7fcc6e800640 1 --2- 172.21.15.3:0/3515825889 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc681087d0 0x7fcc68108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:14.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.294+0000 7fcc6e800640 1 --2- 172.21.15.3:0/3515825889 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc68102dc0 0x7fcc681031a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:14.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.294+0000 7fcc6e800640 1 -- 172.21.15.3:0/3515825889 >> 172.21.15.3:0/3515825889 conn(0x7fcc680fe830 msgr2=0x7fcc68100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:14.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.294+0000 7fcc6e800640 1 -- 172.21.15.3:0/3515825889 shutdown_connections 2024-09-10T23:26:14.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.294+0000 7fcc6e800640 1 -- 172.21.15.3:0/3515825889 wait complete. 2024-09-10T23:26:14.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.295+0000 7fcc6e800640 1 Processor -- start 2024-09-10T23:26:14.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.295+0000 7fcc6e800640 1 -- start start 2024-09-10T23:26:14.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.296+0000 7fcc6e800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc68102dc0 0x7fcc6819b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:14.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.296+0000 7fcc6e800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc681087d0 0x7fcc6819b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:14.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.296+0000 7fcc6e800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc68109150 0x7fcc681a0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:14.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.296+0000 7fcc6e800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fcc68112d10 con 0x7fcc68109150 2024-09-10T23:26:14.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.296+0000 7fcc6e800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fcc68112b90 con 0x7fcc68102dc0 2024-09-10T23:26:14.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.296+0000 7fcc6e800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcc68112e90 con 0x7fcc681087d0 2024-09-10T23:26:14.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.296+0000 7fcc67e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc68109150 0x7fcc681a0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:14.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.296+0000 7fcc67e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc68109150 0x7fcc681a0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60168/0 (socket says 172.21.15.3:60168) 2024-09-10T23:26:14.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.296+0000 7fcc67e00640 1 -- 172.21.15.3:0/524575065 learned_addr learned my addr 172.21.15.3:0/524575065 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:14.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.296+0000 7fcc67400640 1 --2- 172.21.15.3:0/524575065 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc68102dc0 0x7fcc6819b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:14.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.296+0000 7fcc5fe00640 1 --2- 172.21.15.3:0/524575065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc681087d0 0x7fcc6819b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:14.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.296+0000 7fcc67e00640 1 -- 172.21.15.3:0/524575065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc681087d0 msgr2=0x7fcc6819b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:14.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.297+0000 7fcc67e00640 1 --2- 172.21.15.3:0/524575065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc681087d0 0x7fcc6819b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:14.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.297+0000 7fcc67e00640 1 -- 172.21.15.3:0/524575065 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc68102dc0 msgr2=0x7fcc6819b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:14.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.297+0000 7fcc67e00640 1 --2- 172.21.15.3:0/524575065 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc68102dc0 0x7fcc6819b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:14.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.297+0000 7fcc67e00640 1 -- 172.21.15.3:0/524575065 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc681a14b0 con 0x7fcc68109150 2024-09-10T23:26:14.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.297+0000 7fcc5fe00640 1 --2- 172.21.15.3:0/524575065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc681087d0 0x7fcc6819b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:14.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.297+0000 7fcc67e00640 1 --2- 172.21.15.3:0/524575065 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc68109150 0x7fcc681a0ce0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fcc6000eaa0 tx=0x7fcc6000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:14.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.297+0000 7fcc64c00640 1 -- 172.21.15.3:0/524575065 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6000cdb0 con 0x7fcc68109150 2024-09-10T23:26:14.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.297+0000 7fcc64c00640 1 -- 172.21.15.3:0/524575065 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc60005020 con 0x7fcc68109150 2024-09-10T23:26:14.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.297+0000 7fcc6e800640 1 -- 172.21.15.3:0/524575065 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc681a17a0 con 0x7fcc68109150 2024-09-10T23:26:14.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.297+0000 7fcc64c00640 1 -- 172.21.15.3:0/524575065 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6001f060 con 0x7fcc68109150 2024-09-10T23:26:14.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.297+0000 7fcc6e800640 1 -- 172.21.15.3:0/524575065 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc681a7e60 con 0x7fcc68109150 2024-09-10T23:26:14.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.298+0000 7fcc6e800640 1 -- 172.21.15.3:0/524575065 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc681031a0 con 0x7fcc68109150 2024-09-10T23:26:14.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.301+0000 7fcc64c00640 1 -- 172.21.15.3:0/524575065 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7fcc6000f040 con 0x7fcc68109150 2024-09-10T23:26:14.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.302+0000 7fcc64c00640 1 --2- 172.21.15.3:0/524575065 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcc4c0b53c0 0x7fcc4c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:14.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.303+0000 7fcc64c00640 1 -- 172.21.15.3:0/524575065 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7fcc600e6500 con 0x7fcc68109150 2024-09-10T23:26:14.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.303+0000 7fcc67400640 1 --2- 172.21.15.3:0/524575065 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcc4c0b53c0 0x7fcc4c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:14.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.303+0000 7fcc67400640 1 --2- 172.21.15.3:0/524575065 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcc4c0b53c0 0x7fcc4c0b7880 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcc58006010 tx=0x7fcc58005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:14.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.305+0000 7fcc64c00640 1 -- 172.21.15.3:0/524575065 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcc60016030 con 0x7fcc68109150 2024-09-10T23:26:14.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:14 smithi194 ceph-mon[33904]: pgmap v374: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:26:14.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:14 smithi003 ceph-mon[30348]: pgmap v374: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:26:14.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.510+0000 7fcc6e800640 1 -- 172.21.15.3:0/524575065 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fcc68063590 con 0x7fcc4c0b53c0 2024-09-10T23:26:14.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.523+0000 7fcc64c00640 1 -- 172.21.15.3:0/524575065 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7fcc68063590 con 0x7fcc4c0b53c0 2024-09-10T23:26:14.524 INFO:teuthology.orchestra.run.smithi003.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T23:26:14.524 INFO:teuthology.orchestra.run.smithi003.stdout:mds.a smithi003 running (2m) 12s ago 2m 13.2M - 19.3.0-4854-g8f219c47 589dd18248e4 0200c64007a9 2024-09-10T23:26:14.524 INFO:teuthology.orchestra.run.smithi003.stdout:mds.b smithi038 running (2m) 13s ago 2m 25.3M - 19.3.0-4854-g8f219c47 589dd18248e4 ac6480bce797 2024-09-10T23:26:14.524 INFO:teuthology.orchestra.run.smithi003.stdout:mds.c smithi194 running (2m) 13s ago 2m 16.9M - 19.3.0-4854-g8f219c47 589dd18248e4 2466729636bd 2024-09-10T23:26:14.524 INFO:teuthology.orchestra.run.smithi003.stdout:mds.d smithi003 running (2m) 12s ago 2m 13.3M - 19.3.0-4854-g8f219c47 589dd18248e4 c1747fac5bd3 2024-09-10T23:26:14.524 INFO:teuthology.orchestra.run.smithi003.stdout:mds.e smithi038 running (2m) 13s ago 2m 18.1M - 19.3.0-4854-g8f219c47 589dd18248e4 2b69464e30fb 2024-09-10T23:26:14.525 INFO:teuthology.orchestra.run.smithi003.stdout:mds.f smithi194 running (2m) 13s ago 2m 13.3M - 19.3.0-4854-g8f219c47 589dd18248e4 ca0eeceaff69 2024-09-10T23:26:14.525 INFO:teuthology.orchestra.run.smithi003.stdout:mds.g smithi003 running (2m) 12s ago 2m 13.2M - 19.3.0-4854-g8f219c47 589dd18248e4 cbbf94f8749d 2024-09-10T23:26:14.525 INFO:teuthology.orchestra.run.smithi003.stdout:mds.h smithi038 running (2m) 13s ago 2m 17.7M - 19.3.0-4854-g8f219c47 589dd18248e4 f5826b115319 2024-09-10T23:26:14.525 INFO:teuthology.orchestra.run.smithi003.stdout:mds.i smithi194 running (2m) 13s ago 2m 17.0M - 19.3.0-4854-g8f219c47 589dd18248e4 a1a9eedf5869 2024-09-10T23:26:14.525 INFO:teuthology.orchestra.run.smithi003.stdout:mds.j smithi003 running (3m) 12s ago 3m 13.4M - 19.3.0-4854-g8f219c47 589dd18248e4 be87cbba1f88 2024-09-10T23:26:14.525 INFO:teuthology.orchestra.run.smithi003.stdout:mds.k smithi038 running (3m) 13s ago 3m 18.3M - 19.3.0-4854-g8f219c47 589dd18248e4 3eb8d873169e 2024-09-10T23:26:14.525 INFO:teuthology.orchestra.run.smithi003.stdout:mds.l smithi194 running (3m) 13s ago 3m 13.4M - 19.3.0-4854-g8f219c47 589dd18248e4 8e7fa99ead2b 2024-09-10T23:26:14.525 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.x smithi003 *:9283,8765 running (11m) 12s ago 11m 519M - 19.3.0-4854-g8f219c47 589dd18248e4 a0f70d5992d3 2024-09-10T23:26:14.525 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.y smithi038 *:8443,8765 running (9m) 13s ago 9m 456M - 19.3.0-4854-g8f219c47 589dd18248e4 812af8ed3c96 2024-09-10T23:26:14.525 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.z smithi194 *:8443,8765 running (9m) 13s ago 9m 456M - 19.3.0-4854-g8f219c47 589dd18248e4 dc5e48ebe462 2024-09-10T23:26:14.525 INFO:teuthology.orchestra.run.smithi003.stdout:mon.a smithi003 running (11m) 12s ago 12m 52.4M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 3744d202b7ec 2024-09-10T23:26:14.525 INFO:teuthology.orchestra.run.smithi003.stdout:mon.b smithi038 running (10m) 13s ago 10m 43.6M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 7a803f8f539b 2024-09-10T23:26:14.525 INFO:teuthology.orchestra.run.smithi003.stdout:mon.c smithi194 running (10m) 13s ago 10m 40.5M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 5dd3906c776c 2024-09-10T23:26:14.526 INFO:teuthology.orchestra.run.smithi003.stdout:osd.0 smithi003 running (8m) 12s ago 8m 54.4M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 62a06809a8f3 2024-09-10T23:26:14.526 INFO:teuthology.orchestra.run.smithi003.stdout:osd.1 smithi038 running (8m) 13s ago 8m 56.1M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 9fcc80541c37 2024-09-10T23:26:14.526 INFO:teuthology.orchestra.run.smithi003.stdout:osd.2 smithi194 running (7m) 13s ago 7m 56.2M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 d1f22cfffa63 2024-09-10T23:26:14.526 INFO:teuthology.orchestra.run.smithi003.stdout:osd.3 smithi003 running (7m) 12s ago 7m 55.2M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 3df54912c9bd 2024-09-10T23:26:14.526 INFO:teuthology.orchestra.run.smithi003.stdout:osd.4 smithi038 running (6m) 13s ago 6m 42.1M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 63c2e0a13362 2024-09-10T23:26:14.526 INFO:teuthology.orchestra.run.smithi003.stdout:osd.5 smithi194 running (6m) 13s ago 6m 54.0M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 718b563aedee 2024-09-10T23:26:14.526 INFO:teuthology.orchestra.run.smithi003.stdout:osd.6 smithi003 running (5m) 12s ago 5m 43.5M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 447dcbe605e2 2024-09-10T23:26:14.526 INFO:teuthology.orchestra.run.smithi003.stdout:osd.7 smithi038 running (5m) 13s ago 5m 55.6M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 dd3f818c75b9 2024-09-10T23:26:14.526 INFO:teuthology.orchestra.run.smithi003.stdout:osd.8 smithi194 running (4m) 13s ago 4m 42.2M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 ff7b8061ec79 2024-09-10T23:26:14.526 INFO:teuthology.orchestra.run.smithi003.stdout:osd.9 smithi003 running (4m) 12s ago 4m 42.4M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 7ebb7dab0d1d 2024-09-10T23:26:14.526 INFO:teuthology.orchestra.run.smithi003.stdout:osd.10 smithi038 running (3m) 13s ago 3m 42.8M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 c0a67ed62460 2024-09-10T23:26:14.526 INFO:teuthology.orchestra.run.smithi003.stdout:osd.11 smithi194 running (3m) 13s ago 3m 51.9M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 fdd650e1254f 2024-09-10T23:26:14.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.525+0000 7fcc6e800640 1 -- 172.21.15.3:0/524575065 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcc4c0b53c0 msgr2=0x7fcc4c0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:14.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.525+0000 7fcc6e800640 1 --2- 172.21.15.3:0/524575065 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcc4c0b53c0 0x7fcc4c0b7880 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcc58006010 tx=0x7fcc58005e80 comp rx=0 tx=0).stop 2024-09-10T23:26:14.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.525+0000 7fcc6e800640 1 -- 172.21.15.3:0/524575065 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc68109150 msgr2=0x7fcc681a0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:14.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.525+0000 7fcc6e800640 1 --2- 172.21.15.3:0/524575065 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc68109150 0x7fcc681a0ce0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fcc6000eaa0 tx=0x7fcc6000ef60 comp rx=0 tx=0).stop 2024-09-10T23:26:14.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.525+0000 7fcc6e800640 1 -- 172.21.15.3:0/524575065 shutdown_connections 2024-09-10T23:26:14.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.525+0000 7fcc6e800640 1 --2- 172.21.15.3:0/524575065 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcc4c0b53c0 0x7fcc4c0b7880 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:14.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.525+0000 7fcc6e800640 1 --2- 172.21.15.3:0/524575065 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc68109150 0x7fcc681a0ce0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:14.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.525+0000 7fcc6e800640 1 --2- 172.21.15.3:0/524575065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc681087d0 0x7fcc6819b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:14.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.525+0000 7fcc6e800640 1 --2- 172.21.15.3:0/524575065 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc68102dc0 0x7fcc6819b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:14.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.525+0000 7fcc6e800640 1 -- 172.21.15.3:0/524575065 >> 172.21.15.3:0/524575065 conn(0x7fcc680fe830 msgr2=0x7fcc68104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:14.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.525+0000 7fcc6e800640 1 -- 172.21.15.3:0/524575065 shutdown_connections 2024-09-10T23:26:14.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:14.526+0000 7fcc6e800640 1 -- 172.21.15.3:0/524575065 wait complete. 2024-09-10T23:26:14.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:14 smithi038 ceph-mon[34225]: pgmap v374: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:26:15.245 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-10T23:26:15.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:15 smithi194 ceph-mon[33904]: from='client.15390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:26:15.472 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:15 smithi003 ceph-mon[30348]: from='client.15390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:26:15.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:15 smithi038 ceph-mon[34225]: from='client.15390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:26:15.625 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:16.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.180+0000 7f2d7e000640 1 -- 172.21.15.3:0/3779033913 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d78104df0 msgr2=0x7f2d781051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:16.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.180+0000 7f2d7e000640 1 --2- 172.21.15.3:0/3779033913 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d78104df0 0x7f2d781051d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2d68009900 tx=0x7f2d6802a3f0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.180+0000 7f2d7e000640 1 -- 172.21.15.3:0/3779033913 shutdown_connections 2024-09-10T23:26:16.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.180+0000 7f2d7e000640 1 --2- 172.21.15.3:0/3779033913 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d7810b180 0x7f2d78111980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.180+0000 7f2d7e000640 1 --2- 172.21.15.3:0/3779033913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d7810a800 0x7f2d7810ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.180+0000 7f2d7e000640 1 --2- 172.21.15.3:0/3779033913 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d78104df0 0x7f2d781051d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.180+0000 7f2d7e000640 1 -- 172.21.15.3:0/3779033913 >> 172.21.15.3:0/3779033913 conn(0x7f2d78100840 msgr2=0x7f2d78102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:16.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.180+0000 7f2d7e000640 1 -- 172.21.15.3:0/3779033913 shutdown_connections 2024-09-10T23:26:16.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.180+0000 7f2d7e000640 1 -- 172.21.15.3:0/3779033913 wait complete. 2024-09-10T23:26:16.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.181+0000 7f2d7e000640 1 Processor -- start 2024-09-10T23:26:16.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.181+0000 7f2d7e000640 1 -- start start 2024-09-10T23:26:16.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.181+0000 7f2d7e000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d78104df0 0x7f2d7819b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:16.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.181+0000 7f2d7e000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d7810a800 0x7f2d7819b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:16.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.181+0000 7f2d7e000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d7810b180 0x7f2d781a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:16.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.181+0000 7f2d7e000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2d78114cf0 con 0x7f2d7810a800 2024-09-10T23:26:16.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.181+0000 7f2d7e000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2d78114b70 con 0x7f2d78104df0 2024-09-10T23:26:16.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.181+0000 7f2d7e000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2d78114e70 con 0x7f2d7810b180 2024-09-10T23:26:16.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.182+0000 7f2d6fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d7810a800 0x7f2d7819b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:16.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.182+0000 7f2d6fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d7810a800 0x7f2d7819b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60188/0 (socket says 172.21.15.3:60188) 2024-09-10T23:26:16.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.182+0000 7f2d6fe00640 1 -- 172.21.15.3:0/2901375620 learned_addr learned my addr 172.21.15.3:0/2901375620 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:16.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.182+0000 7f2d7d600640 1 --2- 172.21.15.3:0/2901375620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d7810b180 0x7f2d781a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:16.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.182+0000 7f2d7cc00640 1 --2- 172.21.15.3:0/2901375620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d78104df0 0x7f2d7819b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:16.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.182+0000 7f2d6fe00640 1 -- 172.21.15.3:0/2901375620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d7810b180 msgr2=0x7f2d781a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:16.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.182+0000 7f2d6fe00640 1 --2- 172.21.15.3:0/2901375620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d7810b180 0x7f2d781a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.182+0000 7f2d6fe00640 1 -- 172.21.15.3:0/2901375620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d78104df0 msgr2=0x7f2d7819b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:16.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.182+0000 7f2d6fe00640 1 --2- 172.21.15.3:0/2901375620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d78104df0 0x7f2d7819b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.182+0000 7f2d6fe00640 1 -- 172.21.15.3:0/2901375620 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d781a1170 con 0x7f2d7810a800 2024-09-10T23:26:16.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.182+0000 7f2d7cc00640 1 --2- 172.21.15.3:0/2901375620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d78104df0 0x7f2d7819b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:16.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.182+0000 7f2d6fe00640 1 --2- 172.21.15.3:0/2901375620 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d7810a800 0x7f2d7819b600 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000d770 tx=0x7f2d6000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:16.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.183+0000 7f2d76000640 1 -- 172.21.15.3:0/2901375620 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d60017070 con 0x7f2d7810a800 2024-09-10T23:26:16.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.183+0000 7f2d76000640 1 -- 172.21.15.3:0/2901375620 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2d600054b0 con 0x7f2d7810a800 2024-09-10T23:26:16.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.183+0000 7f2d7e000640 1 -- 172.21.15.3:0/2901375620 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d781a1460 con 0x7f2d7810a800 2024-09-10T23:26:16.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.183+0000 7f2d76000640 1 -- 172.21.15.3:0/2901375620 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d60004c60 con 0x7f2d7810a800 2024-09-10T23:26:16.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.183+0000 7f2d7e000640 1 -- 172.21.15.3:0/2901375620 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d781a7b20 con 0x7f2d7810a800 2024-09-10T23:26:16.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.184+0000 7f2d7e000640 1 -- 172.21.15.3:0/2901375620 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d781051d0 con 0x7f2d7810a800 2024-09-10T23:26:16.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.186+0000 7f2d76000640 1 -- 172.21.15.3:0/2901375620 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7f2d60004e00 con 0x7f2d7810a800 2024-09-10T23:26:16.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.188+0000 7f2d76000640 1 --2- 172.21.15.3:0/2901375620 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f2d5c0b54e0 0x7f2d5c0b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:16.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.188+0000 7f2d76000640 1 -- 172.21.15.3:0/2901375620 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f2d600e60b0 con 0x7f2d7810a800 2024-09-10T23:26:16.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.188+0000 7f2d7cc00640 1 --2- 172.21.15.3:0/2901375620 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f2d5c0b54e0 0x7f2d5c0b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:16.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.189+0000 7f2d7cc00640 1 --2- 172.21.15.3:0/2901375620 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f2d5c0b54e0 0x7f2d5c0b79a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2d68000c00 tx=0x7f2d68005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:16.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.189+0000 7f2d76000640 1 -- 172.21.15.3:0/2901375620 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2d600ac9a0 con 0x7f2d7810a800 2024-09-10T23:26:16.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.392+0000 7f2d7e000640 1 -- 172.21.15.3:0/2901375620 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f2d78107dc0 con 0x7f2d5c0b54e0 2024-09-10T23:26:16.394 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:16 smithi003 ceph-mon[30348]: pgmap v375: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:26:16.400 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.399+0000 7f2d76000640 1 -- 172.21.15.3:0/2901375620 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f2d78107dc0 con 0x7f2d5c0b54e0 2024-09-10T23:26:16.400 INFO:teuthology.orchestra.run.smithi003.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-10T23:26:16.400 INFO:teuthology.orchestra.run.smithi003.stdout:mds.all 12/12 15s ago 3m smithi003=a;smithi003=d;smithi003=g;smithi003=j;smithi038=b;smithi038=e;smithi038=h;smithi038=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l;count:12 2024-09-10T23:26:16.400 INFO:teuthology.orchestra.run.smithi003.stdout:mgr 3/3 15s ago 9m smithi003=x;smithi038=y;smithi194=z;count:3 2024-09-10T23:26:16.401 INFO:teuthology.orchestra.run.smithi003.stdout:mon 3/3 15s ago 10m smithi003:172.21.15.3=a;smithi038:172.21.15.38=b;smithi194:172.21.15.194=c;count:3 2024-09-10T23:26:16.401 INFO:teuthology.orchestra.run.smithi003.stdout:osd 12 15s ago - 2024-09-10T23:26:16.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.402+0000 7f2d7e000640 1 -- 172.21.15.3:0/2901375620 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f2d5c0b54e0 msgr2=0x7f2d5c0b79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:16.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.402+0000 7f2d7e000640 1 --2- 172.21.15.3:0/2901375620 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f2d5c0b54e0 0x7f2d5c0b79a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2d68000c00 tx=0x7f2d68005a20 comp rx=0 tx=0).stop 2024-09-10T23:26:16.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.402+0000 7f2d7e000640 1 -- 172.21.15.3:0/2901375620 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d7810a800 msgr2=0x7f2d7819b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:16.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.402+0000 7f2d7e000640 1 --2- 172.21.15.3:0/2901375620 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d7810a800 0x7f2d7819b600 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000d770 tx=0x7f2d6000dc30 comp rx=0 tx=0).stop 2024-09-10T23:26:16.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.402+0000 7f2d7e000640 1 -- 172.21.15.3:0/2901375620 shutdown_connections 2024-09-10T23:26:16.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.402+0000 7f2d7e000640 1 --2- 172.21.15.3:0/2901375620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d7810b180 0x7f2d781a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.402+0000 7f2d7e000640 1 --2- 172.21.15.3:0/2901375620 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f2d5c0b54e0 0x7f2d5c0b79a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.402+0000 7f2d7e000640 1 --2- 172.21.15.3:0/2901375620 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d7810a800 0x7f2d7819b600 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.402+0000 7f2d7e000640 1 --2- 172.21.15.3:0/2901375620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d78104df0 0x7f2d7819b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.402+0000 7f2d7e000640 1 -- 172.21.15.3:0/2901375620 >> 172.21.15.3:0/2901375620 conn(0x7f2d78100840 msgr2=0x7f2d78103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:16.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.402+0000 7f2d7e000640 1 -- 172.21.15.3:0/2901375620 shutdown_connections 2024-09-10T23:26:16.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:16.402+0000 7f2d7e000640 1 -- 172.21.15.3:0/2901375620 wait complete. 2024-09-10T23:26:16.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:16 smithi194 ceph-mon[33904]: pgmap v375: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:26:16.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:16 smithi038 ceph-mon[34225]: pgmap v375: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:26:17.133 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-10T23:26:17.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:17 smithi194 ceph-mon[33904]: from='client.15396 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:26:17.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:17 smithi003 ceph-mon[30348]: from='client.15396 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:26:17.513 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:17.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:17 smithi038 ceph-mon[34225]: from='client.15396 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:26:18.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.047+0000 7f8878600640 1 -- 172.21.15.3:0/3753068817 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8870113990 msgr2=0x7f8870115d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:18.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.047+0000 7f8878600640 1 --2- 172.21.15.3:0/3753068817 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8870113990 0x7f8870115d80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8868009ca0 tx=0x7f886802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.048+0000 7f8878600640 1 -- 172.21.15.3:0/3753068817 shutdown_connections 2024-09-10T23:26:18.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.048+0000 7f8878600640 1 --2- 172.21.15.3:0/3753068817 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8870113990 0x7f8870115d80 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.048+0000 7f8878600640 1 --2- 172.21.15.3:0/3753068817 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8870077ff0 0x7f8870113450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.048+0000 7f8878600640 1 --2- 172.21.15.3:0/3753068817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88700776d0 0x7f8870077ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.048+0000 7f8878600640 1 -- 172.21.15.3:0/3753068817 >> 172.21.15.3:0/3753068817 conn(0x7f8870100a50 msgr2=0x7f8870102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:18.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.048+0000 7f8878600640 1 -- 172.21.15.3:0/3753068817 shutdown_connections 2024-09-10T23:26:18.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.048+0000 7f8878600640 1 -- 172.21.15.3:0/3753068817 wait complete. 2024-09-10T23:26:18.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.048+0000 7f8878600640 1 Processor -- start 2024-09-10T23:26:18.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.049+0000 7f8878600640 1 -- start start 2024-09-10T23:26:18.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.049+0000 7f8878600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88700776d0 0x7f887019f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.049+0000 7f8878600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8870077ff0 0x7f887019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.049+0000 7f8878600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8870113990 0x7f88701a5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.049+0000 7f8878600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8870119270 con 0x7f8870113990 2024-09-10T23:26:18.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.049+0000 7f8878600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f88701190f0 con 0x7f8870077ff0 2024-09-10T23:26:18.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.049+0000 7f8878600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f88701193f0 con 0x7f88700776d0 2024-09-10T23:26:18.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.049+0000 7f8876600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8870113990 0x7f88701a5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.049+0000 7f8875200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8870077ff0 0x7f887019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.049+0000 7f8875c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88700776d0 0x7f887019f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.049+0000 7f8875200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8870077ff0 0x7f887019fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.3:49182/0 (socket says 172.21.15.3:49182) 2024-09-10T23:26:18.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.049+0000 7f8875200640 1 -- 172.21.15.3:0/2958714183 learned_addr learned my addr 172.21.15.3:0/2958714183 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:18.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.049+0000 7f8876600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8870113990 0x7f88701a5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60198/0 (socket says 172.21.15.3:60198) 2024-09-10T23:26:18.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.050+0000 7f8875200640 1 -- 172.21.15.3:0/2958714183 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88700776d0 msgr2=0x7f887019f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:18.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.050+0000 7f8875200640 1 --2- 172.21.15.3:0/2958714183 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88700776d0 0x7f887019f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.050+0000 7f8875200640 1 -- 172.21.15.3:0/2958714183 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8870113990 msgr2=0x7f88701a5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:18.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.050+0000 7f8875200640 1 --2- 172.21.15.3:0/2958714183 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8870113990 0x7f88701a5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.050+0000 7f8875200640 1 -- 172.21.15.3:0/2958714183 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88701a5850 con 0x7f8870077ff0 2024-09-10T23:26:18.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.050+0000 7f8875200640 1 --2- 172.21.15.3:0/2958714183 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8870077ff0 0x7f887019fce0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f885c00e9f0 tx=0x7f885c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:18.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.050+0000 7f886e000640 1 -- 172.21.15.3:0/2958714183 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f885c00cd80 con 0x7f8870077ff0 2024-09-10T23:26:18.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.051+0000 7f886e000640 1 -- 172.21.15.3:0/2958714183 <== mon.2 v2:172.21.15.38:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f885c0108c0 con 0x7f8870077ff0 2024-09-10T23:26:18.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.051+0000 7f8878600640 1 -- 172.21.15.3:0/2958714183 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88701a5b40 con 0x7f8870077ff0 2024-09-10T23:26:18.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.051+0000 7f886e000640 1 -- 172.21.15.3:0/2958714183 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f885c0187c0 con 0x7f8870077ff0 2024-09-10T23:26:18.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.051+0000 7f8878600640 1 -- 172.21.15.3:0/2958714183 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88701ac3d0 con 0x7f8870077ff0 2024-09-10T23:26:18.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.052+0000 7f8878600640 1 -- 172.21.15.3:0/2958714183 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8870078be0 con 0x7f8870077ff0 2024-09-10T23:26:18.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.054+0000 7f886e000640 1 -- 172.21.15.3:0/2958714183 <== mon.2 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7f885c010430 con 0x7f8870077ff0 2024-09-10T23:26:18.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.056+0000 7f886e000640 1 --2- 172.21.15.3:0/2958714183 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f88580b5440 0x7f88580b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.056+0000 7f886e000640 1 -- 172.21.15.3:0/2958714183 <== mon.2 v2:172.21.15.38:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f885c0e6a40 con 0x7f8870077ff0 2024-09-10T23:26:18.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.056+0000 7f8875c00640 1 --2- 172.21.15.3:0/2958714183 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f88580b5440 0x7f88580b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.057+0000 7f8875c00640 1 --2- 172.21.15.3:0/2958714183 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f88580b5440 0x7f88580b7900 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8864005fd0 tx=0x7f886400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:18.058 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.058+0000 7f886e000640 1 -- 172.21.15.3:0/2958714183 <== mon.2 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f885c0acc60 con 0x7f8870077ff0 2024-09-10T23:26:18.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:18 smithi003 ceph-mon[30348]: pgmap v376: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:26:18.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.259+0000 7f8878600640 1 -- 172.21.15.3:0/2958714183 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f8870115ae0 con 0x7f88580b5440 2024-09-10T23:26:18.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.260+0000 7f886e000640 1 -- 172.21.15.3:0/2958714183 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f8870115ae0 con 0x7f88580b5440 2024-09-10T23:26:18.261 INFO:teuthology.orchestra.run.smithi003.stdout:HOST ADDR LABELS STATUS 2024-09-10T23:26:18.261 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003 172.21.15.3 2024-09-10T23:26:18.261 INFO:teuthology.orchestra.run.smithi003.stdout:smithi038 172.21.15.38 2024-09-10T23:26:18.261 INFO:teuthology.orchestra.run.smithi003.stdout:smithi194 172.21.15.194 2024-09-10T23:26:18.261 INFO:teuthology.orchestra.run.smithi003.stdout:3 hosts in cluster 2024-09-10T23:26:18.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.263+0000 7f8878600640 1 -- 172.21.15.3:0/2958714183 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f88580b5440 msgr2=0x7f88580b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:18.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.263+0000 7f8878600640 1 --2- 172.21.15.3:0/2958714183 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f88580b5440 0x7f88580b7900 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8864005fd0 tx=0x7f886400b390 comp rx=0 tx=0).stop 2024-09-10T23:26:18.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.263+0000 7f8878600640 1 -- 172.21.15.3:0/2958714183 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8870077ff0 msgr2=0x7f887019fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:18.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.263+0000 7f8878600640 1 --2- 172.21.15.3:0/2958714183 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8870077ff0 0x7f887019fce0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f885c00e9f0 tx=0x7f885c00eeb0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.263+0000 7f8878600640 1 -- 172.21.15.3:0/2958714183 shutdown_connections 2024-09-10T23:26:18.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.263+0000 7f8878600640 1 --2- 172.21.15.3:0/2958714183 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f88580b5440 0x7f88580b7900 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.263+0000 7f8878600640 1 --2- 172.21.15.3:0/2958714183 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8870113990 0x7f88701a5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.263+0000 7f8878600640 1 --2- 172.21.15.3:0/2958714183 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8870077ff0 0x7f887019fce0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.263+0000 7f8878600640 1 --2- 172.21.15.3:0/2958714183 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88700776d0 0x7f887019f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.263+0000 7f8878600640 1 -- 172.21.15.3:0/2958714183 >> 172.21.15.3:0/2958714183 conn(0x7f8870100a50 msgr2=0x7f8870102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:18.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.263+0000 7f8878600640 1 -- 172.21.15.3:0/2958714183 shutdown_connections 2024-09-10T23:26:18.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:18.263+0000 7f8878600640 1 -- 172.21.15.3:0/2958714183 wait complete. 2024-09-10T23:26:18.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:18 smithi194 ceph-mon[33904]: pgmap v376: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:26:18.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:18 smithi038 ceph-mon[34225]: pgmap v376: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:26:19.018 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-10T23:26:19.397 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:19.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:19 smithi194 ceph-mon[33904]: from='client.35201 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:26:19.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:19 smithi003 ceph-mon[30348]: from='client.35201 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:26:19.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:19 smithi038 ceph-mon[34225]: from='client.35201 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:26:19.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.965+0000 7f0542600640 1 -- 172.21.15.3:0/306473618 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f053c10b330 msgr2=0x7f053c111b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:19.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.965+0000 7f0542600640 1 --2- 172.21.15.3:0/306473618 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f053c10b330 0x7f053c111b30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0534009ca0 tx=0x7f053402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:26:19.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.965+0000 7f0542600640 1 -- 172.21.15.3:0/306473618 shutdown_connections 2024-09-10T23:26:19.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.965+0000 7f0542600640 1 --2- 172.21.15.3:0/306473618 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f053c10b330 0x7f053c111b30 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:19.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.965+0000 7f0542600640 1 --2- 172.21.15.3:0/306473618 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f053c10a9b0 0x7f053c10adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:19.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.965+0000 7f0542600640 1 --2- 172.21.15.3:0/306473618 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f053c104fa0 0x7f053c105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:19.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.965+0000 7f0542600640 1 -- 172.21.15.3:0/306473618 >> 172.21.15.3:0/306473618 conn(0x7f053c100a50 msgr2=0x7f053c102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:19.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.966+0000 7f0542600640 1 -- 172.21.15.3:0/306473618 shutdown_connections 2024-09-10T23:26:19.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.966+0000 7f0542600640 1 -- 172.21.15.3:0/306473618 wait complete. 2024-09-10T23:26:19.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.966+0000 7f0542600640 1 Processor -- start 2024-09-10T23:26:19.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.967+0000 7f0542600640 1 -- start start 2024-09-10T23:26:19.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.967+0000 7f0542600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f053c104fa0 0x7f053c19b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:19.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.967+0000 7f0542600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f053c10a9b0 0x7f053c19b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:19.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.967+0000 7f0542600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f053c10b330 0x7f053c1a0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:19.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.967+0000 7f0542600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f053c114e60 con 0x7f053c10a9b0 2024-09-10T23:26:19.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.967+0000 7f0542600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f053c114ce0 con 0x7f053c10b330 2024-09-10T23:26:19.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.967+0000 7f0542600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f053c114fe0 con 0x7f053c104fa0 2024-09-10T23:26:19.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.967+0000 7f053aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f053c10a9b0 0x7f053c19b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:19.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.967+0000 7f053b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f053c104fa0 0x7f053c19b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:19.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.967+0000 7f053aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f053c10a9b0 0x7f053c19b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60216/0 (socket says 172.21.15.3:60216) 2024-09-10T23:26:19.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.967+0000 7f053aa00640 1 -- 172.21.15.3:0/2876630809 learned_addr learned my addr 172.21.15.3:0/2876630809 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:19.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.967+0000 7f053be00640 1 --2- 172.21.15.3:0/2876630809 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f053c10b330 0x7f053c1a0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:19.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.968+0000 7f053aa00640 1 -- 172.21.15.3:0/2876630809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f053c104fa0 msgr2=0x7f053c19b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:19.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.968+0000 7f053aa00640 1 --2- 172.21.15.3:0/2876630809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f053c104fa0 0x7f053c19b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:19.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.968+0000 7f053aa00640 1 -- 172.21.15.3:0/2876630809 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f053c10b330 msgr2=0x7f053c1a0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:19.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.968+0000 7f053aa00640 1 --2- 172.21.15.3:0/2876630809 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f053c10b330 0x7f053c1a0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:19.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.968+0000 7f053aa00640 1 -- 172.21.15.3:0/2876630809 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f053c1a1420 con 0x7f053c10a9b0 2024-09-10T23:26:19.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.968+0000 7f053aa00640 1 --2- 172.21.15.3:0/2876630809 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f053c10a9b0 0x7f053c19b8b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f052800d770 tx=0x7f052800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:19.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.968+0000 7f0533e00640 1 -- 172.21.15.3:0/2876630809 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0528017070 con 0x7f053c10a9b0 2024-09-10T23:26:19.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.968+0000 7f0533e00640 1 -- 172.21.15.3:0/2876630809 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f05280054b0 con 0x7f053c10a9b0 2024-09-10T23:26:19.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.969+0000 7f0533e00640 1 -- 172.21.15.3:0/2876630809 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0528004c60 con 0x7f053c10a9b0 2024-09-10T23:26:19.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.969+0000 7f0542600640 1 -- 172.21.15.3:0/2876630809 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f053c1a1710 con 0x7f053c10a9b0 2024-09-10T23:26:19.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.969+0000 7f0542600640 1 -- 172.21.15.3:0/2876630809 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f053c1a7dd0 con 0x7f053c10a9b0 2024-09-10T23:26:19.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.970+0000 7f0542600640 1 -- 172.21.15.3:0/2876630809 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f053c105380 con 0x7f053c10a9b0 2024-09-10T23:26:19.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.973+0000 7f0533e00640 1 -- 172.21.15.3:0/2876630809 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7f0528004e00 con 0x7f053c10a9b0 2024-09-10T23:26:19.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.974+0000 7f0533e00640 1 --2- 172.21.15.3:0/2876630809 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f05200b5440 0x7f05200b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:19.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.974+0000 7f0533e00640 1 -- 172.21.15.3:0/2876630809 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f05280e5c10 con 0x7f053c10a9b0 2024-09-10T23:26:19.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.974+0000 7f053b400640 1 --2- 172.21.15.3:0/2876630809 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f05200b5440 0x7f05200b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:19.975 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.975+0000 7f053b400640 1 --2- 172.21.15.3:0/2876630809 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f05200b5440 0x7f05200b7900 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f052c009bd0 tx=0x7f052c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:19.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:19.978+0000 7f0533e00640 1 -- 172.21.15.3:0/2876630809 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f05280abe30 con 0x7f053c10a9b0 2024-09-10T23:26:20.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:20.181+0000 7f0542600640 1 -- 172.21.15.3:0/2876630809 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f053c063590 con 0x7f05200b5440 2024-09-10T23:26:20.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:20.183+0000 7f0533e00640 1 -- 172.21.15.3:0/2876630809 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f053c063590 con 0x7f05200b5440 2024-09-10T23:26:20.183 INFO:teuthology.orchestra.run.smithi003.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-10T23:26:20.183 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5330009Z400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-09-10T23:26:20.184 INFO:teuthology.orchestra.run.smithi003.stdout:smithi038 /dev/nvme0n1 ssd INTEL_SSDPEDKE040T7_BTLE736103BB4P0KGN 3726G No 3m ago Has a FileSystem, LVM detected 2024-09-10T23:26:20.184 INFO:teuthology.orchestra.run.smithi003.stdout:smithi194 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6240002A400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-10T23:26:20.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:20.186+0000 7f0542600640 1 -- 172.21.15.3:0/2876630809 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f05200b5440 msgr2=0x7f05200b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:20.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:20.186+0000 7f0542600640 1 --2- 172.21.15.3:0/2876630809 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f05200b5440 0x7f05200b7900 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f052c009bd0 tx=0x7f052c005f90 comp rx=0 tx=0).stop 2024-09-10T23:26:20.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:20.186+0000 7f0542600640 1 -- 172.21.15.3:0/2876630809 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f053c10a9b0 msgr2=0x7f053c19b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:20.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:20.186+0000 7f0542600640 1 --2- 172.21.15.3:0/2876630809 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f053c10a9b0 0x7f053c19b8b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f052800d770 tx=0x7f052800dc30 comp rx=0 tx=0).stop 2024-09-10T23:26:20.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:20.186+0000 7f0542600640 1 -- 172.21.15.3:0/2876630809 shutdown_connections 2024-09-10T23:26:20.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:20.186+0000 7f0542600640 1 --2- 172.21.15.3:0/2876630809 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f053c10b330 0x7f053c1a0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:20.186+0000 7f0542600640 1 --2- 172.21.15.3:0/2876630809 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f05200b5440 0x7f05200b7900 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:20.186+0000 7f0542600640 1 --2- 172.21.15.3:0/2876630809 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f053c10a9b0 0x7f053c19b8b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:20.186+0000 7f0542600640 1 --2- 172.21.15.3:0/2876630809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f053c104fa0 0x7f053c19b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:20.186+0000 7f0542600640 1 -- 172.21.15.3:0/2876630809 >> 172.21.15.3:0/2876630809 conn(0x7f053c100a50 msgr2=0x7f053c102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:20.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:20.186+0000 7f0542600640 1 -- 172.21.15.3:0/2876630809 shutdown_connections 2024-09-10T23:26:20.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:20.186+0000 7f0542600640 1 -- 172.21.15.3:0/2876630809 wait complete. 2024-09-10T23:26:20.192 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:20 smithi003 ceph-mon[30348]: pgmap v377: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:26:20.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:20 smithi194 ceph-mon[33904]: pgmap v377: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:26:20.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:20 smithi038 ceph-mon[34225]: pgmap v377: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:26:20.896 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T23:26:20.907 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi003.front.sepia.ceph.com 2024-09-10T23:26:20.908 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-10T23:26:21.320 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:21.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:21 smithi194 ceph-mon[33904]: from='client.15408 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:26:21.459 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:21 smithi003 ceph-mon[30348]: from='client.15408 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:26:21.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:21 smithi038 ceph-mon[34225]: from='client.15408 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:26:21.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.877+0000 7feeeac00640 1 -- 172.21.15.3:0/3641950282 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feee41087b0 msgr2=0x7feee4108bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:21.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.877+0000 7feeeac00640 1 --2- 172.21.15.3:0/3641950282 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feee41087b0 0x7feee4108bf0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7feed0009900 tx=0x7feed002a410 comp rx=0 tx=0).stop 2024-09-10T23:26:21.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.877+0000 7feeeac00640 1 -- 172.21.15.3:0/3641950282 shutdown_connections 2024-09-10T23:26:21.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.877+0000 7feeeac00640 1 --2- 172.21.15.3:0/3641950282 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feee4109130 0x7feee410f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:21.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.877+0000 7feeeac00640 1 --2- 172.21.15.3:0/3641950282 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feee41087b0 0x7feee4108bf0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:21.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.877+0000 7feeeac00640 1 --2- 172.21.15.3:0/3641950282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feee4102da0 0x7feee4103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:21.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.877+0000 7feeeac00640 1 -- 172.21.15.3:0/3641950282 >> 172.21.15.3:0/3641950282 conn(0x7feee40fe810 msgr2=0x7feee4100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:21.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.877+0000 7feeeac00640 1 -- 172.21.15.3:0/3641950282 shutdown_connections 2024-09-10T23:26:21.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.878+0000 7feeeac00640 1 -- 172.21.15.3:0/3641950282 wait complete. 2024-09-10T23:26:21.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.878+0000 7feeeac00640 1 Processor -- start 2024-09-10T23:26:21.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.879+0000 7feeeac00640 1 -- start start 2024-09-10T23:26:21.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.879+0000 7feeeac00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feee4102da0 0x7feee419b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:21.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.879+0000 7feeeac00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feee41087b0 0x7feee419b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:21.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.879+0000 7feeeac00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feee4109130 0x7feee41a0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:21.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.879+0000 7feeeac00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7feee4112cf0 con 0x7feee41087b0 2024-09-10T23:26:21.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.879+0000 7feeeac00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7feee4112b70 con 0x7feee4102da0 2024-09-10T23:26:21.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.879+0000 7feeeac00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7feee4112e70 con 0x7feee4109130 2024-09-10T23:26:21.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.879+0000 7feee3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feee41087b0 0x7feee419b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:21.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.879+0000 7feee3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feee41087b0 0x7feee419b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39696/0 (socket says 172.21.15.3:39696) 2024-09-10T23:26:21.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.879+0000 7feee3400640 1 -- 172.21.15.3:0/4112049566 learned_addr learned my addr 172.21.15.3:0/4112049566 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:21.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.879+0000 7feee8c00640 1 --2- 172.21.15.3:0/4112049566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feee4109130 0x7feee41a0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:21.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.879+0000 7feee3e00640 1 --2- 172.21.15.3:0/4112049566 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feee4102da0 0x7feee419b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:21.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.880+0000 7feee3400640 1 -- 172.21.15.3:0/4112049566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feee4109130 msgr2=0x7feee41a0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:21.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.880+0000 7feee3400640 1 --2- 172.21.15.3:0/4112049566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feee4109130 0x7feee41a0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:21.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.880+0000 7feee3400640 1 -- 172.21.15.3:0/4112049566 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feee4102da0 msgr2=0x7feee419b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:21.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.880+0000 7feee3400640 1 --2- 172.21.15.3:0/4112049566 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feee4102da0 0x7feee419b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:21.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.880+0000 7feee3400640 1 -- 172.21.15.3:0/4112049566 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee41a1440 con 0x7feee41087b0 2024-09-10T23:26:21.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.880+0000 7feee3e00640 1 --2- 172.21.15.3:0/4112049566 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feee4102da0 0x7feee419b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:21.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.880+0000 7feee3400640 1 --2- 172.21.15.3:0/4112049566 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feee41087b0 0x7feee419b8d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7feed002a930 tx=0x7feed0003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:21.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.880+0000 7feee0c00640 1 -- 172.21.15.3:0/4112049566 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed003f070 con 0x7feee41087b0 2024-09-10T23:26:21.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.880+0000 7feee0c00640 1 -- 172.21.15.3:0/4112049566 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feed0003e40 con 0x7feee41087b0 2024-09-10T23:26:21.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.880+0000 7feee0c00640 1 -- 172.21.15.3:0/4112049566 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed0035030 con 0x7feee41087b0 2024-09-10T23:26:21.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.880+0000 7feeeac00640 1 -- 172.21.15.3:0/4112049566 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feee41a16d0 con 0x7feee41087b0 2024-09-10T23:26:21.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.881+0000 7feeeac00640 1 -- 172.21.15.3:0/4112049566 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feee41a7df0 con 0x7feee41087b0 2024-09-10T23:26:21.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.882+0000 7feeeac00640 1 -- 172.21.15.3:0/4112049566 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feee4103180 con 0x7feee41087b0 2024-09-10T23:26:21.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.884+0000 7feee0c00640 1 -- 172.21.15.3:0/4112049566 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 21) ==== 153317+0+0 (secure 0 0 0) 0x7feed0031400 con 0x7feee41087b0 2024-09-10T23:26:21.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.886+0000 7feee0c00640 1 --2- 172.21.15.3:0/4112049566 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7feec80b5440 0x7feec80b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:21.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.886+0000 7feee0c00640 1 -- 172.21.15.3:0/4112049566 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7feed0106d00 con 0x7feee41087b0 2024-09-10T23:26:21.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.886+0000 7feee3e00640 1 --2- 172.21.15.3:0/4112049566 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7feec80b5440 0x7feec80b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:21.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.888+0000 7feee3e00640 1 --2- 172.21.15.3:0/4112049566 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7feec80b5440 0x7feec80b7900 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7feed4005fd0 tx=0x7feed4009520 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:21.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:21.891+0000 7feee0c00640 1 -- 172.21.15.3:0/4112049566 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7feed00cd570 con 0x7feee41087b0 2024-09-10T23:26:22.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:22.129+0000 7feeeac00640 1 -- 172.21.15.3:0/4112049566 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7feee402e5c0 con 0x7feee41087b0 2024-09-10T23:26:22.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:22.130+0000 7feee0c00640 1 -- 172.21.15.3:0/4112049566 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+3074 (secure 0 0 0) 0x7feed00cce70 con 0x7feee41087b0 2024-09-10T23:26:22.130 INFO:teuthology.orchestra.run.smithi003.stdout:e25 2024-09-10T23:26:22.130 INFO:teuthology.orchestra.run.smithi003.stdout:btime 2024-09-10T23:24:51:241992+0000 2024-09-10T23:26:22.130 INFO:teuthology.orchestra.run.smithi003.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T23:26:22.131 INFO:teuthology.orchestra.run.smithi003.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T23:26:22.131 INFO:teuthology.orchestra.run.smithi003.stdout:legacy client fscid: 1 2024-09-10T23:26:22.131 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:26:22.131 INFO:teuthology.orchestra.run.smithi003.stdout:Filesystem 'cephfs' (1) 2024-09-10T23:26:22.131 INFO:teuthology.orchestra.run.smithi003.stdout:fs_name cephfs 2024-09-10T23:26:22.131 INFO:teuthology.orchestra.run.smithi003.stdout:epoch 25 2024-09-10T23:26:22.131 INFO:teuthology.orchestra.run.smithi003.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T23:26:22.131 INFO:teuthology.orchestra.run.smithi003.stdout:created 2024-09-10T23:23:58.866253+0000 2024-09-10T23:26:22.131 INFO:teuthology.orchestra.run.smithi003.stdout:modified 2024-09-10T23:24:51.177863+0000 2024-09-10T23:26:22.131 INFO:teuthology.orchestra.run.smithi003.stdout:tableserver 0 2024-09-10T23:26:22.131 INFO:teuthology.orchestra.run.smithi003.stdout:root 0 2024-09-10T23:26:22.131 INFO:teuthology.orchestra.run.smithi003.stdout:session_timeout 300 2024-09-10T23:26:22.132 INFO:teuthology.orchestra.run.smithi003.stdout:session_autoclose 300 2024-09-10T23:26:22.132 INFO:teuthology.orchestra.run.smithi003.stdout:max_file_size 1099511627776 2024-09-10T23:26:22.132 INFO:teuthology.orchestra.run.smithi003.stdout:max_xattr_size 65536 2024-09-10T23:26:22.132 INFO:teuthology.orchestra.run.smithi003.stdout:required_client_features {} 2024-09-10T23:26:22.132 INFO:teuthology.orchestra.run.smithi003.stdout:last_failure 0 2024-09-10T23:26:22.132 INFO:teuthology.orchestra.run.smithi003.stdout:last_failure_osd_epoch 0 2024-09-10T23:26:22.132 INFO:teuthology.orchestra.run.smithi003.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T23:26:22.132 INFO:teuthology.orchestra.run.smithi003.stdout:max_mds 3 2024-09-10T23:26:22.132 INFO:teuthology.orchestra.run.smithi003.stdout:in 0,1,2 2024-09-10T23:26:22.132 INFO:teuthology.orchestra.run.smithi003.stdout:up {0=34724,1=34682,2=34652} 2024-09-10T23:26:22.132 INFO:teuthology.orchestra.run.smithi003.stdout:failed 2024-09-10T23:26:22.132 INFO:teuthology.orchestra.run.smithi003.stdout:damaged 2024-09-10T23:26:22.132 INFO:teuthology.orchestra.run.smithi003.stdout:stopped 2024-09-10T23:26:22.132 INFO:teuthology.orchestra.run.smithi003.stdout:data_pools [3,4] 2024-09-10T23:26:22.133 INFO:teuthology.orchestra.run.smithi003.stdout:metadata_pool 2 2024-09-10T23:26:22.133 INFO:teuthology.orchestra.run.smithi003.stdout:inline_data disabled 2024-09-10T23:26:22.133 INFO:teuthology.orchestra.run.smithi003.stdout:balancer 2024-09-10T23:26:22.133 INFO:teuthology.orchestra.run.smithi003.stdout:bal_rank_mask -1 2024-09-10T23:26:22.133 INFO:teuthology.orchestra.run.smithi003.stdout:standby_count_wanted 0 2024-09-10T23:26:22.133 INFO:teuthology.orchestra.run.smithi003.stdout:qdb_cluster leader: 34724 members: 34652,34682,34724 2024-09-10T23:26:22.133 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.b{0:34724} state up:active seq 5 addr [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:26:22.133 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.k{0:34619} state up:standby-replay seq 1 addr [v2:172.21.15.38:6832/1194099617,v1:172.21.15.38:6833/1194099617] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:26:22.133 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.h{1:34682} state up:active seq 21 addr [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:26:22.133 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.i{1:24673} state up:standby-replay seq 1 addr [v2:172.21.15.194:6838/3198777710,v1:172.21.15.194:6839/3198777710] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:26:22.134 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.e{2:34652} state up:active seq 24 addr [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:26:22.134 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.c{2:24649} state up:standby-replay seq 1 addr [v2:172.21.15.194:6836/739730313,v1:172.21.15.194:6837/739730313] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:26:22.134 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:26:22.134 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:26:22.134 INFO:teuthology.orchestra.run.smithi003.stdout:Standby daemons: 2024-09-10T23:26:22.134 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:26:22.134 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.j{-1:14793} state up:standby seq 1 addr [v2:172.21.15.3:6834/1495411512,v1:172.21.15.3:6835/1495411512] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:26:22.134 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.d{-1:14805} state up:standby seq 1 addr [v2:172.21.15.3:6836/1857372777,v1:172.21.15.3:6837/1857372777] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:26:22.134 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.g{-1:14862} state up:standby seq 1 addr [v2:172.21.15.3:6838/493850676,v1:172.21.15.3:6839/493850676] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:26:22.134 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.a{-1:14874} state up:standby seq 1 addr [v2:172.21.15.3:6840/1580524358,v1:172.21.15.3:6841/1580524358] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:26:22.134 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.l{-1:24592} state up:standby seq 1 addr [v2:172.21.15.194:6832/352514665,v1:172.21.15.194:6833/352514665] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:26:22.134 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.f{-1:24637} state up:standby seq 1 addr [v2:172.21.15.194:6834/2380508105,v1:172.21.15.194:6835/2380508105] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:26:22.135 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 25 2024-09-10T23:26:22.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:22.133+0000 7feeeac00640 1 -- 172.21.15.3:0/4112049566 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7feec80b5440 msgr2=0x7feec80b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:22.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:22.133+0000 7feeeac00640 1 --2- 172.21.15.3:0/4112049566 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7feec80b5440 0x7feec80b7900 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7feed4005fd0 tx=0x7feed4009520 comp rx=0 tx=0).stop 2024-09-10T23:26:22.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:22.133+0000 7feeeac00640 1 -- 172.21.15.3:0/4112049566 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feee41087b0 msgr2=0x7feee419b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:22.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:22.133+0000 7feeeac00640 1 --2- 172.21.15.3:0/4112049566 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feee41087b0 0x7feee419b8d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7feed002a930 tx=0x7feed0003c20 comp rx=0 tx=0).stop 2024-09-10T23:26:22.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:22.133+0000 7feeeac00640 1 -- 172.21.15.3:0/4112049566 shutdown_connections 2024-09-10T23:26:22.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:22.133+0000 7feeeac00640 1 --2- 172.21.15.3:0/4112049566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feee4109130 0x7feee41a0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:22.133+0000 7feeeac00640 1 --2- 172.21.15.3:0/4112049566 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7feec80b5440 0x7feec80b7900 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:22.133+0000 7feeeac00640 1 --2- 172.21.15.3:0/4112049566 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feee41087b0 0x7feee419b8d0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:22.133+0000 7feeeac00640 1 --2- 172.21.15.3:0/4112049566 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feee4102da0 0x7feee419b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:22.133+0000 7feeeac00640 1 -- 172.21.15.3:0/4112049566 >> 172.21.15.3:0/4112049566 conn(0x7feee40fe810 msgr2=0x7feee4104d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:22.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:22.134+0000 7feeeac00640 1 -- 172.21.15.3:0/4112049566 shutdown_connections 2024-09-10T23:26:22.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:22.134+0000 7feeeac00640 1 -- 172.21.15.3:0/4112049566 wait complete. 2024-09-10T23:26:22.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:22 smithi194 ceph-mon[33904]: pgmap v378: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:26:22.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:22 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/4112049566' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-10T23:26:22.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:22 smithi003 ceph-mon[30348]: pgmap v378: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:26:22.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:22 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/4112049566' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-10T23:26:22.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:22 smithi038 ceph-mon[34225]: pgmap v378: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:26:22.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:22 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/4112049566' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-10T23:26:23.047 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-10T23:26:23.449 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:24.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.028+0000 7fd90b200640 1 -- 172.21.15.3:0/1934607261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd9040754e0 msgr2=0x7fd9040758c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:24.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.028+0000 7fd90b200640 1 --2- 172.21.15.3:0/1934607261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd9040754e0 0x7fd9040758c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009900 tx=0x7fd8f802a3f0 comp rx=0 tx=0).stop 2024-09-10T23:26:24.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.029+0000 7fd90b200640 1 -- 172.21.15.3:0/1934607261 shutdown_connections 2024-09-10T23:26:24.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.029+0000 7fd90b200640 1 --2- 172.21.15.3:0/1934607261 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd90410f200 0x7fd9041115f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:24.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.029+0000 7fd90b200640 1 --2- 172.21.15.3:0/1934607261 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd904075e00 0x7fd90410ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:24.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.029+0000 7fd90b200640 1 --2- 172.21.15.3:0/1934607261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd9040754e0 0x7fd9040758c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:24.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.029+0000 7fd90b200640 1 -- 172.21.15.3:0/1934607261 >> 172.21.15.3:0/1934607261 conn(0x7fd9040fe660 msgr2=0x7fd904100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:24.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.029+0000 7fd90b200640 1 -- 172.21.15.3:0/1934607261 shutdown_connections 2024-09-10T23:26:24.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.029+0000 7fd90b200640 1 -- 172.21.15.3:0/1934607261 wait complete. 2024-09-10T23:26:24.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.030+0000 7fd90b200640 1 Processor -- start 2024-09-10T23:26:24.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.030+0000 7fd90b200640 1 -- start start 2024-09-10T23:26:24.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.030+0000 7fd90b200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd9040754e0 0x7fd90419b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:24.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.030+0000 7fd90b200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd904075e00 0x7fd90419b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:24.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.030+0000 7fd90b200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd90410f200 0x7fd9041a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:24.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.030+0000 7fd90b200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd904114ce0 con 0x7fd9040754e0 2024-09-10T23:26:24.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.030+0000 7fd90b200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd904114b60 con 0x7fd90410f200 2024-09-10T23:26:24.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.030+0000 7fd90b200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd904114e60 con 0x7fd904075e00 2024-09-10T23:26:24.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.030+0000 7fd909e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd9040754e0 0x7fd90419b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:24.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.030+0000 7fd909e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd9040754e0 0x7fd90419b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39710/0 (socket says 172.21.15.3:39710) 2024-09-10T23:26:24.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.030+0000 7fd909e00640 1 -- 172.21.15.3:0/3225391104 learned_addr learned my addr 172.21.15.3:0/3225391104 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:24.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.031+0000 7fd909400640 1 --2- 172.21.15.3:0/3225391104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd904075e00 0x7fd90419b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:24.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.031+0000 7fd90a800640 1 --2- 172.21.15.3:0/3225391104 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd90410f200 0x7fd9041a0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:24.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.031+0000 7fd909e00640 1 -- 172.21.15.3:0/3225391104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd904075e00 msgr2=0x7fd90419b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:24.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.031+0000 7fd909e00640 1 --2- 172.21.15.3:0/3225391104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd904075e00 0x7fd90419b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:24.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.031+0000 7fd909e00640 1 -- 172.21.15.3:0/3225391104 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd90410f200 msgr2=0x7fd9041a0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:24.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.031+0000 7fd909e00640 1 --2- 172.21.15.3:0/3225391104 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd90410f200 0x7fd9041a0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:24.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.031+0000 7fd909e00640 1 -- 172.21.15.3:0/3225391104 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9041a1260 con 0x7fd9040754e0 2024-09-10T23:26:24.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.031+0000 7fd909400640 1 --2- 172.21.15.3:0/3225391104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd904075e00 0x7fd90419b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:24.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.031+0000 7fd90a800640 1 --2- 172.21.15.3:0/3225391104 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd90410f200 0x7fd9041a0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:24.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.031+0000 7fd909e00640 1 --2- 172.21.15.3:0/3225391104 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd9040754e0 0x7fd90419b1b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd8f802a910 tx=0x7fd8f8003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:24.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.031+0000 7fd8fea00640 1 -- 172.21.15.3:0/3225391104 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f803f070 con 0x7fd9040754e0 2024-09-10T23:26:24.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.032+0000 7fd8fea00640 1 -- 172.21.15.3:0/3225391104 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8f803baf0 con 0x7fd9040754e0 2024-09-10T23:26:24.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.032+0000 7fd90b200640 1 -- 172.21.15.3:0/3225391104 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9041a14f0 con 0x7fd9040754e0 2024-09-10T23:26:24.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.032+0000 7fd8fea00640 1 -- 172.21.15.3:0/3225391104 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8035030 con 0x7fd9040754e0 2024-09-10T23:26:24.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.032+0000 7fd90b200640 1 -- 172.21.15.3:0/3225391104 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9041a7c10 con 0x7fd9040754e0 2024-09-10T23:26:24.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.033+0000 7fd90b200640 1 -- 172.21.15.3:0/3225391104 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9040758c0 con 0x7fd9040754e0 2024-09-10T23:26:24.035 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.035+0000 7fd8fea00640 1 -- 172.21.15.3:0/3225391104 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 22) ==== 153266+0+0 (secure 0 0 0) 0x7fd8f803b660 con 0x7fd9040754e0 2024-09-10T23:26:24.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.038+0000 7fd8fea00640 1 --2- 172.21.15.3:0/3225391104 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd8ec0b5460 0x7fd8ec0b7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:24.038 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.038+0000 7fd8fea00640 1 -- 172.21.15.3:0/3225391104 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7fd8f8106f50 con 0x7fd9040754e0 2024-09-10T23:26:24.038 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.038+0000 7fd909400640 1 --2- 172.21.15.3:0/3225391104 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd8ec0b5460 0x7fd8ec0b7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:24.038 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.039+0000 7fd909400640 1 --2- 172.21.15.3:0/3225391104 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd8ec0b5460 0x7fd8ec0b7920 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd904100e00 tx=0x7fd8f4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:24.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.040+0000 7fd8fea00640 1 -- 172.21.15.3:0/3225391104 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd8f80cd920 con 0x7fd9040754e0 2024-09-10T23:26:24.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.237+0000 7fd90b200640 1 -- 172.21.15.3:0/3225391104 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fd9041a7f00 con 0x7fd9040754e0 2024-09-10T23:26:24.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.238+0000 7fd8fea00640 1 -- 172.21.15.3:0/3225391104 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v90) ==== 56+0+6020 (secure 0 0 0) 0x7fd8f80d60d0 con 0x7fd9040754e0 2024-09-10T23:26:24.239 INFO:teuthology.orchestra.run.smithi003.stdout:epoch 90 2024-09-10T23:26:24.239 INFO:teuthology.orchestra.run.smithi003.stdout:fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:26:24.239 INFO:teuthology.orchestra.run.smithi003.stdout:created 2024-09-10T23:14:12.377466+0000 2024-09-10T23:26:24.239 INFO:teuthology.orchestra.run.smithi003.stdout:modified 2024-09-10T23:25:22.134690+0000 2024-09-10T23:26:24.239 INFO:teuthology.orchestra.run.smithi003.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-10T23:26:24.239 INFO:teuthology.orchestra.run.smithi003.stdout:crush_version 27 2024-09-10T23:26:24.239 INFO:teuthology.orchestra.run.smithi003.stdout:full_ratio 0.95 2024-09-10T23:26:24.239 INFO:teuthology.orchestra.run.smithi003.stdout:backfillfull_ratio 0.9 2024-09-10T23:26:24.239 INFO:teuthology.orchestra.run.smithi003.stdout:nearfull_ratio 0.85 2024-09-10T23:26:24.240 INFO:teuthology.orchestra.run.smithi003.stdout:require_min_compat_client luminous 2024-09-10T23:26:24.240 INFO:teuthology.orchestra.run.smithi003.stdout:min_compat_client luminous 2024-09-10T23:26:24.240 INFO:teuthology.orchestra.run.smithi003.stdout:require_osd_release squid 2024-09-10T23:26:24.240 INFO:teuthology.orchestra.run.smithi003.stdout:stretch_mode_enabled false 2024-09-10T23:26:24.240 INFO:teuthology.orchestra.run.smithi003.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-10T23:26:24.240 INFO:teuthology.orchestra.run.smithi003.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 79 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-10T23:26:24.240 INFO:teuthology.orchestra.run.smithi003.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 79 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-10T23:26:24.240 INFO:teuthology.orchestra.run.smithi003.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 86 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-10T23:26:24.240 INFO:teuthology.orchestra.run.smithi003.stdout:max_osd 12 2024-09-10T23:26:24.240 INFO:teuthology.orchestra.run.smithi003.stdout:osd.0 up in weight 1 up_from 9 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.3:6802/824467747,v1:172.21.15.3:6803/824467747] [v2:172.21.15.3:6804/824467747,v1:172.21.15.3:6805/824467747] exists,up a38330ed-a85b-4e61-b373-dd8f1d5f7ba4 2024-09-10T23:26:24.240 INFO:teuthology.orchestra.run.smithi003.stdout:osd.1 up in weight 1 up_from 14 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.38:6800/1447444485,v1:172.21.15.38:6801/1447444485] [v2:172.21.15.38:6802/1447444485,v1:172.21.15.38:6803/1447444485] exists,up 49bb1212-a83e-4f85-ad71-d863880d8268 2024-09-10T23:26:24.240 INFO:teuthology.orchestra.run.smithi003.stdout:osd.2 up in weight 1 up_from 19 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6800/3191263316,v1:172.21.15.194:6801/3191263316] [v2:172.21.15.194:6802/3191263316,v1:172.21.15.194:6803/3191263316] exists,up ea53eb27-e7fa-4783-9a53-8b44b4e293ab 2024-09-10T23:26:24.240 INFO:teuthology.orchestra.run.smithi003.stdout:osd.3 up in weight 1 up_from 26 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.3:6810/2061990952,v1:172.21.15.3:6811/2061990952] [v2:172.21.15.3:6812/2061990952,v1:172.21.15.3:6813/2061990952] exists,up 75067769-7be5-4a99-9e02-f7735b2e69c6 2024-09-10T23:26:24.241 INFO:teuthology.orchestra.run.smithi003.stdout:osd.4 up in weight 1 up_from 32 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.38:6808/413294160,v1:172.21.15.38:6809/413294160] [v2:172.21.15.38:6810/413294160,v1:172.21.15.38:6811/413294160] exists,up 872e90ca-b711-4206-b586-e7fa41122199 2024-09-10T23:26:24.241 INFO:teuthology.orchestra.run.smithi003.stdout:osd.5 up in weight 1 up_from 37 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6808/4117812658,v1:172.21.15.194:6809/4117812658] [v2:172.21.15.194:6810/4117812658,v1:172.21.15.194:6811/4117812658] exists,up 2cfa107c-6dae-4c26-9e29-8175b1237b31 2024-09-10T23:26:24.241 INFO:teuthology.orchestra.run.smithi003.stdout:osd.6 up in weight 1 up_from 43 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.3:6818/3470543721,v1:172.21.15.3:6819/3470543721] [v2:172.21.15.3:6820/3470543721,v1:172.21.15.3:6821/3470543721] exists,up d2e4e309-c587-4725-a5b3-cbc7b1226750 2024-09-10T23:26:24.241 INFO:teuthology.orchestra.run.smithi003.stdout:osd.7 up in weight 1 up_from 48 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.38:6816/2054203924,v1:172.21.15.38:6817/2054203924] [v2:172.21.15.38:6818/2054203924,v1:172.21.15.38:6819/2054203924] exists,up 46ecaec5-29da-4e1d-ac2f-42bbbd77e949 2024-09-10T23:26:24.241 INFO:teuthology.orchestra.run.smithi003.stdout:osd.8 up in weight 1 up_from 54 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6816/170051722,v1:172.21.15.194:6817/170051722] [v2:172.21.15.194:6818/170051722,v1:172.21.15.194:6819/170051722] exists,up 57fd8e43-9612-4f74-8eb2-8bdbbf7c0417 2024-09-10T23:26:24.241 INFO:teuthology.orchestra.run.smithi003.stdout:osd.9 up in weight 1 up_from 60 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.3:6826/3967749600,v1:172.21.15.3:6827/3967749600] [v2:172.21.15.3:6828/3967749600,v1:172.21.15.3:6829/3967749600] exists,up aeaaf23b-d2e2-4e30-9a49-de4aaba53900 2024-09-10T23:26:24.241 INFO:teuthology.orchestra.run.smithi003.stdout:osd.10 up in weight 1 up_from 65 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.38:6824/1671957178,v1:172.21.15.38:6825/1671957178] [v2:172.21.15.38:6826/1671957178,v1:172.21.15.38:6827/1671957178] exists,up b0ece81b-1c5b-40da-b579-fb99bacb005d 2024-09-10T23:26:24.241 INFO:teuthology.orchestra.run.smithi003.stdout:osd.11 up in weight 1 up_from 71 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6824/1048859686,v1:172.21.15.194:6825/1048859686] [v2:172.21.15.194:6826/1048859686,v1:172.21.15.194:6827/1048859686] exists,up a0036526-54bf-4e8b-95cc-e7b75725961c 2024-09-10T23:26:24.241 INFO:teuthology.orchestra.run.smithi003.stdout:pg_upmap_items 2.0 [8,1] 2024-09-10T23:26:24.241 INFO:teuthology.orchestra.run.smithi003.stdout:pg_upmap_items 2.e [2,4] 2024-09-10T23:26:24.241 INFO:teuthology.orchestra.run.smithi003.stdout:pg_upmap_items 2.13 [2,11] 2024-09-10T23:26:24.241 INFO:teuthology.orchestra.run.smithi003.stdout:pg_upmap_items 2.1c [8,11] 2024-09-10T23:26:24.241 INFO:teuthology.orchestra.run.smithi003.stdout:pg_upmap_items 3.6 [4,7] 2024-09-10T23:26:24.242 INFO:teuthology.orchestra.run.smithi003.stdout:pg_upmap_items 3.e [5,9] 2024-09-10T23:26:24.242 INFO:teuthology.orchestra.run.smithi003.stdout:pg_upmap_items 3.1d [4,8] 2024-09-10T23:26:24.242 INFO:teuthology.orchestra.run.smithi003.stdout:pg_upmap_items 3.21 [4,6,5,9] 2024-09-10T23:26:24.242 INFO:teuthology.orchestra.run.smithi003.stdout:pg_upmap_items 3.29 [3,9] 2024-09-10T23:26:24.242 INFO:teuthology.orchestra.run.smithi003.stdout:pg_upmap_items 4.6 [9,11] 2024-09-10T23:26:24.242 INFO:teuthology.orchestra.run.smithi003.stdout:pg_upmap_items 4.e [5,8] 2024-09-10T23:26:24.242 INFO:teuthology.orchestra.run.smithi003.stdout:pg_upmap_items 4.14 [9,8] 2024-09-10T23:26:24.242 INFO:teuthology.orchestra.run.smithi003.stdout:pg_upmap_items 4.17 [9,10] 2024-09-10T23:26:24.242 INFO:teuthology.orchestra.run.smithi003.stdout:blocklist 172.21.15.3:0/776988825 expires 2024-09-11T23:16:20.647314+0000 2024-09-10T23:26:24.242 INFO:teuthology.orchestra.run.smithi003.stdout:blocklist 172.21.15.3:0/2965090335 expires 2024-09-11T23:14:37.169991+0000 2024-09-10T23:26:24.242 INFO:teuthology.orchestra.run.smithi003.stdout:blocklist 172.21.15.3:0/2364823868 expires 2024-09-11T23:14:37.169991+0000 2024-09-10T23:26:24.242 INFO:teuthology.orchestra.run.smithi003.stdout:blocklist 172.21.15.3:0/3186881356 expires 2024-09-11T23:14:37.169991+0000 2024-09-10T23:26:24.242 INFO:teuthology.orchestra.run.smithi003.stdout:blocklist 172.21.15.3:0/911991463 expires 2024-09-11T23:16:20.647314+0000 2024-09-10T23:26:24.242 INFO:teuthology.orchestra.run.smithi003.stdout:blocklist 172.21.15.3:6800/2582365069 expires 2024-09-11T23:14:37.169991+0000 2024-09-10T23:26:24.242 INFO:teuthology.orchestra.run.smithi003.stdout:blocklist 172.21.15.3:6801/2582365069 expires 2024-09-11T23:14:37.169991+0000 2024-09-10T23:26:24.243 INFO:teuthology.orchestra.run.smithi003.stdout:blocklist 172.21.15.3:6801/1528153492 expires 2024-09-11T23:15:05.835734+0000 2024-09-10T23:26:24.243 INFO:teuthology.orchestra.run.smithi003.stdout:blocklist 172.21.15.3:6800/1924113958 expires 2024-09-11T23:16:20.647314+0000 2024-09-10T23:26:24.243 INFO:teuthology.orchestra.run.smithi003.stdout:blocklist 172.21.15.3:0/554479543 expires 2024-09-11T23:15:05.835734+0000 2024-09-10T23:26:24.243 INFO:teuthology.orchestra.run.smithi003.stdout:blocklist 172.21.15.3:0/4238683346 expires 2024-09-11T23:15:05.835734+0000 2024-09-10T23:26:24.243 INFO:teuthology.orchestra.run.smithi003.stdout:blocklist 172.21.15.3:6800/1528153492 expires 2024-09-11T23:15:05.835734+0000 2024-09-10T23:26:24.243 INFO:teuthology.orchestra.run.smithi003.stdout:blocklist 172.21.15.3:0/285471483 expires 2024-09-11T23:15:05.835734+0000 2024-09-10T23:26:24.243 INFO:teuthology.orchestra.run.smithi003.stdout:blocklist 172.21.15.3:0/1249510760 expires 2024-09-11T23:16:20.647314+0000 2024-09-10T23:26:24.243 INFO:teuthology.orchestra.run.smithi003.stdout:blocklist 172.21.15.3:6801/1924113958 expires 2024-09-11T23:16:20.647314+0000 2024-09-10T23:26:24.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.240+0000 7fd90b200640 1 -- 172.21.15.3:0/3225391104 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd8ec0b5460 msgr2=0x7fd8ec0b7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:24.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.240+0000 7fd90b200640 1 --2- 172.21.15.3:0/3225391104 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd8ec0b5460 0x7fd8ec0b7920 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd904100e00 tx=0x7fd8f4005f90 comp rx=0 tx=0).stop 2024-09-10T23:26:24.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.240+0000 7fd90b200640 1 -- 172.21.15.3:0/3225391104 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd9040754e0 msgr2=0x7fd90419b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:24.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.240+0000 7fd90b200640 1 --2- 172.21.15.3:0/3225391104 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd9040754e0 0x7fd90419b1b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd8f802a910 tx=0x7fd8f8003b90 comp rx=0 tx=0).stop 2024-09-10T23:26:24.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.241+0000 7fd90b200640 1 -- 172.21.15.3:0/3225391104 shutdown_connections 2024-09-10T23:26:24.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.241+0000 7fd90b200640 1 --2- 172.21.15.3:0/3225391104 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd90410f200 0x7fd9041a0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:24.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.241+0000 7fd90b200640 1 --2- 172.21.15.3:0/3225391104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd904075e00 0x7fd90419b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:24.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.241+0000 7fd90b200640 1 --2- 172.21.15.3:0/3225391104 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd8ec0b5460 0x7fd8ec0b7920 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:24.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.241+0000 7fd90b200640 1 --2- 172.21.15.3:0/3225391104 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd9040754e0 0x7fd90419b1b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:24.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.241+0000 7fd90b200640 1 -- 172.21.15.3:0/3225391104 >> 172.21.15.3:0/3225391104 conn(0x7fd9040fe660 msgr2=0x7fd9041113b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:24.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.241+0000 7fd90b200640 1 -- 172.21.15.3:0/3225391104 shutdown_connections 2024-09-10T23:26:24.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:24.241+0000 7fd90b200640 1 -- 172.21.15.3:0/3225391104 wait complete. 2024-09-10T23:26:24.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:24 smithi003 ceph-mon[30348]: pgmap v379: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-10T23:26:24.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:24 smithi003 ceph-mon[30348]: mgrmap e22: x(active, since 10m), standbys: z, y 2024-09-10T23:26:24.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:24 smithi038 ceph-mon[34225]: pgmap v379: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-10T23:26:24.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:24 smithi038 ceph-mon[34225]: mgrmap e22: x(active, since 10m), standbys: z, y 2024-09-10T23:26:24.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:24 smithi194 ceph-mon[33904]: pgmap v379: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-10T23:26:24.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:24 smithi194 ceph-mon[33904]: mgrmap e22: x(active, since 10m), standbys: z, y 2024-09-10T23:26:25.064 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-10T23:26:25.075 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:26:25.458 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:25.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:25 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3225391104' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-10T23:26:25.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:25 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3225391104' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-10T23:26:25.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:25 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3225391104' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-10T23:26:26.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.068+0000 7ff79bc00640 1 -- 172.21.15.3:0/4288913094 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff794109130 msgr2=0x7ff79410f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:26.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.068+0000 7ff79bc00640 1 --2- 172.21.15.3:0/4288913094 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff794109130 0x7ff79410f930 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff78c009ca0 tx=0x7ff78c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.068+0000 7ff79bc00640 1 -- 172.21.15.3:0/4288913094 shutdown_connections 2024-09-10T23:26:26.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.068+0000 7ff79bc00640 1 --2- 172.21.15.3:0/4288913094 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff794109130 0x7ff79410f930 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.068+0000 7ff79bc00640 1 --2- 172.21.15.3:0/4288913094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7941087b0 0x7ff794108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.068+0000 7ff79bc00640 1 --2- 172.21.15.3:0/4288913094 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff794102da0 0x7ff794103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.068+0000 7ff79bc00640 1 -- 172.21.15.3:0/4288913094 >> 172.21.15.3:0/4288913094 conn(0x7ff7940fe810 msgr2=0x7ff794100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:26.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.068+0000 7ff79bc00640 1 -- 172.21.15.3:0/4288913094 shutdown_connections 2024-09-10T23:26:26.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.068+0000 7ff79bc00640 1 -- 172.21.15.3:0/4288913094 wait complete. 2024-09-10T23:26:26.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.069+0000 7ff79bc00640 1 Processor -- start 2024-09-10T23:26:26.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.069+0000 7ff79bc00640 1 -- start start 2024-09-10T23:26:26.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.069+0000 7ff79bc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff794102da0 0x7ff794109920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:26.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.069+0000 7ff79bc00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff7941087b0 0x7ff794109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:26.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.069+0000 7ff79bc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff794109130 0x7ff79410a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:26.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.069+0000 7ff79bc00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff794112cf0 con 0x7ff794109130 2024-09-10T23:26:26.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.069+0000 7ff79bc00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff794112b70 con 0x7ff7941087b0 2024-09-10T23:26:26.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.069+0000 7ff79bc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff794112e70 con 0x7ff794102da0 2024-09-10T23:26:26.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.070+0000 7ff799c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff794109130 0x7ff79410a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:26.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.070+0000 7ff799c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff794109130 0x7ff79410a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39718/0 (socket says 172.21.15.3:39718) 2024-09-10T23:26:26.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.070+0000 7ff799c00640 1 -- 172.21.15.3:0/362241151 learned_addr learned my addr 172.21.15.3:0/362241151 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:26.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.070+0000 7ff799200640 1 --2- 172.21.15.3:0/362241151 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff794102da0 0x7ff794109920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:26.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.070+0000 7ff793e00640 1 --2- 172.21.15.3:0/362241151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff7941087b0 0x7ff794109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:26.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.070+0000 7ff799c00640 1 -- 172.21.15.3:0/362241151 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff794102da0 msgr2=0x7ff794109920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:26.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.070+0000 7ff799c00640 1 --2- 172.21.15.3:0/362241151 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff794102da0 0x7ff794109920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.070+0000 7ff799c00640 1 -- 172.21.15.3:0/362241151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff7941087b0 msgr2=0x7ff794109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:26.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.070+0000 7ff799c00640 1 --2- 172.21.15.3:0/362241151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff7941087b0 0x7ff794109e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.070+0000 7ff799c00640 1 -- 172.21.15.3:0/362241151 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7941ab8a0 con 0x7ff794109130 2024-09-10T23:26:26.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.071+0000 7ff799c00640 1 --2- 172.21.15.3:0/362241151 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff794109130 0x7ff79410a3a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff78c005e30 tx=0x7ff78c0093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:26.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.071+0000 7ff791600640 1 -- 172.21.15.3:0/362241151 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78c032d10 con 0x7ff794109130 2024-09-10T23:26:26.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.071+0000 7ff79bc00640 1 -- 172.21.15.3:0/362241151 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7941abb30 con 0x7ff794109130 2024-09-10T23:26:26.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.071+0000 7ff791600640 1 -- 172.21.15.3:0/362241151 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff78c032eb0 con 0x7ff794109130 2024-09-10T23:26:26.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.071+0000 7ff79bc00640 1 -- 172.21.15.3:0/362241151 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7941ac070 con 0x7ff794109130 2024-09-10T23:26:26.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.071+0000 7ff791600640 1 -- 172.21.15.3:0/362241151 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78c030a00 con 0x7ff794109130 2024-09-10T23:26:26.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.072+0000 7ff79bc00640 1 -- 172.21.15.3:0/362241151 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff794103180 con 0x7ff794109130 2024-09-10T23:26:26.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.074+0000 7ff791600640 1 -- 172.21.15.3:0/362241151 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 22) ==== 153266+0+0 (secure 0 0 0) 0x7ff78c030ba0 con 0x7ff794109130 2024-09-10T23:26:26.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.077+0000 7ff791600640 1 --2- 172.21.15.3:0/362241151 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff77c0b5330 0x7ff77c0b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:26.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.077+0000 7ff791600640 1 -- 172.21.15.3:0/362241151 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7ff78c107480 con 0x7ff794109130 2024-09-10T23:26:26.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.077+0000 7ff799200640 1 --2- 172.21.15.3:0/362241151 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff77c0b5330 0x7ff77c0b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:26.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.078+0000 7ff799200640 1 --2- 172.21.15.3:0/362241151 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff77c0b5330 0x7ff77c0b77f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff788009bd0 tx=0x7ff788005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:26.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.081+0000 7ff791600640 1 -- 172.21.15.3:0/362241151 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff78c0cde50 con 0x7ff794109130 2024-09-10T23:26:26.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.320+0000 7ff79bc00640 1 -- 172.21.15.3:0/362241151 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff79402e5c0 con 0x7ff794109130 2024-09-10T23:26:26.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.320+0000 7ff791600640 1 -- 172.21.15.3:0/362241151 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11891 (secure 0 0 0) 0x7ff78c0cd750 con 0x7ff794109130 2024-09-10T23:26:26.321 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:26:26.321 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":25,"btime":"2024-09-10T23:24:51:241992+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/1495411512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":1495411512},{"type":"v1","addr":"172.21.15.3:6835","nonce":1495411512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/1857372777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1857372777},{"type":"v1","addr":"172.21.15.3:6837","nonce":1857372777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14862,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6839/493850676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":493850676},{"type":"v1","addr":"172.21.15.3:6839","nonce":493850676}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14874,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6841/1580524358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":1580524358},{"type":"v1","addr":"172.21.15.3:6841","nonce":1580524358}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/352514665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":352514665},{"type":"v1","addr":"172.21.15.194:6833","nonce":352514665}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2380508105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2380508105},{"type":"v1","addr":"172.21.15.194:6835","nonce":2380508105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:23:58.866253+0000","modified":"2024-09-10T23:24:51.177863+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34724,"mds_1":34682,"mds_2":34652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24649":{"gid":24649,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/739730313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":739730313},{"type":"v1","addr":"172.21.15.194:6837","nonce":739730313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/3198777710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3198777710},{"type":"v1","addr":"172.21.15.194:6839","nonce":3198777710}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34619":{"gid":34619,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6833/1194099617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1194099617},{"type":"v1","addr":"172.21.15.38:6833","nonce":1194099617}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34652":{"gid":34652,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.38:6835/218783320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":218783320},{"type":"v1","addr":"172.21.15.38:6835","nonce":218783320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34682":{"gid":34682,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":21,"addr":"172.21.15.38:6837/1821839397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":1821839397},{"type":"v1","addr":"172.21.15.38:6837","nonce":1821839397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34724":{"gid":34724,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.38:6839/458259815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":458259815},{"type":"v1","addr":"172.21.15.38:6839","nonce":458259815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34724,"qdb_cluster":[34652,34682,34724]},"id":1}]} 2024-09-10T23:26:26.322 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 25 2024-09-10T23:26:26.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.323+0000 7ff79bc00640 1 -- 172.21.15.3:0/362241151 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff77c0b5330 msgr2=0x7ff77c0b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:26.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.323+0000 7ff79bc00640 1 --2- 172.21.15.3:0/362241151 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff77c0b5330 0x7ff77c0b77f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff788009bd0 tx=0x7ff788005f90 comp rx=0 tx=0).stop 2024-09-10T23:26:26.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.323+0000 7ff79bc00640 1 -- 172.21.15.3:0/362241151 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff794109130 msgr2=0x7ff79410a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:26.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.323+0000 7ff79bc00640 1 --2- 172.21.15.3:0/362241151 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff794109130 0x7ff79410a3a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff78c005e30 tx=0x7ff78c0093d0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.323+0000 7ff79bc00640 1 -- 172.21.15.3:0/362241151 shutdown_connections 2024-09-10T23:26:26.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.323+0000 7ff79bc00640 1 --2- 172.21.15.3:0/362241151 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff77c0b5330 0x7ff77c0b77f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.323+0000 7ff79bc00640 1 --2- 172.21.15.3:0/362241151 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff794109130 0x7ff79410a3a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.323+0000 7ff79bc00640 1 --2- 172.21.15.3:0/362241151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff7941087b0 0x7ff794109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.323+0000 7ff79bc00640 1 --2- 172.21.15.3:0/362241151 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff794102da0 0x7ff794109920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.323+0000 7ff79bc00640 1 -- 172.21.15.3:0/362241151 >> 172.21.15.3:0/362241151 conn(0x7ff7940fe810 msgr2=0x7ff794104d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:26.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.323+0000 7ff79bc00640 1 -- 172.21.15.3:0/362241151 shutdown_connections 2024-09-10T23:26:26.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:26.323+0000 7ff79bc00640 1 -- 172.21.15.3:0/362241151 wait complete. 2024-09-10T23:26:26.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:26 smithi003 ceph-mon[30348]: pgmap v380: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-10T23:26:26.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:26 smithi038 ceph-mon[34225]: pgmap v380: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-10T23:26:26.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:26 smithi194 ceph-mon[33904]: pgmap v380: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-10T23:26:27.184 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:26:27.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:27 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/362241151' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:26:27.564 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:27.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:27 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/362241151' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:26:27.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:27 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/362241151' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:26:28.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.136+0000 7fce09000640 1 -- 172.21.15.3:0/244463828 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce04102da0 msgr2=0x7fce04103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:28.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.136+0000 7fce09000640 1 --2- 172.21.15.3:0/244463828 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce04102da0 0x7fce04103180 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4009900 tx=0x7fcdf402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:26:28.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.136+0000 7fce09000640 1 -- 172.21.15.3:0/244463828 shutdown_connections 2024-09-10T23:26:28.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.136+0000 7fce09000640 1 --2- 172.21.15.3:0/244463828 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce04109130 0x7fce0410f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:28.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.136+0000 7fce09000640 1 --2- 172.21.15.3:0/244463828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce041087b0 0x7fce04108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:28.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.136+0000 7fce09000640 1 --2- 172.21.15.3:0/244463828 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce04102da0 0x7fce04103180 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:28.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.136+0000 7fce09000640 1 -- 172.21.15.3:0/244463828 >> 172.21.15.3:0/244463828 conn(0x7fce040fe810 msgr2=0x7fce04100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:28.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.136+0000 7fce09000640 1 -- 172.21.15.3:0/244463828 shutdown_connections 2024-09-10T23:26:28.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.136+0000 7fce09000640 1 -- 172.21.15.3:0/244463828 wait complete. 2024-09-10T23:26:28.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.137+0000 7fce09000640 1 Processor -- start 2024-09-10T23:26:28.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.137+0000 7fce09000640 1 -- start start 2024-09-10T23:26:28.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.137+0000 7fce09000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce04102da0 0x7fce04076f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:28.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.138+0000 7fce09000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce041087b0 0x7fce040754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:28.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.138+0000 7fce09000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce04109130 0x7fce04075ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:28.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.138+0000 7fce09000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fce04112c60 con 0x7fce04109130 2024-09-10T23:26:28.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.138+0000 7fce09000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fce04112ae0 con 0x7fce041087b0 2024-09-10T23:26:28.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.138+0000 7fce09000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fce04112de0 con 0x7fce04102da0 2024-09-10T23:26:28.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.138+0000 7fce02800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce04109130 0x7fce04075ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:28.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.138+0000 7fce02800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce04109130 0x7fce04075ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39742/0 (socket says 172.21.15.3:39742) 2024-09-10T23:26:28.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.138+0000 7fce02800640 1 -- 172.21.15.3:0/3646646276 learned_addr learned my addr 172.21.15.3:0/3646646276 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:28.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.138+0000 7fce01e00640 1 --2- 172.21.15.3:0/3646646276 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce04102da0 0x7fce04076f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:28.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.138+0000 7fce01400640 1 --2- 172.21.15.3:0/3646646276 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce041087b0 0x7fce040754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:28.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.138+0000 7fce02800640 1 -- 172.21.15.3:0/3646646276 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce04102da0 msgr2=0x7fce04076f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:28.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.138+0000 7fce02800640 1 --2- 172.21.15.3:0/3646646276 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce04102da0 0x7fce04076f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:28.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.138+0000 7fce02800640 1 -- 172.21.15.3:0/3646646276 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce041087b0 msgr2=0x7fce040754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:28.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.138+0000 7fce02800640 1 --2- 172.21.15.3:0/3646646276 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce041087b0 0x7fce040754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:28.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.138+0000 7fce02800640 1 -- 172.21.15.3:0/3646646276 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce041abb50 con 0x7fce04109130 2024-09-10T23:26:28.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.139+0000 7fce02800640 1 --2- 172.21.15.3:0/3646646276 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce04109130 0x7fce04075ad0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00eaa0 tx=0x7fcdfc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:28.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.139+0000 7fcdfaa00640 1 -- 172.21.15.3:0/3646646276 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc00cdb0 con 0x7fce04109130 2024-09-10T23:26:28.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.139+0000 7fcdfaa00640 1 -- 172.21.15.3:0/3646646276 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcdfc005020 con 0x7fce04109130 2024-09-10T23:26:28.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.139+0000 7fce09000640 1 -- 172.21.15.3:0/3646646276 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce041abd20 con 0x7fce04109130 2024-09-10T23:26:28.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.139+0000 7fcdfaa00640 1 -- 172.21.15.3:0/3646646276 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc0116d0 con 0x7fce04109130 2024-09-10T23:26:28.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.139+0000 7fce09000640 1 -- 172.21.15.3:0/3646646276 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce041ac1d0 con 0x7fce04109130 2024-09-10T23:26:28.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.140+0000 7fce09000640 1 -- 172.21.15.3:0/3646646276 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce04103180 con 0x7fce04109130 2024-09-10T23:26:28.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.142+0000 7fcdfaa00640 1 -- 172.21.15.3:0/3646646276 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 22) ==== 153266+0+0 (secure 0 0 0) 0x7fcdfc00f040 con 0x7fce04109130 2024-09-10T23:26:28.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.144+0000 7fcdfaa00640 1 --2- 172.21.15.3:0/3646646276 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcde80b53b0 0x7fcde80b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:28.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.144+0000 7fcdfaa00640 1 -- 172.21.15.3:0/3646646276 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7fcdfc0e61c0 con 0x7fce04109130 2024-09-10T23:26:28.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.144+0000 7fce01e00640 1 --2- 172.21.15.3:0/3646646276 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcde80b53b0 0x7fcde80b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:28.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.145+0000 7fce01e00640 1 --2- 172.21.15.3:0/3646646276 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcde80b53b0 0x7fcde80b7870 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcdf40057c0 tx=0x7fcdf40058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:28.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.148+0000 7fcdfaa00640 1 -- 172.21.15.3:0/3646646276 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcdfc016030 con 0x7fce04109130 2024-09-10T23:26:28.381 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.380+0000 7fce09000640 1 -- 172.21.15.3:0/3646646276 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce0402e5c0 con 0x7fce04109130 2024-09-10T23:26:28.381 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:28 smithi003 ceph-mon[30348]: pgmap v381: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-10T23:26:28.382 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.381+0000 7fcdfaa00640 1 -- 172.21.15.3:0/3646646276 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11891 (secure 0 0 0) 0x7fcdfc0ac540 con 0x7fce04109130 2024-09-10T23:26:28.382 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:26:28.382 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":25,"btime":"2024-09-10T23:24:51:241992+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/1495411512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":1495411512},{"type":"v1","addr":"172.21.15.3:6835","nonce":1495411512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/1857372777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1857372777},{"type":"v1","addr":"172.21.15.3:6837","nonce":1857372777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14862,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6839/493850676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":493850676},{"type":"v1","addr":"172.21.15.3:6839","nonce":493850676}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14874,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6841/1580524358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":1580524358},{"type":"v1","addr":"172.21.15.3:6841","nonce":1580524358}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/352514665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":352514665},{"type":"v1","addr":"172.21.15.194:6833","nonce":352514665}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2380508105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2380508105},{"type":"v1","addr":"172.21.15.194:6835","nonce":2380508105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:23:58.866253+0000","modified":"2024-09-10T23:24:51.177863+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34724,"mds_1":34682,"mds_2":34652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24649":{"gid":24649,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/739730313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":739730313},{"type":"v1","addr":"172.21.15.194:6837","nonce":739730313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/3198777710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3198777710},{"type":"v1","addr":"172.21.15.194:6839","nonce":3198777710}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34619":{"gid":34619,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6833/1194099617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1194099617},{"type":"v1","addr":"172.21.15.38:6833","nonce":1194099617}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34652":{"gid":34652,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.38:6835/218783320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":218783320},{"type":"v1","addr":"172.21.15.38:6835","nonce":218783320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34682":{"gid":34682,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":21,"addr":"172.21.15.38:6837/1821839397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":1821839397},{"type":"v1","addr":"172.21.15.38:6837","nonce":1821839397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34724":{"gid":34724,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.38:6839/458259815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":458259815},{"type":"v1","addr":"172.21.15.38:6839","nonce":458259815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34724,"qdb_cluster":[34652,34682,34724]},"id":1}]} 2024-09-10T23:26:28.383 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 25 2024-09-10T23:26:28.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.384+0000 7fce09000640 1 -- 172.21.15.3:0/3646646276 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcde80b53b0 msgr2=0x7fcde80b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:28.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.384+0000 7fce09000640 1 --2- 172.21.15.3:0/3646646276 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcde80b53b0 0x7fcde80b7870 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcdf40057c0 tx=0x7fcdf40058d0 comp rx=0 tx=0).stop 2024-09-10T23:26:28.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.384+0000 7fce09000640 1 -- 172.21.15.3:0/3646646276 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce04109130 msgr2=0x7fce04075ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:28.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.384+0000 7fce09000640 1 --2- 172.21.15.3:0/3646646276 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce04109130 0x7fce04075ad0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00eaa0 tx=0x7fcdfc00ef60 comp rx=0 tx=0).stop 2024-09-10T23:26:28.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.384+0000 7fce09000640 1 -- 172.21.15.3:0/3646646276 shutdown_connections 2024-09-10T23:26:28.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.384+0000 7fce09000640 1 --2- 172.21.15.3:0/3646646276 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcde80b53b0 0x7fcde80b7870 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:28.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.384+0000 7fce09000640 1 --2- 172.21.15.3:0/3646646276 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce04109130 0x7fce04075ad0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:28.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.384+0000 7fce09000640 1 --2- 172.21.15.3:0/3646646276 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce041087b0 0x7fce040754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:28.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.384+0000 7fce09000640 1 --2- 172.21.15.3:0/3646646276 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce04102da0 0x7fce04076f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:28.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.384+0000 7fce09000640 1 -- 172.21.15.3:0/3646646276 >> 172.21.15.3:0/3646646276 conn(0x7fce040fe810 msgr2=0x7fce04100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:28.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.384+0000 7fce09000640 1 -- 172.21.15.3:0/3646646276 shutdown_connections 2024-09-10T23:26:28.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:28.384+0000 7fce09000640 1 -- 172.21.15.3:0/3646646276 wait complete. 2024-09-10T23:26:28.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:28 smithi038 ceph-mon[34225]: pgmap v381: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-10T23:26:28.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:28 smithi194 ceph-mon[33904]: pgmap v381: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-10T23:26:29.122 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:26:29.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:29 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3646646276' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:26:29.501 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:29.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:29 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3646646276' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:26:29.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:29 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3646646276' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:26:30.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.077+0000 7f1d9ec00640 1 -- 172.21.15.3:0/1682717301 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d98077ff0 msgr2=0x7f1d98113450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:30.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.077+0000 7f1d9ec00640 1 --2- 172.21.15.3:0/1682717301 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d98077ff0 0x7f1d98113450 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1d80009900 tx=0x7f1d8002a400 comp rx=0 tx=0).stop 2024-09-10T23:26:30.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.077+0000 7f1d9ec00640 1 -- 172.21.15.3:0/1682717301 shutdown_connections 2024-09-10T23:26:30.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.077+0000 7f1d9ec00640 1 --2- 172.21.15.3:0/1682717301 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d98113990 0x7f1d98115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:30.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.077+0000 7f1d9ec00640 1 --2- 172.21.15.3:0/1682717301 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d98077ff0 0x7f1d98113450 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:30.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.077+0000 7f1d9ec00640 1 --2- 172.21.15.3:0/1682717301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d980776d0 0x7f1d98077ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:30.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.077+0000 7f1d9ec00640 1 -- 172.21.15.3:0/1682717301 >> 172.21.15.3:0/1682717301 conn(0x7f1d98100a50 msgr2=0x7f1d98102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:30.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.077+0000 7f1d9ec00640 1 -- 172.21.15.3:0/1682717301 shutdown_connections 2024-09-10T23:26:30.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.078+0000 7f1d9ec00640 1 -- 172.21.15.3:0/1682717301 wait complete. 2024-09-10T23:26:30.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.078+0000 7f1d9ec00640 1 Processor -- start 2024-09-10T23:26:30.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.079+0000 7f1d9ec00640 1 -- start start 2024-09-10T23:26:30.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.079+0000 7f1d9ec00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d980776d0 0x7f1d9819f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:30.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.079+0000 7f1d9ec00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d98077ff0 0x7f1d9819fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:30.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.079+0000 7f1d9ec00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d98113990 0x7f1d981a5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:30.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.079+0000 7f1d9ec00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1d98119270 con 0x7f1d980776d0 2024-09-10T23:26:30.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.079+0000 7f1d9ec00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f1d981190f0 con 0x7f1d98113990 2024-09-10T23:26:30.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.079+0000 7f1d9ec00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1d981193f0 con 0x7f1d98077ff0 2024-09-10T23:26:30.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.079+0000 7f1d97e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d980776d0 0x7f1d9819f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:30.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.079+0000 7f1d97e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d980776d0 0x7f1d9819f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39766/0 (socket says 172.21.15.3:39766) 2024-09-10T23:26:30.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.080+0000 7f1d97e00640 1 -- 172.21.15.3:0/2305545248 learned_addr learned my addr 172.21.15.3:0/2305545248 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:30.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.080+0000 7f1d8fe00640 1 --2- 172.21.15.3:0/2305545248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d98077ff0 0x7f1d9819fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:30.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.080+0000 7f1d9cc00640 1 --2- 172.21.15.3:0/2305545248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d98113990 0x7f1d981a5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:30.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.080+0000 7f1d97e00640 1 -- 172.21.15.3:0/2305545248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d98077ff0 msgr2=0x7f1d9819fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:30.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.080+0000 7f1d97e00640 1 --2- 172.21.15.3:0/2305545248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d98077ff0 0x7f1d9819fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:30.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.080+0000 7f1d97e00640 1 -- 172.21.15.3:0/2305545248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d98113990 msgr2=0x7f1d981a5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:30.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.080+0000 7f1d97e00640 1 --2- 172.21.15.3:0/2305545248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d98113990 0x7f1d981a5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:30.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.080+0000 7f1d97e00640 1 -- 172.21.15.3:0/2305545248 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d981a57f0 con 0x7f1d980776d0 2024-09-10T23:26:30.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.080+0000 7f1d97e00640 1 --2- 172.21.15.3:0/2305545248 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d980776d0 0x7f1d9819f740 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1d8800c920 tx=0x7f1d8800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:30.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.081+0000 7f1d95600640 1 -- 172.21.15.3:0/2305545248 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d88007c70 con 0x7f1d980776d0 2024-09-10T23:26:30.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.081+0000 7f1d95600640 1 -- 172.21.15.3:0/2305545248 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d88007e10 con 0x7f1d980776d0 2024-09-10T23:26:30.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.081+0000 7f1d95600640 1 -- 172.21.15.3:0/2305545248 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d88018710 con 0x7f1d980776d0 2024-09-10T23:26:30.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.081+0000 7f1d9ec00640 1 -- 172.21.15.3:0/2305545248 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d981a5ae0 con 0x7f1d980776d0 2024-09-10T23:26:30.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.081+0000 7f1d9ec00640 1 -- 172.21.15.3:0/2305545248 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d981ac370 con 0x7f1d980776d0 2024-09-10T23:26:30.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.082+0000 7f1d9ec00640 1 -- 172.21.15.3:0/2305545248 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d98077ab0 con 0x7f1d980776d0 2024-09-10T23:26:30.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.084+0000 7f1d95600640 1 -- 172.21.15.3:0/2305545248 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 22) ==== 153266+0+0 (secure 0 0 0) 0x7f1d8800f450 con 0x7f1d980776d0 2024-09-10T23:26:30.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.085+0000 7f1d95600640 1 --2- 172.21.15.3:0/2305545248 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f1d7c0b53b0 0x7f1d7c0b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:30.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.086+0000 7f1d95600640 1 -- 172.21.15.3:0/2305545248 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f1d880e61b0 con 0x7f1d980776d0 2024-09-10T23:26:30.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.086+0000 7f1d8fe00640 1 --2- 172.21.15.3:0/2305545248 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f1d7c0b53b0 0x7f1d7c0b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:30.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.086+0000 7f1d8fe00640 1 --2- 172.21.15.3:0/2305545248 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f1d7c0b53b0 0x7f1d7c0b7870 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1d80006010 tx=0x7f1d80005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:30.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.090+0000 7f1d95600640 1 -- 172.21.15.3:0/2305545248 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1d88014030 con 0x7f1d980776d0 2024-09-10T23:26:30.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.288+0000 7f1d9ec00640 1 -- 172.21.15.3:0/2305545248 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1d981ac540 con 0x7f1d980776d0 2024-09-10T23:26:30.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.289+0000 7f1d95600640 1 -- 172.21.15.3:0/2305545248 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+25112 (secure 0 0 0) 0x7f1d880acb80 con 0x7f1d980776d0 2024-09-10T23:26:30.291 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:26:30.291 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":90,"fsid":"3f4e30d0-6fca-11ef-bcea-c7b262605968","created":"2024-09-10T23:14:12.377466+0000","modified":"2024-09-10T23:25:22.134690+0000","last_up_change":"2024-09-10T23:22:54.895554+0000","last_in_change":"2024-09-10T23:22:29.701108+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:18:27.131879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:23:53.689954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:23:55.864693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:24:03.869094+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a38330ed-a85b-4e61-b373-dd8f1d5f7ba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6803","nonce":824467747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6805","nonce":824467747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6809","nonce":824467747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6807","nonce":824467747}]},"public_addr":"172.21.15.3:6803/824467747","cluster_addr":"172.21.15.3:6805/824467747","heartbeat_back_addr":"172.21.15.3:6809/824467747","heartbeat_front_addr":"172.21.15.3:6807/824467747","state":["exists","up"]},{"osd":1,"uuid":"49bb1212-a83e-4f85-ad71-d863880d8268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6801","nonce":1447444485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6803","nonce":1447444485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6807","nonce":1447444485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6805","nonce":1447444485}]},"public_addr":"172.21.15.38:6801/1447444485","cluster_addr":"172.21.15.38:6803/1447444485","heartbeat_back_addr":"172.21.15.38:6807/1447444485","heartbeat_front_addr":"172.21.15.38:6805/1447444485","state":["exists","up"]},{"osd":2,"uuid":"ea53eb27-e7fa-4783-9a53-8b44b4e293ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6801","nonce":3191263316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6803","nonce":3191263316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6807","nonce":3191263316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6805","nonce":3191263316}]},"public_addr":"172.21.15.194:6801/3191263316","cluster_addr":"172.21.15.194:6803/3191263316","heartbeat_back_addr":"172.21.15.194:6807/3191263316","heartbeat_front_addr":"172.21.15.194:6805/3191263316","state":["exists","up"]},{"osd":3,"uuid":"75067769-7be5-4a99-9e02-f7735b2e69c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6811","nonce":2061990952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6813","nonce":2061990952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6817","nonce":2061990952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6815","nonce":2061990952}]},"public_addr":"172.21.15.3:6811/2061990952","cluster_addr":"172.21.15.3:6813/2061990952","heartbeat_back_addr":"172.21.15.3:6817/2061990952","heartbeat_front_addr":"172.21.15.3:6815/2061990952","state":["exists","up"]},{"osd":4,"uuid":"872e90ca-b711-4206-b586-e7fa41122199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6809","nonce":413294160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6811","nonce":413294160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6815","nonce":413294160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6813","nonce":413294160}]},"public_addr":"172.21.15.38:6809/413294160","cluster_addr":"172.21.15.38:6811/413294160","heartbeat_back_addr":"172.21.15.38:6815/413294160","heartbeat_front_addr":"172.21.15.38:6813/413294160","state":["exists","up"]},{"osd":5,"uuid":"2cfa107c-6dae-4c26-9e29-8175b1237b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6809","nonce":4117812658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6811","nonce":4117812658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6815","nonce":4117812658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6813","nonce":4117812658}]},"public_addr":"172.21.15.194:6809/4117812658","cluster_addr":"172.21.15.194:6811/4117812658","heartbeat_back_addr":"172.21.15.194:6815/4117812658","heartbeat_front_addr":"172.21.15.194:6813/4117812658","state":["exists","up"]},{"osd":6,"uuid":"d2e4e309-c587-4725-a5b3-cbc7b1226750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6819","nonce":3470543721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6821","nonce":3470543721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6825","nonce":3470543721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6823","nonce":3470543721}]},"public_addr":"172.21.15.3:6819/3470543721","cluster_addr":"172.21.15.3:6821/3470543721","heartbeat_back_addr":"172.21.15.3:6825/3470543721","heartbeat_front_addr":"172.21.15.3:6823/3470543721","state":["exists","up"]},{"osd":7,"uuid":"46ecaec5-29da-4e1d-ac2f-42bbbd77e949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6817","nonce":2054203924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6819","nonce":2054203924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6823","nonce":2054203924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6821","nonce":2054203924}]},"public_addr":"172.21.15.38:6817/2054203924","cluster_addr":"172.21.15.38:6819/2054203924","heartbeat_back_addr":"172.21.15.38:6823/2054203924","heartbeat_front_addr":"172.21.15.38:6821/2054203924","state":["exists","up"]},{"osd":8,"uuid":"57fd8e43-9612-4f74-8eb2-8bdbbf7c0417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6817","nonce":170051722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6819","nonce":170051722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6823","nonce":170051722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6821","nonce":170051722}]},"public_addr":"172.21.15.194:6817/170051722","cluster_addr":"172.21.15.194:6819/170051722","heartbeat_back_addr":"172.21.15.194:6823/170051722","heartbeat_front_addr":"172.21.15.194:6821/170051722","state":["exists","up"]},{"osd":9,"uuid":"aeaaf23b-d2e2-4e30-9a49-de4aaba53900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6827","nonce":3967749600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6829","nonce":3967749600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6833","nonce":3967749600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6831","nonce":3967749600}]},"public_addr":"172.21.15.3:6827/3967749600","cluster_addr":"172.21.15.3:6829/3967749600","heartbeat_back_addr":"172.21.15.3:6833/3967749600","heartbeat_front_addr":"172.21.15.3:6831/3967749600","state":["exists","up"]},{"osd":10,"uuid":"b0ece81b-1c5b-40da-b579-fb99bacb005d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6825","nonce":1671957178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6827","nonce":1671957178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6831","nonce":1671957178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6829","nonce":1671957178}]},"public_addr":"172.21.15.38:6825/1671957178","cluster_addr":"172.21.15.38:6827/1671957178","heartbeat_back_addr":"172.21.15.38:6831/1671957178","heartbeat_front_addr":"172.21.15.38:6829/1671957178","state":["exists","up"]},{"osd":11,"uuid":"a0036526-54bf-4e8b-95cc-e7b75725961c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6825","nonce":1048859686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6827","nonce":1048859686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6831","nonce":1048859686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6829","nonce":1048859686}]},"public_addr":"172.21.15.194:6825/1048859686","cluster_addr":"172.21.15.194:6827/1048859686","heartbeat_back_addr":"172.21.15.194:6831/1048859686","heartbeat_front_addr":"172.21.15.194:6829/1048859686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:27.013354+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:56.609046+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:24.878988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:55.218204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:25.224770+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:54.614336+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:25.385483+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:55.317137+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:25.064825+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:54.655361+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:22:24.080027+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:22:52.886412+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":4,"to":6},{"from":5,"to":9}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.3:0/776988825":"2024-09-11T23:16:20.647314+0000","172.21.15.3:0/2965090335":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/2364823868":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/3186881356":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/911991463":"2024-09-11T23:16:20.647314+0000","172.21.15.3:6800/2582365069":"2024-09-11T23:14:37.169991+0000","172.21.15.3:6801/2582365069":"2024-09-11T23:14:37.169991+0000","172.21.15.3:6801/1528153492":"2024-09-11T23:15:05.835734+0000","172.21.15.3:6800/1924113958":"2024-09-11T23:16:20.647314+0000","172.21.15.3:0/554479543":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/4238683346":"2024-09-11T23:15:05.835734+0000","172.21.15.3:6800/1528153492":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/285471483":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/1249510760":"2024-09-11T23:16:20.647314+0000","172.21.15.3:6801/1924113958":"2024-09-11T23:16:20.647314+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:26:30.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.292+0000 7f1d9ec00640 1 -- 172.21.15.3:0/2305545248 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f1d7c0b53b0 msgr2=0x7f1d7c0b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:30.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.292+0000 7f1d9ec00640 1 --2- 172.21.15.3:0/2305545248 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f1d7c0b53b0 0x7f1d7c0b7870 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1d80006010 tx=0x7f1d80005e80 comp rx=0 tx=0).stop 2024-09-10T23:26:30.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.292+0000 7f1d9ec00640 1 -- 172.21.15.3:0/2305545248 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d980776d0 msgr2=0x7f1d9819f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:30.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.292+0000 7f1d9ec00640 1 --2- 172.21.15.3:0/2305545248 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d980776d0 0x7f1d9819f740 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1d8800c920 tx=0x7f1d8800cde0 comp rx=0 tx=0).stop 2024-09-10T23:26:30.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.292+0000 7f1d9ec00640 1 -- 172.21.15.3:0/2305545248 shutdown_connections 2024-09-10T23:26:30.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.292+0000 7f1d9ec00640 1 --2- 172.21.15.3:0/2305545248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d98113990 0x7f1d981a5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:30.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.292+0000 7f1d9ec00640 1 --2- 172.21.15.3:0/2305545248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d98077ff0 0x7f1d9819fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:30.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.292+0000 7f1d9ec00640 1 --2- 172.21.15.3:0/2305545248 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f1d7c0b53b0 0x7f1d7c0b7870 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:30.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.292+0000 7f1d9ec00640 1 --2- 172.21.15.3:0/2305545248 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d980776d0 0x7f1d9819f740 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:30.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.292+0000 7f1d9ec00640 1 -- 172.21.15.3:0/2305545248 >> 172.21.15.3:0/2305545248 conn(0x7f1d98100a50 msgr2=0x7f1d98102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:30.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.292+0000 7f1d9ec00640 1 -- 172.21.15.3:0/2305545248 shutdown_connections 2024-09-10T23:26:30.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:30.292+0000 7f1d9ec00640 1 -- 172.21.15.3:0/2305545248 wait complete. 2024-09-10T23:26:30.499 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:30 smithi038 ceph-mon[34225]: pgmap v382: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-10T23:26:30.638 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:30 smithi003 ceph-mon[30348]: pgmap v382: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-10T23:26:30.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:30 smithi194 ceph-mon[33904]: pgmap v382: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-10T23:26:31.086 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T23:23:58.866253+0000', 'modified': '2024-09-10T23:24:51.177863+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 34724, 'mds_1': 34682, 'mds_2': 34652}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24649': {'gid': 24649, 'name': 'c', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.194:6837/739730313', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6836', 'nonce': 739730313}, {'type': 'v1', 'addr': '172.21.15.194:6837', 'nonce': 739730313}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24673': {'gid': 24673, 'name': 'i', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.194:6839/3198777710', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6838', 'nonce': 3198777710}, {'type': 'v1', 'addr': '172.21.15.194:6839', 'nonce': 3198777710}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34619': {'gid': 34619, 'name': 'k', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.38:6833/1194099617', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6832', 'nonce': 1194099617}, {'type': 'v1', 'addr': '172.21.15.38:6833', 'nonce': 1194099617}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34652': {'gid': 34652, 'name': 'e', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 24, 'addr': '172.21.15.38:6835/218783320', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6834', 'nonce': 218783320}, {'type': 'v1', 'addr': '172.21.15.38:6835', 'nonce': 218783320}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34682': {'gid': 34682, 'name': 'h', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 21, 'addr': '172.21.15.38:6837/1821839397', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6836', 'nonce': 1821839397}, {'type': 'v1', 'addr': '172.21.15.38:6837', 'nonce': 1821839397}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34724': {'gid': 34724, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.38:6839/458259815', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6838', 'nonce': 458259815}, {'type': 'v1', 'addr': '172.21.15.38:6839', 'nonce': 458259815}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34724, 'qdb_cluster': [34652, 34682, 34724]} 2024-09-10T23:26:31.086 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-10T23:26:31.086 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.e status 2024-09-10T23:26:31.469 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:31.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:31 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2305545248' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:26:31.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:31 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2305545248' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:26:31.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:31 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2305545248' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:26:32.039 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.037+0000 7f70a5000640 1 -- 172.21.15.3:0/1331774912 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f70a0103cc0 msgr2=0x7f70a01040a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:32.039 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.037+0000 7f70a5000640 1 --2- 172.21.15.3:0/1331774912 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f70a0103cc0 0x7f70a01040a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7090009900 tx=0x7f709002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:26:32.039 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.037+0000 7f70a5000640 1 -- 172.21.15.3:0/1331774912 shutdown_connections 2024-09-10T23:26:32.039 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.037+0000 7f70a5000640 1 --2- 172.21.15.3:0/1331774912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70a010d120 0x7f70a010f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:32.039 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.037+0000 7f70a5000640 1 --2- 172.21.15.3:0/1331774912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70a01045e0 0x7f70a010cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:32.039 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.037+0000 7f70a5000640 1 --2- 172.21.15.3:0/1331774912 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f70a0103cc0 0x7f70a01040a0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:32.039 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.037+0000 7f70a5000640 1 -- 172.21.15.3:0/1331774912 >> 172.21.15.3:0/1331774912 conn(0x7f70a00fd700 msgr2=0x7f70a00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:32.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.038+0000 7f70a5000640 1 -- 172.21.15.3:0/1331774912 shutdown_connections 2024-09-10T23:26:32.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.038+0000 7f70a5000640 1 -- 172.21.15.3:0/1331774912 wait complete. 2024-09-10T23:26:32.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.039+0000 7f70a5000640 1 Processor -- start 2024-09-10T23:26:32.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.039+0000 7f70a5000640 1 -- start start 2024-09-10T23:26:32.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.039+0000 7f70a5000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70a0103cc0 0x7f70a019b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:32.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.039+0000 7f70a5000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f70a01045e0 0x7f70a019b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:32.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.039+0000 7f70a5000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70a010d120 0x7f70a01a0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:32.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.039+0000 7f70a5000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f70a0112c40 con 0x7f70a01045e0 2024-09-10T23:26:32.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.039+0000 7f70a5000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f70a0112ac0 con 0x7f70a0103cc0 2024-09-10T23:26:32.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.039+0000 7f70a5000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f70a0112dc0 con 0x7f70a010d120 2024-09-10T23:26:32.043 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.039+0000 7f7095400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f70a01045e0 0x7f70a019b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:32.043 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.039+0000 7f7095400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f70a01045e0 0x7f70a019b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50036/0 (socket says 172.21.15.3:50036) 2024-09-10T23:26:32.043 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.039+0000 7f7095400640 1 -- 172.21.15.3:0/1969175512 learned_addr learned my addr 172.21.15.3:0/1969175512 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:32.043 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.039+0000 7f709de00640 1 --2- 172.21.15.3:0/1969175512 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70a0103cc0 0x7f70a019b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:32.043 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.040+0000 7f709e800640 1 --2- 172.21.15.3:0/1969175512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70a010d120 0x7f70a01a0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:32.043 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.040+0000 7f7095400640 1 -- 172.21.15.3:0/1969175512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70a010d120 msgr2=0x7f70a01a0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:32.043 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.040+0000 7f7095400640 1 --2- 172.21.15.3:0/1969175512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70a010d120 0x7f70a01a0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:32.043 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.040+0000 7f7095400640 1 -- 172.21.15.3:0/1969175512 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70a0103cc0 msgr2=0x7f70a019b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:32.043 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.040+0000 7f7095400640 1 --2- 172.21.15.3:0/1969175512 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70a0103cc0 0x7f70a019b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:32.043 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.040+0000 7f7095400640 1 -- 172.21.15.3:0/1969175512 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70a01a14e0 con 0x7f70a01045e0 2024-09-10T23:26:32.043 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.040+0000 7f7095400640 1 --2- 172.21.15.3:0/1969175512 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f70a01045e0 0x7f70a019b970 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f708800d6b0 tx=0x7f708800db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:32.044 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.041+0000 7f7097400640 1 -- 172.21.15.3:0/1969175512 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7088017070 con 0x7f70a01045e0 2024-09-10T23:26:32.044 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.041+0000 7f7097400640 1 -- 172.21.15.3:0/1969175512 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7088010460 con 0x7f70a01045e0 2024-09-10T23:26:32.044 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.041+0000 7f70a5000640 1 -- 172.21.15.3:0/1969175512 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70a01a17d0 con 0x7f70a01045e0 2024-09-10T23:26:32.044 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.041+0000 7f7097400640 1 -- 172.21.15.3:0/1969175512 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708800f620 con 0x7f70a01045e0 2024-09-10T23:26:32.044 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.041+0000 7f70a5000640 1 -- 172.21.15.3:0/1969175512 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70a01a7e90 con 0x7f70a01045e0 2024-09-10T23:26:32.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.044+0000 7f70a7a2f740 1 Processor -- start 2024-09-10T23:26:32.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.044+0000 7f70a7a2f740 1 -- start start 2024-09-10T23:26:32.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.044+0000 7f7097400640 1 -- 172.21.15.3:0/1969175512 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 22) ==== 153266+0+0 (secure 0 0 0) 0x7f7088010930 con 0x7f70a01045e0 2024-09-10T23:26:32.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.044+0000 7f70a7a2f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5621150a2240 0x5621150a2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:32.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.044+0000 7f70a7a2f740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621150a2b60 0x5621150ae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:32.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.045+0000 7f70a7a2f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5621150aeaf0 0x5621150b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:32.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.045+0000 7f70a7a2f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562115019d50 con 0x5621150aeaf0 2024-09-10T23:26:32.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.045+0000 7f70a7a2f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x562115009180 con 0x5621150a2240 2024-09-10T23:26:32.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.045+0000 7f70a7a2f740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56211500cf90 con 0x5621150a2b60 2024-09-10T23:26:32.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.045+0000 7f7095400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5621150aeaf0 0x5621150b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:32.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.045+0000 7f7095400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5621150aeaf0 0x5621150b0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50048/0 (socket says 172.21.15.3:50048) 2024-09-10T23:26:32.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.045+0000 7f7095400640 1 -- 172.21.15.3:0/2409222778 learned_addr learned my addr 172.21.15.3:0/2409222778 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:32.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.045+0000 7f709e800640 1 --2- 172.21.15.3:0/2409222778 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5621150a2240 0x5621150a2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:32.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.045+0000 7f709de00640 1 --2- 172.21.15.3:0/2409222778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621150a2b60 0x5621150ae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:32.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.045+0000 7f7095400640 1 -- 172.21.15.3:0/2409222778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621150a2b60 msgr2=0x5621150ae5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:32.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.046+0000 7f7095400640 1 --2- 172.21.15.3:0/2409222778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621150a2b60 0x5621150ae5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:32.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.046+0000 7f7095400640 1 -- 172.21.15.3:0/2409222778 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5621150a2240 msgr2=0x5621150a2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:32.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.046+0000 7f7095400640 1 --2- 172.21.15.3:0/2409222778 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5621150a2240 0x5621150a2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:32.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.046+0000 7f7095400640 1 -- 172.21.15.3:0/2409222778 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562114fd3a70 con 0x5621150aeaf0 2024-09-10T23:26:32.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.046+0000 7f709e800640 1 --2- 172.21.15.3:0/2409222778 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5621150a2240 0x5621150a2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:26:32.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.046+0000 7f7095400640 1 --2- 172.21.15.3:0/2409222778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5621150aeaf0 0x5621150b0ee0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f70880e9e90 tx=0x7f70880ee780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbc0cc6e2e5b1558 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:32.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.046+0000 7f708f400640 1 -- 172.21.15.3:0/2409222778 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70880ec840 con 0x5621150aeaf0 2024-09-10T23:26:32.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.046+0000 7f708f400640 1 -- 172.21.15.3:0/2409222778 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f70880f3070 con 0x5621150aeaf0 2024-09-10T23:26:32.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.046+0000 7f708f400640 1 -- 172.21.15.3:0/2409222778 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70880f8cd0 con 0x5621150aeaf0 2024-09-10T23:26:32.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.046+0000 7f7097400640 1 --2- 172.21.15.3:0/1969175512 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f70840b5330 0x7f70840b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:32.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.047+0000 7f7097400640 1 -- 172.21.15.3:0/1969175512 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f70880e5d30 con 0x7f70a01045e0 2024-09-10T23:26:32.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.047+0000 7f709e800640 1 --2- 172.21.15.3:0/1969175512 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f70840b5330 0x7f70840b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:32.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.047+0000 7f70a7a2f740 1 -- 172.21.15.3:0/2409222778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5621150aeaf0 msgr2=0x5621150b0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:32.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.047+0000 7f70a7a2f740 1 --2- 172.21.15.3:0/2409222778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5621150aeaf0 0x5621150b0ee0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f70880e9e90 tx=0x7f70880ee780 comp rx=0 tx=0).stop 2024-09-10T23:26:32.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.047+0000 7f70a7a2f740 1 -- 172.21.15.3:0/2409222778 shutdown_connections 2024-09-10T23:26:32.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.047+0000 7f70a7a2f740 1 --2- 172.21.15.3:0/2409222778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5621150aeaf0 0x5621150b0ee0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:32.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.047+0000 7f70a7a2f740 1 --2- 172.21.15.3:0/2409222778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621150a2b60 0x5621150ae5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:32.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.047+0000 7f70a7a2f740 1 --2- 172.21.15.3:0/2409222778 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5621150a2240 0x5621150a2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:32.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.047+0000 7f70a7a2f740 1 -- 172.21.15.3:0/2409222778 >> 172.21.15.3:0/2409222778 conn(0x5621150a0020 msgr2=0x5621150a1210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:32.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.047+0000 7f70a7a2f740 1 -- 172.21.15.3:0/2409222778 shutdown_connections 2024-09-10T23:26:32.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.047+0000 7f709e800640 1 --2- 172.21.15.3:0/1969175512 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f70840b5330 0x7f70840b77f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7098005fd0 tx=0x7f7098009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:32.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.048+0000 7f70a7a2f740 1 -- 172.21.15.3:0/2409222778 wait complete. 2024-09-10T23:26:32.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.048+0000 7f70a7a2f740 1 -- start start 2024-09-10T23:26:32.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.048+0000 7f70a7a2f740 1 Processor -- start 2024-09-10T23:26:32.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.049+0000 7f70a7a2f740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621150a2240 0x5621150abab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:32.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.049+0000 7f70a7a2f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5621150a2b60 0x5621150abff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:32.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.049+0000 7f70a7a2f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5621150aeaf0 0x5621150ac530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:32.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.049+0000 7f70a7a2f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562114e6a5f0 con 0x5621150aeaf0 2024-09-10T23:26:32.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.049+0000 7f70a7a2f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x562114fa4460 con 0x5621150a2b60 2024-09-10T23:26:32.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.049+0000 7f70a7a2f740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5621150b1840 con 0x5621150a2240 2024-09-10T23:26:32.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.049+0000 7f70a7a2f740 10 client.0 _ll_register_callbacks cb 0x562114fb4210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:32.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.049+0000 7f709e800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5621150aeaf0 0x5621150ac530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:32.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.049+0000 7f709e800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5621150aeaf0 0x5621150ac530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50064/0 (socket says 172.21.15.3:50064) 2024-09-10T23:26:32.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.049+0000 7f709e800640 1 -- 172.21.15.3:0/1882636811 learned_addr learned my addr 172.21.15.3:0/1882636811 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:32.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.049+0000 7f7095400640 1 --2- 172.21.15.3:0/1882636811 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5621150a2b60 0x5621150abff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:32.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.049+0000 7f709de00640 1 --2- 172.21.15.3:0/1882636811 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621150a2240 0x5621150abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:32.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.050+0000 7f7095400640 1 -- 172.21.15.3:0/1882636811 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621150a2240 msgr2=0x5621150abab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:32.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.050+0000 7f7095400640 1 --2- 172.21.15.3:0/1882636811 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621150a2240 0x5621150abab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:32.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.050+0000 7f7095400640 1 -- 172.21.15.3:0/1882636811 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5621150aeaf0 msgr2=0x5621150ac530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:32.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.050+0000 7f7095400640 1 --2- 172.21.15.3:0/1882636811 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5621150aeaf0 0x5621150ac530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:32.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.050+0000 7f7095400640 1 -- 172.21.15.3:0/1882636811 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562114d67540 con 0x5621150a2b60 2024-09-10T23:26:32.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.050+0000 7f709e800640 1 --2- 172.21.15.3:0/1882636811 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5621150aeaf0 0x5621150ac530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:26:32.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.050+0000 7f7095400640 1 --2- 172.21.15.3:0/1882636811 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5621150a2b60 0x5621150abff0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f70880a9320 tx=0x7f70880f8910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f98d06934d253340 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:32.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.050+0000 7f7083e00640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-10T23:26:32.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.050+0000 7f7083e00640 1 -- 172.21.15.3:0/1882636811 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7088021070 con 0x5621150a2b60 2024-09-10T23:26:32.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.050+0000 7f70a7a2f740 1 -- 172.21.15.3:0/1882636811 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562114fa6a70 con 0x5621150a2b60 2024-09-10T23:26:32.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.050+0000 7f7083e00640 1 -- 172.21.15.3:0/1882636811 <== mon.2 v2:172.21.15.38:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f7088010610 con 0x5621150a2b60 2024-09-10T23:26:32.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.051+0000 7f7083e00640 1 -- 172.21.15.3:0/1882636811 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f70880b3e60 con 0x5621150a2b60 2024-09-10T23:26:32.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.051+0000 7f70a7a2f740 10 client.35246 fetch_fsmap learned FSMap version 25 2024-09-10T23:26:32.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.051+0000 7f70a7a2f740 1 -- 172.21.15.3:0/1882636811 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562114fc16f0 con 0x5621150a2b60 2024-09-10T23:26:32.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.051+0000 7f7083e00640 1 -- 172.21.15.3:0/1882636811 <== mon.2 v2:172.21.15.38:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x562114fa6a70 con 0x5621150a2b60 2024-09-10T23:26:32.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.051+0000 7f7083e00640 1 -- 172.21.15.3:0/1882636811 <== mon.2 v2:172.21.15.38:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f70880a8320 con 0x5621150a2b60 2024-09-10T23:26:32.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.051+0000 7f70a7a2f740 10 client.35246 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:26:32.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.052+0000 7f70a7a2f740 10 client.35246 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-10T23:26:32.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.052+0000 7f70a7a2f740 20 client.35246 populate_metadata read hostname 'smithi003' 2024-09-10T23:26:32.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.052+0000 7f70a7a2f740 1 --2- 172.21.15.3:0/1882636811 >> [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] conn(0x5621150be580 0x5621150c0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:32.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.052+0000 7f70a7a2f740 4 client.35246 mds_command: new command op to 34652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:26:32.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.052+0000 7f70a7a2f740 1 -- 172.21.15.3:0/1882636811 --> [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56211501bca0 con 0x5621150be580 2024-09-10T23:26:32.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.052+0000 7f709de00640 1 --2- 172.21.15.3:0/1882636811 >> [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] conn(0x5621150be580 0x5621150c0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:32.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.053+0000 7f709de00640 1 --2- 172.21.15.3:0/1882636811 >> [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] conn(0x5621150be580 0x5621150c0700 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=581d76e50c5cee2d server_cookie=33e04d0646414fe4 in_seq=0 out_seq=0 2024-09-10T23:26:32.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.053+0000 7f7083e00640 10 client.35246 ms_handle_connect on v2:172.21.15.38:6834/218783320 2024-09-10T23:26:32.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.053+0000 7f7083e00640 1 -- 172.21.15.3:0/1882636811 <== mds.2 v2:172.21.15.38:6834/218783320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56211501bca0 con 0x5621150be580 2024-09-10T23:26:32.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.053+0000 7f7083e00640 10 client.35246 handle_command_reply: tid=0 2024-09-10T23:26:32.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.054+0000 7f70a7a2f740 1 client.35246 shutdown 2024-09-10T23:26:32.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.054+0000 7f70a7a2f740 1 -- 172.21.15.3:0/1882636811 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5621150a2b60 msgr2=0x5621150abff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:32.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.054+0000 7f70a7a2f740 1 --2- 172.21.15.3:0/1882636811 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5621150a2b60 0x5621150abff0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f70880a9320 tx=0x7f70880f8910 comp rx=0 tx=0).stop 2024-09-10T23:26:32.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.054+0000 7f70a7a2f740 1 -- 172.21.15.3:0/1882636811 shutdown_connections 2024-09-10T23:26:32.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.054+0000 7f70a7a2f740 1 --2- 172.21.15.3:0/1882636811 >> [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] conn(0x5621150be580 0x5621150c0700 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:32.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.054+0000 7f70a7a2f740 1 --2- 172.21.15.3:0/1882636811 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5621150aeaf0 0x5621150ac530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:32.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.054+0000 7f70a7a2f740 1 --2- 172.21.15.3:0/1882636811 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5621150a2b60 0x5621150abff0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:32.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.054+0000 7f70a7a2f740 1 --2- 172.21.15.3:0/1882636811 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621150a2240 0x5621150abab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:32.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.054+0000 7f7083e00640 0 client.35246 ms_handle_reset on v2:172.21.15.38:6834/218783320 2024-09-10T23:26:32.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.054+0000 7f70a7a2f740 1 -- 172.21.15.3:0/1882636811 >> 172.21.15.3:0/1882636811 conn(0x5621150a0020 msgr2=0x5621150a5be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:32.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.054+0000 7f70a7a2f740 1 -- 172.21.15.3:0/1882636811 shutdown_connections 2024-09-10T23:26:32.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.054+0000 7f70a7a2f740 1 -- 172.21.15.3:0/1882636811 wait complete. 2024-09-10T23:26:32.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.054+0000 7f70a7a2f740 20 client.35246 trim_cache size 0 max 16384 2024-09-10T23:26:32.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.073+0000 7f70a7a2f740 1 Processor -- start 2024-09-10T23:26:32.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.074+0000 7f70a7a2f740 1 -- start start 2024-09-10T23:26:32.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.074+0000 7f70a7a2f740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621150a2240 0x5621150bf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:32.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.074+0000 7f70a7a2f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5621150a2b60 0x5621150a6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:32.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.074+0000 7f70a7a2f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5621150aeaf0 0x5621150a8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:32.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.074+0000 7f70a7a2f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5621150bea40 con 0x5621150aeaf0 2024-09-10T23:26:32.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.074+0000 7f70a7a2f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5621150bf110 con 0x5621150a2b60 2024-09-10T23:26:32.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.074+0000 7f70a7a2f740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5621150bf7e0 con 0x5621150a2240 2024-09-10T23:26:32.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.074+0000 7f709e800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5621150aeaf0 0x5621150a8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:32.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.074+0000 7f709e800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5621150aeaf0 0x5621150a8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50068/0 (socket says 172.21.15.3:50068) 2024-09-10T23:26:32.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.074+0000 7f709e800640 1 -- 172.21.15.3:0/3951855963 learned_addr learned my addr 172.21.15.3:0/3951855963 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:32.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.074+0000 7f709de00640 1 --2- 172.21.15.3:0/3951855963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621150a2240 0x5621150bf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:32.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.075+0000 7f7095400640 1 --2- 172.21.15.3:0/3951855963 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5621150a2b60 0x5621150a6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:32.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.075+0000 7f709e800640 1 -- 172.21.15.3:0/3951855963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621150a2240 msgr2=0x5621150bf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:32.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.075+0000 7f709e800640 1 --2- 172.21.15.3:0/3951855963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621150a2240 0x5621150bf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:32.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.075+0000 7f709e800640 1 -- 172.21.15.3:0/3951855963 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5621150a2b60 msgr2=0x5621150a6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:32.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.075+0000 7f709e800640 1 --2- 172.21.15.3:0/3951855963 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5621150a2b60 0x5621150a6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:32.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.075+0000 7f709e800640 1 -- 172.21.15.3:0/3951855963 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621150a9fb0 con 0x5621150aeaf0 2024-09-10T23:26:32.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.075+0000 7f709e800640 1 --2- 172.21.15.3:0/3951855963 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5621150aeaf0 0x5621150a8cc0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7098005c40 tx=0x7f7098016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72272957897b7721 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:32.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.075+0000 7f708ea00640 1 -- 172.21.15.3:0/3951855963 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70980205e0 con 0x5621150aeaf0 2024-09-10T23:26:32.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.075+0000 7f708ea00640 1 -- 172.21.15.3:0/3951855963 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7098020c10 con 0x5621150aeaf0 2024-09-10T23:26:32.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.075+0000 7f708ea00640 1 -- 172.21.15.3:0/3951855963 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709801dcd0 con 0x5621150aeaf0 2024-09-10T23:26:32.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.076+0000 7f70a7a2f740 1 -- 172.21.15.3:0/3951855963 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5621150aeaf0 msgr2=0x5621150a8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:32.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.076+0000 7f70a7a2f740 1 --2- 172.21.15.3:0/3951855963 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5621150aeaf0 0x5621150a8cc0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7098005c40 tx=0x7f7098016000 comp rx=0 tx=0).stop 2024-09-10T23:26:32.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.076+0000 7f70a7a2f740 1 -- 172.21.15.3:0/3951855963 shutdown_connections 2024-09-10T23:26:32.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.076+0000 7f70a7a2f740 1 --2- 172.21.15.3:0/3951855963 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5621150aeaf0 0x5621150a8cc0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:32.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.076+0000 7f70a7a2f740 1 --2- 172.21.15.3:0/3951855963 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5621150a2b60 0x5621150a6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:32.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.076+0000 7f70a7a2f740 1 --2- 172.21.15.3:0/3951855963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621150a2240 0x5621150bf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:32.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.076+0000 7f70a7a2f740 1 -- 172.21.15.3:0/3951855963 >> 172.21.15.3:0/3951855963 conn(0x5621150a0020 msgr2=0x5621150a6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:32.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.076+0000 7f70a7a2f740 1 -- 172.21.15.3:0/3951855963 shutdown_connections 2024-09-10T23:26:32.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.076+0000 7f70a7a2f740 1 -- 172.21.15.3:0/3951855963 wait complete. 2024-09-10T23:26:32.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.077+0000 7f70a7a2f740 1 -- start start 2024-09-10T23:26:32.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.077+0000 7f70a7a2f740 1 Processor -- start 2024-09-10T23:26:32.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.077+0000 7f70a7a2f740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621150a2240 0x5621150c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:32.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.077+0000 7f70a7a2f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5621150a2b60 0x5621150c25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:32.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.077+0000 7f70a7a2f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5621150aeaf0 0x5621150c2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:32.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.077+0000 7f70a7a2f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5621150c0580 con 0x5621150a2b60 2024-09-10T23:26:32.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.077+0000 7f70a7a2f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5621150bfeb0 con 0x5621150aeaf0 2024-09-10T23:26:32.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.077+0000 7f70a7a2f740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5621150c0c50 con 0x5621150a2240 2024-09-10T23:26:32.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.077+0000 7f70a7a2f740 10 client.0 _ll_register_callbacks cb 0x7f70880e9cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:32.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.078+0000 7f7095400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5621150a2b60 0x5621150c25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:32.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.078+0000 7f7095400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5621150a2b60 0x5621150c25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50080/0 (socket says 172.21.15.3:50080) 2024-09-10T23:26:32.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.078+0000 7f7095400640 1 -- 172.21.15.3:0/1888324823 learned_addr learned my addr 172.21.15.3:0/1888324823 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:32.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.078+0000 7f709de00640 1 --2- 172.21.15.3:0/1888324823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621150a2240 0x5621150c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:32.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.078+0000 7f7095400640 1 -- 172.21.15.3:0/1888324823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621150a2240 msgr2=0x5621150c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:32.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.078+0000 7f7095400640 1 --2- 172.21.15.3:0/1888324823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621150a2240 0x5621150c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:32.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.078+0000 7f709e800640 1 --2- 172.21.15.3:0/1888324823 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5621150aeaf0 0x5621150c2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:32.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.078+0000 7f7095400640 1 -- 172.21.15.3:0/1888324823 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5621150aeaf0 msgr2=0x5621150c2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:32.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.078+0000 7f7095400640 1 --2- 172.21.15.3:0/1888324823 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5621150aeaf0 0x5621150c2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:32.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.078+0000 7f7095400640 1 -- 172.21.15.3:0/1888324823 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621150c3310 con 0x5621150a2b60 2024-09-10T23:26:32.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.078+0000 7f709e800640 1 --2- 172.21.15.3:0/1888324823 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5621150aeaf0 0x5621150c2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:32.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.078+0000 7f7095400640 1 --2- 172.21.15.3:0/1888324823 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5621150a2b60 0x5621150c25a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f70880e9210 tx=0x7f70880e9ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56e37067804829a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:32.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.078+0000 7f7083e00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-10T23:26:32.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.079+0000 7f7083e00640 1 -- 172.21.15.3:0/1888324823 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7088021070 con 0x5621150a2b60 2024-09-10T23:26:32.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.079+0000 7f7083e00640 1 -- 172.21.15.3:0/1888324823 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f70880b5300 con 0x5621150a2b60 2024-09-10T23:26:32.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.079+0000 7f70a7a2f740 1 -- 172.21.15.3:0/1888324823 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7098020c10 con 0x5621150a2b60 2024-09-10T23:26:32.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.079+0000 7f7083e00640 1 -- 172.21.15.3:0/1888324823 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f70880a8700 con 0x5621150a2b60 2024-09-10T23:26:32.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.079+0000 7f70a7a2f740 10 client.15456 fetch_fsmap learned FSMap version 25 2024-09-10T23:26:32.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.079+0000 7f70a7a2f740 1 -- 172.21.15.3:0/1888324823 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562115134440 con 0x5621150a2b60 2024-09-10T23:26:32.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.079+0000 7f7083e00640 1 -- 172.21.15.3:0/1888324823 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7098020c10 con 0x5621150a2b60 2024-09-10T23:26:32.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.079+0000 7f7083e00640 1 -- 172.21.15.3:0/1888324823 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f70880ac310 con 0x5621150a2b60 2024-09-10T23:26:32.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.080+0000 7f70a7a2f740 10 client.15456 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:26:32.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.080+0000 7f70a7a2f740 10 client.15456 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-10T23:26:32.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.080+0000 7f70a7a2f740 20 client.15456 populate_metadata read hostname 'smithi003' 2024-09-10T23:26:32.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.080+0000 7f70a7a2f740 1 --2- 172.21.15.3:0/1888324823 >> [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] conn(0x562115138e00 0x562115137b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:32.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.080+0000 7f70a7a2f740 4 client.15456 mds_command: new command op to 34652 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:26:32.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.080+0000 7f70a7a2f740 1 -- 172.21.15.3:0/1888324823 --> [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] -- command(tid 0: {"prefix": "status"}) -- 0x562115017750 con 0x562115138e00 2024-09-10T23:26:32.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.080+0000 7f709de00640 1 --2- 172.21.15.3:0/1888324823 >> [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] conn(0x562115138e00 0x562115137b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:32.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.081+0000 7f709de00640 1 --2- 172.21.15.3:0/1888324823 >> [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] conn(0x562115138e00 0x562115137b10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8efac473a7064217 server_cookie=34717fdb3d3d010b in_seq=0 out_seq=0 2024-09-10T23:26:32.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.081+0000 7f7083e00640 10 client.15456 ms_handle_connect on v2:172.21.15.38:6834/218783320 2024-09-10T23:26:32.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.081+0000 7f7083e00640 1 -- 172.21.15.3:0/1888324823 <== mds.2 v2:172.21.15.38:6834/218783320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x562115017750 con 0x562115138e00 2024-09-10T23:26:32.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.081+0000 7f7083e00640 10 client.15456 handle_command_reply: tid=0 2024-09-10T23:26:32.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.081+0000 7f70a7a2f740 1 client.15456 shutdown 2024-09-10T23:26:32.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.081+0000 7f70a7a2f740 1 -- 172.21.15.3:0/1888324823 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5621150a2b60 msgr2=0x5621150c25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:32.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.081+0000 7f70a7a2f740 1 --2- 172.21.15.3:0/1888324823 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5621150a2b60 0x5621150c25a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f70880e9210 tx=0x7f70880e9ba0 comp rx=0 tx=0).stop 2024-09-10T23:26:32.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.081+0000 7f70a7a2f740 1 -- 172.21.15.3:0/1888324823 shutdown_connections 2024-09-10T23:26:32.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.081+0000 7f70a7a2f740 1 --2- 172.21.15.3:0/1888324823 >> [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] conn(0x562115138e00 0x562115137b10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:32.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.081+0000 7f70a7a2f740 1 --2- 172.21.15.3:0/1888324823 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5621150aeaf0 0x5621150c2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:32.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.081+0000 7f7083e00640 0 client.15456 ms_handle_reset on v2:172.21.15.38:6834/218783320 2024-09-10T23:26:32.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.081+0000 7f70a7a2f740 1 --2- 172.21.15.3:0/1888324823 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5621150a2b60 0x5621150c25a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:32.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.081+0000 7f70a7a2f740 1 --2- 172.21.15.3:0/1888324823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621150a2240 0x5621150c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:32.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.081+0000 7f70a7a2f740 1 -- 172.21.15.3:0/1888324823 >> 172.21.15.3:0/1888324823 conn(0x5621150a0020 msgr2=0x5621150aa330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:32.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.081+0000 7f70a7a2f740 1 -- 172.21.15.3:0/1888324823 shutdown_connections 2024-09-10T23:26:32.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.082+0000 7f70a7a2f740 1 -- 172.21.15.3:0/1888324823 wait complete. 2024-09-10T23:26:32.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.082+0000 7f70a7a2f740 20 client.15456 trim_cache size 0 max 16384 2024-09-10T23:26:32.089 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-10T23:26:32.089 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_fsid": "3f4e30d0-6fca-11ef-bcea-c7b262605968", 2024-09-10T23:26:32.089 INFO:teuthology.orchestra.run.smithi003.stdout: "whoami": 2, 2024-09-10T23:26:32.090 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 34652, 2024-09-10T23:26:32.090 INFO:teuthology.orchestra.run.smithi003.stdout: "want_state": "up:active", 2024-09-10T23:26:32.090 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "up:active", 2024-09-10T23:26:32.090 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs", 2024-09-10T23:26:32.090 INFO:teuthology.orchestra.run.smithi003.stdout: "rank_uptime": 103.847180241, 2024-09-10T23:26:32.090 INFO:teuthology.orchestra.run.smithi003.stdout: "mdsmap_epoch": 25, 2024-09-10T23:26:32.090 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch": 90, 2024-09-10T23:26:32.090 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch_barrier": 88, 2024-09-10T23:26:32.090 INFO:teuthology.orchestra.run.smithi003.stdout: "uptime": 192.085453366 2024-09-10T23:26:32.090 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-10T23:26:32.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.082+0000 7f70a5000640 1 -- 172.21.15.3:0/1969175512 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f70840b5330 msgr2=0x7f70840b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:32.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.082+0000 7f70a5000640 1 --2- 172.21.15.3:0/1969175512 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f70840b5330 0x7f70840b77f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7098005fd0 tx=0x7f7098009600 comp rx=0 tx=0).stop 2024-09-10T23:26:32.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.082+0000 7f70a5000640 1 -- 172.21.15.3:0/1969175512 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f70a01045e0 msgr2=0x7f70a019b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:32.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.082+0000 7f70a5000640 1 --2- 172.21.15.3:0/1969175512 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f70a01045e0 0x7f70a019b970 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f708800d6b0 tx=0x7f708800db70 comp rx=0 tx=0).stop 2024-09-10T23:26:32.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.082+0000 7f70a5000640 1 -- 172.21.15.3:0/1969175512 shutdown_connections 2024-09-10T23:26:32.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.082+0000 7f70a5000640 1 --2- 172.21.15.3:0/1969175512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70a010d120 0x7f70a01a0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:32.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.082+0000 7f70a5000640 1 --2- 172.21.15.3:0/1969175512 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f70840b5330 0x7f70840b77f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:32.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.082+0000 7f70a5000640 1 --2- 172.21.15.3:0/1969175512 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f70a01045e0 0x7f70a019b970 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:32.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.082+0000 7f70a5000640 1 --2- 172.21.15.3:0/1969175512 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70a0103cc0 0x7f70a019b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:32.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.082+0000 7f70a5000640 1 -- 172.21.15.3:0/1969175512 >> 172.21.15.3:0/1969175512 conn(0x7f70a00fd700 msgr2=0x7f70a00ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:32.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.083+0000 7f70a5000640 1 -- 172.21.15.3:0/1969175512 shutdown_connections 2024-09-10T23:26:32.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:32.083+0000 7f70a5000640 1 -- 172.21.15.3:0/1969175512 wait complete. 2024-09-10T23:26:32.502 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:32 smithi003 ceph-mon[30348]: pgmap v383: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-10T23:26:32.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:32 smithi038 ceph-mon[34225]: pgmap v383: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-10T23:26:32.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:32 smithi194 ceph-mon[33904]: pgmap v383: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-10T23:26:32.870 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-10T23:26:33.250 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:33.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.849+0000 7fb92a200640 1 -- 172.21.15.3:0/3076372086 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb924102dc0 msgr2=0x7fb9241031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:33.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.849+0000 7fb92a200640 1 --2- 172.21.15.3:0/3076372086 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb924102dc0 0x7fb9241031a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb914009900 tx=0x7fb91402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.849+0000 7fb92a200640 1 -- 172.21.15.3:0/3076372086 shutdown_connections 2024-09-10T23:26:33.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.849+0000 7fb92a200640 1 --2- 172.21.15.3:0/3076372086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb924109150 0x7fb92410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.849+0000 7fb92a200640 1 --2- 172.21.15.3:0/3076372086 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9241087d0 0x7fb924108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.849+0000 7fb92a200640 1 --2- 172.21.15.3:0/3076372086 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb924102dc0 0x7fb9241031a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.849+0000 7fb92a200640 1 -- 172.21.15.3:0/3076372086 >> 172.21.15.3:0/3076372086 conn(0x7fb9240fe830 msgr2=0x7fb924100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:33.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.849+0000 7fb92a200640 1 -- 172.21.15.3:0/3076372086 shutdown_connections 2024-09-10T23:26:33.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.849+0000 7fb92a200640 1 -- 172.21.15.3:0/3076372086 wait complete. 2024-09-10T23:26:33.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.850+0000 7fb92a200640 1 Processor -- start 2024-09-10T23:26:33.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.850+0000 7fb92a200640 1 -- start start 2024-09-10T23:26:33.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.850+0000 7fb92a200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb924102dc0 0x7fb9240754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:33.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.850+0000 7fb92a200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9241087d0 0x7fb9240759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:33.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.850+0000 7fb92a200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb924109150 0x7fb924075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:33.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.850+0000 7fb92a200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb924112cc0 con 0x7fb924109150 2024-09-10T23:26:33.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.850+0000 7fb92a200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb924112b40 con 0x7fb924102dc0 2024-09-10T23:26:33.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.850+0000 7fb92a200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb924112e40 con 0x7fb9241087d0 2024-09-10T23:26:33.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.851+0000 7fb923e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb924109150 0x7fb924075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:33.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.851+0000 7fb923e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb924109150 0x7fb924075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50104/0 (socket says 172.21.15.3:50104) 2024-09-10T23:26:33.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.851+0000 7fb923e00640 1 -- 172.21.15.3:0/2076660728 learned_addr learned my addr 172.21.15.3:0/2076660728 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:33.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.851+0000 7fb923400640 1 --2- 172.21.15.3:0/2076660728 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb924102dc0 0x7fb9240754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:33.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.851+0000 7fb91aa00640 1 --2- 172.21.15.3:0/2076660728 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9241087d0 0x7fb9240759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:33.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.851+0000 7fb923e00640 1 -- 172.21.15.3:0/2076660728 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9241087d0 msgr2=0x7fb9240759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:33.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.851+0000 7fb923e00640 1 --2- 172.21.15.3:0/2076660728 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9241087d0 0x7fb9240759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.851+0000 7fb923e00640 1 -- 172.21.15.3:0/2076660728 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb924102dc0 msgr2=0x7fb9240754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:33.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.851+0000 7fb923e00640 1 --2- 172.21.15.3:0/2076660728 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb924102dc0 0x7fb9240754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.851+0000 7fb923e00640 1 -- 172.21.15.3:0/2076660728 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9241a7610 con 0x7fb924109150 2024-09-10T23:26:33.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.851+0000 7fb91aa00640 1 --2- 172.21.15.3:0/2076660728 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9241087d0 0x7fb9240759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:33.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.852+0000 7fb923e00640 1 --2- 172.21.15.3:0/2076660728 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb924109150 0x7fb924075f20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00eaa0 tx=0x7fb91c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:33.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.852+0000 7fb920c00640 1 -- 172.21.15.3:0/2076660728 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c00cdb0 con 0x7fb924109150 2024-09-10T23:26:33.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.852+0000 7fb920c00640 1 -- 172.21.15.3:0/2076660728 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb91c005020 con 0x7fb924109150 2024-09-10T23:26:33.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.852+0000 7fb92a200640 1 -- 172.21.15.3:0/2076660728 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9241a7900 con 0x7fb924109150 2024-09-10T23:26:33.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.852+0000 7fb920c00640 1 -- 172.21.15.3:0/2076660728 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c0116d0 con 0x7fb924109150 2024-09-10T23:26:33.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.852+0000 7fb92a200640 1 -- 172.21.15.3:0/2076660728 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9241a7e40 con 0x7fb924109150 2024-09-10T23:26:33.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.855+0000 7fb92cbcd740 1 Processor -- start 2024-09-10T23:26:33.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.855+0000 7fb920c00640 1 -- 172.21.15.3:0/2076660728 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 22) ==== 153266+0+0 (secure 0 0 0) 0x7fb91c00f040 con 0x7fb924109150 2024-09-10T23:26:33.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.856+0000 7fb92cbcd740 1 -- start start 2024-09-10T23:26:33.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.856+0000 7fb92cbcd740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56521686b240 0x56521686b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:33.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.856+0000 7fb92cbcd740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56521686bb60 0x5652168775b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:33.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.856+0000 7fb92cbcd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x565216877af0 0x565216879ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:33.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.856+0000 7fb92cbcd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5652167e2d50 con 0x565216877af0 2024-09-10T23:26:33.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.856+0000 7fb92cbcd740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5652167d2180 con 0x56521686b240 2024-09-10T23:26:33.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.856+0000 7fb92cbcd740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5652167d5f90 con 0x56521686bb60 2024-09-10T23:26:33.859 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.856+0000 7fb91aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x565216877af0 0x565216879ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:33.859 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.856+0000 7fb91aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x565216877af0 0x565216879ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50114/0 (socket says 172.21.15.3:50114) 2024-09-10T23:26:33.859 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.856+0000 7fb923400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56521686bb60 0x5652168775b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:33.859 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.856+0000 7fb91aa00640 1 -- 172.21.15.3:0/2555579169 learned_addr learned my addr 172.21.15.3:0/2555579169 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:33.859 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.857+0000 7fb91aa00640 1 --2- 172.21.15.3:0/2555579169 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56521686b240 0x56521686b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:33.859 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.857+0000 7fb923400640 1 -- 172.21.15.3:0/2555579169 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56521686b240 msgr2=0x56521686b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:33.859 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.857+0000 7fb923400640 1 --2- 172.21.15.3:0/2555579169 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56521686b240 0x56521686b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.859 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.857+0000 7fb923400640 1 -- 172.21.15.3:0/2555579169 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x565216877af0 msgr2=0x565216879ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:33.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.857+0000 7fb923400640 1 --2- 172.21.15.3:0/2555579169 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x565216877af0 0x565216879ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.857+0000 7fb923400640 1 -- 172.21.15.3:0/2555579169 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56521679ca70 con 0x56521686bb60 2024-09-10T23:26:33.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.857+0000 7fb91aa00640 1 --2- 172.21.15.3:0/2555579169 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x565216877af0 0x565216879ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:26:33.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.857+0000 7fb923400640 1 --2- 172.21.15.3:0/2555579169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56521686bb60 0x5652168775b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb914005940 tx=0x7fb914031bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee2eccebcc67c6ac server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:33.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.858+0000 7fb920c00640 1 --2- 172.21.15.3:0/2076660728 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb9080b5330 0x7fb9080b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:33.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.858+0000 7fb913e00640 1 -- 172.21.15.3:0/2555579169 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb914035070 con 0x56521686bb60 2024-09-10T23:26:33.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.858+0000 7fb913e00640 1 -- 172.21.15.3:0/2555579169 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb914040070 con 0x56521686bb60 2024-09-10T23:26:33.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.858+0000 7fb913e00640 1 -- 172.21.15.3:0/2555579169 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb914003ae0 con 0x56521686bb60 2024-09-10T23:26:33.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.858+0000 7fb920c00640 1 -- 172.21.15.3:0/2076660728 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7fb91c0e62a0 con 0x7fb924109150 2024-09-10T23:26:33.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.858+0000 7fb91aa00640 1 --2- 172.21.15.3:0/2076660728 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb9080b5330 0x7fb9080b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:33.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.859+0000 7fb92cbcd740 1 -- 172.21.15.3:0/2555579169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56521686bb60 msgr2=0x5652168775b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:33.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.859+0000 7fb92cbcd740 1 --2- 172.21.15.3:0/2555579169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56521686bb60 0x5652168775b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb914005940 tx=0x7fb914031bc0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.859+0000 7fb91aa00640 1 --2- 172.21.15.3:0/2076660728 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb9080b5330 0x7fb9080b77f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x56521686b1f0 tx=0x7fb90c00b5b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:33.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.859+0000 7fb92cbcd740 1 -- 172.21.15.3:0/2555579169 shutdown_connections 2024-09-10T23:26:33.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.859+0000 7fb92cbcd740 1 --2- 172.21.15.3:0/2555579169 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x565216877af0 0x565216879ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.859+0000 7fb92cbcd740 1 --2- 172.21.15.3:0/2555579169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56521686bb60 0x5652168775b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.859+0000 7fb92cbcd740 1 --2- 172.21.15.3:0/2555579169 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56521686b240 0x56521686b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.859+0000 7fb92cbcd740 1 -- 172.21.15.3:0/2555579169 >> 172.21.15.3:0/2555579169 conn(0x565216869020 msgr2=0x56521686a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:33.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.859+0000 7fb92cbcd740 1 -- 172.21.15.3:0/2555579169 shutdown_connections 2024-09-10T23:26:33.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.859+0000 7fb92cbcd740 1 -- 172.21.15.3:0/2555579169 wait complete. 2024-09-10T23:26:33.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.859+0000 7fb92cbcd740 1 -- start start 2024-09-10T23:26:33.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.860+0000 7fb92cbcd740 1 Processor -- start 2024-09-10T23:26:33.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.860+0000 7fb92cbcd740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56521686b240 0x565216874a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:33.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.860+0000 7fb92cbcd740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56521686bb60 0x565216874f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:33.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.860+0000 7fb92cbcd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x565216877af0 0x5652168754c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:33.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.860+0000 7fb92cbcd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5652166335f0 con 0x565216877af0 2024-09-10T23:26:33.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.860+0000 7fb92cbcd740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x56521676d460 con 0x56521686bb60 2024-09-10T23:26:33.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.860+0000 7fb92cbcd740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56521687a7e0 con 0x56521686b240 2024-09-10T23:26:33.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.860+0000 7fb92cbcd740 10 client.0 _ll_register_callbacks cb 0x56521677d210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:33.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.860+0000 7fb923e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x565216877af0 0x5652168754c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:33.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.860+0000 7fb923e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x565216877af0 0x5652168754c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50120/0 (socket says 172.21.15.3:50120) 2024-09-10T23:26:33.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.860+0000 7fb923e00640 1 -- 172.21.15.3:0/2786306595 learned_addr learned my addr 172.21.15.3:0/2786306595 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:33.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.860+0000 7fb923400640 1 --2- 172.21.15.3:0/2786306595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56521686b240 0x565216874a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:33.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.861+0000 7fb91aa00640 1 --2- 172.21.15.3:0/2786306595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56521686bb60 0x565216874f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:33.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.861+0000 7fb923e00640 1 -- 172.21.15.3:0/2786306595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56521686b240 msgr2=0x565216874a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:33.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.861+0000 7fb923e00640 1 --2- 172.21.15.3:0/2786306595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56521686b240 0x565216874a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.861+0000 7fb923e00640 1 -- 172.21.15.3:0/2786306595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56521686bb60 msgr2=0x565216874f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:33.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.861+0000 7fb923e00640 1 --2- 172.21.15.3:0/2786306595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56521686bb60 0x565216874f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.861+0000 7fb923e00640 1 -- 172.21.15.3:0/2786306595 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565216530540 con 0x565216877af0 2024-09-10T23:26:33.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.861+0000 7fb923e00640 1 --2- 172.21.15.3:0/2786306595 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x565216877af0 0x5652168754c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb91c005bc0 tx=0x7fb91c0abce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26bbc9d5ca91433e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:33.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.861+0000 7fb910c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-10T23:26:33.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.861+0000 7fb910c00640 1 -- 172.21.15.3:0/2786306595 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c01f070 con 0x565216877af0 2024-09-10T23:26:33.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.861+0000 7fb910c00640 1 -- 172.21.15.3:0/2786306595 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7fb91c0b5670 con 0x565216877af0 2024-09-10T23:26:33.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.861+0000 7fb92cbcd740 1 -- 172.21.15.3:0/2786306595 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56521676fa70 con 0x565216877af0 2024-09-10T23:26:33.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.862+0000 7fb910c00640 1 -- 172.21.15.3:0/2786306595 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb91c0ac570 con 0x565216877af0 2024-09-10T23:26:33.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.862+0000 7fb92cbcd740 10 client.15468 fetch_fsmap learned FSMap version 25 2024-09-10T23:26:33.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.862+0000 7fb92cbcd740 1 -- 172.21.15.3:0/2786306595 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56521678a6f0 con 0x565216877af0 2024-09-10T23:26:33.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.862+0000 7fb910c00640 1 -- 172.21.15.3:0/2786306595 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56521676fa70 con 0x565216877af0 2024-09-10T23:26:33.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.862+0000 7fb910c00640 1 -- 172.21.15.3:0/2786306595 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fb91c0d31a0 con 0x565216877af0 2024-09-10T23:26:33.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.862+0000 7fb92cbcd740 10 client.15468 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:26:33.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.862+0000 7fb92cbcd740 10 client.15468 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T23:26:33.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.862+0000 7fb92cbcd740 20 client.15468 populate_metadata read hostname 'smithi003' 2024-09-10T23:26:33.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.862+0000 7fb92cbcd740 1 --2- 172.21.15.3:0/2786306595 >> [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] conn(0x5652168887c0 0x565216889c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:33.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.862+0000 7fb92cbcd740 4 client.15468 mds_command: new command op to 34682 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:26:33.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.862+0000 7fb92cbcd740 1 -- 172.21.15.3:0/2786306595 --> [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5652167e4ca0 con 0x5652168887c0 2024-09-10T23:26:33.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.863+0000 7fb923400640 1 --2- 172.21.15.3:0/2786306595 >> [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] conn(0x5652168887c0 0x565216889c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:33.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.864+0000 7fb923400640 1 --2- 172.21.15.3:0/2786306595 >> [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] conn(0x5652168887c0 0x565216889c30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1ae5c1cdd896ccca server_cookie=cc0db32cfea933ce in_seq=0 out_seq=0 2024-09-10T23:26:33.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.864+0000 7fb910c00640 10 client.15468 ms_handle_connect on v2:172.21.15.38:6836/1821839397 2024-09-10T23:26:33.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.865+0000 7fb910c00640 1 -- 172.21.15.3:0/2786306595 <== mds.1 v2:172.21.15.38:6836/1821839397 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5652167e4ca0 con 0x5652168887c0 2024-09-10T23:26:33.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.865+0000 7fb910c00640 10 client.15468 handle_command_reply: tid=0 2024-09-10T23:26:33.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.865+0000 7fb92cbcd740 1 client.15468 shutdown 2024-09-10T23:26:33.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.865+0000 7fb92cbcd740 1 -- 172.21.15.3:0/2786306595 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x565216877af0 msgr2=0x5652168754c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:33.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.865+0000 7fb92cbcd740 1 --2- 172.21.15.3:0/2786306595 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x565216877af0 0x5652168754c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb91c005bc0 tx=0x7fb91c0abce0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.865+0000 7fb92cbcd740 1 -- 172.21.15.3:0/2786306595 shutdown_connections 2024-09-10T23:26:33.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.865+0000 7fb92cbcd740 1 --2- 172.21.15.3:0/2786306595 >> [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] conn(0x5652168887c0 0x565216889c30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.865+0000 7fb92cbcd740 1 --2- 172.21.15.3:0/2786306595 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x565216877af0 0x5652168754c0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.865+0000 7fb92cbcd740 1 --2- 172.21.15.3:0/2786306595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56521686bb60 0x565216874f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.865+0000 7fb92cbcd740 1 --2- 172.21.15.3:0/2786306595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56521686b240 0x565216874a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.865+0000 7fb92cbcd740 1 -- 172.21.15.3:0/2786306595 >> 172.21.15.3:0/2786306595 conn(0x565216869020 msgr2=0x56521686ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:33.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.865+0000 7fb910c00640 0 client.15468 ms_handle_reset on v2:172.21.15.38:6836/1821839397 2024-09-10T23:26:33.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.865+0000 7fb92cbcd740 1 -- 172.21.15.3:0/2786306595 shutdown_connections 2024-09-10T23:26:33.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.865+0000 7fb92cbcd740 1 -- 172.21.15.3:0/2786306595 wait complete. 2024-09-10T23:26:33.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.865+0000 7fb92cbcd740 20 client.15468 trim_cache size 0 max 16384 2024-09-10T23:26:33.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.884+0000 7fb92cbcd740 1 Processor -- start 2024-09-10T23:26:33.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.884+0000 7fb92cbcd740 1 -- start start 2024-09-10T23:26:33.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.885+0000 7fb92cbcd740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56521686b240 0x565216889c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:33.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.885+0000 7fb92cbcd740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56521686bb60 0x5652168876f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:33.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.885+0000 7fb92cbcd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x565216877af0 0x565216871c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:33.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.885+0000 7fb92cbcd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x565216887f70 con 0x565216877af0 2024-09-10T23:26:33.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.885+0000 7fb92cbcd740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x565216888640 con 0x56521686bb60 2024-09-10T23:26:33.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.885+0000 7fb92cbcd740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x565216888d10 con 0x56521686b240 2024-09-10T23:26:33.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.885+0000 7fb923e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x565216877af0 0x565216871c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:33.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.885+0000 7fb923e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x565216877af0 0x565216871c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50132/0 (socket says 172.21.15.3:50132) 2024-09-10T23:26:33.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.885+0000 7fb923e00640 1 -- 172.21.15.3:0/2014147069 learned_addr learned my addr 172.21.15.3:0/2014147069 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:33.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.885+0000 7fb91aa00640 1 --2- 172.21.15.3:0/2014147069 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56521686bb60 0x5652168876f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:33.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.885+0000 7fb923400640 1 --2- 172.21.15.3:0/2014147069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56521686b240 0x565216889c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:33.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.885+0000 7fb923e00640 1 -- 172.21.15.3:0/2014147069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56521686b240 msgr2=0x565216889c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:33.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.885+0000 7fb923e00640 1 --2- 172.21.15.3:0/2014147069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56521686b240 0x565216889c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.885+0000 7fb923e00640 1 -- 172.21.15.3:0/2014147069 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56521686bb60 msgr2=0x5652168876f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:33.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.885+0000 7fb923e00640 1 --2- 172.21.15.3:0/2014147069 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56521686bb60 0x5652168876f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.885+0000 7fb923e00640 1 -- 172.21.15.3:0/2014147069 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56521686b990 con 0x565216877af0 2024-09-10T23:26:33.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.885+0000 7fb923400640 1 --2- 172.21.15.3:0/2014147069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56521686b240 0x565216889c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:33.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.886+0000 7fb923e00640 1 --2- 172.21.15.3:0/2014147069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x565216877af0 0x565216871c50 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb91c0ac270 tx=0x7fb91c0abe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66187fb98c728917 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:33.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.886+0000 7fb913400640 1 -- 172.21.15.3:0/2014147069 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c01f050 con 0x565216877af0 2024-09-10T23:26:33.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.886+0000 7fb913400640 1 -- 172.21.15.3:0/2014147069 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb91c0b1050 con 0x565216877af0 2024-09-10T23:26:33.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.886+0000 7fb913400640 1 -- 172.21.15.3:0/2014147069 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c0b5670 con 0x565216877af0 2024-09-10T23:26:33.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.887+0000 7fb92cbcd740 1 -- 172.21.15.3:0/2014147069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x565216877af0 msgr2=0x565216871c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:33.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.887+0000 7fb92cbcd740 1 --2- 172.21.15.3:0/2014147069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x565216877af0 0x565216871c50 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb91c0ac270 tx=0x7fb91c0abe10 comp rx=0 tx=0).stop 2024-09-10T23:26:33.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.887+0000 7fb92cbcd740 1 -- 172.21.15.3:0/2014147069 shutdown_connections 2024-09-10T23:26:33.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.887+0000 7fb92cbcd740 1 --2- 172.21.15.3:0/2014147069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x565216877af0 0x565216871c50 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.887+0000 7fb92cbcd740 1 --2- 172.21.15.3:0/2014147069 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56521686bb60 0x5652168876f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.887+0000 7fb92cbcd740 1 --2- 172.21.15.3:0/2014147069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56521686b240 0x565216889c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.887+0000 7fb92cbcd740 1 -- 172.21.15.3:0/2014147069 >> 172.21.15.3:0/2014147069 conn(0x565216869020 msgr2=0x5652168732c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:33.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.887+0000 7fb92cbcd740 1 -- 172.21.15.3:0/2014147069 shutdown_connections 2024-09-10T23:26:33.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.887+0000 7fb92cbcd740 1 -- 172.21.15.3:0/2014147069 wait complete. 2024-09-10T23:26:33.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.887+0000 7fb92cbcd740 1 -- start start 2024-09-10T23:26:33.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.887+0000 7fb92cbcd740 1 Processor -- start 2024-09-10T23:26:33.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.888+0000 7fb92cbcd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56521686b240 0x56521688c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:33.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.888+0000 7fb92cbcd740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56521686bb60 0x56521688ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:33.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.888+0000 7fb92cbcd740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565216877af0 0x565216891b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:33.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.888+0000 7fb92cbcd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x565216889ab0 con 0x56521686b240 2024-09-10T23:26:33.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.888+0000 7fb92cbcd740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5652168893e0 con 0x56521686bb60 2024-09-10T23:26:33.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.888+0000 7fb92cbcd740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56521688a180 con 0x565216877af0 2024-09-10T23:26:33.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.888+0000 7fb92cbcd740 10 client.0 _ll_register_callbacks cb 0x7fb91c0abec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:33.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.888+0000 7fb923400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56521686b240 0x56521688c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:33.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.888+0000 7fb923400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56521686b240 0x56521688c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50136/0 (socket says 172.21.15.3:50136) 2024-09-10T23:26:33.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.888+0000 7fb923400640 1 -- 172.21.15.3:0/2931906620 learned_addr learned my addr 172.21.15.3:0/2931906620 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:33.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.888+0000 7fb91aa00640 1 --2- 172.21.15.3:0/2931906620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56521686bb60 0x56521688ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:33.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.888+0000 7fb923e00640 1 --2- 172.21.15.3:0/2931906620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565216877af0 0x565216891b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:33.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.889+0000 7fb923400640 1 -- 172.21.15.3:0/2931906620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565216877af0 msgr2=0x565216891b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:33.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.889+0000 7fb923400640 1 --2- 172.21.15.3:0/2931906620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565216877af0 0x565216891b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.889+0000 7fb923400640 1 -- 172.21.15.3:0/2931906620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56521686bb60 msgr2=0x56521688ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:33.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.889+0000 7fb923400640 1 --2- 172.21.15.3:0/2931906620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56521686bb60 0x56521688ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.889+0000 7fb923400640 1 -- 172.21.15.3:0/2931906620 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652168920c0 con 0x56521686b240 2024-09-10T23:26:33.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.889+0000 7fb923400640 1 --2- 172.21.15.3:0/2931906620 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56521686b240 0x56521688c550 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb914009230 tx=0x7fb914000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d143f570c4412ccf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:33.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.889+0000 7fb910c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-10T23:26:33.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.889+0000 7fb910c00640 1 -- 172.21.15.3:0/2931906620 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb914054030 con 0x56521686b240 2024-09-10T23:26:33.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.889+0000 7fb910c00640 1 -- 172.21.15.3:0/2931906620 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7fb9140317d0 con 0x56521686b240 2024-09-10T23:26:33.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.889+0000 7fb92cbcd740 1 -- 172.21.15.3:0/2931906620 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb91c0b1050 con 0x56521686b240 2024-09-10T23:26:33.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.890+0000 7fb910c00640 1 -- 172.21.15.3:0/2931906620 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb914061050 con 0x56521686b240 2024-09-10T23:26:33.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.890+0000 7fb92cbcd740 10 client.15474 fetch_fsmap learned FSMap version 25 2024-09-10T23:26:33.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.890+0000 7fb92cbcd740 1 -- 172.21.15.3:0/2931906620 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5652168fe100 con 0x56521686b240 2024-09-10T23:26:33.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.890+0000 7fb910c00640 1 -- 172.21.15.3:0/2931906620 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb91c0b1050 con 0x56521686b240 2024-09-10T23:26:33.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.890+0000 7fb910c00640 1 -- 172.21.15.3:0/2931906620 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fb91404e070 con 0x56521686b240 2024-09-10T23:26:33.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.890+0000 7fb92cbcd740 10 client.15474 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:26:33.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.890+0000 7fb92cbcd740 10 client.15474 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T23:26:33.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.890+0000 7fb92cbcd740 20 client.15474 populate_metadata read hostname 'smithi003' 2024-09-10T23:26:33.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.890+0000 7fb92cbcd740 1 --2- 172.21.15.3:0/2931906620 >> [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] conn(0x5652169028e0 0x5652169015f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:33.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.890+0000 7fb92cbcd740 4 client.15474 mds_command: new command op to 34682 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:26:33.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.890+0000 7fb92cbcd740 1 -- 172.21.15.3:0/2931906620 --> [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] -- command(tid 0: {"prefix": "status"}) -- 0x5652167e0750 con 0x5652169028e0 2024-09-10T23:26:33.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.891+0000 7fb91aa00640 1 --2- 172.21.15.3:0/2931906620 >> [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] conn(0x5652169028e0 0x5652169015f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:33.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.892+0000 7fb91aa00640 1 --2- 172.21.15.3:0/2931906620 >> [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] conn(0x5652169028e0 0x5652169015f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cda726bffb28d6f0 server_cookie=2b56465facf3e5db in_seq=0 out_seq=0 2024-09-10T23:26:33.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.892+0000 7fb910c00640 10 client.15474 ms_handle_connect on v2:172.21.15.38:6836/1821839397 2024-09-10T23:26:33.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.892+0000 7fb910c00640 1 -- 172.21.15.3:0/2931906620 <== mds.1 v2:172.21.15.38:6836/1821839397 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5652167e0750 con 0x5652169028e0 2024-09-10T23:26:33.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.892+0000 7fb910c00640 10 client.15474 handle_command_reply: tid=0 2024-09-10T23:26:33.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.892+0000 7fb92cbcd740 1 client.15474 shutdown 2024-09-10T23:26:33.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.892+0000 7fb92cbcd740 1 -- 172.21.15.3:0/2931906620 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56521686b240 msgr2=0x56521688c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:33.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.892+0000 7fb92cbcd740 1 --2- 172.21.15.3:0/2931906620 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56521686b240 0x56521688c550 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb914009230 tx=0x7fb914000bc0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.892+0000 7fb92cbcd740 1 -- 172.21.15.3:0/2931906620 shutdown_connections 2024-09-10T23:26:33.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.892+0000 7fb92cbcd740 1 --2- 172.21.15.3:0/2931906620 >> [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] conn(0x5652169028e0 0x5652169015f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.892+0000 7fb92cbcd740 1 --2- 172.21.15.3:0/2931906620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565216877af0 0x565216891b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.892+0000 7fb92cbcd740 1 --2- 172.21.15.3:0/2931906620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56521686bb60 0x56521688ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.892+0000 7fb92cbcd740 1 --2- 172.21.15.3:0/2931906620 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56521686b240 0x56521688c550 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.892+0000 7fb92cbcd740 1 -- 172.21.15.3:0/2931906620 >> 172.21.15.3:0/2931906620 conn(0x565216869020 msgr2=0x56521686a570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:33.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.892+0000 7fb910c00640 0 client.15474 ms_handle_reset on v2:172.21.15.38:6836/1821839397 2024-09-10T23:26:33.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.892+0000 7fb92cbcd740 1 -- 172.21.15.3:0/2931906620 shutdown_connections 2024-09-10T23:26:33.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.892+0000 7fb92cbcd740 1 -- 172.21.15.3:0/2931906620 wait complete. 2024-09-10T23:26:33.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.893+0000 7fb92cbcd740 20 client.15474 trim_cache size 0 max 16384 2024-09-10T23:26:33.897 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-10T23:26:33.897 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_fsid": "3f4e30d0-6fca-11ef-bcea-c7b262605968", 2024-09-10T23:26:33.897 INFO:teuthology.orchestra.run.smithi003.stdout: "whoami": 1, 2024-09-10T23:26:33.897 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 34682, 2024-09-10T23:26:33.897 INFO:teuthology.orchestra.run.smithi003.stdout: "want_state": "up:active", 2024-09-10T23:26:33.898 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "up:active", 2024-09-10T23:26:33.898 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs", 2024-09-10T23:26:33.898 INFO:teuthology.orchestra.run.smithi003.stdout: "rank_uptime": 106.668465496, 2024-09-10T23:26:33.898 INFO:teuthology.orchestra.run.smithi003.stdout: "mdsmap_epoch": 25, 2024-09-10T23:26:33.898 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch": 90, 2024-09-10T23:26:33.898 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch_barrier": 88, 2024-09-10T23:26:33.898 INFO:teuthology.orchestra.run.smithi003.stdout: "uptime": 183.88168214699999 2024-09-10T23:26:33.898 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-10T23:26:33.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.893+0000 7fb92a200640 1 -- 172.21.15.3:0/2076660728 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb9080b5330 msgr2=0x7fb9080b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:33.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.893+0000 7fb92a200640 1 --2- 172.21.15.3:0/2076660728 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb9080b5330 0x7fb9080b77f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x56521686b1f0 tx=0x7fb90c00b5b0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.893+0000 7fb92a200640 1 -- 172.21.15.3:0/2076660728 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb924109150 msgr2=0x7fb924075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:33.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.893+0000 7fb92a200640 1 --2- 172.21.15.3:0/2076660728 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb924109150 0x7fb924075f20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00eaa0 tx=0x7fb91c00ef60 comp rx=0 tx=0).stop 2024-09-10T23:26:33.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.893+0000 7fb92a200640 1 -- 172.21.15.3:0/2076660728 shutdown_connections 2024-09-10T23:26:33.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.893+0000 7fb92a200640 1 --2- 172.21.15.3:0/2076660728 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb9080b5330 0x7fb9080b77f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.893+0000 7fb92a200640 1 --2- 172.21.15.3:0/2076660728 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb924109150 0x7fb924075f20 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.893+0000 7fb92a200640 1 --2- 172.21.15.3:0/2076660728 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9241087d0 0x7fb9240759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.893+0000 7fb92a200640 1 --2- 172.21.15.3:0/2076660728 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb924102dc0 0x7fb9240754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:33.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.893+0000 7fb92a200640 1 -- 172.21.15.3:0/2076660728 >> 172.21.15.3:0/2076660728 conn(0x7fb9240fe830 msgr2=0x7fb924100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:33.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.894+0000 7fb92a200640 1 -- 172.21.15.3:0/2076660728 shutdown_connections 2024-09-10T23:26:33.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:33.894+0000 7fb92a200640 1 -- 172.21.15.3:0/2076660728 wait complete. 2024-09-10T23:26:34.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:34 smithi038 ceph-mon[34225]: pgmap v384: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-10T23:26:34.673 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:34 smithi003 ceph-mon[30348]: pgmap v384: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-10T23:26:34.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:34 smithi194 ceph-mon[33904]: pgmap v384: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-10T23:26:34.711 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T23:26:35.091 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:35.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.640+0000 7fd8b7600640 1 -- 172.21.15.3:0/4169272239 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd8b0104fa0 msgr2=0x7fd8b0105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:35.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.640+0000 7fd8b7600640 1 --2- 172.21.15.3:0/4169272239 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd8b0104fa0 0x7fd8b0105380 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4009900 tx=0x7fd8a402a410 comp rx=0 tx=0).stop 2024-09-10T23:26:35.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.640+0000 7fd8b7600640 1 -- 172.21.15.3:0/4169272239 shutdown_connections 2024-09-10T23:26:35.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.640+0000 7fd8b7600640 1 --2- 172.21.15.3:0/4169272239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8b010b330 0x7fd8b0111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:35.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.640+0000 7fd8b7600640 1 --2- 172.21.15.3:0/4169272239 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8b010a9b0 0x7fd8b010adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:35.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.640+0000 7fd8b7600640 1 --2- 172.21.15.3:0/4169272239 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd8b0104fa0 0x7fd8b0105380 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:35.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.640+0000 7fd8b7600640 1 -- 172.21.15.3:0/4169272239 >> 172.21.15.3:0/4169272239 conn(0x7fd8b0100a50 msgr2=0x7fd8b0102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:35.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.640+0000 7fd8b7600640 1 -- 172.21.15.3:0/4169272239 shutdown_connections 2024-09-10T23:26:35.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.640+0000 7fd8b7600640 1 -- 172.21.15.3:0/4169272239 wait complete. 2024-09-10T23:26:35.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.641+0000 7fd8b7600640 1 Processor -- start 2024-09-10T23:26:35.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.641+0000 7fd8b7600640 1 -- start start 2024-09-10T23:26:35.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.642+0000 7fd8b7600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8b0104fa0 0x7fd8b019b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:35.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.642+0000 7fd8b7600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8b010a9b0 0x7fd8b019b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:35.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.642+0000 7fd8b7600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd8b010b330 0x7fd8b01a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:35.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.642+0000 7fd8b7600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b0114e10 con 0x7fd8b010b330 2024-09-10T23:26:35.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.642+0000 7fd8b7600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b0114c90 con 0x7fd8b0104fa0 2024-09-10T23:26:35.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.642+0000 7fd8b7600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b0114f90 con 0x7fd8b010a9b0 2024-09-10T23:26:35.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.642+0000 7fd8b5600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd8b010b330 0x7fd8b01a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:35.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.642+0000 7fd8b5600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd8b010b330 0x7fd8b01a0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50156/0 (socket says 172.21.15.3:50156) 2024-09-10T23:26:35.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.642+0000 7fd8b5600640 1 -- 172.21.15.3:0/3008922482 learned_addr learned my addr 172.21.15.3:0/3008922482 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:35.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.642+0000 7fd8b4c00640 1 --2- 172.21.15.3:0/3008922482 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8b0104fa0 0x7fd8b019b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:35.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.642+0000 7fd8afe00640 1 --2- 172.21.15.3:0/3008922482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8b010a9b0 0x7fd8b019b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:35.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.642+0000 7fd8b5600640 1 -- 172.21.15.3:0/3008922482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8b010a9b0 msgr2=0x7fd8b019b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:35.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.643+0000 7fd8b5600640 1 --2- 172.21.15.3:0/3008922482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8b010a9b0 0x7fd8b019b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:35.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.643+0000 7fd8b5600640 1 -- 172.21.15.3:0/3008922482 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8b0104fa0 msgr2=0x7fd8b019b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:35.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.643+0000 7fd8b5600640 1 --2- 172.21.15.3:0/3008922482 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8b0104fa0 0x7fd8b019b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:35.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.643+0000 7fd8b5600640 1 -- 172.21.15.3:0/3008922482 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8b01a1510 con 0x7fd8b010b330 2024-09-10T23:26:35.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.643+0000 7fd8b4c00640 1 --2- 172.21.15.3:0/3008922482 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8b0104fa0 0x7fd8b019b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:26:35.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.643+0000 7fd8b5600640 1 --2- 172.21.15.3:0/3008922482 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd8b010b330 0x7fd8b01a0d40 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd8a800eaa0 tx=0x7fd8a800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:35.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.643+0000 7fd8ad600640 1 -- 172.21.15.3:0/3008922482 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a800cdb0 con 0x7fd8b010b330 2024-09-10T23:26:35.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.643+0000 7fd8ad600640 1 -- 172.21.15.3:0/3008922482 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8a8005020 con 0x7fd8b010b330 2024-09-10T23:26:35.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.643+0000 7fd8ad600640 1 -- 172.21.15.3:0/3008922482 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a80116d0 con 0x7fd8b010b330 2024-09-10T23:26:35.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.643+0000 7fd8b7600640 1 -- 172.21.15.3:0/3008922482 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8b01a1800 con 0x7fd8b010b330 2024-09-10T23:26:35.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.643+0000 7fd8b7600640 1 -- 172.21.15.3:0/3008922482 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8b01a7ec0 con 0x7fd8b010b330 2024-09-10T23:26:35.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.646+0000 7fd8b9fba740 1 Processor -- start 2024-09-10T23:26:35.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.647+0000 7fd8ad600640 1 -- 172.21.15.3:0/3008922482 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 22) ==== 153266+0+0 (secure 0 0 0) 0x7fd8a800f040 con 0x7fd8b010b330 2024-09-10T23:26:35.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.647+0000 7fd8b9fba740 1 -- start start 2024-09-10T23:26:35.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.647+0000 7fd8b9fba740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cd3acf8240 0x55cd3acf8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:35.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.647+0000 7fd8b9fba740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cd3acf8b60 0x55cd3ad045b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:35.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.648+0000 7fd8b9fba740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cd3ad04af0 0x55cd3ad06ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:35.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.648+0000 7fd8b9fba740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55cd3ac6fd50 con 0x55cd3ad04af0 2024-09-10T23:26:35.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.648+0000 7fd8b9fba740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55cd3ac5f180 con 0x55cd3acf8240 2024-09-10T23:26:35.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.648+0000 7fd8b9fba740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55cd3ac62f90 con 0x55cd3acf8b60 2024-09-10T23:26:35.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.648+0000 7fd8afe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cd3ad04af0 0x55cd3ad06ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:35.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.648+0000 7fd8afe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cd3ad04af0 0x55cd3ad06ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50172/0 (socket says 172.21.15.3:50172) 2024-09-10T23:26:35.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.648+0000 7fd8afe00640 1 -- 172.21.15.3:0/964925327 learned_addr learned my addr 172.21.15.3:0/964925327 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:35.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.648+0000 7fd8b4c00640 1 --2- 172.21.15.3:0/964925327 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cd3acf8b60 0x55cd3ad045b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:35.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.648+0000 7fd8afe00640 1 --2- 172.21.15.3:0/964925327 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cd3acf8240 0x55cd3acf8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:35.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.648+0000 7fd8afe00640 1 -- 172.21.15.3:0/964925327 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cd3acf8b60 msgr2=0x55cd3ad045b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:35.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.648+0000 7fd8afe00640 1 --2- 172.21.15.3:0/964925327 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cd3acf8b60 0x55cd3ad045b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:35.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.649+0000 7fd8afe00640 1 -- 172.21.15.3:0/964925327 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cd3acf8240 msgr2=0x55cd3acf8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:35.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.649+0000 7fd8afe00640 1 --2- 172.21.15.3:0/964925327 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cd3acf8240 0x55cd3acf8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:35.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.649+0000 7fd8afe00640 1 -- 172.21.15.3:0/964925327 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd3ac29a70 con 0x55cd3ad04af0 2024-09-10T23:26:35.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.649+0000 7fd8afe00640 1 --2- 172.21.15.3:0/964925327 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cd3ad04af0 0x55cd3ad06ee0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd89c011820 tx=0x7fd89c005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f0f9cb3d7b4bfba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:35.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.649+0000 7fd8ad600640 1 --2- 172.21.15.3:0/3008922482 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd8980b53b0 0x7fd8980b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:35.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.649+0000 7fd8a1c00640 1 -- 172.21.15.3:0/964925327 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89c004030 con 0x55cd3ad04af0 2024-09-10T23:26:35.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.649+0000 7fd8a1c00640 1 -- 172.21.15.3:0/964925327 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd89c00f7c0 con 0x55cd3ad04af0 2024-09-10T23:26:35.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.649+0000 7fd8ad600640 1 -- 172.21.15.3:0/3008922482 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7fd8a80e5dd0 con 0x7fd8b010b330 2024-09-10T23:26:35.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.649+0000 7fd8a1c00640 1 -- 172.21.15.3:0/964925327 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89c003a10 con 0x55cd3ad04af0 2024-09-10T23:26:35.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.649+0000 7fd8b4c00640 1 --2- 172.21.15.3:0/3008922482 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd8980b53b0 0x7fd8980b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:35.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.650+0000 7fd8b9fba740 1 -- 172.21.15.3:0/964925327 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cd3ad04af0 msgr2=0x55cd3ad06ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:35.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.650+0000 7fd8b9fba740 1 --2- 172.21.15.3:0/964925327 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cd3ad04af0 0x55cd3ad06ee0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd89c011820 tx=0x7fd89c005850 comp rx=0 tx=0).stop 2024-09-10T23:26:35.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.650+0000 7fd8b4c00640 1 --2- 172.21.15.3:0/3008922482 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd8980b53b0 0x7fd8980b7870 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd8a40057c0 tx=0x7fd8a40058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:35.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.650+0000 7fd8b9fba740 1 -- 172.21.15.3:0/964925327 shutdown_connections 2024-09-10T23:26:35.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.650+0000 7fd8b9fba740 1 --2- 172.21.15.3:0/964925327 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cd3ad04af0 0x55cd3ad06ee0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:35.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.650+0000 7fd8b9fba740 1 --2- 172.21.15.3:0/964925327 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cd3acf8b60 0x55cd3ad045b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:35.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.650+0000 7fd8b9fba740 1 --2- 172.21.15.3:0/964925327 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cd3acf8240 0x55cd3acf8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:35.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.650+0000 7fd8b9fba740 1 -- 172.21.15.3:0/964925327 >> 172.21.15.3:0/964925327 conn(0x55cd3acf6020 msgr2=0x55cd3acf7210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:35.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.650+0000 7fd8b9fba740 1 -- 172.21.15.3:0/964925327 shutdown_connections 2024-09-10T23:26:35.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.650+0000 7fd8b9fba740 1 -- 172.21.15.3:0/964925327 wait complete. 2024-09-10T23:26:35.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.651+0000 7fd8b9fba740 1 -- start start 2024-09-10T23:26:35.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.651+0000 7fd8b9fba740 1 Processor -- start 2024-09-10T23:26:35.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.652+0000 7fd8b9fba740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cd3acf8240 0x55cd3ad01a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:35.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.652+0000 7fd8b9fba740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cd3acf8b60 0x55cd3ad01fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:35.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.652+0000 7fd8b9fba740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cd3ad04af0 0x55cd3ad02500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:35.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.652+0000 7fd8b9fba740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55cd3aac05f0 con 0x55cd3acf8b60 2024-09-10T23:26:35.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.652+0000 7fd8b9fba740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55cd3abfa460 con 0x55cd3acf8240 2024-09-10T23:26:35.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.652+0000 7fd8b9fba740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55cd3ad07840 con 0x55cd3ad04af0 2024-09-10T23:26:35.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.652+0000 7fd8b9fba740 10 client.0 _ll_register_callbacks cb 0x55cd3ac0a210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:35.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.652+0000 7fd8afe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cd3acf8b60 0x55cd3ad01fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:35.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.652+0000 7fd8b4c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cd3acf8240 0x55cd3ad01a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:35.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.652+0000 7fd8afe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cd3acf8b60 0x55cd3ad01fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50182/0 (socket says 172.21.15.3:50182) 2024-09-10T23:26:35.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.652+0000 7fd8afe00640 1 -- 172.21.15.3:0/98633011 learned_addr learned my addr 172.21.15.3:0/98633011 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:35.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.652+0000 7fd8b5600640 1 --2- 172.21.15.3:0/98633011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cd3ad04af0 0x55cd3ad02500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:35.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.652+0000 7fd8afe00640 1 -- 172.21.15.3:0/98633011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cd3ad04af0 msgr2=0x55cd3ad02500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:35.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.652+0000 7fd8afe00640 1 --2- 172.21.15.3:0/98633011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cd3ad04af0 0x55cd3ad02500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:35.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.653+0000 7fd8afe00640 1 -- 172.21.15.3:0/98633011 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cd3acf8240 msgr2=0x55cd3ad01a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:35.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.653+0000 7fd8afe00640 1 --2- 172.21.15.3:0/98633011 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cd3acf8240 0x55cd3ad01a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:35.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.653+0000 7fd8afe00640 1 -- 172.21.15.3:0/98633011 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd3a9bd540 con 0x55cd3acf8b60 2024-09-10T23:26:35.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.653+0000 7fd8afe00640 1 --2- 172.21.15.3:0/98633011 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cd3acf8b60 0x55cd3ad01fc0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd89c00fc80 tx=0x7fd89c00fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7539105215da6e30 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:35.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.653+0000 7fd896000640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-10T23:26:35.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.653+0000 7fd896000640 1 -- 172.21.15.3:0/98633011 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89c005070 con 0x55cd3acf8b60 2024-09-10T23:26:35.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.653+0000 7fd896000640 1 -- 172.21.15.3:0/98633011 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7fd89c005210 con 0x55cd3acf8b60 2024-09-10T23:26:35.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.653+0000 7fd8b9fba740 1 -- 172.21.15.3:0/98633011 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cd3abfca70 con 0x55cd3acf8b60 2024-09-10T23:26:35.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.653+0000 7fd896000640 1 -- 172.21.15.3:0/98633011 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd89c030050 con 0x55cd3acf8b60 2024-09-10T23:26:35.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.653+0000 7fd8b9fba740 10 client.15486 fetch_fsmap learned FSMap version 25 2024-09-10T23:26:35.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.653+0000 7fd8b9fba740 1 -- 172.21.15.3:0/98633011 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cd3ac176f0 con 0x55cd3acf8b60 2024-09-10T23:26:35.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.654+0000 7fd896000640 1 -- 172.21.15.3:0/98633011 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55cd3abfca70 con 0x55cd3acf8b60 2024-09-10T23:26:35.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.654+0000 7fd896000640 1 -- 172.21.15.3:0/98633011 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fd89c004b50 con 0x55cd3acf8b60 2024-09-10T23:26:35.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.654+0000 7fd8b9fba740 10 client.15486 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:26:35.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.654+0000 7fd8b9fba740 10 client.15486 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T23:26:35.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.654+0000 7fd8b9fba740 20 client.15486 populate_metadata read hostname 'smithi003' 2024-09-10T23:26:35.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.654+0000 7fd8b9fba740 1 --2- 172.21.15.3:0/98633011 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x55cd3ad155d0 0x55cd3ad16a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:35.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.654+0000 7fd8b9fba740 4 client.15486 mds_command: new command op to 34724 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:26:35.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.654+0000 7fd8b9fba740 1 -- 172.21.15.3:0/98633011 --> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd3ac71ca0 con 0x55cd3ad155d0 2024-09-10T23:26:35.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.655+0000 7fd8b4c00640 1 --2- 172.21.15.3:0/98633011 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x55cd3ad155d0 0x55cd3ad16a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:35.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.655+0000 7fd8b4c00640 1 --2- 172.21.15.3:0/98633011 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x55cd3ad155d0 0x55cd3ad16a40 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd83fed27390c3a5 server_cookie=7598f18941d0ef1e in_seq=0 out_seq=0 2024-09-10T23:26:35.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.655+0000 7fd896000640 10 client.15486 ms_handle_connect on v2:172.21.15.38:6838/458259815 2024-09-10T23:26:35.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.656+0000 7fd896000640 1 -- 172.21.15.3:0/98633011 <== mds.0 v2:172.21.15.38:6838/458259815 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cd3ac71ca0 con 0x55cd3ad155d0 2024-09-10T23:26:35.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.656+0000 7fd896000640 10 client.15486 handle_command_reply: tid=0 2024-09-10T23:26:35.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.656+0000 7fd8b9fba740 1 client.15486 shutdown 2024-09-10T23:26:35.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.657+0000 7fd8b9fba740 1 -- 172.21.15.3:0/98633011 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cd3acf8b60 msgr2=0x55cd3ad01fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:35.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.657+0000 7fd8b9fba740 1 --2- 172.21.15.3:0/98633011 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cd3acf8b60 0x55cd3ad01fc0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd89c00fc80 tx=0x7fd89c00fcb0 comp rx=0 tx=0).stop 2024-09-10T23:26:35.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.657+0000 7fd8b9fba740 1 -- 172.21.15.3:0/98633011 shutdown_connections 2024-09-10T23:26:35.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.657+0000 7fd8b9fba740 1 --2- 172.21.15.3:0/98633011 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x55cd3ad155d0 0x55cd3ad16a40 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:35.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.657+0000 7fd8b9fba740 1 --2- 172.21.15.3:0/98633011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cd3ad04af0 0x55cd3ad02500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:35.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.657+0000 7fd896000640 0 client.15486 ms_handle_reset on v2:172.21.15.38:6838/458259815 2024-09-10T23:26:35.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.657+0000 7fd8b9fba740 1 --2- 172.21.15.3:0/98633011 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cd3acf8b60 0x55cd3ad01fc0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:35.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.657+0000 7fd8b9fba740 1 --2- 172.21.15.3:0/98633011 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cd3acf8240 0x55cd3ad01a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:35.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.657+0000 7fd8b9fba740 1 -- 172.21.15.3:0/98633011 >> 172.21.15.3:0/98633011 conn(0x55cd3acf6020 msgr2=0x55cd3acfbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:35.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.657+0000 7fd8b9fba740 1 -- 172.21.15.3:0/98633011 shutdown_connections 2024-09-10T23:26:35.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.657+0000 7fd8b9fba740 1 -- 172.21.15.3:0/98633011 wait complete. 2024-09-10T23:26:35.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.657+0000 7fd8b9fba740 20 client.15486 trim_cache size 0 max 16384 2024-09-10T23:26:35.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.676+0000 7fd8b9fba740 1 Processor -- start 2024-09-10T23:26:35.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.676+0000 7fd8b9fba740 1 -- start start 2024-09-10T23:26:35.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.676+0000 7fd8b9fba740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cd3acf8240 0x55cd3ad16a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:35.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.676+0000 7fd8b9fba740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cd3acf8b60 0x55cd3ad14550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:35.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.677+0000 7fd8b9fba740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cd3ad04af0 0x55cd3acf7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:35.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.677+0000 7fd8b9fba740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55cd3ad14d80 con 0x55cd3ad04af0 2024-09-10T23:26:35.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.677+0000 7fd8b9fba740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55cd3ad15450 con 0x55cd3acf8b60 2024-09-10T23:26:35.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.677+0000 7fd8b9fba740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55cd3ad15b20 con 0x55cd3acf8240 2024-09-10T23:26:35.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.677+0000 7fd8b5600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cd3ad04af0 0x55cd3acf7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:35.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.677+0000 7fd8b5600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cd3ad04af0 0x55cd3acf7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50190/0 (socket says 172.21.15.3:50190) 2024-09-10T23:26:35.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.677+0000 7fd8b5600640 1 -- 172.21.15.3:0/266884796 learned_addr learned my addr 172.21.15.3:0/266884796 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:35.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.677+0000 7fd8b4c00640 1 --2- 172.21.15.3:0/266884796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cd3acf8240 0x55cd3ad16a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:35.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.677+0000 7fd8afe00640 1 --2- 172.21.15.3:0/266884796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cd3acf8b60 0x55cd3ad14550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:35.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.677+0000 7fd8b5600640 1 -- 172.21.15.3:0/266884796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cd3acf8240 msgr2=0x55cd3ad16a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:35.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.677+0000 7fd8b5600640 1 --2- 172.21.15.3:0/266884796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cd3acf8240 0x55cd3ad16a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:35.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.677+0000 7fd8b5600640 1 -- 172.21.15.3:0/266884796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cd3acf8b60 msgr2=0x55cd3ad14550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:35.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.677+0000 7fd8b5600640 1 --2- 172.21.15.3:0/266884796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cd3acf8b60 0x55cd3ad14550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:35.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.677+0000 7fd8b5600640 1 -- 172.21.15.3:0/266884796 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd3acf6f60 con 0x55cd3ad04af0 2024-09-10T23:26:35.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.678+0000 7fd8b5600640 1 --2- 172.21.15.3:0/266884796 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cd3ad04af0 0x55cd3acf7180 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd8a80e33e0 tx=0x7fd8a80ab8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a00101eec60c59 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:35.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.678+0000 7fd8a1200640 1 -- 172.21.15.3:0/266884796 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a801f040 con 0x55cd3ad04af0 2024-09-10T23:26:35.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.678+0000 7fd8a1200640 1 -- 172.21.15.3:0/266884796 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8a80b0b80 con 0x55cd3ad04af0 2024-09-10T23:26:35.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.678+0000 7fd8a1200640 1 -- 172.21.15.3:0/266884796 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a80a7aa0 con 0x55cd3ad04af0 2024-09-10T23:26:35.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.679+0000 7fd8b9fba740 1 -- 172.21.15.3:0/266884796 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cd3ad04af0 msgr2=0x55cd3acf7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:35.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.679+0000 7fd8b9fba740 1 --2- 172.21.15.3:0/266884796 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cd3ad04af0 0x55cd3acf7180 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd8a80e33e0 tx=0x7fd8a80ab8c0 comp rx=0 tx=0).stop 2024-09-10T23:26:35.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.679+0000 7fd8b9fba740 1 -- 172.21.15.3:0/266884796 shutdown_connections 2024-09-10T23:26:35.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.679+0000 7fd8b9fba740 1 --2- 172.21.15.3:0/266884796 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cd3ad04af0 0x55cd3acf7180 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:35.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.679+0000 7fd8b9fba740 1 --2- 172.21.15.3:0/266884796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cd3acf8b60 0x55cd3ad14550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:35.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.679+0000 7fd8b9fba740 1 --2- 172.21.15.3:0/266884796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cd3acf8240 0x55cd3ad16a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:35.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.679+0000 7fd8b9fba740 1 -- 172.21.15.3:0/266884796 >> 172.21.15.3:0/266884796 conn(0x55cd3acf6020 msgr2=0x55cd3ad00300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:35.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.679+0000 7fd8b9fba740 1 -- 172.21.15.3:0/266884796 shutdown_connections 2024-09-10T23:26:35.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.679+0000 7fd8b9fba740 1 -- 172.21.15.3:0/266884796 wait complete. 2024-09-10T23:26:35.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.679+0000 7fd8b9fba740 1 -- start start 2024-09-10T23:26:35.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.680+0000 7fd8b9fba740 1 Processor -- start 2024-09-10T23:26:35.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.680+0000 7fd8b9fba740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cd3acf8240 0x55cd3ad1eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:35.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.680+0000 7fd8b9fba740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cd3acf8b60 0x55cd3ad1f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:35.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.680+0000 7fd8b9fba740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cd3ad04af0 0x55cd3ad1f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:35.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.680+0000 7fd8b9fba740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55cd3ad168c0 con 0x55cd3acf8b60 2024-09-10T23:26:35.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.680+0000 7fd8b9fba740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55cd3ad161f0 con 0x55cd3acf8240 2024-09-10T23:26:35.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.680+0000 7fd8b9fba740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55cd3ad16f90 con 0x55cd3ad04af0 2024-09-10T23:26:35.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.680+0000 7fd8b9fba740 10 client.0 _ll_register_callbacks cb 0x7fd89c011720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:35.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.680+0000 7fd8afe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cd3acf8b60 0x55cd3ad1f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:35.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.680+0000 7fd8b4c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cd3acf8240 0x55cd3ad1eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:35.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.680+0000 7fd8afe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cd3acf8b60 0x55cd3ad1f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50202/0 (socket says 172.21.15.3:50202) 2024-09-10T23:26:35.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.680+0000 7fd8afe00640 1 -- 172.21.15.3:0/3633673768 learned_addr learned my addr 172.21.15.3:0/3633673768 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:35.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.681+0000 7fd8b5600640 1 --2- 172.21.15.3:0/3633673768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cd3ad04af0 0x55cd3ad1f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:35.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.681+0000 7fd8afe00640 1 -- 172.21.15.3:0/3633673768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cd3ad04af0 msgr2=0x55cd3ad1f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:35.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.681+0000 7fd8afe00640 1 --2- 172.21.15.3:0/3633673768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cd3ad04af0 0x55cd3ad1f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:35.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.681+0000 7fd8afe00640 1 -- 172.21.15.3:0/3633673768 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cd3acf8240 msgr2=0x55cd3ad1eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:35.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.681+0000 7fd8afe00640 1 --2- 172.21.15.3:0/3633673768 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cd3acf8240 0x55cd3ad1eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:35.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.681+0000 7fd8afe00640 1 -- 172.21.15.3:0/3633673768 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd3acfc7e0 con 0x55cd3acf8b60 2024-09-10T23:26:35.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.681+0000 7fd8b4c00640 1 --2- 172.21.15.3:0/3633673768 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cd3acf8240 0x55cd3ad1eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:26:35.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.681+0000 7fd8afe00640 1 --2- 172.21.15.3:0/3633673768 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cd3acf8b60 0x55cd3ad1f1e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd89c011660 tx=0x7fd89c00ff50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac5562f3827a288 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:35.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.681+0000 7fd896000640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-10T23:26:35.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.681+0000 7fd896000640 1 -- 172.21.15.3:0/3633673768 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89c01f980 con 0x55cd3acf8b60 2024-09-10T23:26:35.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.681+0000 7fd896000640 1 -- 172.21.15.3:0/3633673768 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7fd89c01fb20 con 0x55cd3acf8b60 2024-09-10T23:26:35.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.681+0000 7fd8b9fba740 1 -- 172.21.15.3:0/3633673768 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8a80b0b80 con 0x55cd3acf8b60 2024-09-10T23:26:35.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.682+0000 7fd896000640 1 -- 172.21.15.3:0/3633673768 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd89c03d050 con 0x55cd3acf8b60 2024-09-10T23:26:35.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.682+0000 7fd8b9fba740 10 client.15492 fetch_fsmap learned FSMap version 25 2024-09-10T23:26:35.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.682+0000 7fd8b9fba740 1 -- 172.21.15.3:0/3633673768 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cd3ad822c0 con 0x55cd3acf8b60 2024-09-10T23:26:35.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.682+0000 7fd896000640 1 -- 172.21.15.3:0/3633673768 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8a80b0b80 con 0x55cd3acf8b60 2024-09-10T23:26:35.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.682+0000 7fd896000640 1 -- 172.21.15.3:0/3633673768 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fd89c003660 con 0x55cd3acf8b60 2024-09-10T23:26:35.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.682+0000 7fd8b9fba740 10 client.15492 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:26:35.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.682+0000 7fd8b9fba740 10 client.15492 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T23:26:35.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.682+0000 7fd8b9fba740 20 client.15492 populate_metadata read hostname 'smithi003' 2024-09-10T23:26:35.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.682+0000 7fd8b9fba740 1 --2- 172.21.15.3:0/3633673768 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x55cd3ad86e90 0x55cd3ad85ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:35.689 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.682+0000 7fd8b9fba740 4 client.15492 mds_command: new command op to 34724 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:26:35.689 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.683+0000 7fd8b9fba740 1 -- 172.21.15.3:0/3633673768 --> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] -- command(tid 0: {"prefix": "status"}) -- 0x55cd3ac6d750 con 0x55cd3ad86e90 2024-09-10T23:26:35.689 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.683+0000 7fd8b4c00640 1 --2- 172.21.15.3:0/3633673768 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x55cd3ad86e90 0x55cd3ad85ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:35.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.684+0000 7fd8b4c00640 1 --2- 172.21.15.3:0/3633673768 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x55cd3ad86e90 0x55cd3ad85ba0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a851330c34b029d server_cookie=74de444885329694 in_seq=0 out_seq=0 2024-09-10T23:26:35.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.684+0000 7fd896000640 10 client.15492 ms_handle_connect on v2:172.21.15.38:6838/458259815 2024-09-10T23:26:35.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.684+0000 7fd896000640 1 -- 172.21.15.3:0/3633673768 <== mds.0 v2:172.21.15.38:6838/458259815 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55cd3ac6d750 con 0x55cd3ad86e90 2024-09-10T23:26:35.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.684+0000 7fd896000640 10 client.15492 handle_command_reply: tid=0 2024-09-10T23:26:35.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.684+0000 7fd8b9fba740 1 client.15492 shutdown 2024-09-10T23:26:35.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.684+0000 7fd8b9fba740 1 -- 172.21.15.3:0/3633673768 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cd3acf8b60 msgr2=0x55cd3ad1f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:35.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.684+0000 7fd8b9fba740 1 --2- 172.21.15.3:0/3633673768 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cd3acf8b60 0x55cd3ad1f1e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd89c011660 tx=0x7fd89c00ff50 comp rx=0 tx=0).stop 2024-09-10T23:26:35.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.684+0000 7fd8b9fba740 1 -- 172.21.15.3:0/3633673768 shutdown_connections 2024-09-10T23:26:35.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.684+0000 7fd8b9fba740 1 --2- 172.21.15.3:0/3633673768 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x55cd3ad86e90 0x55cd3ad85ba0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:35.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.684+0000 7fd8b9fba740 1 --2- 172.21.15.3:0/3633673768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cd3ad04af0 0x55cd3ad1f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:35.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.684+0000 7fd8b9fba740 1 --2- 172.21.15.3:0/3633673768 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cd3acf8b60 0x55cd3ad1f1e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:35.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.684+0000 7fd8b9fba740 1 --2- 172.21.15.3:0/3633673768 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cd3acf8240 0x55cd3ad1eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:35.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.684+0000 7fd8b9fba740 1 -- 172.21.15.3:0/3633673768 >> 172.21.15.3:0/3633673768 conn(0x55cd3acf6020 msgr2=0x55cd3ad030b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:35.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.684+0000 7fd896000640 0 client.15492 ms_handle_reset on v2:172.21.15.38:6838/458259815 2024-09-10T23:26:35.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.685+0000 7fd8b9fba740 1 -- 172.21.15.3:0/3633673768 shutdown_connections 2024-09-10T23:26:35.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.685+0000 7fd8b9fba740 1 -- 172.21.15.3:0/3633673768 wait complete. 2024-09-10T23:26:35.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.685+0000 7fd8b9fba740 20 client.15492 trim_cache size 0 max 16384 2024-09-10T23:26:35.691 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-10T23:26:35.692 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_fsid": "3f4e30d0-6fca-11ef-bcea-c7b262605968", 2024-09-10T23:26:35.692 INFO:teuthology.orchestra.run.smithi003.stdout: "whoami": 0, 2024-09-10T23:26:35.692 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 34724, 2024-09-10T23:26:35.692 INFO:teuthology.orchestra.run.smithi003.stdout: "want_state": "up:active", 2024-09-10T23:26:35.692 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "up:active", 2024-09-10T23:26:35.692 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs", 2024-09-10T23:26:35.692 INFO:teuthology.orchestra.run.smithi003.stdout: "rank_uptime": 155.849196783, 2024-09-10T23:26:35.692 INFO:teuthology.orchestra.run.smithi003.stdout: "mdsmap_epoch": 25, 2024-09-10T23:26:35.692 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch": 90, 2024-09-10T23:26:35.692 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch_barrier": 88, 2024-09-10T23:26:35.692 INFO:teuthology.orchestra.run.smithi003.stdout: "uptime": 170.54669467900001 2024-09-10T23:26:35.693 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-10T23:26:35.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.685+0000 7fd8b7600640 1 -- 172.21.15.3:0/3008922482 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd8980b53b0 msgr2=0x7fd8980b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:35.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.685+0000 7fd8b7600640 1 --2- 172.21.15.3:0/3008922482 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd8980b53b0 0x7fd8980b7870 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd8a40057c0 tx=0x7fd8a40058d0 comp rx=0 tx=0).stop 2024-09-10T23:26:35.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.685+0000 7fd8b7600640 1 -- 172.21.15.3:0/3008922482 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd8b010b330 msgr2=0x7fd8b01a0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:35.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.685+0000 7fd8b7600640 1 --2- 172.21.15.3:0/3008922482 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd8b010b330 0x7fd8b01a0d40 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd8a800eaa0 tx=0x7fd8a800ef60 comp rx=0 tx=0).stop 2024-09-10T23:26:35.694 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.686+0000 7fd8b7600640 1 -- 172.21.15.3:0/3008922482 shutdown_connections 2024-09-10T23:26:35.694 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.686+0000 7fd8b7600640 1 --2- 172.21.15.3:0/3008922482 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd8980b53b0 0x7fd8980b7870 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:35.694 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.686+0000 7fd8b7600640 1 --2- 172.21.15.3:0/3008922482 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd8b010b330 0x7fd8b01a0d40 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:35.694 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.686+0000 7fd8b7600640 1 --2- 172.21.15.3:0/3008922482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8b010a9b0 0x7fd8b019b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:35.694 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.686+0000 7fd8b7600640 1 --2- 172.21.15.3:0/3008922482 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8b0104fa0 0x7fd8b019b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:35.694 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.686+0000 7fd8b7600640 1 -- 172.21.15.3:0/3008922482 >> 172.21.15.3:0/3008922482 conn(0x7fd8b0100a50 msgr2=0x7fd8b0101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:35.694 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.686+0000 7fd8b7600640 1 -- 172.21.15.3:0/3008922482 shutdown_connections 2024-09-10T23:26:35.694 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:35.686+0000 7fd8b7600640 1 -- 172.21.15.3:0/3008922482 wait complete. 2024-09-10T23:26:36.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:36 smithi003 ceph-mon[30348]: pgmap v385: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:26:36.512 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-10T23:26:36.523 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-10T23:26:36.524 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-10T23:26:36.524 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-09-10T23:26:36.524 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T23:26:36.524 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:26:36.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:26:36.524 DEBUG:teuthology.orchestra.run.smithi003:> ip netns list 2024-09-10T23:26:36.560 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-10T23:26:36.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:26:36.561 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T23:26:36.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:36 smithi038 ceph-mon[34225]: pgmap v385: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:26:36.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:26:36.659 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link delete ceph-brx 2024-09-10T23:26:36.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:36 smithi194 ceph-mon[33904]: pgmap v385: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:26:36.985 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-10T23:26:36.986 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-10T23:26:36.986 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-10T23:26:37.368 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:37.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.924+0000 7fefdf800640 1 -- 172.21.15.3:0/986381142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fefd81137f0 msgr2=0x7fefd8115be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:37.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.924+0000 7fefdf800640 1 --2- 172.21.15.3:0/986381142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fefd81137f0 0x7fefd8115be0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fefd0009ca0 tx=0x7fefd002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:26:37.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.925+0000 7fefdf800640 1 -- 172.21.15.3:0/986381142 shutdown_connections 2024-09-10T23:26:37.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.925+0000 7fefdf800640 1 --2- 172.21.15.3:0/986381142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fefd81137f0 0x7fefd8115be0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:37.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.925+0000 7fefdf800640 1 --2- 172.21.15.3:0/986381142 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fefd81013f0 0x7fefd81132b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:37.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.925+0000 7fefdf800640 1 --2- 172.21.15.3:0/986381142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefd8100ad0 0x7fefd8100eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:37.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.925+0000 7fefdf800640 1 -- 172.21.15.3:0/986381142 >> 172.21.15.3:0/986381142 conn(0x7fefd80fca20 msgr2=0x7fefd80fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:37.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.925+0000 7fefdf800640 1 -- 172.21.15.3:0/986381142 shutdown_connections 2024-09-10T23:26:37.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.925+0000 7fefdf800640 1 -- 172.21.15.3:0/986381142 wait complete. 2024-09-10T23:26:37.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.925+0000 7fefdf800640 1 Processor -- start 2024-09-10T23:26:37.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.926+0000 7fefdf800640 1 -- start start 2024-09-10T23:26:37.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.926+0000 7fefdf800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fefd8100ad0 0x7fefd819f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:37.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.926+0000 7fefdf800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fefd81013f0 0x7fefd819fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:37.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.926+0000 7fefdf800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefd81137f0 0x7fefd81a5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:37.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.926+0000 7fefdf800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fefd8119250 con 0x7fefd8100ad0 2024-09-10T23:26:37.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.926+0000 7fefdf800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fefd81190d0 con 0x7fefd81013f0 2024-09-10T23:26:37.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.926+0000 7fefdf800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fefd81193d0 con 0x7fefd81137f0 2024-09-10T23:26:37.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.926+0000 7fefdce00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fefd8100ad0 0x7fefd819f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:37.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.926+0000 7fefdce00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fefd8100ad0 0x7fefd819f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50220/0 (socket says 172.21.15.3:50220) 2024-09-10T23:26:37.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.926+0000 7fefdce00640 1 -- 172.21.15.3:0/1830535471 learned_addr learned my addr 172.21.15.3:0/1830535471 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:37.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.926+0000 7fefd7e00640 1 --2- 172.21.15.3:0/1830535471 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fefd81013f0 0x7fefd819fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:37.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.926+0000 7fefdd800640 1 --2- 172.21.15.3:0/1830535471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefd81137f0 0x7fefd81a5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:37.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.927+0000 7fefdce00640 1 -- 172.21.15.3:0/1830535471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefd81137f0 msgr2=0x7fefd81a5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:37.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.927+0000 7fefdce00640 1 --2- 172.21.15.3:0/1830535471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefd81137f0 0x7fefd81a5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:37.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.927+0000 7fefdce00640 1 -- 172.21.15.3:0/1830535471 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fefd81013f0 msgr2=0x7fefd819fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:37.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.927+0000 7fefdce00640 1 --2- 172.21.15.3:0/1830535471 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fefd81013f0 0x7fefd819fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:37.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.927+0000 7fefdce00640 1 -- 172.21.15.3:0/1830535471 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd81a5850 con 0x7fefd8100ad0 2024-09-10T23:26:37.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.927+0000 7fefdce00640 1 --2- 172.21.15.3:0/1830535471 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fefd8100ad0 0x7fefd819f7a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fefcc00d770 tx=0x7fefcc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:37.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.927+0000 7fefd5600640 1 -- 172.21.15.3:0/1830535471 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefcc017070 con 0x7fefd8100ad0 2024-09-10T23:26:37.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.927+0000 7fefd5600640 1 -- 172.21.15.3:0/1830535471 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fefcc0054b0 con 0x7fefd8100ad0 2024-09-10T23:26:37.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.928+0000 7fefdf800640 1 -- 172.21.15.3:0/1830535471 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefd81a5b40 con 0x7fefd8100ad0 2024-09-10T23:26:37.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.928+0000 7fefd5600640 1 -- 172.21.15.3:0/1830535471 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefcc004c60 con 0x7fefd8100ad0 2024-09-10T23:26:37.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.928+0000 7fefdf800640 1 -- 172.21.15.3:0/1830535471 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefd81ac200 con 0x7fefd8100ad0 2024-09-10T23:26:37.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.929+0000 7fefdf800640 1 -- 172.21.15.3:0/1830535471 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefd8100eb0 con 0x7fefd8100ad0 2024-09-10T23:26:37.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.932+0000 7fefd5600640 1 -- 172.21.15.3:0/1830535471 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 22) ==== 153266+0+0 (secure 0 0 0) 0x7fefcc004e00 con 0x7fefd8100ad0 2024-09-10T23:26:37.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.933+0000 7fefd5600640 1 --2- 172.21.15.3:0/1830535471 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fefc00b5330 0x7fefc00b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:37.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.933+0000 7fefd5600640 1 -- 172.21.15.3:0/1830535471 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7fefcc0e5ae0 con 0x7fefd8100ad0 2024-09-10T23:26:37.935 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.933+0000 7fefd7e00640 1 --2- 172.21.15.3:0/1830535471 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fefc00b5330 0x7fefc00b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:37.935 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.935+0000 7fefd7e00640 1 --2- 172.21.15.3:0/1830535471 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fefc00b5330 0x7fefc00b77f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fefd8113540 tx=0x7fefc4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:37.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:37.937+0000 7fefd5600640 1 -- 172.21.15.3:0/1830535471 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fefcc0abe60 con 0x7fefd8100ad0 2024-09-10T23:26:38.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:38.172+0000 7fefdf800640 1 -- 172.21.15.3:0/1830535471 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fefd8112420 con 0x7fefd8100ad0 2024-09-10T23:26:38.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:38.173+0000 7fefd5600640 1 -- 172.21.15.3:0/1830535471 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+88 (secure 0 0 0) 0x7fefcc0b0890 con 0x7fefd8100ad0 2024-09-10T23:26:38.174 INFO:teuthology.orchestra.run.smithi003.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-10T23:26:38.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:38.175+0000 7fefdf800640 1 -- 172.21.15.3:0/1830535471 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fefc00b5330 msgr2=0x7fefc00b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:38.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:38.175+0000 7fefdf800640 1 --2- 172.21.15.3:0/1830535471 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fefc00b5330 0x7fefc00b77f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fefd8113540 tx=0x7fefc4005f90 comp rx=0 tx=0).stop 2024-09-10T23:26:38.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:38.175+0000 7fefdf800640 1 -- 172.21.15.3:0/1830535471 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fefd8100ad0 msgr2=0x7fefd819f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:38.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:38.175+0000 7fefdf800640 1 --2- 172.21.15.3:0/1830535471 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fefd8100ad0 0x7fefd819f7a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fefcc00d770 tx=0x7fefcc00dc30 comp rx=0 tx=0).stop 2024-09-10T23:26:38.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:38.175+0000 7fefdf800640 1 -- 172.21.15.3:0/1830535471 shutdown_connections 2024-09-10T23:26:38.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:38.175+0000 7fefdf800640 1 --2- 172.21.15.3:0/1830535471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefd81137f0 0x7fefd81a5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:38.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:38.175+0000 7fefdf800640 1 --2- 172.21.15.3:0/1830535471 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fefd81013f0 0x7fefd819fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:38.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:38.175+0000 7fefdf800640 1 --2- 172.21.15.3:0/1830535471 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fefc00b5330 0x7fefc00b77f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:38.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:38.175+0000 7fefdf800640 1 --2- 172.21.15.3:0/1830535471 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fefd8100ad0 0x7fefd819f7a0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:38.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:38.175+0000 7fefdf800640 1 -- 172.21.15.3:0/1830535471 >> 172.21.15.3:0/1830535471 conn(0x7fefd80fca20 msgr2=0x7fefd8102b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:38.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:38.176+0000 7fefdf800640 1 -- 172.21.15.3:0/1830535471 shutdown_connections 2024-09-10T23:26:38.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:38.176+0000 7fefdf800640 1 -- 172.21.15.3:0/1830535471 wait complete. 2024-09-10T23:26:38.458 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:38 smithi003 ceph-mon[30348]: pgmap v386: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:26:38.458 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:38 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1830535471' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T23:26:38.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:38 smithi038 ceph-mon[34225]: pgmap v386: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:26:38.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:38 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/1830535471' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T23:26:38.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:38 smithi194 ceph-mon[33904]: pgmap v386: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:26:38.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:38 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/1830535471' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T23:26:38.982 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T23:26:38.982 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:26:38.982 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi003.front.sepia.ceph.com 2024-09-10T23:26:38.982 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T23:26:38.983 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:26:38.983 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T23:26:38.983 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T23:26:38.983 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:26:38.983 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:26:38.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:26:38.983 DEBUG:teuthology.orchestra.run.smithi003:> ip addr 2024-09-10T23:26:39.019 INFO:teuthology.orchestra.run.smithi003.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:26:39.019 INFO:teuthology.orchestra.run.smithi003.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:26:39.019 INFO:teuthology.orchestra.run.smithi003.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:26:39.019 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:26:39.020 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 ::1/128 scope host 2024-09-10T23:26:39.020 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:26:39.020 INFO:teuthology.orchestra.run.smithi003.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:26:39.020 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:6b:fd:ac brd ff:ff:ff:ff:ff:ff 2024-09-10T23:26:39.020 INFO:teuthology.orchestra.run.smithi003.stdout: altname enp7s0f0 2024-09-10T23:26:39.020 INFO:teuthology.orchestra.run.smithi003.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:26:39.020 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:6b:fd:ad brd ff:ff:ff:ff:ff:ff 2024-09-10T23:26:39.021 INFO:teuthology.orchestra.run.smithi003.stdout: altname enp7s0f1 2024-09-10T23:26:39.021 INFO:teuthology.orchestra.run.smithi003.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:26:39.021 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:bd:15:dc brd ff:ff:ff:ff:ff:ff 2024-09-10T23:26:39.021 INFO:teuthology.orchestra.run.smithi003.stdout: altname enp1s0f0 2024-09-10T23:26:39.021 INFO:teuthology.orchestra.run.smithi003.stdout: inet 172.21.15.3/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T23:26:39.021 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft 41929sec preferred_lft 41929sec 2024-09-10T23:26:39.021 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 fe80::ec4:7aff:febd:15dc/64 scope link 2024-09-10T23:26:39.021 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:26:39.021 INFO:teuthology.orchestra.run.smithi003.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:26:39.021 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:bd:15:dd brd ff:ff:ff:ff:ff:ff 2024-09-10T23:26:39.021 INFO:teuthology.orchestra.run.smithi003.stdout: altname enp1s0f1 2024-09-10T23:26:39.022 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T23:26:39.022 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:26:39.023 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2024-09-10T23:26:39.023 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link add name ceph-brx type bridge 2024-09-10T23:26:39.023 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip addr flush dev ceph-brx 2024-09-10T23:26:39.023 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link set ceph-brx up 2024-09-10T23:26:39.023 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T23:26:39.023 DEBUG:teuthology.orchestra.run.smithi003:> ') 2024-09-10T23:26:39.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:26:39.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:39.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:26:39.249 DEBUG:teuthology.orchestra.run.smithi003:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:26:39.305 INFO:teuthology.orchestra.run.smithi003.stdout:1 2024-09-10T23:26:39.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:26:39.308 DEBUG:teuthology.orchestra.run.smithi003:> route 2024-09-10T23:26:39.345 INFO:teuthology.orchestra.run.smithi003.stdout:Kernel IP routing table 2024-09-10T23:26:39.345 INFO:teuthology.orchestra.run.smithi003.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:26:39.346 INFO:teuthology.orchestra.run.smithi003.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T23:26:39.346 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T23:26:39.346 INFO:teuthology.orchestra.run.smithi003.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:26:39.346 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:26:39.346 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2024-09-10T23:26:39.346 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T23:26:39.346 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T23:26:39.346 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T23:26:39.346 DEBUG:teuthology.orchestra.run.smithi003:> ') 2024-09-10T23:26:39.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:26:39.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:39.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:26:39.545 DEBUG:teuthology.orchestra.run.smithi003:> ip netns list 2024-09-10T23:26:39.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:26:39.581 DEBUG:teuthology.orchestra.run.smithi003:> ip netns list-id 2024-09-10T23:26:39.656 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:26:39.657 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2024-09-10T23:26:39.657 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:26:39.657 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-10T23:26:39.657 DEBUG:teuthology.orchestra.run.smithi003:> ') 2024-09-10T23:26:39.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:26:39.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:39.834 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-10T23:26:39.834 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:26:39.835 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2024-09-10T23:26:39.835 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-10T23:26:39.835 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T23:26:39.835 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-10T23:26:39.835 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-10T23:26:39.835 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-10T23:26:39.835 DEBUG:teuthology.orchestra.run.smithi003:> ') 2024-09-10T23:26:39.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:26:40.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:40.055 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:26:40.056 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2024-09-10T23:26:40.056 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link set brx.0 up 2024-09-10T23:26:40.056 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T23:26:40.056 DEBUG:teuthology.orchestra.run.smithi003:> ') 2024-09-10T23:26:40.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:26:40.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:40.223 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-09-10T23:26:40.223 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:26:40.223 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T23:26:40.259 INFO:teuthology.orchestra.run.smithi003.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:26:40.260 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:26:40.260 DEBUG:teuthology.orchestra.run.smithi003:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:26:40.335 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2024-09-10T23:26:40.422 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:40 smithi003 ceph-mon[30348]: pgmap v387: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:26:40.432 DEBUG:teuthology.orchestra.run.smithi003:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:26:40.469 INFO:teuthology.orchestra.run.smithi003.stdout:/proc 2024-09-10T23:26:40.469 INFO:teuthology.orchestra.run.smithi003.stdout:/sys 2024-09-10T23:26:40.469 INFO:teuthology.orchestra.run.smithi003.stdout:/dev 2024-09-10T23:26:40.469 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/kernel/security 2024-09-10T23:26:40.469 INFO:teuthology.orchestra.run.smithi003.stdout:/dev/shm 2024-09-10T23:26:40.469 INFO:teuthology.orchestra.run.smithi003.stdout:/dev/pts 2024-09-10T23:26:40.469 INFO:teuthology.orchestra.run.smithi003.stdout:/run 2024-09-10T23:26:40.469 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/cgroup 2024-09-10T23:26:40.470 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/pstore 2024-09-10T23:26:40.470 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/bpf 2024-09-10T23:26:40.470 INFO:teuthology.orchestra.run.smithi003.stdout:/ 2024-09-10T23:26:40.470 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/selinux 2024-09-10T23:26:40.470 INFO:teuthology.orchestra.run.smithi003.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:26:40.470 INFO:teuthology.orchestra.run.smithi003.stdout:/dev/hugepages 2024-09-10T23:26:40.470 INFO:teuthology.orchestra.run.smithi003.stdout:/dev/mqueue 2024-09-10T23:26:40.470 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/kernel/debug 2024-09-10T23:26:40.470 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/kernel/tracing 2024-09-10T23:26:40.470 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/fuse/connections 2024-09-10T23:26:40.470 INFO:teuthology.orchestra.run.smithi003.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T23:26:40.470 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/kernel/config 2024-09-10T23:26:40.470 INFO:teuthology.orchestra.run.smithi003.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T23:26:40.470 INFO:teuthology.orchestra.run.smithi003.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T23:26:40.471 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T23:26:40.471 INFO:teuthology.orchestra.run.smithi003.stdout:/run/user/1000 2024-09-10T23:26:40.471 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/ceph 2024-09-10T23:26:40.471 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay 2024-09-10T23:26:40.471 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/77a52a37e8f88462cea6771d4aa25e63ac6d837ba398cf6f00e776111cc2de6c/merged 2024-09-10T23:26:40.471 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/2be80f4f7316ca8a5c459cb75da698a51fd97ddeee5287fced694a5cf5f140d6/merged 2024-09-10T23:26:40.471 INFO:teuthology.orchestra.run.smithi003.stdout:/run/user/0 2024-09-10T23:26:40.471 INFO:teuthology.orchestra.run.smithi003.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:26:40.471 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/66878287880ab44aac3a698d632b53d186ef96bd229817e2c32daf048dd97f92/merged 2024-09-10T23:26:40.471 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/b40eef2d3fcd560ad2ef7624aab75a55df76bba8f030a4902fdfa408775bcac1/merged 2024-09-10T23:26:40.471 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/149be40fb418ab1c50a85b04773165856107476c82452a4214334bcb0c68f990/merged 2024-09-10T23:26:40.471 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/c99549f2a487791a4307554b64eaaf405a56145721c6c639f26838d93dbcae27/merged 2024-09-10T23:26:40.471 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/5d955b957d4a0e77655edc5bca007d7b5205d27be8e86779763ae4c28882193b/merged 2024-09-10T23:26:40.471 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/8dc267f2e57c5e4611917f0bf3096933c3206bb6dfbc875fbefb8c38a037f015/merged 2024-09-10T23:26:40.472 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/79206fec5c2e5e2f4ebd93c5b5af04de66191d2569b256cb135f90cfd0f322ce/merged 2024-09-10T23:26:40.472 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/a7c378ff9d49bdc46d1c11d67a029b08e6cd1ab59462f0d54c417e00a17cf5c4/merged 2024-09-10T23:26:40.472 INFO:teuthology.orchestra.run.smithi003.stdout:/run/netns 2024-09-10T23:26:40.472 INFO:teuthology.orchestra.run.smithi003.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:26:40.472 INFO:teuthology.orchestra.run.smithi003.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:26:40.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:26:40.473 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2024-09-10T23:26:40.548 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T23:26:40.548 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/669cda76-c58d-41dc-ae12-1e5b6e68c3de --client_fs=cephfs) 2024-09-10T23:26:40.592 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2024-09-10T23:26:40.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:40 smithi038 ceph-mon[34225]: pgmap v387: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:26:40.648 DEBUG:teuthology.orchestra.run.smithi003:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:26:40.685 INFO:teuthology.orchestra.run.smithi003.stdout:/proc 2024-09-10T23:26:40.685 INFO:teuthology.orchestra.run.smithi003.stdout:/sys 2024-09-10T23:26:40.685 INFO:teuthology.orchestra.run.smithi003.stdout:/dev 2024-09-10T23:26:40.686 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/kernel/security 2024-09-10T23:26:40.686 INFO:teuthology.orchestra.run.smithi003.stdout:/dev/shm 2024-09-10T23:26:40.686 INFO:teuthology.orchestra.run.smithi003.stdout:/dev/pts 2024-09-10T23:26:40.686 INFO:teuthology.orchestra.run.smithi003.stdout:/run 2024-09-10T23:26:40.686 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/cgroup 2024-09-10T23:26:40.686 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/pstore 2024-09-10T23:26:40.686 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/bpf 2024-09-10T23:26:40.686 INFO:teuthology.orchestra.run.smithi003.stdout:/ 2024-09-10T23:26:40.686 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/selinux 2024-09-10T23:26:40.686 INFO:teuthology.orchestra.run.smithi003.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:26:40.686 INFO:teuthology.orchestra.run.smithi003.stdout:/dev/hugepages 2024-09-10T23:26:40.686 INFO:teuthology.orchestra.run.smithi003.stdout:/dev/mqueue 2024-09-10T23:26:40.686 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/kernel/debug 2024-09-10T23:26:40.686 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/kernel/tracing 2024-09-10T23:26:40.687 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/fuse/connections 2024-09-10T23:26:40.687 INFO:teuthology.orchestra.run.smithi003.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T23:26:40.687 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/kernel/config 2024-09-10T23:26:40.687 INFO:teuthology.orchestra.run.smithi003.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T23:26:40.687 INFO:teuthology.orchestra.run.smithi003.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T23:26:40.687 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T23:26:40.687 INFO:teuthology.orchestra.run.smithi003.stdout:/run/user/1000 2024-09-10T23:26:40.687 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/ceph 2024-09-10T23:26:40.687 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay 2024-09-10T23:26:40.687 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/77a52a37e8f88462cea6771d4aa25e63ac6d837ba398cf6f00e776111cc2de6c/merged 2024-09-10T23:26:40.687 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/2be80f4f7316ca8a5c459cb75da698a51fd97ddeee5287fced694a5cf5f140d6/merged 2024-09-10T23:26:40.687 INFO:teuthology.orchestra.run.smithi003.stdout:/run/user/0 2024-09-10T23:26:40.687 INFO:teuthology.orchestra.run.smithi003.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:26:40.687 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/66878287880ab44aac3a698d632b53d186ef96bd229817e2c32daf048dd97f92/merged 2024-09-10T23:26:40.688 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/b40eef2d3fcd560ad2ef7624aab75a55df76bba8f030a4902fdfa408775bcac1/merged 2024-09-10T23:26:40.688 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/149be40fb418ab1c50a85b04773165856107476c82452a4214334bcb0c68f990/merged 2024-09-10T23:26:40.688 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/c99549f2a487791a4307554b64eaaf405a56145721c6c639f26838d93dbcae27/merged 2024-09-10T23:26:40.688 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/5d955b957d4a0e77655edc5bca007d7b5205d27be8e86779763ae4c28882193b/merged 2024-09-10T23:26:40.688 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/8dc267f2e57c5e4611917f0bf3096933c3206bb6dfbc875fbefb8c38a037f015/merged 2024-09-10T23:26:40.688 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/79206fec5c2e5e2f4ebd93c5b5af04de66191d2569b256cb135f90cfd0f322ce/merged 2024-09-10T23:26:40.688 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/a7c378ff9d49bdc46d1c11d67a029b08e6cd1ab59462f0d54c417e00a17cf5c4/merged 2024-09-10T23:26:40.688 INFO:teuthology.orchestra.run.smithi003.stdout:/run/netns 2024-09-10T23:26:40.688 INFO:teuthology.orchestra.run.smithi003.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:26:40.688 INFO:teuthology.orchestra.run.smithi003.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:26:40.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:26:40.689 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2024-09-10T23:26:40.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:40 smithi194 ceph-mon[33904]: pgmap v387: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:26:40.740 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi003.stderr:2024-09-10T23:26:40.739+0000 7f8391156480 -1 init, newargv = 0x55a2ed7fc3f0 newargc=15 2024-09-10T23:26:40.740 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi003.stderr:ceph-fuse[89332]: starting ceph client 2024-09-10T23:26:40.763 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi003.stderr:ceph-fuse[89332]: starting fuse 2024-09-10T23:26:40.771 INFO:teuthology.orchestra.run.smithi003.stdout:120 2024-09-10T23:26:40.771 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-10T23:26:40.771 DEBUG:teuthology.orchestra.run.smithi003:> sudo stdin-killer -- python3 -c ' 2024-09-10T23:26:40.771 DEBUG:teuthology.orchestra.run.smithi003:> import glob 2024-09-10T23:26:40.771 DEBUG:teuthology.orchestra.run.smithi003:> import re 2024-09-10T23:26:40.771 DEBUG:teuthology.orchestra.run.smithi003:> import os 2024-09-10T23:26:40.772 DEBUG:teuthology.orchestra.run.smithi003:> import subprocess 2024-09-10T23:26:40.772 DEBUG:teuthology.orchestra.run.smithi003:> 2024-09-10T23:26:40.772 DEBUG:teuthology.orchestra.run.smithi003:> def _find_admin_socket(client_name): 2024-09-10T23:26:40.772 DEBUG:teuthology.orchestra.run.smithi003:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T23:26:40.772 DEBUG:teuthology.orchestra.run.smithi003:> files = glob.glob(asok_path) 2024-09-10T23:26:40.772 DEBUG:teuthology.orchestra.run.smithi003:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T23:26:40.772 DEBUG:teuthology.orchestra.run.smithi003:> 2024-09-10T23:26:40.772 DEBUG:teuthology.orchestra.run.smithi003:> # Given a non-glob path, it better be there 2024-09-10T23:26:40.772 DEBUG:teuthology.orchestra.run.smithi003:> if "*" not in asok_path: 2024-09-10T23:26:40.772 DEBUG:teuthology.orchestra.run.smithi003:> assert(len(files) == 1) 2024-09-10T23:26:40.772 DEBUG:teuthology.orchestra.run.smithi003:> return files[0] 2024-09-10T23:26:40.772 DEBUG:teuthology.orchestra.run.smithi003:> 2024-09-10T23:26:40.772 DEBUG:teuthology.orchestra.run.smithi003:> for f in files: 2024-09-10T23:26:40.772 DEBUG:teuthology.orchestra.run.smithi003:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T23:26:40.772 DEBUG:teuthology.orchestra.run.smithi003:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T23:26:40.773 DEBUG:teuthology.orchestra.run.smithi003:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T23:26:40.773 DEBUG:teuthology.orchestra.run.smithi003:> contents = proc_f.read() 2024-09-10T23:26:40.773 DEBUG:teuthology.orchestra.run.smithi003:> if mountpoint in contents: 2024-09-10T23:26:40.773 DEBUG:teuthology.orchestra.run.smithi003:> return f 2024-09-10T23:26:40.773 DEBUG:teuthology.orchestra.run.smithi003:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T23:26:40.773 DEBUG:teuthology.orchestra.run.smithi003:> 2024-09-10T23:26:40.773 DEBUG:teuthology.orchestra.run.smithi003:> print(_find_admin_socket("client.0")) 2024-09-10T23:26:40.773 DEBUG:teuthology.orchestra.run.smithi003:> ' 2024-09-10T23:26:40.938 INFO:teuthology.orchestra.run.smithi003.stdout:/var/run/ceph/ceph-client.0.89332.asok 2024-09-10T23:26:40.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:40.952 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.89332.asok 2024-09-10T23:26:40.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:26:40.952 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.89332.asok status 2024-09-10T23:26:41.139 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-10T23:26:41.139 INFO:teuthology.orchestra.run.smithi003.stdout: "metadata": { 2024-09-10T23:26:41.139 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T23:26:41.139 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:26:41.139 INFO:teuthology.orchestra.run.smithi003.stdout: "entity_id": "0", 2024-09-10T23:26:41.139 INFO:teuthology.orchestra.run.smithi003.stdout: "hostname": "smithi003", 2024-09-10T23:26:41.139 INFO:teuthology.orchestra.run.smithi003.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T23:26:41.139 INFO:teuthology.orchestra.run.smithi003.stdout: "pid": "89332", 2024-09-10T23:26:41.139 INFO:teuthology.orchestra.run.smithi003.stdout: "root": "/volumes/qa/sv_0/669cda76-c58d-41dc-ae12-1e5b6e68c3de" 2024-09-10T23:26:41.139 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:26:41.139 INFO:teuthology.orchestra.run.smithi003.stdout: "dentry_count": 0, 2024-09-10T23:26:41.140 INFO:teuthology.orchestra.run.smithi003.stdout: "dentry_pinned_count": 0, 2024-09-10T23:26:41.140 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 15504, 2024-09-10T23:26:41.140 INFO:teuthology.orchestra.run.smithi003.stdout: "inst": { 2024-09-10T23:26:41.140 INFO:teuthology.orchestra.run.smithi003.stdout: "name": { 2024-09-10T23:26:41.140 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client", 2024-09-10T23:26:41.140 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 15504 2024-09-10T23:26:41.140 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:26:41.140 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": { 2024-09-10T23:26:41.140 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2024-09-10T23:26:41.140 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:26:41.140 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 960673917 2024-09-10T23:26:41.140 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:26:41.140 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:26:41.141 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": { 2024-09-10T23:26:41.141 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2024-09-10T23:26:41.141 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:26:41.141 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 960673917 2024-09-10T23:26:41.141 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:26:41.141 INFO:teuthology.orchestra.run.smithi003.stdout: "inst_str": "client.15504 192.168.0.1:0/960673917", 2024-09-10T23:26:41.141 INFO:teuthology.orchestra.run.smithi003.stdout: "addr_str": "192.168.0.1:0/960673917", 2024-09-10T23:26:41.141 INFO:teuthology.orchestra.run.smithi003.stdout: "inode_count": 5, 2024-09-10T23:26:41.141 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_epoch": 25, 2024-09-10T23:26:41.141 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_epoch": 90, 2024-09-10T23:26:41.141 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_epoch_barrier": 0, 2024-09-10T23:26:41.141 INFO:teuthology.orchestra.run.smithi003.stdout: "blocklisted": false, 2024-09-10T23:26:41.141 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs" 2024-09-10T23:26:41.141 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-10T23:26:41.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:26:41.151 DEBUG:teuthology.orchestra.run.smithi003:> stat --file-system '--printf=%T 2024-09-10T23:26:41.151 DEBUG:teuthology.orchestra.run.smithi003:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T23:26:41.187 INFO:teuthology.orchestra.run.smithi003.stdout:fuseblk 2024-09-10T23:26:41.187 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T23:26:41.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:26:41.187 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:26:41.285 INFO:teuthology.run_tasks:Running task exec... 2024-09-10T23:26:41.296 INFO:teuthology.task.exec:Executing custom commands... 2024-09-10T23:26:41.296 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi003.front.sepia.ceph.com 2024-09-10T23:26:41.297 DEBUG:teuthology.orchestra.run.smithi003:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-10T23:26:41.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.450+0000 7fee48400640 1 -- 172.21.15.3:0/3241070624 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee4010a920 msgr2=0x7fee4010ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:41.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.450+0000 7fee48400640 1 --2- 172.21.15.3:0/3241070624 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee4010a920 0x7fee4010ad60 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fee2c009900 tx=0x7fee2c02a410 comp rx=0 tx=0).stop 2024-09-10T23:26:41.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.451+0000 7fee48400640 1 -- 172.21.15.3:0/3241070624 shutdown_connections 2024-09-10T23:26:41.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.451+0000 7fee48400640 1 --2- 172.21.15.3:0/3241070624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee4010b2a0 0x7fee40111aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:41.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.451+0000 7fee48400640 1 --2- 172.21.15.3:0/3241070624 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee4010a920 0x7fee4010ad60 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:41.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.451+0000 7fee48400640 1 --2- 172.21.15.3:0/3241070624 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee40104f20 0x7fee40105300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:41.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.451+0000 7fee48400640 1 -- 172.21.15.3:0/3241070624 >> 172.21.15.3:0/3241070624 conn(0x7fee40100900 msgr2=0x7fee40102d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:41.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.451+0000 7fee48400640 1 -- 172.21.15.3:0/3241070624 shutdown_connections 2024-09-10T23:26:41.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.451+0000 7fee48400640 1 -- 172.21.15.3:0/3241070624 wait complete. 2024-09-10T23:26:41.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.451+0000 7fee48400640 1 Processor -- start 2024-09-10T23:26:41.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.452+0000 7fee48400640 1 -- start start 2024-09-10T23:26:41.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.452+0000 7fee48400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee40104f20 0x7fee4019b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:41.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.452+0000 7fee48400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee4010a920 0x7fee4019b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:41.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.452+0000 7fee48400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee4010b2a0 0x7fee401a0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:41.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.452+0000 7fee48400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fee40114d80 con 0x7fee4010b2a0 2024-09-10T23:26:41.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.452+0000 7fee48400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fee40114c00 con 0x7fee4010a920 2024-09-10T23:26:41.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.452+0000 7fee48400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fee40114f00 con 0x7fee40104f20 2024-09-10T23:26:41.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.452+0000 7fee46400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee4010b2a0 0x7fee401a0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:41.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.452+0000 7fee46400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee4010b2a0 0x7fee401a0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39394/0 (socket says 172.21.15.3:39394) 2024-09-10T23:26:41.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.452+0000 7fee46400640 1 -- 172.21.15.3:0/1177517190 learned_addr learned my addr 172.21.15.3:0/1177517190 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:41.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.452+0000 7fee45a00640 1 --2- 172.21.15.3:0/1177517190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee40104f20 0x7fee4019b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:41.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.452+0000 7fee45000640 1 --2- 172.21.15.3:0/1177517190 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee4010a920 0x7fee4019b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:41.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.453+0000 7fee46400640 1 -- 172.21.15.3:0/1177517190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee40104f20 msgr2=0x7fee4019b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:41.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.453+0000 7fee46400640 1 --2- 172.21.15.3:0/1177517190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee40104f20 0x7fee4019b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:41.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.453+0000 7fee46400640 1 -- 172.21.15.3:0/1177517190 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee4010a920 msgr2=0x7fee4019b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:41.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.453+0000 7fee46400640 1 --2- 172.21.15.3:0/1177517190 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee4010a920 0x7fee4019b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:41.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.453+0000 7fee46400640 1 -- 172.21.15.3:0/1177517190 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee401a13e0 con 0x7fee4010b2a0 2024-09-10T23:26:41.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.453+0000 7fee46400640 1 --2- 172.21.15.3:0/1177517190 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee4010b2a0 0x7fee401a0c10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fee3800eaa0 tx=0x7fee3800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:41.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.453+0000 7fee3e000640 1 -- 172.21.15.3:0/1177517190 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee3800cdb0 con 0x7fee4010b2a0 2024-09-10T23:26:41.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.453+0000 7fee3e000640 1 -- 172.21.15.3:0/1177517190 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fee38005020 con 0x7fee4010b2a0 2024-09-10T23:26:41.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.453+0000 7fee48400640 1 -- 172.21.15.3:0/1177517190 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee401a16d0 con 0x7fee4010b2a0 2024-09-10T23:26:41.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.453+0000 7fee3e000640 1 -- 172.21.15.3:0/1177517190 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee380116d0 con 0x7fee4010b2a0 2024-09-10T23:26:41.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.453+0000 7fee48400640 1 -- 172.21.15.3:0/1177517190 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee401a7d90 con 0x7fee4010b2a0 2024-09-10T23:26:41.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.454+0000 7fee48400640 1 -- 172.21.15.3:0/1177517190 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee40105300 con 0x7fee4010b2a0 2024-09-10T23:26:41.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.457+0000 7fee3e000640 1 -- 172.21.15.3:0/1177517190 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 22) ==== 153266+0+0 (secure 0 0 0) 0x7fee3800f040 con 0x7fee4010b2a0 2024-09-10T23:26:41.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.458+0000 7fee3e000640 1 --2- 172.21.15.3:0/1177517190 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fee280b5330 0x7fee280b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:41.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.458+0000 7fee3e000640 1 -- 172.21.15.3:0/1177517190 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7fee380e6260 con 0x7fee4010b2a0 2024-09-10T23:26:41.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.458+0000 7fee45a00640 1 --2- 172.21.15.3:0/1177517190 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fee280b5330 0x7fee280b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:41.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.459+0000 7fee45a00640 1 --2- 172.21.15.3:0/1177517190 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fee280b5330 0x7fee280b77f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fee34009bd0 tx=0x7fee34005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:41.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.460+0000 7fee3e000640 1 -- 172.21.15.3:0/1177517190 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fee38016030 con 0x7fee4010b2a0 2024-09-10T23:26:41.694 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:41.693+0000 7fee48400640 1 -- 172.21.15.3:0/1177517190 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7fee4019c460 con 0x7fee4010b2a0 2024-09-10T23:26:42.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.261+0000 7fee3e000640 1 -- 172.21.15.3:0/1177517190 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v26) ==== 118+0+0 (secure 0 0 0) 0x7fee4019c460 con 0x7fee4010b2a0 2024-09-10T23:26:42.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.264+0000 7fee48400640 1 -- 172.21.15.3:0/1177517190 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fee280b5330 msgr2=0x7fee280b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:42.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.264+0000 7fee48400640 1 --2- 172.21.15.3:0/1177517190 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fee280b5330 0x7fee280b77f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fee34009bd0 tx=0x7fee34005f90 comp rx=0 tx=0).stop 2024-09-10T23:26:42.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.264+0000 7fee48400640 1 -- 172.21.15.3:0/1177517190 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee4010b2a0 msgr2=0x7fee401a0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:42.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.264+0000 7fee48400640 1 --2- 172.21.15.3:0/1177517190 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee4010b2a0 0x7fee401a0c10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fee3800eaa0 tx=0x7fee3800ef60 comp rx=0 tx=0).stop 2024-09-10T23:26:42.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.265+0000 7fee48400640 1 -- 172.21.15.3:0/1177517190 shutdown_connections 2024-09-10T23:26:42.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.265+0000 7fee48400640 1 --2- 172.21.15.3:0/1177517190 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fee280b5330 0x7fee280b77f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:42.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.265+0000 7fee48400640 1 --2- 172.21.15.3:0/1177517190 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee4010b2a0 0x7fee401a0c10 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:42.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.265+0000 7fee48400640 1 --2- 172.21.15.3:0/1177517190 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee4010a920 0x7fee4019b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:42.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.265+0000 7fee48400640 1 --2- 172.21.15.3:0/1177517190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee40104f20 0x7fee4019b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:42.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.265+0000 7fee48400640 1 -- 172.21.15.3:0/1177517190 >> 172.21.15.3:0/1177517190 conn(0x7fee40100900 msgr2=0x7fee40102cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:42.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.265+0000 7fee48400640 1 -- 172.21.15.3:0/1177517190 shutdown_connections 2024-09-10T23:26:42.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.265+0000 7fee48400640 1 -- 172.21.15.3:0/1177517190 wait complete. 2024-09-10T23:26:42.285 DEBUG:teuthology.orchestra.run.smithi003:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-10T23:26:42.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.443+0000 7f0769800640 1 -- 172.21.15.3:0/4169425764 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f076410a920 msgr2=0x7f076410ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:42.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.443+0000 7f0769800640 1 --2- 172.21.15.3:0/4169425764 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f076410a920 0x7f076410ad60 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0750009900 tx=0x7f075002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:26:42.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.443+0000 7f0769800640 1 -- 172.21.15.3:0/4169425764 shutdown_connections 2024-09-10T23:26:42.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.443+0000 7f0769800640 1 --2- 172.21.15.3:0/4169425764 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f076410b2a0 0x7f0764111aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:42.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.443+0000 7f0769800640 1 --2- 172.21.15.3:0/4169425764 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f076410a920 0x7f076410ad60 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:42.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.443+0000 7f0769800640 1 --2- 172.21.15.3:0/4169425764 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0764104f20 0x7f0764105300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:42.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.443+0000 7f0769800640 1 -- 172.21.15.3:0/4169425764 >> 172.21.15.3:0/4169425764 conn(0x7f0764100900 msgr2=0x7f0764102d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:42.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.443+0000 7f0769800640 1 -- 172.21.15.3:0/4169425764 shutdown_connections 2024-09-10T23:26:42.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.443+0000 7f0769800640 1 -- 172.21.15.3:0/4169425764 wait complete. 2024-09-10T23:26:42.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.444+0000 7f0769800640 1 Processor -- start 2024-09-10T23:26:42.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.444+0000 7f0769800640 1 -- start start 2024-09-10T23:26:42.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.445+0000 7f0769800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0764104f20 0x7f076419b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:42.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.445+0000 7f0769800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f076410a920 0x7f076419b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:42.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.445+0000 7f0769800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f076410b2a0 0x7f07641a0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:42.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.445+0000 7f0769800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0764114d90 con 0x7f0764104f20 2024-09-10T23:26:42.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.445+0000 7f0769800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0764114c10 con 0x7f076410b2a0 2024-09-10T23:26:42.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.445+0000 7f0769800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0764114f10 con 0x7f076410a920 2024-09-10T23:26:42.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.445+0000 7f0762a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0764104f20 0x7f076419b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:42.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.445+0000 7f0762a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0764104f20 0x7f076419b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39404/0 (socket says 172.21.15.3:39404) 2024-09-10T23:26:42.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.445+0000 7f0762a00640 1 -- 172.21.15.3:0/3039785253 learned_addr learned my addr 172.21.15.3:0/3039785253 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:42.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.445+0000 7f0762000640 1 --2- 172.21.15.3:0/3039785253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f076410a920 0x7f076419b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:42.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.445+0000 7f0763400640 1 --2- 172.21.15.3:0/3039785253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f076410b2a0 0x7f07641a0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:42.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.445+0000 7f0762a00640 1 -- 172.21.15.3:0/3039785253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f076410a920 msgr2=0x7f076419b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:42.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.445+0000 7f0762a00640 1 --2- 172.21.15.3:0/3039785253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f076410a920 0x7f076419b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:42.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.445+0000 7f0762a00640 1 -- 172.21.15.3:0/3039785253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f076410b2a0 msgr2=0x7f07641a0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:42.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.445+0000 7f0762a00640 1 --2- 172.21.15.3:0/3039785253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f076410b2a0 0x7f07641a0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:42.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.446+0000 7f0762a00640 1 -- 172.21.15.3:0/3039785253 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07641a13f0 con 0x7f0764104f20 2024-09-10T23:26:42.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.446+0000 7f0762a00640 1 --2- 172.21.15.3:0/3039785253 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0764104f20 0x7f076419b350 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f075400d950 tx=0x7f075400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:42.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.446+0000 7f075b400640 1 -- 172.21.15.3:0/3039785253 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0754017030 con 0x7f0764104f20 2024-09-10T23:26:42.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.446+0000 7f075b400640 1 -- 172.21.15.3:0/3039785253 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0754004020 con 0x7f0764104f20 2024-09-10T23:26:42.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.446+0000 7f075b400640 1 -- 172.21.15.3:0/3039785253 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07540055d0 con 0x7f0764104f20 2024-09-10T23:26:42.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.446+0000 7f0769800640 1 -- 172.21.15.3:0/3039785253 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07641a16e0 con 0x7f0764104f20 2024-09-10T23:26:42.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.446+0000 7f0769800640 1 -- 172.21.15.3:0/3039785253 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07641a7da0 con 0x7f0764104f20 2024-09-10T23:26:42.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.447+0000 7f0769800640 1 -- 172.21.15.3:0/3039785253 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0764105300 con 0x7f0764104f20 2024-09-10T23:26:42.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.450+0000 7f075b400640 1 -- 172.21.15.3:0/3039785253 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 22) ==== 153266+0+0 (secure 0 0 0) 0x7f0754009a30 con 0x7f0764104f20 2024-09-10T23:26:42.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.451+0000 7f075b400640 1 --2- 172.21.15.3:0/3039785253 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f07480b5330 0x7f07480b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:42.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.451+0000 7f075b400640 1 -- 172.21.15.3:0/3039785253 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f07540e5b00 con 0x7f0764104f20 2024-09-10T23:26:42.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.451+0000 7f0762000640 1 --2- 172.21.15.3:0/3039785253 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f07480b5330 0x7f07480b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:42.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.452+0000 7f0762000640 1 --2- 172.21.15.3:0/3039785253 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f07480b5330 0x7f07480b77f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f07500057c0 tx=0x7f07500058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:42.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.455+0000 7f075b400640 1 -- 172.21.15.3:0/3039785253 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f07540ac4d0 con 0x7f0764104f20 2024-09-10T23:26:42.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:42 smithi038 ceph-mon[34225]: pgmap v388: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:26:42.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:42 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/1177517190' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-10T23:26:42.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.681+0000 7f0769800640 1 -- 172.21.15.3:0/3039785253 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f0764063590 con 0x7f07480b5330 2024-09-10T23:26:42.689 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:42 smithi003 ceph-mon[30348]: pgmap v388: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:26:42.689 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:42 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1177517190' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-10T23:26:42.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:42 smithi194 ceph-mon[33904]: pgmap v388: 129 pgs: 129 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:26:42.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:42 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/1177517190' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-10T23:26:42.704 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.703+0000 7f075b400640 1 -- 172.21.15.3:0/3039785253 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f0764063590 con 0x7f07480b5330 2024-09-10T23:26:42.704 INFO:teuthology.orchestra.run.smithi003.stdout:{} 2024-09-10T23:26:42.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.705+0000 7f0769800640 1 -- 172.21.15.3:0/3039785253 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f07480b5330 msgr2=0x7f07480b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:42.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.705+0000 7f0769800640 1 --2- 172.21.15.3:0/3039785253 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f07480b5330 0x7f07480b77f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f07500057c0 tx=0x7f07500058d0 comp rx=0 tx=0).stop 2024-09-10T23:26:42.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.705+0000 7f0769800640 1 -- 172.21.15.3:0/3039785253 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0764104f20 msgr2=0x7f076419b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:42.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.705+0000 7f0769800640 1 --2- 172.21.15.3:0/3039785253 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0764104f20 0x7f076419b350 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f075400d950 tx=0x7f075400de10 comp rx=0 tx=0).stop 2024-09-10T23:26:42.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.705+0000 7f0769800640 1 -- 172.21.15.3:0/3039785253 shutdown_connections 2024-09-10T23:26:42.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.705+0000 7f0769800640 1 --2- 172.21.15.3:0/3039785253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f076410b2a0 0x7f07641a0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:42.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.705+0000 7f0769800640 1 --2- 172.21.15.3:0/3039785253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f076410a920 0x7f076419b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:42.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.705+0000 7f0769800640 1 --2- 172.21.15.3:0/3039785253 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f07480b5330 0x7f07480b77f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:42.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.705+0000 7f0769800640 1 --2- 172.21.15.3:0/3039785253 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0764104f20 0x7f076419b350 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:42.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.705+0000 7f0769800640 1 -- 172.21.15.3:0/3039785253 >> 172.21.15.3:0/3039785253 conn(0x7f0764100900 msgr2=0x7f0764102cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:42.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.705+0000 7f0769800640 1 -- 172.21.15.3:0/3039785253 shutdown_connections 2024-09-10T23:26:42.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.705+0000 7f0769800640 1 -- 172.21.15.3:0/3039785253 wait complete. 2024-09-10T23:26:42.722 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-10T23:26:42.733 INFO:teuthology.run_tasks:Running task exec... 2024-09-10T23:26:42.773 INFO:teuthology.task.exec:Executing custom commands... 2024-09-10T23:26:42.773 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi003.front.sepia.ceph.com 2024-09-10T23:26:42.774 DEBUG:teuthology.orchestra.run.smithi003:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-10T23:26:42.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.932+0000 7f7b67e00640 1 -- 172.21.15.3:0/1542119497 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b60077ff0 msgr2=0x7f7b601133c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:42.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.932+0000 7f7b67e00640 1 --2- 172.21.15.3:0/1542119497 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b60077ff0 0x7f7b601133c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c009900 tx=0x7f7b4c02a3f0 comp rx=0 tx=0).stop 2024-09-10T23:26:42.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.932+0000 7f7b67e00640 1 -- 172.21.15.3:0/1542119497 shutdown_connections 2024-09-10T23:26:42.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.932+0000 7f7b67e00640 1 --2- 172.21.15.3:0/1542119497 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b60113900 0x7f7b60115cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:42.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.932+0000 7f7b67e00640 1 --2- 172.21.15.3:0/1542119497 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b60077ff0 0x7f7b601133c0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:42.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.932+0000 7f7b67e00640 1 --2- 172.21.15.3:0/1542119497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b600776d0 0x7f7b60077ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:42.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.932+0000 7f7b67e00640 1 -- 172.21.15.3:0/1542119497 >> 172.21.15.3:0/1542119497 conn(0x7f7b60100900 msgr2=0x7f7b60102d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:42.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.932+0000 7f7b67e00640 1 -- 172.21.15.3:0/1542119497 shutdown_connections 2024-09-10T23:26:42.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.932+0000 7f7b67e00640 1 -- 172.21.15.3:0/1542119497 wait complete. 2024-09-10T23:26:42.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.933+0000 7f7b67e00640 1 Processor -- start 2024-09-10T23:26:42.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.933+0000 7f7b67e00640 1 -- start start 2024-09-10T23:26:42.936 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.933+0000 7f7b67e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b600776d0 0x7f7b6019f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:42.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.933+0000 7f7b67e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b60077ff0 0x7f7b6019fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:42.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.933+0000 7f7b67e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b60113900 0x7f7b601a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:42.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.933+0000 7f7b67e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7b60119220 con 0x7f7b600776d0 2024-09-10T23:26:42.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.933+0000 7f7b67e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7b601190a0 con 0x7f7b60077ff0 2024-09-10T23:26:42.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.933+0000 7f7b67e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7b601193a0 con 0x7f7b60113900 2024-09-10T23:26:42.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.933+0000 7f7b65400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b600776d0 0x7f7b6019f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:42.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.934+0000 7f7b65400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b600776d0 0x7f7b6019f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39442/0 (socket says 172.21.15.3:39442) 2024-09-10T23:26:42.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.934+0000 7f7b65400640 1 -- 172.21.15.3:0/2103525856 learned_addr learned my addr 172.21.15.3:0/2103525856 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:42.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.934+0000 7f7b64a00640 1 --2- 172.21.15.3:0/2103525856 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b60077ff0 0x7f7b6019fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:42.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.934+0000 7f7b65e00640 1 --2- 172.21.15.3:0/2103525856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b60113900 0x7f7b601a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:42.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.934+0000 7f7b65400640 1 -- 172.21.15.3:0/2103525856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b60113900 msgr2=0x7f7b601a50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:42.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.934+0000 7f7b65400640 1 --2- 172.21.15.3:0/2103525856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b60113900 0x7f7b601a50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:42.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.934+0000 7f7b65400640 1 -- 172.21.15.3:0/2103525856 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b60077ff0 msgr2=0x7f7b6019fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:42.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.934+0000 7f7b65400640 1 --2- 172.21.15.3:0/2103525856 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b60077ff0 0x7f7b6019fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:42.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.934+0000 7f7b65400640 1 -- 172.21.15.3:0/2103525856 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b601a58a0 con 0x7f7b600776d0 2024-09-10T23:26:42.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.934+0000 7f7b64a00640 1 --2- 172.21.15.3:0/2103525856 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b60077ff0 0x7f7b6019fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:42.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.934+0000 7f7b65400640 1 --2- 172.21.15.3:0/2103525856 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b600776d0 0x7f7b6019f800 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7b5400d770 tx=0x7f7b5400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:42.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.934+0000 7f7b5e000640 1 -- 172.21.15.3:0/2103525856 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b54017070 con 0x7f7b600776d0 2024-09-10T23:26:42.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.934+0000 7f7b5e000640 1 -- 172.21.15.3:0/2103525856 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b540054b0 con 0x7f7b600776d0 2024-09-10T23:26:42.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.934+0000 7f7b5e000640 1 -- 172.21.15.3:0/2103525856 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b54004c60 con 0x7f7b600776d0 2024-09-10T23:26:42.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.935+0000 7f7b67e00640 1 -- 172.21.15.3:0/2103525856 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b601a5b90 con 0x7f7b600776d0 2024-09-10T23:26:42.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.935+0000 7f7b67e00640 1 -- 172.21.15.3:0/2103525856 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b601ac250 con 0x7f7b600776d0 2024-09-10T23:26:42.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.936+0000 7f7b67e00640 1 -- 172.21.15.3:0/2103525856 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b60077ab0 con 0x7f7b600776d0 2024-09-10T23:26:42.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.938+0000 7f7b5e000640 1 -- 172.21.15.3:0/2103525856 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 22) ==== 153266+0+0 (secure 0 0 0) 0x7f7b54004e00 con 0x7f7b600776d0 2024-09-10T23:26:42.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.939+0000 7f7b5e000640 1 --2- 172.21.15.3:0/2103525856 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f7b480b5330 0x7f7b480b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:42.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.939+0000 7f7b5e000640 1 -- 172.21.15.3:0/2103525856 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f7b540e5c40 con 0x7f7b600776d0 2024-09-10T23:26:42.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.939+0000 7f7b64a00640 1 --2- 172.21.15.3:0/2103525856 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f7b480b5330 0x7f7b480b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:42.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.940+0000 7f7b64a00640 1 --2- 172.21.15.3:0/2103525856 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f7b480b5330 0x7f7b480b77f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c000c00 tx=0x7f7b4c005a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:42.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:42.943+0000 7f7b5e000640 1 -- 172.21.15.3:0/2103525856 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7b540ac610 con 0x7f7b600776d0 2024-09-10T23:26:42.970 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:26:42 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T23:26:42.687+0000 7f7096e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:26:42.970 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:26:42 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T23:26:42.687+0000 7f7096e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:26:42.970 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:26:42 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T23:26:42.687+0000 7f7096e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:26:42.970 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:26:42 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T23:26:42.687+0000 7f7096e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:26:42.971 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:26:42 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T23:26:42.687+0000 7f7096e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:26:43.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.159+0000 7f7b67e00640 1 -- 172.21.15.3:0/2103525856 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f7b60063590 con 0x7f7b480b5330 2024-09-10T23:26:43.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.289+0000 7f7b5e000640 1 -- 172.21.15.3:0/2103525856 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mgrmap(e 23) ==== 153317+0+0 (secure 0 0 0) 0x7f7b540a8180 con 0x7f7b600776d0 2024-09-10T23:26:43.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.362+0000 7f7b5e000640 1 -- 172.21.15.3:0/2103525856 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f7b60063590 con 0x7f7b480b5330 2024-09-10T23:26:43.363 INFO:teuthology.orchestra.run.smithi003.stdout:Schedule set for path / 2024-09-10T23:26:43.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.364+0000 7f7b67e00640 1 -- 172.21.15.3:0/2103525856 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f7b480b5330 msgr2=0x7f7b480b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:43.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.364+0000 7f7b67e00640 1 --2- 172.21.15.3:0/2103525856 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f7b480b5330 0x7f7b480b77f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c000c00 tx=0x7f7b4c005a40 comp rx=0 tx=0).stop 2024-09-10T23:26:43.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.364+0000 7f7b67e00640 1 -- 172.21.15.3:0/2103525856 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b600776d0 msgr2=0x7f7b6019f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:43.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.364+0000 7f7b67e00640 1 --2- 172.21.15.3:0/2103525856 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b600776d0 0x7f7b6019f800 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7b5400d770 tx=0x7f7b5400dc30 comp rx=0 tx=0).stop 2024-09-10T23:26:43.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.364+0000 7f7b67e00640 1 -- 172.21.15.3:0/2103525856 shutdown_connections 2024-09-10T23:26:43.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.364+0000 7f7b67e00640 1 --2- 172.21.15.3:0/2103525856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b60113900 0x7f7b601a50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:43.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.364+0000 7f7b67e00640 1 --2- 172.21.15.3:0/2103525856 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b60077ff0 0x7f7b6019fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:43.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.364+0000 7f7b67e00640 1 --2- 172.21.15.3:0/2103525856 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f7b480b5330 0x7f7b480b77f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:43.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.364+0000 7f7b67e00640 1 --2- 172.21.15.3:0/2103525856 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b600776d0 0x7f7b6019f800 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:43.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.364+0000 7f7b67e00640 1 -- 172.21.15.3:0/2103525856 >> 172.21.15.3:0/2103525856 conn(0x7f7b60100900 msgr2=0x7f7b60102cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:43.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.364+0000 7f7b67e00640 1 -- 172.21.15.3:0/2103525856 shutdown_connections 2024-09-10T23:26:43.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.365+0000 7f7b67e00640 1 -- 172.21.15.3:0/2103525856 wait complete. 2024-09-10T23:26:43.381 DEBUG:teuthology.orchestra.run.smithi003:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-10T23:26:43.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.540+0000 7f0548a00640 1 -- 172.21.15.3:0/400427790 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0544113900 msgr2=0x7f0544115cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:43.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.540+0000 7f0548a00640 1 --2- 172.21.15.3:0/400427790 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0544113900 0x7f0544115cf0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f053c009ca0 tx=0x7f053c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:26:43.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.540+0000 7f0548a00640 1 -- 172.21.15.3:0/400427790 shutdown_connections 2024-09-10T23:26:43.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.540+0000 7f0548a00640 1 --2- 172.21.15.3:0/400427790 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0544113900 0x7f0544115cf0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:43.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.540+0000 7f0548a00640 1 --2- 172.21.15.3:0/400427790 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0544077ff0 0x7f05441133c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:43.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.540+0000 7f0548a00640 1 --2- 172.21.15.3:0/400427790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05440776d0 0x7f0544077ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:43.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.540+0000 7f0548a00640 1 -- 172.21.15.3:0/400427790 >> 172.21.15.3:0/400427790 conn(0x7f0544100900 msgr2=0x7f0544102d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:43.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.540+0000 7f0548a00640 1 -- 172.21.15.3:0/400427790 shutdown_connections 2024-09-10T23:26:43.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.540+0000 7f0548a00640 1 -- 172.21.15.3:0/400427790 wait complete. 2024-09-10T23:26:43.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.541+0000 7f0548a00640 1 Processor -- start 2024-09-10T23:26:43.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.541+0000 7f0548a00640 1 -- start start 2024-09-10T23:26:43.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.541+0000 7f0548a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f05440776d0 0x7f054419f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:43.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.541+0000 7f0548a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0544077ff0 0x7f054419fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:43.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.541+0000 7f0548a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0544113900 0x7f05441a5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:43.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.541+0000 7f0548a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f05441191a0 con 0x7f05440776d0 2024-09-10T23:26:43.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.541+0000 7f0548a00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0544119020 con 0x7f0544077ff0 2024-09-10T23:26:43.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.541+0000 7f0548a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0544119320 con 0x7f0544113900 2024-09-10T23:26:43.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.541+0000 7f0541e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f05440776d0 0x7f054419f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:43.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.542+0000 7f0541e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f05440776d0 0x7f054419f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39488/0 (socket says 172.21.15.3:39488) 2024-09-10T23:26:43.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.542+0000 7f0541e00640 1 -- 172.21.15.3:0/1027242805 learned_addr learned my addr 172.21.15.3:0/1027242805 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:43.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.542+0000 7f0542800640 1 --2- 172.21.15.3:0/1027242805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0544113900 0x7f05441a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:43.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.542+0000 7f0539400640 1 --2- 172.21.15.3:0/1027242805 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0544077ff0 0x7f054419fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:43.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.542+0000 7f0541e00640 1 -- 172.21.15.3:0/1027242805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0544113900 msgr2=0x7f05441a5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:43.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.542+0000 7f0541e00640 1 --2- 172.21.15.3:0/1027242805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0544113900 0x7f05441a5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:43.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.542+0000 7f0541e00640 1 -- 172.21.15.3:0/1027242805 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0544077ff0 msgr2=0x7f054419fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:43.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.542+0000 7f0541e00640 1 --2- 172.21.15.3:0/1027242805 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0544077ff0 0x7f054419fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:43.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.542+0000 7f0541e00640 1 -- 172.21.15.3:0/1027242805 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05441a5800 con 0x7f05440776d0 2024-09-10T23:26:43.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.542+0000 7f0539400640 1 --2- 172.21.15.3:0/1027242805 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0544077ff0 0x7f054419fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:43.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.542+0000 7f0541e00640 1 --2- 172.21.15.3:0/1027242805 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f05440776d0 0x7f054419f760 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f053400e9f0 tx=0x7f053400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:43.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.543+0000 7f053b400640 1 -- 172.21.15.3:0/1027242805 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053400cd80 con 0x7f05440776d0 2024-09-10T23:26:43.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.543+0000 7f053b400640 1 -- 172.21.15.3:0/1027242805 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f05340108c0 con 0x7f05440776d0 2024-09-10T23:26:43.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.543+0000 7f0548a00640 1 -- 172.21.15.3:0/1027242805 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05441a5af0 con 0x7f05440776d0 2024-09-10T23:26:43.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.543+0000 7f053b400640 1 -- 172.21.15.3:0/1027242805 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05340187c0 con 0x7f05440776d0 2024-09-10T23:26:43.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.543+0000 7f0548a00640 1 -- 172.21.15.3:0/1027242805 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05441ac1b0 con 0x7f05440776d0 2024-09-10T23:26:43.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.544+0000 7f0548a00640 1 -- 172.21.15.3:0/1027242805 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0544077ab0 con 0x7f05440776d0 2024-09-10T23:26:43.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.546+0000 7f053b400640 1 -- 172.21.15.3:0/1027242805 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 23) ==== 153317+0+0 (secure 0 0 0) 0x7f0534010430 con 0x7f05440776d0 2024-09-10T23:26:43.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.547+0000 7f053b400640 1 --2- 172.21.15.3:0/1027242805 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f05280b53c0 0x7f05280b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:43.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.547+0000 7f053b400640 1 -- 172.21.15.3:0/1027242805 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f05340e66e0 con 0x7f05440776d0 2024-09-10T23:26:43.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.547+0000 7f0539400640 1 --2- 172.21.15.3:0/1027242805 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f05280b53c0 0x7f05280b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:43.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.548+0000 7f0539400640 1 --2- 172.21.15.3:0/1027242805 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f05280b53c0 0x7f05280b7880 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f052c0058c0 tx=0x7f052c005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:43.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.551+0000 7f053b400640 1 -- 172.21.15.3:0/1027242805 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f05340acf50 con 0x7f05440776d0 2024-09-10T23:26:43.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:43 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/1177517190' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-10T23:26:43.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:43 smithi038 ceph-mon[34225]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T23:26:43.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:43 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/1177517190' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-10T23:26:43.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:43 smithi194 ceph-mon[33904]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T23:26:43.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:43 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1177517190' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-10T23:26:43.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:43 smithi003 ceph-mon[30348]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T23:26:43.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.769+0000 7f0548a00640 1 -- 172.21.15.3:0/1027242805 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f0544063630 con 0x7f05280b53c0 2024-09-10T23:26:43.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.839+0000 7f053b400640 1 -- 172.21.15.3:0/1027242805 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f0544063630 con 0x7f05280b53c0 2024-09-10T23:26:43.841 INFO:teuthology.orchestra.run.smithi003.stdout:Retention added to path / 2024-09-10T23:26:43.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.842+0000 7f0548a00640 1 -- 172.21.15.3:0/1027242805 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f05280b53c0 msgr2=0x7f05280b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:43.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.842+0000 7f0548a00640 1 --2- 172.21.15.3:0/1027242805 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f05280b53c0 0x7f05280b7880 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f052c0058c0 tx=0x7f052c005850 comp rx=0 tx=0).stop 2024-09-10T23:26:43.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.842+0000 7f0548a00640 1 -- 172.21.15.3:0/1027242805 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f05440776d0 msgr2=0x7f054419f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:43.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.842+0000 7f0548a00640 1 --2- 172.21.15.3:0/1027242805 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f05440776d0 0x7f054419f760 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f053400e9f0 tx=0x7f053400eeb0 comp rx=0 tx=0).stop 2024-09-10T23:26:43.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.842+0000 7f0548a00640 1 -- 172.21.15.3:0/1027242805 shutdown_connections 2024-09-10T23:26:43.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.842+0000 7f0548a00640 1 --2- 172.21.15.3:0/1027242805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0544113900 0x7f05441a5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:43.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.842+0000 7f0548a00640 1 --2- 172.21.15.3:0/1027242805 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0544077ff0 0x7f054419fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:43.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.842+0000 7f0548a00640 1 --2- 172.21.15.3:0/1027242805 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f05280b53c0 0x7f05280b7880 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:43.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.842+0000 7f0548a00640 1 --2- 172.21.15.3:0/1027242805 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f05440776d0 0x7f054419f760 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:43.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.842+0000 7f0548a00640 1 -- 172.21.15.3:0/1027242805 >> 172.21.15.3:0/1027242805 conn(0x7f0544100900 msgr2=0x7f0544102cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:43.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.842+0000 7f0548a00640 1 -- 172.21.15.3:0/1027242805 shutdown_connections 2024-09-10T23:26:43.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:43.842+0000 7f0548a00640 1 -- 172.21.15.3:0/1027242805 wait complete. 2024-09-10T23:26:43.858 DEBUG:teuthology.orchestra.run.smithi003:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-10T23:26:44.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.012+0000 7f476be00640 1 -- 172.21.15.3:0/3413187830 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f476c108670 msgr2=0x7f476c108ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:44.014 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.012+0000 7f476be00640 1 --2- 172.21.15.3:0/3413187830 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f476c108670 0x7f476c108ab0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4758009900 tx=0x7f475802a410 comp rx=0 tx=0).stop 2024-09-10T23:26:44.014 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.012+0000 7f476be00640 1 -- 172.21.15.3:0/3413187830 shutdown_connections 2024-09-10T23:26:44.014 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.012+0000 7f476be00640 1 --2- 172.21.15.3:0/3413187830 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f476c108ff0 0x7f476c10f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.014 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.012+0000 7f476be00640 1 --2- 172.21.15.3:0/3413187830 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f476c108670 0x7f476c108ab0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.014 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.012+0000 7f476be00640 1 --2- 172.21.15.3:0/3413187830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f476c06ac10 0x7f476c06aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.014 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.012+0000 7f476be00640 1 -- 172.21.15.3:0/3413187830 >> 172.21.15.3:0/3413187830 conn(0x7f476c077470 msgr2=0x7f476c079cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:44.014 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.012+0000 7f476be00640 1 -- 172.21.15.3:0/3413187830 shutdown_connections 2024-09-10T23:26:44.014 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.013+0000 7f476be00640 1 -- 172.21.15.3:0/3413187830 wait complete. 2024-09-10T23:26:44.016 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.013+0000 7f476be00640 1 Processor -- start 2024-09-10T23:26:44.016 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.014+0000 7f476be00640 1 -- start start 2024-09-10T23:26:44.016 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.014+0000 7f476be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f476c06ac10 0x7f476c19b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:44.016 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.014+0000 7f476be00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f476c108670 0x7f476c19b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:44.016 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.014+0000 7f476be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f476c108ff0 0x7f476c1a0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:44.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.014+0000 7f476be00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f476c112b70 con 0x7f476c108ff0 2024-09-10T23:26:44.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.014+0000 7f476be00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f476c1129f0 con 0x7f476c108670 2024-09-10T23:26:44.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.014+0000 7f476be00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f476c112cf0 con 0x7f476c06ac10 2024-09-10T23:26:44.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.014+0000 7f476b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f476c108ff0 0x7f476c1a0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:44.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.014+0000 7f476aa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f476c06ac10 0x7f476c19b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:44.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.014+0000 7f476b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f476c108ff0 0x7f476c1a0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39494/0 (socket says 172.21.15.3:39494) 2024-09-10T23:26:44.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.014+0000 7f476b400640 1 -- 172.21.15.3:0/1428584444 learned_addr learned my addr 172.21.15.3:0/1428584444 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:44.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.014+0000 7f476aa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f476c06ac10 0x7f476c19b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.3:57574/0 (socket says 172.21.15.3:57574) 2024-09-10T23:26:44.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.014+0000 7f476a000640 1 --2- 172.21.15.3:0/1428584444 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f476c108670 0x7f476c19b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:44.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.015+0000 7f476b400640 1 -- 172.21.15.3:0/1428584444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f476c06ac10 msgr2=0x7f476c19b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:44.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.015+0000 7f476b400640 1 --2- 172.21.15.3:0/1428584444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f476c06ac10 0x7f476c19b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.015+0000 7f476b400640 1 -- 172.21.15.3:0/1428584444 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f476c108670 msgr2=0x7f476c19b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:44.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.015+0000 7f476b400640 1 --2- 172.21.15.3:0/1428584444 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f476c108670 0x7f476c19b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.015+0000 7f476b400640 1 -- 172.21.15.3:0/1428584444 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f476c1a1340 con 0x7f476c108ff0 2024-09-10T23:26:44.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.015+0000 7f476b400640 1 --2- 172.21.15.3:0/1428584444 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f476c108ff0 0x7f476c1a0b70 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f476400eb10 tx=0x7f476400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:44.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.015+0000 7f4763400640 1 -- 172.21.15.3:0/1428584444 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4764004b20 con 0x7f476c108ff0 2024-09-10T23:26:44.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.015+0000 7f4763400640 1 -- 172.21.15.3:0/1428584444 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4764004cc0 con 0x7f476c108ff0 2024-09-10T23:26:44.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.015+0000 7f476be00640 1 -- 172.21.15.3:0/1428584444 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f476c1a1630 con 0x7f476c108ff0 2024-09-10T23:26:44.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.015+0000 7f4763400640 1 -- 172.21.15.3:0/1428584444 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4764010690 con 0x7f476c108ff0 2024-09-10T23:26:44.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.015+0000 7f476be00640 1 -- 172.21.15.3:0/1428584444 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f476c1a7ed0 con 0x7f476c108ff0 2024-09-10T23:26:44.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.017+0000 7f476be00640 1 -- 172.21.15.3:0/1428584444 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f476c103e00 con 0x7f476c108ff0 2024-09-10T23:26:44.019 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.019+0000 7f4763400640 1 -- 172.21.15.3:0/1428584444 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 23) ==== 153317+0+0 (secure 0 0 0) 0x7f4764005000 con 0x7f476c108ff0 2024-09-10T23:26:44.021 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.020+0000 7f4763400640 1 --2- 172.21.15.3:0/1428584444 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f47500b5440 0x7f47500b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:44.021 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.020+0000 7f4763400640 1 -- 172.21.15.3:0/1428584444 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f47640e6910 con 0x7f476c108ff0 2024-09-10T23:26:44.021 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.021+0000 7f476aa00640 1 --2- 172.21.15.3:0/1428584444 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f47500b5440 0x7f47500b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:44.022 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.021+0000 7f476aa00640 1 --2- 172.21.15.3:0/1428584444 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f47500b5440 0x7f47500b7900 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f475c005d00 tx=0x7f475c00b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:44.022 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.022+0000 7f4763400640 1 -- 172.21.15.3:0/1428584444 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4764056220 con 0x7f476c108ff0 2024-09-10T23:26:44.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.240+0000 7f476be00640 1 -- 172.21.15.3:0/1428584444 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f476c106b90 con 0x7f47500b5440 2024-09-10T23:26:44.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.248+0000 7f4763400640 1 -- 172.21.15.3:0/1428584444 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f476c106b90 con 0x7f47500b5440 2024-09-10T23:26:44.249 INFO:teuthology.orchestra.run.smithi003.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-10T00:00:00", "created": "2024-09-10T23:26:43", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-10T23:26:44.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.250+0000 7f476be00640 1 -- 172.21.15.3:0/1428584444 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f47500b5440 msgr2=0x7f47500b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:44.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.250+0000 7f476be00640 1 --2- 172.21.15.3:0/1428584444 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f47500b5440 0x7f47500b7900 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f475c005d00 tx=0x7f475c00b410 comp rx=0 tx=0).stop 2024-09-10T23:26:44.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.250+0000 7f476be00640 1 -- 172.21.15.3:0/1428584444 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f476c108ff0 msgr2=0x7f476c1a0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:44.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.250+0000 7f476be00640 1 --2- 172.21.15.3:0/1428584444 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f476c108ff0 0x7f476c1a0b70 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f476400eb10 tx=0x7f476400c2d0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.250+0000 7f476be00640 1 -- 172.21.15.3:0/1428584444 shutdown_connections 2024-09-10T23:26:44.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.250+0000 7f476be00640 1 --2- 172.21.15.3:0/1428584444 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f47500b5440 0x7f47500b7900 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.250+0000 7f476be00640 1 --2- 172.21.15.3:0/1428584444 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f476c108ff0 0x7f476c1a0b70 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.250+0000 7f476be00640 1 --2- 172.21.15.3:0/1428584444 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f476c108670 0x7f476c19b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.250+0000 7f476be00640 1 --2- 172.21.15.3:0/1428584444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f476c06ac10 0x7f476c19b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.250+0000 7f476be00640 1 -- 172.21.15.3:0/1428584444 >> 172.21.15.3:0/1428584444 conn(0x7f476c077470 msgr2=0x7f476c106480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:44.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.250+0000 7f476be00640 1 -- 172.21.15.3:0/1428584444 shutdown_connections 2024-09-10T23:26:44.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.250+0000 7f476be00640 1 -- 172.21.15.3:0/1428584444 wait complete. 2024-09-10T23:26:44.267 DEBUG:teuthology.orchestra.run.smithi003:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-10T23:26:44.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.422+0000 7fb462400640 1 -- 172.21.15.3:0/1754729494 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb45c10b2a0 msgr2=0x7fb45c111aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:44.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.422+0000 7fb462400640 1 --2- 172.21.15.3:0/1754729494 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb45c10b2a0 0x7fb45c111aa0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb454009ca0 tx=0x7fb45402a8b0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.422+0000 7fb462400640 1 -- 172.21.15.3:0/1754729494 shutdown_connections 2024-09-10T23:26:44.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.422+0000 7fb462400640 1 --2- 172.21.15.3:0/1754729494 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb45c10b2a0 0x7fb45c111aa0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.422+0000 7fb462400640 1 --2- 172.21.15.3:0/1754729494 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb45c10a920 0x7fb45c10ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.422+0000 7fb462400640 1 --2- 172.21.15.3:0/1754729494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb45c104f20 0x7fb45c105300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.422+0000 7fb462400640 1 -- 172.21.15.3:0/1754729494 >> 172.21.15.3:0/1754729494 conn(0x7fb45c100900 msgr2=0x7fb45c102d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:44.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.422+0000 7fb462400640 1 -- 172.21.15.3:0/1754729494 shutdown_connections 2024-09-10T23:26:44.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.422+0000 7fb462400640 1 -- 172.21.15.3:0/1754729494 wait complete. 2024-09-10T23:26:44.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.423+0000 7fb462400640 1 Processor -- start 2024-09-10T23:26:44.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.423+0000 7fb462400640 1 -- start start 2024-09-10T23:26:44.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.424+0000 7fb462400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb45c104f20 0x7fb45c19b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:44.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.424+0000 7fb462400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb45c10a920 0x7fb45c19b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:44.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.424+0000 7fb462400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb45c10b2a0 0x7fb45c1a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:44.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.424+0000 7fb462400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb45c114dc0 con 0x7fb45c104f20 2024-09-10T23:26:44.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.424+0000 7fb462400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb45c114c40 con 0x7fb45c10a920 2024-09-10T23:26:44.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.424+0000 7fb462400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb45c114f40 con 0x7fb45c10b2a0 2024-09-10T23:26:44.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.424+0000 7fb45b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb45c104f20 0x7fb45c19b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:44.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.424+0000 7fb45b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb45c104f20 0x7fb45c19b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39518/0 (socket says 172.21.15.3:39518) 2024-09-10T23:26:44.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.424+0000 7fb45b400640 1 -- 172.21.15.3:0/788854673 learned_addr learned my addr 172.21.15.3:0/788854673 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:44.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.424+0000 7fb45be00640 1 --2- 172.21.15.3:0/788854673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb45c10b2a0 0x7fb45c1a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:44.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.424+0000 7fb45aa00640 1 --2- 172.21.15.3:0/788854673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb45c10a920 0x7fb45c19b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:44.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.424+0000 7fb45b400640 1 -- 172.21.15.3:0/788854673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb45c10b2a0 msgr2=0x7fb45c1a0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:44.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.425+0000 7fb45b400640 1 --2- 172.21.15.3:0/788854673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb45c10b2a0 0x7fb45c1a0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.425+0000 7fb45b400640 1 -- 172.21.15.3:0/788854673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb45c10a920 msgr2=0x7fb45c19b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:44.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.425+0000 7fb45b400640 1 --2- 172.21.15.3:0/788854673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb45c10a920 0x7fb45c19b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.425+0000 7fb45b400640 1 -- 172.21.15.3:0/788854673 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb45c1a1360 con 0x7fb45c104f20 2024-09-10T23:26:44.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.425+0000 7fb45aa00640 1 --2- 172.21.15.3:0/788854673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb45c10a920 0x7fb45c19b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:44.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.425+0000 7fb45b400640 1 --2- 172.21.15.3:0/788854673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb45c104f20 0x7fb45c19b2c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb44c00d950 tx=0x7fb44c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:44.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.425+0000 7fb453e00640 1 -- 172.21.15.3:0/788854673 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44c017030 con 0x7fb45c104f20 2024-09-10T23:26:44.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.425+0000 7fb453e00640 1 -- 172.21.15.3:0/788854673 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb44c004020 con 0x7fb45c104f20 2024-09-10T23:26:44.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.425+0000 7fb453e00640 1 -- 172.21.15.3:0/788854673 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44c0055d0 con 0x7fb45c104f20 2024-09-10T23:26:44.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.425+0000 7fb462400640 1 -- 172.21.15.3:0/788854673 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb45c1a1650 con 0x7fb45c104f20 2024-09-10T23:26:44.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.425+0000 7fb462400640 1 -- 172.21.15.3:0/788854673 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb45c1a7d10 con 0x7fb45c104f20 2024-09-10T23:26:44.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.426+0000 7fb462400640 1 -- 172.21.15.3:0/788854673 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb45c105300 con 0x7fb45c104f20 2024-09-10T23:26:44.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.428+0000 7fb453e00640 1 -- 172.21.15.3:0/788854673 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 23) ==== 153317+0+0 (secure 0 0 0) 0x7fb44c009a30 con 0x7fb45c104f20 2024-09-10T23:26:44.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.430+0000 7fb453e00640 1 --2- 172.21.15.3:0/788854673 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb4400b5440 0x7fb4400b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:44.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.430+0000 7fb453e00640 1 -- 172.21.15.3:0/788854673 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7fb44c0e5ce0 con 0x7fb45c104f20 2024-09-10T23:26:44.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.430+0000 7fb45aa00640 1 --2- 172.21.15.3:0/788854673 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb4400b5440 0x7fb4400b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:44.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.431+0000 7fb45aa00640 1 --2- 172.21.15.3:0/788854673 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb4400b5440 0x7fb4400b7900 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb448005e10 tx=0x7fb448005da0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:44.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.433+0000 7fb453e00640 1 -- 172.21.15.3:0/788854673 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb44c0ac550 con 0x7fb45c104f20 2024-09-10T23:26:44.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:44 smithi038 ceph-mon[34225]: from='client.15516 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:26:44.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:44 smithi038 ceph-mon[34225]: pgmap v389: 129 pgs: 129 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-10T23:26:44.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:44 smithi038 ceph-mon[34225]: from='client.15528 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:26:44.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:44 smithi038 ceph-mon[34225]: mgrmap e23: x(active, since 10m), standbys: z, y 2024-09-10T23:26:44.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.650+0000 7fb462400640 1 -- 172.21.15.3:0/788854673 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fb45c02e620 con 0x7fb4400b5440 2024-09-10T23:26:44.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.658+0000 7fb453e00640 1 -- 172.21.15.3:0/788854673 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fb45c02e620 con 0x7fb4400b5440 2024-09-10T23:26:44.659 INFO:teuthology.orchestra.run.smithi003.stdout:/ 1m 6m3h 2024-09-10T23:26:44.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.660+0000 7fb462400640 1 -- 172.21.15.3:0/788854673 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb4400b5440 msgr2=0x7fb4400b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:44.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.660+0000 7fb462400640 1 --2- 172.21.15.3:0/788854673 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb4400b5440 0x7fb4400b7900 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb448005e10 tx=0x7fb448005da0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.661+0000 7fb462400640 1 -- 172.21.15.3:0/788854673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb45c104f20 msgr2=0x7fb45c19b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:44.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.661+0000 7fb462400640 1 --2- 172.21.15.3:0/788854673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb45c104f20 0x7fb45c19b2c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb44c00d950 tx=0x7fb44c00de10 comp rx=0 tx=0).stop 2024-09-10T23:26:44.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.661+0000 7fb462400640 1 -- 172.21.15.3:0/788854673 shutdown_connections 2024-09-10T23:26:44.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.661+0000 7fb462400640 1 --2- 172.21.15.3:0/788854673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb45c10b2a0 0x7fb45c1a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.661+0000 7fb462400640 1 --2- 172.21.15.3:0/788854673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb45c10a920 0x7fb45c19b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.661+0000 7fb462400640 1 --2- 172.21.15.3:0/788854673 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb4400b5440 0x7fb4400b7900 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.661+0000 7fb462400640 1 --2- 172.21.15.3:0/788854673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb45c104f20 0x7fb45c19b2c0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:44.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.661+0000 7fb462400640 1 -- 172.21.15.3:0/788854673 >> 172.21.15.3:0/788854673 conn(0x7fb45c100900 msgr2=0x7fb45c102cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:44.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.661+0000 7fb462400640 1 -- 172.21.15.3:0/788854673 shutdown_connections 2024-09-10T23:26:44.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:44.661+0000 7fb462400640 1 -- 172.21.15.3:0/788854673 wait complete. 2024-09-10T23:26:44.675 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:44 smithi003 ceph-mon[30348]: from='client.15516 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:26:44.675 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:44 smithi003 ceph-mon[30348]: pgmap v389: 129 pgs: 129 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-10T23:26:44.675 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:44 smithi003 ceph-mon[30348]: from='client.15528 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:26:44.675 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:44 smithi003 ceph-mon[30348]: mgrmap e23: x(active, since 10m), standbys: z, y 2024-09-10T23:26:44.677 DEBUG:teuthology.orchestra.run.smithi003:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-10T23:26:44.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:44 smithi194 ceph-mon[33904]: from='client.15516 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:26:44.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:44 smithi194 ceph-mon[33904]: pgmap v389: 129 pgs: 129 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-10T23:26:44.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:44 smithi194 ceph-mon[33904]: from='client.15528 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:26:44.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:44 smithi194 ceph-mon[33904]: mgrmap e23: x(active, since 10m), standbys: z, y 2024-09-10T23:26:44.737 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-10T23:26:44.747 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-10T23:26:44.814 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T23:26:44.815 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T23:26:45.194 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:45.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:45 smithi038 ceph-mon[34225]: from='client.15540 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:26:45.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:45 smithi038 ceph-mon[34225]: from='client.15546 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:26:45.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:45 smithi038 ceph-mon[34225]: from='client.15552 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:26:45.634 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:45 smithi003 ceph-mon[30348]: from='client.15540 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:26:45.634 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:45 smithi003 ceph-mon[30348]: from='client.15546 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:26:45.634 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:45 smithi003 ceph-mon[30348]: from='client.15552 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:26:45.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:45 smithi194 ceph-mon[33904]: from='client.15540 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:26:45.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:45 smithi194 ceph-mon[33904]: from='client.15546 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:26:45.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:45 smithi194 ceph-mon[33904]: from='client.15552 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:26:45.749 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.747+0000 7fe9e3e00640 1 -- 172.21.15.3:0/764840291 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9e4102c10 msgr2=0x7fe9e4102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:45.749 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.747+0000 7fe9e3e00640 1 --2- 172.21.15.3:0/764840291 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9e4102c10 0x7fe9e4102ff0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4009900 tx=0x7fe9d402a410 comp rx=0 tx=0).stop 2024-09-10T23:26:45.749 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.747+0000 7fe9e3e00640 1 -- 172.21.15.3:0/764840291 shutdown_connections 2024-09-10T23:26:45.749 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.747+0000 7fe9e3e00640 1 --2- 172.21.15.3:0/764840291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9e4108fa0 0x7fe9e410f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:45.749 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.747+0000 7fe9e3e00640 1 --2- 172.21.15.3:0/764840291 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9e4108620 0x7fe9e4108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:45.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.747+0000 7fe9e3e00640 1 --2- 172.21.15.3:0/764840291 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9e4102c10 0x7fe9e4102ff0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:45.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.747+0000 7fe9e3e00640 1 -- 172.21.15.3:0/764840291 >> 172.21.15.3:0/764840291 conn(0x7fe9e40fe660 msgr2=0x7fe9e4100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:45.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.748+0000 7fe9e3e00640 1 -- 172.21.15.3:0/764840291 shutdown_connections 2024-09-10T23:26:45.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.748+0000 7fe9e3e00640 1 -- 172.21.15.3:0/764840291 wait complete. 2024-09-10T23:26:45.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.749+0000 7fe9e3e00640 1 Processor -- start 2024-09-10T23:26:45.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.749+0000 7fe9e3e00640 1 -- start start 2024-09-10T23:26:45.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.749+0000 7fe9e3e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9e4102c10 0x7fe9e4198f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:45.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.749+0000 7fe9e3e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9e4108620 0x7fe9e4199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:45.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.749+0000 7fe9e3e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9e4108fa0 0x7fe9e419e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:45.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.749+0000 7fe9e3e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e4112b10 con 0x7fe9e4108620 2024-09-10T23:26:45.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.749+0000 7fe9e3e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e4112990 con 0x7fe9e4102c10 2024-09-10T23:26:45.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.749+0000 7fe9e3e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e4112c90 con 0x7fe9e4108fa0 2024-09-10T23:26:45.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.749+0000 7fe9da000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9e4108620 0x7fe9e4199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:45.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.750+0000 7fe9da000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9e4108620 0x7fe9e4199480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39540/0 (socket says 172.21.15.3:39540) 2024-09-10T23:26:45.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.750+0000 7fe9da000640 1 -- 172.21.15.3:0/4241636780 learned_addr learned my addr 172.21.15.3:0/4241636780 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:45.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.750+0000 7fe9e3400640 1 --2- 172.21.15.3:0/4241636780 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9e4108fa0 0x7fe9e419e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:45.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.750+0000 7fe9e2a00640 1 --2- 172.21.15.3:0/4241636780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9e4102c10 0x7fe9e4198f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:45.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.750+0000 7fe9da000640 1 -- 172.21.15.3:0/4241636780 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9e4108fa0 msgr2=0x7fe9e419e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:45.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.750+0000 7fe9da000640 1 --2- 172.21.15.3:0/4241636780 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9e4108fa0 0x7fe9e419e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:45.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.750+0000 7fe9da000640 1 -- 172.21.15.3:0/4241636780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9e4102c10 msgr2=0x7fe9e4198f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:45.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.750+0000 7fe9da000640 1 --2- 172.21.15.3:0/4241636780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9e4102c10 0x7fe9e4198f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:45.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.750+0000 7fe9da000640 1 -- 172.21.15.3:0/4241636780 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e419eff0 con 0x7fe9e4108620 2024-09-10T23:26:45.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.750+0000 7fe9da000640 1 --2- 172.21.15.3:0/4241636780 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9e4108620 0x7fe9e4199480 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc00db80 tx=0x7fe9cc00b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:45.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.751+0000 7fe9dbe00640 1 -- 172.21.15.3:0/4241636780 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc017070 con 0x7fe9e4108620 2024-09-10T23:26:45.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.751+0000 7fe9dbe00640 1 -- 172.21.15.3:0/4241636780 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe9cc004020 con 0x7fe9e4108620 2024-09-10T23:26:45.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.751+0000 7fe9e3e00640 1 -- 172.21.15.3:0/4241636780 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9e419f2e0 con 0x7fe9e4108620 2024-09-10T23:26:45.754 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.751+0000 7fe9dbe00640 1 -- 172.21.15.3:0/4241636780 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc00be60 con 0x7fe9e4108620 2024-09-10T23:26:45.754 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.751+0000 7fe9e3e00640 1 -- 172.21.15.3:0/4241636780 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9e41a5b70 con 0x7fe9e4108620 2024-09-10T23:26:45.754 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.752+0000 7fe9e3e00640 1 -- 172.21.15.3:0/4241636780 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9e4103ec0 con 0x7fe9e4108620 2024-09-10T23:26:45.755 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.754+0000 7fe9dbe00640 1 -- 172.21.15.3:0/4241636780 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 24) ==== 153374+0+0 (secure 0 0 0) 0x7fe9cc023060 con 0x7fe9e4108620 2024-09-10T23:26:45.757 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.756+0000 7fe9dbe00640 1 --2- 172.21.15.3:0/4241636780 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fe9c80b5580 0x7fe9c80b7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:45.757 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.756+0000 7fe9dbe00640 1 -- 172.21.15.3:0/4241636780 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7fe9cc0e60b0 con 0x7fe9e4108620 2024-09-10T23:26:45.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.757+0000 7fe9e2a00640 1 --2- 172.21.15.3:0/4241636780 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fe9c80b5580 0x7fe9c80b7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:45.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.757+0000 7fe9e2a00640 1 --2- 172.21.15.3:0/4241636780 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fe9c80b5580 0x7fe9c80b7a40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe9d40057c0 tx=0x7fe9d40058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:45.760 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.759+0000 7fe9dbe00640 1 -- 172.21.15.3:0/4241636780 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe9cc0ac860 con 0x7fe9e4108620 2024-09-10T23:26:45.962 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.961+0000 7fe9e3e00640 1 -- 172.21.15.3:0/4241636780 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe9e4063590 con 0x7fe9c80b5580 2024-09-10T23:26:45.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.968+0000 7fe9dbe00640 1 -- 172.21.15.3:0/4241636780 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340795 (secure 0 0 0) 0x7fe9e4063590 con 0x7fe9c80b5580 2024-09-10T23:26:45.974 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:26:45.976 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-10T23:26:45.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.973+0000 7fe9e3e00640 1 -- 172.21.15.3:0/4241636780 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fe9c80b5580 msgr2=0x7fe9c80b7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:45.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.973+0000 7fe9e3e00640 1 --2- 172.21.15.3:0/4241636780 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fe9c80b5580 0x7fe9c80b7a40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe9d40057c0 tx=0x7fe9d40058d0 comp rx=0 tx=0).stop 2024-09-10T23:26:45.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.973+0000 7fe9e3e00640 1 -- 172.21.15.3:0/4241636780 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9e4108620 msgr2=0x7fe9e4199480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:45.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.973+0000 7fe9e3e00640 1 --2- 172.21.15.3:0/4241636780 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9e4108620 0x7fe9e4199480 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc00db80 tx=0x7fe9cc00b630 comp rx=0 tx=0).stop 2024-09-10T23:26:45.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.973+0000 7fe9e3e00640 1 -- 172.21.15.3:0/4241636780 shutdown_connections 2024-09-10T23:26:45.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.973+0000 7fe9e3e00640 1 --2- 172.21.15.3:0/4241636780 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9e4108fa0 0x7fe9e419e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:45.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.973+0000 7fe9e3e00640 1 --2- 172.21.15.3:0/4241636780 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fe9c80b5580 0x7fe9c80b7a40 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:45.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.973+0000 7fe9e3e00640 1 --2- 172.21.15.3:0/4241636780 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9e4108620 0x7fe9e4199480 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:45.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.973+0000 7fe9e3e00640 1 --2- 172.21.15.3:0/4241636780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9e4102c10 0x7fe9e4198f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:45.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.973+0000 7fe9e3e00640 1 -- 172.21.15.3:0/4241636780 >> 172.21.15.3:0/4241636780 conn(0x7fe9e40fe660 msgr2=0x7fe9e4100a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:45.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.974+0000 7fe9e3e00640 1 -- 172.21.15.3:0/4241636780 shutdown_connections 2024-09-10T23:26:45.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:45.974+0000 7fe9e3e00640 1 -- 172.21.15.3:0/4241636780 wait complete. 2024-09-10T23:26:46.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:46 smithi038 ceph-mon[34225]: pgmap v390: 129 pgs: 129 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-10T23:26:46.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:46 smithi038 ceph-mon[34225]: mgrmap e24: x(active, since 10m), standbys: z, y 2024-09-10T23:26:46.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:46 smithi194 ceph-mon[33904]: pgmap v390: 129 pgs: 129 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-10T23:26:46.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:46 smithi194 ceph-mon[33904]: mgrmap e24: x(active, since 10m), standbys: z, y 2024-09-10T23:26:46.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:46 smithi003 ceph-mon[30348]: pgmap v390: 129 pgs: 129 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-10T23:26:46.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:46 smithi003 ceph-mon[30348]: mgrmap e24: x(active, since 10m), standbys: z, y 2024-09-10T23:26:46.898 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":390,"stamp":"2024-09-10T23:26:44.793540+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658382,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":793,"num_read_kb":496,"num_write":306,"num_write_kb":2280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2951874,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":749,"ondisk_log_size":749,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365564,"kb_used_data":12156,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576260,"statfs":{"total":1151940427776,"available":1151566090240,"internally_reserved":0,"allocated":12447744,"data_stored":8376907,"data_compressed":505110,"data_compressed_allocated":688128,"data_compressed_original":2875392,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1870,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":33,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003302"},"pg_stats":[{"pgid":"2.1f","version":"88'9","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.145875+0000","last_change":"2024-09-10T23:23:54.796561+0000","last_active":"2024-09-10T23:25:22.145875+0000","last_peered":"2024-09-10T23:25:22.145875+0000","last_clean":"2024-09-10T23:25:22.145875+0000","last_became_active":"2024-09-10T23:23:54.796058+0000","last_became_peered":"2024-09-10T23:23:54.796058+0000","last_unstale":"2024-09-10T23:25:22.145875+0000","last_undegraded":"2024-09-10T23:25:22.145875+0000","last_fullsized":"2024-09-10T23:25:22.145875+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:27.790990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.159632+0000","last_change":"2024-09-10T23:23:57.828660+0000","last_active":"2024-09-10T23:26:21.159632+0000","last_peered":"2024-09-10T23:26:21.159632+0000","last_clean":"2024-09-10T23:26:21.159632+0000","last_became_active":"2024-09-10T23:23:57.828287+0000","last_became_peered":"2024-09-10T23:23:57.828287+0000","last_unstale":"2024-09-10T23:26:21.159632+0000","last_undegraded":"2024-09-10T23:26:21.159632+0000","last_fullsized":"2024-09-10T23:26:21.159632+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:13.085003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.140416+0000","last_change":"2024-09-10T23:24:05.886167+0000","last_active":"2024-09-10T23:25:22.140416+0000","last_peered":"2024-09-10T23:25:22.140416+0000","last_clean":"2024-09-10T23:25:22.140416+0000","last_became_active":"2024-09-10T23:24:05.885706+0000","last_became_peered":"2024-09-10T23:24:05.885706+0000","last_unstale":"2024-09-10T23:25:22.140416+0000","last_undegraded":"2024-09-10T23:25:22.140416+0000","last_fullsized":"2024-09-10T23:25:22.140416+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:42.337384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481001+0000","last_change":"2024-09-10T23:23:54.791770+0000","last_active":"2024-09-10T23:25:22.481001+0000","last_peered":"2024-09-10T23:25:22.481001+0000","last_clean":"2024-09-10T23:25:22.481001+0000","last_became_active":"2024-09-10T23:23:54.791476+0000","last_became_peered":"2024-09-10T23:23:54.791476+0000","last_unstale":"2024-09-10T23:25:22.481001+0000","last_undegraded":"2024-09-10T23:25:22.481001+0000","last_fullsized":"2024-09-10T23:25:22.481001+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:07.493654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.185714+0000","last_change":"2024-09-10T23:23:57.833858+0000","last_active":"2024-09-10T23:26:21.185714+0000","last_peered":"2024-09-10T23:26:21.185714+0000","last_clean":"2024-09-10T23:26:21.185714+0000","last_became_active":"2024-09-10T23:23:57.833496+0000","last_became_peered":"2024-09-10T23:23:57.833496+0000","last_unstale":"2024-09-10T23:26:21.185714+0000","last_undegraded":"2024-09-10T23:26:21.185714+0000","last_fullsized":"2024-09-10T23:26:21.185714+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:48:50.293342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147391+0000","last_change":"2024-09-10T23:24:05.878733+0000","last_active":"2024-09-10T23:25:22.147391+0000","last_peered":"2024-09-10T23:25:22.147391+0000","last_clean":"2024-09-10T23:25:22.147391+0000","last_became_active":"2024-09-10T23:24:05.878285+0000","last_became_peered":"2024-09-10T23:24:05.878285+0000","last_unstale":"2024-09-10T23:25:22.147391+0000","last_undegraded":"2024-09-10T23:25:22.147391+0000","last_fullsized":"2024-09-10T23:25:22.147391+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:21:11.636292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.181613+0000","last_change":"2024-09-10T23:23:54.792253+0000","last_active":"2024-09-10T23:25:22.181613+0000","last_peered":"2024-09-10T23:25:22.181613+0000","last_clean":"2024-09-10T23:25:22.181613+0000","last_became_active":"2024-09-10T23:23:54.791847+0000","last_became_peered":"2024-09-10T23:23:54.791847+0000","last_unstale":"2024-09-10T23:25:22.181613+0000","last_undegraded":"2024-09-10T23:25:22.181613+0000","last_fullsized":"2024-09-10T23:25:22.181613+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:03.563741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.187276+0000","last_change":"2024-09-10T23:23:57.837009+0000","last_active":"2024-09-10T23:26:21.187276+0000","last_peered":"2024-09-10T23:26:21.187276+0000","last_clean":"2024-09-10T23:26:21.187276+0000","last_became_active":"2024-09-10T23:23:57.835152+0000","last_became_peered":"2024-09-10T23:23:57.835152+0000","last_unstale":"2024-09-10T23:26:21.187276+0000","last_undegraded":"2024-09-10T23:26:21.187276+0000","last_fullsized":"2024-09-10T23:26:21.187276+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:25.345514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147469+0000","last_change":"2024-09-10T23:24:05.882593+0000","last_active":"2024-09-10T23:25:22.147469+0000","last_peered":"2024-09-10T23:25:22.147469+0000","last_clean":"2024-09-10T23:25:22.147469+0000","last_became_active":"2024-09-10T23:24:05.882123+0000","last_became_peered":"2024-09-10T23:24:05.882123+0000","last_unstale":"2024-09-10T23:25:22.147469+0000","last_undegraded":"2024-09-10T23:25:22.147469+0000","last_fullsized":"2024-09-10T23:25:22.147469+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:22:30.103412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.142081+0000","last_change":"2024-09-10T23:24:21.980433+0000","last_active":"2024-09-10T23:25:22.142081+0000","last_peered":"2024-09-10T23:25:22.142081+0000","last_clean":"2024-09-10T23:25:22.142081+0000","last_became_active":"2024-09-10T23:24:21.974096+0000","last_became_peered":"2024-09-10T23:24:21.974096+0000","last_unstale":"2024-09-10T23:25:22.142081+0000","last_undegraded":"2024-09-10T23:25:22.142081+0000","last_fullsized":"2024-09-10T23:25:22.142081+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:33.430921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":62,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.184065+0000","last_change":"2024-09-10T23:24:21.978526+0000","last_active":"2024-09-10T23:26:21.184065+0000","last_peered":"2024-09-10T23:26:21.184065+0000","last_clean":"2024-09-10T23:26:21.184065+0000","last_became_active":"2024-09-10T23:24:21.978137+0000","last_became_peered":"2024-09-10T23:24:21.978137+0000","last_unstale":"2024-09-10T23:26:21.184065+0000","last_undegraded":"2024-09-10T23:26:21.184065+0000","last_fullsized":"2024-09-10T23:26:21.184065+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:53:31.785033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147303+0000","last_change":"2024-09-10T23:24:05.889983+0000","last_active":"2024-09-10T23:25:22.147303+0000","last_peered":"2024-09-10T23:25:22.147303+0000","last_clean":"2024-09-10T23:25:22.147303+0000","last_became_active":"2024-09-10T23:24:05.889003+0000","last_became_peered":"2024-09-10T23:24:05.889003+0000","last_unstale":"2024-09-10T23:25:22.147303+0000","last_undegraded":"2024-09-10T23:25:22.147303+0000","last_fullsized":"2024-09-10T23:25:22.147303+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:19:13.555187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.186655+0000","last_change":"2024-09-10T23:23:57.831433+0000","last_active":"2024-09-10T23:26:21.186655+0000","last_peered":"2024-09-10T23:26:21.186655+0000","last_clean":"2024-09-10T23:26:21.186655+0000","last_became_active":"2024-09-10T23:23:57.831108+0000","last_became_peered":"2024-09-10T23:23:57.831108+0000","last_unstale":"2024-09-10T23:26:21.186655+0000","last_undegraded":"2024-09-10T23:26:21.186655+0000","last_fullsized":"2024-09-10T23:26:21.186655+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:50:20.160455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.181266+0000","last_change":"2024-09-10T23:23:54.792269+0000","last_active":"2024-09-10T23:25:22.181266+0000","last_peered":"2024-09-10T23:25:22.181266+0000","last_clean":"2024-09-10T23:25:22.181266+0000","last_became_active":"2024-09-10T23:23:54.791853+0000","last_became_peered":"2024-09-10T23:23:54.791853+0000","last_unstale":"2024-09-10T23:25:22.181266+0000","last_undegraded":"2024-09-10T23:25:22.181266+0000","last_fullsized":"2024-09-10T23:25:22.181266+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:43.020267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147630+0000","last_change":"2024-09-10T23:24:05.886155+0000","last_active":"2024-09-10T23:25:22.147630+0000","last_peered":"2024-09-10T23:25:22.147630+0000","last_clean":"2024-09-10T23:25:22.147630+0000","last_became_active":"2024-09-10T23:24:05.885674+0000","last_became_peered":"2024-09-10T23:24:05.885674+0000","last_unstale":"2024-09-10T23:25:22.147630+0000","last_undegraded":"2024-09-10T23:25:22.147630+0000","last_fullsized":"2024-09-10T23:25:22.147630+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:46:00.891311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.170665+0000","last_change":"2024-09-10T23:23:57.830440+0000","last_active":"2024-09-10T23:26:21.170665+0000","last_peered":"2024-09-10T23:26:21.170665+0000","last_clean":"2024-09-10T23:26:21.170665+0000","last_became_active":"2024-09-10T23:23:57.829219+0000","last_became_peered":"2024-09-10T23:23:57.829219+0000","last_unstale":"2024-09-10T23:26:21.170665+0000","last_undegraded":"2024-09-10T23:26:21.170665+0000","last_fullsized":"2024-09-10T23:26:21.170665+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:28:15.696684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"90'2","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:07.582692+0000","last_change":"2024-09-10T23:23:54.796493+0000","last_active":"2024-09-10T23:26:07.582692+0000","last_peered":"2024-09-10T23:26:07.582692+0000","last_clean":"2024-09-10T23:26:07.582692+0000","last_became_active":"2024-09-10T23:23:54.796077+0000","last_became_peered":"2024-09-10T23:23:54.796077+0000","last_unstale":"2024-09-10T23:26:07.582692+0000","last_undegraded":"2024-09-10T23:26:07.582692+0000","last_fullsized":"2024-09-10T23:26:07.582692+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:13.054307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147718+0000","last_change":"2024-09-10T23:24:05.885557+0000","last_active":"2024-09-10T23:25:22.147718+0000","last_peered":"2024-09-10T23:25:22.147718+0000","last_clean":"2024-09-10T23:25:22.147718+0000","last_became_active":"2024-09-10T23:24:05.884773+0000","last_became_peered":"2024-09-10T23:24:05.884773+0000","last_unstale":"2024-09-10T23:25:22.147718+0000","last_undegraded":"2024-09-10T23:25:22.147718+0000","last_fullsized":"2024-09-10T23:25:22.147718+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:52.596822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.156861+0000","last_change":"2024-09-10T23:23:57.816395+0000","last_active":"2024-09-10T23:26:21.156861+0000","last_peered":"2024-09-10T23:26:21.156861+0000","last_clean":"2024-09-10T23:26:21.156861+0000","last_became_active":"2024-09-10T23:23:57.816047+0000","last_became_peered":"2024-09-10T23:23:57.816047+0000","last_unstale":"2024-09-10T23:26:21.156861+0000","last_undegraded":"2024-09-10T23:26:21.156861+0000","last_fullsized":"2024-09-10T23:26:21.156861+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:08:11.535738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480277+0000","last_change":"2024-09-10T23:23:54.795827+0000","last_active":"2024-09-10T23:25:22.480277+0000","last_peered":"2024-09-10T23:25:22.480277+0000","last_clean":"2024-09-10T23:25:22.480277+0000","last_became_active":"2024-09-10T23:23:54.794253+0000","last_became_peered":"2024-09-10T23:23:54.794253+0000","last_unstale":"2024-09-10T23:25:22.480277+0000","last_undegraded":"2024-09-10T23:25:22.480277+0000","last_fullsized":"2024-09-10T23:25:22.480277+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:27:27.988380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.145484+0000","last_change":"2024-09-10T23:24:05.889120+0000","last_active":"2024-09-10T23:25:22.145484+0000","last_peered":"2024-09-10T23:25:22.145484+0000","last_clean":"2024-09-10T23:25:22.145484+0000","last_became_active":"2024-09-10T23:24:05.888771+0000","last_became_peered":"2024-09-10T23:24:05.888771+0000","last_unstale":"2024-09-10T23:25:22.145484+0000","last_undegraded":"2024-09-10T23:25:22.145484+0000","last_fullsized":"2024-09-10T23:25:22.145484+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:55.414786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.122950+0000","last_change":"2024-09-10T23:23:57.814073+0000","last_active":"2024-09-10T23:26:21.122950+0000","last_peered":"2024-09-10T23:26:21.122950+0000","last_clean":"2024-09-10T23:26:21.122950+0000","last_became_active":"2024-09-10T23:23:57.813681+0000","last_became_peered":"2024-09-10T23:23:57.813681+0000","last_unstale":"2024-09-10T23:26:21.122950+0000","last_undegraded":"2024-09-10T23:26:21.122950+0000","last_fullsized":"2024-09-10T23:26:21.122950+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:44.129174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480412+0000","last_change":"2024-09-10T23:23:54.791119+0000","last_active":"2024-09-10T23:25:22.480412+0000","last_peered":"2024-09-10T23:25:22.480412+0000","last_clean":"2024-09-10T23:25:22.480412+0000","last_became_active":"2024-09-10T23:23:54.790770+0000","last_became_peered":"2024-09-10T23:23:54.790770+0000","last_unstale":"2024-09-10T23:25:22.480412+0000","last_undegraded":"2024-09-10T23:25:22.480412+0000","last_fullsized":"2024-09-10T23:25:22.480412+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:35.015104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.183894+0000","last_change":"2024-09-10T23:25:22.183216+0000","last_active":"2024-09-10T23:25:22.183894+0000","last_peered":"2024-09-10T23:25:22.183894+0000","last_clean":"2024-09-10T23:25:22.183894+0000","last_became_active":"2024-09-10T23:25:22.182735+0000","last_became_peered":"2024-09-10T23:25:22.182735+0000","last_unstale":"2024-09-10T23:25:22.183894+0000","last_undegraded":"2024-09-10T23:25:22.183894+0000","last_fullsized":"2024-09-10T23:25:22.183894+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:39:53.143633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.161571+0000","last_change":"2024-09-10T23:24:21.976169+0000","last_active":"2024-09-10T23:26:21.161571+0000","last_peered":"2024-09-10T23:26:21.161571+0000","last_clean":"2024-09-10T23:26:21.161571+0000","last_became_active":"2024-09-10T23:24:21.975330+0000","last_became_peered":"2024-09-10T23:24:21.975330+0000","last_unstale":"2024-09-10T23:26:21.161571+0000","last_undegraded":"2024-09-10T23:26:21.161571+0000","last_fullsized":"2024-09-10T23:26:21.161571+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:54:59.422630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.148043+0000","last_change":"2024-09-10T23:23:55.082093+0000","last_active":"2024-09-10T23:25:22.148043+0000","last_peered":"2024-09-10T23:25:22.148043+0000","last_clean":"2024-09-10T23:25:22.148043+0000","last_became_active":"2024-09-10T23:23:55.081705+0000","last_became_peered":"2024-09-10T23:23:55.081705+0000","last_unstale":"2024-09-10T23:25:22.148043+0000","last_undegraded":"2024-09-10T23:25:22.148043+0000","last_fullsized":"2024-09-10T23:25:22.148043+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:01:04.150153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.140670+0000","last_change":"2024-09-10T23:24:05.880084+0000","last_active":"2024-09-10T23:25:22.140670+0000","last_peered":"2024-09-10T23:25:22.140670+0000","last_clean":"2024-09-10T23:25:22.140670+0000","last_became_active":"2024-09-10T23:24:05.879655+0000","last_became_peered":"2024-09-10T23:24:05.879655+0000","last_unstale":"2024-09-10T23:25:22.140670+0000","last_undegraded":"2024-09-10T23:25:22.140670+0000","last_fullsized":"2024-09-10T23:25:22.140670+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:01.473494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.174054+0000","last_change":"2024-09-10T23:23:57.836207+0000","last_active":"2024-09-10T23:26:21.174054+0000","last_peered":"2024-09-10T23:26:21.174054+0000","last_clean":"2024-09-10T23:26:21.174054+0000","last_became_active":"2024-09-10T23:23:57.835801+0000","last_became_peered":"2024-09-10T23:23:57.835801+0000","last_unstale":"2024-09-10T23:26:21.174054+0000","last_undegraded":"2024-09-10T23:26:21.174054+0000","last_fullsized":"2024-09-10T23:26:21.174054+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:48:18.246508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'12","reported_seq":58,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.865818+0000","last_change":"2024-09-10T23:23:54.798126+0000","last_active":"2024-09-10T23:26:21.865818+0000","last_peered":"2024-09-10T23:26:21.865818+0000","last_clean":"2024-09-10T23:26:21.865818+0000","last_became_active":"2024-09-10T23:23:54.797755+0000","last_became_peered":"2024-09-10T23:23:54.797755+0000","last_unstale":"2024-09-10T23:26:21.865818+0000","last_undegraded":"2024-09-10T23:26:21.865818+0000","last_fullsized":"2024-09-10T23:26:21.865818+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:54.474382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.479753+0000","last_change":"2024-09-10T23:24:05.886431+0000","last_active":"2024-09-10T23:25:22.479753+0000","last_peered":"2024-09-10T23:25:22.479753+0000","last_clean":"2024-09-10T23:25:22.479753+0000","last_became_active":"2024-09-10T23:24:05.885962+0000","last_became_peered":"2024-09-10T23:24:05.885962+0000","last_unstale":"2024-09-10T23:25:22.479753+0000","last_undegraded":"2024-09-10T23:25:22.479753+0000","last_fullsized":"2024-09-10T23:25:22.479753+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:32.568553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.172961+0000","last_change":"2024-09-10T23:23:57.825790+0000","last_active":"2024-09-10T23:26:21.172961+0000","last_peered":"2024-09-10T23:26:21.172961+0000","last_clean":"2024-09-10T23:26:21.172961+0000","last_became_active":"2024-09-10T23:23:57.825510+0000","last_became_peered":"2024-09-10T23:23:57.825510+0000","last_unstale":"2024-09-10T23:26:21.172961+0000","last_undegraded":"2024-09-10T23:26:21.172961+0000","last_fullsized":"2024-09-10T23:26:21.172961+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:43.816144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.181663+0000","last_change":"2024-09-10T23:23:54.791957+0000","last_active":"2024-09-10T23:25:22.181663+0000","last_peered":"2024-09-10T23:25:22.181663+0000","last_clean":"2024-09-10T23:25:22.181663+0000","last_became_active":"2024-09-10T23:23:54.791607+0000","last_became_peered":"2024-09-10T23:23:54.791607+0000","last_unstale":"2024-09-10T23:25:22.181663+0000","last_undegraded":"2024-09-10T23:25:22.181663+0000","last_fullsized":"2024-09-10T23:25:22.181663+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:00:47.600299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.142066+0000","last_change":"2024-09-10T23:24:05.884275+0000","last_active":"2024-09-10T23:25:22.142066+0000","last_peered":"2024-09-10T23:25:22.142066+0000","last_clean":"2024-09-10T23:25:22.142066+0000","last_became_active":"2024-09-10T23:24:05.882340+0000","last_became_peered":"2024-09-10T23:24:05.882340+0000","last_unstale":"2024-09-10T23:25:22.142066+0000","last_undegraded":"2024-09-10T23:25:22.142066+0000","last_fullsized":"2024-09-10T23:25:22.142066+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:15.243993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"90'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.172476+0000","last_change":"2024-09-10T23:23:57.828322+0000","last_active":"2024-09-10T23:26:21.172476+0000","last_peered":"2024-09-10T23:26:21.172476+0000","last_clean":"2024-09-10T23:26:21.172476+0000","last_became_active":"2024-09-10T23:23:57.827925+0000","last_became_peered":"2024-09-10T23:23:57.827925+0000","last_unstale":"2024-09-10T23:26:21.172476+0000","last_undegraded":"2024-09-10T23:26:21.172476+0000","last_fullsized":"2024-09-10T23:26:21.172476+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:55.214207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144992+0000","last_change":"2024-09-10T23:23:54.789507+0000","last_active":"2024-09-10T23:25:22.144992+0000","last_peered":"2024-09-10T23:25:22.144992+0000","last_clean":"2024-09-10T23:25:22.144992+0000","last_became_active":"2024-09-10T23:23:54.789120+0000","last_became_peered":"2024-09-10T23:23:54.789120+0000","last_unstale":"2024-09-10T23:25:22.144992+0000","last_undegraded":"2024-09-10T23:25:22.144992+0000","last_fullsized":"2024-09-10T23:25:22.144992+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:58.033953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.181120+0000","last_change":"2024-09-10T23:24:05.881015+0000","last_active":"2024-09-10T23:25:22.181120+0000","last_peered":"2024-09-10T23:25:22.181120+0000","last_clean":"2024-09-10T23:25:22.181120+0000","last_became_active":"2024-09-10T23:24:05.880261+0000","last_became_peered":"2024-09-10T23:24:05.880261+0000","last_unstale":"2024-09-10T23:25:22.181120+0000","last_undegraded":"2024-09-10T23:25:22.181120+0000","last_fullsized":"2024-09-10T23:25:22.181120+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:13:36.937503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.167570+0000","last_change":"2024-09-10T23:23:57.842018+0000","last_active":"2024-09-10T23:26:21.167570+0000","last_peered":"2024-09-10T23:26:21.167570+0000","last_clean":"2024-09-10T23:26:21.167570+0000","last_became_active":"2024-09-10T23:23:57.841669+0000","last_became_peered":"2024-09-10T23:23:57.841669+0000","last_unstale":"2024-09-10T23:26:21.167570+0000","last_undegraded":"2024-09-10T23:26:21.167570+0000","last_fullsized":"2024-09-10T23:26:21.167570+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:11.619741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481110+0000","last_change":"2024-09-10T23:23:54.794565+0000","last_active":"2024-09-10T23:25:22.481110+0000","last_peered":"2024-09-10T23:25:22.481110+0000","last_clean":"2024-09-10T23:25:22.481110+0000","last_became_active":"2024-09-10T23:23:54.793794+0000","last_became_peered":"2024-09-10T23:23:54.793794+0000","last_unstale":"2024-09-10T23:25:22.481110+0000","last_undegraded":"2024-09-10T23:25:22.481110+0000","last_fullsized":"2024-09-10T23:25:22.481110+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:42.665924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.139490+0000","last_change":"2024-09-10T23:24:05.883706+0000","last_active":"2024-09-10T23:25:22.139490+0000","last_peered":"2024-09-10T23:25:22.139490+0000","last_clean":"2024-09-10T23:25:22.139490+0000","last_became_active":"2024-09-10T23:24:05.881621+0000","last_became_peered":"2024-09-10T23:24:05.881621+0000","last_unstale":"2024-09-10T23:25:22.139490+0000","last_undegraded":"2024-09-10T23:25:22.139490+0000","last_fullsized":"2024-09-10T23:25:22.139490+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:23.468331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.165929+0000","last_change":"2024-09-10T23:23:57.834504+0000","last_active":"2024-09-10T23:26:21.165929+0000","last_peered":"2024-09-10T23:26:21.165929+0000","last_clean":"2024-09-10T23:26:21.165929+0000","last_became_active":"2024-09-10T23:23:57.834105+0000","last_became_peered":"2024-09-10T23:23:57.834105+0000","last_unstale":"2024-09-10T23:26:21.165929+0000","last_undegraded":"2024-09-10T23:26:21.165929+0000","last_fullsized":"2024-09-10T23:26:21.165929+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:03.539763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'6","reported_seq":166,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:41.462757+0000","last_change":"2024-09-10T23:23:54.796519+0000","last_active":"2024-09-10T23:26:41.462757+0000","last_peered":"2024-09-10T23:26:41.462757+0000","last_clean":"2024-09-10T23:26:41.462757+0000","last_became_active":"2024-09-10T23:23:54.795174+0000","last_became_peered":"2024-09-10T23:23:54.795174+0000","last_unstale":"2024-09-10T23:26:41.462757+0000","last_undegraded":"2024-09-10T23:26:41.462757+0000","last_fullsized":"2024-09-10T23:26:41.462757+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:53.622935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.140542+0000","last_change":"2024-09-10T23:24:05.884496+0000","last_active":"2024-09-10T23:25:22.140542+0000","last_peered":"2024-09-10T23:25:22.140542+0000","last_clean":"2024-09-10T23:25:22.140542+0000","last_became_active":"2024-09-10T23:24:05.883659+0000","last_became_peered":"2024-09-10T23:24:05.883659+0000","last_unstale":"2024-09-10T23:25:22.140542+0000","last_undegraded":"2024-09-10T23:25:22.140542+0000","last_fullsized":"2024-09-10T23:25:22.140542+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:23.449830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.172326+0000","last_change":"2024-09-10T23:23:57.842436+0000","last_active":"2024-09-10T23:26:21.172326+0000","last_peered":"2024-09-10T23:26:21.172326+0000","last_clean":"2024-09-10T23:26:21.172326+0000","last_became_active":"2024-09-10T23:23:57.842054+0000","last_became_peered":"2024-09-10T23:23:57.842054+0000","last_unstale":"2024-09-10T23:26:21.172326+0000","last_undegraded":"2024-09-10T23:26:21.172326+0000","last_fullsized":"2024-09-10T23:26:21.172326+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:07.234201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481636+0000","last_change":"2024-09-10T23:24:21.974615+0000","last_active":"2024-09-10T23:25:22.481636+0000","last_peered":"2024-09-10T23:25:22.481636+0000","last_clean":"2024-09-10T23:25:22.481636+0000","last_became_active":"2024-09-10T23:24:21.974129+0000","last_became_peered":"2024-09-10T23:24:21.974129+0000","last_unstale":"2024-09-10T23:25:22.481636+0000","last_undegraded":"2024-09-10T23:25:22.481636+0000","last_fullsized":"2024-09-10T23:25:22.481636+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:11.510005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.151991+0000","last_change":"2024-09-10T23:25:22.151288+0000","last_active":"2024-09-10T23:25:22.151991+0000","last_peered":"2024-09-10T23:25:22.151991+0000","last_clean":"2024-09-10T23:25:22.151991+0000","last_became_active":"2024-09-10T23:25:22.150800+0000","last_became_peered":"2024-09-10T23:25:22.150800+0000","last_unstale":"2024-09-10T23:25:22.151991+0000","last_undegraded":"2024-09-10T23:25:22.151991+0000","last_fullsized":"2024-09-10T23:25:22.151991+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:56.974242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.183481+0000","last_change":"2024-09-10T23:23:57.828722+0000","last_active":"2024-09-10T23:26:21.183481+0000","last_peered":"2024-09-10T23:26:21.183481+0000","last_clean":"2024-09-10T23:26:21.183481+0000","last_became_active":"2024-09-10T23:23:57.828373+0000","last_became_peered":"2024-09-10T23:23:57.828373+0000","last_unstale":"2024-09-10T23:26:21.183481+0000","last_undegraded":"2024-09-10T23:26:21.183481+0000","last_fullsized":"2024-09-10T23:26:21.183481+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:19.891684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147902+0000","last_change":"2024-09-10T23:23:54.789584+0000","last_active":"2024-09-10T23:25:22.147902+0000","last_peered":"2024-09-10T23:25:22.147902+0000","last_clean":"2024-09-10T23:25:22.147902+0000","last_became_active":"2024-09-10T23:23:54.789166+0000","last_became_peered":"2024-09-10T23:23:54.789166+0000","last_unstale":"2024-09-10T23:25:22.147902+0000","last_undegraded":"2024-09-10T23:25:22.147902+0000","last_fullsized":"2024-09-10T23:25:22.147902+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:02.292384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":121,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481682+0000","last_change":"2024-09-10T23:22:28.076475+0000","last_active":"2024-09-10T23:25:22.481682+0000","last_peered":"2024-09-10T23:25:22.481682+0000","last_clean":"2024-09-10T23:25:22.481682+0000","last_became_active":"2024-09-10T23:22:28.070622+0000","last_became_peered":"2024-09-10T23:22:28.070622+0000","last_unstale":"2024-09-10T23:25:22.481682+0000","last_undegraded":"2024-09-10T23:25:22.481682+0000","last_fullsized":"2024-09-10T23:25:22.481682+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:28.022462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:28.022462+0000","last_clean_scrub_stamp":"2024-09-10T23:18:28.022462+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:46:16.329399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481433+0000","last_change":"2024-09-10T23:24:05.884647+0000","last_active":"2024-09-10T23:25:22.481433+0000","last_peered":"2024-09-10T23:25:22.481433+0000","last_clean":"2024-09-10T23:25:22.481433+0000","last_became_active":"2024-09-10T23:24:05.883476+0000","last_became_peered":"2024-09-10T23:24:05.883476+0000","last_unstale":"2024-09-10T23:25:22.481433+0000","last_undegraded":"2024-09-10T23:25:22.481433+0000","last_fullsized":"2024-09-10T23:25:22.481433+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:02.524767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.185970+0000","last_change":"2024-09-10T23:23:57.840835+0000","last_active":"2024-09-10T23:26:21.185970+0000","last_peered":"2024-09-10T23:26:21.185970+0000","last_clean":"2024-09-10T23:26:21.185970+0000","last_became_active":"2024-09-10T23:23:57.840472+0000","last_became_peered":"2024-09-10T23:23:57.840472+0000","last_unstale":"2024-09-10T23:26:21.185970+0000","last_undegraded":"2024-09-10T23:26:21.185970+0000","last_fullsized":"2024-09-10T23:26:21.185970+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:18.050686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.141282+0000","last_change":"2024-09-10T23:23:55.081669+0000","last_active":"2024-09-10T23:25:22.141282+0000","last_peered":"2024-09-10T23:25:22.141282+0000","last_clean":"2024-09-10T23:25:22.141282+0000","last_became_active":"2024-09-10T23:23:55.081306+0000","last_became_peered":"2024-09-10T23:23:55.081306+0000","last_unstale":"2024-09-10T23:25:22.141282+0000","last_undegraded":"2024-09-10T23:25:22.141282+0000","last_fullsized":"2024-09-10T23:25:22.141282+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:54.968431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480541+0000","last_change":"2024-09-10T23:24:05.880876+0000","last_active":"2024-09-10T23:25:22.480541+0000","last_peered":"2024-09-10T23:25:22.480541+0000","last_clean":"2024-09-10T23:25:22.480541+0000","last_became_active":"2024-09-10T23:24:05.880504+0000","last_became_peered":"2024-09-10T23:24:05.880504+0000","last_unstale":"2024-09-10T23:25:22.480541+0000","last_undegraded":"2024-09-10T23:25:22.480541+0000","last_fullsized":"2024-09-10T23:25:22.480541+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:17:55.689134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.176096+0000","last_change":"2024-09-10T23:23:57.826637+0000","last_active":"2024-09-10T23:26:21.176096+0000","last_peered":"2024-09-10T23:26:21.176096+0000","last_clean":"2024-09-10T23:26:21.176096+0000","last_became_active":"2024-09-10T23:23:57.825915+0000","last_became_peered":"2024-09-10T23:23:57.825915+0000","last_unstale":"2024-09-10T23:26:21.176096+0000","last_undegraded":"2024-09-10T23:26:21.176096+0000","last_fullsized":"2024-09-10T23:26:21.176096+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:55.281687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.145150+0000","last_change":"2024-09-10T23:23:54.789847+0000","last_active":"2024-09-10T23:25:22.145150+0000","last_peered":"2024-09-10T23:25:22.145150+0000","last_clean":"2024-09-10T23:25:22.145150+0000","last_became_active":"2024-09-10T23:23:54.789082+0000","last_became_peered":"2024-09-10T23:23:54.789082+0000","last_unstale":"2024-09-10T23:25:22.145150+0000","last_undegraded":"2024-09-10T23:25:22.145150+0000","last_fullsized":"2024-09-10T23:25:22.145150+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:39:16.162317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.479783+0000","last_change":"2024-09-10T23:24:05.895799+0000","last_active":"2024-09-10T23:25:22.479783+0000","last_peered":"2024-09-10T23:25:22.479783+0000","last_clean":"2024-09-10T23:25:22.479783+0000","last_became_active":"2024-09-10T23:24:05.895361+0000","last_became_peered":"2024-09-10T23:24:05.895361+0000","last_unstale":"2024-09-10T23:25:22.479783+0000","last_undegraded":"2024-09-10T23:25:22.479783+0000","last_fullsized":"2024-09-10T23:25:22.479783+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:10.893000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.175415+0000","last_change":"2024-09-10T23:23:57.834954+0000","last_active":"2024-09-10T23:26:21.175415+0000","last_peered":"2024-09-10T23:26:21.175415+0000","last_clean":"2024-09-10T23:26:21.175415+0000","last_became_active":"2024-09-10T23:23:57.834215+0000","last_became_peered":"2024-09-10T23:23:57.834215+0000","last_unstale":"2024-09-10T23:26:21.175415+0000","last_undegraded":"2024-09-10T23:26:21.175415+0000","last_fullsized":"2024-09-10T23:26:21.175415+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:19:42.051352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.140302+0000","last_change":"2024-09-10T23:24:22.301029+0000","last_active":"2024-09-10T23:25:22.140302+0000","last_peered":"2024-09-10T23:25:22.140302+0000","last_clean":"2024-09-10T23:25:22.140302+0000","last_became_active":"2024-09-10T23:24:22.297759+0000","last_became_peered":"2024-09-10T23:24:22.297759+0000","last_unstale":"2024-09-10T23:25:22.140302+0000","last_undegraded":"2024-09-10T23:25:22.140302+0000","last_fullsized":"2024-09-10T23:25:22.140302+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:05.364737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.143459+0000","last_change":"2024-09-10T23:24:05.884172+0000","last_active":"2024-09-10T23:25:22.143459+0000","last_peered":"2024-09-10T23:25:22.143459+0000","last_clean":"2024-09-10T23:25:22.143459+0000","last_became_active":"2024-09-10T23:24:05.881918+0000","last_became_peered":"2024-09-10T23:24:05.881918+0000","last_unstale":"2024-09-10T23:25:22.143459+0000","last_undegraded":"2024-09-10T23:25:22.143459+0000","last_fullsized":"2024-09-10T23:25:22.143459+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:19:15.250926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.166507+0000","last_change":"2024-09-10T23:24:22.297163+0000","last_active":"2024-09-10T23:26:21.166507+0000","last_peered":"2024-09-10T23:26:21.166507+0000","last_clean":"2024-09-10T23:26:21.166507+0000","last_became_active":"2024-09-10T23:24:22.296751+0000","last_became_peered":"2024-09-10T23:24:22.296751+0000","last_unstale":"2024-09-10T23:26:21.166507+0000","last_undegraded":"2024-09-10T23:26:21.166507+0000","last_fullsized":"2024-09-10T23:26:21.166507+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:37:50.379101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.181518+0000","last_change":"2024-09-10T23:23:54.788008+0000","last_active":"2024-09-10T23:25:22.181518+0000","last_peered":"2024-09-10T23:25:22.181518+0000","last_clean":"2024-09-10T23:25:22.181518+0000","last_became_active":"2024-09-10T23:23:54.787702+0000","last_became_peered":"2024-09-10T23:23:54.787702+0000","last_unstale":"2024-09-10T23:25:22.181518+0000","last_undegraded":"2024-09-10T23:25:22.181518+0000","last_fullsized":"2024-09-10T23:25:22.181518+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:45.997467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144487+0000","last_change":"2024-09-10T23:24:05.887208+0000","last_active":"2024-09-10T23:25:22.144487+0000","last_peered":"2024-09-10T23:25:22.144487+0000","last_clean":"2024-09-10T23:25:22.144487+0000","last_became_active":"2024-09-10T23:24:05.885556+0000","last_became_peered":"2024-09-10T23:24:05.885556+0000","last_unstale":"2024-09-10T23:25:22.144487+0000","last_undegraded":"2024-09-10T23:25:22.144487+0000","last_fullsized":"2024-09-10T23:25:22.144487+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:21.843558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.171810+0000","last_change":"2024-09-10T23:23:57.842937+0000","last_active":"2024-09-10T23:26:21.171810+0000","last_peered":"2024-09-10T23:26:21.171810+0000","last_clean":"2024-09-10T23:26:21.171810+0000","last_became_active":"2024-09-10T23:23:57.842158+0000","last_became_peered":"2024-09-10T23:23:57.842158+0000","last_unstale":"2024-09-10T23:26:21.171810+0000","last_undegraded":"2024-09-10T23:26:21.171810+0000","last_fullsized":"2024-09-10T23:26:21.171810+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:49:58.716816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":62,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.181080+0000","last_change":"2024-09-10T23:23:54.787515+0000","last_active":"2024-09-10T23:25:22.181080+0000","last_peered":"2024-09-10T23:25:22.181080+0000","last_clean":"2024-09-10T23:25:22.181080+0000","last_became_active":"2024-09-10T23:23:54.786950+0000","last_became_peered":"2024-09-10T23:23:54.786950+0000","last_unstale":"2024-09-10T23:25:22.181080+0000","last_undegraded":"2024-09-10T23:25:22.181080+0000","last_fullsized":"2024-09-10T23:25:22.181080+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:12.546459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.140106+0000","last_change":"2024-09-10T23:24:05.882784+0000","last_active":"2024-09-10T23:25:22.140106+0000","last_peered":"2024-09-10T23:25:22.140106+0000","last_clean":"2024-09-10T23:25:22.140106+0000","last_became_active":"2024-09-10T23:24:05.882331+0000","last_became_peered":"2024-09-10T23:24:05.882331+0000","last_unstale":"2024-09-10T23:25:22.140106+0000","last_undegraded":"2024-09-10T23:25:22.140106+0000","last_fullsized":"2024-09-10T23:25:22.140106+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:51:42.519144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.164114+0000","last_change":"2024-09-10T23:23:57.827896+0000","last_active":"2024-09-10T23:26:21.164114+0000","last_peered":"2024-09-10T23:26:21.164114+0000","last_clean":"2024-09-10T23:26:21.164114+0000","last_became_active":"2024-09-10T23:23:57.827572+0000","last_became_peered":"2024-09-10T23:23:57.827572+0000","last_unstale":"2024-09-10T23:26:21.164114+0000","last_undegraded":"2024-09-10T23:26:21.164114+0000","last_fullsized":"2024-09-10T23:26:21.164114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:11.126594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'7","reported_seq":172,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:42.465987+0000","last_change":"2024-09-10T23:23:54.795582+0000","last_active":"2024-09-10T23:26:42.465987+0000","last_peered":"2024-09-10T23:26:42.465987+0000","last_clean":"2024-09-10T23:26:42.465987+0000","last_became_active":"2024-09-10T23:23:54.795225+0000","last_became_peered":"2024-09-10T23:23:54.795225+0000","last_unstale":"2024-09-10T23:26:42.465987+0000","last_undegraded":"2024-09-10T23:26:42.465987+0000","last_fullsized":"2024-09-10T23:26:42.465987+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:11.827090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2004,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":6,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.483416+0000","last_change":"2024-09-10T23:25:22.483250+0000","last_active":"2024-09-10T23:25:22.483416+0000","last_peered":"2024-09-10T23:25:22.483416+0000","last_clean":"2024-09-10T23:25:22.483416+0000","last_became_active":"2024-09-10T23:25:22.482721+0000","last_became_peered":"2024-09-10T23:25:22.482721+0000","last_unstale":"2024-09-10T23:25:22.483416+0000","last_undegraded":"2024-09-10T23:25:22.483416+0000","last_fullsized":"2024-09-10T23:25:22.483416+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:41:31.732139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,7,0,3],"acting":[10,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.183006+0000","last_change":"2024-09-10T23:23:57.843899+0000","last_active":"2024-09-10T23:26:21.183006+0000","last_peered":"2024-09-10T23:26:21.183006+0000","last_clean":"2024-09-10T23:26:21.183006+0000","last_became_active":"2024-09-10T23:23:57.843590+0000","last_became_peered":"2024-09-10T23:23:57.843590+0000","last_unstale":"2024-09-10T23:26:21.183006+0000","last_undegraded":"2024-09-10T23:26:21.183006+0000","last_fullsized":"2024-09-10T23:26:21.183006+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:32:17.919904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144414+0000","last_change":"2024-09-10T23:23:54.795091+0000","last_active":"2024-09-10T23:25:22.144414+0000","last_peered":"2024-09-10T23:25:22.144414+0000","last_clean":"2024-09-10T23:25:22.144414+0000","last_became_active":"2024-09-10T23:23:54.794726+0000","last_became_peered":"2024-09-10T23:23:54.794726+0000","last_unstale":"2024-09-10T23:25:22.144414+0000","last_undegraded":"2024-09-10T23:25:22.144414+0000","last_fullsized":"2024-09-10T23:25:22.144414+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:56:20.322532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.483962+0000","last_change":"2024-09-10T23:25:22.483252+0000","last_active":"2024-09-10T23:25:22.483962+0000","last_peered":"2024-09-10T23:25:22.483962+0000","last_clean":"2024-09-10T23:25:22.483962+0000","last_became_active":"2024-09-10T23:25:22.482719+0000","last_became_peered":"2024-09-10T23:25:22.482719+0000","last_unstale":"2024-09-10T23:25:22.483962+0000","last_undegraded":"2024-09-10T23:25:22.483962+0000","last_fullsized":"2024-09-10T23:25:22.483962+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:36.281256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.166862+0000","last_change":"2024-09-10T23:23:57.823729+0000","last_active":"2024-09-10T23:26:21.166862+0000","last_peered":"2024-09-10T23:26:21.166862+0000","last_clean":"2024-09-10T23:26:21.166862+0000","last_became_active":"2024-09-10T23:23:57.822797+0000","last_became_peered":"2024-09-10T23:23:57.822797+0000","last_unstale":"2024-09-10T23:26:21.166862+0000","last_undegraded":"2024-09-10T23:26:21.166862+0000","last_fullsized":"2024-09-10T23:26:21.166862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:09.646543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.141877+0000","last_change":"2024-09-10T23:24:21.985389+0000","last_active":"2024-09-10T23:25:22.141877+0000","last_peered":"2024-09-10T23:25:22.141877+0000","last_clean":"2024-09-10T23:25:22.141877+0000","last_became_active":"2024-09-10T23:24:21.976084+0000","last_became_peered":"2024-09-10T23:24:21.976084+0000","last_unstale":"2024-09-10T23:25:22.141877+0000","last_undegraded":"2024-09-10T23:25:22.141877+0000","last_fullsized":"2024-09-10T23:25:22.141877+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:33.284211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144976+0000","last_change":"2024-09-10T23:24:05.890656+0000","last_active":"2024-09-10T23:25:22.144976+0000","last_peered":"2024-09-10T23:25:22.144976+0000","last_clean":"2024-09-10T23:25:22.144976+0000","last_became_active":"2024-09-10T23:24:05.889827+0000","last_became_peered":"2024-09-10T23:24:05.889827+0000","last_unstale":"2024-09-10T23:25:22.144976+0000","last_undegraded":"2024-09-10T23:25:22.144976+0000","last_fullsized":"2024-09-10T23:25:22.144976+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:15.301567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.170882+0000","last_change":"2024-09-10T23:23:57.827348+0000","last_active":"2024-09-10T23:26:21.170882+0000","last_peered":"2024-09-10T23:26:21.170882+0000","last_clean":"2024-09-10T23:26:21.170882+0000","last_became_active":"2024-09-10T23:23:57.826670+0000","last_became_peered":"2024-09-10T23:23:57.826670+0000","last_unstale":"2024-09-10T23:26:21.170882+0000","last_undegraded":"2024-09-10T23:26:21.170882+0000","last_fullsized":"2024-09-10T23:26:21.170882+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:19.268930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'36","reported_seq":317,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:41.444928+0000","last_change":"2024-09-10T23:23:54.789603+0000","last_active":"2024-09-10T23:26:41.444928+0000","last_peered":"2024-09-10T23:26:41.444928+0000","last_clean":"2024-09-10T23:26:41.444928+0000","last_became_active":"2024-09-10T23:23:54.789136+0000","last_became_peered":"2024-09-10T23:23:54.789136+0000","last_unstale":"2024-09-10T23:26:41.444928+0000","last_undegraded":"2024-09-10T23:26:41.444928+0000","last_fullsized":"2024-09-10T23:26:41.444928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:47.648232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62261,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":235,"num_read_kb":178,"num_write":37,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144524+0000","last_change":"2024-09-10T23:24:05.883758+0000","last_active":"2024-09-10T23:25:22.144524+0000","last_peered":"2024-09-10T23:25:22.144524+0000","last_clean":"2024-09-10T23:25:22.144524+0000","last_became_active":"2024-09-10T23:24:05.883401+0000","last_became_peered":"2024-09-10T23:24:05.883401+0000","last_unstale":"2024-09-10T23:25:22.144524+0000","last_undegraded":"2024-09-10T23:25:22.144524+0000","last_fullsized":"2024-09-10T23:25:22.144524+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:52.862088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.189152+0000","last_change":"2024-09-10T23:23:57.846524+0000","last_active":"2024-09-10T23:26:21.189152+0000","last_peered":"2024-09-10T23:26:21.189152+0000","last_clean":"2024-09-10T23:26:21.189152+0000","last_became_active":"2024-09-10T23:23:57.846036+0000","last_became_peered":"2024-09-10T23:23:57.846036+0000","last_unstale":"2024-09-10T23:26:21.189152+0000","last_undegraded":"2024-09-10T23:26:21.189152+0000","last_fullsized":"2024-09-10T23:26:21.189152+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:13.866827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.145163+0000","last_change":"2024-09-10T23:23:54.789925+0000","last_active":"2024-09-10T23:25:22.145163+0000","last_peered":"2024-09-10T23:25:22.145163+0000","last_clean":"2024-09-10T23:25:22.145163+0000","last_became_active":"2024-09-10T23:23:54.789600+0000","last_became_peered":"2024-09-10T23:23:54.789600+0000","last_unstale":"2024-09-10T23:25:22.145163+0000","last_undegraded":"2024-09-10T23:25:22.145163+0000","last_fullsized":"2024-09-10T23:25:22.145163+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:54.937422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147724+0000","last_change":"2024-09-10T23:24:05.882530+0000","last_active":"2024-09-10T23:25:22.147724+0000","last_peered":"2024-09-10T23:25:22.147724+0000","last_clean":"2024-09-10T23:25:22.147724+0000","last_became_active":"2024-09-10T23:24:05.881092+0000","last_became_peered":"2024-09-10T23:24:05.881092+0000","last_unstale":"2024-09-10T23:25:22.147724+0000","last_undegraded":"2024-09-10T23:25:22.147724+0000","last_fullsized":"2024-09-10T23:25:22.147724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:54.954300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.168450+0000","last_change":"2024-09-10T23:23:57.837341+0000","last_active":"2024-09-10T23:26:21.168450+0000","last_peered":"2024-09-10T23:26:21.168450+0000","last_clean":"2024-09-10T23:26:21.168450+0000","last_became_active":"2024-09-10T23:23:57.837024+0000","last_became_peered":"2024-09-10T23:23:57.837024+0000","last_unstale":"2024-09-10T23:26:21.168450+0000","last_undegraded":"2024-09-10T23:26:21.168450+0000","last_fullsized":"2024-09-10T23:26:21.168450+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:22:48.241471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481409+0000","last_change":"2024-09-10T23:23:54.792028+0000","last_active":"2024-09-10T23:25:22.481409+0000","last_peered":"2024-09-10T23:25:22.481409+0000","last_clean":"2024-09-10T23:25:22.481409+0000","last_became_active":"2024-09-10T23:23:54.791589+0000","last_became_peered":"2024-09-10T23:23:54.791589+0000","last_unstale":"2024-09-10T23:25:22.481409+0000","last_undegraded":"2024-09-10T23:25:22.481409+0000","last_fullsized":"2024-09-10T23:25:22.481409+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:48.589441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144216+0000","last_change":"2024-09-10T23:24:05.888627+0000","last_active":"2024-09-10T23:25:22.144216+0000","last_peered":"2024-09-10T23:25:22.144216+0000","last_clean":"2024-09-10T23:25:22.144216+0000","last_became_active":"2024-09-10T23:24:05.887925+0000","last_became_peered":"2024-09-10T23:24:05.887925+0000","last_unstale":"2024-09-10T23:25:22.144216+0000","last_undegraded":"2024-09-10T23:25:22.144216+0000","last_fullsized":"2024-09-10T23:25:22.144216+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:15.956333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.188813+0000","last_change":"2024-09-10T23:23:57.833009+0000","last_active":"2024-09-10T23:26:21.188813+0000","last_peered":"2024-09-10T23:26:21.188813+0000","last_clean":"2024-09-10T23:26:21.188813+0000","last_became_active":"2024-09-10T23:23:57.830782+0000","last_became_peered":"2024-09-10T23:23:57.830782+0000","last_unstale":"2024-09-10T23:26:21.188813+0000","last_undegraded":"2024-09-10T23:26:21.188813+0000","last_fullsized":"2024-09-10T23:26:21.188813+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:42.520461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"90'4","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:40.749038+0000","last_change":"2024-09-10T23:23:54.789322+0000","last_active":"2024-09-10T23:26:40.749038+0000","last_peered":"2024-09-10T23:26:40.749038+0000","last_clean":"2024-09-10T23:26:40.749038+0000","last_became_active":"2024-09-10T23:23:54.788879+0000","last_became_peered":"2024-09-10T23:23:54.788879+0000","last_unstale":"2024-09-10T23:26:40.749038+0000","last_undegraded":"2024-09-10T23:26:40.749038+0000","last_fullsized":"2024-09-10T23:26:40.749038+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:37.276413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":113,"num_read_kb":113,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480177+0000","last_change":"2024-09-10T23:24:05.886626+0000","last_active":"2024-09-10T23:25:22.480177+0000","last_peered":"2024-09-10T23:25:22.480177+0000","last_clean":"2024-09-10T23:25:22.480177+0000","last_became_active":"2024-09-10T23:24:05.886076+0000","last_became_peered":"2024-09-10T23:24:05.886076+0000","last_unstale":"2024-09-10T23:25:22.480177+0000","last_undegraded":"2024-09-10T23:25:22.480177+0000","last_fullsized":"2024-09-10T23:25:22.480177+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:44.987664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480182+0000","last_change":"2024-09-10T23:24:05.891242+0000","last_active":"2024-09-10T23:25:22.480182+0000","last_peered":"2024-09-10T23:25:22.480182+0000","last_clean":"2024-09-10T23:25:22.480182+0000","last_became_active":"2024-09-10T23:24:05.889513+0000","last_became_peered":"2024-09-10T23:24:05.889513+0000","last_unstale":"2024-09-10T23:25:22.480182+0000","last_undegraded":"2024-09-10T23:25:22.480182+0000","last_fullsized":"2024-09-10T23:25:22.480182+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:07.774304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.176320+0000","last_change":"2024-09-10T23:23:57.831698+0000","last_active":"2024-09-10T23:26:21.176320+0000","last_peered":"2024-09-10T23:26:21.176320+0000","last_clean":"2024-09-10T23:26:21.176320+0000","last_became_active":"2024-09-10T23:23:57.829348+0000","last_became_peered":"2024-09-10T23:23:57.829348+0000","last_unstale":"2024-09-10T23:26:21.176320+0000","last_undegraded":"2024-09-10T23:26:21.176320+0000","last_fullsized":"2024-09-10T23:26:21.176320+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:09.636786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.143717+0000","last_change":"2024-09-10T23:23:54.795380+0000","last_active":"2024-09-10T23:25:22.143717+0000","last_peered":"2024-09-10T23:25:22.143717+0000","last_clean":"2024-09-10T23:25:22.143717+0000","last_became_active":"2024-09-10T23:23:54.794465+0000","last_became_peered":"2024-09-10T23:23:54.794465+0000","last_unstale":"2024-09-10T23:25:22.143717+0000","last_undegraded":"2024-09-10T23:25:22.143717+0000","last_fullsized":"2024-09-10T23:25:22.143717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:32.082020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.142451+0000","last_change":"2024-09-10T23:24:05.886531+0000","last_active":"2024-09-10T23:25:22.142451+0000","last_peered":"2024-09-10T23:25:22.142451+0000","last_clean":"2024-09-10T23:25:22.142451+0000","last_became_active":"2024-09-10T23:24:05.885762+0000","last_became_peered":"2024-09-10T23:24:05.885762+0000","last_unstale":"2024-09-10T23:25:22.142451+0000","last_undegraded":"2024-09-10T23:25:22.142451+0000","last_fullsized":"2024-09-10T23:25:22.142451+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:35.407364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.170969+0000","last_change":"2024-09-10T23:23:57.828052+0000","last_active":"2024-09-10T23:26:21.170969+0000","last_peered":"2024-09-10T23:26:21.170969+0000","last_clean":"2024-09-10T23:26:21.170969+0000","last_became_active":"2024-09-10T23:23:57.827653+0000","last_became_peered":"2024-09-10T23:23:57.827653+0000","last_unstale":"2024-09-10T23:26:21.170969+0000","last_undegraded":"2024-09-10T23:26:21.170969+0000","last_fullsized":"2024-09-10T23:26:21.170969+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:33.605054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.139104+0000","last_change":"2024-09-10T23:23:54.791375+0000","last_active":"2024-09-10T23:25:22.139104+0000","last_peered":"2024-09-10T23:25:22.139104+0000","last_clean":"2024-09-10T23:25:22.139104+0000","last_became_active":"2024-09-10T23:23:54.790974+0000","last_became_peered":"2024-09-10T23:23:54.790974+0000","last_unstale":"2024-09-10T23:25:22.139104+0000","last_undegraded":"2024-09-10T23:25:22.139104+0000","last_fullsized":"2024-09-10T23:25:22.139104+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:23:44.066787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.149326+0000","last_change":"2024-09-10T23:23:54.792056+0000","last_active":"2024-09-10T23:25:22.149326+0000","last_peered":"2024-09-10T23:25:22.149326+0000","last_clean":"2024-09-10T23:25:22.149326+0000","last_became_active":"2024-09-10T23:23:54.791665+0000","last_became_peered":"2024-09-10T23:23:54.791665+0000","last_unstale":"2024-09-10T23:25:22.149326+0000","last_undegraded":"2024-09-10T23:25:22.149326+0000","last_fullsized":"2024-09-10T23:25:22.149326+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:34:38.517066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.167402+0000","last_change":"2024-09-10T23:23:57.842524+0000","last_active":"2024-09-10T23:26:21.167402+0000","last_peered":"2024-09-10T23:26:21.167402+0000","last_clean":"2024-09-10T23:26:21.167402+0000","last_became_active":"2024-09-10T23:23:57.842033+0000","last_became_peered":"2024-09-10T23:23:57.842033+0000","last_unstale":"2024-09-10T23:26:21.167402+0000","last_undegraded":"2024-09-10T23:26:21.167402+0000","last_fullsized":"2024-09-10T23:26:21.167402+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:39.431115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.140947+0000","last_change":"2024-09-10T23:24:05.891676+0000","last_active":"2024-09-10T23:25:22.140947+0000","last_peered":"2024-09-10T23:25:22.140947+0000","last_clean":"2024-09-10T23:25:22.140947+0000","last_became_active":"2024-09-10T23:24:05.891224+0000","last_became_peered":"2024-09-10T23:24:05.891224+0000","last_unstale":"2024-09-10T23:25:22.140947+0000","last_undegraded":"2024-09-10T23:25:22.140947+0000","last_fullsized":"2024-09-10T23:25:22.140947+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:16:50.384745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'6","reported_seq":169,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:41.446077+0000","last_change":"2024-09-10T23:23:54.795126+0000","last_active":"2024-09-10T23:26:41.446077+0000","last_peered":"2024-09-10T23:26:41.446077+0000","last_clean":"2024-09-10T23:26:41.446077+0000","last_became_active":"2024-09-10T23:23:54.794553+0000","last_became_peered":"2024-09-10T23:23:54.794553+0000","last_unstale":"2024-09-10T23:26:41.446077+0000","last_undegraded":"2024-09-10T23:26:41.446077+0000","last_fullsized":"2024-09-10T23:26:41.446077+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:15:43.181180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1115,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.166101+0000","last_change":"2024-09-10T23:23:57.826827+0000","last_active":"2024-09-10T23:26:21.166101+0000","last_peered":"2024-09-10T23:26:21.166101+0000","last_clean":"2024-09-10T23:26:21.166101+0000","last_became_active":"2024-09-10T23:23:57.826457+0000","last_became_peered":"2024-09-10T23:23:57.826457+0000","last_unstale":"2024-09-10T23:26:21.166101+0000","last_undegraded":"2024-09-10T23:26:21.166101+0000","last_fullsized":"2024-09-10T23:26:21.166101+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:13.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.141368+0000","last_change":"2024-09-10T23:24:05.888774+0000","last_active":"2024-09-10T23:25:22.141368+0000","last_peered":"2024-09-10T23:25:22.141368+0000","last_clean":"2024-09-10T23:25:22.141368+0000","last_became_active":"2024-09-10T23:24:05.888267+0000","last_became_peered":"2024-09-10T23:24:05.888267+0000","last_unstale":"2024-09-10T23:25:22.141368+0000","last_undegraded":"2024-09-10T23:25:22.141368+0000","last_fullsized":"2024-09-10T23:25:22.141368+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:29.283509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.161996+0000","last_change":"2024-09-10T23:23:57.819178+0000","last_active":"2024-09-10T23:26:21.161996+0000","last_peered":"2024-09-10T23:26:21.161996+0000","last_clean":"2024-09-10T23:26:21.161996+0000","last_became_active":"2024-09-10T23:23:57.817029+0000","last_became_peered":"2024-09-10T23:23:57.817029+0000","last_unstale":"2024-09-10T23:26:21.161996+0000","last_undegraded":"2024-09-10T23:26:21.161996+0000","last_fullsized":"2024-09-10T23:26:21.161996+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:28:51.491402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.172379+0000","last_change":"2024-09-10T23:24:21.978215+0000","last_active":"2024-09-10T23:26:21.172379+0000","last_peered":"2024-09-10T23:26:21.172379+0000","last_clean":"2024-09-10T23:26:21.172379+0000","last_became_active":"2024-09-10T23:24:21.977811+0000","last_became_peered":"2024-09-10T23:24:21.977811+0000","last_unstale":"2024-09-10T23:26:21.172379+0000","last_undegraded":"2024-09-10T23:26:21.172379+0000","last_fullsized":"2024-09-10T23:26:21.172379+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:41.769216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.164810+0000","last_change":"2024-09-10T23:23:57.824147+0000","last_active":"2024-09-10T23:26:21.164810+0000","last_peered":"2024-09-10T23:26:21.164810+0000","last_clean":"2024-09-10T23:26:21.164810+0000","last_became_active":"2024-09-10T23:23:57.823503+0000","last_became_peered":"2024-09-10T23:23:57.823503+0000","last_unstale":"2024-09-10T23:26:21.164810+0000","last_undegraded":"2024-09-10T23:26:21.164810+0000","last_fullsized":"2024-09-10T23:26:21.164810+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:12:34.310648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.178151+0000","last_change":"2024-09-10T23:23:57.841413+0000","last_active":"2024-09-10T23:26:21.178151+0000","last_peered":"2024-09-10T23:26:21.178151+0000","last_clean":"2024-09-10T23:26:21.178151+0000","last_became_active":"2024-09-10T23:23:57.840889+0000","last_became_peered":"2024-09-10T23:23:57.840889+0000","last_unstale":"2024-09-10T23:26:21.178151+0000","last_undegraded":"2024-09-10T23:26:21.178151+0000","last_fullsized":"2024-09-10T23:26:21.178151+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:10:08.757628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.173077+0000","last_change":"2024-09-10T23:23:57.837267+0000","last_active":"2024-09-10T23:26:21.173077+0000","last_peered":"2024-09-10T23:26:21.173077+0000","last_clean":"2024-09-10T23:26:21.173077+0000","last_became_active":"2024-09-10T23:23:57.836911+0000","last_became_peered":"2024-09-10T23:23:57.836911+0000","last_unstale":"2024-09-10T23:26:21.173077+0000","last_undegraded":"2024-09-10T23:26:21.173077+0000","last_fullsized":"2024-09-10T23:26:21.173077+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:24.969215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.165488+0000","last_change":"2024-09-10T23:23:57.813855+0000","last_active":"2024-09-10T23:26:21.165488+0000","last_peered":"2024-09-10T23:26:21.165488+0000","last_clean":"2024-09-10T23:26:21.165488+0000","last_became_active":"2024-09-10T23:23:57.812862+0000","last_became_peered":"2024-09-10T23:23:57.812862+0000","last_unstale":"2024-09-10T23:26:21.165488+0000","last_undegraded":"2024-09-10T23:26:21.165488+0000","last_fullsized":"2024-09-10T23:26:21.165488+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:21.542499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.184491+0000","last_change":"2024-09-10T23:23:57.826082+0000","last_active":"2024-09-10T23:26:21.184491+0000","last_peered":"2024-09-10T23:26:21.184491+0000","last_clean":"2024-09-10T23:26:21.184491+0000","last_became_active":"2024-09-10T23:23:57.825695+0000","last_became_peered":"2024-09-10T23:23:57.825695+0000","last_unstale":"2024-09-10T23:26:21.184491+0000","last_undegraded":"2024-09-10T23:26:21.184491+0000","last_fullsized":"2024-09-10T23:26:21.184491+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:08.518084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.157077+0000","last_change":"2024-09-10T23:23:57.835147+0000","last_active":"2024-09-10T23:26:21.157077+0000","last_peered":"2024-09-10T23:26:21.157077+0000","last_clean":"2024-09-10T23:26:21.157077+0000","last_became_active":"2024-09-10T23:23:57.834739+0000","last_became_peered":"2024-09-10T23:23:57.834739+0000","last_unstale":"2024-09-10T23:26:21.157077+0000","last_undegraded":"2024-09-10T23:26:21.157077+0000","last_fullsized":"2024-09-10T23:26:21.157077+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:06:27.023088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.164735+0000","last_change":"2024-09-10T23:23:57.825996+0000","last_active":"2024-09-10T23:26:21.164735+0000","last_peered":"2024-09-10T23:26:21.164735+0000","last_clean":"2024-09-10T23:26:21.164735+0000","last_became_active":"2024-09-10T23:23:57.824168+0000","last_became_peered":"2024-09-10T23:23:57.824168+0000","last_unstale":"2024-09-10T23:26:21.164735+0000","last_undegraded":"2024-09-10T23:26:21.164735+0000","last_fullsized":"2024-09-10T23:26:21.164735+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:36.396179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.166612+0000","last_change":"2024-09-10T23:24:21.976841+0000","last_active":"2024-09-10T23:26:21.166612+0000","last_peered":"2024-09-10T23:26:21.166612+0000","last_clean":"2024-09-10T23:26:21.166612+0000","last_became_active":"2024-09-10T23:24:21.976461+0000","last_became_peered":"2024-09-10T23:24:21.976461+0000","last_unstale":"2024-09-10T23:26:21.166612+0000","last_undegraded":"2024-09-10T23:26:21.166612+0000","last_fullsized":"2024-09-10T23:26:21.166612+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:04:00.000274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.182479+0000","last_change":"2024-09-10T23:23:57.840477+0000","last_active":"2024-09-10T23:26:21.182479+0000","last_peered":"2024-09-10T23:26:21.182479+0000","last_clean":"2024-09-10T23:26:21.182479+0000","last_became_active":"2024-09-10T23:23:57.840113+0000","last_became_peered":"2024-09-10T23:23:57.840113+0000","last_unstale":"2024-09-10T23:26:21.182479+0000","last_undegraded":"2024-09-10T23:26:21.182479+0000","last_fullsized":"2024-09-10T23:26:21.182479+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:27:23.913802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.180371+0000","last_change":"2024-09-10T23:23:57.837416+0000","last_active":"2024-09-10T23:26:21.180371+0000","last_peered":"2024-09-10T23:26:21.180371+0000","last_clean":"2024-09-10T23:26:21.180371+0000","last_became_active":"2024-09-10T23:23:57.837104+0000","last_became_peered":"2024-09-10T23:23:57.837104+0000","last_unstale":"2024-09-10T23:26:21.180371+0000","last_undegraded":"2024-09-10T23:26:21.180371+0000","last_fullsized":"2024-09-10T23:26:21.180371+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:00.712148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.166773+0000","last_change":"2024-09-10T23:23:57.838304+0000","last_active":"2024-09-10T23:26:21.166773+0000","last_peered":"2024-09-10T23:26:21.166773+0000","last_clean":"2024-09-10T23:26:21.166773+0000","last_became_active":"2024-09-10T23:23:57.837677+0000","last_became_peered":"2024-09-10T23:23:57.837677+0000","last_unstale":"2024-09-10T23:26:21.166773+0000","last_undegraded":"2024-09-10T23:26:21.166773+0000","last_fullsized":"2024-09-10T23:26:21.166773+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:40.862950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.166514+0000","last_change":"2024-09-10T23:23:57.825579+0000","last_active":"2024-09-10T23:26:21.166514+0000","last_peered":"2024-09-10T23:26:21.166514+0000","last_clean":"2024-09-10T23:26:21.166514+0000","last_became_active":"2024-09-10T23:23:57.824840+0000","last_became_peered":"2024-09-10T23:23:57.824840+0000","last_unstale":"2024-09-10T23:26:21.166514+0000","last_undegraded":"2024-09-10T23:26:21.166514+0000","last_fullsized":"2024-09-10T23:26:21.166514+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:53:35.150858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.181556+0000","last_change":"2024-09-10T23:23:57.833479+0000","last_active":"2024-09-10T23:26:21.181556+0000","last_peered":"2024-09-10T23:26:21.181556+0000","last_clean":"2024-09-10T23:26:21.181556+0000","last_became_active":"2024-09-10T23:23:57.833124+0000","last_became_peered":"2024-09-10T23:23:57.833124+0000","last_unstale":"2024-09-10T23:26:21.181556+0000","last_undegraded":"2024-09-10T23:26:21.181556+0000","last_fullsized":"2024-09-10T23:26:21.181556+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:02.869308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.185986+0000","last_change":"2024-09-10T23:23:57.831610+0000","last_active":"2024-09-10T23:26:21.185986+0000","last_peered":"2024-09-10T23:26:21.185986+0000","last_clean":"2024-09-10T23:26:21.185986+0000","last_became_active":"2024-09-10T23:23:57.831227+0000","last_became_peered":"2024-09-10T23:23:57.831227+0000","last_unstale":"2024-09-10T23:26:21.185986+0000","last_undegraded":"2024-09-10T23:26:21.185986+0000","last_fullsized":"2024-09-10T23:26:21.185986+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:45.735286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.180683+0000","last_change":"2024-09-10T23:23:57.839295+0000","last_active":"2024-09-10T23:26:21.180683+0000","last_peered":"2024-09-10T23:26:21.180683+0000","last_clean":"2024-09-10T23:26:21.180683+0000","last_became_active":"2024-09-10T23:23:57.838857+0000","last_became_peered":"2024-09-10T23:23:57.838857+0000","last_unstale":"2024-09-10T23:26:21.180683+0000","last_undegraded":"2024-09-10T23:26:21.180683+0000","last_fullsized":"2024-09-10T23:26:21.180683+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:20:13.203324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.165534+0000","last_change":"2024-09-10T23:23:57.841459+0000","last_active":"2024-09-10T23:26:21.165534+0000","last_peered":"2024-09-10T23:26:21.165534+0000","last_clean":"2024-09-10T23:26:21.165534+0000","last_became_active":"2024-09-10T23:23:57.841049+0000","last_became_peered":"2024-09-10T23:23:57.841049+0000","last_unstale":"2024-09-10T23:26:21.165534+0000","last_undegraded":"2024-09-10T23:26:21.165534+0000","last_fullsized":"2024-09-10T23:26:21.165534+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:39:51.372657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.164155+0000","last_change":"2024-09-10T23:23:57.813028+0000","last_active":"2024-09-10T23:26:21.164155+0000","last_peered":"2024-09-10T23:26:21.164155+0000","last_clean":"2024-09-10T23:26:21.164155+0000","last_became_active":"2024-09-10T23:23:57.812648+0000","last_became_peered":"2024-09-10T23:23:57.812648+0000","last_unstale":"2024-09-10T23:26:21.164155+0000","last_undegraded":"2024-09-10T23:26:21.164155+0000","last_fullsized":"2024-09-10T23:26:21.164155+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:57.691811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.179739+0000","last_change":"2024-09-10T23:23:57.814467+0000","last_active":"2024-09-10T23:26:21.179739+0000","last_peered":"2024-09-10T23:26:21.179739+0000","last_clean":"2024-09-10T23:26:21.179739+0000","last_became_active":"2024-09-10T23:23:57.812286+0000","last_became_peered":"2024-09-10T23:23:57.812286+0000","last_unstale":"2024-09-10T23:26:21.179739+0000","last_undegraded":"2024-09-10T23:26:21.179739+0000","last_fullsized":"2024-09-10T23:26:21.179739+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:42.044495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.171818+0000","last_change":"2024-09-10T23:23:57.834679+0000","last_active":"2024-09-10T23:26:21.171818+0000","last_peered":"2024-09-10T23:26:21.171818+0000","last_clean":"2024-09-10T23:26:21.171818+0000","last_became_active":"2024-09-10T23:23:57.833964+0000","last_became_peered":"2024-09-10T23:23:57.833964+0000","last_unstale":"2024-09-10T23:26:21.171818+0000","last_undegraded":"2024-09-10T23:26:21.171818+0000","last_fullsized":"2024-09-10T23:26:21.171818+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:29.160280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.187632+0000","last_change":"2024-09-10T23:23:57.840788+0000","last_active":"2024-09-10T23:26:21.187632+0000","last_peered":"2024-09-10T23:26:21.187632+0000","last_clean":"2024-09-10T23:26:21.187632+0000","last_became_active":"2024-09-10T23:23:57.839946+0000","last_became_peered":"2024-09-10T23:23:57.839946+0000","last_unstale":"2024-09-10T23:26:21.187632+0000","last_undegraded":"2024-09-10T23:26:21.187632+0000","last_fullsized":"2024-09-10T23:26:21.187632+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:14.354925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.173950+0000","last_change":"2024-09-10T23:23:57.843454+0000","last_active":"2024-09-10T23:26:21.173950+0000","last_peered":"2024-09-10T23:26:21.173950+0000","last_clean":"2024-09-10T23:26:21.173950+0000","last_became_active":"2024-09-10T23:23:57.841623+0000","last_became_peered":"2024-09-10T23:23:57.841623+0000","last_unstale":"2024-09-10T23:26:21.173950+0000","last_undegraded":"2024-09-10T23:26:21.173950+0000","last_fullsized":"2024-09-10T23:26:21.173950+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:03:03.957444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.174992+0000","last_change":"2024-09-10T23:23:57.834196+0000","last_active":"2024-09-10T23:26:21.174992+0000","last_peered":"2024-09-10T23:26:21.174992+0000","last_clean":"2024-09-10T23:26:21.174992+0000","last_became_active":"2024-09-10T23:23:57.833692+0000","last_became_peered":"2024-09-10T23:23:57.833692+0000","last_unstale":"2024-09-10T23:26:21.174992+0000","last_undegraded":"2024-09-10T23:26:21.174992+0000","last_fullsized":"2024-09-10T23:26:21.174992+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:49.814475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.171348+0000","last_change":"2024-09-10T23:23:57.831457+0000","last_active":"2024-09-10T23:26:21.171348+0000","last_peered":"2024-09-10T23:26:21.171348+0000","last_clean":"2024-09-10T23:26:21.171348+0000","last_became_active":"2024-09-10T23:23:57.829686+0000","last_became_peered":"2024-09-10T23:23:57.829686+0000","last_unstale":"2024-09-10T23:26:21.171348+0000","last_undegraded":"2024-09-10T23:26:21.171348+0000","last_fullsized":"2024-09-10T23:26:21.171348+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:39.204501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.177997+0000","last_change":"2024-09-10T23:23:57.829437+0000","last_active":"2024-09-10T23:26:21.177997+0000","last_peered":"2024-09-10T23:26:21.177997+0000","last_clean":"2024-09-10T23:26:21.177997+0000","last_became_active":"2024-09-10T23:23:57.828956+0000","last_became_peered":"2024-09-10T23:23:57.828956+0000","last_unstale":"2024-09-10T23:26:21.177997+0000","last_undegraded":"2024-09-10T23:26:21.177997+0000","last_fullsized":"2024-09-10T23:26:21.177997+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:18.191002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.175037+0000","last_change":"2024-09-10T23:23:57.839661+0000","last_active":"2024-09-10T23:26:21.175037+0000","last_peered":"2024-09-10T23:26:21.175037+0000","last_clean":"2024-09-10T23:26:21.175037+0000","last_became_active":"2024-09-10T23:23:57.839197+0000","last_became_peered":"2024-09-10T23:23:57.839197+0000","last_unstale":"2024-09-10T23:26:21.175037+0000","last_undegraded":"2024-09-10T23:26:21.175037+0000","last_fullsized":"2024-09-10T23:26:21.175037+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:33.599860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.176613+0000","last_change":"2024-09-10T23:23:57.820968+0000","last_active":"2024-09-10T23:26:21.176613+0000","last_peered":"2024-09-10T23:26:21.176613+0000","last_clean":"2024-09-10T23:26:21.176613+0000","last_became_active":"2024-09-10T23:23:57.820108+0000","last_became_peered":"2024-09-10T23:23:57.820108+0000","last_unstale":"2024-09-10T23:26:21.176613+0000","last_undegraded":"2024-09-10T23:26:21.176613+0000","last_fullsized":"2024-09-10T23:26:21.176613+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:23.864751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.168522+0000","last_change":"2024-09-10T23:23:57.842302+0000","last_active":"2024-09-10T23:26:21.168522+0000","last_peered":"2024-09-10T23:26:21.168522+0000","last_clean":"2024-09-10T23:26:21.168522+0000","last_became_active":"2024-09-10T23:23:57.838460+0000","last_became_peered":"2024-09-10T23:23:57.838460+0000","last_unstale":"2024-09-10T23:26:21.168522+0000","last_undegraded":"2024-09-10T23:26:21.168522+0000","last_fullsized":"2024-09-10T23:26:21.168522+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:54.731481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.185496+0000","last_change":"2024-09-10T23:23:57.837749+0000","last_active":"2024-09-10T23:26:21.185496+0000","last_peered":"2024-09-10T23:26:21.185496+0000","last_clean":"2024-09-10T23:26:21.185496+0000","last_became_active":"2024-09-10T23:23:57.836195+0000","last_became_peered":"2024-09-10T23:23:57.836195+0000","last_unstale":"2024-09-10T23:26:21.185496+0000","last_undegraded":"2024-09-10T23:26:21.185496+0000","last_fullsized":"2024-09-10T23:26:21.185496+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:10.064725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.164284+0000","last_change":"2024-09-10T23:23:57.812182+0000","last_active":"2024-09-10T23:26:21.164284+0000","last_peered":"2024-09-10T23:26:21.164284+0000","last_clean":"2024-09-10T23:26:21.164284+0000","last_became_active":"2024-09-10T23:23:57.811853+0000","last_became_peered":"2024-09-10T23:23:57.811853+0000","last_unstale":"2024-09-10T23:26:21.164284+0000","last_undegraded":"2024-09-10T23:26:21.164284+0000","last_fullsized":"2024-09-10T23:26:21.164284+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:03.389054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.185862+0000","last_change":"2024-09-10T23:23:57.833957+0000","last_active":"2024-09-10T23:26:21.185862+0000","last_peered":"2024-09-10T23:26:21.185862+0000","last_clean":"2024-09-10T23:26:21.185862+0000","last_became_active":"2024-09-10T23:23:57.833547+0000","last_became_peered":"2024-09-10T23:23:57.833547+0000","last_unstale":"2024-09-10T23:26:21.185862+0000","last_undegraded":"2024-09-10T23:26:21.185862+0000","last_fullsized":"2024-09-10T23:26:21.185862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:30.917801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67780,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":712,"num_read_kb":427,"num_write":181,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":421888,"data_stored":207263,"data_compressed":5592,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":288697,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678065,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":999424,"data_stored":535193,"data_compressed":32452,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874295,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28136,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717016,"statfs":{"total":95995035648,"available":95966224384,"internally_reserved":0,"allocated":1138688,"data_stored":1185713,"data_compressed":71014,"data_compressed_allocated":94208,"data_compressed_original":688128,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037820,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":539491,"data_compressed":32452,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234050,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":535315,"data_compressed":32452,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430280,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1060864,"data_stored":1132351,"data_compressed":69150,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593807,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":530571,"data_compressed":32452,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790037,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1069056,"data_stored":1126914,"data_compressed":69150,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953563,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":536637,"data_compressed":32452,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149792,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32164,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712988,"statfs":{"total":95995035648,"available":95962099712,"internally_reserved":0,"allocated":1003520,"data_stored":530765,"data_compressed":32452,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378727,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32236,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712916,"statfs":{"total":95995035648,"available":95962025984,"internally_reserved":0,"allocated":1077248,"data_stored":594551,"data_compressed":34316,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542251,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1060864,"data_stored":597447,"data_compressed":34316,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705777,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32176,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712976,"statfs":{"total":95995035648,"available":95962087424,"internally_reserved":0,"allocated":1015808,"data_stored":531959,"data_compressed":32452,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":66966,"data_compressed":1864,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":64070,"data_compressed":1864,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":64864,"data_compressed":1864,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:26:46.904 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T23:26:47.286 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:47.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:47 smithi038 ceph-mon[34225]: from='client.15558 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:26:47.627 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:47 smithi003 ceph-mon[30348]: from='client.15558 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:26:47.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:47 smithi194 ceph-mon[33904]: from='client.15558 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:26:47.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.893+0000 7f22f2e00640 1 -- 172.21.15.3:0/2737527437 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f22ec102c10 msgr2=0x7f22ec102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:47.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.893+0000 7f22f2e00640 1 --2- 172.21.15.3:0/2737527437 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f22ec102c10 0x7f22ec102ff0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f22e0009900 tx=0x7f22e002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.893+0000 7f22f2e00640 1 -- 172.21.15.3:0/2737527437 shutdown_connections 2024-09-10T23:26:47.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.893+0000 7f22f2e00640 1 --2- 172.21.15.3:0/2737527437 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22ec108fa0 0x7f22ec10f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.893+0000 7f22f2e00640 1 --2- 172.21.15.3:0/2737527437 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22ec108620 0x7f22ec108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.893+0000 7f22f2e00640 1 --2- 172.21.15.3:0/2737527437 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f22ec102c10 0x7f22ec102ff0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.893+0000 7f22f2e00640 1 -- 172.21.15.3:0/2737527437 >> 172.21.15.3:0/2737527437 conn(0x7f22ec0fe660 msgr2=0x7f22ec100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:47.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.893+0000 7f22f2e00640 1 -- 172.21.15.3:0/2737527437 shutdown_connections 2024-09-10T23:26:47.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.893+0000 7f22f2e00640 1 -- 172.21.15.3:0/2737527437 wait complete. 2024-09-10T23:26:47.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.894+0000 7f22f2e00640 1 Processor -- start 2024-09-10T23:26:47.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.894+0000 7f22f2e00640 1 -- start start 2024-09-10T23:26:47.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.895+0000 7f22f2e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22ec102c10 0x7f22ec198f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.895+0000 7f22f2e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22ec108620 0x7f22ec199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.895+0000 7f22f2e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f22ec108fa0 0x7f22ec19e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.895+0000 7f22f2e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f22ec112ae0 con 0x7f22ec108fa0 2024-09-10T23:26:47.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.895+0000 7f22f2e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f22ec112960 con 0x7f22ec102c10 2024-09-10T23:26:47.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.895+0000 7f22f2e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f22ec112c60 con 0x7f22ec108620 2024-09-10T23:26:47.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.895+0000 7f22f2400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f22ec108fa0 0x7f22ec19e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.895+0000 7f22f2400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f22ec108fa0 0x7f22ec19e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39560/0 (socket says 172.21.15.3:39560) 2024-09-10T23:26:47.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.895+0000 7f22f2400640 1 -- 172.21.15.3:0/3737630832 learned_addr learned my addr 172.21.15.3:0/3737630832 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:47.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.895+0000 7f22f1a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22ec102c10 0x7f22ec198f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.895+0000 7f22f1000640 1 --2- 172.21.15.3:0/3737630832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22ec108620 0x7f22ec199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.896+0000 7f22f2400640 1 -- 172.21.15.3:0/3737630832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22ec108620 msgr2=0x7f22ec199470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:47.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.896+0000 7f22f2400640 1 --2- 172.21.15.3:0/3737630832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22ec108620 0x7f22ec199470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.896+0000 7f22f2400640 1 -- 172.21.15.3:0/3737630832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22ec102c10 msgr2=0x7f22ec198f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:47.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.896+0000 7f22f2400640 1 --2- 172.21.15.3:0/3737630832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22ec102c10 0x7f22ec198f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.896+0000 7f22f2400640 1 -- 172.21.15.3:0/3737630832 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22ec19efe0 con 0x7f22ec108fa0 2024-09-10T23:26:47.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.896+0000 7f22f1000640 1 --2- 172.21.15.3:0/3737630832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22ec108620 0x7f22ec199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:47.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.896+0000 7f22f2400640 1 --2- 172.21.15.3:0/3737630832 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f22ec108fa0 0x7f22ec19e810 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f22e4009fd0 tx=0x7f22e400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:47.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.896+0000 7f22ea000640 1 -- 172.21.15.3:0/3737630832 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e4017070 con 0x7f22ec108fa0 2024-09-10T23:26:47.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.896+0000 7f22ea000640 1 -- 172.21.15.3:0/3737630832 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f22e4003e00 con 0x7f22ec108fa0 2024-09-10T23:26:47.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.896+0000 7f22ea000640 1 -- 172.21.15.3:0/3737630832 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e4010460 con 0x7f22ec108fa0 2024-09-10T23:26:47.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.896+0000 7f22f2e00640 1 -- 172.21.15.3:0/3737630832 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22ec19f2d0 con 0x7f22ec108fa0 2024-09-10T23:26:47.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.896+0000 7f22f2e00640 1 -- 172.21.15.3:0/3737630832 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22ec1a5990 con 0x7f22ec108fa0 2024-09-10T23:26:47.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.897+0000 7f22f2e00640 1 -- 172.21.15.3:0/3737630832 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22ec102ff0 con 0x7f22ec108fa0 2024-09-10T23:26:47.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.899+0000 7f22ea000640 1 -- 172.21.15.3:0/3737630832 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 24) ==== 153374+0+0 (secure 0 0 0) 0x7f22e4003970 con 0x7f22ec108fa0 2024-09-10T23:26:47.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.901+0000 7f22ea000640 1 --2- 172.21.15.3:0/3737630832 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f22d40b5580 0x7f22d40b7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.901+0000 7f22ea000640 1 -- 172.21.15.3:0/3737630832 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f22e40e64a0 con 0x7f22ec108fa0 2024-09-10T23:26:47.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.901+0000 7f22f1a00640 1 --2- 172.21.15.3:0/3737630832 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f22d40b5580 0x7f22d40b7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.902+0000 7f22f1a00640 1 --2- 172.21.15.3:0/3737630832 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f22d40b5580 0x7f22d40b7a40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f22e00057c0 tx=0x7f22e00058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:47.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:47.905+0000 7f22ea000640 1 -- 172.21.15.3:0/3737630832 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f22e40acc50 con 0x7f22ec108fa0 2024-09-10T23:26:48.097 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:48.095+0000 7f22f2e00640 1 -- 172.21.15.3:0/3737630832 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f22ec063590 con 0x7f22d40b5580 2024-09-10T23:26:48.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:48.101+0000 7f22ea000640 1 -- 172.21.15.3:0/3737630832 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340805 (secure 0 0 0) 0x7f22ec063590 con 0x7f22d40b5580 2024-09-10T23:26:48.106 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:26:48.107 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-10T23:26:48.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:48.106+0000 7f22f2e00640 1 -- 172.21.15.3:0/3737630832 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f22d40b5580 msgr2=0x7f22d40b7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:48.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:48.106+0000 7f22f2e00640 1 --2- 172.21.15.3:0/3737630832 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f22d40b5580 0x7f22d40b7a40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f22e00057c0 tx=0x7f22e00058d0 comp rx=0 tx=0).stop 2024-09-10T23:26:48.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:48.106+0000 7f22f2e00640 1 -- 172.21.15.3:0/3737630832 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f22ec108fa0 msgr2=0x7f22ec19e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:48.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:48.106+0000 7f22f2e00640 1 --2- 172.21.15.3:0/3737630832 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f22ec108fa0 0x7f22ec19e810 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f22e4009fd0 tx=0x7f22e400b260 comp rx=0 tx=0).stop 2024-09-10T23:26:48.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:48.106+0000 7f22f2e00640 1 -- 172.21.15.3:0/3737630832 shutdown_connections 2024-09-10T23:26:48.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:48.106+0000 7f22f2e00640 1 --2- 172.21.15.3:0/3737630832 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f22d40b5580 0x7f22d40b7a40 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:48.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:48.106+0000 7f22f2e00640 1 --2- 172.21.15.3:0/3737630832 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f22ec108fa0 0x7f22ec19e810 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:48.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:48.106+0000 7f22f2e00640 1 --2- 172.21.15.3:0/3737630832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22ec108620 0x7f22ec199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:48.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:48.106+0000 7f22f2e00640 1 --2- 172.21.15.3:0/3737630832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22ec102c10 0x7f22ec198f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:48.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:48.106+0000 7f22f2e00640 1 -- 172.21.15.3:0/3737630832 >> 172.21.15.3:0/3737630832 conn(0x7f22ec0fe660 msgr2=0x7f22ec100a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:48.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:48.106+0000 7f22f2e00640 1 -- 172.21.15.3:0/3737630832 shutdown_connections 2024-09-10T23:26:48.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:48.107+0000 7f22f2e00640 1 -- 172.21.15.3:0/3737630832 wait complete. 2024-09-10T23:26:48.503 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:48 smithi003 ceph-mon[30348]: pgmap v391: 129 pgs: 129 active+clean; 650 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-10T23:26:48.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:48 smithi038 ceph-mon[34225]: pgmap v391: 129 pgs: 129 active+clean; 650 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-10T23:26:48.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:48 smithi194 ceph-mon[33904]: pgmap v391: 129 pgs: 129 active+clean; 650 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-10T23:26:48.988 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":391,"stamp":"2024-09-10T23:26:46.794069+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665607,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":810,"num_read_kb":514,"num_write":308,"num_write_kb":2288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2951874,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":751,"ondisk_log_size":751,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365628,"kb_used_data":12212,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576196,"statfs":{"total":1151940427776,"available":1151566024704,"internally_reserved":0,"allocated":12505088,"data_stored":8778690,"data_compressed":523201,"data_compressed_allocated":712704,"data_compressed_original":3244032,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9095,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":51,"num_write":13,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003268"},"pg_stats":[{"pgid":"2.1f","version":"88'9","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.145875+0000","last_change":"2024-09-10T23:23:54.796561+0000","last_active":"2024-09-10T23:25:22.145875+0000","last_peered":"2024-09-10T23:25:22.145875+0000","last_clean":"2024-09-10T23:25:22.145875+0000","last_became_active":"2024-09-10T23:23:54.796058+0000","last_became_peered":"2024-09-10T23:23:54.796058+0000","last_unstale":"2024-09-10T23:25:22.145875+0000","last_undegraded":"2024-09-10T23:25:22.145875+0000","last_fullsized":"2024-09-10T23:25:22.145875+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:27.790990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.159632+0000","last_change":"2024-09-10T23:23:57.828660+0000","last_active":"2024-09-10T23:26:21.159632+0000","last_peered":"2024-09-10T23:26:21.159632+0000","last_clean":"2024-09-10T23:26:21.159632+0000","last_became_active":"2024-09-10T23:23:57.828287+0000","last_became_peered":"2024-09-10T23:23:57.828287+0000","last_unstale":"2024-09-10T23:26:21.159632+0000","last_undegraded":"2024-09-10T23:26:21.159632+0000","last_fullsized":"2024-09-10T23:26:21.159632+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:13.085003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.140416+0000","last_change":"2024-09-10T23:24:05.886167+0000","last_active":"2024-09-10T23:25:22.140416+0000","last_peered":"2024-09-10T23:25:22.140416+0000","last_clean":"2024-09-10T23:25:22.140416+0000","last_became_active":"2024-09-10T23:24:05.885706+0000","last_became_peered":"2024-09-10T23:24:05.885706+0000","last_unstale":"2024-09-10T23:25:22.140416+0000","last_undegraded":"2024-09-10T23:25:22.140416+0000","last_fullsized":"2024-09-10T23:25:22.140416+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:42.337384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481001+0000","last_change":"2024-09-10T23:23:54.791770+0000","last_active":"2024-09-10T23:25:22.481001+0000","last_peered":"2024-09-10T23:25:22.481001+0000","last_clean":"2024-09-10T23:25:22.481001+0000","last_became_active":"2024-09-10T23:23:54.791476+0000","last_became_peered":"2024-09-10T23:23:54.791476+0000","last_unstale":"2024-09-10T23:25:22.481001+0000","last_undegraded":"2024-09-10T23:25:22.481001+0000","last_fullsized":"2024-09-10T23:25:22.481001+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:07.493654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.185714+0000","last_change":"2024-09-10T23:23:57.833858+0000","last_active":"2024-09-10T23:26:21.185714+0000","last_peered":"2024-09-10T23:26:21.185714+0000","last_clean":"2024-09-10T23:26:21.185714+0000","last_became_active":"2024-09-10T23:23:57.833496+0000","last_became_peered":"2024-09-10T23:23:57.833496+0000","last_unstale":"2024-09-10T23:26:21.185714+0000","last_undegraded":"2024-09-10T23:26:21.185714+0000","last_fullsized":"2024-09-10T23:26:21.185714+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:48:50.293342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147391+0000","last_change":"2024-09-10T23:24:05.878733+0000","last_active":"2024-09-10T23:25:22.147391+0000","last_peered":"2024-09-10T23:25:22.147391+0000","last_clean":"2024-09-10T23:25:22.147391+0000","last_became_active":"2024-09-10T23:24:05.878285+0000","last_became_peered":"2024-09-10T23:24:05.878285+0000","last_unstale":"2024-09-10T23:25:22.147391+0000","last_undegraded":"2024-09-10T23:25:22.147391+0000","last_fullsized":"2024-09-10T23:25:22.147391+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:21:11.636292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.181613+0000","last_change":"2024-09-10T23:23:54.792253+0000","last_active":"2024-09-10T23:25:22.181613+0000","last_peered":"2024-09-10T23:25:22.181613+0000","last_clean":"2024-09-10T23:25:22.181613+0000","last_became_active":"2024-09-10T23:23:54.791847+0000","last_became_peered":"2024-09-10T23:23:54.791847+0000","last_unstale":"2024-09-10T23:25:22.181613+0000","last_undegraded":"2024-09-10T23:25:22.181613+0000","last_fullsized":"2024-09-10T23:25:22.181613+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:03.563741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.187276+0000","last_change":"2024-09-10T23:23:57.837009+0000","last_active":"2024-09-10T23:26:21.187276+0000","last_peered":"2024-09-10T23:26:21.187276+0000","last_clean":"2024-09-10T23:26:21.187276+0000","last_became_active":"2024-09-10T23:23:57.835152+0000","last_became_peered":"2024-09-10T23:23:57.835152+0000","last_unstale":"2024-09-10T23:26:21.187276+0000","last_undegraded":"2024-09-10T23:26:21.187276+0000","last_fullsized":"2024-09-10T23:26:21.187276+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:25.345514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147469+0000","last_change":"2024-09-10T23:24:05.882593+0000","last_active":"2024-09-10T23:25:22.147469+0000","last_peered":"2024-09-10T23:25:22.147469+0000","last_clean":"2024-09-10T23:25:22.147469+0000","last_became_active":"2024-09-10T23:24:05.882123+0000","last_became_peered":"2024-09-10T23:24:05.882123+0000","last_unstale":"2024-09-10T23:25:22.147469+0000","last_undegraded":"2024-09-10T23:25:22.147469+0000","last_fullsized":"2024-09-10T23:25:22.147469+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:22:30.103412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.142081+0000","last_change":"2024-09-10T23:24:21.980433+0000","last_active":"2024-09-10T23:25:22.142081+0000","last_peered":"2024-09-10T23:25:22.142081+0000","last_clean":"2024-09-10T23:25:22.142081+0000","last_became_active":"2024-09-10T23:24:21.974096+0000","last_became_peered":"2024-09-10T23:24:21.974096+0000","last_unstale":"2024-09-10T23:25:22.142081+0000","last_undegraded":"2024-09-10T23:25:22.142081+0000","last_fullsized":"2024-09-10T23:25:22.142081+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:33.430921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":62,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.184065+0000","last_change":"2024-09-10T23:24:21.978526+0000","last_active":"2024-09-10T23:26:21.184065+0000","last_peered":"2024-09-10T23:26:21.184065+0000","last_clean":"2024-09-10T23:26:21.184065+0000","last_became_active":"2024-09-10T23:24:21.978137+0000","last_became_peered":"2024-09-10T23:24:21.978137+0000","last_unstale":"2024-09-10T23:26:21.184065+0000","last_undegraded":"2024-09-10T23:26:21.184065+0000","last_fullsized":"2024-09-10T23:26:21.184065+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:53:31.785033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147303+0000","last_change":"2024-09-10T23:24:05.889983+0000","last_active":"2024-09-10T23:25:22.147303+0000","last_peered":"2024-09-10T23:25:22.147303+0000","last_clean":"2024-09-10T23:25:22.147303+0000","last_became_active":"2024-09-10T23:24:05.889003+0000","last_became_peered":"2024-09-10T23:24:05.889003+0000","last_unstale":"2024-09-10T23:25:22.147303+0000","last_undegraded":"2024-09-10T23:25:22.147303+0000","last_fullsized":"2024-09-10T23:25:22.147303+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:19:13.555187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.186655+0000","last_change":"2024-09-10T23:23:57.831433+0000","last_active":"2024-09-10T23:26:21.186655+0000","last_peered":"2024-09-10T23:26:21.186655+0000","last_clean":"2024-09-10T23:26:21.186655+0000","last_became_active":"2024-09-10T23:23:57.831108+0000","last_became_peered":"2024-09-10T23:23:57.831108+0000","last_unstale":"2024-09-10T23:26:21.186655+0000","last_undegraded":"2024-09-10T23:26:21.186655+0000","last_fullsized":"2024-09-10T23:26:21.186655+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:50:20.160455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.181266+0000","last_change":"2024-09-10T23:23:54.792269+0000","last_active":"2024-09-10T23:25:22.181266+0000","last_peered":"2024-09-10T23:25:22.181266+0000","last_clean":"2024-09-10T23:25:22.181266+0000","last_became_active":"2024-09-10T23:23:54.791853+0000","last_became_peered":"2024-09-10T23:23:54.791853+0000","last_unstale":"2024-09-10T23:25:22.181266+0000","last_undegraded":"2024-09-10T23:25:22.181266+0000","last_fullsized":"2024-09-10T23:25:22.181266+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:43.020267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147630+0000","last_change":"2024-09-10T23:24:05.886155+0000","last_active":"2024-09-10T23:25:22.147630+0000","last_peered":"2024-09-10T23:25:22.147630+0000","last_clean":"2024-09-10T23:25:22.147630+0000","last_became_active":"2024-09-10T23:24:05.885674+0000","last_became_peered":"2024-09-10T23:24:05.885674+0000","last_unstale":"2024-09-10T23:25:22.147630+0000","last_undegraded":"2024-09-10T23:25:22.147630+0000","last_fullsized":"2024-09-10T23:25:22.147630+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:46:00.891311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.170665+0000","last_change":"2024-09-10T23:23:57.830440+0000","last_active":"2024-09-10T23:26:21.170665+0000","last_peered":"2024-09-10T23:26:21.170665+0000","last_clean":"2024-09-10T23:26:21.170665+0000","last_became_active":"2024-09-10T23:23:57.829219+0000","last_became_peered":"2024-09-10T23:23:57.829219+0000","last_unstale":"2024-09-10T23:26:21.170665+0000","last_undegraded":"2024-09-10T23:26:21.170665+0000","last_fullsized":"2024-09-10T23:26:21.170665+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:28:15.696684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"90'2","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:07.582692+0000","last_change":"2024-09-10T23:23:54.796493+0000","last_active":"2024-09-10T23:26:07.582692+0000","last_peered":"2024-09-10T23:26:07.582692+0000","last_clean":"2024-09-10T23:26:07.582692+0000","last_became_active":"2024-09-10T23:23:54.796077+0000","last_became_peered":"2024-09-10T23:23:54.796077+0000","last_unstale":"2024-09-10T23:26:07.582692+0000","last_undegraded":"2024-09-10T23:26:07.582692+0000","last_fullsized":"2024-09-10T23:26:07.582692+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:13.054307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147718+0000","last_change":"2024-09-10T23:24:05.885557+0000","last_active":"2024-09-10T23:25:22.147718+0000","last_peered":"2024-09-10T23:25:22.147718+0000","last_clean":"2024-09-10T23:25:22.147718+0000","last_became_active":"2024-09-10T23:24:05.884773+0000","last_became_peered":"2024-09-10T23:24:05.884773+0000","last_unstale":"2024-09-10T23:25:22.147718+0000","last_undegraded":"2024-09-10T23:25:22.147718+0000","last_fullsized":"2024-09-10T23:25:22.147718+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:52.596822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.156861+0000","last_change":"2024-09-10T23:23:57.816395+0000","last_active":"2024-09-10T23:26:21.156861+0000","last_peered":"2024-09-10T23:26:21.156861+0000","last_clean":"2024-09-10T23:26:21.156861+0000","last_became_active":"2024-09-10T23:23:57.816047+0000","last_became_peered":"2024-09-10T23:23:57.816047+0000","last_unstale":"2024-09-10T23:26:21.156861+0000","last_undegraded":"2024-09-10T23:26:21.156861+0000","last_fullsized":"2024-09-10T23:26:21.156861+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:08:11.535738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480277+0000","last_change":"2024-09-10T23:23:54.795827+0000","last_active":"2024-09-10T23:25:22.480277+0000","last_peered":"2024-09-10T23:25:22.480277+0000","last_clean":"2024-09-10T23:25:22.480277+0000","last_became_active":"2024-09-10T23:23:54.794253+0000","last_became_peered":"2024-09-10T23:23:54.794253+0000","last_unstale":"2024-09-10T23:25:22.480277+0000","last_undegraded":"2024-09-10T23:25:22.480277+0000","last_fullsized":"2024-09-10T23:25:22.480277+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:27:27.988380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.145484+0000","last_change":"2024-09-10T23:24:05.889120+0000","last_active":"2024-09-10T23:25:22.145484+0000","last_peered":"2024-09-10T23:25:22.145484+0000","last_clean":"2024-09-10T23:25:22.145484+0000","last_became_active":"2024-09-10T23:24:05.888771+0000","last_became_peered":"2024-09-10T23:24:05.888771+0000","last_unstale":"2024-09-10T23:25:22.145484+0000","last_undegraded":"2024-09-10T23:25:22.145484+0000","last_fullsized":"2024-09-10T23:25:22.145484+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:55.414786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.122950+0000","last_change":"2024-09-10T23:23:57.814073+0000","last_active":"2024-09-10T23:26:21.122950+0000","last_peered":"2024-09-10T23:26:21.122950+0000","last_clean":"2024-09-10T23:26:21.122950+0000","last_became_active":"2024-09-10T23:23:57.813681+0000","last_became_peered":"2024-09-10T23:23:57.813681+0000","last_unstale":"2024-09-10T23:26:21.122950+0000","last_undegraded":"2024-09-10T23:26:21.122950+0000","last_fullsized":"2024-09-10T23:26:21.122950+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:44.129174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480412+0000","last_change":"2024-09-10T23:23:54.791119+0000","last_active":"2024-09-10T23:25:22.480412+0000","last_peered":"2024-09-10T23:25:22.480412+0000","last_clean":"2024-09-10T23:25:22.480412+0000","last_became_active":"2024-09-10T23:23:54.790770+0000","last_became_peered":"2024-09-10T23:23:54.790770+0000","last_unstale":"2024-09-10T23:25:22.480412+0000","last_undegraded":"2024-09-10T23:25:22.480412+0000","last_fullsized":"2024-09-10T23:25:22.480412+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:35.015104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.183894+0000","last_change":"2024-09-10T23:25:22.183216+0000","last_active":"2024-09-10T23:25:22.183894+0000","last_peered":"2024-09-10T23:25:22.183894+0000","last_clean":"2024-09-10T23:25:22.183894+0000","last_became_active":"2024-09-10T23:25:22.182735+0000","last_became_peered":"2024-09-10T23:25:22.182735+0000","last_unstale":"2024-09-10T23:25:22.183894+0000","last_undegraded":"2024-09-10T23:25:22.183894+0000","last_fullsized":"2024-09-10T23:25:22.183894+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:39:53.143633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.161571+0000","last_change":"2024-09-10T23:24:21.976169+0000","last_active":"2024-09-10T23:26:21.161571+0000","last_peered":"2024-09-10T23:26:21.161571+0000","last_clean":"2024-09-10T23:26:21.161571+0000","last_became_active":"2024-09-10T23:24:21.975330+0000","last_became_peered":"2024-09-10T23:24:21.975330+0000","last_unstale":"2024-09-10T23:26:21.161571+0000","last_undegraded":"2024-09-10T23:26:21.161571+0000","last_fullsized":"2024-09-10T23:26:21.161571+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:54:59.422630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.148043+0000","last_change":"2024-09-10T23:23:55.082093+0000","last_active":"2024-09-10T23:25:22.148043+0000","last_peered":"2024-09-10T23:25:22.148043+0000","last_clean":"2024-09-10T23:25:22.148043+0000","last_became_active":"2024-09-10T23:23:55.081705+0000","last_became_peered":"2024-09-10T23:23:55.081705+0000","last_unstale":"2024-09-10T23:25:22.148043+0000","last_undegraded":"2024-09-10T23:25:22.148043+0000","last_fullsized":"2024-09-10T23:25:22.148043+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:01:04.150153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.140670+0000","last_change":"2024-09-10T23:24:05.880084+0000","last_active":"2024-09-10T23:25:22.140670+0000","last_peered":"2024-09-10T23:25:22.140670+0000","last_clean":"2024-09-10T23:25:22.140670+0000","last_became_active":"2024-09-10T23:24:05.879655+0000","last_became_peered":"2024-09-10T23:24:05.879655+0000","last_unstale":"2024-09-10T23:25:22.140670+0000","last_undegraded":"2024-09-10T23:25:22.140670+0000","last_fullsized":"2024-09-10T23:25:22.140670+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:01.473494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.174054+0000","last_change":"2024-09-10T23:23:57.836207+0000","last_active":"2024-09-10T23:26:21.174054+0000","last_peered":"2024-09-10T23:26:21.174054+0000","last_clean":"2024-09-10T23:26:21.174054+0000","last_became_active":"2024-09-10T23:23:57.835801+0000","last_became_peered":"2024-09-10T23:23:57.835801+0000","last_unstale":"2024-09-10T23:26:21.174054+0000","last_undegraded":"2024-09-10T23:26:21.174054+0000","last_fullsized":"2024-09-10T23:26:21.174054+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:48:18.246508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'12","reported_seq":58,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.865818+0000","last_change":"2024-09-10T23:23:54.798126+0000","last_active":"2024-09-10T23:26:21.865818+0000","last_peered":"2024-09-10T23:26:21.865818+0000","last_clean":"2024-09-10T23:26:21.865818+0000","last_became_active":"2024-09-10T23:23:54.797755+0000","last_became_peered":"2024-09-10T23:23:54.797755+0000","last_unstale":"2024-09-10T23:26:21.865818+0000","last_undegraded":"2024-09-10T23:26:21.865818+0000","last_fullsized":"2024-09-10T23:26:21.865818+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:54.474382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.479753+0000","last_change":"2024-09-10T23:24:05.886431+0000","last_active":"2024-09-10T23:25:22.479753+0000","last_peered":"2024-09-10T23:25:22.479753+0000","last_clean":"2024-09-10T23:25:22.479753+0000","last_became_active":"2024-09-10T23:24:05.885962+0000","last_became_peered":"2024-09-10T23:24:05.885962+0000","last_unstale":"2024-09-10T23:25:22.479753+0000","last_undegraded":"2024-09-10T23:25:22.479753+0000","last_fullsized":"2024-09-10T23:25:22.479753+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:32.568553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.172961+0000","last_change":"2024-09-10T23:23:57.825790+0000","last_active":"2024-09-10T23:26:21.172961+0000","last_peered":"2024-09-10T23:26:21.172961+0000","last_clean":"2024-09-10T23:26:21.172961+0000","last_became_active":"2024-09-10T23:23:57.825510+0000","last_became_peered":"2024-09-10T23:23:57.825510+0000","last_unstale":"2024-09-10T23:26:21.172961+0000","last_undegraded":"2024-09-10T23:26:21.172961+0000","last_fullsized":"2024-09-10T23:26:21.172961+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:43.816144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.181663+0000","last_change":"2024-09-10T23:23:54.791957+0000","last_active":"2024-09-10T23:25:22.181663+0000","last_peered":"2024-09-10T23:25:22.181663+0000","last_clean":"2024-09-10T23:25:22.181663+0000","last_became_active":"2024-09-10T23:23:54.791607+0000","last_became_peered":"2024-09-10T23:23:54.791607+0000","last_unstale":"2024-09-10T23:25:22.181663+0000","last_undegraded":"2024-09-10T23:25:22.181663+0000","last_fullsized":"2024-09-10T23:25:22.181663+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:00:47.600299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.142066+0000","last_change":"2024-09-10T23:24:05.884275+0000","last_active":"2024-09-10T23:25:22.142066+0000","last_peered":"2024-09-10T23:25:22.142066+0000","last_clean":"2024-09-10T23:25:22.142066+0000","last_became_active":"2024-09-10T23:24:05.882340+0000","last_became_peered":"2024-09-10T23:24:05.882340+0000","last_unstale":"2024-09-10T23:25:22.142066+0000","last_undegraded":"2024-09-10T23:25:22.142066+0000","last_fullsized":"2024-09-10T23:25:22.142066+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:15.243993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"90'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.172476+0000","last_change":"2024-09-10T23:23:57.828322+0000","last_active":"2024-09-10T23:26:21.172476+0000","last_peered":"2024-09-10T23:26:21.172476+0000","last_clean":"2024-09-10T23:26:21.172476+0000","last_became_active":"2024-09-10T23:23:57.827925+0000","last_became_peered":"2024-09-10T23:23:57.827925+0000","last_unstale":"2024-09-10T23:26:21.172476+0000","last_undegraded":"2024-09-10T23:26:21.172476+0000","last_fullsized":"2024-09-10T23:26:21.172476+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:55.214207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144992+0000","last_change":"2024-09-10T23:23:54.789507+0000","last_active":"2024-09-10T23:25:22.144992+0000","last_peered":"2024-09-10T23:25:22.144992+0000","last_clean":"2024-09-10T23:25:22.144992+0000","last_became_active":"2024-09-10T23:23:54.789120+0000","last_became_peered":"2024-09-10T23:23:54.789120+0000","last_unstale":"2024-09-10T23:25:22.144992+0000","last_undegraded":"2024-09-10T23:25:22.144992+0000","last_fullsized":"2024-09-10T23:25:22.144992+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:58.033953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.181120+0000","last_change":"2024-09-10T23:24:05.881015+0000","last_active":"2024-09-10T23:25:22.181120+0000","last_peered":"2024-09-10T23:25:22.181120+0000","last_clean":"2024-09-10T23:25:22.181120+0000","last_became_active":"2024-09-10T23:24:05.880261+0000","last_became_peered":"2024-09-10T23:24:05.880261+0000","last_unstale":"2024-09-10T23:25:22.181120+0000","last_undegraded":"2024-09-10T23:25:22.181120+0000","last_fullsized":"2024-09-10T23:25:22.181120+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:13:36.937503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.167570+0000","last_change":"2024-09-10T23:23:57.842018+0000","last_active":"2024-09-10T23:26:21.167570+0000","last_peered":"2024-09-10T23:26:21.167570+0000","last_clean":"2024-09-10T23:26:21.167570+0000","last_became_active":"2024-09-10T23:23:57.841669+0000","last_became_peered":"2024-09-10T23:23:57.841669+0000","last_unstale":"2024-09-10T23:26:21.167570+0000","last_undegraded":"2024-09-10T23:26:21.167570+0000","last_fullsized":"2024-09-10T23:26:21.167570+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:11.619741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481110+0000","last_change":"2024-09-10T23:23:54.794565+0000","last_active":"2024-09-10T23:25:22.481110+0000","last_peered":"2024-09-10T23:25:22.481110+0000","last_clean":"2024-09-10T23:25:22.481110+0000","last_became_active":"2024-09-10T23:23:54.793794+0000","last_became_peered":"2024-09-10T23:23:54.793794+0000","last_unstale":"2024-09-10T23:25:22.481110+0000","last_undegraded":"2024-09-10T23:25:22.481110+0000","last_fullsized":"2024-09-10T23:25:22.481110+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:42.665924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.139490+0000","last_change":"2024-09-10T23:24:05.883706+0000","last_active":"2024-09-10T23:25:22.139490+0000","last_peered":"2024-09-10T23:25:22.139490+0000","last_clean":"2024-09-10T23:25:22.139490+0000","last_became_active":"2024-09-10T23:24:05.881621+0000","last_became_peered":"2024-09-10T23:24:05.881621+0000","last_unstale":"2024-09-10T23:25:22.139490+0000","last_undegraded":"2024-09-10T23:25:22.139490+0000","last_fullsized":"2024-09-10T23:25:22.139490+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:23.468331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.165929+0000","last_change":"2024-09-10T23:23:57.834504+0000","last_active":"2024-09-10T23:26:21.165929+0000","last_peered":"2024-09-10T23:26:21.165929+0000","last_clean":"2024-09-10T23:26:21.165929+0000","last_became_active":"2024-09-10T23:23:57.834105+0000","last_became_peered":"2024-09-10T23:23:57.834105+0000","last_unstale":"2024-09-10T23:26:21.165929+0000","last_undegraded":"2024-09-10T23:26:21.165929+0000","last_fullsized":"2024-09-10T23:26:21.165929+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:03.539763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'6","reported_seq":166,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:41.462757+0000","last_change":"2024-09-10T23:23:54.796519+0000","last_active":"2024-09-10T23:26:41.462757+0000","last_peered":"2024-09-10T23:26:41.462757+0000","last_clean":"2024-09-10T23:26:41.462757+0000","last_became_active":"2024-09-10T23:23:54.795174+0000","last_became_peered":"2024-09-10T23:23:54.795174+0000","last_unstale":"2024-09-10T23:26:41.462757+0000","last_undegraded":"2024-09-10T23:26:41.462757+0000","last_fullsized":"2024-09-10T23:26:41.462757+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:53.622935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.140542+0000","last_change":"2024-09-10T23:24:05.884496+0000","last_active":"2024-09-10T23:25:22.140542+0000","last_peered":"2024-09-10T23:25:22.140542+0000","last_clean":"2024-09-10T23:25:22.140542+0000","last_became_active":"2024-09-10T23:24:05.883659+0000","last_became_peered":"2024-09-10T23:24:05.883659+0000","last_unstale":"2024-09-10T23:25:22.140542+0000","last_undegraded":"2024-09-10T23:25:22.140542+0000","last_fullsized":"2024-09-10T23:25:22.140542+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:23.449830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.172326+0000","last_change":"2024-09-10T23:23:57.842436+0000","last_active":"2024-09-10T23:26:21.172326+0000","last_peered":"2024-09-10T23:26:21.172326+0000","last_clean":"2024-09-10T23:26:21.172326+0000","last_became_active":"2024-09-10T23:23:57.842054+0000","last_became_peered":"2024-09-10T23:23:57.842054+0000","last_unstale":"2024-09-10T23:26:21.172326+0000","last_undegraded":"2024-09-10T23:26:21.172326+0000","last_fullsized":"2024-09-10T23:26:21.172326+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:07.234201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481636+0000","last_change":"2024-09-10T23:24:21.974615+0000","last_active":"2024-09-10T23:25:22.481636+0000","last_peered":"2024-09-10T23:25:22.481636+0000","last_clean":"2024-09-10T23:25:22.481636+0000","last_became_active":"2024-09-10T23:24:21.974129+0000","last_became_peered":"2024-09-10T23:24:21.974129+0000","last_unstale":"2024-09-10T23:25:22.481636+0000","last_undegraded":"2024-09-10T23:25:22.481636+0000","last_fullsized":"2024-09-10T23:25:22.481636+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:11.510005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.151991+0000","last_change":"2024-09-10T23:25:22.151288+0000","last_active":"2024-09-10T23:25:22.151991+0000","last_peered":"2024-09-10T23:25:22.151991+0000","last_clean":"2024-09-10T23:25:22.151991+0000","last_became_active":"2024-09-10T23:25:22.150800+0000","last_became_peered":"2024-09-10T23:25:22.150800+0000","last_unstale":"2024-09-10T23:25:22.151991+0000","last_undegraded":"2024-09-10T23:25:22.151991+0000","last_fullsized":"2024-09-10T23:25:22.151991+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:56.974242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.183481+0000","last_change":"2024-09-10T23:23:57.828722+0000","last_active":"2024-09-10T23:26:21.183481+0000","last_peered":"2024-09-10T23:26:21.183481+0000","last_clean":"2024-09-10T23:26:21.183481+0000","last_became_active":"2024-09-10T23:23:57.828373+0000","last_became_peered":"2024-09-10T23:23:57.828373+0000","last_unstale":"2024-09-10T23:26:21.183481+0000","last_undegraded":"2024-09-10T23:26:21.183481+0000","last_fullsized":"2024-09-10T23:26:21.183481+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:19.891684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147902+0000","last_change":"2024-09-10T23:23:54.789584+0000","last_active":"2024-09-10T23:25:22.147902+0000","last_peered":"2024-09-10T23:25:22.147902+0000","last_clean":"2024-09-10T23:25:22.147902+0000","last_became_active":"2024-09-10T23:23:54.789166+0000","last_became_peered":"2024-09-10T23:23:54.789166+0000","last_unstale":"2024-09-10T23:25:22.147902+0000","last_undegraded":"2024-09-10T23:25:22.147902+0000","last_fullsized":"2024-09-10T23:25:22.147902+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:02.292384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":121,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481682+0000","last_change":"2024-09-10T23:22:28.076475+0000","last_active":"2024-09-10T23:25:22.481682+0000","last_peered":"2024-09-10T23:25:22.481682+0000","last_clean":"2024-09-10T23:25:22.481682+0000","last_became_active":"2024-09-10T23:22:28.070622+0000","last_became_peered":"2024-09-10T23:22:28.070622+0000","last_unstale":"2024-09-10T23:25:22.481682+0000","last_undegraded":"2024-09-10T23:25:22.481682+0000","last_fullsized":"2024-09-10T23:25:22.481682+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:28.022462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:28.022462+0000","last_clean_scrub_stamp":"2024-09-10T23:18:28.022462+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:46:16.329399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481433+0000","last_change":"2024-09-10T23:24:05.884647+0000","last_active":"2024-09-10T23:25:22.481433+0000","last_peered":"2024-09-10T23:25:22.481433+0000","last_clean":"2024-09-10T23:25:22.481433+0000","last_became_active":"2024-09-10T23:24:05.883476+0000","last_became_peered":"2024-09-10T23:24:05.883476+0000","last_unstale":"2024-09-10T23:25:22.481433+0000","last_undegraded":"2024-09-10T23:25:22.481433+0000","last_fullsized":"2024-09-10T23:25:22.481433+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:02.524767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.185970+0000","last_change":"2024-09-10T23:23:57.840835+0000","last_active":"2024-09-10T23:26:21.185970+0000","last_peered":"2024-09-10T23:26:21.185970+0000","last_clean":"2024-09-10T23:26:21.185970+0000","last_became_active":"2024-09-10T23:23:57.840472+0000","last_became_peered":"2024-09-10T23:23:57.840472+0000","last_unstale":"2024-09-10T23:26:21.185970+0000","last_undegraded":"2024-09-10T23:26:21.185970+0000","last_fullsized":"2024-09-10T23:26:21.185970+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:18.050686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.141282+0000","last_change":"2024-09-10T23:23:55.081669+0000","last_active":"2024-09-10T23:25:22.141282+0000","last_peered":"2024-09-10T23:25:22.141282+0000","last_clean":"2024-09-10T23:25:22.141282+0000","last_became_active":"2024-09-10T23:23:55.081306+0000","last_became_peered":"2024-09-10T23:23:55.081306+0000","last_unstale":"2024-09-10T23:25:22.141282+0000","last_undegraded":"2024-09-10T23:25:22.141282+0000","last_fullsized":"2024-09-10T23:25:22.141282+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:54.968431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480541+0000","last_change":"2024-09-10T23:24:05.880876+0000","last_active":"2024-09-10T23:25:22.480541+0000","last_peered":"2024-09-10T23:25:22.480541+0000","last_clean":"2024-09-10T23:25:22.480541+0000","last_became_active":"2024-09-10T23:24:05.880504+0000","last_became_peered":"2024-09-10T23:24:05.880504+0000","last_unstale":"2024-09-10T23:25:22.480541+0000","last_undegraded":"2024-09-10T23:25:22.480541+0000","last_fullsized":"2024-09-10T23:25:22.480541+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:17:55.689134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.176096+0000","last_change":"2024-09-10T23:23:57.826637+0000","last_active":"2024-09-10T23:26:21.176096+0000","last_peered":"2024-09-10T23:26:21.176096+0000","last_clean":"2024-09-10T23:26:21.176096+0000","last_became_active":"2024-09-10T23:23:57.825915+0000","last_became_peered":"2024-09-10T23:23:57.825915+0000","last_unstale":"2024-09-10T23:26:21.176096+0000","last_undegraded":"2024-09-10T23:26:21.176096+0000","last_fullsized":"2024-09-10T23:26:21.176096+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:55.281687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.145150+0000","last_change":"2024-09-10T23:23:54.789847+0000","last_active":"2024-09-10T23:25:22.145150+0000","last_peered":"2024-09-10T23:25:22.145150+0000","last_clean":"2024-09-10T23:25:22.145150+0000","last_became_active":"2024-09-10T23:23:54.789082+0000","last_became_peered":"2024-09-10T23:23:54.789082+0000","last_unstale":"2024-09-10T23:25:22.145150+0000","last_undegraded":"2024-09-10T23:25:22.145150+0000","last_fullsized":"2024-09-10T23:25:22.145150+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:39:16.162317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.479783+0000","last_change":"2024-09-10T23:24:05.895799+0000","last_active":"2024-09-10T23:25:22.479783+0000","last_peered":"2024-09-10T23:25:22.479783+0000","last_clean":"2024-09-10T23:25:22.479783+0000","last_became_active":"2024-09-10T23:24:05.895361+0000","last_became_peered":"2024-09-10T23:24:05.895361+0000","last_unstale":"2024-09-10T23:25:22.479783+0000","last_undegraded":"2024-09-10T23:25:22.479783+0000","last_fullsized":"2024-09-10T23:25:22.479783+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:10.893000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.175415+0000","last_change":"2024-09-10T23:23:57.834954+0000","last_active":"2024-09-10T23:26:21.175415+0000","last_peered":"2024-09-10T23:26:21.175415+0000","last_clean":"2024-09-10T23:26:21.175415+0000","last_became_active":"2024-09-10T23:23:57.834215+0000","last_became_peered":"2024-09-10T23:23:57.834215+0000","last_unstale":"2024-09-10T23:26:21.175415+0000","last_undegraded":"2024-09-10T23:26:21.175415+0000","last_fullsized":"2024-09-10T23:26:21.175415+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:19:42.051352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.140302+0000","last_change":"2024-09-10T23:24:22.301029+0000","last_active":"2024-09-10T23:25:22.140302+0000","last_peered":"2024-09-10T23:25:22.140302+0000","last_clean":"2024-09-10T23:25:22.140302+0000","last_became_active":"2024-09-10T23:24:22.297759+0000","last_became_peered":"2024-09-10T23:24:22.297759+0000","last_unstale":"2024-09-10T23:25:22.140302+0000","last_undegraded":"2024-09-10T23:25:22.140302+0000","last_fullsized":"2024-09-10T23:25:22.140302+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:05.364737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.143459+0000","last_change":"2024-09-10T23:24:05.884172+0000","last_active":"2024-09-10T23:25:22.143459+0000","last_peered":"2024-09-10T23:25:22.143459+0000","last_clean":"2024-09-10T23:25:22.143459+0000","last_became_active":"2024-09-10T23:24:05.881918+0000","last_became_peered":"2024-09-10T23:24:05.881918+0000","last_unstale":"2024-09-10T23:25:22.143459+0000","last_undegraded":"2024-09-10T23:25:22.143459+0000","last_fullsized":"2024-09-10T23:25:22.143459+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:19:15.250926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.166507+0000","last_change":"2024-09-10T23:24:22.297163+0000","last_active":"2024-09-10T23:26:21.166507+0000","last_peered":"2024-09-10T23:26:21.166507+0000","last_clean":"2024-09-10T23:26:21.166507+0000","last_became_active":"2024-09-10T23:24:22.296751+0000","last_became_peered":"2024-09-10T23:24:22.296751+0000","last_unstale":"2024-09-10T23:26:21.166507+0000","last_undegraded":"2024-09-10T23:26:21.166507+0000","last_fullsized":"2024-09-10T23:26:21.166507+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:37:50.379101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.181518+0000","last_change":"2024-09-10T23:23:54.788008+0000","last_active":"2024-09-10T23:25:22.181518+0000","last_peered":"2024-09-10T23:25:22.181518+0000","last_clean":"2024-09-10T23:25:22.181518+0000","last_became_active":"2024-09-10T23:23:54.787702+0000","last_became_peered":"2024-09-10T23:23:54.787702+0000","last_unstale":"2024-09-10T23:25:22.181518+0000","last_undegraded":"2024-09-10T23:25:22.181518+0000","last_fullsized":"2024-09-10T23:25:22.181518+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:45.997467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144487+0000","last_change":"2024-09-10T23:24:05.887208+0000","last_active":"2024-09-10T23:25:22.144487+0000","last_peered":"2024-09-10T23:25:22.144487+0000","last_clean":"2024-09-10T23:25:22.144487+0000","last_became_active":"2024-09-10T23:24:05.885556+0000","last_became_peered":"2024-09-10T23:24:05.885556+0000","last_unstale":"2024-09-10T23:25:22.144487+0000","last_undegraded":"2024-09-10T23:25:22.144487+0000","last_fullsized":"2024-09-10T23:25:22.144487+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:21.843558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.171810+0000","last_change":"2024-09-10T23:23:57.842937+0000","last_active":"2024-09-10T23:26:21.171810+0000","last_peered":"2024-09-10T23:26:21.171810+0000","last_clean":"2024-09-10T23:26:21.171810+0000","last_became_active":"2024-09-10T23:23:57.842158+0000","last_became_peered":"2024-09-10T23:23:57.842158+0000","last_unstale":"2024-09-10T23:26:21.171810+0000","last_undegraded":"2024-09-10T23:26:21.171810+0000","last_fullsized":"2024-09-10T23:26:21.171810+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:49:58.716816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":62,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.181080+0000","last_change":"2024-09-10T23:23:54.787515+0000","last_active":"2024-09-10T23:25:22.181080+0000","last_peered":"2024-09-10T23:25:22.181080+0000","last_clean":"2024-09-10T23:25:22.181080+0000","last_became_active":"2024-09-10T23:23:54.786950+0000","last_became_peered":"2024-09-10T23:23:54.786950+0000","last_unstale":"2024-09-10T23:25:22.181080+0000","last_undegraded":"2024-09-10T23:25:22.181080+0000","last_fullsized":"2024-09-10T23:25:22.181080+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:12.546459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.140106+0000","last_change":"2024-09-10T23:24:05.882784+0000","last_active":"2024-09-10T23:25:22.140106+0000","last_peered":"2024-09-10T23:25:22.140106+0000","last_clean":"2024-09-10T23:25:22.140106+0000","last_became_active":"2024-09-10T23:24:05.882331+0000","last_became_peered":"2024-09-10T23:24:05.882331+0000","last_unstale":"2024-09-10T23:25:22.140106+0000","last_undegraded":"2024-09-10T23:25:22.140106+0000","last_fullsized":"2024-09-10T23:25:22.140106+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:51:42.519144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.164114+0000","last_change":"2024-09-10T23:23:57.827896+0000","last_active":"2024-09-10T23:26:21.164114+0000","last_peered":"2024-09-10T23:26:21.164114+0000","last_clean":"2024-09-10T23:26:21.164114+0000","last_became_active":"2024-09-10T23:23:57.827572+0000","last_became_peered":"2024-09-10T23:23:57.827572+0000","last_unstale":"2024-09-10T23:26:21.164114+0000","last_undegraded":"2024-09-10T23:26:21.164114+0000","last_fullsized":"2024-09-10T23:26:21.164114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:11.126594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'7","reported_seq":172,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:42.465987+0000","last_change":"2024-09-10T23:23:54.795582+0000","last_active":"2024-09-10T23:26:42.465987+0000","last_peered":"2024-09-10T23:26:42.465987+0000","last_clean":"2024-09-10T23:26:42.465987+0000","last_became_active":"2024-09-10T23:23:54.795225+0000","last_became_peered":"2024-09-10T23:23:54.795225+0000","last_unstale":"2024-09-10T23:26:42.465987+0000","last_undegraded":"2024-09-10T23:26:42.465987+0000","last_fullsized":"2024-09-10T23:26:42.465987+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:11.827090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2004,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":6,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.483416+0000","last_change":"2024-09-10T23:25:22.483250+0000","last_active":"2024-09-10T23:25:22.483416+0000","last_peered":"2024-09-10T23:25:22.483416+0000","last_clean":"2024-09-10T23:25:22.483416+0000","last_became_active":"2024-09-10T23:25:22.482721+0000","last_became_peered":"2024-09-10T23:25:22.482721+0000","last_unstale":"2024-09-10T23:25:22.483416+0000","last_undegraded":"2024-09-10T23:25:22.483416+0000","last_fullsized":"2024-09-10T23:25:22.483416+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:41:31.732139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,7,0,3],"acting":[10,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.183006+0000","last_change":"2024-09-10T23:23:57.843899+0000","last_active":"2024-09-10T23:26:21.183006+0000","last_peered":"2024-09-10T23:26:21.183006+0000","last_clean":"2024-09-10T23:26:21.183006+0000","last_became_active":"2024-09-10T23:23:57.843590+0000","last_became_peered":"2024-09-10T23:23:57.843590+0000","last_unstale":"2024-09-10T23:26:21.183006+0000","last_undegraded":"2024-09-10T23:26:21.183006+0000","last_fullsized":"2024-09-10T23:26:21.183006+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:32:17.919904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144414+0000","last_change":"2024-09-10T23:23:54.795091+0000","last_active":"2024-09-10T23:25:22.144414+0000","last_peered":"2024-09-10T23:25:22.144414+0000","last_clean":"2024-09-10T23:25:22.144414+0000","last_became_active":"2024-09-10T23:23:54.794726+0000","last_became_peered":"2024-09-10T23:23:54.794726+0000","last_unstale":"2024-09-10T23:25:22.144414+0000","last_undegraded":"2024-09-10T23:25:22.144414+0000","last_fullsized":"2024-09-10T23:25:22.144414+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:56:20.322532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.483962+0000","last_change":"2024-09-10T23:25:22.483252+0000","last_active":"2024-09-10T23:25:22.483962+0000","last_peered":"2024-09-10T23:25:22.483962+0000","last_clean":"2024-09-10T23:25:22.483962+0000","last_became_active":"2024-09-10T23:25:22.482719+0000","last_became_peered":"2024-09-10T23:25:22.482719+0000","last_unstale":"2024-09-10T23:25:22.483962+0000","last_undegraded":"2024-09-10T23:25:22.483962+0000","last_fullsized":"2024-09-10T23:25:22.483962+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:36.281256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.166862+0000","last_change":"2024-09-10T23:23:57.823729+0000","last_active":"2024-09-10T23:26:21.166862+0000","last_peered":"2024-09-10T23:26:21.166862+0000","last_clean":"2024-09-10T23:26:21.166862+0000","last_became_active":"2024-09-10T23:23:57.822797+0000","last_became_peered":"2024-09-10T23:23:57.822797+0000","last_unstale":"2024-09-10T23:26:21.166862+0000","last_undegraded":"2024-09-10T23:26:21.166862+0000","last_fullsized":"2024-09-10T23:26:21.166862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:09.646543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.141932+0000","last_change":"2024-09-10T23:24:21.985389+0000","last_active":"2024-09-10T23:25:22.141932+0000","last_peered":"2024-09-10T23:25:22.141932+0000","last_clean":"2024-09-10T23:25:22.141932+0000","last_became_active":"2024-09-10T23:24:21.976084+0000","last_became_peered":"2024-09-10T23:24:21.976084+0000","last_unstale":"2024-09-10T23:25:22.141932+0000","last_undegraded":"2024-09-10T23:25:22.141932+0000","last_fullsized":"2024-09-10T23:25:22.141932+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:33.284211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144976+0000","last_change":"2024-09-10T23:24:05.890656+0000","last_active":"2024-09-10T23:25:22.144976+0000","last_peered":"2024-09-10T23:25:22.144976+0000","last_clean":"2024-09-10T23:25:22.144976+0000","last_became_active":"2024-09-10T23:24:05.889827+0000","last_became_peered":"2024-09-10T23:24:05.889827+0000","last_unstale":"2024-09-10T23:25:22.144976+0000","last_undegraded":"2024-09-10T23:25:22.144976+0000","last_fullsized":"2024-09-10T23:25:22.144976+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:15.301567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.170882+0000","last_change":"2024-09-10T23:23:57.827348+0000","last_active":"2024-09-10T23:26:21.170882+0000","last_peered":"2024-09-10T23:26:21.170882+0000","last_clean":"2024-09-10T23:26:21.170882+0000","last_became_active":"2024-09-10T23:23:57.826670+0000","last_became_peered":"2024-09-10T23:23:57.826670+0000","last_unstale":"2024-09-10T23:26:21.170882+0000","last_undegraded":"2024-09-10T23:26:21.170882+0000","last_fullsized":"2024-09-10T23:26:21.170882+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:19.268930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'38","reported_seq":331,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:46.454902+0000","last_change":"2024-09-10T23:23:54.789603+0000","last_active":"2024-09-10T23:26:46.454902+0000","last_peered":"2024-09-10T23:26:46.454902+0000","last_clean":"2024-09-10T23:26:46.454902+0000","last_became_active":"2024-09-10T23:23:54.789136+0000","last_became_peered":"2024-09-10T23:23:54.789136+0000","last_unstale":"2024-09-10T23:26:46.454902+0000","last_undegraded":"2024-09-10T23:26:46.454902+0000","last_fullsized":"2024-09-10T23:26:46.454902+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:47.648232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69486,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":247,"num_read_kb":191,"num_write":39,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144524+0000","last_change":"2024-09-10T23:24:05.883758+0000","last_active":"2024-09-10T23:25:22.144524+0000","last_peered":"2024-09-10T23:25:22.144524+0000","last_clean":"2024-09-10T23:25:22.144524+0000","last_became_active":"2024-09-10T23:24:05.883401+0000","last_became_peered":"2024-09-10T23:24:05.883401+0000","last_unstale":"2024-09-10T23:25:22.144524+0000","last_undegraded":"2024-09-10T23:25:22.144524+0000","last_fullsized":"2024-09-10T23:25:22.144524+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:52.862088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.189152+0000","last_change":"2024-09-10T23:23:57.846524+0000","last_active":"2024-09-10T23:26:21.189152+0000","last_peered":"2024-09-10T23:26:21.189152+0000","last_clean":"2024-09-10T23:26:21.189152+0000","last_became_active":"2024-09-10T23:23:57.846036+0000","last_became_peered":"2024-09-10T23:23:57.846036+0000","last_unstale":"2024-09-10T23:26:21.189152+0000","last_undegraded":"2024-09-10T23:26:21.189152+0000","last_fullsized":"2024-09-10T23:26:21.189152+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:13.866827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.145163+0000","last_change":"2024-09-10T23:23:54.789925+0000","last_active":"2024-09-10T23:25:22.145163+0000","last_peered":"2024-09-10T23:25:22.145163+0000","last_clean":"2024-09-10T23:25:22.145163+0000","last_became_active":"2024-09-10T23:23:54.789600+0000","last_became_peered":"2024-09-10T23:23:54.789600+0000","last_unstale":"2024-09-10T23:25:22.145163+0000","last_undegraded":"2024-09-10T23:25:22.145163+0000","last_fullsized":"2024-09-10T23:25:22.145163+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:54.937422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147724+0000","last_change":"2024-09-10T23:24:05.882530+0000","last_active":"2024-09-10T23:25:22.147724+0000","last_peered":"2024-09-10T23:25:22.147724+0000","last_clean":"2024-09-10T23:25:22.147724+0000","last_became_active":"2024-09-10T23:24:05.881092+0000","last_became_peered":"2024-09-10T23:24:05.881092+0000","last_unstale":"2024-09-10T23:25:22.147724+0000","last_undegraded":"2024-09-10T23:25:22.147724+0000","last_fullsized":"2024-09-10T23:25:22.147724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:54.954300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.168450+0000","last_change":"2024-09-10T23:23:57.837341+0000","last_active":"2024-09-10T23:26:21.168450+0000","last_peered":"2024-09-10T23:26:21.168450+0000","last_clean":"2024-09-10T23:26:21.168450+0000","last_became_active":"2024-09-10T23:23:57.837024+0000","last_became_peered":"2024-09-10T23:23:57.837024+0000","last_unstale":"2024-09-10T23:26:21.168450+0000","last_undegraded":"2024-09-10T23:26:21.168450+0000","last_fullsized":"2024-09-10T23:26:21.168450+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:22:48.241471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481409+0000","last_change":"2024-09-10T23:23:54.792028+0000","last_active":"2024-09-10T23:25:22.481409+0000","last_peered":"2024-09-10T23:25:22.481409+0000","last_clean":"2024-09-10T23:25:22.481409+0000","last_became_active":"2024-09-10T23:23:54.791589+0000","last_became_peered":"2024-09-10T23:23:54.791589+0000","last_unstale":"2024-09-10T23:25:22.481409+0000","last_undegraded":"2024-09-10T23:25:22.481409+0000","last_fullsized":"2024-09-10T23:25:22.481409+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:48.589441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144216+0000","last_change":"2024-09-10T23:24:05.888627+0000","last_active":"2024-09-10T23:25:22.144216+0000","last_peered":"2024-09-10T23:25:22.144216+0000","last_clean":"2024-09-10T23:25:22.144216+0000","last_became_active":"2024-09-10T23:24:05.887925+0000","last_became_peered":"2024-09-10T23:24:05.887925+0000","last_unstale":"2024-09-10T23:25:22.144216+0000","last_undegraded":"2024-09-10T23:25:22.144216+0000","last_fullsized":"2024-09-10T23:25:22.144216+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:15.956333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.188813+0000","last_change":"2024-09-10T23:23:57.833009+0000","last_active":"2024-09-10T23:26:21.188813+0000","last_peered":"2024-09-10T23:26:21.188813+0000","last_clean":"2024-09-10T23:26:21.188813+0000","last_became_active":"2024-09-10T23:23:57.830782+0000","last_became_peered":"2024-09-10T23:23:57.830782+0000","last_unstale":"2024-09-10T23:26:21.188813+0000","last_undegraded":"2024-09-10T23:26:21.188813+0000","last_fullsized":"2024-09-10T23:26:21.188813+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:42.520461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"90'4","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:45.452664+0000","last_change":"2024-09-10T23:23:54.789322+0000","last_active":"2024-09-10T23:26:45.452664+0000","last_peered":"2024-09-10T23:26:45.452664+0000","last_clean":"2024-09-10T23:26:45.452664+0000","last_became_active":"2024-09-10T23:23:54.788879+0000","last_became_peered":"2024-09-10T23:23:54.788879+0000","last_unstale":"2024-09-10T23:26:45.452664+0000","last_undegraded":"2024-09-10T23:26:45.452664+0000","last_fullsized":"2024-09-10T23:26:45.452664+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:37.276413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480177+0000","last_change":"2024-09-10T23:24:05.886626+0000","last_active":"2024-09-10T23:25:22.480177+0000","last_peered":"2024-09-10T23:25:22.480177+0000","last_clean":"2024-09-10T23:25:22.480177+0000","last_became_active":"2024-09-10T23:24:05.886076+0000","last_became_peered":"2024-09-10T23:24:05.886076+0000","last_unstale":"2024-09-10T23:25:22.480177+0000","last_undegraded":"2024-09-10T23:25:22.480177+0000","last_fullsized":"2024-09-10T23:25:22.480177+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:44.987664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480182+0000","last_change":"2024-09-10T23:24:05.891242+0000","last_active":"2024-09-10T23:25:22.480182+0000","last_peered":"2024-09-10T23:25:22.480182+0000","last_clean":"2024-09-10T23:25:22.480182+0000","last_became_active":"2024-09-10T23:24:05.889513+0000","last_became_peered":"2024-09-10T23:24:05.889513+0000","last_unstale":"2024-09-10T23:25:22.480182+0000","last_undegraded":"2024-09-10T23:25:22.480182+0000","last_fullsized":"2024-09-10T23:25:22.480182+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:07.774304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.176320+0000","last_change":"2024-09-10T23:23:57.831698+0000","last_active":"2024-09-10T23:26:21.176320+0000","last_peered":"2024-09-10T23:26:21.176320+0000","last_clean":"2024-09-10T23:26:21.176320+0000","last_became_active":"2024-09-10T23:23:57.829348+0000","last_became_peered":"2024-09-10T23:23:57.829348+0000","last_unstale":"2024-09-10T23:26:21.176320+0000","last_undegraded":"2024-09-10T23:26:21.176320+0000","last_fullsized":"2024-09-10T23:26:21.176320+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:09.636786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.143717+0000","last_change":"2024-09-10T23:23:54.795380+0000","last_active":"2024-09-10T23:25:22.143717+0000","last_peered":"2024-09-10T23:25:22.143717+0000","last_clean":"2024-09-10T23:25:22.143717+0000","last_became_active":"2024-09-10T23:23:54.794465+0000","last_became_peered":"2024-09-10T23:23:54.794465+0000","last_unstale":"2024-09-10T23:25:22.143717+0000","last_undegraded":"2024-09-10T23:25:22.143717+0000","last_fullsized":"2024-09-10T23:25:22.143717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:32.082020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.142451+0000","last_change":"2024-09-10T23:24:05.886531+0000","last_active":"2024-09-10T23:25:22.142451+0000","last_peered":"2024-09-10T23:25:22.142451+0000","last_clean":"2024-09-10T23:25:22.142451+0000","last_became_active":"2024-09-10T23:24:05.885762+0000","last_became_peered":"2024-09-10T23:24:05.885762+0000","last_unstale":"2024-09-10T23:25:22.142451+0000","last_undegraded":"2024-09-10T23:25:22.142451+0000","last_fullsized":"2024-09-10T23:25:22.142451+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:35.407364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.170969+0000","last_change":"2024-09-10T23:23:57.828052+0000","last_active":"2024-09-10T23:26:21.170969+0000","last_peered":"2024-09-10T23:26:21.170969+0000","last_clean":"2024-09-10T23:26:21.170969+0000","last_became_active":"2024-09-10T23:23:57.827653+0000","last_became_peered":"2024-09-10T23:23:57.827653+0000","last_unstale":"2024-09-10T23:26:21.170969+0000","last_undegraded":"2024-09-10T23:26:21.170969+0000","last_fullsized":"2024-09-10T23:26:21.170969+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:33.605054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.139104+0000","last_change":"2024-09-10T23:23:54.791375+0000","last_active":"2024-09-10T23:25:22.139104+0000","last_peered":"2024-09-10T23:25:22.139104+0000","last_clean":"2024-09-10T23:25:22.139104+0000","last_became_active":"2024-09-10T23:23:54.790974+0000","last_became_peered":"2024-09-10T23:23:54.790974+0000","last_unstale":"2024-09-10T23:25:22.139104+0000","last_undegraded":"2024-09-10T23:25:22.139104+0000","last_fullsized":"2024-09-10T23:25:22.139104+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:23:44.066787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.149326+0000","last_change":"2024-09-10T23:23:54.792056+0000","last_active":"2024-09-10T23:25:22.149326+0000","last_peered":"2024-09-10T23:25:22.149326+0000","last_clean":"2024-09-10T23:25:22.149326+0000","last_became_active":"2024-09-10T23:23:54.791665+0000","last_became_peered":"2024-09-10T23:23:54.791665+0000","last_unstale":"2024-09-10T23:25:22.149326+0000","last_undegraded":"2024-09-10T23:25:22.149326+0000","last_fullsized":"2024-09-10T23:25:22.149326+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:34:38.517066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.167402+0000","last_change":"2024-09-10T23:23:57.842524+0000","last_active":"2024-09-10T23:26:21.167402+0000","last_peered":"2024-09-10T23:26:21.167402+0000","last_clean":"2024-09-10T23:26:21.167402+0000","last_became_active":"2024-09-10T23:23:57.842033+0000","last_became_peered":"2024-09-10T23:23:57.842033+0000","last_unstale":"2024-09-10T23:26:21.167402+0000","last_undegraded":"2024-09-10T23:26:21.167402+0000","last_fullsized":"2024-09-10T23:26:21.167402+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:39.431115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.140947+0000","last_change":"2024-09-10T23:24:05.891676+0000","last_active":"2024-09-10T23:25:22.140947+0000","last_peered":"2024-09-10T23:25:22.140947+0000","last_clean":"2024-09-10T23:25:22.140947+0000","last_became_active":"2024-09-10T23:24:05.891224+0000","last_became_peered":"2024-09-10T23:24:05.891224+0000","last_unstale":"2024-09-10T23:25:22.140947+0000","last_undegraded":"2024-09-10T23:25:22.140947+0000","last_fullsized":"2024-09-10T23:25:22.140947+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:16:50.384745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'6","reported_seq":169,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:41.446077+0000","last_change":"2024-09-10T23:23:54.795126+0000","last_active":"2024-09-10T23:26:41.446077+0000","last_peered":"2024-09-10T23:26:41.446077+0000","last_clean":"2024-09-10T23:26:41.446077+0000","last_became_active":"2024-09-10T23:23:54.794553+0000","last_became_peered":"2024-09-10T23:23:54.794553+0000","last_unstale":"2024-09-10T23:26:41.446077+0000","last_undegraded":"2024-09-10T23:26:41.446077+0000","last_fullsized":"2024-09-10T23:26:41.446077+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:15:43.181180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1115,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.166101+0000","last_change":"2024-09-10T23:23:57.826827+0000","last_active":"2024-09-10T23:26:21.166101+0000","last_peered":"2024-09-10T23:26:21.166101+0000","last_clean":"2024-09-10T23:26:21.166101+0000","last_became_active":"2024-09-10T23:23:57.826457+0000","last_became_peered":"2024-09-10T23:23:57.826457+0000","last_unstale":"2024-09-10T23:26:21.166101+0000","last_undegraded":"2024-09-10T23:26:21.166101+0000","last_fullsized":"2024-09-10T23:26:21.166101+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:13.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.141368+0000","last_change":"2024-09-10T23:24:05.888774+0000","last_active":"2024-09-10T23:25:22.141368+0000","last_peered":"2024-09-10T23:25:22.141368+0000","last_clean":"2024-09-10T23:25:22.141368+0000","last_became_active":"2024-09-10T23:24:05.888267+0000","last_became_peered":"2024-09-10T23:24:05.888267+0000","last_unstale":"2024-09-10T23:25:22.141368+0000","last_undegraded":"2024-09-10T23:25:22.141368+0000","last_fullsized":"2024-09-10T23:25:22.141368+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:29.283509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.161996+0000","last_change":"2024-09-10T23:23:57.819178+0000","last_active":"2024-09-10T23:26:21.161996+0000","last_peered":"2024-09-10T23:26:21.161996+0000","last_clean":"2024-09-10T23:26:21.161996+0000","last_became_active":"2024-09-10T23:23:57.817029+0000","last_became_peered":"2024-09-10T23:23:57.817029+0000","last_unstale":"2024-09-10T23:26:21.161996+0000","last_undegraded":"2024-09-10T23:26:21.161996+0000","last_fullsized":"2024-09-10T23:26:21.161996+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:28:51.491402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.172379+0000","last_change":"2024-09-10T23:24:21.978215+0000","last_active":"2024-09-10T23:26:21.172379+0000","last_peered":"2024-09-10T23:26:21.172379+0000","last_clean":"2024-09-10T23:26:21.172379+0000","last_became_active":"2024-09-10T23:24:21.977811+0000","last_became_peered":"2024-09-10T23:24:21.977811+0000","last_unstale":"2024-09-10T23:26:21.172379+0000","last_undegraded":"2024-09-10T23:26:21.172379+0000","last_fullsized":"2024-09-10T23:26:21.172379+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:41.769216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.164810+0000","last_change":"2024-09-10T23:23:57.824147+0000","last_active":"2024-09-10T23:26:21.164810+0000","last_peered":"2024-09-10T23:26:21.164810+0000","last_clean":"2024-09-10T23:26:21.164810+0000","last_became_active":"2024-09-10T23:23:57.823503+0000","last_became_peered":"2024-09-10T23:23:57.823503+0000","last_unstale":"2024-09-10T23:26:21.164810+0000","last_undegraded":"2024-09-10T23:26:21.164810+0000","last_fullsized":"2024-09-10T23:26:21.164810+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:12:34.310648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.178151+0000","last_change":"2024-09-10T23:23:57.841413+0000","last_active":"2024-09-10T23:26:21.178151+0000","last_peered":"2024-09-10T23:26:21.178151+0000","last_clean":"2024-09-10T23:26:21.178151+0000","last_became_active":"2024-09-10T23:23:57.840889+0000","last_became_peered":"2024-09-10T23:23:57.840889+0000","last_unstale":"2024-09-10T23:26:21.178151+0000","last_undegraded":"2024-09-10T23:26:21.178151+0000","last_fullsized":"2024-09-10T23:26:21.178151+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:10:08.757628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.173077+0000","last_change":"2024-09-10T23:23:57.837267+0000","last_active":"2024-09-10T23:26:21.173077+0000","last_peered":"2024-09-10T23:26:21.173077+0000","last_clean":"2024-09-10T23:26:21.173077+0000","last_became_active":"2024-09-10T23:23:57.836911+0000","last_became_peered":"2024-09-10T23:23:57.836911+0000","last_unstale":"2024-09-10T23:26:21.173077+0000","last_undegraded":"2024-09-10T23:26:21.173077+0000","last_fullsized":"2024-09-10T23:26:21.173077+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:24.969215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.165488+0000","last_change":"2024-09-10T23:23:57.813855+0000","last_active":"2024-09-10T23:26:21.165488+0000","last_peered":"2024-09-10T23:26:21.165488+0000","last_clean":"2024-09-10T23:26:21.165488+0000","last_became_active":"2024-09-10T23:23:57.812862+0000","last_became_peered":"2024-09-10T23:23:57.812862+0000","last_unstale":"2024-09-10T23:26:21.165488+0000","last_undegraded":"2024-09-10T23:26:21.165488+0000","last_fullsized":"2024-09-10T23:26:21.165488+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:21.542499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.184491+0000","last_change":"2024-09-10T23:23:57.826082+0000","last_active":"2024-09-10T23:26:21.184491+0000","last_peered":"2024-09-10T23:26:21.184491+0000","last_clean":"2024-09-10T23:26:21.184491+0000","last_became_active":"2024-09-10T23:23:57.825695+0000","last_became_peered":"2024-09-10T23:23:57.825695+0000","last_unstale":"2024-09-10T23:26:21.184491+0000","last_undegraded":"2024-09-10T23:26:21.184491+0000","last_fullsized":"2024-09-10T23:26:21.184491+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:08.518084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.157077+0000","last_change":"2024-09-10T23:23:57.835147+0000","last_active":"2024-09-10T23:26:21.157077+0000","last_peered":"2024-09-10T23:26:21.157077+0000","last_clean":"2024-09-10T23:26:21.157077+0000","last_became_active":"2024-09-10T23:23:57.834739+0000","last_became_peered":"2024-09-10T23:23:57.834739+0000","last_unstale":"2024-09-10T23:26:21.157077+0000","last_undegraded":"2024-09-10T23:26:21.157077+0000","last_fullsized":"2024-09-10T23:26:21.157077+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:06:27.023088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.164735+0000","last_change":"2024-09-10T23:23:57.825996+0000","last_active":"2024-09-10T23:26:21.164735+0000","last_peered":"2024-09-10T23:26:21.164735+0000","last_clean":"2024-09-10T23:26:21.164735+0000","last_became_active":"2024-09-10T23:23:57.824168+0000","last_became_peered":"2024-09-10T23:23:57.824168+0000","last_unstale":"2024-09-10T23:26:21.164735+0000","last_undegraded":"2024-09-10T23:26:21.164735+0000","last_fullsized":"2024-09-10T23:26:21.164735+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:36.396179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.166612+0000","last_change":"2024-09-10T23:24:21.976841+0000","last_active":"2024-09-10T23:26:21.166612+0000","last_peered":"2024-09-10T23:26:21.166612+0000","last_clean":"2024-09-10T23:26:21.166612+0000","last_became_active":"2024-09-10T23:24:21.976461+0000","last_became_peered":"2024-09-10T23:24:21.976461+0000","last_unstale":"2024-09-10T23:26:21.166612+0000","last_undegraded":"2024-09-10T23:26:21.166612+0000","last_fullsized":"2024-09-10T23:26:21.166612+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:04:00.000274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.182479+0000","last_change":"2024-09-10T23:23:57.840477+0000","last_active":"2024-09-10T23:26:21.182479+0000","last_peered":"2024-09-10T23:26:21.182479+0000","last_clean":"2024-09-10T23:26:21.182479+0000","last_became_active":"2024-09-10T23:23:57.840113+0000","last_became_peered":"2024-09-10T23:23:57.840113+0000","last_unstale":"2024-09-10T23:26:21.182479+0000","last_undegraded":"2024-09-10T23:26:21.182479+0000","last_fullsized":"2024-09-10T23:26:21.182479+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:27:23.913802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.180371+0000","last_change":"2024-09-10T23:23:57.837416+0000","last_active":"2024-09-10T23:26:21.180371+0000","last_peered":"2024-09-10T23:26:21.180371+0000","last_clean":"2024-09-10T23:26:21.180371+0000","last_became_active":"2024-09-10T23:23:57.837104+0000","last_became_peered":"2024-09-10T23:23:57.837104+0000","last_unstale":"2024-09-10T23:26:21.180371+0000","last_undegraded":"2024-09-10T23:26:21.180371+0000","last_fullsized":"2024-09-10T23:26:21.180371+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:00.712148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.166773+0000","last_change":"2024-09-10T23:23:57.838304+0000","last_active":"2024-09-10T23:26:21.166773+0000","last_peered":"2024-09-10T23:26:21.166773+0000","last_clean":"2024-09-10T23:26:21.166773+0000","last_became_active":"2024-09-10T23:23:57.837677+0000","last_became_peered":"2024-09-10T23:23:57.837677+0000","last_unstale":"2024-09-10T23:26:21.166773+0000","last_undegraded":"2024-09-10T23:26:21.166773+0000","last_fullsized":"2024-09-10T23:26:21.166773+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:40.862950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.166514+0000","last_change":"2024-09-10T23:23:57.825579+0000","last_active":"2024-09-10T23:26:21.166514+0000","last_peered":"2024-09-10T23:26:21.166514+0000","last_clean":"2024-09-10T23:26:21.166514+0000","last_became_active":"2024-09-10T23:23:57.824840+0000","last_became_peered":"2024-09-10T23:23:57.824840+0000","last_unstale":"2024-09-10T23:26:21.166514+0000","last_undegraded":"2024-09-10T23:26:21.166514+0000","last_fullsized":"2024-09-10T23:26:21.166514+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:53:35.150858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.181556+0000","last_change":"2024-09-10T23:23:57.833479+0000","last_active":"2024-09-10T23:26:21.181556+0000","last_peered":"2024-09-10T23:26:21.181556+0000","last_clean":"2024-09-10T23:26:21.181556+0000","last_became_active":"2024-09-10T23:23:57.833124+0000","last_became_peered":"2024-09-10T23:23:57.833124+0000","last_unstale":"2024-09-10T23:26:21.181556+0000","last_undegraded":"2024-09-10T23:26:21.181556+0000","last_fullsized":"2024-09-10T23:26:21.181556+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:02.869308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.185986+0000","last_change":"2024-09-10T23:23:57.831610+0000","last_active":"2024-09-10T23:26:21.185986+0000","last_peered":"2024-09-10T23:26:21.185986+0000","last_clean":"2024-09-10T23:26:21.185986+0000","last_became_active":"2024-09-10T23:23:57.831227+0000","last_became_peered":"2024-09-10T23:23:57.831227+0000","last_unstale":"2024-09-10T23:26:21.185986+0000","last_undegraded":"2024-09-10T23:26:21.185986+0000","last_fullsized":"2024-09-10T23:26:21.185986+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:45.735286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.180683+0000","last_change":"2024-09-10T23:23:57.839295+0000","last_active":"2024-09-10T23:26:21.180683+0000","last_peered":"2024-09-10T23:26:21.180683+0000","last_clean":"2024-09-10T23:26:21.180683+0000","last_became_active":"2024-09-10T23:23:57.838857+0000","last_became_peered":"2024-09-10T23:23:57.838857+0000","last_unstale":"2024-09-10T23:26:21.180683+0000","last_undegraded":"2024-09-10T23:26:21.180683+0000","last_fullsized":"2024-09-10T23:26:21.180683+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:20:13.203324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.165534+0000","last_change":"2024-09-10T23:23:57.841459+0000","last_active":"2024-09-10T23:26:21.165534+0000","last_peered":"2024-09-10T23:26:21.165534+0000","last_clean":"2024-09-10T23:26:21.165534+0000","last_became_active":"2024-09-10T23:23:57.841049+0000","last_became_peered":"2024-09-10T23:23:57.841049+0000","last_unstale":"2024-09-10T23:26:21.165534+0000","last_undegraded":"2024-09-10T23:26:21.165534+0000","last_fullsized":"2024-09-10T23:26:21.165534+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:39:51.372657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.164155+0000","last_change":"2024-09-10T23:23:57.813028+0000","last_active":"2024-09-10T23:26:21.164155+0000","last_peered":"2024-09-10T23:26:21.164155+0000","last_clean":"2024-09-10T23:26:21.164155+0000","last_became_active":"2024-09-10T23:23:57.812648+0000","last_became_peered":"2024-09-10T23:23:57.812648+0000","last_unstale":"2024-09-10T23:26:21.164155+0000","last_undegraded":"2024-09-10T23:26:21.164155+0000","last_fullsized":"2024-09-10T23:26:21.164155+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:57.691811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.179739+0000","last_change":"2024-09-10T23:23:57.814467+0000","last_active":"2024-09-10T23:26:21.179739+0000","last_peered":"2024-09-10T23:26:21.179739+0000","last_clean":"2024-09-10T23:26:21.179739+0000","last_became_active":"2024-09-10T23:23:57.812286+0000","last_became_peered":"2024-09-10T23:23:57.812286+0000","last_unstale":"2024-09-10T23:26:21.179739+0000","last_undegraded":"2024-09-10T23:26:21.179739+0000","last_fullsized":"2024-09-10T23:26:21.179739+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:42.044495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.171818+0000","last_change":"2024-09-10T23:23:57.834679+0000","last_active":"2024-09-10T23:26:21.171818+0000","last_peered":"2024-09-10T23:26:21.171818+0000","last_clean":"2024-09-10T23:26:21.171818+0000","last_became_active":"2024-09-10T23:23:57.833964+0000","last_became_peered":"2024-09-10T23:23:57.833964+0000","last_unstale":"2024-09-10T23:26:21.171818+0000","last_undegraded":"2024-09-10T23:26:21.171818+0000","last_fullsized":"2024-09-10T23:26:21.171818+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:29.160280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.187632+0000","last_change":"2024-09-10T23:23:57.840788+0000","last_active":"2024-09-10T23:26:21.187632+0000","last_peered":"2024-09-10T23:26:21.187632+0000","last_clean":"2024-09-10T23:26:21.187632+0000","last_became_active":"2024-09-10T23:23:57.839946+0000","last_became_peered":"2024-09-10T23:23:57.839946+0000","last_unstale":"2024-09-10T23:26:21.187632+0000","last_undegraded":"2024-09-10T23:26:21.187632+0000","last_fullsized":"2024-09-10T23:26:21.187632+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:14.354925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.173950+0000","last_change":"2024-09-10T23:23:57.843454+0000","last_active":"2024-09-10T23:26:21.173950+0000","last_peered":"2024-09-10T23:26:21.173950+0000","last_clean":"2024-09-10T23:26:21.173950+0000","last_became_active":"2024-09-10T23:23:57.841623+0000","last_became_peered":"2024-09-10T23:23:57.841623+0000","last_unstale":"2024-09-10T23:26:21.173950+0000","last_undegraded":"2024-09-10T23:26:21.173950+0000","last_fullsized":"2024-09-10T23:26:21.173950+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:03:03.957444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.174992+0000","last_change":"2024-09-10T23:23:57.834196+0000","last_active":"2024-09-10T23:26:21.174992+0000","last_peered":"2024-09-10T23:26:21.174992+0000","last_clean":"2024-09-10T23:26:21.174992+0000","last_became_active":"2024-09-10T23:23:57.833692+0000","last_became_peered":"2024-09-10T23:23:57.833692+0000","last_unstale":"2024-09-10T23:26:21.174992+0000","last_undegraded":"2024-09-10T23:26:21.174992+0000","last_fullsized":"2024-09-10T23:26:21.174992+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:49.814475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.171348+0000","last_change":"2024-09-10T23:23:57.831457+0000","last_active":"2024-09-10T23:26:21.171348+0000","last_peered":"2024-09-10T23:26:21.171348+0000","last_clean":"2024-09-10T23:26:21.171348+0000","last_became_active":"2024-09-10T23:23:57.829686+0000","last_became_peered":"2024-09-10T23:23:57.829686+0000","last_unstale":"2024-09-10T23:26:21.171348+0000","last_undegraded":"2024-09-10T23:26:21.171348+0000","last_fullsized":"2024-09-10T23:26:21.171348+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:39.204501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.177997+0000","last_change":"2024-09-10T23:23:57.829437+0000","last_active":"2024-09-10T23:26:21.177997+0000","last_peered":"2024-09-10T23:26:21.177997+0000","last_clean":"2024-09-10T23:26:21.177997+0000","last_became_active":"2024-09-10T23:23:57.828956+0000","last_became_peered":"2024-09-10T23:23:57.828956+0000","last_unstale":"2024-09-10T23:26:21.177997+0000","last_undegraded":"2024-09-10T23:26:21.177997+0000","last_fullsized":"2024-09-10T23:26:21.177997+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:18.191002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.175037+0000","last_change":"2024-09-10T23:23:57.839661+0000","last_active":"2024-09-10T23:26:21.175037+0000","last_peered":"2024-09-10T23:26:21.175037+0000","last_clean":"2024-09-10T23:26:21.175037+0000","last_became_active":"2024-09-10T23:23:57.839197+0000","last_became_peered":"2024-09-10T23:23:57.839197+0000","last_unstale":"2024-09-10T23:26:21.175037+0000","last_undegraded":"2024-09-10T23:26:21.175037+0000","last_fullsized":"2024-09-10T23:26:21.175037+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:33.599860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.176613+0000","last_change":"2024-09-10T23:23:57.820968+0000","last_active":"2024-09-10T23:26:21.176613+0000","last_peered":"2024-09-10T23:26:21.176613+0000","last_clean":"2024-09-10T23:26:21.176613+0000","last_became_active":"2024-09-10T23:23:57.820108+0000","last_became_peered":"2024-09-10T23:23:57.820108+0000","last_unstale":"2024-09-10T23:26:21.176613+0000","last_undegraded":"2024-09-10T23:26:21.176613+0000","last_fullsized":"2024-09-10T23:26:21.176613+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:23.864751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.168522+0000","last_change":"2024-09-10T23:23:57.842302+0000","last_active":"2024-09-10T23:26:21.168522+0000","last_peered":"2024-09-10T23:26:21.168522+0000","last_clean":"2024-09-10T23:26:21.168522+0000","last_became_active":"2024-09-10T23:23:57.838460+0000","last_became_peered":"2024-09-10T23:23:57.838460+0000","last_unstale":"2024-09-10T23:26:21.168522+0000","last_undegraded":"2024-09-10T23:26:21.168522+0000","last_fullsized":"2024-09-10T23:26:21.168522+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:54.731481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.185496+0000","last_change":"2024-09-10T23:23:57.837749+0000","last_active":"2024-09-10T23:26:21.185496+0000","last_peered":"2024-09-10T23:26:21.185496+0000","last_clean":"2024-09-10T23:26:21.185496+0000","last_became_active":"2024-09-10T23:23:57.836195+0000","last_became_peered":"2024-09-10T23:23:57.836195+0000","last_unstale":"2024-09-10T23:26:21.185496+0000","last_undegraded":"2024-09-10T23:26:21.185496+0000","last_fullsized":"2024-09-10T23:26:21.185496+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:10.064725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.164284+0000","last_change":"2024-09-10T23:23:57.812182+0000","last_active":"2024-09-10T23:26:21.164284+0000","last_peered":"2024-09-10T23:26:21.164284+0000","last_clean":"2024-09-10T23:26:21.164284+0000","last_became_active":"2024-09-10T23:23:57.811853+0000","last_became_peered":"2024-09-10T23:23:57.811853+0000","last_unstale":"2024-09-10T23:26:21.164284+0000","last_undegraded":"2024-09-10T23:26:21.164284+0000","last_fullsized":"2024-09-10T23:26:21.164284+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:03.389054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.185862+0000","last_change":"2024-09-10T23:23:57.833957+0000","last_active":"2024-09-10T23:26:21.185862+0000","last_peered":"2024-09-10T23:26:21.185862+0000","last_clean":"2024-09-10T23:26:21.185862+0000","last_became_active":"2024-09-10T23:23:57.833547+0000","last_became_peered":"2024-09-10T23:23:57.833547+0000","last_unstale":"2024-09-10T23:26:21.185862+0000","last_undegraded":"2024-09-10T23:26:21.185862+0000","last_fullsized":"2024-09-10T23:26:21.185862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:30.917801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75005,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":729,"num_read_kb":445,"num_write":183,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":479232,"data_stored":609046,"data_compressed":23683,"data_compressed_allocated":36864,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":288697,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678066,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":999424,"data_stored":535193,"data_compressed":32452,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874296,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28200,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716952,"statfs":{"total":95995035648,"available":95966158848,"internally_reserved":0,"allocated":1196032,"data_stored":1587105,"data_compressed":89105,"data_compressed_allocated":118784,"data_compressed_original":1056768,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037820,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":539491,"data_compressed":32452,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234050,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":535315,"data_compressed":32452,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430281,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1060864,"data_stored":1132742,"data_compressed":69150,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593807,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":530571,"data_compressed":32452,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790037,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1069056,"data_stored":1126914,"data_compressed":69150,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953563,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":536637,"data_compressed":32452,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149792,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32164,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712988,"statfs":{"total":95995035648,"available":95962099712,"internally_reserved":0,"allocated":1003520,"data_stored":530765,"data_compressed":32452,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378727,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32236,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712916,"statfs":{"total":95995035648,"available":95962025984,"internally_reserved":0,"allocated":1077248,"data_stored":594551,"data_compressed":34316,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542251,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1060864,"data_stored":597447,"data_compressed":34316,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705778,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32176,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712976,"statfs":{"total":95995035648,"available":95962087424,"internally_reserved":0,"allocated":1015808,"data_stored":531959,"data_compressed":32452,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":66966,"data_compressed":1864,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":64070,"data_compressed":1864,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":466256,"data_compressed":19955,"data_compressed_allocated":28672,"data_compressed_original":376832,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:26:48.994 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T23:26:48.994 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T23:26:49.411 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:49.549 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:49 smithi003 ceph-mon[30348]: from='client.15564 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:26:49.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:49 smithi038 ceph-mon[34225]: from='client.15564 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:26:49.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:49 smithi194 ceph-mon[33904]: from='client.15564 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:26:50.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.001+0000 7f9021800640 1 -- 172.21.15.3:0/2297654959 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f901c10b330 msgr2=0x7f901c111b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:50.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.001+0000 7f9021800640 1 --2- 172.21.15.3:0/2297654959 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f901c10b330 0x7f901c111b30 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9014009ca0 tx=0x7f901402a8b0 comp rx=0 tx=0).stop 2024-09-10T23:26:50.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.001+0000 7f9021800640 1 -- 172.21.15.3:0/2297654959 shutdown_connections 2024-09-10T23:26:50.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.001+0000 7f9021800640 1 --2- 172.21.15.3:0/2297654959 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f901c10b330 0x7f901c111b30 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:50.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.001+0000 7f9021800640 1 --2- 172.21.15.3:0/2297654959 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f901c10a9b0 0x7f901c10adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:50.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.001+0000 7f9021800640 1 --2- 172.21.15.3:0/2297654959 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f901c104fa0 0x7f901c105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:50.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.002+0000 7f9021800640 1 -- 172.21.15.3:0/2297654959 >> 172.21.15.3:0/2297654959 conn(0x7f901c100a50 msgr2=0x7f901c102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:50.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.002+0000 7f9021800640 1 -- 172.21.15.3:0/2297654959 shutdown_connections 2024-09-10T23:26:50.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.002+0000 7f9021800640 1 -- 172.21.15.3:0/2297654959 wait complete. 2024-09-10T23:26:50.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.003+0000 7f9021800640 1 Processor -- start 2024-09-10T23:26:50.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.003+0000 7f9021800640 1 -- start start 2024-09-10T23:26:50.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.003+0000 7f9021800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f901c104fa0 0x7f901c19b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:50.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.003+0000 7f9021800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f901c10a9b0 0x7f901c19b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:50.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.003+0000 7f9021800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f901c10b330 0x7f901c1a0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:50.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.003+0000 7f9021800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f901c114e60 con 0x7f901c10b330 2024-09-10T23:26:50.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.003+0000 7f9021800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f901c114ce0 con 0x7f901c10a9b0 2024-09-10T23:26:50.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.003+0000 7f9021800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f901c114fe0 con 0x7f901c104fa0 2024-09-10T23:26:50.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.004+0000 7f901b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f901c10b330 0x7f901c1a0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:50.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.004+0000 7f901b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f901c10b330 0x7f901c1a0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39578/0 (socket says 172.21.15.3:39578) 2024-09-10T23:26:50.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.004+0000 7f901b400640 1 -- 172.21.15.3:0/593891585 learned_addr learned my addr 172.21.15.3:0/593891585 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:50.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.004+0000 7f9013e00640 1 --2- 172.21.15.3:0/593891585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f901c10a9b0 0x7f901c19b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:50.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.004+0000 7f901aa00640 1 --2- 172.21.15.3:0/593891585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f901c104fa0 0x7f901c19b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:50.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.004+0000 7f901b400640 1 -- 172.21.15.3:0/593891585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f901c104fa0 msgr2=0x7f901c19b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:50.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.004+0000 7f901b400640 1 --2- 172.21.15.3:0/593891585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f901c104fa0 0x7f901c19b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:50.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.004+0000 7f901b400640 1 -- 172.21.15.3:0/593891585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f901c10a9b0 msgr2=0x7f901c19b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:50.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.004+0000 7f901b400640 1 --2- 172.21.15.3:0/593891585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f901c10a9b0 0x7f901c19b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:50.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.004+0000 7f901b400640 1 -- 172.21.15.3:0/593891585 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f901c1a1420 con 0x7f901c10b330 2024-09-10T23:26:50.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.004+0000 7f901b400640 1 --2- 172.21.15.3:0/593891585 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f901c10b330 0x7f901c1a0c50 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9014030750 tx=0x7f9014030d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:50.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.005+0000 7f9013400640 1 -- 172.21.15.3:0/593891585 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9014004040 con 0x7f901c10b330 2024-09-10T23:26:50.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.005+0000 7f9013400640 1 -- 172.21.15.3:0/593891585 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9014040070 con 0x7f901c10b330 2024-09-10T23:26:50.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.005+0000 7f9021800640 1 -- 172.21.15.3:0/593891585 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f901c1a16b0 con 0x7f901c10b330 2024-09-10T23:26:50.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.005+0000 7f9013400640 1 -- 172.21.15.3:0/593891585 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9014045ae0 con 0x7f901c10b330 2024-09-10T23:26:50.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.005+0000 7f9021800640 1 -- 172.21.15.3:0/593891585 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f901c1a7dd0 con 0x7f901c10b330 2024-09-10T23:26:50.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.006+0000 7f9021800640 1 -- 172.21.15.3:0/593891585 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f901c105380 con 0x7f901c10b330 2024-09-10T23:26:50.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.008+0000 7f9013400640 1 -- 172.21.15.3:0/593891585 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 24) ==== 153374+0+0 (secure 0 0 0) 0x7f901404d030 con 0x7f901c10b330 2024-09-10T23:26:50.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.009+0000 7f9013400640 1 --2- 172.21.15.3:0/593891585 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f90000b5450 0x7f90000b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:50.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.010+0000 7f9013400640 1 -- 172.21.15.3:0/593891585 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f90141076d0 con 0x7f901c10b330 2024-09-10T23:26:50.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.010+0000 7f901aa00640 1 --2- 172.21.15.3:0/593891585 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f90000b5450 0x7f90000b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:50.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.010+0000 7f901aa00640 1 --2- 172.21.15.3:0/593891585 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f90000b5450 0x7f90000b7910 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f900c005fd0 tx=0x7f900c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:50.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.012+0000 7f9013400640 1 -- 172.21.15.3:0/593891585 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f90140cde80 con 0x7f901c10b330 2024-09-10T23:26:50.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.204+0000 7f9021800640 1 -- 172.21.15.3:0/593891585 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f901c10d170 con 0x7f90000b5450 2024-09-10T23:26:50.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.210+0000 7f9013400640 1 -- 172.21.15.3:0/593891585 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340921 (secure 0 0 0) 0x7f901c10d170 con 0x7f90000b5450 2024-09-10T23:26:50.215 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:26:50.216 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-10T23:26:50.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.215+0000 7f9021800640 1 -- 172.21.15.3:0/593891585 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f90000b5450 msgr2=0x7f90000b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:50.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.215+0000 7f9021800640 1 --2- 172.21.15.3:0/593891585 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f90000b5450 0x7f90000b7910 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f900c005fd0 tx=0x7f900c00b390 comp rx=0 tx=0).stop 2024-09-10T23:26:50.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.215+0000 7f9021800640 1 -- 172.21.15.3:0/593891585 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f901c10b330 msgr2=0x7f901c1a0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:50.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.215+0000 7f9021800640 1 --2- 172.21.15.3:0/593891585 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f901c10b330 0x7f901c1a0c50 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9014030750 tx=0x7f9014030d50 comp rx=0 tx=0).stop 2024-09-10T23:26:50.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.215+0000 7f9021800640 1 -- 172.21.15.3:0/593891585 shutdown_connections 2024-09-10T23:26:50.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.215+0000 7f9021800640 1 --2- 172.21.15.3:0/593891585 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f90000b5450 0x7f90000b7910 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:50.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.215+0000 7f9021800640 1 --2- 172.21.15.3:0/593891585 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f901c10b330 0x7f901c1a0c50 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:50.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.215+0000 7f9021800640 1 --2- 172.21.15.3:0/593891585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f901c10a9b0 0x7f901c19b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:50.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.215+0000 7f9021800640 1 --2- 172.21.15.3:0/593891585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f901c104fa0 0x7f901c19b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:50.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.215+0000 7f9021800640 1 -- 172.21.15.3:0/593891585 >> 172.21.15.3:0/593891585 conn(0x7f901c100a50 msgr2=0x7f901c102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:50.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.215+0000 7f9021800640 1 -- 172.21.15.3:0/593891585 shutdown_connections 2024-09-10T23:26:50.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:50.215+0000 7f9021800640 1 -- 172.21.15.3:0/593891585 wait complete. 2024-09-10T23:26:50.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:50 smithi003 ceph-mon[30348]: pgmap v392: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 176 KiB/s wr, 54 op/s 2024-09-10T23:26:50.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:50 smithi038 ceph-mon[34225]: pgmap v392: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 176 KiB/s wr, 54 op/s 2024-09-10T23:26:50.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:50 smithi194 ceph-mon[33904]: pgmap v392: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 176 KiB/s wr, 54 op/s 2024-09-10T23:26:50.995 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":392,"stamp":"2024-09-10T23:26:48.794749+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1452599,"num_objects":66,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1160,"num_read_kb":819,"num_write":536,"num_write_kb":4378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2951874,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":896,"ondisk_log_size":896,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365816,"kb_used_data":12392,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576008,"statfs":{"total":1151940427776,"available":1151565832192,"internally_reserved":0,"allocated":12689408,"data_stored":10753115,"data_compressed":617250,"data_compressed_allocated":835584,"data_compressed_original":5160960,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":796087,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":415,"num_read_kb":346,"num_write":241,"num_write_kb":2107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003488"},"pg_stats":[{"pgid":"2.1f","version":"88'9","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.145875+0000","last_change":"2024-09-10T23:23:54.796561+0000","last_active":"2024-09-10T23:25:22.145875+0000","last_peered":"2024-09-10T23:25:22.145875+0000","last_clean":"2024-09-10T23:25:22.145875+0000","last_became_active":"2024-09-10T23:23:54.796058+0000","last_became_peered":"2024-09-10T23:23:54.796058+0000","last_unstale":"2024-09-10T23:25:22.145875+0000","last_undegraded":"2024-09-10T23:25:22.145875+0000","last_fullsized":"2024-09-10T23:25:22.145875+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:27.790990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.159632+0000","last_change":"2024-09-10T23:23:57.828660+0000","last_active":"2024-09-10T23:26:21.159632+0000","last_peered":"2024-09-10T23:26:21.159632+0000","last_clean":"2024-09-10T23:26:21.159632+0000","last_became_active":"2024-09-10T23:23:57.828287+0000","last_became_peered":"2024-09-10T23:23:57.828287+0000","last_unstale":"2024-09-10T23:26:21.159632+0000","last_undegraded":"2024-09-10T23:26:21.159632+0000","last_fullsized":"2024-09-10T23:26:21.159632+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:13.085003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.140416+0000","last_change":"2024-09-10T23:24:05.886167+0000","last_active":"2024-09-10T23:25:22.140416+0000","last_peered":"2024-09-10T23:25:22.140416+0000","last_clean":"2024-09-10T23:25:22.140416+0000","last_became_active":"2024-09-10T23:24:05.885706+0000","last_became_peered":"2024-09-10T23:24:05.885706+0000","last_unstale":"2024-09-10T23:25:22.140416+0000","last_undegraded":"2024-09-10T23:25:22.140416+0000","last_fullsized":"2024-09-10T23:25:22.140416+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:42.337384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481001+0000","last_change":"2024-09-10T23:23:54.791770+0000","last_active":"2024-09-10T23:25:22.481001+0000","last_peered":"2024-09-10T23:25:22.481001+0000","last_clean":"2024-09-10T23:25:22.481001+0000","last_became_active":"2024-09-10T23:23:54.791476+0000","last_became_peered":"2024-09-10T23:23:54.791476+0000","last_unstale":"2024-09-10T23:25:22.481001+0000","last_undegraded":"2024-09-10T23:25:22.481001+0000","last_fullsized":"2024-09-10T23:25:22.481001+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:07.493654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.185714+0000","last_change":"2024-09-10T23:23:57.833858+0000","last_active":"2024-09-10T23:26:21.185714+0000","last_peered":"2024-09-10T23:26:21.185714+0000","last_clean":"2024-09-10T23:26:21.185714+0000","last_became_active":"2024-09-10T23:23:57.833496+0000","last_became_peered":"2024-09-10T23:23:57.833496+0000","last_unstale":"2024-09-10T23:26:21.185714+0000","last_undegraded":"2024-09-10T23:26:21.185714+0000","last_fullsized":"2024-09-10T23:26:21.185714+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:48:50.293342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147391+0000","last_change":"2024-09-10T23:24:05.878733+0000","last_active":"2024-09-10T23:25:22.147391+0000","last_peered":"2024-09-10T23:25:22.147391+0000","last_clean":"2024-09-10T23:25:22.147391+0000","last_became_active":"2024-09-10T23:24:05.878285+0000","last_became_peered":"2024-09-10T23:24:05.878285+0000","last_unstale":"2024-09-10T23:25:22.147391+0000","last_undegraded":"2024-09-10T23:25:22.147391+0000","last_fullsized":"2024-09-10T23:25:22.147391+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:21:11.636292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.181613+0000","last_change":"2024-09-10T23:23:54.792253+0000","last_active":"2024-09-10T23:25:22.181613+0000","last_peered":"2024-09-10T23:25:22.181613+0000","last_clean":"2024-09-10T23:25:22.181613+0000","last_became_active":"2024-09-10T23:23:54.791847+0000","last_became_peered":"2024-09-10T23:23:54.791847+0000","last_unstale":"2024-09-10T23:25:22.181613+0000","last_undegraded":"2024-09-10T23:25:22.181613+0000","last_fullsized":"2024-09-10T23:25:22.181613+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:03.563741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.187276+0000","last_change":"2024-09-10T23:23:57.837009+0000","last_active":"2024-09-10T23:26:21.187276+0000","last_peered":"2024-09-10T23:26:21.187276+0000","last_clean":"2024-09-10T23:26:21.187276+0000","last_became_active":"2024-09-10T23:23:57.835152+0000","last_became_peered":"2024-09-10T23:23:57.835152+0000","last_unstale":"2024-09-10T23:26:21.187276+0000","last_undegraded":"2024-09-10T23:26:21.187276+0000","last_fullsized":"2024-09-10T23:26:21.187276+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:25.345514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147469+0000","last_change":"2024-09-10T23:24:05.882593+0000","last_active":"2024-09-10T23:25:22.147469+0000","last_peered":"2024-09-10T23:25:22.147469+0000","last_clean":"2024-09-10T23:25:22.147469+0000","last_became_active":"2024-09-10T23:24:05.882123+0000","last_became_peered":"2024-09-10T23:24:05.882123+0000","last_unstale":"2024-09-10T23:25:22.147469+0000","last_undegraded":"2024-09-10T23:25:22.147469+0000","last_fullsized":"2024-09-10T23:25:22.147469+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:22:30.103412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.142081+0000","last_change":"2024-09-10T23:24:21.980433+0000","last_active":"2024-09-10T23:25:22.142081+0000","last_peered":"2024-09-10T23:25:22.142081+0000","last_clean":"2024-09-10T23:25:22.142081+0000","last_became_active":"2024-09-10T23:24:21.974096+0000","last_became_peered":"2024-09-10T23:24:21.974096+0000","last_unstale":"2024-09-10T23:25:22.142081+0000","last_undegraded":"2024-09-10T23:25:22.142081+0000","last_fullsized":"2024-09-10T23:25:22.142081+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:33.430921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":62,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.184065+0000","last_change":"2024-09-10T23:24:21.978526+0000","last_active":"2024-09-10T23:26:21.184065+0000","last_peered":"2024-09-10T23:26:21.184065+0000","last_clean":"2024-09-10T23:26:21.184065+0000","last_became_active":"2024-09-10T23:24:21.978137+0000","last_became_peered":"2024-09-10T23:24:21.978137+0000","last_unstale":"2024-09-10T23:26:21.184065+0000","last_undegraded":"2024-09-10T23:26:21.184065+0000","last_fullsized":"2024-09-10T23:26:21.184065+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:53:31.785033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147303+0000","last_change":"2024-09-10T23:24:05.889983+0000","last_active":"2024-09-10T23:25:22.147303+0000","last_peered":"2024-09-10T23:25:22.147303+0000","last_clean":"2024-09-10T23:25:22.147303+0000","last_became_active":"2024-09-10T23:24:05.889003+0000","last_became_peered":"2024-09-10T23:24:05.889003+0000","last_unstale":"2024-09-10T23:25:22.147303+0000","last_undegraded":"2024-09-10T23:25:22.147303+0000","last_fullsized":"2024-09-10T23:25:22.147303+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:19:13.555187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.186655+0000","last_change":"2024-09-10T23:23:57.831433+0000","last_active":"2024-09-10T23:26:21.186655+0000","last_peered":"2024-09-10T23:26:21.186655+0000","last_clean":"2024-09-10T23:26:21.186655+0000","last_became_active":"2024-09-10T23:23:57.831108+0000","last_became_peered":"2024-09-10T23:23:57.831108+0000","last_unstale":"2024-09-10T23:26:21.186655+0000","last_undegraded":"2024-09-10T23:26:21.186655+0000","last_fullsized":"2024-09-10T23:26:21.186655+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:50:20.160455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.181266+0000","last_change":"2024-09-10T23:23:54.792269+0000","last_active":"2024-09-10T23:25:22.181266+0000","last_peered":"2024-09-10T23:25:22.181266+0000","last_clean":"2024-09-10T23:25:22.181266+0000","last_became_active":"2024-09-10T23:23:54.791853+0000","last_became_peered":"2024-09-10T23:23:54.791853+0000","last_unstale":"2024-09-10T23:25:22.181266+0000","last_undegraded":"2024-09-10T23:25:22.181266+0000","last_fullsized":"2024-09-10T23:25:22.181266+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:43.020267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147630+0000","last_change":"2024-09-10T23:24:05.886155+0000","last_active":"2024-09-10T23:25:22.147630+0000","last_peered":"2024-09-10T23:25:22.147630+0000","last_clean":"2024-09-10T23:25:22.147630+0000","last_became_active":"2024-09-10T23:24:05.885674+0000","last_became_peered":"2024-09-10T23:24:05.885674+0000","last_unstale":"2024-09-10T23:25:22.147630+0000","last_undegraded":"2024-09-10T23:25:22.147630+0000","last_fullsized":"2024-09-10T23:25:22.147630+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:46:00.891311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.170665+0000","last_change":"2024-09-10T23:23:57.830440+0000","last_active":"2024-09-10T23:26:21.170665+0000","last_peered":"2024-09-10T23:26:21.170665+0000","last_clean":"2024-09-10T23:26:21.170665+0000","last_became_active":"2024-09-10T23:23:57.829219+0000","last_became_peered":"2024-09-10T23:23:57.829219+0000","last_unstale":"2024-09-10T23:26:21.170665+0000","last_undegraded":"2024-09-10T23:26:21.170665+0000","last_fullsized":"2024-09-10T23:26:21.170665+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:28:15.696684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"90'2","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:07.582692+0000","last_change":"2024-09-10T23:23:54.796493+0000","last_active":"2024-09-10T23:26:07.582692+0000","last_peered":"2024-09-10T23:26:07.582692+0000","last_clean":"2024-09-10T23:26:07.582692+0000","last_became_active":"2024-09-10T23:23:54.796077+0000","last_became_peered":"2024-09-10T23:23:54.796077+0000","last_unstale":"2024-09-10T23:26:07.582692+0000","last_undegraded":"2024-09-10T23:26:07.582692+0000","last_fullsized":"2024-09-10T23:26:07.582692+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:13.054307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147718+0000","last_change":"2024-09-10T23:24:05.885557+0000","last_active":"2024-09-10T23:25:22.147718+0000","last_peered":"2024-09-10T23:25:22.147718+0000","last_clean":"2024-09-10T23:25:22.147718+0000","last_became_active":"2024-09-10T23:24:05.884773+0000","last_became_peered":"2024-09-10T23:24:05.884773+0000","last_unstale":"2024-09-10T23:25:22.147718+0000","last_undegraded":"2024-09-10T23:25:22.147718+0000","last_fullsized":"2024-09-10T23:25:22.147718+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:52.596822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.156861+0000","last_change":"2024-09-10T23:23:57.816395+0000","last_active":"2024-09-10T23:26:21.156861+0000","last_peered":"2024-09-10T23:26:21.156861+0000","last_clean":"2024-09-10T23:26:21.156861+0000","last_became_active":"2024-09-10T23:23:57.816047+0000","last_became_peered":"2024-09-10T23:23:57.816047+0000","last_unstale":"2024-09-10T23:26:21.156861+0000","last_undegraded":"2024-09-10T23:26:21.156861+0000","last_fullsized":"2024-09-10T23:26:21.156861+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:08:11.535738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480277+0000","last_change":"2024-09-10T23:23:54.795827+0000","last_active":"2024-09-10T23:25:22.480277+0000","last_peered":"2024-09-10T23:25:22.480277+0000","last_clean":"2024-09-10T23:25:22.480277+0000","last_became_active":"2024-09-10T23:23:54.794253+0000","last_became_peered":"2024-09-10T23:23:54.794253+0000","last_unstale":"2024-09-10T23:25:22.480277+0000","last_undegraded":"2024-09-10T23:25:22.480277+0000","last_fullsized":"2024-09-10T23:25:22.480277+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:27:27.988380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.145484+0000","last_change":"2024-09-10T23:24:05.889120+0000","last_active":"2024-09-10T23:25:22.145484+0000","last_peered":"2024-09-10T23:25:22.145484+0000","last_clean":"2024-09-10T23:25:22.145484+0000","last_became_active":"2024-09-10T23:24:05.888771+0000","last_became_peered":"2024-09-10T23:24:05.888771+0000","last_unstale":"2024-09-10T23:25:22.145484+0000","last_undegraded":"2024-09-10T23:25:22.145484+0000","last_fullsized":"2024-09-10T23:25:22.145484+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:55.414786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.122950+0000","last_change":"2024-09-10T23:23:57.814073+0000","last_active":"2024-09-10T23:26:21.122950+0000","last_peered":"2024-09-10T23:26:21.122950+0000","last_clean":"2024-09-10T23:26:21.122950+0000","last_became_active":"2024-09-10T23:23:57.813681+0000","last_became_peered":"2024-09-10T23:23:57.813681+0000","last_unstale":"2024-09-10T23:26:21.122950+0000","last_undegraded":"2024-09-10T23:26:21.122950+0000","last_fullsized":"2024-09-10T23:26:21.122950+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:44.129174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480412+0000","last_change":"2024-09-10T23:23:54.791119+0000","last_active":"2024-09-10T23:25:22.480412+0000","last_peered":"2024-09-10T23:25:22.480412+0000","last_clean":"2024-09-10T23:25:22.480412+0000","last_became_active":"2024-09-10T23:23:54.790770+0000","last_became_peered":"2024-09-10T23:23:54.790770+0000","last_unstale":"2024-09-10T23:25:22.480412+0000","last_undegraded":"2024-09-10T23:25:22.480412+0000","last_fullsized":"2024-09-10T23:25:22.480412+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:35.015104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.183894+0000","last_change":"2024-09-10T23:25:22.183216+0000","last_active":"2024-09-10T23:25:22.183894+0000","last_peered":"2024-09-10T23:25:22.183894+0000","last_clean":"2024-09-10T23:25:22.183894+0000","last_became_active":"2024-09-10T23:25:22.182735+0000","last_became_peered":"2024-09-10T23:25:22.182735+0000","last_unstale":"2024-09-10T23:25:22.183894+0000","last_undegraded":"2024-09-10T23:25:22.183894+0000","last_fullsized":"2024-09-10T23:25:22.183894+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:39:53.143633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.161571+0000","last_change":"2024-09-10T23:24:21.976169+0000","last_active":"2024-09-10T23:26:21.161571+0000","last_peered":"2024-09-10T23:26:21.161571+0000","last_clean":"2024-09-10T23:26:21.161571+0000","last_became_active":"2024-09-10T23:24:21.975330+0000","last_became_peered":"2024-09-10T23:24:21.975330+0000","last_unstale":"2024-09-10T23:26:21.161571+0000","last_undegraded":"2024-09-10T23:26:21.161571+0000","last_fullsized":"2024-09-10T23:26:21.161571+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:54:59.422630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.148043+0000","last_change":"2024-09-10T23:23:55.082093+0000","last_active":"2024-09-10T23:25:22.148043+0000","last_peered":"2024-09-10T23:25:22.148043+0000","last_clean":"2024-09-10T23:25:22.148043+0000","last_became_active":"2024-09-10T23:23:55.081705+0000","last_became_peered":"2024-09-10T23:23:55.081705+0000","last_unstale":"2024-09-10T23:25:22.148043+0000","last_undegraded":"2024-09-10T23:25:22.148043+0000","last_fullsized":"2024-09-10T23:25:22.148043+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:01:04.150153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.140670+0000","last_change":"2024-09-10T23:24:05.880084+0000","last_active":"2024-09-10T23:25:22.140670+0000","last_peered":"2024-09-10T23:25:22.140670+0000","last_clean":"2024-09-10T23:25:22.140670+0000","last_became_active":"2024-09-10T23:24:05.879655+0000","last_became_peered":"2024-09-10T23:24:05.879655+0000","last_unstale":"2024-09-10T23:25:22.140670+0000","last_undegraded":"2024-09-10T23:25:22.140670+0000","last_fullsized":"2024-09-10T23:25:22.140670+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:01.473494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.174054+0000","last_change":"2024-09-10T23:23:57.836207+0000","last_active":"2024-09-10T23:26:21.174054+0000","last_peered":"2024-09-10T23:26:21.174054+0000","last_clean":"2024-09-10T23:26:21.174054+0000","last_became_active":"2024-09-10T23:23:57.835801+0000","last_became_peered":"2024-09-10T23:23:57.835801+0000","last_unstale":"2024-09-10T23:26:21.174054+0000","last_undegraded":"2024-09-10T23:26:21.174054+0000","last_fullsized":"2024-09-10T23:26:21.174054+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:48:18.246508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'97","reported_seq":232,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:44.656700+0000","last_change":"2024-09-10T23:23:54.798126+0000","last_active":"2024-09-10T23:26:44.656700+0000","last_peered":"2024-09-10T23:26:44.656700+0000","last_clean":"2024-09-10T23:26:44.656700+0000","last_became_active":"2024-09-10T23:23:54.797755+0000","last_became_peered":"2024-09-10T23:23:54.797755+0000","last_unstale":"2024-09-10T23:26:44.656700+0000","last_undegraded":"2024-09-10T23:26:44.656700+0000","last_fullsized":"2024-09-10T23:26:44.656700+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:54.474382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":302,"num_read_kb":268,"num_write":178,"num_write_kb":1221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.479753+0000","last_change":"2024-09-10T23:24:05.886431+0000","last_active":"2024-09-10T23:25:22.479753+0000","last_peered":"2024-09-10T23:25:22.479753+0000","last_clean":"2024-09-10T23:25:22.479753+0000","last_became_active":"2024-09-10T23:24:05.885962+0000","last_became_peered":"2024-09-10T23:24:05.885962+0000","last_unstale":"2024-09-10T23:25:22.479753+0000","last_undegraded":"2024-09-10T23:25:22.479753+0000","last_fullsized":"2024-09-10T23:25:22.479753+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:32.568553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.172961+0000","last_change":"2024-09-10T23:23:57.825790+0000","last_active":"2024-09-10T23:26:21.172961+0000","last_peered":"2024-09-10T23:26:21.172961+0000","last_clean":"2024-09-10T23:26:21.172961+0000","last_became_active":"2024-09-10T23:23:57.825510+0000","last_became_peered":"2024-09-10T23:23:57.825510+0000","last_unstale":"2024-09-10T23:26:21.172961+0000","last_undegraded":"2024-09-10T23:26:21.172961+0000","last_fullsized":"2024-09-10T23:26:21.172961+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:43.816144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.181663+0000","last_change":"2024-09-10T23:23:54.791957+0000","last_active":"2024-09-10T23:25:22.181663+0000","last_peered":"2024-09-10T23:25:22.181663+0000","last_clean":"2024-09-10T23:25:22.181663+0000","last_became_active":"2024-09-10T23:23:54.791607+0000","last_became_peered":"2024-09-10T23:23:54.791607+0000","last_unstale":"2024-09-10T23:25:22.181663+0000","last_undegraded":"2024-09-10T23:25:22.181663+0000","last_fullsized":"2024-09-10T23:25:22.181663+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:00:47.600299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.142066+0000","last_change":"2024-09-10T23:24:05.884275+0000","last_active":"2024-09-10T23:25:22.142066+0000","last_peered":"2024-09-10T23:25:22.142066+0000","last_clean":"2024-09-10T23:25:22.142066+0000","last_became_active":"2024-09-10T23:24:05.882340+0000","last_became_peered":"2024-09-10T23:24:05.882340+0000","last_unstale":"2024-09-10T23:25:22.142066+0000","last_undegraded":"2024-09-10T23:25:22.142066+0000","last_fullsized":"2024-09-10T23:25:22.142066+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:15.243993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"90'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.172476+0000","last_change":"2024-09-10T23:23:57.828322+0000","last_active":"2024-09-10T23:26:21.172476+0000","last_peered":"2024-09-10T23:26:21.172476+0000","last_clean":"2024-09-10T23:26:21.172476+0000","last_became_active":"2024-09-10T23:23:57.827925+0000","last_became_peered":"2024-09-10T23:23:57.827925+0000","last_unstale":"2024-09-10T23:26:21.172476+0000","last_undegraded":"2024-09-10T23:26:21.172476+0000","last_fullsized":"2024-09-10T23:26:21.172476+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:55.214207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144992+0000","last_change":"2024-09-10T23:23:54.789507+0000","last_active":"2024-09-10T23:25:22.144992+0000","last_peered":"2024-09-10T23:25:22.144992+0000","last_clean":"2024-09-10T23:25:22.144992+0000","last_became_active":"2024-09-10T23:23:54.789120+0000","last_became_peered":"2024-09-10T23:23:54.789120+0000","last_unstale":"2024-09-10T23:25:22.144992+0000","last_undegraded":"2024-09-10T23:25:22.144992+0000","last_fullsized":"2024-09-10T23:25:22.144992+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:58.033953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.181120+0000","last_change":"2024-09-10T23:24:05.881015+0000","last_active":"2024-09-10T23:25:22.181120+0000","last_peered":"2024-09-10T23:25:22.181120+0000","last_clean":"2024-09-10T23:25:22.181120+0000","last_became_active":"2024-09-10T23:24:05.880261+0000","last_became_peered":"2024-09-10T23:24:05.880261+0000","last_unstale":"2024-09-10T23:25:22.181120+0000","last_undegraded":"2024-09-10T23:25:22.181120+0000","last_fullsized":"2024-09-10T23:25:22.181120+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:13:36.937503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.167570+0000","last_change":"2024-09-10T23:23:57.842018+0000","last_active":"2024-09-10T23:26:21.167570+0000","last_peered":"2024-09-10T23:26:21.167570+0000","last_clean":"2024-09-10T23:26:21.167570+0000","last_became_active":"2024-09-10T23:23:57.841669+0000","last_became_peered":"2024-09-10T23:23:57.841669+0000","last_unstale":"2024-09-10T23:26:21.167570+0000","last_undegraded":"2024-09-10T23:26:21.167570+0000","last_fullsized":"2024-09-10T23:26:21.167570+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:11.619741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481110+0000","last_change":"2024-09-10T23:23:54.794565+0000","last_active":"2024-09-10T23:25:22.481110+0000","last_peered":"2024-09-10T23:25:22.481110+0000","last_clean":"2024-09-10T23:25:22.481110+0000","last_became_active":"2024-09-10T23:23:54.793794+0000","last_became_peered":"2024-09-10T23:23:54.793794+0000","last_unstale":"2024-09-10T23:25:22.481110+0000","last_undegraded":"2024-09-10T23:25:22.481110+0000","last_fullsized":"2024-09-10T23:25:22.481110+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:42.665924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.139490+0000","last_change":"2024-09-10T23:24:05.883706+0000","last_active":"2024-09-10T23:25:22.139490+0000","last_peered":"2024-09-10T23:25:22.139490+0000","last_clean":"2024-09-10T23:25:22.139490+0000","last_became_active":"2024-09-10T23:24:05.881621+0000","last_became_peered":"2024-09-10T23:24:05.881621+0000","last_unstale":"2024-09-10T23:25:22.139490+0000","last_undegraded":"2024-09-10T23:25:22.139490+0000","last_fullsized":"2024-09-10T23:25:22.139490+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:23.468331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.165929+0000","last_change":"2024-09-10T23:23:57.834504+0000","last_active":"2024-09-10T23:26:21.165929+0000","last_peered":"2024-09-10T23:26:21.165929+0000","last_clean":"2024-09-10T23:26:21.165929+0000","last_became_active":"2024-09-10T23:23:57.834105+0000","last_became_peered":"2024-09-10T23:23:57.834105+0000","last_unstale":"2024-09-10T23:26:21.165929+0000","last_undegraded":"2024-09-10T23:26:21.165929+0000","last_fullsized":"2024-09-10T23:26:21.165929+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:03.539763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'6","reported_seq":171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:46.473813+0000","last_change":"2024-09-10T23:23:54.796519+0000","last_active":"2024-09-10T23:26:46.473813+0000","last_peered":"2024-09-10T23:26:46.473813+0000","last_clean":"2024-09-10T23:26:46.473813+0000","last_became_active":"2024-09-10T23:23:54.795174+0000","last_became_peered":"2024-09-10T23:23:54.795174+0000","last_unstale":"2024-09-10T23:26:46.473813+0000","last_undegraded":"2024-09-10T23:26:46.473813+0000","last_fullsized":"2024-09-10T23:26:46.473813+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:53.622935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.140542+0000","last_change":"2024-09-10T23:24:05.884496+0000","last_active":"2024-09-10T23:25:22.140542+0000","last_peered":"2024-09-10T23:25:22.140542+0000","last_clean":"2024-09-10T23:25:22.140542+0000","last_became_active":"2024-09-10T23:24:05.883659+0000","last_became_peered":"2024-09-10T23:24:05.883659+0000","last_unstale":"2024-09-10T23:25:22.140542+0000","last_undegraded":"2024-09-10T23:25:22.140542+0000","last_fullsized":"2024-09-10T23:25:22.140542+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:23.449830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.172326+0000","last_change":"2024-09-10T23:23:57.842436+0000","last_active":"2024-09-10T23:26:21.172326+0000","last_peered":"2024-09-10T23:26:21.172326+0000","last_clean":"2024-09-10T23:26:21.172326+0000","last_became_active":"2024-09-10T23:23:57.842054+0000","last_became_peered":"2024-09-10T23:23:57.842054+0000","last_unstale":"2024-09-10T23:26:21.172326+0000","last_undegraded":"2024-09-10T23:26:21.172326+0000","last_fullsized":"2024-09-10T23:26:21.172326+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:07.234201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481636+0000","last_change":"2024-09-10T23:24:21.974615+0000","last_active":"2024-09-10T23:25:22.481636+0000","last_peered":"2024-09-10T23:25:22.481636+0000","last_clean":"2024-09-10T23:25:22.481636+0000","last_became_active":"2024-09-10T23:24:21.974129+0000","last_became_peered":"2024-09-10T23:24:21.974129+0000","last_unstale":"2024-09-10T23:25:22.481636+0000","last_undegraded":"2024-09-10T23:25:22.481636+0000","last_fullsized":"2024-09-10T23:25:22.481636+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:11.510005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.151991+0000","last_change":"2024-09-10T23:25:22.151288+0000","last_active":"2024-09-10T23:25:22.151991+0000","last_peered":"2024-09-10T23:25:22.151991+0000","last_clean":"2024-09-10T23:25:22.151991+0000","last_became_active":"2024-09-10T23:25:22.150800+0000","last_became_peered":"2024-09-10T23:25:22.150800+0000","last_unstale":"2024-09-10T23:25:22.151991+0000","last_undegraded":"2024-09-10T23:25:22.151991+0000","last_fullsized":"2024-09-10T23:25:22.151991+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:56.974242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.183481+0000","last_change":"2024-09-10T23:23:57.828722+0000","last_active":"2024-09-10T23:26:21.183481+0000","last_peered":"2024-09-10T23:26:21.183481+0000","last_clean":"2024-09-10T23:26:21.183481+0000","last_became_active":"2024-09-10T23:23:57.828373+0000","last_became_peered":"2024-09-10T23:23:57.828373+0000","last_unstale":"2024-09-10T23:26:21.183481+0000","last_undegraded":"2024-09-10T23:26:21.183481+0000","last_fullsized":"2024-09-10T23:26:21.183481+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:19.891684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147902+0000","last_change":"2024-09-10T23:23:54.789584+0000","last_active":"2024-09-10T23:25:22.147902+0000","last_peered":"2024-09-10T23:25:22.147902+0000","last_clean":"2024-09-10T23:25:22.147902+0000","last_became_active":"2024-09-10T23:23:54.789166+0000","last_became_peered":"2024-09-10T23:23:54.789166+0000","last_unstale":"2024-09-10T23:25:22.147902+0000","last_undegraded":"2024-09-10T23:25:22.147902+0000","last_fullsized":"2024-09-10T23:25:22.147902+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:02.292384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":121,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481682+0000","last_change":"2024-09-10T23:22:28.076475+0000","last_active":"2024-09-10T23:25:22.481682+0000","last_peered":"2024-09-10T23:25:22.481682+0000","last_clean":"2024-09-10T23:25:22.481682+0000","last_became_active":"2024-09-10T23:22:28.070622+0000","last_became_peered":"2024-09-10T23:22:28.070622+0000","last_unstale":"2024-09-10T23:25:22.481682+0000","last_undegraded":"2024-09-10T23:25:22.481682+0000","last_fullsized":"2024-09-10T23:25:22.481682+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:28.022462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:28.022462+0000","last_clean_scrub_stamp":"2024-09-10T23:18:28.022462+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:46:16.329399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481433+0000","last_change":"2024-09-10T23:24:05.884647+0000","last_active":"2024-09-10T23:25:22.481433+0000","last_peered":"2024-09-10T23:25:22.481433+0000","last_clean":"2024-09-10T23:25:22.481433+0000","last_became_active":"2024-09-10T23:24:05.883476+0000","last_became_peered":"2024-09-10T23:24:05.883476+0000","last_unstale":"2024-09-10T23:25:22.481433+0000","last_undegraded":"2024-09-10T23:25:22.481433+0000","last_fullsized":"2024-09-10T23:25:22.481433+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:02.524767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.185970+0000","last_change":"2024-09-10T23:23:57.840835+0000","last_active":"2024-09-10T23:26:21.185970+0000","last_peered":"2024-09-10T23:26:21.185970+0000","last_clean":"2024-09-10T23:26:21.185970+0000","last_became_active":"2024-09-10T23:23:57.840472+0000","last_became_peered":"2024-09-10T23:23:57.840472+0000","last_unstale":"2024-09-10T23:26:21.185970+0000","last_undegraded":"2024-09-10T23:26:21.185970+0000","last_fullsized":"2024-09-10T23:26:21.185970+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:18.050686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.141282+0000","last_change":"2024-09-10T23:23:55.081669+0000","last_active":"2024-09-10T23:25:22.141282+0000","last_peered":"2024-09-10T23:25:22.141282+0000","last_clean":"2024-09-10T23:25:22.141282+0000","last_became_active":"2024-09-10T23:23:55.081306+0000","last_became_peered":"2024-09-10T23:23:55.081306+0000","last_unstale":"2024-09-10T23:25:22.141282+0000","last_undegraded":"2024-09-10T23:25:22.141282+0000","last_fullsized":"2024-09-10T23:25:22.141282+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:54.968431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480541+0000","last_change":"2024-09-10T23:24:05.880876+0000","last_active":"2024-09-10T23:25:22.480541+0000","last_peered":"2024-09-10T23:25:22.480541+0000","last_clean":"2024-09-10T23:25:22.480541+0000","last_became_active":"2024-09-10T23:24:05.880504+0000","last_became_peered":"2024-09-10T23:24:05.880504+0000","last_unstale":"2024-09-10T23:25:22.480541+0000","last_undegraded":"2024-09-10T23:25:22.480541+0000","last_fullsized":"2024-09-10T23:25:22.480541+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:17:55.689134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.176096+0000","last_change":"2024-09-10T23:23:57.826637+0000","last_active":"2024-09-10T23:26:21.176096+0000","last_peered":"2024-09-10T23:26:21.176096+0000","last_clean":"2024-09-10T23:26:21.176096+0000","last_became_active":"2024-09-10T23:23:57.825915+0000","last_became_peered":"2024-09-10T23:23:57.825915+0000","last_unstale":"2024-09-10T23:26:21.176096+0000","last_undegraded":"2024-09-10T23:26:21.176096+0000","last_fullsized":"2024-09-10T23:26:21.176096+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:55.281687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"90'60","reported_seq":136,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:44.246205+0000","last_change":"2024-09-10T23:23:54.789847+0000","last_active":"2024-09-10T23:26:44.246205+0000","last_peered":"2024-09-10T23:26:44.246205+0000","last_clean":"2024-09-10T23:26:44.246205+0000","last_became_active":"2024-09-10T23:23:54.789082+0000","last_became_peered":"2024-09-10T23:23:54.789082+0000","last_unstale":"2024-09-10T23:26:44.246205+0000","last_undegraded":"2024-09-10T23:26:44.246205+0000","last_fullsized":"2024-09-10T23:26:44.246205+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:39:16.162317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393846,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":32,"num_write":71,"num_write_kb":873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.479783+0000","last_change":"2024-09-10T23:24:05.895799+0000","last_active":"2024-09-10T23:25:22.479783+0000","last_peered":"2024-09-10T23:25:22.479783+0000","last_clean":"2024-09-10T23:25:22.479783+0000","last_became_active":"2024-09-10T23:24:05.895361+0000","last_became_peered":"2024-09-10T23:24:05.895361+0000","last_unstale":"2024-09-10T23:25:22.479783+0000","last_undegraded":"2024-09-10T23:25:22.479783+0000","last_fullsized":"2024-09-10T23:25:22.479783+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:10.893000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.175415+0000","last_change":"2024-09-10T23:23:57.834954+0000","last_active":"2024-09-10T23:26:21.175415+0000","last_peered":"2024-09-10T23:26:21.175415+0000","last_clean":"2024-09-10T23:26:21.175415+0000","last_became_active":"2024-09-10T23:23:57.834215+0000","last_became_peered":"2024-09-10T23:23:57.834215+0000","last_unstale":"2024-09-10T23:26:21.175415+0000","last_undegraded":"2024-09-10T23:26:21.175415+0000","last_fullsized":"2024-09-10T23:26:21.175415+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:19:42.051352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.140302+0000","last_change":"2024-09-10T23:24:22.301029+0000","last_active":"2024-09-10T23:25:22.140302+0000","last_peered":"2024-09-10T23:25:22.140302+0000","last_clean":"2024-09-10T23:25:22.140302+0000","last_became_active":"2024-09-10T23:24:22.297759+0000","last_became_peered":"2024-09-10T23:24:22.297759+0000","last_unstale":"2024-09-10T23:25:22.140302+0000","last_undegraded":"2024-09-10T23:25:22.140302+0000","last_fullsized":"2024-09-10T23:25:22.140302+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:05.364737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.143459+0000","last_change":"2024-09-10T23:24:05.884172+0000","last_active":"2024-09-10T23:25:22.143459+0000","last_peered":"2024-09-10T23:25:22.143459+0000","last_clean":"2024-09-10T23:25:22.143459+0000","last_became_active":"2024-09-10T23:24:05.881918+0000","last_became_peered":"2024-09-10T23:24:05.881918+0000","last_unstale":"2024-09-10T23:25:22.143459+0000","last_undegraded":"2024-09-10T23:25:22.143459+0000","last_fullsized":"2024-09-10T23:25:22.143459+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:19:15.250926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.166507+0000","last_change":"2024-09-10T23:24:22.297163+0000","last_active":"2024-09-10T23:26:21.166507+0000","last_peered":"2024-09-10T23:26:21.166507+0000","last_clean":"2024-09-10T23:26:21.166507+0000","last_became_active":"2024-09-10T23:24:22.296751+0000","last_became_peered":"2024-09-10T23:24:22.296751+0000","last_unstale":"2024-09-10T23:26:21.166507+0000","last_undegraded":"2024-09-10T23:26:21.166507+0000","last_fullsized":"2024-09-10T23:26:21.166507+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:37:50.379101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"90'3","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:12.407353+0000","last_change":"2024-09-10T23:23:54.788008+0000","last_active":"2024-09-10T23:26:12.407353+0000","last_peered":"2024-09-10T23:26:12.407353+0000","last_clean":"2024-09-10T23:26:12.407353+0000","last_became_active":"2024-09-10T23:23:54.787702+0000","last_became_peered":"2024-09-10T23:23:54.787702+0000","last_unstale":"2024-09-10T23:26:12.407353+0000","last_undegraded":"2024-09-10T23:26:12.407353+0000","last_fullsized":"2024-09-10T23:26:12.407353+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:45.997467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144487+0000","last_change":"2024-09-10T23:24:05.887208+0000","last_active":"2024-09-10T23:25:22.144487+0000","last_peered":"2024-09-10T23:25:22.144487+0000","last_clean":"2024-09-10T23:25:22.144487+0000","last_became_active":"2024-09-10T23:24:05.885556+0000","last_became_peered":"2024-09-10T23:24:05.885556+0000","last_unstale":"2024-09-10T23:25:22.144487+0000","last_undegraded":"2024-09-10T23:25:22.144487+0000","last_fullsized":"2024-09-10T23:25:22.144487+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:21.843558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.171810+0000","last_change":"2024-09-10T23:23:57.842937+0000","last_active":"2024-09-10T23:26:21.171810+0000","last_peered":"2024-09-10T23:26:21.171810+0000","last_clean":"2024-09-10T23:26:21.171810+0000","last_became_active":"2024-09-10T23:23:57.842158+0000","last_became_peered":"2024-09-10T23:23:57.842158+0000","last_unstale":"2024-09-10T23:26:21.171810+0000","last_undegraded":"2024-09-10T23:26:21.171810+0000","last_fullsized":"2024-09-10T23:26:21.171810+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:49:58.716816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":62,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.181080+0000","last_change":"2024-09-10T23:23:54.787515+0000","last_active":"2024-09-10T23:25:22.181080+0000","last_peered":"2024-09-10T23:25:22.181080+0000","last_clean":"2024-09-10T23:25:22.181080+0000","last_became_active":"2024-09-10T23:23:54.786950+0000","last_became_peered":"2024-09-10T23:23:54.786950+0000","last_unstale":"2024-09-10T23:25:22.181080+0000","last_undegraded":"2024-09-10T23:25:22.181080+0000","last_fullsized":"2024-09-10T23:25:22.181080+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:12.546459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.140106+0000","last_change":"2024-09-10T23:24:05.882784+0000","last_active":"2024-09-10T23:25:22.140106+0000","last_peered":"2024-09-10T23:25:22.140106+0000","last_clean":"2024-09-10T23:25:22.140106+0000","last_became_active":"2024-09-10T23:24:05.882331+0000","last_became_peered":"2024-09-10T23:24:05.882331+0000","last_unstale":"2024-09-10T23:25:22.140106+0000","last_undegraded":"2024-09-10T23:25:22.140106+0000","last_fullsized":"2024-09-10T23:25:22.140106+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:51:42.519144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.164114+0000","last_change":"2024-09-10T23:23:57.827896+0000","last_active":"2024-09-10T23:26:21.164114+0000","last_peered":"2024-09-10T23:26:21.164114+0000","last_clean":"2024-09-10T23:26:21.164114+0000","last_became_active":"2024-09-10T23:23:57.827572+0000","last_became_peered":"2024-09-10T23:23:57.827572+0000","last_unstale":"2024-09-10T23:26:21.164114+0000","last_undegraded":"2024-09-10T23:26:21.164114+0000","last_fullsized":"2024-09-10T23:26:21.164114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:11.126594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'7","reported_seq":178,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:46.474732+0000","last_change":"2024-09-10T23:23:54.795582+0000","last_active":"2024-09-10T23:26:46.474732+0000","last_peered":"2024-09-10T23:26:46.474732+0000","last_clean":"2024-09-10T23:26:46.474732+0000","last_became_active":"2024-09-10T23:23:54.795225+0000","last_became_peered":"2024-09-10T23:23:54.795225+0000","last_unstale":"2024-09-10T23:26:46.474732+0000","last_undegraded":"2024-09-10T23:26:46.474732+0000","last_fullsized":"2024-09-10T23:26:46.474732+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:11.827090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2004,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":7,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.483416+0000","last_change":"2024-09-10T23:25:22.483250+0000","last_active":"2024-09-10T23:25:22.483416+0000","last_peered":"2024-09-10T23:25:22.483416+0000","last_clean":"2024-09-10T23:25:22.483416+0000","last_became_active":"2024-09-10T23:25:22.482721+0000","last_became_peered":"2024-09-10T23:25:22.482721+0000","last_unstale":"2024-09-10T23:25:22.483416+0000","last_undegraded":"2024-09-10T23:25:22.483416+0000","last_fullsized":"2024-09-10T23:25:22.483416+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:41:31.732139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,7,0,3],"acting":[10,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.183006+0000","last_change":"2024-09-10T23:23:57.843899+0000","last_active":"2024-09-10T23:26:21.183006+0000","last_peered":"2024-09-10T23:26:21.183006+0000","last_clean":"2024-09-10T23:26:21.183006+0000","last_became_active":"2024-09-10T23:23:57.843590+0000","last_became_peered":"2024-09-10T23:23:57.843590+0000","last_unstale":"2024-09-10T23:26:21.183006+0000","last_undegraded":"2024-09-10T23:26:21.183006+0000","last_fullsized":"2024-09-10T23:26:21.183006+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:32:17.919904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144414+0000","last_change":"2024-09-10T23:23:54.795091+0000","last_active":"2024-09-10T23:25:22.144414+0000","last_peered":"2024-09-10T23:25:22.144414+0000","last_clean":"2024-09-10T23:25:22.144414+0000","last_became_active":"2024-09-10T23:23:54.794726+0000","last_became_peered":"2024-09-10T23:23:54.794726+0000","last_unstale":"2024-09-10T23:25:22.144414+0000","last_undegraded":"2024-09-10T23:25:22.144414+0000","last_fullsized":"2024-09-10T23:25:22.144414+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:56:20.322532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.483962+0000","last_change":"2024-09-10T23:25:22.483252+0000","last_active":"2024-09-10T23:25:22.483962+0000","last_peered":"2024-09-10T23:25:22.483962+0000","last_clean":"2024-09-10T23:25:22.483962+0000","last_became_active":"2024-09-10T23:25:22.482719+0000","last_became_peered":"2024-09-10T23:25:22.482719+0000","last_unstale":"2024-09-10T23:25:22.483962+0000","last_undegraded":"2024-09-10T23:25:22.483962+0000","last_fullsized":"2024-09-10T23:25:22.483962+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:36.281256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.166862+0000","last_change":"2024-09-10T23:23:57.823729+0000","last_active":"2024-09-10T23:26:21.166862+0000","last_peered":"2024-09-10T23:26:21.166862+0000","last_clean":"2024-09-10T23:26:21.166862+0000","last_became_active":"2024-09-10T23:23:57.822797+0000","last_became_peered":"2024-09-10T23:23:57.822797+0000","last_unstale":"2024-09-10T23:26:21.166862+0000","last_undegraded":"2024-09-10T23:26:21.166862+0000","last_fullsized":"2024-09-10T23:26:21.166862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:09.646543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.141932+0000","last_change":"2024-09-10T23:24:21.985389+0000","last_active":"2024-09-10T23:25:22.141932+0000","last_peered":"2024-09-10T23:25:22.141932+0000","last_clean":"2024-09-10T23:25:22.141932+0000","last_became_active":"2024-09-10T23:24:21.976084+0000","last_became_peered":"2024-09-10T23:24:21.976084+0000","last_unstale":"2024-09-10T23:25:22.141932+0000","last_undegraded":"2024-09-10T23:25:22.141932+0000","last_fullsized":"2024-09-10T23:25:22.141932+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:33.284211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144976+0000","last_change":"2024-09-10T23:24:05.890656+0000","last_active":"2024-09-10T23:25:22.144976+0000","last_peered":"2024-09-10T23:25:22.144976+0000","last_clean":"2024-09-10T23:25:22.144976+0000","last_became_active":"2024-09-10T23:24:05.889827+0000","last_became_peered":"2024-09-10T23:24:05.889827+0000","last_unstale":"2024-09-10T23:25:22.144976+0000","last_undegraded":"2024-09-10T23:25:22.144976+0000","last_fullsized":"2024-09-10T23:25:22.144976+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:15.301567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.170882+0000","last_change":"2024-09-10T23:23:57.827348+0000","last_active":"2024-09-10T23:26:21.170882+0000","last_peered":"2024-09-10T23:26:21.170882+0000","last_clean":"2024-09-10T23:26:21.170882+0000","last_became_active":"2024-09-10T23:23:57.826670+0000","last_became_peered":"2024-09-10T23:23:57.826670+0000","last_unstale":"2024-09-10T23:26:21.170882+0000","last_undegraded":"2024-09-10T23:26:21.170882+0000","last_fullsized":"2024-09-10T23:26:21.170882+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:19.268930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'38","reported_seq":331,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:46.454902+0000","last_change":"2024-09-10T23:23:54.789603+0000","last_active":"2024-09-10T23:26:46.454902+0000","last_peered":"2024-09-10T23:26:46.454902+0000","last_clean":"2024-09-10T23:26:46.454902+0000","last_became_active":"2024-09-10T23:23:54.789136+0000","last_became_peered":"2024-09-10T23:23:54.789136+0000","last_unstale":"2024-09-10T23:26:46.454902+0000","last_undegraded":"2024-09-10T23:26:46.454902+0000","last_fullsized":"2024-09-10T23:26:46.454902+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:47.648232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69486,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":247,"num_read_kb":191,"num_write":39,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144524+0000","last_change":"2024-09-10T23:24:05.883758+0000","last_active":"2024-09-10T23:25:22.144524+0000","last_peered":"2024-09-10T23:25:22.144524+0000","last_clean":"2024-09-10T23:25:22.144524+0000","last_became_active":"2024-09-10T23:24:05.883401+0000","last_became_peered":"2024-09-10T23:24:05.883401+0000","last_unstale":"2024-09-10T23:25:22.144524+0000","last_undegraded":"2024-09-10T23:25:22.144524+0000","last_fullsized":"2024-09-10T23:25:22.144524+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:52.862088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.189152+0000","last_change":"2024-09-10T23:23:57.846524+0000","last_active":"2024-09-10T23:26:21.189152+0000","last_peered":"2024-09-10T23:26:21.189152+0000","last_clean":"2024-09-10T23:26:21.189152+0000","last_became_active":"2024-09-10T23:23:57.846036+0000","last_became_peered":"2024-09-10T23:23:57.846036+0000","last_unstale":"2024-09-10T23:26:21.189152+0000","last_undegraded":"2024-09-10T23:26:21.189152+0000","last_fullsized":"2024-09-10T23:26:21.189152+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:13.866827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.145163+0000","last_change":"2024-09-10T23:23:54.789925+0000","last_active":"2024-09-10T23:25:22.145163+0000","last_peered":"2024-09-10T23:25:22.145163+0000","last_clean":"2024-09-10T23:25:22.145163+0000","last_became_active":"2024-09-10T23:23:54.789600+0000","last_became_peered":"2024-09-10T23:23:54.789600+0000","last_unstale":"2024-09-10T23:25:22.145163+0000","last_undegraded":"2024-09-10T23:25:22.145163+0000","last_fullsized":"2024-09-10T23:25:22.145163+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:54.937422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.147724+0000","last_change":"2024-09-10T23:24:05.882530+0000","last_active":"2024-09-10T23:25:22.147724+0000","last_peered":"2024-09-10T23:25:22.147724+0000","last_clean":"2024-09-10T23:25:22.147724+0000","last_became_active":"2024-09-10T23:24:05.881092+0000","last_became_peered":"2024-09-10T23:24:05.881092+0000","last_unstale":"2024-09-10T23:25:22.147724+0000","last_undegraded":"2024-09-10T23:25:22.147724+0000","last_fullsized":"2024-09-10T23:25:22.147724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:54.954300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.168450+0000","last_change":"2024-09-10T23:23:57.837341+0000","last_active":"2024-09-10T23:26:21.168450+0000","last_peered":"2024-09-10T23:26:21.168450+0000","last_clean":"2024-09-10T23:26:21.168450+0000","last_became_active":"2024-09-10T23:23:57.837024+0000","last_became_peered":"2024-09-10T23:23:57.837024+0000","last_unstale":"2024-09-10T23:26:21.168450+0000","last_undegraded":"2024-09-10T23:26:21.168450+0000","last_fullsized":"2024-09-10T23:26:21.168450+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:22:48.241471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.481409+0000","last_change":"2024-09-10T23:23:54.792028+0000","last_active":"2024-09-10T23:25:22.481409+0000","last_peered":"2024-09-10T23:25:22.481409+0000","last_clean":"2024-09-10T23:25:22.481409+0000","last_became_active":"2024-09-10T23:23:54.791589+0000","last_became_peered":"2024-09-10T23:23:54.791589+0000","last_unstale":"2024-09-10T23:25:22.481409+0000","last_undegraded":"2024-09-10T23:25:22.481409+0000","last_fullsized":"2024-09-10T23:25:22.481409+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:48.589441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.144216+0000","last_change":"2024-09-10T23:24:05.888627+0000","last_active":"2024-09-10T23:25:22.144216+0000","last_peered":"2024-09-10T23:25:22.144216+0000","last_clean":"2024-09-10T23:25:22.144216+0000","last_became_active":"2024-09-10T23:24:05.887925+0000","last_became_peered":"2024-09-10T23:24:05.887925+0000","last_unstale":"2024-09-10T23:25:22.144216+0000","last_undegraded":"2024-09-10T23:25:22.144216+0000","last_fullsized":"2024-09-10T23:25:22.144216+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:15.956333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.188813+0000","last_change":"2024-09-10T23:23:57.833009+0000","last_active":"2024-09-10T23:26:21.188813+0000","last_peered":"2024-09-10T23:26:21.188813+0000","last_clean":"2024-09-10T23:26:21.188813+0000","last_became_active":"2024-09-10T23:23:57.830782+0000","last_became_peered":"2024-09-10T23:23:57.830782+0000","last_unstale":"2024-09-10T23:26:21.188813+0000","last_undegraded":"2024-09-10T23:26:21.188813+0000","last_fullsized":"2024-09-10T23:26:21.188813+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:42.520461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"90'4","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:45.452664+0000","last_change":"2024-09-10T23:23:54.789322+0000","last_active":"2024-09-10T23:26:45.452664+0000","last_peered":"2024-09-10T23:26:45.452664+0000","last_clean":"2024-09-10T23:26:45.452664+0000","last_became_active":"2024-09-10T23:23:54.788879+0000","last_became_peered":"2024-09-10T23:23:54.788879+0000","last_unstale":"2024-09-10T23:26:45.452664+0000","last_undegraded":"2024-09-10T23:26:45.452664+0000","last_fullsized":"2024-09-10T23:26:45.452664+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:37.276413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480177+0000","last_change":"2024-09-10T23:24:05.886626+0000","last_active":"2024-09-10T23:25:22.480177+0000","last_peered":"2024-09-10T23:25:22.480177+0000","last_clean":"2024-09-10T23:25:22.480177+0000","last_became_active":"2024-09-10T23:24:05.886076+0000","last_became_peered":"2024-09-10T23:24:05.886076+0000","last_unstale":"2024-09-10T23:25:22.480177+0000","last_undegraded":"2024-09-10T23:25:22.480177+0000","last_fullsized":"2024-09-10T23:25:22.480177+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:44.987664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.480182+0000","last_change":"2024-09-10T23:24:05.891242+0000","last_active":"2024-09-10T23:25:22.480182+0000","last_peered":"2024-09-10T23:25:22.480182+0000","last_clean":"2024-09-10T23:25:22.480182+0000","last_became_active":"2024-09-10T23:24:05.889513+0000","last_became_peered":"2024-09-10T23:24:05.889513+0000","last_unstale":"2024-09-10T23:25:22.480182+0000","last_undegraded":"2024-09-10T23:25:22.480182+0000","last_fullsized":"2024-09-10T23:25:22.480182+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:07.774304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.176320+0000","last_change":"2024-09-10T23:23:57.831698+0000","last_active":"2024-09-10T23:26:21.176320+0000","last_peered":"2024-09-10T23:26:21.176320+0000","last_clean":"2024-09-10T23:26:21.176320+0000","last_became_active":"2024-09-10T23:23:57.829348+0000","last_became_peered":"2024-09-10T23:23:57.829348+0000","last_unstale":"2024-09-10T23:26:21.176320+0000","last_undegraded":"2024-09-10T23:26:21.176320+0000","last_fullsized":"2024-09-10T23:26:21.176320+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:09.636786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.143717+0000","last_change":"2024-09-10T23:23:54.795380+0000","last_active":"2024-09-10T23:25:22.143717+0000","last_peered":"2024-09-10T23:25:22.143717+0000","last_clean":"2024-09-10T23:25:22.143717+0000","last_became_active":"2024-09-10T23:23:54.794465+0000","last_became_peered":"2024-09-10T23:23:54.794465+0000","last_unstale":"2024-09-10T23:25:22.143717+0000","last_undegraded":"2024-09-10T23:25:22.143717+0000","last_fullsized":"2024-09-10T23:25:22.143717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:32.082020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.142451+0000","last_change":"2024-09-10T23:24:05.886531+0000","last_active":"2024-09-10T23:25:22.142451+0000","last_peered":"2024-09-10T23:25:22.142451+0000","last_clean":"2024-09-10T23:25:22.142451+0000","last_became_active":"2024-09-10T23:24:05.885762+0000","last_became_peered":"2024-09-10T23:24:05.885762+0000","last_unstale":"2024-09-10T23:25:22.142451+0000","last_undegraded":"2024-09-10T23:25:22.142451+0000","last_fullsized":"2024-09-10T23:25:22.142451+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:35.407364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.170969+0000","last_change":"2024-09-10T23:23:57.828052+0000","last_active":"2024-09-10T23:26:21.170969+0000","last_peered":"2024-09-10T23:26:21.170969+0000","last_clean":"2024-09-10T23:26:21.170969+0000","last_became_active":"2024-09-10T23:23:57.827653+0000","last_became_peered":"2024-09-10T23:23:57.827653+0000","last_unstale":"2024-09-10T23:26:21.170969+0000","last_undegraded":"2024-09-10T23:26:21.170969+0000","last_fullsized":"2024-09-10T23:26:21.170969+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:33.605054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.139104+0000","last_change":"2024-09-10T23:23:54.791375+0000","last_active":"2024-09-10T23:25:22.139104+0000","last_peered":"2024-09-10T23:25:22.139104+0000","last_clean":"2024-09-10T23:25:22.139104+0000","last_became_active":"2024-09-10T23:23:54.790974+0000","last_became_peered":"2024-09-10T23:23:54.790974+0000","last_unstale":"2024-09-10T23:25:22.139104+0000","last_undegraded":"2024-09-10T23:25:22.139104+0000","last_fullsized":"2024-09-10T23:25:22.139104+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:23:44.066787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.149326+0000","last_change":"2024-09-10T23:23:54.792056+0000","last_active":"2024-09-10T23:25:22.149326+0000","last_peered":"2024-09-10T23:25:22.149326+0000","last_clean":"2024-09-10T23:25:22.149326+0000","last_became_active":"2024-09-10T23:23:54.791665+0000","last_became_peered":"2024-09-10T23:23:54.791665+0000","last_unstale":"2024-09-10T23:25:22.149326+0000","last_undegraded":"2024-09-10T23:25:22.149326+0000","last_fullsized":"2024-09-10T23:25:22.149326+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:34:38.517066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.167402+0000","last_change":"2024-09-10T23:23:57.842524+0000","last_active":"2024-09-10T23:26:21.167402+0000","last_peered":"2024-09-10T23:26:21.167402+0000","last_clean":"2024-09-10T23:26:21.167402+0000","last_became_active":"2024-09-10T23:23:57.842033+0000","last_became_peered":"2024-09-10T23:23:57.842033+0000","last_unstale":"2024-09-10T23:26:21.167402+0000","last_undegraded":"2024-09-10T23:26:21.167402+0000","last_fullsized":"2024-09-10T23:26:21.167402+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:39.431115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.140947+0000","last_change":"2024-09-10T23:24:05.891676+0000","last_active":"2024-09-10T23:25:22.140947+0000","last_peered":"2024-09-10T23:25:22.140947+0000","last_clean":"2024-09-10T23:25:22.140947+0000","last_became_active":"2024-09-10T23:24:05.891224+0000","last_became_peered":"2024-09-10T23:24:05.891224+0000","last_unstale":"2024-09-10T23:25:22.140947+0000","last_undegraded":"2024-09-10T23:25:22.140947+0000","last_fullsized":"2024-09-10T23:25:22.140947+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:16:50.384745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'6","reported_seq":174,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:46.455395+0000","last_change":"2024-09-10T23:23:54.795126+0000","last_active":"2024-09-10T23:26:46.455395+0000","last_peered":"2024-09-10T23:26:46.455395+0000","last_clean":"2024-09-10T23:26:46.455395+0000","last_became_active":"2024-09-10T23:23:54.794553+0000","last_became_peered":"2024-09-10T23:23:54.794553+0000","last_unstale":"2024-09-10T23:26:46.455395+0000","last_undegraded":"2024-09-10T23:26:46.455395+0000","last_fullsized":"2024-09-10T23:26:46.455395+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:53.760716+0000","last_clean_scrub_stamp":"2024-09-10T23:23:53.760716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:15:43.181180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1115,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.166101+0000","last_change":"2024-09-10T23:23:57.826827+0000","last_active":"2024-09-10T23:26:21.166101+0000","last_peered":"2024-09-10T23:26:21.166101+0000","last_clean":"2024-09-10T23:26:21.166101+0000","last_became_active":"2024-09-10T23:23:57.826457+0000","last_became_peered":"2024-09-10T23:23:57.826457+0000","last_unstale":"2024-09-10T23:26:21.166101+0000","last_undegraded":"2024-09-10T23:26:21.166101+0000","last_fullsized":"2024-09-10T23:26:21.166101+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:13.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:25:22.141368+0000","last_change":"2024-09-10T23:24:05.888774+0000","last_active":"2024-09-10T23:25:22.141368+0000","last_peered":"2024-09-10T23:25:22.141368+0000","last_clean":"2024-09-10T23:25:22.141368+0000","last_became_active":"2024-09-10T23:24:05.888267+0000","last_became_peered":"2024-09-10T23:24:05.888267+0000","last_unstale":"2024-09-10T23:25:22.141368+0000","last_undegraded":"2024-09-10T23:25:22.141368+0000","last_fullsized":"2024-09-10T23:25:22.141368+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:04.856717+0000","last_clean_scrub_stamp":"2024-09-10T23:24:04.856717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:29.283509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.161996+0000","last_change":"2024-09-10T23:23:57.819178+0000","last_active":"2024-09-10T23:26:21.161996+0000","last_peered":"2024-09-10T23:26:21.161996+0000","last_clean":"2024-09-10T23:26:21.161996+0000","last_became_active":"2024-09-10T23:23:57.817029+0000","last_became_peered":"2024-09-10T23:23:57.817029+0000","last_unstale":"2024-09-10T23:26:21.161996+0000","last_undegraded":"2024-09-10T23:26:21.161996+0000","last_fullsized":"2024-09-10T23:26:21.161996+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:28:51.491402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.172379+0000","last_change":"2024-09-10T23:24:21.978215+0000","last_active":"2024-09-10T23:26:21.172379+0000","last_peered":"2024-09-10T23:26:21.172379+0000","last_clean":"2024-09-10T23:26:21.172379+0000","last_became_active":"2024-09-10T23:24:21.977811+0000","last_became_peered":"2024-09-10T23:24:21.977811+0000","last_unstale":"2024-09-10T23:26:21.172379+0000","last_undegraded":"2024-09-10T23:26:21.172379+0000","last_fullsized":"2024-09-10T23:26:21.172379+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:41.769216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.164810+0000","last_change":"2024-09-10T23:23:57.824147+0000","last_active":"2024-09-10T23:26:21.164810+0000","last_peered":"2024-09-10T23:26:21.164810+0000","last_clean":"2024-09-10T23:26:21.164810+0000","last_became_active":"2024-09-10T23:23:57.823503+0000","last_became_peered":"2024-09-10T23:23:57.823503+0000","last_unstale":"2024-09-10T23:26:21.164810+0000","last_undegraded":"2024-09-10T23:26:21.164810+0000","last_fullsized":"2024-09-10T23:26:21.164810+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:12:34.310648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.178151+0000","last_change":"2024-09-10T23:23:57.841413+0000","last_active":"2024-09-10T23:26:21.178151+0000","last_peered":"2024-09-10T23:26:21.178151+0000","last_clean":"2024-09-10T23:26:21.178151+0000","last_became_active":"2024-09-10T23:23:57.840889+0000","last_became_peered":"2024-09-10T23:23:57.840889+0000","last_unstale":"2024-09-10T23:26:21.178151+0000","last_undegraded":"2024-09-10T23:26:21.178151+0000","last_fullsized":"2024-09-10T23:26:21.178151+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:10:08.757628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.173077+0000","last_change":"2024-09-10T23:23:57.837267+0000","last_active":"2024-09-10T23:26:21.173077+0000","last_peered":"2024-09-10T23:26:21.173077+0000","last_clean":"2024-09-10T23:26:21.173077+0000","last_became_active":"2024-09-10T23:23:57.836911+0000","last_became_peered":"2024-09-10T23:23:57.836911+0000","last_unstale":"2024-09-10T23:26:21.173077+0000","last_undegraded":"2024-09-10T23:26:21.173077+0000","last_fullsized":"2024-09-10T23:26:21.173077+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:24.969215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.165488+0000","last_change":"2024-09-10T23:23:57.813855+0000","last_active":"2024-09-10T23:26:21.165488+0000","last_peered":"2024-09-10T23:26:21.165488+0000","last_clean":"2024-09-10T23:26:21.165488+0000","last_became_active":"2024-09-10T23:23:57.812862+0000","last_became_peered":"2024-09-10T23:23:57.812862+0000","last_unstale":"2024-09-10T23:26:21.165488+0000","last_undegraded":"2024-09-10T23:26:21.165488+0000","last_fullsized":"2024-09-10T23:26:21.165488+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:21.542499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.184491+0000","last_change":"2024-09-10T23:23:57.826082+0000","last_active":"2024-09-10T23:26:21.184491+0000","last_peered":"2024-09-10T23:26:21.184491+0000","last_clean":"2024-09-10T23:26:21.184491+0000","last_became_active":"2024-09-10T23:23:57.825695+0000","last_became_peered":"2024-09-10T23:23:57.825695+0000","last_unstale":"2024-09-10T23:26:21.184491+0000","last_undegraded":"2024-09-10T23:26:21.184491+0000","last_fullsized":"2024-09-10T23:26:21.184491+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:08.518084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.157077+0000","last_change":"2024-09-10T23:23:57.835147+0000","last_active":"2024-09-10T23:26:21.157077+0000","last_peered":"2024-09-10T23:26:21.157077+0000","last_clean":"2024-09-10T23:26:21.157077+0000","last_became_active":"2024-09-10T23:23:57.834739+0000","last_became_peered":"2024-09-10T23:23:57.834739+0000","last_unstale":"2024-09-10T23:26:21.157077+0000","last_undegraded":"2024-09-10T23:26:21.157077+0000","last_fullsized":"2024-09-10T23:26:21.157077+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:06:27.023088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.164735+0000","last_change":"2024-09-10T23:23:57.825996+0000","last_active":"2024-09-10T23:26:21.164735+0000","last_peered":"2024-09-10T23:26:21.164735+0000","last_clean":"2024-09-10T23:26:21.164735+0000","last_became_active":"2024-09-10T23:23:57.824168+0000","last_became_peered":"2024-09-10T23:23:57.824168+0000","last_unstale":"2024-09-10T23:26:21.164735+0000","last_undegraded":"2024-09-10T23:26:21.164735+0000","last_fullsized":"2024-09-10T23:26:21.164735+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:36.396179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.166612+0000","last_change":"2024-09-10T23:24:21.976841+0000","last_active":"2024-09-10T23:26:21.166612+0000","last_peered":"2024-09-10T23:26:21.166612+0000","last_clean":"2024-09-10T23:26:21.166612+0000","last_became_active":"2024-09-10T23:24:21.976461+0000","last_became_peered":"2024-09-10T23:24:21.976461+0000","last_unstale":"2024-09-10T23:26:21.166612+0000","last_undegraded":"2024-09-10T23:26:21.166612+0000","last_fullsized":"2024-09-10T23:26:21.166612+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:04:00.000274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.182479+0000","last_change":"2024-09-10T23:23:57.840477+0000","last_active":"2024-09-10T23:26:21.182479+0000","last_peered":"2024-09-10T23:26:21.182479+0000","last_clean":"2024-09-10T23:26:21.182479+0000","last_became_active":"2024-09-10T23:23:57.840113+0000","last_became_peered":"2024-09-10T23:23:57.840113+0000","last_unstale":"2024-09-10T23:26:21.182479+0000","last_undegraded":"2024-09-10T23:26:21.182479+0000","last_fullsized":"2024-09-10T23:26:21.182479+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:27:23.913802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.180371+0000","last_change":"2024-09-10T23:23:57.837416+0000","last_active":"2024-09-10T23:26:21.180371+0000","last_peered":"2024-09-10T23:26:21.180371+0000","last_clean":"2024-09-10T23:26:21.180371+0000","last_became_active":"2024-09-10T23:23:57.837104+0000","last_became_peered":"2024-09-10T23:23:57.837104+0000","last_unstale":"2024-09-10T23:26:21.180371+0000","last_undegraded":"2024-09-10T23:26:21.180371+0000","last_fullsized":"2024-09-10T23:26:21.180371+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:00.712148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.166773+0000","last_change":"2024-09-10T23:23:57.838304+0000","last_active":"2024-09-10T23:26:21.166773+0000","last_peered":"2024-09-10T23:26:21.166773+0000","last_clean":"2024-09-10T23:26:21.166773+0000","last_became_active":"2024-09-10T23:23:57.837677+0000","last_became_peered":"2024-09-10T23:23:57.837677+0000","last_unstale":"2024-09-10T23:26:21.166773+0000","last_undegraded":"2024-09-10T23:26:21.166773+0000","last_fullsized":"2024-09-10T23:26:21.166773+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:40.862950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.166514+0000","last_change":"2024-09-10T23:23:57.825579+0000","last_active":"2024-09-10T23:26:21.166514+0000","last_peered":"2024-09-10T23:26:21.166514+0000","last_clean":"2024-09-10T23:26:21.166514+0000","last_became_active":"2024-09-10T23:23:57.824840+0000","last_became_peered":"2024-09-10T23:23:57.824840+0000","last_unstale":"2024-09-10T23:26:21.166514+0000","last_undegraded":"2024-09-10T23:26:21.166514+0000","last_fullsized":"2024-09-10T23:26:21.166514+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:53:35.150858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.181556+0000","last_change":"2024-09-10T23:23:57.833479+0000","last_active":"2024-09-10T23:26:21.181556+0000","last_peered":"2024-09-10T23:26:21.181556+0000","last_clean":"2024-09-10T23:26:21.181556+0000","last_became_active":"2024-09-10T23:23:57.833124+0000","last_became_peered":"2024-09-10T23:23:57.833124+0000","last_unstale":"2024-09-10T23:26:21.181556+0000","last_undegraded":"2024-09-10T23:26:21.181556+0000","last_fullsized":"2024-09-10T23:26:21.181556+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:02.869308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.185986+0000","last_change":"2024-09-10T23:23:57.831610+0000","last_active":"2024-09-10T23:26:21.185986+0000","last_peered":"2024-09-10T23:26:21.185986+0000","last_clean":"2024-09-10T23:26:21.185986+0000","last_became_active":"2024-09-10T23:23:57.831227+0000","last_became_peered":"2024-09-10T23:23:57.831227+0000","last_unstale":"2024-09-10T23:26:21.185986+0000","last_undegraded":"2024-09-10T23:26:21.185986+0000","last_fullsized":"2024-09-10T23:26:21.185986+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:45.735286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.180683+0000","last_change":"2024-09-10T23:23:57.839295+0000","last_active":"2024-09-10T23:26:21.180683+0000","last_peered":"2024-09-10T23:26:21.180683+0000","last_clean":"2024-09-10T23:26:21.180683+0000","last_became_active":"2024-09-10T23:23:57.838857+0000","last_became_peered":"2024-09-10T23:23:57.838857+0000","last_unstale":"2024-09-10T23:26:21.180683+0000","last_undegraded":"2024-09-10T23:26:21.180683+0000","last_fullsized":"2024-09-10T23:26:21.180683+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:20:13.203324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.165534+0000","last_change":"2024-09-10T23:23:57.841459+0000","last_active":"2024-09-10T23:26:21.165534+0000","last_peered":"2024-09-10T23:26:21.165534+0000","last_clean":"2024-09-10T23:26:21.165534+0000","last_became_active":"2024-09-10T23:23:57.841049+0000","last_became_peered":"2024-09-10T23:23:57.841049+0000","last_unstale":"2024-09-10T23:26:21.165534+0000","last_undegraded":"2024-09-10T23:26:21.165534+0000","last_fullsized":"2024-09-10T23:26:21.165534+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:39:51.372657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.164155+0000","last_change":"2024-09-10T23:23:57.813028+0000","last_active":"2024-09-10T23:26:21.164155+0000","last_peered":"2024-09-10T23:26:21.164155+0000","last_clean":"2024-09-10T23:26:21.164155+0000","last_became_active":"2024-09-10T23:23:57.812648+0000","last_became_peered":"2024-09-10T23:23:57.812648+0000","last_unstale":"2024-09-10T23:26:21.164155+0000","last_undegraded":"2024-09-10T23:26:21.164155+0000","last_fullsized":"2024-09-10T23:26:21.164155+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:57.691811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.179739+0000","last_change":"2024-09-10T23:23:57.814467+0000","last_active":"2024-09-10T23:26:21.179739+0000","last_peered":"2024-09-10T23:26:21.179739+0000","last_clean":"2024-09-10T23:26:21.179739+0000","last_became_active":"2024-09-10T23:23:57.812286+0000","last_became_peered":"2024-09-10T23:23:57.812286+0000","last_unstale":"2024-09-10T23:26:21.179739+0000","last_undegraded":"2024-09-10T23:26:21.179739+0000","last_fullsized":"2024-09-10T23:26:21.179739+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:42.044495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.171818+0000","last_change":"2024-09-10T23:23:57.834679+0000","last_active":"2024-09-10T23:26:21.171818+0000","last_peered":"2024-09-10T23:26:21.171818+0000","last_clean":"2024-09-10T23:26:21.171818+0000","last_became_active":"2024-09-10T23:23:57.833964+0000","last_became_peered":"2024-09-10T23:23:57.833964+0000","last_unstale":"2024-09-10T23:26:21.171818+0000","last_undegraded":"2024-09-10T23:26:21.171818+0000","last_fullsized":"2024-09-10T23:26:21.171818+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:29.160280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.187632+0000","last_change":"2024-09-10T23:23:57.840788+0000","last_active":"2024-09-10T23:26:21.187632+0000","last_peered":"2024-09-10T23:26:21.187632+0000","last_clean":"2024-09-10T23:26:21.187632+0000","last_became_active":"2024-09-10T23:23:57.839946+0000","last_became_peered":"2024-09-10T23:23:57.839946+0000","last_unstale":"2024-09-10T23:26:21.187632+0000","last_undegraded":"2024-09-10T23:26:21.187632+0000","last_fullsized":"2024-09-10T23:26:21.187632+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:14.354925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.173950+0000","last_change":"2024-09-10T23:23:57.843454+0000","last_active":"2024-09-10T23:26:21.173950+0000","last_peered":"2024-09-10T23:26:21.173950+0000","last_clean":"2024-09-10T23:26:21.173950+0000","last_became_active":"2024-09-10T23:23:57.841623+0000","last_became_peered":"2024-09-10T23:23:57.841623+0000","last_unstale":"2024-09-10T23:26:21.173950+0000","last_undegraded":"2024-09-10T23:26:21.173950+0000","last_fullsized":"2024-09-10T23:26:21.173950+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:03:03.957444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.174992+0000","last_change":"2024-09-10T23:23:57.834196+0000","last_active":"2024-09-10T23:26:21.174992+0000","last_peered":"2024-09-10T23:26:21.174992+0000","last_clean":"2024-09-10T23:26:21.174992+0000","last_became_active":"2024-09-10T23:23:57.833692+0000","last_became_peered":"2024-09-10T23:23:57.833692+0000","last_unstale":"2024-09-10T23:26:21.174992+0000","last_undegraded":"2024-09-10T23:26:21.174992+0000","last_fullsized":"2024-09-10T23:26:21.174992+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:49.814475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.171348+0000","last_change":"2024-09-10T23:23:57.831457+0000","last_active":"2024-09-10T23:26:21.171348+0000","last_peered":"2024-09-10T23:26:21.171348+0000","last_clean":"2024-09-10T23:26:21.171348+0000","last_became_active":"2024-09-10T23:23:57.829686+0000","last_became_peered":"2024-09-10T23:23:57.829686+0000","last_unstale":"2024-09-10T23:26:21.171348+0000","last_undegraded":"2024-09-10T23:26:21.171348+0000","last_fullsized":"2024-09-10T23:26:21.171348+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:39.204501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.177997+0000","last_change":"2024-09-10T23:23:57.829437+0000","last_active":"2024-09-10T23:26:21.177997+0000","last_peered":"2024-09-10T23:26:21.177997+0000","last_clean":"2024-09-10T23:26:21.177997+0000","last_became_active":"2024-09-10T23:23:57.828956+0000","last_became_peered":"2024-09-10T23:23:57.828956+0000","last_unstale":"2024-09-10T23:26:21.177997+0000","last_undegraded":"2024-09-10T23:26:21.177997+0000","last_fullsized":"2024-09-10T23:26:21.177997+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:18.191002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.175037+0000","last_change":"2024-09-10T23:23:57.839661+0000","last_active":"2024-09-10T23:26:21.175037+0000","last_peered":"2024-09-10T23:26:21.175037+0000","last_clean":"2024-09-10T23:26:21.175037+0000","last_became_active":"2024-09-10T23:23:57.839197+0000","last_became_peered":"2024-09-10T23:23:57.839197+0000","last_unstale":"2024-09-10T23:26:21.175037+0000","last_undegraded":"2024-09-10T23:26:21.175037+0000","last_fullsized":"2024-09-10T23:26:21.175037+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:33.599860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.176613+0000","last_change":"2024-09-10T23:23:57.820968+0000","last_active":"2024-09-10T23:26:21.176613+0000","last_peered":"2024-09-10T23:26:21.176613+0000","last_clean":"2024-09-10T23:26:21.176613+0000","last_became_active":"2024-09-10T23:23:57.820108+0000","last_became_peered":"2024-09-10T23:23:57.820108+0000","last_unstale":"2024-09-10T23:26:21.176613+0000","last_undegraded":"2024-09-10T23:26:21.176613+0000","last_fullsized":"2024-09-10T23:26:21.176613+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:23.864751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.168522+0000","last_change":"2024-09-10T23:23:57.842302+0000","last_active":"2024-09-10T23:26:21.168522+0000","last_peered":"2024-09-10T23:26:21.168522+0000","last_clean":"2024-09-10T23:26:21.168522+0000","last_became_active":"2024-09-10T23:23:57.838460+0000","last_became_peered":"2024-09-10T23:23:57.838460+0000","last_unstale":"2024-09-10T23:26:21.168522+0000","last_undegraded":"2024-09-10T23:26:21.168522+0000","last_fullsized":"2024-09-10T23:26:21.168522+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:54.731481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.185496+0000","last_change":"2024-09-10T23:23:57.837749+0000","last_active":"2024-09-10T23:26:21.185496+0000","last_peered":"2024-09-10T23:26:21.185496+0000","last_clean":"2024-09-10T23:26:21.185496+0000","last_became_active":"2024-09-10T23:23:57.836195+0000","last_became_peered":"2024-09-10T23:23:57.836195+0000","last_unstale":"2024-09-10T23:26:21.185496+0000","last_undegraded":"2024-09-10T23:26:21.185496+0000","last_fullsized":"2024-09-10T23:26:21.185496+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:10.064725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.164284+0000","last_change":"2024-09-10T23:23:57.812182+0000","last_active":"2024-09-10T23:26:21.164284+0000","last_peered":"2024-09-10T23:26:21.164284+0000","last_clean":"2024-09-10T23:26:21.164284+0000","last_became_active":"2024-09-10T23:23:57.811853+0000","last_became_peered":"2024-09-10T23:23:57.811853+0000","last_unstale":"2024-09-10T23:26:21.164284+0000","last_undegraded":"2024-09-10T23:26:21.164284+0000","last_fullsized":"2024-09-10T23:26:21.164284+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:03.389054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.185862+0000","last_change":"2024-09-10T23:23:57.833957+0000","last_active":"2024-09-10T23:26:21.185862+0000","last_peered":"2024-09-10T23:26:21.185862+0000","last_clean":"2024-09-10T23:26:21.185862+0000","last_became_active":"2024-09-10T23:23:57.833547+0000","last_became_peered":"2024-09-10T23:23:57.833547+0000","last_unstale":"2024-09-10T23:26:21.185862+0000","last_undegraded":"2024-09-10T23:26:21.185862+0000","last_fullsized":"2024-09-10T23:26:21.185862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:23:56.787265+0000","last_clean_scrub_stamp":"2024-09-10T23:23:56.787265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:30.917801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":861997,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":1079,"num_read_kb":750,"num_write":411,"num_write_kb":2226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":663552,"data_stored":2583471,"data_compressed":117732,"data_compressed_allocated":159744,"data_compressed_original":2310144,"omap_allocated":0,"internal_metadata":0},"log_size":302,"ondisk_log_size":302,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":288697,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678066,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":999424,"data_stored":535193,"data_compressed":32452,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874296,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28200,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716952,"statfs":{"total":95995035648,"available":95966158848,"internally_reserved":0,"allocated":1196032,"data_stored":1587105,"data_compressed":89105,"data_compressed_allocated":118784,"data_compressed_original":1056768,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037821,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":932707,"data_compressed":51741,"data_compressed_allocated":69632,"data_compressed_original":483328,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234051,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":928531,"data_compressed":51741,"data_compressed_allocated":69632,"data_compressed_original":483328,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430281,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1060864,"data_stored":1132742,"data_compressed":69150,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593808,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":530571,"data_compressed":32452,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790038,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32284,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712868,"statfs":{"total":95995035648,"available":95961976832,"internally_reserved":0,"allocated":1122304,"data_stored":1520690,"data_compressed":87241,"data_compressed_allocated":114688,"data_compressed_original":1048576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953564,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":536637,"data_compressed":32452,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149793,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32244,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712908,"statfs":{"total":95995035648,"available":95962017792,"internally_reserved":0,"allocated":1081344,"data_stored":1317757,"data_compressed":69832,"data_compressed_allocated":94208,"data_compressed_original":851968,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378728,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32240,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712912,"statfs":{"total":95995035648,"available":95962021888,"internally_reserved":0,"allocated":1081344,"data_stored":601776,"data_compressed":34316,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542251,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1060864,"data_stored":597447,"data_compressed":34316,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705778,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32176,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712976,"statfs":{"total":95995035648,"available":95962087424,"internally_reserved":0,"allocated":1015808,"data_stored":531959,"data_compressed":32452,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36698,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":66966,"data_compressed":1864,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":71295,"data_compressed":1864,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":787276,"data_compressed":37380,"data_compressed_allocated":49152,"data_compressed_original":761856,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":395745,"data_compressed":18091,"data_compressed_allocated":24576,"data_compressed_original":368640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":393954,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394034,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":466256,"data_compressed":19955,"data_compressed_allocated":28672,"data_compressed_original":376832,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:26:51.001 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:26:51.384 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:51.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:51 smithi038 ceph-mon[34225]: from='client.15570 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:26:51.670 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:51 smithi003 ceph-mon[30348]: from='client.15570 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:26:51.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:51 smithi194 ceph-mon[33904]: from='client.15570 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:26:51.936 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.935+0000 7f4cd4000640 1 -- 172.21.15.3:0/1645255948 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4ccc104fb0 msgr2=0x7f4ccc105390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:51.936 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.935+0000 7f4cd4000640 1 --2- 172.21.15.3:0/1645255948 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4ccc104fb0 0x7f4ccc105390 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0009900 tx=0x7f4cc002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:26:51.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.935+0000 7f4cd4000640 1 -- 172.21.15.3:0/1645255948 shutdown_connections 2024-09-10T23:26:51.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.935+0000 7f4cd4000640 1 --2- 172.21.15.3:0/1645255948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ccc10b340 0x7f4ccc111b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:51.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.935+0000 7f4cd4000640 1 --2- 172.21.15.3:0/1645255948 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ccc10a9c0 0x7f4ccc10ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:51.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.935+0000 7f4cd4000640 1 --2- 172.21.15.3:0/1645255948 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4ccc104fb0 0x7f4ccc105390 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:51.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.935+0000 7f4cd4000640 1 -- 172.21.15.3:0/1645255948 >> 172.21.15.3:0/1645255948 conn(0x7f4ccc100a20 msgr2=0x7f4ccc102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:51.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.935+0000 7f4cd4000640 1 -- 172.21.15.3:0/1645255948 shutdown_connections 2024-09-10T23:26:51.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.935+0000 7f4cd4000640 1 -- 172.21.15.3:0/1645255948 wait complete. 2024-09-10T23:26:51.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.936+0000 7f4cd4000640 1 Processor -- start 2024-09-10T23:26:51.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.936+0000 7f4cd4000640 1 -- start start 2024-09-10T23:26:51.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.936+0000 7f4cd4000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ccc104fb0 0x7f4ccc19b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:51.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.936+0000 7f4cd4000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4ccc10a9c0 0x7f4ccc19b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:51.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.936+0000 7f4cd4000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ccc10b340 0x7f4ccc1a0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:51.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.936+0000 7f4cd4000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f4ccc114e50 con 0x7f4ccc10a9c0 2024-09-10T23:26:51.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.936+0000 7f4cd4000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4ccc114cd0 con 0x7f4ccc104fb0 2024-09-10T23:26:51.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.937+0000 7f4cd4000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4ccc114fd0 con 0x7f4ccc10b340 2024-09-10T23:26:51.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.937+0000 7f4cd0c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4ccc10a9c0 0x7f4ccc19b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:51.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.937+0000 7f4cd0c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4ccc10a9c0 0x7f4ccc19b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34162/0 (socket says 172.21.15.3:34162) 2024-09-10T23:26:51.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.937+0000 7f4cd0c00640 1 -- 172.21.15.3:0/2465746954 learned_addr learned my addr 172.21.15.3:0/2465746954 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:51.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.937+0000 7f4cd1600640 1 --2- 172.21.15.3:0/2465746954 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ccc104fb0 0x7f4ccc19b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:51.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.937+0000 7f4cd2000640 1 --2- 172.21.15.3:0/2465746954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ccc10b340 0x7f4ccc1a0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:51.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.937+0000 7f4cd0c00640 1 -- 172.21.15.3:0/2465746954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ccc10b340 msgr2=0x7f4ccc1a0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:51.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.937+0000 7f4cd0c00640 1 --2- 172.21.15.3:0/2465746954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ccc10b340 0x7f4ccc1a0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:51.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.937+0000 7f4cd0c00640 1 -- 172.21.15.3:0/2465746954 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ccc104fb0 msgr2=0x7f4ccc19b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:51.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.937+0000 7f4cd0c00640 1 --2- 172.21.15.3:0/2465746954 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ccc104fb0 0x7f4ccc19b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:51.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.937+0000 7f4cd0c00640 1 -- 172.21.15.3:0/2465746954 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ccc1a1470 con 0x7f4ccc10a9c0 2024-09-10T23:26:51.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.937+0000 7f4cd2000640 1 --2- 172.21.15.3:0/2465746954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ccc10b340 0x7f4ccc1a0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:51.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.938+0000 7f4cd0c00640 1 --2- 172.21.15.3:0/2465746954 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4ccc10a9c0 0x7f4ccc19b900 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800d950 tx=0x7f4cb800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:51.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.938+0000 7f4cca000640 1 -- 172.21.15.3:0/2465746954 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb8017070 con 0x7f4ccc10a9c0 2024-09-10T23:26:51.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.938+0000 7f4cd4000640 1 -- 172.21.15.3:0/2465746954 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ccc1a1760 con 0x7f4ccc10a9c0 2024-09-10T23:26:51.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.938+0000 7f4cca000640 1 -- 172.21.15.3:0/2465746954 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4cb8009c30 con 0x7f4ccc10a9c0 2024-09-10T23:26:51.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.938+0000 7f4cca000640 1 -- 172.21.15.3:0/2465746954 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb800f620 con 0x7f4ccc10a9c0 2024-09-10T23:26:51.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.938+0000 7f4cd4000640 1 -- 172.21.15.3:0/2465746954 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ccc1a7ff0 con 0x7f4ccc10a9c0 2024-09-10T23:26:51.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.939+0000 7f4cd4000640 1 -- 172.21.15.3:0/2465746954 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ccc106260 con 0x7f4ccc10a9c0 2024-09-10T23:26:51.942 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.941+0000 7f4cca000640 1 -- 172.21.15.3:0/2465746954 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 24) ==== 153374+0+0 (secure 0 0 0) 0x7f4cb8010460 con 0x7f4ccc10a9c0 2024-09-10T23:26:51.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.943+0000 7f4cca000640 1 --2- 172.21.15.3:0/2465746954 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f4cb40b5450 0x7f4cb40b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:51.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.943+0000 7f4cca000640 1 -- 172.21.15.3:0/2465746954 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f4cb80e5fe0 con 0x7f4ccc10a9c0 2024-09-10T23:26:51.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.943+0000 7f4cd1600640 1 --2- 172.21.15.3:0/2465746954 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f4cb40b5450 0x7f4cb40b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:51.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.944+0000 7f4cd1600640 1 --2- 172.21.15.3:0/2465746954 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f4cb40b5450 0x7f4cb40b7910 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0006010 tx=0x7f4cc0005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:51.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:51.946+0000 7f4cca000640 1 -- 172.21.15.3:0/2465746954 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4cb80ac790 con 0x7f4ccc10a9c0 2024-09-10T23:26:52.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:52.180+0000 7f4cd4000640 1 -- 172.21.15.3:0/2465746954 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ccc10d120 con 0x7f4ccc10a9c0 2024-09-10T23:26:52.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:52.181+0000 7f4cca000640 1 -- 172.21.15.3:0/2465746954 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11891 (secure 0 0 0) 0x7f4cb8009de0 con 0x7f4ccc10a9c0 2024-09-10T23:26:52.182 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:26:52.182 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":26,"btime":"2024-09-10T23:26:42:260644+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/1495411512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":1495411512},{"type":"v1","addr":"172.21.15.3:6835","nonce":1495411512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/1857372777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1857372777},{"type":"v1","addr":"172.21.15.3:6837","nonce":1857372777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14862,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6839/493850676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":493850676},{"type":"v1","addr":"172.21.15.3:6839","nonce":493850676}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14874,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6841/1580524358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":1580524358},{"type":"v1","addr":"172.21.15.3:6841","nonce":1580524358}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/352514665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":352514665},{"type":"v1","addr":"172.21.15.194:6833","nonce":352514665}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2380508105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2380508105},{"type":"v1","addr":"172.21.15.194:6835","nonce":2380508105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:23:58.866253+0000","modified":"2024-09-10T23:26:41.694795+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34724,"mds_1":34682,"mds_2":34652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24649":{"gid":24649,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/739730313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":739730313},{"type":"v1","addr":"172.21.15.194:6837","nonce":739730313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/3198777710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3198777710},{"type":"v1","addr":"172.21.15.194:6839","nonce":3198777710}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34619":{"gid":34619,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6833/1194099617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1194099617},{"type":"v1","addr":"172.21.15.38:6833","nonce":1194099617}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34652":{"gid":34652,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.38:6835/218783320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":218783320},{"type":"v1","addr":"172.21.15.38:6835","nonce":218783320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34682":{"gid":34682,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":21,"addr":"172.21.15.38:6837/1821839397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":1821839397},{"type":"v1","addr":"172.21.15.38:6837","nonce":1821839397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34724":{"gid":34724,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.38:6839/458259815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":458259815},{"type":"v1","addr":"172.21.15.38:6839","nonce":458259815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34724,"qdb_cluster":[34724,34682,34652]},"id":1}]} 2024-09-10T23:26:52.182 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 26 2024-09-10T23:26:52.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:52.183+0000 7f4cd4000640 1 -- 172.21.15.3:0/2465746954 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f4cb40b5450 msgr2=0x7f4cb40b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:52.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:52.183+0000 7f4cd4000640 1 --2- 172.21.15.3:0/2465746954 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f4cb40b5450 0x7f4cb40b7910 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0006010 tx=0x7f4cc0005e80 comp rx=0 tx=0).stop 2024-09-10T23:26:52.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:52.183+0000 7f4cd4000640 1 -- 172.21.15.3:0/2465746954 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4ccc10a9c0 msgr2=0x7f4ccc19b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:52.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:52.183+0000 7f4cd4000640 1 --2- 172.21.15.3:0/2465746954 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4ccc10a9c0 0x7f4ccc19b900 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800d950 tx=0x7f4cb800de10 comp rx=0 tx=0).stop 2024-09-10T23:26:52.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:52.183+0000 7f4cd4000640 1 -- 172.21.15.3:0/2465746954 shutdown_connections 2024-09-10T23:26:52.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:52.183+0000 7f4cd4000640 1 --2- 172.21.15.3:0/2465746954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ccc10b340 0x7f4ccc1a0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:52.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:52.183+0000 7f4cd4000640 1 --2- 172.21.15.3:0/2465746954 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f4cb40b5450 0x7f4cb40b7910 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:52.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:52.183+0000 7f4cd4000640 1 --2- 172.21.15.3:0/2465746954 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4ccc10a9c0 0x7f4ccc19b900 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:52.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:52.183+0000 7f4cd4000640 1 --2- 172.21.15.3:0/2465746954 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ccc104fb0 0x7f4ccc19b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:52.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:52.183+0000 7f4cd4000640 1 -- 172.21.15.3:0/2465746954 >> 172.21.15.3:0/2465746954 conn(0x7f4ccc100a20 msgr2=0x7f4ccc1013f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:52.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:52.183+0000 7f4cd4000640 1 -- 172.21.15.3:0/2465746954 shutdown_connections 2024-09-10T23:26:52.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:52.183+0000 7f4cd4000640 1 -- 172.21.15.3:0/2465746954 wait complete. 2024-09-10T23:26:52.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:52 smithi003 ceph-mon[30348]: pgmap v393: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 176 KiB/s wr, 53 op/s 2024-09-10T23:26:52.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:52 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2465746954' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:26:52.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:52 smithi038 ceph-mon[34225]: pgmap v393: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 176 KiB/s wr, 53 op/s 2024-09-10T23:26:52.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:52 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2465746954' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:26:52.599 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:52 smithi194 ceph-mon[33904]: pgmap v393: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 176 KiB/s wr, 53 op/s 2024-09-10T23:26:52.599 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:52 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2465746954' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:26:53.114 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:26:53.517 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:54.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.247+0000 7f50ad400640 1 -- 172.21.15.3:0/3956501420 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50a8075de0 msgr2=0x7f50a810ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:54.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.247+0000 7f50ad400640 1 --2- 172.21.15.3:0/3956501420 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50a8075de0 0x7f50a810ece0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5090009900 tx=0x7f509002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.247+0000 7f50ad400640 1 -- 172.21.15.3:0/3956501420 shutdown_connections 2024-09-10T23:26:54.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.247+0000 7f50ad400640 1 --2- 172.21.15.3:0/3956501420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50a810f220 0x7f50a8111610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.247+0000 7f50ad400640 1 --2- 172.21.15.3:0/3956501420 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50a8075de0 0x7f50a810ece0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.247+0000 7f50ad400640 1 --2- 172.21.15.3:0/3956501420 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50a80754c0 0x7f50a80758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.247+0000 7f50ad400640 1 -- 172.21.15.3:0/3956501420 >> 172.21.15.3:0/3956501420 conn(0x7f50a80fe6c0 msgr2=0x7f50a8100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:54.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.247+0000 7f50ad400640 1 -- 172.21.15.3:0/3956501420 shutdown_connections 2024-09-10T23:26:54.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.247+0000 7f50ad400640 1 -- 172.21.15.3:0/3956501420 wait complete. 2024-09-10T23:26:54.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.248+0000 7f50ad400640 1 Processor -- start 2024-09-10T23:26:54.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.248+0000 7f50ad400640 1 -- start start 2024-09-10T23:26:54.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.248+0000 7f50ad400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50a80754c0 0x7f50a819b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:54.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.248+0000 7f50ad400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50a8075de0 0x7f50a819b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:54.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.248+0000 7f50ad400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50a810f220 0x7f50a81a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:54.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.248+0000 7f50ad400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f50a8114d00 con 0x7f50a810f220 2024-09-10T23:26:54.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.248+0000 7f50ad400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f50a8114b80 con 0x7f50a80754c0 2024-09-10T23:26:54.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.248+0000 7f50ad400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f50a8114e80 con 0x7f50a8075de0 2024-09-10T23:26:54.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.249+0000 7f50aca00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50a810f220 0x7f50a81a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:54.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.249+0000 7f50aca00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50a810f220 0x7f50a81a0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34170/0 (socket says 172.21.15.3:34170) 2024-09-10T23:26:54.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.249+0000 7f50aca00640 1 -- 172.21.15.3:0/1911532430 learned_addr learned my addr 172.21.15.3:0/1911532430 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:54.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.249+0000 7f50a7e00640 1 --2- 172.21.15.3:0/1911532430 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50a80754c0 0x7f50a819b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:54.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.249+0000 7f509f400640 1 --2- 172.21.15.3:0/1911532430 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50a8075de0 0x7f50a819b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:54.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.249+0000 7f50aca00640 1 -- 172.21.15.3:0/1911532430 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50a8075de0 msgr2=0x7f50a819b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:54.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.249+0000 7f50aca00640 1 --2- 172.21.15.3:0/1911532430 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50a8075de0 0x7f50a819b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.249+0000 7f50aca00640 1 -- 172.21.15.3:0/1911532430 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50a80754c0 msgr2=0x7f50a819b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:54.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.249+0000 7f50aca00640 1 --2- 172.21.15.3:0/1911532430 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50a80754c0 0x7f50a819b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.249+0000 7f50aca00640 1 -- 172.21.15.3:0/1911532430 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50a81a1220 con 0x7f50a810f220 2024-09-10T23:26:54.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.250+0000 7f50aca00640 1 --2- 172.21.15.3:0/1911532430 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50a810f220 0x7f50a81a0a50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f50a0009fd0 tx=0x7f50a000eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:54.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.250+0000 7f50a5600640 1 -- 172.21.15.3:0/1911532430 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a0004d20 con 0x7f50a810f220 2024-09-10T23:26:54.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.250+0000 7f50a5600640 1 -- 172.21.15.3:0/1911532430 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f50a0005020 con 0x7f50a810f220 2024-09-10T23:26:54.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.250+0000 7f50ad400640 1 -- 172.21.15.3:0/1911532430 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50a81a1510 con 0x7f50a810f220 2024-09-10T23:26:54.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.250+0000 7f50a5600640 1 -- 172.21.15.3:0/1911532430 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a00116d0 con 0x7f50a810f220 2024-09-10T23:26:54.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.250+0000 7f50ad400640 1 -- 172.21.15.3:0/1911532430 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50a81a7da0 con 0x7f50a810f220 2024-09-10T23:26:54.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.251+0000 7f50ad400640 1 -- 172.21.15.3:0/1911532430 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50a80758a0 con 0x7f50a810f220 2024-09-10T23:26:54.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.254+0000 7f50a5600640 1 -- 172.21.15.3:0/1911532430 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 24) ==== 153374+0+0 (secure 0 0 0) 0x7f50a000f040 con 0x7f50a810f220 2024-09-10T23:26:54.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.255+0000 7f50a5600640 1 --2- 172.21.15.3:0/1911532430 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f508c0b5580 0x7f508c0b7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:54.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.255+0000 7f50a5600640 1 -- 172.21.15.3:0/1911532430 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f50a00e64d0 con 0x7f50a810f220 2024-09-10T23:26:54.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.255+0000 7f50a7e00640 1 --2- 172.21.15.3:0/1911532430 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f508c0b5580 0x7f508c0b7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:54.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.256+0000 7f50a7e00640 1 --2- 172.21.15.3:0/1911532430 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f508c0b5580 0x7f508c0b7a40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f509800abe0 tx=0x7f509800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:54.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.257+0000 7f50a5600640 1 -- 172.21.15.3:0/1911532430 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f50a0016030 con 0x7f50a810f220 2024-09-10T23:26:54.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.494+0000 7f50ad400640 1 -- 172.21.15.3:0/1911532430 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50a81a8000 con 0x7f50a810f220 2024-09-10T23:26:54.495 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:54 smithi003 ceph-mon[30348]: pgmap v394: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 176 KiB/s wr, 55 op/s 2024-09-10T23:26:54.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.495+0000 7f50a5600640 1 -- 172.21.15.3:0/1911532430 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11891 (secure 0 0 0) 0x7f50a00acd00 con 0x7f50a810f220 2024-09-10T23:26:54.496 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:26:54.496 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":26,"btime":"2024-09-10T23:26:42:260644+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/1495411512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":1495411512},{"type":"v1","addr":"172.21.15.3:6835","nonce":1495411512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/1857372777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1857372777},{"type":"v1","addr":"172.21.15.3:6837","nonce":1857372777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14862,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6839/493850676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":493850676},{"type":"v1","addr":"172.21.15.3:6839","nonce":493850676}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14874,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6841/1580524358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":1580524358},{"type":"v1","addr":"172.21.15.3:6841","nonce":1580524358}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/352514665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":352514665},{"type":"v1","addr":"172.21.15.194:6833","nonce":352514665}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2380508105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2380508105},{"type":"v1","addr":"172.21.15.194:6835","nonce":2380508105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:23:58.866253+0000","modified":"2024-09-10T23:26:41.694795+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34724,"mds_1":34682,"mds_2":34652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24649":{"gid":24649,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/739730313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":739730313},{"type":"v1","addr":"172.21.15.194:6837","nonce":739730313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/3198777710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3198777710},{"type":"v1","addr":"172.21.15.194:6839","nonce":3198777710}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34619":{"gid":34619,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6833/1194099617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1194099617},{"type":"v1","addr":"172.21.15.38:6833","nonce":1194099617}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34652":{"gid":34652,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.38:6835/218783320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":218783320},{"type":"v1","addr":"172.21.15.38:6835","nonce":218783320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34682":{"gid":34682,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":21,"addr":"172.21.15.38:6837/1821839397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":1821839397},{"type":"v1","addr":"172.21.15.38:6837","nonce":1821839397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34724":{"gid":34724,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.38:6839/458259815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":458259815},{"type":"v1","addr":"172.21.15.38:6839","nonce":458259815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34724,"qdb_cluster":[34724,34682,34652]},"id":1}]} 2024-09-10T23:26:54.497 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 26 2024-09-10T23:26:54.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.497+0000 7f50ad400640 1 -- 172.21.15.3:0/1911532430 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f508c0b5580 msgr2=0x7f508c0b7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:54.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.497+0000 7f50ad400640 1 --2- 172.21.15.3:0/1911532430 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f508c0b5580 0x7f508c0b7a40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f509800abe0 tx=0x7f509800a2d0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.497+0000 7f50ad400640 1 -- 172.21.15.3:0/1911532430 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50a810f220 msgr2=0x7f50a81a0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:54.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.497+0000 7f50ad400640 1 --2- 172.21.15.3:0/1911532430 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50a810f220 0x7f50a81a0a50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f50a0009fd0 tx=0x7f50a000eda0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.497+0000 7f50ad400640 1 -- 172.21.15.3:0/1911532430 shutdown_connections 2024-09-10T23:26:54.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.497+0000 7f50ad400640 1 --2- 172.21.15.3:0/1911532430 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f508c0b5580 0x7f508c0b7a40 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.497+0000 7f50ad400640 1 --2- 172.21.15.3:0/1911532430 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50a810f220 0x7f50a81a0a50 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.497+0000 7f50ad400640 1 --2- 172.21.15.3:0/1911532430 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50a8075de0 0x7f50a819b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.497+0000 7f50ad400640 1 --2- 172.21.15.3:0/1911532430 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50a80754c0 0x7f50a819b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.497+0000 7f50ad400640 1 -- 172.21.15.3:0/1911532430 >> 172.21.15.3:0/1911532430 conn(0x7f50a80fe6c0 msgr2=0x7f50a80feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:54.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.497+0000 7f50ad400640 1 -- 172.21.15.3:0/1911532430 shutdown_connections 2024-09-10T23:26:54.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:54.497+0000 7f50ad400640 1 -- 172.21.15.3:0/1911532430 wait complete. 2024-09-10T23:26:54.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:54 smithi038 ceph-mon[34225]: pgmap v394: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 176 KiB/s wr, 55 op/s 2024-09-10T23:26:54.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:54 smithi194 ceph-mon[33904]: pgmap v394: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 176 KiB/s wr, 55 op/s 2024-09-10T23:26:55.269 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:26:55.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:55 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/1911532430' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:26:55.651 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:55.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:55 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/1911532430' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:26:55.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:55 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1911532430' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:26:56.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.203+0000 7f6149600640 1 -- 172.21.15.3:0/711768575 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61440754e0 msgr2=0x7f61440758c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:56.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.203+0000 7f6149600640 1 --2- 172.21.15.3:0/711768575 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61440754e0 0x7f61440758c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6134009900 tx=0x7f613402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.203+0000 7f6149600640 1 -- 172.21.15.3:0/711768575 shutdown_connections 2024-09-10T23:26:56.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.203+0000 7f6149600640 1 --2- 172.21.15.3:0/711768575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f614410f200 0x7f61441115f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.203+0000 7f6149600640 1 --2- 172.21.15.3:0/711768575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6144075e00 0x7f614410ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.203+0000 7f6149600640 1 --2- 172.21.15.3:0/711768575 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61440754e0 0x7f61440758c0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.203+0000 7f6149600640 1 -- 172.21.15.3:0/711768575 >> 172.21.15.3:0/711768575 conn(0x7f61440fe660 msgr2=0x7f6144100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:56.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.203+0000 7f6149600640 1 -- 172.21.15.3:0/711768575 shutdown_connections 2024-09-10T23:26:56.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.203+0000 7f6149600640 1 -- 172.21.15.3:0/711768575 wait complete. 2024-09-10T23:26:56.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.204+0000 7f6149600640 1 Processor -- start 2024-09-10T23:26:56.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.204+0000 7f6149600640 1 -- start start 2024-09-10T23:26:56.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.205+0000 7f6149600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61440754e0 0x7f614419b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:56.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.205+0000 7f6149600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6144075e00 0x7f614419b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:56.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.205+0000 7f6149600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f614410f200 0x7f61441a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:56.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.205+0000 7f6149600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6144114c90 con 0x7f61440754e0 2024-09-10T23:26:56.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.205+0000 7f6149600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6144114b10 con 0x7f6144075e00 2024-09-10T23:26:56.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.205+0000 7f6149600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6144114e10 con 0x7f614410f200 2024-09-10T23:26:56.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.205+0000 7f6143e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61440754e0 0x7f614419b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:56.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.205+0000 7f6143e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61440754e0 0x7f614419b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34198/0 (socket says 172.21.15.3:34198) 2024-09-10T23:26:56.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.205+0000 7f6143e00640 1 -- 172.21.15.3:0/3523433920 learned_addr learned my addr 172.21.15.3:0/3523433920 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:56.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.205+0000 7f6143400640 1 --2- 172.21.15.3:0/3523433920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6144075e00 0x7f614419b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:56.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.205+0000 7f6148c00640 1 --2- 172.21.15.3:0/3523433920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f614410f200 0x7f61441a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:56.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.205+0000 7f6143400640 1 -- 172.21.15.3:0/3523433920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f614410f200 msgr2=0x7f61441a0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:56.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.205+0000 7f6143400640 1 --2- 172.21.15.3:0/3523433920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f614410f200 0x7f61441a0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.205+0000 7f6143400640 1 -- 172.21.15.3:0/3523433920 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61440754e0 msgr2=0x7f614419b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:56.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.205+0000 7f6143400640 1 --2- 172.21.15.3:0/3523433920 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61440754e0 0x7f614419b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.205+0000 7f6143400640 1 -- 172.21.15.3:0/3523433920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61441a1230 con 0x7f6144075e00 2024-09-10T23:26:56.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.205+0000 7f6143e00640 1 --2- 172.21.15.3:0/3523433920 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61440754e0 0x7f614419b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:26:56.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.206+0000 7f6143400640 1 --2- 172.21.15.3:0/3523433920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6144075e00 0x7f614419b6c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f613000d6d0 tx=0x7f613000db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:56.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.206+0000 7f6140c00640 1 -- 172.21.15.3:0/3523433920 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6130017070 con 0x7f6144075e00 2024-09-10T23:26:56.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.206+0000 7f6149600640 1 -- 172.21.15.3:0/3523433920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61441a1520 con 0x7f6144075e00 2024-09-10T23:26:56.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.206+0000 7f6140c00640 1 -- 172.21.15.3:0/3523433920 <== mon.2 v2:172.21.15.38:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6130009820 con 0x7f6144075e00 2024-09-10T23:26:56.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.206+0000 7f6140c00640 1 -- 172.21.15.3:0/3523433920 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6130004bc0 con 0x7f6144075e00 2024-09-10T23:26:56.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.206+0000 7f6149600640 1 -- 172.21.15.3:0/3523433920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61441a7db0 con 0x7f6144075e00 2024-09-10T23:26:56.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.207+0000 7f6149600640 1 -- 172.21.15.3:0/3523433920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61440769f0 con 0x7f6144075e00 2024-09-10T23:26:56.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.210+0000 7f6140c00640 1 -- 172.21.15.3:0/3523433920 <== mon.2 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 24) ==== 153374+0+0 (secure 0 0 0) 0x7f6130005220 con 0x7f6144075e00 2024-09-10T23:26:56.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.211+0000 7f6140c00640 1 --2- 172.21.15.3:0/3523433920 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f61280b5500 0x7f61280b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:56.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.211+0000 7f6140c00640 1 -- 172.21.15.3:0/3523433920 <== mon.2 v2:172.21.15.38:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f61300e61f0 con 0x7f6144075e00 2024-09-10T23:26:56.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.211+0000 7f6143e00640 1 --2- 172.21.15.3:0/3523433920 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f61280b5500 0x7f61280b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:56.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.212+0000 7f6143e00640 1 --2- 172.21.15.3:0/3523433920 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f61280b5500 0x7f61280b79c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6134032fd0 tx=0x7f6134009580 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:56.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.213+0000 7f6140c00640 1 -- 172.21.15.3:0/3523433920 <== mon.2 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6130005540 con 0x7f6144075e00 2024-09-10T23:26:56.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.411+0000 7f6149600640 1 -- 172.21.15.3:0/3523433920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f61441a7f80 con 0x7f6144075e00 2024-09-10T23:26:56.412 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:56 smithi003 ceph-mon[30348]: pgmap v395: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-10T23:26:56.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.413+0000 7f6140c00640 1 -- 172.21.15.3:0/3523433920 <== mon.2 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+25112 (secure 0 0 0) 0x7f61300ac350 con 0x7f6144075e00 2024-09-10T23:26:56.414 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:26:56.414 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":90,"fsid":"3f4e30d0-6fca-11ef-bcea-c7b262605968","created":"2024-09-10T23:14:12.377466+0000","modified":"2024-09-10T23:25:22.134690+0000","last_up_change":"2024-09-10T23:22:54.895554+0000","last_in_change":"2024-09-10T23:22:29.701108+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:18:27.131879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:23:53.689954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:23:55.864693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:24:03.869094+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a38330ed-a85b-4e61-b373-dd8f1d5f7ba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6803","nonce":824467747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6805","nonce":824467747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6809","nonce":824467747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6807","nonce":824467747}]},"public_addr":"172.21.15.3:6803/824467747","cluster_addr":"172.21.15.3:6805/824467747","heartbeat_back_addr":"172.21.15.3:6809/824467747","heartbeat_front_addr":"172.21.15.3:6807/824467747","state":["exists","up"]},{"osd":1,"uuid":"49bb1212-a83e-4f85-ad71-d863880d8268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6801","nonce":1447444485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6803","nonce":1447444485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6807","nonce":1447444485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6805","nonce":1447444485}]},"public_addr":"172.21.15.38:6801/1447444485","cluster_addr":"172.21.15.38:6803/1447444485","heartbeat_back_addr":"172.21.15.38:6807/1447444485","heartbeat_front_addr":"172.21.15.38:6805/1447444485","state":["exists","up"]},{"osd":2,"uuid":"ea53eb27-e7fa-4783-9a53-8b44b4e293ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6801","nonce":3191263316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6803","nonce":3191263316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6807","nonce":3191263316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6805","nonce":3191263316}]},"public_addr":"172.21.15.194:6801/3191263316","cluster_addr":"172.21.15.194:6803/3191263316","heartbeat_back_addr":"172.21.15.194:6807/3191263316","heartbeat_front_addr":"172.21.15.194:6805/3191263316","state":["exists","up"]},{"osd":3,"uuid":"75067769-7be5-4a99-9e02-f7735b2e69c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6811","nonce":2061990952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6813","nonce":2061990952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6817","nonce":2061990952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6815","nonce":2061990952}]},"public_addr":"172.21.15.3:6811/2061990952","cluster_addr":"172.21.15.3:6813/2061990952","heartbeat_back_addr":"172.21.15.3:6817/2061990952","heartbeat_front_addr":"172.21.15.3:6815/2061990952","state":["exists","up"]},{"osd":4,"uuid":"872e90ca-b711-4206-b586-e7fa41122199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6809","nonce":413294160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6811","nonce":413294160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6815","nonce":413294160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6813","nonce":413294160}]},"public_addr":"172.21.15.38:6809/413294160","cluster_addr":"172.21.15.38:6811/413294160","heartbeat_back_addr":"172.21.15.38:6815/413294160","heartbeat_front_addr":"172.21.15.38:6813/413294160","state":["exists","up"]},{"osd":5,"uuid":"2cfa107c-6dae-4c26-9e29-8175b1237b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6809","nonce":4117812658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6811","nonce":4117812658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6815","nonce":4117812658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6813","nonce":4117812658}]},"public_addr":"172.21.15.194:6809/4117812658","cluster_addr":"172.21.15.194:6811/4117812658","heartbeat_back_addr":"172.21.15.194:6815/4117812658","heartbeat_front_addr":"172.21.15.194:6813/4117812658","state":["exists","up"]},{"osd":6,"uuid":"d2e4e309-c587-4725-a5b3-cbc7b1226750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6819","nonce":3470543721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6821","nonce":3470543721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6825","nonce":3470543721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6823","nonce":3470543721}]},"public_addr":"172.21.15.3:6819/3470543721","cluster_addr":"172.21.15.3:6821/3470543721","heartbeat_back_addr":"172.21.15.3:6825/3470543721","heartbeat_front_addr":"172.21.15.3:6823/3470543721","state":["exists","up"]},{"osd":7,"uuid":"46ecaec5-29da-4e1d-ac2f-42bbbd77e949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6817","nonce":2054203924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6819","nonce":2054203924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6823","nonce":2054203924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6821","nonce":2054203924}]},"public_addr":"172.21.15.38:6817/2054203924","cluster_addr":"172.21.15.38:6819/2054203924","heartbeat_back_addr":"172.21.15.38:6823/2054203924","heartbeat_front_addr":"172.21.15.38:6821/2054203924","state":["exists","up"]},{"osd":8,"uuid":"57fd8e43-9612-4f74-8eb2-8bdbbf7c0417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6817","nonce":170051722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6819","nonce":170051722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6823","nonce":170051722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6821","nonce":170051722}]},"public_addr":"172.21.15.194:6817/170051722","cluster_addr":"172.21.15.194:6819/170051722","heartbeat_back_addr":"172.21.15.194:6823/170051722","heartbeat_front_addr":"172.21.15.194:6821/170051722","state":["exists","up"]},{"osd":9,"uuid":"aeaaf23b-d2e2-4e30-9a49-de4aaba53900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6827","nonce":3967749600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6829","nonce":3967749600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6833","nonce":3967749600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6831","nonce":3967749600}]},"public_addr":"172.21.15.3:6827/3967749600","cluster_addr":"172.21.15.3:6829/3967749600","heartbeat_back_addr":"172.21.15.3:6833/3967749600","heartbeat_front_addr":"172.21.15.3:6831/3967749600","state":["exists","up"]},{"osd":10,"uuid":"b0ece81b-1c5b-40da-b579-fb99bacb005d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6825","nonce":1671957178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6827","nonce":1671957178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6831","nonce":1671957178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6829","nonce":1671957178}]},"public_addr":"172.21.15.38:6825/1671957178","cluster_addr":"172.21.15.38:6827/1671957178","heartbeat_back_addr":"172.21.15.38:6831/1671957178","heartbeat_front_addr":"172.21.15.38:6829/1671957178","state":["exists","up"]},{"osd":11,"uuid":"a0036526-54bf-4e8b-95cc-e7b75725961c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6825","nonce":1048859686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6827","nonce":1048859686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6831","nonce":1048859686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6829","nonce":1048859686}]},"public_addr":"172.21.15.194:6825/1048859686","cluster_addr":"172.21.15.194:6827/1048859686","heartbeat_back_addr":"172.21.15.194:6831/1048859686","heartbeat_front_addr":"172.21.15.194:6829/1048859686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:27.013354+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:56.609046+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:24.878988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:55.218204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:25.224770+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:54.614336+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:25.385483+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:55.317137+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:25.064825+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:54.655361+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:22:24.080027+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:22:52.886412+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":4,"to":6},{"from":5,"to":9}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.3:0/776988825":"2024-09-11T23:16:20.647314+0000","172.21.15.3:0/2965090335":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/2364823868":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/3186881356":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/911991463":"2024-09-11T23:16:20.647314+0000","172.21.15.3:6800/2582365069":"2024-09-11T23:14:37.169991+0000","172.21.15.3:6801/2582365069":"2024-09-11T23:14:37.169991+0000","172.21.15.3:6801/1528153492":"2024-09-11T23:15:05.835734+0000","172.21.15.3:6800/1924113958":"2024-09-11T23:16:20.647314+0000","172.21.15.3:0/554479543":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/4238683346":"2024-09-11T23:15:05.835734+0000","172.21.15.3:6800/1528153492":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/285471483":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/1249510760":"2024-09-11T23:16:20.647314+0000","172.21.15.3:6801/1924113958":"2024-09-11T23:16:20.647314+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:26:56.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.415+0000 7f6149600640 1 -- 172.21.15.3:0/3523433920 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f61280b5500 msgr2=0x7f61280b79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:56.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.415+0000 7f6149600640 1 --2- 172.21.15.3:0/3523433920 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f61280b5500 0x7f61280b79c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6134032fd0 tx=0x7f6134009580 comp rx=0 tx=0).stop 2024-09-10T23:26:56.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.415+0000 7f6149600640 1 -- 172.21.15.3:0/3523433920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6144075e00 msgr2=0x7f614419b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:56.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.415+0000 7f6149600640 1 --2- 172.21.15.3:0/3523433920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6144075e00 0x7f614419b6c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f613000d6d0 tx=0x7f613000db90 comp rx=0 tx=0).stop 2024-09-10T23:26:56.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.416+0000 7f6149600640 1 -- 172.21.15.3:0/3523433920 shutdown_connections 2024-09-10T23:26:56.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.416+0000 7f6149600640 1 --2- 172.21.15.3:0/3523433920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f614410f200 0x7f61441a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.416+0000 7f6149600640 1 --2- 172.21.15.3:0/3523433920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6144075e00 0x7f614419b6c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.416+0000 7f6149600640 1 --2- 172.21.15.3:0/3523433920 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f61280b5500 0x7f61280b79c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.416+0000 7f6149600640 1 --2- 172.21.15.3:0/3523433920 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61440754e0 0x7f614419b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:56.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.416+0000 7f6149600640 1 -- 172.21.15.3:0/3523433920 >> 172.21.15.3:0/3523433920 conn(0x7f61440fe660 msgr2=0x7f61441113e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:56.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.416+0000 7f6149600640 1 -- 172.21.15.3:0/3523433920 shutdown_connections 2024-09-10T23:26:56.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:56.416+0000 7f6149600640 1 -- 172.21.15.3:0/3523433920 wait complete. 2024-09-10T23:26:56.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:56 smithi038 ceph-mon[34225]: pgmap v395: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-10T23:26:56.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:56 smithi194 ceph-mon[33904]: pgmap v395: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-10T23:26:57.247 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-10T23:26:57.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:57 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3523433920' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:26:57.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:57 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3523433920' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:26:57.629 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:57.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:57 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3523433920' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:26:58.610 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:26:58 smithi003 ceph-mon[30348]: pgmap v396: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-10T23:26:58.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:26:58 smithi194 ceph-mon[33904]: pgmap v396: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-10T23:26:58.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:26:58 smithi038 ceph-mon[34225]: pgmap v396: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-10T23:26:58.996 INFO:teuthology.orchestra.run.smithi003.stdout:{"run_dir":"/var/run/ceph"} 2024-09-10T23:26:58.997 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-10T23:26:58.997 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 6190 2024-09-10T23:26:58.997 DEBUG:tasks.quiescer:Yielding 2024-09-10T23:26:58.997 INFO:teuthology.run_tasks:Running task workunit... 2024-09-10T23:26:59.012 INFO:tasks.workunit:Pulling workunits from ref 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:26:59.013 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-10T23:26:59.013 INFO:tasks.workunit:timeout=3h 2024-09-10T23:26:59.013 INFO:tasks.workunit:cleanup=True 2024-09-10T23:26:59.013 DEBUG:teuthology.orchestra.run.smithi003:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-10T23:26:59.013 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:26:59.050 INFO:teuthology.orchestra.run.smithi003.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-10T23:26:59.051 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-10T23:26:59.051 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 78h/120d Inode: 1 Links: 2 2024-09-10T23:26:59.051 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:26:59.051 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-10T23:26:59.051 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2024-09-10 23:24:55.916471035 +0000 2024-09-10T23:26:59.051 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2024-09-10 23:24:55.916471035 +0000 2024-09-10T23:26:59.051 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2024-09-10 23:26:41.281301302 +0000 2024-09-10T23:26:59.051 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: - 2024-09-10T23:26:59.051 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-10T23:26:59.051 DEBUG:teuthology.orchestra.run.smithi003:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-10T23:26:59.157 DEBUG:teuthology.orchestra.run.smithi003:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:26:59.195 INFO:tasks.workunit.client.0.smithi003.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-10T23:26:59.402 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:26:59.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.917+0000 7ff01dc00640 1 -- 172.21.15.3:0/2408271380 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff018104df0 msgr2=0x7ff0181051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:59.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.917+0000 7ff01dc00640 1 --2- 172.21.15.3:0/2408271380 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff018104df0 0x7ff0181051d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff008009ca0 tx=0x7ff00802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:26:59.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.917+0000 7ff01dc00640 1 -- 172.21.15.3:0/2408271380 shutdown_connections 2024-09-10T23:26:59.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.917+0000 7ff01dc00640 1 --2- 172.21.15.3:0/2408271380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff01810b180 0x7ff018111980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:59.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.917+0000 7ff01dc00640 1 --2- 172.21.15.3:0/2408271380 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff01810a800 0x7ff01810ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:59.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.917+0000 7ff01dc00640 1 --2- 172.21.15.3:0/2408271380 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff018104df0 0x7ff0181051d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:59.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.917+0000 7ff01dc00640 1 -- 172.21.15.3:0/2408271380 >> 172.21.15.3:0/2408271380 conn(0x7ff018100840 msgr2=0x7ff018102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:59.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.917+0000 7ff01dc00640 1 -- 172.21.15.3:0/2408271380 shutdown_connections 2024-09-10T23:26:59.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.917+0000 7ff01dc00640 1 -- 172.21.15.3:0/2408271380 wait complete. 2024-09-10T23:26:59.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.918+0000 7ff01dc00640 1 Processor -- start 2024-09-10T23:26:59.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.918+0000 7ff01dc00640 1 -- start start 2024-09-10T23:26:59.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.919+0000 7ff01dc00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff018104df0 0x7ff01819b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:59.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.919+0000 7ff01dc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff01810a800 0x7ff01819b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:59.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.919+0000 7ff01dc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff01810b180 0x7ff0181a09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:59.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.919+0000 7ff01dc00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff018114d40 con 0x7ff01810b180 2024-09-10T23:26:59.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.919+0000 7ff01dc00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff018114bc0 con 0x7ff018104df0 2024-09-10T23:26:59.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.919+0000 7ff01dc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff018114ec0 con 0x7ff01810a800 2024-09-10T23:26:59.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.919+0000 7ff017e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff018104df0 0x7ff01819b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:59.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.919+0000 7ff01d200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff01810b180 0x7ff0181a09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:59.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.919+0000 7ff017e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff018104df0 0x7ff01819b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.3:59242/0 (socket says 172.21.15.3:59242) 2024-09-10T23:26:59.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.919+0000 7ff017e00640 1 -- 172.21.15.3:0/3286000420 learned_addr learned my addr 172.21.15.3:0/3286000420 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:26:59.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.919+0000 7ff017400640 1 --2- 172.21.15.3:0/3286000420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff01810a800 0x7ff01819b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:59.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.920+0000 7ff01d200640 1 -- 172.21.15.3:0/3286000420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff01810a800 msgr2=0x7ff01819b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:59.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.920+0000 7ff01d200640 1 --2- 172.21.15.3:0/3286000420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff01810a800 0x7ff01819b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:59.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.920+0000 7ff01d200640 1 -- 172.21.15.3:0/3286000420 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff018104df0 msgr2=0x7ff01819b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:59.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.920+0000 7ff01d200640 1 --2- 172.21.15.3:0/3286000420 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff018104df0 0x7ff01819b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:59.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.920+0000 7ff01d200640 1 -- 172.21.15.3:0/3286000420 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0181a11c0 con 0x7ff01810b180 2024-09-10T23:26:59.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.920+0000 7ff01d200640 1 --2- 172.21.15.3:0/3286000420 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff01810b180 0x7ff0181a09f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff01000e970 tx=0x7ff01000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:59.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.920+0000 7ff014c00640 1 -- 172.21.15.3:0/3286000420 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01000ccc0 con 0x7ff01810b180 2024-09-10T23:26:59.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.920+0000 7ff014c00640 1 -- 172.21.15.3:0/3286000420 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff010005020 con 0x7ff01810b180 2024-09-10T23:26:59.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.920+0000 7ff014c00640 1 -- 172.21.15.3:0/3286000420 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01000ce60 con 0x7ff01810b180 2024-09-10T23:26:59.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.920+0000 7ff01dc00640 1 -- 172.21.15.3:0/3286000420 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0181a14b0 con 0x7ff01810b180 2024-09-10T23:26:59.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.920+0000 7ff01dc00640 1 -- 172.21.15.3:0/3286000420 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0181a7b70 con 0x7ff01810b180 2024-09-10T23:26:59.924 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.922+0000 7ff01dc00640 1 -- 172.21.15.3:0/3286000420 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0181051d0 con 0x7ff01810b180 2024-09-10T23:26:59.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.924+0000 7ff014c00640 1 -- 172.21.15.3:0/3286000420 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 24) ==== 153374+0+0 (secure 0 0 0) 0x7ff010004a00 con 0x7ff01810b180 2024-09-10T23:26:59.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.925+0000 7ff014c00640 1 --2- 172.21.15.3:0/3286000420 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7feffc0b5500 0x7feffc0b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:59.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.925+0000 7ff014c00640 1 -- 172.21.15.3:0/3286000420 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7ff0100e6340 con 0x7ff01810b180 2024-09-10T23:26:59.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.926+0000 7ff017e00640 1 --2- 172.21.15.3:0/3286000420 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7feffc0b5500 0x7feffc0b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:59.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.926+0000 7ff017e00640 1 --2- 172.21.15.3:0/3286000420 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7feffc0b5500 0x7feffc0b79c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff008009430 tx=0x7ff008009360 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:59.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:26:59.929+0000 7ff014c00640 1 -- 172.21.15.3:0/3286000420 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff0100acb50 con 0x7ff01810b180 2024-09-10T23:27:00.166 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:00.165+0000 7ff01dc00640 1 -- 172.21.15.3:0/3286000420 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff01802e5c0 con 0x7ff01810b180 2024-09-10T23:27:00.166 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:00.166+0000 7ff014c00640 1 -- 172.21.15.3:0/3286000420 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11891 (secure 0 0 0) 0x7ff0100ac450 con 0x7ff01810b180 2024-09-10T23:27:00.167 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:27:00.167 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":26,"btime":"2024-09-10T23:26:42:260644+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/1495411512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":1495411512},{"type":"v1","addr":"172.21.15.3:6835","nonce":1495411512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/1857372777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1857372777},{"type":"v1","addr":"172.21.15.3:6837","nonce":1857372777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14862,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6839/493850676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":493850676},{"type":"v1","addr":"172.21.15.3:6839","nonce":493850676}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14874,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6841/1580524358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":1580524358},{"type":"v1","addr":"172.21.15.3:6841","nonce":1580524358}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/352514665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":352514665},{"type":"v1","addr":"172.21.15.194:6833","nonce":352514665}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2380508105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2380508105},{"type":"v1","addr":"172.21.15.194:6835","nonce":2380508105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:23:58.866253+0000","modified":"2024-09-10T23:26:41.694795+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34724,"mds_1":34682,"mds_2":34652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24649":{"gid":24649,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/739730313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":739730313},{"type":"v1","addr":"172.21.15.194:6837","nonce":739730313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/3198777710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3198777710},{"type":"v1","addr":"172.21.15.194:6839","nonce":3198777710}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34619":{"gid":34619,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6833/1194099617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1194099617},{"type":"v1","addr":"172.21.15.38:6833","nonce":1194099617}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34652":{"gid":34652,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.38:6835/218783320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":218783320},{"type":"v1","addr":"172.21.15.38:6835","nonce":218783320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34682":{"gid":34682,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":21,"addr":"172.21.15.38:6837/1821839397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":1821839397},{"type":"v1","addr":"172.21.15.38:6837","nonce":1821839397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34724":{"gid":34724,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.38:6839/458259815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":458259815},{"type":"v1","addr":"172.21.15.38:6839","nonce":458259815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34724,"qdb_cluster":[34724,34682,34652]},"id":1}]} 2024-09-10T23:27:00.167 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 26 2024-09-10T23:27:00.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:00.169+0000 7ff01dc00640 1 -- 172.21.15.3:0/3286000420 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7feffc0b5500 msgr2=0x7feffc0b79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:00.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:00.169+0000 7ff01dc00640 1 --2- 172.21.15.3:0/3286000420 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7feffc0b5500 0x7feffc0b79c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff008009430 tx=0x7ff008009360 comp rx=0 tx=0).stop 2024-09-10T23:27:00.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:00.169+0000 7ff01dc00640 1 -- 172.21.15.3:0/3286000420 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff01810b180 msgr2=0x7ff0181a09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:00.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:00.169+0000 7ff01dc00640 1 --2- 172.21.15.3:0/3286000420 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff01810b180 0x7ff0181a09f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff01000e970 tx=0x7ff01000ee30 comp rx=0 tx=0).stop 2024-09-10T23:27:00.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:00.169+0000 7ff01dc00640 1 -- 172.21.15.3:0/3286000420 shutdown_connections 2024-09-10T23:27:00.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:00.169+0000 7ff01dc00640 1 --2- 172.21.15.3:0/3286000420 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7feffc0b5500 0x7feffc0b79c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:00.169+0000 7ff01dc00640 1 --2- 172.21.15.3:0/3286000420 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff01810b180 0x7ff0181a09f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:00.169+0000 7ff01dc00640 1 --2- 172.21.15.3:0/3286000420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff01810a800 0x7ff01819b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:00.169+0000 7ff01dc00640 1 --2- 172.21.15.3:0/3286000420 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff018104df0 0x7ff01819b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:00.169+0000 7ff01dc00640 1 -- 172.21.15.3:0/3286000420 >> 172.21.15.3:0/3286000420 conn(0x7ff018100840 msgr2=0x7ff018102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:00.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:00.169+0000 7ff01dc00640 1 -- 172.21.15.3:0/3286000420 shutdown_connections 2024-09-10T23:27:00.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:00.169+0000 7ff01dc00640 1 -- 172.21.15.3:0/3286000420 wait complete. 2024-09-10T23:27:00.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:00 smithi003 ceph-mon[30348]: pgmap v397: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 174 KiB/s wr, 53 op/s 2024-09-10T23:27:00.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:00 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3286000420' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:27:00.649 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:00 smithi038 ceph-mon[34225]: pgmap v397: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 174 KiB/s wr, 53 op/s 2024-09-10T23:27:00.650 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:00 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3286000420' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:27:00.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:00 smithi194 ceph-mon[33904]: pgmap v397: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 174 KiB/s wr, 53 op/s 2024-09-10T23:27:00.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:00 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3286000420' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:27:00.959 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T23:23:58.866253+0000', 'modified': '2024-09-10T23:26:41.694795+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 34724, 'mds_1': 34682, 'mds_2': 34652}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24649': {'gid': 24649, 'name': 'c', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.194:6837/739730313', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6836', 'nonce': 739730313}, {'type': 'v1', 'addr': '172.21.15.194:6837', 'nonce': 739730313}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24673': {'gid': 24673, 'name': 'i', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.194:6839/3198777710', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6838', 'nonce': 3198777710}, {'type': 'v1', 'addr': '172.21.15.194:6839', 'nonce': 3198777710}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34619': {'gid': 34619, 'name': 'k', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.38:6833/1194099617', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6832', 'nonce': 1194099617}, {'type': 'v1', 'addr': '172.21.15.38:6833', 'nonce': 1194099617}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34652': {'gid': 34652, 'name': 'e', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 24, 'addr': '172.21.15.38:6835/218783320', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6834', 'nonce': 218783320}, {'type': 'v1', 'addr': '172.21.15.38:6835', 'nonce': 218783320}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34682': {'gid': 34682, 'name': 'h', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 21, 'addr': '172.21.15.38:6837/1821839397', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6836', 'nonce': 1821839397}, {'type': 'v1', 'addr': '172.21.15.38:6837', 'nonce': 1821839397}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34724': {'gid': 34724, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.38:6839/458259815', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6838', 'nonce': 458259815}, {'type': 'v1', 'addr': '172.21.15.38:6839', 'nonce': 458259815}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34724, 'qdb_cluster': [34724, 34682, 34652]} 2024-09-10T23:27:00.960 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-10T23:27:00.960 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.e status 2024-09-10T23:27:01.220 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:27:00 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T23:27:00.852+0000 7f706f200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:27:01.220 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:27:00 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T23:27:00.852+0000 7f706f200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:27:01.221 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:27:00 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T23:27:00.852+0000 7f706f200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:27:01.221 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:27:00 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T23:27:00.852+0000 7f706f200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:27:01.221 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:27:00 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T23:27:00.852+0000 7f706f200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:27:01.388 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:27:01.936 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.935+0000 7f813ea00640 1 -- 172.21.15.3:0/3886198975 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8138102c10 msgr2=0x7f8138102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:01.936 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.935+0000 7f813ea00640 1 --2- 172.21.15.3:0/3886198975 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8138102c10 0x7f8138102ff0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f812c009ca0 tx=0x7f812c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.935+0000 7f813ea00640 1 -- 172.21.15.3:0/3886198975 shutdown_connections 2024-09-10T23:27:01.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.935+0000 7f813ea00640 1 --2- 172.21.15.3:0/3886198975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8138108fa0 0x7f813810f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.935+0000 7f813ea00640 1 --2- 172.21.15.3:0/3886198975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8138108620 0x7f8138108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.935+0000 7f813ea00640 1 --2- 172.21.15.3:0/3886198975 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8138102c10 0x7f8138102ff0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.935+0000 7f813ea00640 1 -- 172.21.15.3:0/3886198975 >> 172.21.15.3:0/3886198975 conn(0x7f81380fe660 msgr2=0x7f8138100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:01.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.935+0000 7f813ea00640 1 -- 172.21.15.3:0/3886198975 shutdown_connections 2024-09-10T23:27:01.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.935+0000 7f813ea00640 1 -- 172.21.15.3:0/3886198975 wait complete. 2024-09-10T23:27:01.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.936+0000 7f813ea00640 1 Processor -- start 2024-09-10T23:27:01.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.936+0000 7f813ea00640 1 -- start start 2024-09-10T23:27:01.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.936+0000 7f813ea00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8138102c10 0x7f8138198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.936+0000 7f813ea00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8138108620 0x7f81381994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.937+0000 7f813ea00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8138108fa0 0x7f813819e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.937+0000 7f813ea00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8138112b60 con 0x7f8138108620 2024-09-10T23:27:01.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.937+0000 7f813ea00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f81381129e0 con 0x7f8138108fa0 2024-09-10T23:27:01.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.937+0000 7f813ea00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8138112ce0 con 0x7f8138102c10 2024-09-10T23:27:01.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.937+0000 7f813cc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8138108620 0x7f81381994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.937+0000 7f813cc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8138108620 0x7f81381994c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38898/0 (socket says 172.21.15.3:38898) 2024-09-10T23:27:01.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.937+0000 7f813cc00640 1 -- 172.21.15.3:0/2378708022 learned_addr learned my addr 172.21.15.3:0/2378708022 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:27:01.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.937+0000 7f813d600640 1 --2- 172.21.15.3:0/2378708022 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8138102c10 0x7f8138198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.937+0000 7f813e000640 1 --2- 172.21.15.3:0/2378708022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8138108fa0 0x7f813819e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.937+0000 7f813cc00640 1 -- 172.21.15.3:0/2378708022 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8138102c10 msgr2=0x7f8138198f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:01.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.937+0000 7f813cc00640 1 --2- 172.21.15.3:0/2378708022 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8138102c10 0x7f8138198f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.937+0000 7f813cc00640 1 -- 172.21.15.3:0/2378708022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8138108fa0 msgr2=0x7f813819e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:01.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.937+0000 7f813cc00640 1 --2- 172.21.15.3:0/2378708022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8138108fa0 0x7f813819e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.937+0000 7f813cc00640 1 -- 172.21.15.3:0/2378708022 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f813819f030 con 0x7f8138108620 2024-09-10T23:27:01.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.938+0000 7f813cc00640 1 --2- 172.21.15.3:0/2378708022 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8138108620 0x7f81381994c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f812400d950 tx=0x7f812400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:01.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.938+0000 7f8136000640 1 -- 172.21.15.3:0/2378708022 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8124017030 con 0x7f8138108620 2024-09-10T23:27:01.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.938+0000 7f8136000640 1 -- 172.21.15.3:0/2378708022 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8124004020 con 0x7f8138108620 2024-09-10T23:27:01.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.938+0000 7f813ea00640 1 -- 172.21.15.3:0/2378708022 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f813819f320 con 0x7f8138108620 2024-09-10T23:27:01.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.938+0000 7f8136000640 1 -- 172.21.15.3:0/2378708022 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81240055d0 con 0x7f8138108620 2024-09-10T23:27:01.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.938+0000 7f813ea00640 1 -- 172.21.15.3:0/2378708022 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81381a59e0 con 0x7f8138108620 2024-09-10T23:27:01.942 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.941+0000 7f8142c60740 1 Processor -- start 2024-09-10T23:27:01.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.942+0000 7f8142c60740 1 -- start start 2024-09-10T23:27:01.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.942+0000 7f8136000640 1 -- 172.21.15.3:0/2378708022 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 25) ==== 153431+0+0 (secure 0 0 0) 0x7f8124009a30 con 0x7f8138108620 2024-09-10T23:27:01.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.942+0000 7f8142c60740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5f4f2b400 0x55b5f4f2b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.942+0000 7f8142c60740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f4f2bd20 0x55b5f4f37770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.942+0000 7f8142c60740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b5f4f37cb0 0x55b5f4f3a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.942+0000 7f8142c60740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b5f4ea2d50 con 0x55b5f4f37cb0 2024-09-10T23:27:01.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.942+0000 7f8142c60740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b5f4e92180 con 0x55b5f4f2b400 2024-09-10T23:27:01.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.942+0000 7f8142c60740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55b5f4e95f90 con 0x55b5f4f2bd20 2024-09-10T23:27:01.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.942+0000 7f813cc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b5f4f37cb0 0x55b5f4f3a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.942+0000 7f813e000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5f4f2b400 0x55b5f4f2b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.942+0000 7f813cc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b5f4f37cb0 0x55b5f4f3a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38912/0 (socket says 172.21.15.3:38912) 2024-09-10T23:27:01.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.942+0000 7f813cc00640 1 -- 172.21.15.3:0/1501533539 learned_addr learned my addr 172.21.15.3:0/1501533539 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:27:01.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.942+0000 7f813d600640 1 --2- 172.21.15.3:0/1501533539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f4f2bd20 0x55b5f4f37770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.943+0000 7f813d600640 1 -- 172.21.15.3:0/1501533539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5f4f2b400 msgr2=0x55b5f4f2b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:01.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.943+0000 7f813d600640 1 --2- 172.21.15.3:0/1501533539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5f4f2b400 0x55b5f4f2b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.943+0000 7f813d600640 1 -- 172.21.15.3:0/1501533539 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b5f4f37cb0 msgr2=0x55b5f4f3a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:01.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.943+0000 7f813d600640 1 --2- 172.21.15.3:0/1501533539 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b5f4f37cb0 0x55b5f4f3a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.943+0000 7f813d600640 1 -- 172.21.15.3:0/1501533539 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5f4e5ca70 con 0x55b5f4f2bd20 2024-09-10T23:27:01.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.943+0000 7f813e000640 1 --2- 172.21.15.3:0/1501533539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5f4f2b400 0x55b5f4f2b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:27:01.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.943+0000 7f813cc00640 1 --2- 172.21.15.3:0/1501533539 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b5f4f37cb0 0x55b5f4f3a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:27:01.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.943+0000 7f813d600640 1 --2- 172.21.15.3:0/1501533539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f4f2bd20 0x55b5f4f37770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f812c02aeb0 tx=0x7f812c009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf4636f6386ed825 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:01.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.944+0000 7f8136000640 1 --2- 172.21.15.3:0/2378708022 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f81200b5580 0x7f81200b7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.944+0000 7f812a600640 1 -- 172.21.15.3:0/1501533539 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c031980 con 0x55b5f4f2bd20 2024-09-10T23:27:01.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.944+0000 7f812a600640 1 -- 172.21.15.3:0/1501533539 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f812c036070 con 0x55b5f4f2bd20 2024-09-10T23:27:01.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.944+0000 7f812a600640 1 -- 172.21.15.3:0/1501533539 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c004460 con 0x55b5f4f2bd20 2024-09-10T23:27:01.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.944+0000 7f8136000640 1 -- 172.21.15.3:0/2378708022 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f81240e5f30 con 0x7f8138108620 2024-09-10T23:27:01.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.944+0000 7f813e000640 1 --2- 172.21.15.3:0/2378708022 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f81200b5580 0x7f81200b7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.945+0000 7f8142c60740 1 -- 172.21.15.3:0/1501533539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f4f2bd20 msgr2=0x55b5f4f37770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:01.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.945+0000 7f8142c60740 1 --2- 172.21.15.3:0/1501533539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f4f2bd20 0x55b5f4f37770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f812c02aeb0 tx=0x7f812c009a20 comp rx=0 tx=0).stop 2024-09-10T23:27:01.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.945+0000 7f8142c60740 1 -- 172.21.15.3:0/1501533539 shutdown_connections 2024-09-10T23:27:01.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.945+0000 7f8142c60740 1 --2- 172.21.15.3:0/1501533539 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b5f4f37cb0 0x55b5f4f3a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.945+0000 7f8142c60740 1 --2- 172.21.15.3:0/1501533539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f4f2bd20 0x55b5f4f37770 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.945+0000 7f8142c60740 1 --2- 172.21.15.3:0/1501533539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5f4f2b400 0x55b5f4f2b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.945+0000 7f8142c60740 1 -- 172.21.15.3:0/1501533539 >> 172.21.15.3:0/1501533539 conn(0x55b5f4f29230 msgr2=0x55b5f4f2a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:01.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.945+0000 7f813e000640 1 --2- 172.21.15.3:0/2378708022 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f81200b5580 0x7f81200b7a40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f813000b890 tx=0x7f813000b2e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:01.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.945+0000 7f8142c60740 1 -- 172.21.15.3:0/1501533539 shutdown_connections 2024-09-10T23:27:01.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.945+0000 7f8142c60740 1 -- 172.21.15.3:0/1501533539 wait complete. 2024-09-10T23:27:01.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.946+0000 7f8142c60740 1 -- start start 2024-09-10T23:27:01.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.946+0000 7f8142c60740 1 Processor -- start 2024-09-10T23:27:01.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.946+0000 7f8142c60740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f4f2b400 0x55b5f4f34cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.946+0000 7f8142c60740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5f4f2bd20 0x55b5f4f351f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.946+0000 7f8142c60740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b5f4f37cb0 0x55b5f4f35730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.946+0000 7f8142c60740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b5f4cf35f0 con 0x55b5f4f37cb0 2024-09-10T23:27:01.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.946+0000 7f8142c60740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b5f4e2d460 con 0x55b5f4f2bd20 2024-09-10T23:27:01.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.946+0000 7f8142c60740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55b5f4f3a820 con 0x55b5f4f2b400 2024-09-10T23:27:01.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.946+0000 7f8142c60740 10 client.0 _ll_register_callbacks cb 0x55b5f4e3d210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:01.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.947+0000 7f813e000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b5f4f37cb0 0x55b5f4f35730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.947+0000 7f813e000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b5f4f37cb0 0x55b5f4f35730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38924/0 (socket says 172.21.15.3:38924) 2024-09-10T23:27:01.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.947+0000 7f813e000640 1 -- 172.21.15.3:0/2027802194 learned_addr learned my addr 172.21.15.3:0/2027802194 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:27:01.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.947+0000 7f813cc00640 1 --2- 172.21.15.3:0/2027802194 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5f4f2bd20 0x55b5f4f351f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.947+0000 7f813d600640 1 --2- 172.21.15.3:0/2027802194 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f4f2b400 0x55b5f4f34cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.947+0000 7f813e000640 1 -- 172.21.15.3:0/2027802194 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f4f2b400 msgr2=0x55b5f4f34cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:01.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.947+0000 7f813e000640 1 --2- 172.21.15.3:0/2027802194 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f4f2b400 0x55b5f4f34cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.947+0000 7f813e000640 1 -- 172.21.15.3:0/2027802194 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5f4f2bd20 msgr2=0x55b5f4f351f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:01.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.947+0000 7f813e000640 1 --2- 172.21.15.3:0/2027802194 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5f4f2bd20 0x55b5f4f351f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.947+0000 7f813e000640 1 -- 172.21.15.3:0/2027802194 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5f4bf0540 con 0x55b5f4f37cb0 2024-09-10T23:27:01.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.947+0000 7f813cc00640 1 --2- 172.21.15.3:0/2027802194 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5f4f2bd20 0x55b5f4f351f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:27:01.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.948+0000 7f813e000640 1 --2- 172.21.15.3:0/2027802194 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b5f4f37cb0 0x55b5f4f35730 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8130003c40 tx=0x7f8130004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c826ef35c941cf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:01.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.948+0000 7f811ea00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-10T23:27:01.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.948+0000 7f811ea00640 1 -- 172.21.15.3:0/2027802194 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813002c060 con 0x55b5f4f37cb0 2024-09-10T23:27:01.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.948+0000 7f8142c60740 1 -- 172.21.15.3:0/2027802194 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b5f4e2fa70 con 0x55b5f4f37cb0 2024-09-10T23:27:01.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.948+0000 7f811ea00640 1 -- 172.21.15.3:0/2027802194 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f8130017030 con 0x55b5f4f37cb0 2024-09-10T23:27:01.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.948+0000 7f811ea00640 1 -- 172.21.15.3:0/2027802194 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8130033050 con 0x55b5f4f37cb0 2024-09-10T23:27:01.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.948+0000 7f8142c60740 10 client.15612 fetch_fsmap learned FSMap version 26 2024-09-10T23:27:01.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.948+0000 7f8142c60740 1 -- 172.21.15.3:0/2027802194 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b5f4e4a6f0 con 0x55b5f4f37cb0 2024-09-10T23:27:01.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.949+0000 7f811ea00640 1 -- 172.21.15.3:0/2027802194 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55b5f4e2fa70 con 0x55b5f4f37cb0 2024-09-10T23:27:01.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.949+0000 7f811ea00640 1 -- 172.21.15.3:0/2027802194 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f8130011440 con 0x55b5f4f37cb0 2024-09-10T23:27:01.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.949+0000 7f8142c60740 10 client.15612 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:27:01.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.949+0000 7f8142c60740 10 client.15612 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-10T23:27:01.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.949+0000 7f8142c60740 20 client.15612 populate_metadata read hostname 'smithi003' 2024-09-10T23:27:01.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.949+0000 7f8142c60740 1 --2- 172.21.15.3:0/2027802194 >> [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] conn(0x55b5f4f4cd40 0x55b5f4f4e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.949+0000 7f8142c60740 4 client.15612 mds_command: new command op to 34652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:27:01.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.949+0000 7f8142c60740 1 -- 172.21.15.3:0/2027802194 --> [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5f4ea4ca0 con 0x55b5f4f4cd40 2024-09-10T23:27:01.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.949+0000 7f813d600640 1 --2- 172.21.15.3:0/2027802194 >> [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] conn(0x55b5f4f4cd40 0x55b5f4f4e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.950+0000 7f813d600640 1 --2- 172.21.15.3:0/2027802194 >> [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] conn(0x55b5f4f4cd40 0x55b5f4f4e1b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=136cdef3538f6277 server_cookie=deb00db9f5ed9aad in_seq=0 out_seq=0 2024-09-10T23:27:01.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.950+0000 7f811ea00640 10 client.15612 ms_handle_connect on v2:172.21.15.38:6834/218783320 2024-09-10T23:27:01.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.951+0000 7f811ea00640 1 -- 172.21.15.3:0/2027802194 <== mds.2 v2:172.21.15.38:6834/218783320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b5f4ea4ca0 con 0x55b5f4f4cd40 2024-09-10T23:27:01.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.951+0000 7f811ea00640 10 client.15612 handle_command_reply: tid=0 2024-09-10T23:27:01.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.951+0000 7f8142c60740 1 client.15612 shutdown 2024-09-10T23:27:01.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.951+0000 7f8142c60740 1 -- 172.21.15.3:0/2027802194 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b5f4f37cb0 msgr2=0x55b5f4f35730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:01.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.951+0000 7f8142c60740 1 --2- 172.21.15.3:0/2027802194 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b5f4f37cb0 0x55b5f4f35730 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8130003c40 tx=0x7f8130004730 comp rx=0 tx=0).stop 2024-09-10T23:27:01.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.951+0000 7f8142c60740 1 -- 172.21.15.3:0/2027802194 shutdown_connections 2024-09-10T23:27:01.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.951+0000 7f8142c60740 1 --2- 172.21.15.3:0/2027802194 >> [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] conn(0x55b5f4f4cd40 0x55b5f4f4e1b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.951+0000 7f8142c60740 1 --2- 172.21.15.3:0/2027802194 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b5f4f37cb0 0x55b5f4f35730 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.951+0000 7f8142c60740 1 --2- 172.21.15.3:0/2027802194 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5f4f2bd20 0x55b5f4f351f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.951+0000 7f811ea00640 0 client.15612 ms_handle_reset on v2:172.21.15.38:6834/218783320 2024-09-10T23:27:01.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.951+0000 7f8142c60740 1 --2- 172.21.15.3:0/2027802194 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f4f2b400 0x55b5f4f34cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.951+0000 7f8142c60740 1 -- 172.21.15.3:0/2027802194 >> 172.21.15.3:0/2027802194 conn(0x55b5f4f29230 msgr2=0x55b5f4f2edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:01.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.951+0000 7f8142c60740 1 -- 172.21.15.3:0/2027802194 shutdown_connections 2024-09-10T23:27:01.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.952+0000 7f8142c60740 1 -- 172.21.15.3:0/2027802194 wait complete. 2024-09-10T23:27:01.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.952+0000 7f8142c60740 20 client.15612 trim_cache size 0 max 16384 2024-09-10T23:27:01.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.971+0000 7f8142c60740 1 Processor -- start 2024-09-10T23:27:01.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.971+0000 7f8142c60740 1 -- start start 2024-09-10T23:27:01.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.971+0000 7f8142c60740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f4f2b400 0x55b5f4f2a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.971+0000 7f8142c60740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b5f4f2bd20 0x55b5f4f2f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.971+0000 7f8142c60740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5f4f37cb0 0x55b5f4f33530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.971+0000 7f8142c60740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b5f4f4c4f0 con 0x55b5f4f2bd20 2024-09-10T23:27:01.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.971+0000 7f8142c60740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b5f4f4cbc0 con 0x55b5f4f37cb0 2024-09-10T23:27:01.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.971+0000 7f8142c60740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55b5f4f4d290 con 0x55b5f4f2b400 2024-09-10T23:27:01.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.971+0000 7f813cc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b5f4f2bd20 0x55b5f4f2f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.972+0000 7f813cc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b5f4f2bd20 0x55b5f4f2f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38932/0 (socket says 172.21.15.3:38932) 2024-09-10T23:27:01.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.972+0000 7f813cc00640 1 -- 172.21.15.3:0/4033724436 learned_addr learned my addr 172.21.15.3:0/4033724436 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:27:01.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.972+0000 7f813d600640 1 --2- 172.21.15.3:0/4033724436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f4f2b400 0x55b5f4f2a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.972+0000 7f813e000640 1 --2- 172.21.15.3:0/4033724436 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5f4f37cb0 0x55b5f4f33530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.972+0000 7f813cc00640 1 -- 172.21.15.3:0/4033724436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f4f2b400 msgr2=0x55b5f4f2a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:01.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.972+0000 7f813cc00640 1 --2- 172.21.15.3:0/4033724436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f4f2b400 0x55b5f4f2a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.972+0000 7f813cc00640 1 -- 172.21.15.3:0/4033724436 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5f4f37cb0 msgr2=0x55b5f4f33530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:01.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.972+0000 7f813cc00640 1 --2- 172.21.15.3:0/4033724436 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5f4f37cb0 0x55b5f4f33530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.972+0000 7f813cc00640 1 -- 172.21.15.3:0/4033724436 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5f4f4a790 con 0x55b5f4f2bd20 2024-09-10T23:27:01.975 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.972+0000 7f813cc00640 1 --2- 172.21.15.3:0/4033724436 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b5f4f2bd20 0x55b5f4f2f5c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8124000c00 tx=0x7f81240e9930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5381b2ed82453c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:01.975 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.972+0000 7f8129c00640 1 -- 172.21.15.3:0/4033724436 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81240a7d10 con 0x55b5f4f2bd20 2024-09-10T23:27:01.975 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.973+0000 7f8129c00640 1 -- 172.21.15.3:0/4033724436 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f81240ab980 con 0x55b5f4f2bd20 2024-09-10T23:27:01.975 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.973+0000 7f8129c00640 1 -- 172.21.15.3:0/4033724436 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81240ab5e0 con 0x55b5f4f2bd20 2024-09-10T23:27:01.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.973+0000 7f8142c60740 1 -- 172.21.15.3:0/4033724436 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b5f4f2bd20 msgr2=0x55b5f4f2f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:01.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.973+0000 7f8142c60740 1 --2- 172.21.15.3:0/4033724436 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b5f4f2bd20 0x55b5f4f2f5c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8124000c00 tx=0x7f81240e9930 comp rx=0 tx=0).stop 2024-09-10T23:27:01.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.973+0000 7f8142c60740 1 -- 172.21.15.3:0/4033724436 shutdown_connections 2024-09-10T23:27:01.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.973+0000 7f8142c60740 1 --2- 172.21.15.3:0/4033724436 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5f4f37cb0 0x55b5f4f33530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.973+0000 7f8142c60740 1 --2- 172.21.15.3:0/4033724436 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b5f4f2bd20 0x55b5f4f2f5c0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.973+0000 7f8142c60740 1 --2- 172.21.15.3:0/4033724436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f4f2b400 0x55b5f4f2a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.973+0000 7f8142c60740 1 -- 172.21.15.3:0/4033724436 >> 172.21.15.3:0/4033724436 conn(0x55b5f4f29230 msgr2=0x55b5f4f2ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:01.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.973+0000 7f8142c60740 1 -- 172.21.15.3:0/4033724436 shutdown_connections 2024-09-10T23:27:01.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.974+0000 7f8142c60740 1 -- 172.21.15.3:0/4033724436 wait complete. 2024-09-10T23:27:01.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.974+0000 7f8142c60740 1 -- start start 2024-09-10T23:27:01.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.974+0000 7f8142c60740 1 Processor -- start 2024-09-10T23:27:01.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.974+0000 7f8142c60740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f4f2b400 0x55b5f4f507d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.975+0000 7f8142c60740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5f4f2bd20 0x55b5f4f50d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.975+0000 7f8142c60740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b5f4f37cb0 0x55b5f4f55f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.975+0000 7f8142c60740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b5f4f4e030 con 0x55b5f4f37cb0 2024-09-10T23:27:01.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.975+0000 7f8142c60740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b5f4f4d960 con 0x55b5f4f2bd20 2024-09-10T23:27:01.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.975+0000 7f8142c60740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55b5f4f4e700 con 0x55b5f4f2b400 2024-09-10T23:27:01.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.975+0000 7f8142c60740 10 client.0 _ll_register_callbacks cb 0x7f8130004260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:01.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.975+0000 7f813e000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b5f4f37cb0 0x55b5f4f55f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.975+0000 7f813e000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b5f4f37cb0 0x55b5f4f55f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38938/0 (socket says 172.21.15.3:38938) 2024-09-10T23:27:01.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.975+0000 7f813e000640 1 -- 172.21.15.3:0/3813241306 learned_addr learned my addr 172.21.15.3:0/3813241306 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:27:01.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.975+0000 7f813cc00640 1 --2- 172.21.15.3:0/3813241306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5f4f2bd20 0x55b5f4f50d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.975+0000 7f813d600640 1 --2- 172.21.15.3:0/3813241306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f4f2b400 0x55b5f4f507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.975+0000 7f813e000640 1 -- 172.21.15.3:0/3813241306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f4f2b400 msgr2=0x55b5f4f507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:01.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.975+0000 7f813e000640 1 --2- 172.21.15.3:0/3813241306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f4f2b400 0x55b5f4f507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.975+0000 7f813e000640 1 -- 172.21.15.3:0/3813241306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5f4f2bd20 msgr2=0x55b5f4f50d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:01.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.975+0000 7f813e000640 1 --2- 172.21.15.3:0/3813241306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5f4f2bd20 0x55b5f4f50d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.975+0000 7f813e000640 1 -- 172.21.15.3:0/3813241306 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5f4f248c0 con 0x55b5f4f37cb0 2024-09-10T23:27:01.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.976+0000 7f813e000640 1 --2- 172.21.15.3:0/3813241306 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b5f4f37cb0 0x55b5f4f55f60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f8130011860 tx=0x7f81300116f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bffb7ecf309cfe1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:01.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.976+0000 7f811ea00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-10T23:27:01.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.976+0000 7f811ea00640 1 -- 172.21.15.3:0/3813241306 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81300047a0 con 0x55b5f4f37cb0 2024-09-10T23:27:01.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.976+0000 7f811ea00640 1 -- 172.21.15.3:0/3813241306 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f8130004940 con 0x55b5f4f37cb0 2024-09-10T23:27:01.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.976+0000 7f8142c60740 1 -- 172.21.15.3:0/3813241306 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81240ab980 con 0x55b5f4f37cb0 2024-09-10T23:27:01.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.976+0000 7f811ea00640 1 -- 172.21.15.3:0/3813241306 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8130045050 con 0x55b5f4f37cb0 2024-09-10T23:27:01.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.976+0000 7f8142c60740 10 client.15618 fetch_fsmap learned FSMap version 26 2024-09-10T23:27:01.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.976+0000 7f8142c60740 1 -- 172.21.15.3:0/3813241306 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b5f4fb9c50 con 0x55b5f4f37cb0 2024-09-10T23:27:01.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.977+0000 7f811ea00640 1 -- 172.21.15.3:0/3813241306 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f81240ab980 con 0x55b5f4f37cb0 2024-09-10T23:27:01.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.977+0000 7f811ea00640 1 -- 172.21.15.3:0/3813241306 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f8130037430 con 0x55b5f4f37cb0 2024-09-10T23:27:01.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.977+0000 7f8142c60740 10 client.15618 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:27:01.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.977+0000 7f8142c60740 10 client.15618 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-10T23:27:01.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.977+0000 7f8142c60740 20 client.15618 populate_metadata read hostname 'smithi003' 2024-09-10T23:27:01.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.977+0000 7f8142c60740 1 --2- 172.21.15.3:0/3813241306 >> [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] conn(0x55b5f4fbe840 0x55b5f4fbd550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.977+0000 7f8142c60740 4 client.15618 mds_command: new command op to 34652 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:27:01.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.977+0000 7f8142c60740 1 -- 172.21.15.3:0/3813241306 --> [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] -- command(tid 0: {"prefix": "status"}) -- 0x55b5f4ea0750 con 0x55b5f4fbe840 2024-09-10T23:27:01.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.977+0000 7f813d600640 1 --2- 172.21.15.3:0/3813241306 >> [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] conn(0x55b5f4fbe840 0x55b5f4fbd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.978+0000 7f813d600640 1 --2- 172.21.15.3:0/3813241306 >> [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] conn(0x55b5f4fbe840 0x55b5f4fbd550 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=91705c13899af8dd server_cookie=6844919e3a57a4de in_seq=0 out_seq=0 2024-09-10T23:27:01.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.978+0000 7f811ea00640 10 client.15618 ms_handle_connect on v2:172.21.15.38:6834/218783320 2024-09-10T23:27:01.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.978+0000 7f811ea00640 1 -- 172.21.15.3:0/3813241306 <== mds.2 v2:172.21.15.38:6834/218783320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55b5f4ea0750 con 0x55b5f4fbe840 2024-09-10T23:27:01.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.978+0000 7f811ea00640 10 client.15618 handle_command_reply: tid=0 2024-09-10T23:27:01.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.978+0000 7f8142c60740 1 client.15618 shutdown 2024-09-10T23:27:01.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.978+0000 7f8142c60740 1 -- 172.21.15.3:0/3813241306 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b5f4f37cb0 msgr2=0x55b5f4f55f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:01.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.978+0000 7f8142c60740 1 --2- 172.21.15.3:0/3813241306 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b5f4f37cb0 0x55b5f4f55f60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f8130011860 tx=0x7f81300116f0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.979+0000 7f8142c60740 1 -- 172.21.15.3:0/3813241306 shutdown_connections 2024-09-10T23:27:01.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.979+0000 7f8142c60740 1 --2- 172.21.15.3:0/3813241306 >> [v2:172.21.15.38:6834/218783320,v1:172.21.15.38:6835/218783320] conn(0x55b5f4fbe840 0x55b5f4fbd550 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.979+0000 7f8142c60740 1 --2- 172.21.15.3:0/3813241306 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b5f4f37cb0 0x55b5f4f55f60 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.979+0000 7f8142c60740 1 --2- 172.21.15.3:0/3813241306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5f4f2bd20 0x55b5f4f50d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.979+0000 7f8142c60740 1 --2- 172.21.15.3:0/3813241306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f4f2b400 0x55b5f4f507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.979+0000 7f8142c60740 1 -- 172.21.15.3:0/3813241306 >> 172.21.15.3:0/3813241306 conn(0x55b5f4f29230 msgr2=0x55b5f4f362e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:01.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.979+0000 7f811ea00640 0 client.15618 ms_handle_reset on v2:172.21.15.38:6834/218783320 2024-09-10T23:27:01.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.979+0000 7f8142c60740 1 -- 172.21.15.3:0/3813241306 shutdown_connections 2024-09-10T23:27:01.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.979+0000 7f8142c60740 1 -- 172.21.15.3:0/3813241306 wait complete. 2024-09-10T23:27:01.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.979+0000 7f8142c60740 20 client.15618 trim_cache size 0 max 16384 2024-09-10T23:27:01.984 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-10T23:27:01.984 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_fsid": "3f4e30d0-6fca-11ef-bcea-c7b262605968", 2024-09-10T23:27:01.984 INFO:teuthology.orchestra.run.smithi003.stdout: "whoami": 2, 2024-09-10T23:27:01.984 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 34652, 2024-09-10T23:27:01.984 INFO:teuthology.orchestra.run.smithi003.stdout: "want_state": "up:active", 2024-09-10T23:27:01.984 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "up:active", 2024-09-10T23:27:01.984 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs", 2024-09-10T23:27:01.984 INFO:teuthology.orchestra.run.smithi003.stdout: "rank_uptime": 133.744457641, 2024-09-10T23:27:01.984 INFO:teuthology.orchestra.run.smithi003.stdout: "mdsmap_epoch": 26, 2024-09-10T23:27:01.984 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch": 90, 2024-09-10T23:27:01.984 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch_barrier": 90, 2024-09-10T23:27:01.984 INFO:teuthology.orchestra.run.smithi003.stdout: "uptime": 221.98273087999999 2024-09-10T23:27:01.984 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-10T23:27:01.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.980+0000 7f813ea00640 1 -- 172.21.15.3:0/2378708022 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f81200b5580 msgr2=0x7f81200b7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:01.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.980+0000 7f813ea00640 1 --2- 172.21.15.3:0/2378708022 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f81200b5580 0x7f81200b7a40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f813000b890 tx=0x7f813000b2e0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.980+0000 7f813ea00640 1 -- 172.21.15.3:0/2378708022 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8138108620 msgr2=0x7f81381994c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:01.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.980+0000 7f813ea00640 1 --2- 172.21.15.3:0/2378708022 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8138108620 0x7f81381994c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f812400d950 tx=0x7f812400de10 comp rx=0 tx=0).stop 2024-09-10T23:27:01.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.980+0000 7f813ea00640 1 -- 172.21.15.3:0/2378708022 shutdown_connections 2024-09-10T23:27:01.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.980+0000 7f813ea00640 1 --2- 172.21.15.3:0/2378708022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8138108fa0 0x7f813819e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.980+0000 7f813ea00640 1 --2- 172.21.15.3:0/2378708022 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f81200b5580 0x7f81200b7a40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.980+0000 7f813ea00640 1 --2- 172.21.15.3:0/2378708022 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8138108620 0x7f81381994c0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.986 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.980+0000 7f813ea00640 1 --2- 172.21.15.3:0/2378708022 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8138102c10 0x7f8138198f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.986 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.980+0000 7f813ea00640 1 -- 172.21.15.3:0/2378708022 >> 172.21.15.3:0/2378708022 conn(0x7f81380fe660 msgr2=0x7f8138100a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:01.986 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.981+0000 7f813ea00640 1 -- 172.21.15.3:0/2378708022 shutdown_connections 2024-09-10T23:27:01.986 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:01.981+0000 7f813ea00640 1 -- 172.21.15.3:0/2378708022 wait complete. 2024-09-10T23:27:02.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:02 smithi194 ceph-mon[33904]: pgmap v398: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:27:02.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:02 smithi194 ceph-mon[33904]: mgrmap e25: x(active, since 10m), standbys: z, y 2024-09-10T23:27:02.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:02 smithi003 ceph-mon[30348]: pgmap v398: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:27:02.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:02 smithi003 ceph-mon[30348]: mgrmap e25: x(active, since 10m), standbys: z, y 2024-09-10T23:27:02.777 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-10T23:27:02.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:02 smithi038 ceph-mon[34225]: pgmap v398: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:27:02.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:02 smithi038 ceph-mon[34225]: mgrmap e25: x(active, since 10m), standbys: z, y 2024-09-10T23:27:03.175 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:27:03.683 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:03 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:27:03.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:03 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:27:03.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.796+0000 7fc7b9e00640 1 -- 172.21.15.3:0/3220903493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc7b4102da0 msgr2=0x7fc7b4103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:03.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.796+0000 7fc7b9e00640 1 --2- 172.21.15.3:0/3220903493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc7b4102da0 0x7fc7b4103180 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4009900 tx=0x7fc7a402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.796+0000 7fc7b9e00640 1 -- 172.21.15.3:0/3220903493 shutdown_connections 2024-09-10T23:27:03.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.796+0000 7fc7b9e00640 1 --2- 172.21.15.3:0/3220903493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7b4109130 0x7fc7b410f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.796+0000 7fc7b9e00640 1 --2- 172.21.15.3:0/3220903493 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7b41087b0 0x7fc7b4108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.796+0000 7fc7b9e00640 1 --2- 172.21.15.3:0/3220903493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc7b4102da0 0x7fc7b4103180 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.796+0000 7fc7b9e00640 1 -- 172.21.15.3:0/3220903493 >> 172.21.15.3:0/3220903493 conn(0x7fc7b40fe810 msgr2=0x7fc7b4100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:03.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.796+0000 7fc7b9e00640 1 -- 172.21.15.3:0/3220903493 shutdown_connections 2024-09-10T23:27:03.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.796+0000 7fc7b9e00640 1 -- 172.21.15.3:0/3220903493 wait complete. 2024-09-10T23:27:03.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.797+0000 7fc7b9e00640 1 Processor -- start 2024-09-10T23:27:03.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.798+0000 7fc7b9e00640 1 -- start start 2024-09-10T23:27:03.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.798+0000 7fc7b9e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7b4102da0 0x7fc7b40754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.798+0000 7fc7b9e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc7b41087b0 0x7fc7b40759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.798+0000 7fc7b9e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7b4109130 0x7fc7b4075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.798+0000 7fc7b9e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b4112ca0 con 0x7fc7b41087b0 2024-09-10T23:27:03.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.798+0000 7fc7b9e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b4112b20 con 0x7fc7b4109130 2024-09-10T23:27:03.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.798+0000 7fc7b9e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b4112e20 con 0x7fc7b4102da0 2024-09-10T23:27:03.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.798+0000 7fc7aa000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc7b41087b0 0x7fc7b40759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.798+0000 7fc7aa000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc7b41087b0 0x7fc7b40759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38960/0 (socket says 172.21.15.3:38960) 2024-09-10T23:27:03.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.798+0000 7fc7aa000640 1 -- 172.21.15.3:0/3877812537 learned_addr learned my addr 172.21.15.3:0/3877812537 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:27:03.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.799+0000 7fc7b3400640 1 --2- 172.21.15.3:0/3877812537 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7b4109130 0x7fc7b4075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.799+0000 7fc7b2a00640 1 --2- 172.21.15.3:0/3877812537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7b4102da0 0x7fc7b40754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.799+0000 7fc7aa000640 1 -- 172.21.15.3:0/3877812537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7b4102da0 msgr2=0x7fc7b40754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:03.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.799+0000 7fc7aa000640 1 --2- 172.21.15.3:0/3877812537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7b4102da0 0x7fc7b40754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.799+0000 7fc7aa000640 1 -- 172.21.15.3:0/3877812537 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7b4109130 msgr2=0x7fc7b4075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:03.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.799+0000 7fc7aa000640 1 --2- 172.21.15.3:0/3877812537 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7b4109130 0x7fc7b4075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.799+0000 7fc7aa000640 1 -- 172.21.15.3:0/3877812537 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b41a76b0 con 0x7fc7b41087b0 2024-09-10T23:27:03.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.799+0000 7fc7b3400640 1 --2- 172.21.15.3:0/3877812537 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7b4109130 0x7fc7b4075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:03.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.799+0000 7fc7b2a00640 1 --2- 172.21.15.3:0/3877812537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7b4102da0 0x7fc7b40754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:03.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.799+0000 7fc7aa000640 1 --2- 172.21.15.3:0/3877812537 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc7b41087b0 0x7fc7b40759e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc79c00ea60 tx=0x7fc79c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:03.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.800+0000 7fc7b8a00640 1 -- 172.21.15.3:0/3877812537 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c00cde0 con 0x7fc7b41087b0 2024-09-10T23:27:03.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.800+0000 7fc7b8a00640 1 -- 172.21.15.3:0/3877812537 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc79c0035f0 con 0x7fc7b41087b0 2024-09-10T23:27:03.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.800+0000 7fc7b8a00640 1 -- 172.21.15.3:0/3877812537 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c010690 con 0x7fc7b41087b0 2024-09-10T23:27:03.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.800+0000 7fc7b9e00640 1 -- 172.21.15.3:0/3877812537 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7b41a79a0 con 0x7fc7b41087b0 2024-09-10T23:27:03.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.800+0000 7fc7b9e00640 1 -- 172.21.15.3:0/3877812537 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7b41a7e90 con 0x7fc7b41087b0 2024-09-10T23:27:03.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.803+0000 7fc7bc8d3740 1 Processor -- start 2024-09-10T23:27:03.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.803+0000 7fc7bc8d3740 1 -- start start 2024-09-10T23:27:03.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.804+0000 7fc7bc8d3740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560b245e0240 0x560b245e0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.804+0000 7fc7bc8d3740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560b245e0b60 0x560b245ec5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.804+0000 7fc7bc8d3740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b245ecaf0 0x560b245eeee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.804+0000 7fc7bc8d3740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x560b24557d50 con 0x560b245ecaf0 2024-09-10T23:27:03.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.804+0000 7fc7bc8d3740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x560b24547180 con 0x560b245e0b60 2024-09-10T23:27:03.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.804+0000 7fc7bc8d3740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x560b2454af90 con 0x560b245e0240 2024-09-10T23:27:03.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.804+0000 7fc7b8a00640 1 -- 172.21.15.3:0/3877812537 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 25) ==== 153431+0+0 (secure 0 0 0) 0x7fc79c004000 con 0x7fc7b41087b0 2024-09-10T23:27:03.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.804+0000 7fc7b3400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560b245e0240 0x560b245e0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.804+0000 7fc7b3400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560b245e0240 0x560b245e0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.3:60304/0 (socket says 172.21.15.3:60304) 2024-09-10T23:27:03.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.804+0000 7fc7b3400640 1 -- 172.21.15.3:0/2526460123 learned_addr learned my addr 172.21.15.3:0/2526460123 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:27:03.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.804+0000 7fc7b2a00640 1 --2- 172.21.15.3:0/2526460123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560b245e0b60 0x560b245ec5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.804+0000 7fc7aa000640 1 --2- 172.21.15.3:0/2526460123 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b245ecaf0 0x560b245eeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.805+0000 7fc7b3400640 1 -- 172.21.15.3:0/2526460123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560b245e0b60 msgr2=0x560b245ec5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:03.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.805+0000 7fc7b3400640 1 --2- 172.21.15.3:0/2526460123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560b245e0b60 0x560b245ec5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.805+0000 7fc7b3400640 1 -- 172.21.15.3:0/2526460123 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b245ecaf0 msgr2=0x560b245eeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:03.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.805+0000 7fc7b3400640 1 --2- 172.21.15.3:0/2526460123 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b245ecaf0 0x560b245eeee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.805+0000 7fc7b3400640 1 -- 172.21.15.3:0/2526460123 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b24511a70 con 0x560b245e0240 2024-09-10T23:27:03.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.805+0000 7fc7b3400640 1 --2- 172.21.15.3:0/2526460123 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560b245e0240 0x560b245e0620 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac0103d0 tx=0x7fc7ac010890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecf87e4728769abb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:03.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.805+0000 7fc7a3e00640 1 -- 172.21.15.3:0/2526460123 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac011700 con 0x560b245e0240 2024-09-10T23:27:03.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.805+0000 7fc7a3e00640 1 -- 172.21.15.3:0/2526460123 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc7ac011d30 con 0x560b245e0240 2024-09-10T23:27:03.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.805+0000 7fc7a3e00640 1 -- 172.21.15.3:0/2526460123 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac01bdb0 con 0x560b245e0240 2024-09-10T23:27:03.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.806+0000 7fc7b8a00640 1 --2- 172.21.15.3:0/3877812537 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc7980b54e0 0x7fc7980b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.806+0000 7fc7b8a00640 1 -- 172.21.15.3:0/3877812537 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7fc79c0e68a0 con 0x7fc7b41087b0 2024-09-10T23:27:03.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.806+0000 7fc7bc8d3740 1 -- 172.21.15.3:0/2526460123 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560b245e0240 msgr2=0x560b245e0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:03.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.806+0000 7fc7b2a00640 1 --2- 172.21.15.3:0/3877812537 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc7980b54e0 0x7fc7980b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.806+0000 7fc7bc8d3740 1 --2- 172.21.15.3:0/2526460123 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560b245e0240 0x560b245e0620 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac0103d0 tx=0x7fc7ac010890 comp rx=0 tx=0).stop 2024-09-10T23:27:03.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.806+0000 7fc7bc8d3740 1 -- 172.21.15.3:0/2526460123 shutdown_connections 2024-09-10T23:27:03.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.806+0000 7fc7bc8d3740 1 --2- 172.21.15.3:0/2526460123 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b245ecaf0 0x560b245eeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.806+0000 7fc7bc8d3740 1 --2- 172.21.15.3:0/2526460123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560b245e0b60 0x560b245ec5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.806+0000 7fc7bc8d3740 1 --2- 172.21.15.3:0/2526460123 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560b245e0240 0x560b245e0620 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.806+0000 7fc7bc8d3740 1 -- 172.21.15.3:0/2526460123 >> 172.21.15.3:0/2526460123 conn(0x560b245de020 msgr2=0x560b245df210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:03.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.807+0000 7fc7bc8d3740 1 -- 172.21.15.3:0/2526460123 shutdown_connections 2024-09-10T23:27:03.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.807+0000 7fc7bc8d3740 1 -- 172.21.15.3:0/2526460123 wait complete. 2024-09-10T23:27:03.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.807+0000 7fc7b2a00640 1 --2- 172.21.15.3:0/3877812537 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc7980b54e0 0x7fc7980b79a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x560b245e33c0 tx=0x7fc7a4032b10 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:03.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.807+0000 7fc7bc8d3740 1 -- start start 2024-09-10T23:27:03.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.807+0000 7fc7bc8d3740 1 Processor -- start 2024-09-10T23:27:03.812 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.808+0000 7fc7bc8d3740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b245e0240 0x560b245e9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.812 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.808+0000 7fc7bc8d3740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560b245e0b60 0x560b245ea030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.812 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.808+0000 7fc7bc8d3740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560b245ecaf0 0x560b245ea570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.812 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.808+0000 7fc7bc8d3740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x560b243a85f0 con 0x560b245e0240 2024-09-10T23:27:03.812 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.808+0000 7fc7bc8d3740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x560b244e2460 con 0x560b245e0b60 2024-09-10T23:27:03.812 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.808+0000 7fc7bc8d3740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x560b245ef840 con 0x560b245ecaf0 2024-09-10T23:27:03.812 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.808+0000 7fc7bc8d3740 10 client.0 _ll_register_callbacks cb 0x560b244f2210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:03.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.808+0000 7fc7b3400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560b245ecaf0 0x560b245ea570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.808+0000 7fc7b2a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b245e0240 0x560b245e9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.808+0000 7fc7b3400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560b245ecaf0 0x560b245ea570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.3:60320/0 (socket says 172.21.15.3:60320) 2024-09-10T23:27:03.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.808+0000 7fc7b3400640 1 -- 172.21.15.3:0/1591516536 learned_addr learned my addr 172.21.15.3:0/1591516536 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:27:03.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.808+0000 7fc7aa000640 1 --2- 172.21.15.3:0/1591516536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560b245e0b60 0x560b245ea030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.809+0000 7fc7aa000640 1 -- 172.21.15.3:0/1591516536 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560b245ecaf0 msgr2=0x560b245ea570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:03.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.809+0000 7fc7aa000640 1 --2- 172.21.15.3:0/1591516536 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560b245ecaf0 0x560b245ea570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.809+0000 7fc7aa000640 1 -- 172.21.15.3:0/1591516536 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b245e0240 msgr2=0x560b245e9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:03.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.809+0000 7fc7aa000640 1 --2- 172.21.15.3:0/1591516536 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b245e0240 0x560b245e9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.809+0000 7fc7aa000640 1 -- 172.21.15.3:0/1591516536 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b242a5540 con 0x560b245e0b60 2024-09-10T23:27:03.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.809+0000 7fc7aa000640 1 --2- 172.21.15.3:0/1591516536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560b245e0b60 0x560b245ea030 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc79c0e3bc0 tx=0x7fc79c0a86e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43cdca2767efb06b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:03.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.809+0000 7fc7a0c00640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-10T23:27:03.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.809+0000 7fc7a0c00640 1 -- 172.21.15.3:0/1591516536 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c0ac190 con 0x560b245e0b60 2024-09-10T23:27:03.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.809+0000 7fc7a0c00640 1 -- 172.21.15.3:0/1591516536 <== mon.2 v2:172.21.15.38:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7fc79c0a8ab0 con 0x560b245e0b60 2024-09-10T23:27:03.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.809+0000 7fc7bc8d3740 1 -- 172.21.15.3:0/1591516536 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560b244e4a70 con 0x560b245e0b60 2024-09-10T23:27:03.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.809+0000 7fc7a0c00640 1 -- 172.21.15.3:0/1591516536 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc79c0abfb0 con 0x560b245e0b60 2024-09-10T23:27:03.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.810+0000 7fc7bc8d3740 10 client.35414 fetch_fsmap learned FSMap version 26 2024-09-10T23:27:03.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.810+0000 7fc7bc8d3740 1 -- 172.21.15.3:0/1591516536 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560b244ff6f0 con 0x560b245e0b60 2024-09-10T23:27:03.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.810+0000 7fc7a0c00640 1 -- 172.21.15.3:0/1591516536 <== mon.2 v2:172.21.15.38:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x560b244e4a70 con 0x560b245e0b60 2024-09-10T23:27:03.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.810+0000 7fc7a0c00640 1 -- 172.21.15.3:0/1591516536 <== mon.2 v2:172.21.15.38:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fc79c020390 con 0x560b245e0b60 2024-09-10T23:27:03.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.810+0000 7fc7bc8d3740 10 client.35414 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:27:03.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.810+0000 7fc7bc8d3740 10 client.35414 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T23:27:03.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.810+0000 7fc7bc8d3740 20 client.35414 populate_metadata read hostname 'smithi003' 2024-09-10T23:27:03.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.810+0000 7fc7bc8d3740 1 --2- 172.21.15.3:0/1591516536 >> [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] conn(0x560b245fd8d0 0x560b245fed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.810+0000 7fc7bc8d3740 4 client.35414 mds_command: new command op to 34682 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:27:03.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.810+0000 7fc7bc8d3740 1 -- 172.21.15.3:0/1591516536 --> [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b24559ca0 con 0x560b245fd8d0 2024-09-10T23:27:03.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.810+0000 7fc7b2a00640 1 --2- 172.21.15.3:0/1591516536 >> [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] conn(0x560b245fd8d0 0x560b245fed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.811+0000 7fc7b2a00640 1 --2- 172.21.15.3:0/1591516536 >> [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] conn(0x560b245fd8d0 0x560b245fed40 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=384d263c40dec00a server_cookie=60f965f9a747d256 in_seq=0 out_seq=0 2024-09-10T23:27:03.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.811+0000 7fc7a0c00640 10 client.35414 ms_handle_connect on v2:172.21.15.38:6836/1821839397 2024-09-10T23:27:03.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.812+0000 7fc7a0c00640 1 -- 172.21.15.3:0/1591516536 <== mds.1 v2:172.21.15.38:6836/1821839397 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560b24559ca0 con 0x560b245fd8d0 2024-09-10T23:27:03.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.812+0000 7fc7a0c00640 10 client.35414 handle_command_reply: tid=0 2024-09-10T23:27:03.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.812+0000 7fc7bc8d3740 1 client.35414 shutdown 2024-09-10T23:27:03.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.812+0000 7fc7bc8d3740 1 -- 172.21.15.3:0/1591516536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560b245e0b60 msgr2=0x560b245ea030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:03.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.812+0000 7fc7bc8d3740 1 --2- 172.21.15.3:0/1591516536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560b245e0b60 0x560b245ea030 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc79c0e3bc0 tx=0x7fc79c0a86e0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.812+0000 7fc7bc8d3740 1 -- 172.21.15.3:0/1591516536 shutdown_connections 2024-09-10T23:27:03.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.812+0000 7fc7bc8d3740 1 --2- 172.21.15.3:0/1591516536 >> [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] conn(0x560b245fd8d0 0x560b245fed40 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.812+0000 7fc7bc8d3740 1 --2- 172.21.15.3:0/1591516536 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560b245ecaf0 0x560b245ea570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.812+0000 7fc7bc8d3740 1 --2- 172.21.15.3:0/1591516536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560b245e0b60 0x560b245ea030 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.812+0000 7fc7bc8d3740 1 --2- 172.21.15.3:0/1591516536 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b245e0240 0x560b245e9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.817 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.812+0000 7fc7a0c00640 0 client.35414 ms_handle_reset on v2:172.21.15.38:6836/1821839397 2024-09-10T23:27:03.817 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.812+0000 7fc7bc8d3740 1 -- 172.21.15.3:0/1591516536 >> 172.21.15.3:0/1591516536 conn(0x560b245de020 msgr2=0x560b245e3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:03.817 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.812+0000 7fc7bc8d3740 1 -- 172.21.15.3:0/1591516536 shutdown_connections 2024-09-10T23:27:03.817 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.812+0000 7fc7bc8d3740 1 -- 172.21.15.3:0/1591516536 wait complete. 2024-09-10T23:27:03.817 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.813+0000 7fc7bc8d3740 20 client.35414 trim_cache size 0 max 16384 2024-09-10T23:27:03.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.832+0000 7fc7bc8d3740 1 Processor -- start 2024-09-10T23:27:03.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.832+0000 7fc7bc8d3740 1 -- start start 2024-09-10T23:27:03.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.832+0000 7fc7bc8d3740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b245e0240 0x560b245fed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.832+0000 7fc7bc8d3740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560b245e0b60 0x560b245e4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.832+0000 7fc7bc8d3740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560b245ecaf0 0x560b245e5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.832+0000 7fc7bc8d3740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x560b245fd080 con 0x560b245e0240 2024-09-10T23:27:03.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.832+0000 7fc7bc8d3740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x560b245fd750 con 0x560b245e0b60 2024-09-10T23:27:03.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.832+0000 7fc7bc8d3740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x560b245fde20 con 0x560b245ecaf0 2024-09-10T23:27:03.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.832+0000 7fc7b2a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b245e0240 0x560b245fed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.833+0000 7fc7b2a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b245e0240 0x560b245fed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38996/0 (socket says 172.21.15.3:38996) 2024-09-10T23:27:03.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.833+0000 7fc7b2a00640 1 -- 172.21.15.3:0/825769082 learned_addr learned my addr 172.21.15.3:0/825769082 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:27:03.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.833+0000 7fc7aa000640 1 --2- 172.21.15.3:0/825769082 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560b245e0b60 0x560b245e4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.833+0000 7fc7b3400640 1 --2- 172.21.15.3:0/825769082 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560b245ecaf0 0x560b245e5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.833+0000 7fc7b2a00640 1 -- 172.21.15.3:0/825769082 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560b245ecaf0 msgr2=0x560b245e5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:03.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.833+0000 7fc7b2a00640 1 --2- 172.21.15.3:0/825769082 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560b245ecaf0 0x560b245e5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.833+0000 7fc7b2a00640 1 -- 172.21.15.3:0/825769082 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560b245e0b60 msgr2=0x560b245e4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:03.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.833+0000 7fc7b2a00640 1 --2- 172.21.15.3:0/825769082 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560b245e0b60 0x560b245e4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.833+0000 7fc7b2a00640 1 -- 172.21.15.3:0/825769082 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b245e0990 con 0x560b245e0240 2024-09-10T23:27:03.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.833+0000 7fc7b2a00640 1 --2- 172.21.15.3:0/825769082 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b245e0240 0x560b245fed40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40057c0 tx=0x7fc7a4040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a9b234213e35405 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:03.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.834+0000 7fc7a3400640 1 -- 172.21.15.3:0/825769082 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4056070 con 0x560b245e0240 2024-09-10T23:27:03.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.834+0000 7fc7a3400640 1 -- 172.21.15.3:0/825769082 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc7a40044d0 con 0x560b245e0240 2024-09-10T23:27:03.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.834+0000 7fc7a3400640 1 -- 172.21.15.3:0/825769082 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4035040 con 0x560b245e0240 2024-09-10T23:27:03.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.834+0000 7fc7bc8d3740 1 -- 172.21.15.3:0/825769082 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b245e0240 msgr2=0x560b245fed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:03.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.834+0000 7fc7bc8d3740 1 --2- 172.21.15.3:0/825769082 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b245e0240 0x560b245fed40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40057c0 tx=0x7fc7a4040000 comp rx=0 tx=0).stop 2024-09-10T23:27:03.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.834+0000 7fc7bc8d3740 1 -- 172.21.15.3:0/825769082 shutdown_connections 2024-09-10T23:27:03.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.834+0000 7fc7bc8d3740 1 --2- 172.21.15.3:0/825769082 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560b245ecaf0 0x560b245e5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.834+0000 7fc7bc8d3740 1 --2- 172.21.15.3:0/825769082 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560b245e0b60 0x560b245e4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.834+0000 7fc7bc8d3740 1 --2- 172.21.15.3:0/825769082 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b245e0240 0x560b245fed40 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.834+0000 7fc7bc8d3740 1 -- 172.21.15.3:0/825769082 >> 172.21.15.3:0/825769082 conn(0x560b245de020 msgr2=0x560b245df180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:03.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.834+0000 7fc7bc8d3740 1 -- 172.21.15.3:0/825769082 shutdown_connections 2024-09-10T23:27:03.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.835+0000 7fc7bc8d3740 1 -- 172.21.15.3:0/825769082 wait complete. 2024-09-10T23:27:03.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.835+0000 7fc7bc8d3740 1 -- start start 2024-09-10T23:27:03.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.835+0000 7fc7bc8d3740 1 Processor -- start 2024-09-10T23:27:03.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.836+0000 7fc7bc8d3740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560b245e0240 0x560b24601380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.836+0000 7fc7bc8d3740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b245e0b60 0x560b246018c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.836+0000 7fc7bc8d3740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560b245ecaf0 0x560b24606b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.836+0000 7fc7bc8d3740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x560b245febc0 con 0x560b245e0b60 2024-09-10T23:27:03.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.836+0000 7fc7bc8d3740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x560b245fe4f0 con 0x560b245ecaf0 2024-09-10T23:27:03.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.836+0000 7fc7bc8d3740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x560b245ff290 con 0x560b245e0240 2024-09-10T23:27:03.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.836+0000 7fc7bc8d3740 10 client.0 _ll_register_callbacks cb 0x7fc79c0a8e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:03.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.836+0000 7fc7aa000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b245e0b60 0x560b246018c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.836+0000 7fc7b3400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560b245ecaf0 0x560b24606b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.836+0000 7fc7b3400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560b245ecaf0 0x560b24606b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.3:58222/0 (socket says 172.21.15.3:58222) 2024-09-10T23:27:03.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.836+0000 7fc7b3400640 1 -- 172.21.15.3:0/3618149828 learned_addr learned my addr 172.21.15.3:0/3618149828 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:27:03.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.836+0000 7fc7b2a00640 1 --2- 172.21.15.3:0/3618149828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560b245e0240 0x560b24601380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.837+0000 7fc7aa000640 1 -- 172.21.15.3:0/3618149828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560b245e0240 msgr2=0x560b24601380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:03.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.837+0000 7fc7aa000640 1 --2- 172.21.15.3:0/3618149828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560b245e0240 0x560b24601380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.837+0000 7fc7aa000640 1 -- 172.21.15.3:0/3618149828 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560b245ecaf0 msgr2=0x560b24606b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:03.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.837+0000 7fc7aa000640 1 --2- 172.21.15.3:0/3618149828 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560b245ecaf0 0x560b24606b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.837+0000 7fc7aa000640 1 -- 172.21.15.3:0/3618149828 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b24607050 con 0x560b245e0b60 2024-09-10T23:27:03.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.837+0000 7fc7aa000640 1 --2- 172.21.15.3:0/3618149828 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b245e0b60 0x560b246018c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc79c00c760 tx=0x7fc79c004550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff38542d9973763 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:03.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.837+0000 7fc7a0c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-10T23:27:03.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.837+0000 7fc7a0c00640 1 -- 172.21.15.3:0/3618149828 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c0ac190 con 0x560b245e0b60 2024-09-10T23:27:03.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.837+0000 7fc7a0c00640 1 -- 172.21.15.3:0/3618149828 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7fc79c0cfb90 con 0x560b245e0b60 2024-09-10T23:27:03.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.837+0000 7fc7bc8d3740 1 -- 172.21.15.3:0/3618149828 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7a40044d0 con 0x560b245e0b60 2024-09-10T23:27:03.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.837+0000 7fc7a0c00640 1 -- 172.21.15.3:0/3618149828 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc79c0e4070 con 0x560b245e0b60 2024-09-10T23:27:03.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.838+0000 7fc7bc8d3740 10 client.15636 fetch_fsmap learned FSMap version 26 2024-09-10T23:27:03.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.838+0000 7fc7bc8d3740 1 -- 172.21.15.3:0/3618149828 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560b2466a9b0 con 0x560b245e0b60 2024-09-10T23:27:03.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.838+0000 7fc7a0c00640 1 -- 172.21.15.3:0/3618149828 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc7a40044d0 con 0x560b245e0b60 2024-09-10T23:27:03.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.838+0000 7fc7a0c00640 1 -- 172.21.15.3:0/3618149828 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fc79c0abaa0 con 0x560b245e0b60 2024-09-10T23:27:03.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.838+0000 7fc7bc8d3740 10 client.15636 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:27:03.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.838+0000 7fc7bc8d3740 10 client.15636 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T23:27:03.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.838+0000 7fc7bc8d3740 20 client.15636 populate_metadata read hostname 'smithi003' 2024-09-10T23:27:03.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.838+0000 7fc7bc8d3740 1 --2- 172.21.15.3:0/3618149828 >> [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] conn(0x560b2466f590 0x560b2466e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.838+0000 7fc7bc8d3740 4 client.15636 mds_command: new command op to 34682 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:27:03.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.838+0000 7fc7bc8d3740 1 -- 172.21.15.3:0/3618149828 --> [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] -- command(tid 0: {"prefix": "status"}) -- 0x560b24555750 con 0x560b2466f590 2024-09-10T23:27:03.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.838+0000 7fc7b2a00640 1 --2- 172.21.15.3:0/3618149828 >> [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] conn(0x560b2466f590 0x560b2466e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.839+0000 7fc7b2a00640 1 --2- 172.21.15.3:0/3618149828 >> [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] conn(0x560b2466f590 0x560b2466e2a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=849c89656f90fb69 server_cookie=7456f699a1559473 in_seq=0 out_seq=0 2024-09-10T23:27:03.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.839+0000 7fc7a0c00640 10 client.15636 ms_handle_connect on v2:172.21.15.38:6836/1821839397 2024-09-10T23:27:03.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.839+0000 7fc7a0c00640 1 -- 172.21.15.3:0/3618149828 <== mds.1 v2:172.21.15.38:6836/1821839397 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x560b24555750 con 0x560b2466f590 2024-09-10T23:27:03.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.839+0000 7fc7a0c00640 10 client.15636 handle_command_reply: tid=0 2024-09-10T23:27:03.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.839+0000 7fc7bc8d3740 1 client.15636 shutdown 2024-09-10T23:27:03.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.839+0000 7fc7bc8d3740 1 -- 172.21.15.3:0/3618149828 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b245e0b60 msgr2=0x560b246018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:03.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.839+0000 7fc7bc8d3740 1 --2- 172.21.15.3:0/3618149828 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b245e0b60 0x560b246018c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc79c00c760 tx=0x7fc79c004550 comp rx=0 tx=0).stop 2024-09-10T23:27:03.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.840+0000 7fc7bc8d3740 1 -- 172.21.15.3:0/3618149828 shutdown_connections 2024-09-10T23:27:03.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.840+0000 7fc7bc8d3740 1 --2- 172.21.15.3:0/3618149828 >> [v2:172.21.15.38:6836/1821839397,v1:172.21.15.38:6837/1821839397] conn(0x560b2466f590 0x560b2466e2a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.840+0000 7fc7bc8d3740 1 --2- 172.21.15.3:0/3618149828 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560b245ecaf0 0x560b24606b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.840+0000 7fc7bc8d3740 1 --2- 172.21.15.3:0/3618149828 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b245e0b60 0x560b246018c0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.840+0000 7fc7bc8d3740 1 --2- 172.21.15.3:0/3618149828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560b245e0240 0x560b24601380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.840+0000 7fc7bc8d3740 1 -- 172.21.15.3:0/3618149828 >> 172.21.15.3:0/3618149828 conn(0x560b245de020 msgr2=0x560b245e4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:03.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.840+0000 7fc7a0c00640 0 client.15636 ms_handle_reset on v2:172.21.15.38:6836/1821839397 2024-09-10T23:27:03.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.840+0000 7fc7bc8d3740 1 -- 172.21.15.3:0/3618149828 shutdown_connections 2024-09-10T23:27:03.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.840+0000 7fc7bc8d3740 1 -- 172.21.15.3:0/3618149828 wait complete. 2024-09-10T23:27:03.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.840+0000 7fc7bc8d3740 20 client.15636 trim_cache size 0 max 16384 2024-09-10T23:27:03.845 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-10T23:27:03.845 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_fsid": "3f4e30d0-6fca-11ef-bcea-c7b262605968", 2024-09-10T23:27:03.845 INFO:teuthology.orchestra.run.smithi003.stdout: "whoami": 1, 2024-09-10T23:27:03.845 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 34682, 2024-09-10T23:27:03.845 INFO:teuthology.orchestra.run.smithi003.stdout: "want_state": "up:active", 2024-09-10T23:27:03.845 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "up:active", 2024-09-10T23:27:03.845 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs", 2024-09-10T23:27:03.845 INFO:teuthology.orchestra.run.smithi003.stdout: "rank_uptime": 136.61582719, 2024-09-10T23:27:03.845 INFO:teuthology.orchestra.run.smithi003.stdout: "mdsmap_epoch": 26, 2024-09-10T23:27:03.845 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch": 90, 2024-09-10T23:27:03.845 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch_barrier": 90, 2024-09-10T23:27:03.846 INFO:teuthology.orchestra.run.smithi003.stdout: "uptime": 213.82904420400001 2024-09-10T23:27:03.846 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-10T23:27:03.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.841+0000 7fc7b9e00640 1 -- 172.21.15.3:0/3877812537 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc7980b54e0 msgr2=0x7fc7980b79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:03.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.841+0000 7fc7b9e00640 1 --2- 172.21.15.3:0/3877812537 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc7980b54e0 0x7fc7980b79a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x560b245e33c0 tx=0x7fc7a4032b10 comp rx=0 tx=0).stop 2024-09-10T23:27:03.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.841+0000 7fc7b9e00640 1 -- 172.21.15.3:0/3877812537 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc7b41087b0 msgr2=0x7fc7b40759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:03.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.841+0000 7fc7b9e00640 1 --2- 172.21.15.3:0/3877812537 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc7b41087b0 0x7fc7b40759e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc79c00ea60 tx=0x7fc79c00ef20 comp rx=0 tx=0).stop 2024-09-10T23:27:03.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.841+0000 7fc7b9e00640 1 -- 172.21.15.3:0/3877812537 shutdown_connections 2024-09-10T23:27:03.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.841+0000 7fc7b9e00640 1 --2- 172.21.15.3:0/3877812537 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7b4109130 0x7fc7b4075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.841+0000 7fc7b9e00640 1 --2- 172.21.15.3:0/3877812537 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc7980b54e0 0x7fc7980b79a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.841+0000 7fc7b9e00640 1 --2- 172.21.15.3:0/3877812537 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc7b41087b0 0x7fc7b40759e0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.841+0000 7fc7b9e00640 1 --2- 172.21.15.3:0/3877812537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7b4102da0 0x7fc7b40754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.841+0000 7fc7b9e00640 1 -- 172.21.15.3:0/3877812537 >> 172.21.15.3:0/3877812537 conn(0x7fc7b40fe810 msgr2=0x7fc7b41001a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:03.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.841+0000 7fc7b9e00640 1 -- 172.21.15.3:0/3877812537 shutdown_connections 2024-09-10T23:27:03.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:03.841+0000 7fc7b9e00640 1 -- 172.21.15.3:0/3877812537 wait complete. 2024-09-10T23:27:03.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:03 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:27:04.521 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:04 smithi003 ceph-mon[30348]: pgmap v399: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-10T23:27:04.522 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:04 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:27:04.522 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:04 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:27:04.522 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:04 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:27:04.559 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T23:27:04.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:04 smithi194 ceph-mon[33904]: pgmap v399: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-10T23:27:04.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:04 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:27:04.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:04 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:27:04.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:04 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:27:04.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:04 smithi038 ceph-mon[34225]: pgmap v399: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-10T23:27:04.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:04 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:27:04.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:04 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:27:04.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:04 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:27:04.956 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:27:05.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.545+0000 7f436ac00640 1 -- 172.21.15.3:0/857146806 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f436410f200 msgr2=0x7f43641115f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:05.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.545+0000 7f436ac00640 1 --2- 172.21.15.3:0/857146806 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f436410f200 0x7f43641115f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f435c009ca0 tx=0x7f435c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.545+0000 7f436ac00640 1 -- 172.21.15.3:0/857146806 shutdown_connections 2024-09-10T23:27:05.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.545+0000 7f436ac00640 1 --2- 172.21.15.3:0/857146806 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f436410f200 0x7f43641115f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.546+0000 7f436ac00640 1 --2- 172.21.15.3:0/857146806 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4364075e00 0x7f436410ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.546+0000 7f436ac00640 1 --2- 172.21.15.3:0/857146806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43640754e0 0x7f43640758c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.546+0000 7f436ac00640 1 -- 172.21.15.3:0/857146806 >> 172.21.15.3:0/857146806 conn(0x7f43640fe660 msgr2=0x7f4364100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:05.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.546+0000 7f436ac00640 1 -- 172.21.15.3:0/857146806 shutdown_connections 2024-09-10T23:27:05.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.546+0000 7f436ac00640 1 -- 172.21.15.3:0/857146806 wait complete. 2024-09-10T23:27:05.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.547+0000 7f436ac00640 1 Processor -- start 2024-09-10T23:27:05.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.547+0000 7f436ac00640 1 -- start start 2024-09-10T23:27:05.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.548+0000 7f436ac00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43640754e0 0x7f436419b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:05.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.548+0000 7f436ac00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4364075e00 0x7f436419b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:05.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.548+0000 7f436ac00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f436410f200 0x7f43641a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:05.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.548+0000 7f436ac00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f4364114ce0 con 0x7f4364075e00 2024-09-10T23:27:05.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.548+0000 7f436ac00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4364114b60 con 0x7f436410f200 2024-09-10T23:27:05.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.548+0000 7f436ac00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4364114e60 con 0x7f43640754e0 2024-09-10T23:27:05.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.548+0000 7f4368e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4364075e00 0x7f436419b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:05.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.548+0000 7f4368e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4364075e00 0x7f436419b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39034/0 (socket says 172.21.15.3:39034) 2024-09-10T23:27:05.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.548+0000 7f4368e00640 1 -- 172.21.15.3:0/426125792 learned_addr learned my addr 172.21.15.3:0/426125792 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:27:05.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.548+0000 7f4369800640 1 --2- 172.21.15.3:0/426125792 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43640754e0 0x7f436419b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:05.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.548+0000 7f436a200640 1 --2- 172.21.15.3:0/426125792 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f436410f200 0x7f43641a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:05.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.549+0000 7f4368e00640 1 -- 172.21.15.3:0/426125792 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43640754e0 msgr2=0x7f436419b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:05.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.549+0000 7f4368e00640 1 --2- 172.21.15.3:0/426125792 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43640754e0 0x7f436419b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.549+0000 7f4368e00640 1 -- 172.21.15.3:0/426125792 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f436410f200 msgr2=0x7f43641a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:05.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.549+0000 7f4368e00640 1 --2- 172.21.15.3:0/426125792 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f436410f200 0x7f43641a0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.549+0000 7f4368e00640 1 -- 172.21.15.3:0/426125792 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43641a1240 con 0x7f4364075e00 2024-09-10T23:27:05.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.549+0000 7f4368e00640 1 --2- 172.21.15.3:0/426125792 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4364075e00 0x7f436419b6d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f435000e9f0 tx=0x7f435000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:05.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.549+0000 7f4362000640 1 -- 172.21.15.3:0/426125792 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435000cd80 con 0x7f4364075e00 2024-09-10T23:27:05.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.549+0000 7f4362000640 1 -- 172.21.15.3:0/426125792 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43500108c0 con 0x7f4364075e00 2024-09-10T23:27:05.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.549+0000 7f4362000640 1 -- 172.21.15.3:0/426125792 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43500187c0 con 0x7f4364075e00 2024-09-10T23:27:05.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.549+0000 7f436ac00640 1 -- 172.21.15.3:0/426125792 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43641a1530 con 0x7f4364075e00 2024-09-10T23:27:05.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.550+0000 7f436ac00640 1 -- 172.21.15.3:0/426125792 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43641a7bf0 con 0x7f4364075e00 2024-09-10T23:27:05.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.553+0000 7f436ecb2740 1 Processor -- start 2024-09-10T23:27:05.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.553+0000 7f436ecb2740 1 -- start start 2024-09-10T23:27:05.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.553+0000 7f436ecb2740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5596df2cb400 0x5596df2cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:05.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.553+0000 7f436ecb2740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596df2cbd20 0x5596df2d7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:05.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.553+0000 7f436ecb2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5596df2d7cb0 0x5596df2da0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:05.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.554+0000 7f436ecb2740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5596df242d50 con 0x5596df2cbd20 2024-09-10T23:27:05.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.554+0000 7f436ecb2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5596df232180 con 0x5596df2d7cb0 2024-09-10T23:27:05.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.554+0000 7f436ecb2740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5596df235f90 con 0x5596df2cb400 2024-09-10T23:27:05.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.554+0000 7f4362000640 1 -- 172.21.15.3:0/426125792 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 25) ==== 153431+0+0 (secure 0 0 0) 0x7f4350010430 con 0x7f4364075e00 2024-09-10T23:27:05.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.554+0000 7f4369800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596df2cbd20 0x5596df2d7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:05.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.554+0000 7f4369800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596df2cbd20 0x5596df2d7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39050/0 (socket says 172.21.15.3:39050) 2024-09-10T23:27:05.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.554+0000 7f4369800640 1 -- 172.21.15.3:0/4238189253 learned_addr learned my addr 172.21.15.3:0/4238189253 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:27:05.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.554+0000 7f436a200640 1 --2- 172.21.15.3:0/4238189253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5596df2cb400 0x5596df2cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:05.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.554+0000 7f4369800640 1 -- 172.21.15.3:0/4238189253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5596df2cb400 msgr2=0x5596df2cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:05.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.554+0000 7f4369800640 1 --2- 172.21.15.3:0/4238189253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5596df2cb400 0x5596df2cb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.554+0000 7f4368e00640 1 --2- 172.21.15.3:0/4238189253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5596df2d7cb0 0x5596df2da0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:05.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.554+0000 7f4369800640 1 -- 172.21.15.3:0/4238189253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5596df2d7cb0 msgr2=0x5596df2da0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:05.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.554+0000 7f4369800640 1 --2- 172.21.15.3:0/4238189253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5596df2d7cb0 0x5596df2da0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.554+0000 7f4369800640 1 -- 172.21.15.3:0/4238189253 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596df1fca70 con 0x5596df2cbd20 2024-09-10T23:27:05.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.554+0000 7f436a200640 1 --2- 172.21.15.3:0/4238189253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5596df2cb400 0x5596df2cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:05.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.554+0000 7f4368e00640 1 --2- 172.21.15.3:0/4238189253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5596df2d7cb0 0x5596df2da0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:05.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.555+0000 7f4369800640 1 --2- 172.21.15.3:0/4238189253 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596df2cbd20 0x5596df2d7770 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f435800bd40 tx=0x7f43580107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41f5883fb5ede4a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:05.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.555+0000 7f4356a00640 1 -- 172.21.15.3:0/4238189253 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4358004230 con 0x5596df2cbd20 2024-09-10T23:27:05.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.555+0000 7f4356a00640 1 -- 172.21.15.3:0/4238189253 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f435800be30 con 0x5596df2cbd20 2024-09-10T23:27:05.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.555+0000 7f4356a00640 1 -- 172.21.15.3:0/4238189253 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435801a690 con 0x5596df2cbd20 2024-09-10T23:27:05.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.556+0000 7f4362000640 1 --2- 172.21.15.3:0/426125792 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f434c0b5580 0x7f434c0b7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:05.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.556+0000 7f4362000640 1 -- 172.21.15.3:0/426125792 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f43500e6860 con 0x7f4364075e00 2024-09-10T23:27:05.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.556+0000 7f436a200640 1 --2- 172.21.15.3:0/426125792 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f434c0b5580 0x7f434c0b7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:05.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.556+0000 7f436ecb2740 1 -- 172.21.15.3:0/4238189253 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596df2cbd20 msgr2=0x5596df2d7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:05.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.556+0000 7f436ecb2740 1 --2- 172.21.15.3:0/4238189253 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596df2cbd20 0x5596df2d7770 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f435800bd40 tx=0x7f43580107a0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.556+0000 7f436ecb2740 1 -- 172.21.15.3:0/4238189253 shutdown_connections 2024-09-10T23:27:05.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.556+0000 7f436ecb2740 1 --2- 172.21.15.3:0/4238189253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5596df2d7cb0 0x5596df2da0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.556+0000 7f436ecb2740 1 --2- 172.21.15.3:0/4238189253 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596df2cbd20 0x5596df2d7770 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.556+0000 7f436ecb2740 1 --2- 172.21.15.3:0/4238189253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5596df2cb400 0x5596df2cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.556+0000 7f436ecb2740 1 -- 172.21.15.3:0/4238189253 >> 172.21.15.3:0/4238189253 conn(0x5596df2c9230 msgr2=0x5596df2ca3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:05.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.557+0000 7f436ecb2740 1 -- 172.21.15.3:0/4238189253 shutdown_connections 2024-09-10T23:27:05.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.557+0000 7f436ecb2740 1 -- 172.21.15.3:0/4238189253 wait complete. 2024-09-10T23:27:05.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.557+0000 7f436a200640 1 --2- 172.21.15.3:0/426125792 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f434c0b5580 0x7f434c0b7a40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f435c005e30 tx=0x7f435c004a80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:05.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.557+0000 7f436ecb2740 1 -- start start 2024-09-10T23:27:05.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.558+0000 7f436ecb2740 1 Processor -- start 2024-09-10T23:27:05.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.558+0000 7f436ecb2740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596df2cb400 0x5596df2d4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:05.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.558+0000 7f436ecb2740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5596df2cbd20 0x5596df2d51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:05.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.558+0000 7f436ecb2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5596df2d7cb0 0x5596df2d56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:05.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.558+0000 7f436ecb2740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5596df0935f0 con 0x5596df2cb400 2024-09-10T23:27:05.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.558+0000 7f436ecb2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5596df1cd460 con 0x5596df2d7cb0 2024-09-10T23:27:05.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.558+0000 7f436ecb2740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5596df2daa00 con 0x5596df2cbd20 2024-09-10T23:27:05.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.558+0000 7f436ecb2740 10 client.0 _ll_register_callbacks cb 0x5596df1dd210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:05.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.558+0000 7f4369800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596df2cb400 0x5596df2d4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:05.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.558+0000 7f4369800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596df2cb400 0x5596df2d4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39064/0 (socket says 172.21.15.3:39064) 2024-09-10T23:27:05.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.558+0000 7f4369800640 1 -- 172.21.15.3:0/3752416158 learned_addr learned my addr 172.21.15.3:0/3752416158 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:27:05.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.559+0000 7f4368e00640 1 --2- 172.21.15.3:0/3752416158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5596df2cbd20 0x5596df2d51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:05.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.559+0000 7f436a200640 1 --2- 172.21.15.3:0/3752416158 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5596df2d7cb0 0x5596df2d56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:05.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.559+0000 7f4369800640 1 -- 172.21.15.3:0/3752416158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5596df2cbd20 msgr2=0x5596df2d51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:05.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.559+0000 7f4369800640 1 --2- 172.21.15.3:0/3752416158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5596df2cbd20 0x5596df2d51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.559+0000 7f4369800640 1 -- 172.21.15.3:0/3752416158 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5596df2d7cb0 msgr2=0x5596df2d56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:05.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.559+0000 7f4369800640 1 --2- 172.21.15.3:0/3752416158 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5596df2d7cb0 0x5596df2d56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.559+0000 7f4369800640 1 -- 172.21.15.3:0/3752416158 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596def90540 con 0x5596df2cb400 2024-09-10T23:27:05.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.559+0000 7f4369800640 1 --2- 172.21.15.3:0/3752416158 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596df2cb400 0x5596df2d4c70 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f435800baa0 tx=0x7f435800bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f90e5524d3ba5d4d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:05.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.559+0000 7f434b400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-10T23:27:05.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.560+0000 7f434b400640 1 -- 172.21.15.3:0/3752416158 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4358005040 con 0x5596df2cb400 2024-09-10T23:27:05.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.560+0000 7f436ecb2740 1 -- 172.21.15.3:0/3752416158 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5596df1cfa70 con 0x5596df2cb400 2024-09-10T23:27:05.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.560+0000 7f434b400640 1 -- 172.21.15.3:0/3752416158 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f43580051e0 con 0x5596df2cb400 2024-09-10T23:27:05.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.560+0000 7f434b400640 1 -- 172.21.15.3:0/3752416158 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f43580053e0 con 0x5596df2cb400 2024-09-10T23:27:05.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.560+0000 7f436ecb2740 10 client.15648 fetch_fsmap learned FSMap version 26 2024-09-10T23:27:05.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.560+0000 7f436ecb2740 1 -- 172.21.15.3:0/3752416158 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5596df1ea6f0 con 0x5596df2cb400 2024-09-10T23:27:05.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.560+0000 7f434b400640 1 -- 172.21.15.3:0/3752416158 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5596df1cfa70 con 0x5596df2cb400 2024-09-10T23:27:05.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.561+0000 7f434b400640 1 -- 172.21.15.3:0/3752416158 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f4358004880 con 0x5596df2cb400 2024-09-10T23:27:05.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.561+0000 7f436ecb2740 10 client.15648 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:27:05.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.561+0000 7f436ecb2740 10 client.15648 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T23:27:05.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.561+0000 7f436ecb2740 20 client.15648 populate_metadata read hostname 'smithi003' 2024-09-10T23:27:05.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.561+0000 7f436ecb2740 1 --2- 172.21.15.3:0/3752416158 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x5596df2e85b0 0x5596df2e9a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:05.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.561+0000 7f436ecb2740 4 client.15648 mds_command: new command op to 34724 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:27:05.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.561+0000 7f436ecb2740 1 -- 172.21.15.3:0/3752416158 --> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596df244ca0 con 0x5596df2e85b0 2024-09-10T23:27:05.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.562+0000 7f4368e00640 1 --2- 172.21.15.3:0/3752416158 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x5596df2e85b0 0x5596df2e9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:05.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.562+0000 7f4368e00640 1 --2- 172.21.15.3:0/3752416158 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x5596df2e85b0 0x5596df2e9a20 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d94af9f4ad980f33 server_cookie=1d5bda11fd249ef8 in_seq=0 out_seq=0 2024-09-10T23:27:05.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.562+0000 7f434b400640 10 client.15648 ms_handle_connect on v2:172.21.15.38:6838/458259815 2024-09-10T23:27:05.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.563+0000 7f434b400640 1 -- 172.21.15.3:0/3752416158 <== mds.0 v2:172.21.15.38:6838/458259815 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5596df244ca0 con 0x5596df2e85b0 2024-09-10T23:27:05.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.563+0000 7f434b400640 10 client.15648 handle_command_reply: tid=0 2024-09-10T23:27:05.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.563+0000 7f436ecb2740 1 client.15648 shutdown 2024-09-10T23:27:05.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.563+0000 7f436ecb2740 1 -- 172.21.15.3:0/3752416158 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596df2cb400 msgr2=0x5596df2d4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:05.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.563+0000 7f436ecb2740 1 --2- 172.21.15.3:0/3752416158 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596df2cb400 0x5596df2d4c70 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f435800baa0 tx=0x7f435800bec0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.564+0000 7f436ecb2740 1 -- 172.21.15.3:0/3752416158 shutdown_connections 2024-09-10T23:27:05.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.564+0000 7f436ecb2740 1 --2- 172.21.15.3:0/3752416158 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x5596df2e85b0 0x5596df2e9a20 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.564+0000 7f436ecb2740 1 --2- 172.21.15.3:0/3752416158 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5596df2d7cb0 0x5596df2d56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.564+0000 7f436ecb2740 1 --2- 172.21.15.3:0/3752416158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5596df2cbd20 0x5596df2d51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.564+0000 7f436ecb2740 1 --2- 172.21.15.3:0/3752416158 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596df2cb400 0x5596df2d4c70 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.564+0000 7f436ecb2740 1 -- 172.21.15.3:0/3752416158 >> 172.21.15.3:0/3752416158 conn(0x5596df2c9230 msgr2=0x5596df2cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:05.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.564+0000 7f434b400640 0 client.15648 ms_handle_reset on v2:172.21.15.38:6838/458259815 2024-09-10T23:27:05.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.564+0000 7f436ecb2740 1 -- 172.21.15.3:0/3752416158 shutdown_connections 2024-09-10T23:27:05.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.564+0000 7f436ecb2740 1 -- 172.21.15.3:0/3752416158 wait complete. 2024-09-10T23:27:05.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.564+0000 7f436ecb2740 20 client.15648 trim_cache size 0 max 16384 2024-09-10T23:27:05.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.584+0000 7f436ecb2740 1 Processor -- start 2024-09-10T23:27:05.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.584+0000 7f436ecb2740 1 -- start start 2024-09-10T23:27:05.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.584+0000 7f436ecb2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5596df2cb400 0x5596df2e9a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:05.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.584+0000 7f436ecb2740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5596df2cbd20 0x5596df2cff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:05.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.584+0000 7f436ecb2740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596df2d7cb0 0x5596df2cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:05.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.584+0000 7f436ecb2740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5596df2e7d60 con 0x5596df2d7cb0 2024-09-10T23:27:05.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.584+0000 7f436ecb2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5596df2e8430 con 0x5596df2cb400 2024-09-10T23:27:05.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.584+0000 7f436ecb2740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5596df2e8b00 con 0x5596df2cbd20 2024-09-10T23:27:05.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.584+0000 7f436a200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596df2d7cb0 0x5596df2cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:05.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.585+0000 7f436a200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596df2d7cb0 0x5596df2cf470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39070/0 (socket says 172.21.15.3:39070) 2024-09-10T23:27:05.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.585+0000 7f436a200640 1 -- 172.21.15.3:0/3883987771 learned_addr learned my addr 172.21.15.3:0/3883987771 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:27:05.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.585+0000 7f4369800640 1 --2- 172.21.15.3:0/3883987771 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5596df2cb400 0x5596df2e9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:05.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.585+0000 7f4368e00640 1 --2- 172.21.15.3:0/3883987771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5596df2cbd20 0x5596df2cff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:05.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.585+0000 7f4369800640 1 -- 172.21.15.3:0/3883987771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5596df2cbd20 msgr2=0x5596df2cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:05.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.585+0000 7f4369800640 1 --2- 172.21.15.3:0/3883987771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5596df2cbd20 0x5596df2cff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.585+0000 7f4369800640 1 -- 172.21.15.3:0/3883987771 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596df2d7cb0 msgr2=0x5596df2cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:05.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.585+0000 7f4369800640 1 --2- 172.21.15.3:0/3883987771 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596df2d7cb0 0x5596df2cf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.585+0000 7f4369800640 1 -- 172.21.15.3:0/3883987771 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596df2c9060 con 0x5596df2cb400 2024-09-10T23:27:05.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.585+0000 7f436a200640 1 --2- 172.21.15.3:0/3883987771 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596df2d7cb0 0x5596df2cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:27:05.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.585+0000 7f4369800640 1 --2- 172.21.15.3:0/3883987771 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5596df2cb400 0x5596df2e9a20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4358004ca0 tx=0x7f4358010ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=634033300ac209ed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:05.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.586+0000 7f4356000640 1 -- 172.21.15.3:0/3883987771 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4358039070 con 0x5596df2cb400 2024-09-10T23:27:05.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.586+0000 7f4356000640 1 -- 172.21.15.3:0/3883987771 <== mon.2 v2:172.21.15.38:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4358028070 con 0x5596df2cb400 2024-09-10T23:27:05.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.586+0000 7f4356000640 1 -- 172.21.15.3:0/3883987771 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4358004a30 con 0x5596df2cb400 2024-09-10T23:27:05.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.587+0000 7f436ecb2740 1 -- 172.21.15.3:0/3883987771 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5596df2cb400 msgr2=0x5596df2e9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:05.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.587+0000 7f436ecb2740 1 --2- 172.21.15.3:0/3883987771 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5596df2cb400 0x5596df2e9a20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4358004ca0 tx=0x7f4358010ca0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.587+0000 7f436ecb2740 1 -- 172.21.15.3:0/3883987771 shutdown_connections 2024-09-10T23:27:05.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.587+0000 7f436ecb2740 1 --2- 172.21.15.3:0/3883987771 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596df2d7cb0 0x5596df2cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.587+0000 7f436ecb2740 1 --2- 172.21.15.3:0/3883987771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5596df2cbd20 0x5596df2cff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.587+0000 7f436ecb2740 1 --2- 172.21.15.3:0/3883987771 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5596df2cb400 0x5596df2e9a20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.587+0000 7f436ecb2740 1 -- 172.21.15.3:0/3883987771 >> 172.21.15.3:0/3883987771 conn(0x5596df2c9230 msgr2=0x5596df2d34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:05.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.587+0000 7f436ecb2740 1 -- 172.21.15.3:0/3883987771 shutdown_connections 2024-09-10T23:27:05.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.587+0000 7f436ecb2740 1 -- 172.21.15.3:0/3883987771 wait complete. 2024-09-10T23:27:05.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.588+0000 7f436ecb2740 1 -- start start 2024-09-10T23:27:05.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.588+0000 7f436ecb2740 1 Processor -- start 2024-09-10T23:27:05.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.588+0000 7f436ecb2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5596df2cb400 0x5596df2ebf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:05.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.588+0000 7f436ecb2740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5596df2cbd20 0x5596df2ec4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:05.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.588+0000 7f436ecb2740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596df2d7cb0 0x5596df2f1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:05.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.588+0000 7f436ecb2740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5596df2e98a0 con 0x5596df2d7cb0 2024-09-10T23:27:05.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.588+0000 7f436ecb2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5596df2e91d0 con 0x5596df2cb400 2024-09-10T23:27:05.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.588+0000 7f436ecb2740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5596df2e9f70 con 0x5596df2cbd20 2024-09-10T23:27:05.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.588+0000 7f436ecb2740 10 client.0 _ll_register_callbacks cb 0x7f435800b9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:05.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.589+0000 7f436a200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596df2d7cb0 0x5596df2f1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:05.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.589+0000 7f4369800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5596df2cb400 0x5596df2ebf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:05.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.589+0000 7f4369800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5596df2cb400 0x5596df2ebf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.3:58268/0 (socket says 172.21.15.3:58268) 2024-09-10T23:27:05.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.589+0000 7f4369800640 1 -- 172.21.15.3:0/2283164582 learned_addr learned my addr 172.21.15.3:0/2283164582 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:27:05.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.589+0000 7f436a200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596df2d7cb0 0x5596df2f1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39072/0 (socket says 172.21.15.3:39072) 2024-09-10T23:27:05.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.589+0000 7f4368e00640 1 --2- 172.21.15.3:0/2283164582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5596df2cbd20 0x5596df2ec4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:05.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.589+0000 7f4369800640 1 -- 172.21.15.3:0/2283164582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5596df2cbd20 msgr2=0x5596df2ec4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:05.592 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.589+0000 7f4369800640 1 --2- 172.21.15.3:0/2283164582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5596df2cbd20 0x5596df2ec4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.592 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.589+0000 7f4369800640 1 -- 172.21.15.3:0/2283164582 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596df2d7cb0 msgr2=0x5596df2f1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:05.592 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.589+0000 7f4369800640 1 --2- 172.21.15.3:0/2283164582 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596df2d7cb0 0x5596df2f1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.592 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.589+0000 7f4369800640 1 -- 172.21.15.3:0/2283164582 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596df2f1c60 con 0x5596df2cb400 2024-09-10T23:27:05.592 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.589+0000 7f4368e00640 1 --2- 172.21.15.3:0/2283164582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5596df2cbd20 0x5596df2ec4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:27:05.592 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.589+0000 7f4369800640 1 --2- 172.21.15.3:0/2283164582 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5596df2cb400 0x5596df2ebf90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4358004c20 tx=0x7f4358004940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=420ccd9a24ea86dd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:05.592 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.590+0000 7f434b400640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-10T23:27:05.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.590+0000 7f434b400640 1 -- 172.21.15.3:0/2283164582 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4358041020 con 0x5596df2cb400 2024-09-10T23:27:05.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.590+0000 7f436ecb2740 1 -- 172.21.15.3:0/2283164582 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4358028070 con 0x5596df2cb400 2024-09-10T23:27:05.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.590+0000 7f434b400640 1 -- 172.21.15.3:0/2283164582 <== mon.2 v2:172.21.15.38:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f4358005090 con 0x5596df2cb400 2024-09-10T23:27:05.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.590+0000 7f434b400640 1 -- 172.21.15.3:0/2283164582 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4358039040 con 0x5596df2cb400 2024-09-10T23:27:05.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.590+0000 7f436ecb2740 10 client.35435 fetch_fsmap learned FSMap version 26 2024-09-10T23:27:05.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.590+0000 7f436ecb2740 1 -- 172.21.15.3:0/2283164582 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5596df3555a0 con 0x5596df2cb400 2024-09-10T23:27:05.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.590+0000 7f434b400640 1 -- 172.21.15.3:0/2283164582 <== mon.2 v2:172.21.15.38:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4358028070 con 0x5596df2cb400 2024-09-10T23:27:05.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.591+0000 7f434b400640 1 -- 172.21.15.3:0/2283164582 <== mon.2 v2:172.21.15.38:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f435801a500 con 0x5596df2cb400 2024-09-10T23:27:05.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.591+0000 7f436ecb2740 10 client.35435 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:27:05.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.591+0000 7f436ecb2740 10 client.35435 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T23:27:05.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.591+0000 7f436ecb2740 20 client.35435 populate_metadata read hostname 'smithi003' 2024-09-10T23:27:05.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.591+0000 7f436ecb2740 1 --2- 172.21.15.3:0/2283164582 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x5596df359bd0 0x5596df3588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:05.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.591+0000 7f436ecb2740 4 client.35435 mds_command: new command op to 34724 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:27:05.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.591+0000 7f436ecb2740 1 -- 172.21.15.3:0/2283164582 --> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] -- command(tid 0: {"prefix": "status"}) -- 0x5596df240750 con 0x5596df359bd0 2024-09-10T23:27:05.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.591+0000 7f4368e00640 1 --2- 172.21.15.3:0/2283164582 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x5596df359bd0 0x5596df3588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:05.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.592+0000 7f4368e00640 1 --2- 172.21.15.3:0/2283164582 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x5596df359bd0 0x5596df3588e0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f03ba84df886819 server_cookie=c2c8cc2d0e89644c in_seq=0 out_seq=0 2024-09-10T23:27:05.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.592+0000 7f434b400640 10 client.35435 ms_handle_connect on v2:172.21.15.38:6838/458259815 2024-09-10T23:27:05.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.592+0000 7f434b400640 1 -- 172.21.15.3:0/2283164582 <== mds.0 v2:172.21.15.38:6838/458259815 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5596df240750 con 0x5596df359bd0 2024-09-10T23:27:05.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.592+0000 7f434b400640 10 client.35435 handle_command_reply: tid=0 2024-09-10T23:27:05.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.592+0000 7f436ecb2740 1 client.35435 shutdown 2024-09-10T23:27:05.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.592+0000 7f436ecb2740 1 -- 172.21.15.3:0/2283164582 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5596df2cb400 msgr2=0x5596df2ebf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:05.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.592+0000 7f436ecb2740 1 --2- 172.21.15.3:0/2283164582 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5596df2cb400 0x5596df2ebf90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4358004c20 tx=0x7f4358004940 comp rx=0 tx=0).stop 2024-09-10T23:27:05.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.593+0000 7f436ecb2740 1 -- 172.21.15.3:0/2283164582 shutdown_connections 2024-09-10T23:27:05.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.593+0000 7f436ecb2740 1 --2- 172.21.15.3:0/2283164582 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x5596df359bd0 0x5596df3588e0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.593+0000 7f436ecb2740 1 --2- 172.21.15.3:0/2283164582 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596df2d7cb0 0x5596df2f1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.593+0000 7f434b400640 0 client.35435 ms_handle_reset on v2:172.21.15.38:6838/458259815 2024-09-10T23:27:05.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.593+0000 7f436ecb2740 1 --2- 172.21.15.3:0/2283164582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5596df2cbd20 0x5596df2ec4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.593+0000 7f436ecb2740 1 --2- 172.21.15.3:0/2283164582 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5596df2cb400 0x5596df2ebf90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.593+0000 7f436ecb2740 1 -- 172.21.15.3:0/2283164582 >> 172.21.15.3:0/2283164582 conn(0x5596df2c9230 msgr2=0x5596df2d38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:05.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.593+0000 7f436ecb2740 1 -- 172.21.15.3:0/2283164582 shutdown_connections 2024-09-10T23:27:05.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.593+0000 7f436ecb2740 1 -- 172.21.15.3:0/2283164582 wait complete. 2024-09-10T23:27:05.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.593+0000 7f436ecb2740 20 client.35435 trim_cache size 0 max 16384 2024-09-10T23:27:05.597 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-10T23:27:05.597 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_fsid": "3f4e30d0-6fca-11ef-bcea-c7b262605968", 2024-09-10T23:27:05.597 INFO:teuthology.orchestra.run.smithi003.stdout: "whoami": 0, 2024-09-10T23:27:05.597 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 34724, 2024-09-10T23:27:05.597 INFO:teuthology.orchestra.run.smithi003.stdout: "want_state": "up:active", 2024-09-10T23:27:05.597 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "up:active", 2024-09-10T23:27:05.597 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs", 2024-09-10T23:27:05.597 INFO:teuthology.orchestra.run.smithi003.stdout: "rank_uptime": 185.75729621100001, 2024-09-10T23:27:05.597 INFO:teuthology.orchestra.run.smithi003.stdout: "mdsmap_epoch": 26, 2024-09-10T23:27:05.597 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch": 90, 2024-09-10T23:27:05.598 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch_barrier": 90, 2024-09-10T23:27:05.598 INFO:teuthology.orchestra.run.smithi003.stdout: "uptime": 200.45479376399999 2024-09-10T23:27:05.598 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-10T23:27:05.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.594+0000 7f436ac00640 1 -- 172.21.15.3:0/426125792 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f434c0b5580 msgr2=0x7f434c0b7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:05.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.594+0000 7f436ac00640 1 --2- 172.21.15.3:0/426125792 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f434c0b5580 0x7f434c0b7a40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f435c005e30 tx=0x7f435c004a80 comp rx=0 tx=0).stop 2024-09-10T23:27:05.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.594+0000 7f436ac00640 1 -- 172.21.15.3:0/426125792 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4364075e00 msgr2=0x7f436419b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:05.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.594+0000 7f436ac00640 1 --2- 172.21.15.3:0/426125792 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4364075e00 0x7f436419b6d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f435000e9f0 tx=0x7f435000eeb0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.594+0000 7f436ac00640 1 -- 172.21.15.3:0/426125792 shutdown_connections 2024-09-10T23:27:05.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.594+0000 7f436ac00640 1 --2- 172.21.15.3:0/426125792 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f436410f200 0x7f43641a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.594+0000 7f436ac00640 1 --2- 172.21.15.3:0/426125792 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f434c0b5580 0x7f434c0b7a40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.594+0000 7f436ac00640 1 --2- 172.21.15.3:0/426125792 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4364075e00 0x7f436419b6d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.594+0000 7f436ac00640 1 --2- 172.21.15.3:0/426125792 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43640754e0 0x7f436419b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.594+0000 7f436ac00640 1 -- 172.21.15.3:0/426125792 >> 172.21.15.3:0/426125792 conn(0x7f43640fe660 msgr2=0x7f4364111330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:05.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.594+0000 7f436ac00640 1 -- 172.21.15.3:0/426125792 shutdown_connections 2024-09-10T23:27:05.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:05.594+0000 7f436ac00640 1 -- 172.21.15.3:0/426125792 wait complete. 2024-09-10T23:27:06.390 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-10T23:27:06.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:06 smithi194 ceph-mon[33904]: pgmap v400: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-10T23:27:06.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:06 smithi003 ceph-mon[30348]: pgmap v400: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-10T23:27:06.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:06 smithi038 ceph-mon[34225]: pgmap v400: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-10T23:27:08.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:08 smithi194 ceph-mon[33904]: pgmap v401: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 21 op/s 2024-09-10T23:27:08.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:08 smithi003 ceph-mon[30348]: pgmap v401: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 21 op/s 2024-09-10T23:27:08.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:08 smithi038 ceph-mon[34225]: pgmap v401: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 21 op/s 2024-09-10T23:27:10.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:10 smithi194 ceph-mon[33904]: pgmap v402: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-09-10T23:27:10.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:10 smithi003 ceph-mon[30348]: pgmap v402: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-09-10T23:27:10.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:10 smithi038 ceph-mon[34225]: pgmap v402: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-09-10T23:27:12.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:12 smithi194 ceph-mon[33904]: pgmap v403: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 20 op/s 2024-09-10T23:27:12.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:12 smithi003 ceph-mon[30348]: pgmap v403: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 20 op/s 2024-09-10T23:27:12.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:12 smithi038 ceph-mon[34225]: pgmap v403: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 20 op/s 2024-09-10T23:27:14.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:14 smithi194 ceph-mon[33904]: pgmap v404: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 23 op/s 2024-09-10T23:27:14.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:14 smithi003 ceph-mon[30348]: pgmap v404: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 23 op/s 2024-09-10T23:27:14.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:14 smithi038 ceph-mon[34225]: pgmap v404: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 23 op/s 2024-09-10T23:27:16.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:16 smithi194 ceph-mon[33904]: pgmap v405: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-09-10T23:27:16.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:16 smithi003 ceph-mon[30348]: pgmap v405: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-09-10T23:27:16.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:16 smithi038 ceph-mon[34225]: pgmap v405: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-09-10T23:27:18.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:18 smithi194 ceph-mon[33904]: pgmap v406: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-09-10T23:27:18.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:18 smithi003 ceph-mon[30348]: pgmap v406: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-09-10T23:27:18.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:18 smithi038 ceph-mon[34225]: pgmap v406: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-09-10T23:27:20.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:20 smithi194 ceph-mon[33904]: pgmap v407: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-10T23:27:20.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:20 smithi003 ceph-mon[30348]: pgmap v407: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-10T23:27:20.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:20 smithi038 ceph-mon[34225]: pgmap v407: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-10T23:27:21.391 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.2 2024-09-10T23:27:21.392 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:27:21.873 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:27:22.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.514+0000 7efd40c00640 1 -- 172.21.15.3:0/912906409 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efd3c102c10 msgr2=0x7efd3c102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:22.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.514+0000 7efd40c00640 1 --2- 172.21.15.3:0/912906409 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efd3c102c10 0x7efd3c102ff0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7efd2c009900 tx=0x7efd2c02a3f0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.514+0000 7efd40c00640 1 -- 172.21.15.3:0/912906409 shutdown_connections 2024-09-10T23:27:22.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.514+0000 7efd40c00640 1 --2- 172.21.15.3:0/912906409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd3c108fa0 0x7efd3c10f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.514+0000 7efd40c00640 1 --2- 172.21.15.3:0/912906409 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd3c108620 0x7efd3c108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.514+0000 7efd40c00640 1 --2- 172.21.15.3:0/912906409 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efd3c102c10 0x7efd3c102ff0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.514+0000 7efd40c00640 1 -- 172.21.15.3:0/912906409 >> 172.21.15.3:0/912906409 conn(0x7efd3c0fe660 msgr2=0x7efd3c100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:22.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.514+0000 7efd40c00640 1 -- 172.21.15.3:0/912906409 shutdown_connections 2024-09-10T23:27:22.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.515+0000 7efd40c00640 1 -- 172.21.15.3:0/912906409 wait complete. 2024-09-10T23:27:22.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.516+0000 7efd40c00640 1 Processor -- start 2024-09-10T23:27:22.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.516+0000 7efd40c00640 1 -- start start 2024-09-10T23:27:22.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.517+0000 7efd40c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efd3c102c10 0x7efd3c10eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:22.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.517+0000 7efd40c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd3c108620 0x7efd3c10f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:22.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.517+0000 7efd40c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd3c108fa0 0x7efd3c1a1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:22.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.517+0000 7efd40c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7efd3c112b10 con 0x7efd3c102c10 2024-09-10T23:27:22.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.517+0000 7efd40c00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7efd3c112990 con 0x7efd3c108620 2024-09-10T23:27:22.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.517+0000 7efd40c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7efd3c112c90 con 0x7efd3c108fa0 2024-09-10T23:27:22.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.517+0000 7efd3b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efd3c102c10 0x7efd3c10eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:22.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.517+0000 7efd3b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efd3c102c10 0x7efd3c10eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58156/0 (socket says 172.21.15.3:58156) 2024-09-10T23:27:22.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.517+0000 7efd3b400640 1 -- 172.21.15.3:0/3855044829 learned_addr learned my addr 172.21.15.3:0/3855044829 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:27:22.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.517+0000 7efd3aa00640 1 --2- 172.21.15.3:0/3855044829 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd3c108620 0x7efd3c10f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:22.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.518+0000 7efd3be00640 1 --2- 172.21.15.3:0/3855044829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd3c108fa0 0x7efd3c1a1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:22.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.518+0000 7efd3aa00640 1 -- 172.21.15.3:0/3855044829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd3c108fa0 msgr2=0x7efd3c1a1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:22.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.518+0000 7efd3aa00640 1 --2- 172.21.15.3:0/3855044829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd3c108fa0 0x7efd3c1a1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.518+0000 7efd3aa00640 1 -- 172.21.15.3:0/3855044829 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efd3c102c10 msgr2=0x7efd3c10eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:22.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.518+0000 7efd3aa00640 1 --2- 172.21.15.3:0/3855044829 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efd3c102c10 0x7efd3c10eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.518+0000 7efd3aa00640 1 -- 172.21.15.3:0/3855044829 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd3c1a23e0 con 0x7efd3c108620 2024-09-10T23:27:22.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.518+0000 7efd3b400640 1 --2- 172.21.15.3:0/3855044829 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efd3c102c10 0x7efd3c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:27:22.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.518+0000 7efd3aa00640 1 --2- 172.21.15.3:0/3855044829 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd3c108620 0x7efd3c10f000 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efd2800e9f0 tx=0x7efd2800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:22.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.519+0000 7efd33e00640 1 -- 172.21.15.3:0/3855044829 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2800ccc0 con 0x7efd3c108620 2024-09-10T23:27:22.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.519+0000 7efd33e00640 1 -- 172.21.15.3:0/3855044829 <== mon.2 v2:172.21.15.38:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd280108c0 con 0x7efd3c108620 2024-09-10T23:27:22.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.519+0000 7efd33e00640 1 -- 172.21.15.3:0/3855044829 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd280187e0 con 0x7efd3c108620 2024-09-10T23:27:22.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.519+0000 7efd40c00640 1 -- 172.21.15.3:0/3855044829 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd3c1a26d0 con 0x7efd3c108620 2024-09-10T23:27:22.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.519+0000 7efd40c00640 1 -- 172.21.15.3:0/3855044829 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd3c1abfb0 con 0x7efd3c108620 2024-09-10T23:27:22.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.520+0000 7efd40c00640 1 -- 172.21.15.3:0/3855044829 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd3c102ff0 con 0x7efd3c108620 2024-09-10T23:27:22.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.525+0000 7efd33e00640 1 -- 172.21.15.3:0/3855044829 <== mon.2 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 25) ==== 153431+0+0 (secure 0 0 0) 0x7efd28010430 con 0x7efd3c108620 2024-09-10T23:27:22.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.527+0000 7efd33e00640 1 --2- 172.21.15.3:0/3855044829 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7efd200b5600 0x7efd200b7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:22.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.528+0000 7efd33e00640 1 -- 172.21.15.3:0/3855044829 <== mon.2 v2:172.21.15.38:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7efd280e6c50 con 0x7efd3c108620 2024-09-10T23:27:22.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.529+0000 7efd33e00640 1 -- 172.21.15.3:0/3855044829 <== mon.2 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7efd281172c0 con 0x7efd3c108620 2024-09-10T23:27:22.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.529+0000 7efd3b400640 1 --2- 172.21.15.3:0/3855044829 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7efd200b5600 0x7efd200b7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:22.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.530+0000 7efd3b400640 1 --2- 172.21.15.3:0/3855044829 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7efd200b5600 0x7efd200b7ac0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efd2c032fd0 tx=0x7efd2c009580 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:22.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:22 smithi194 ceph-mon[33904]: pgmap v408: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:27:22.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:22 smithi003 ceph-mon[30348]: pgmap v408: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:27:22.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.773+0000 7efd40c00640 1 -- 172.21.15.3:0/3855044829 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efd3c1a0790 con 0x7efd3c108620 2024-09-10T23:27:22.775 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:27:22.776 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":26,"btime":"2024-09-10T23:26:42:260644+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/1495411512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":1495411512},{"type":"v1","addr":"172.21.15.3:6835","nonce":1495411512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/1857372777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1857372777},{"type":"v1","addr":"172.21.15.3:6837","nonce":1857372777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14862,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6839/493850676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":493850676},{"type":"v1","addr":"172.21.15.3:6839","nonce":493850676}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14874,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6841/1580524358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":1580524358},{"type":"v1","addr":"172.21.15.3:6841","nonce":1580524358}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/352514665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":352514665},{"type":"v1","addr":"172.21.15.194:6833","nonce":352514665}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2380508105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2380508105},{"type":"v1","addr":"172.21.15.194:6835","nonce":2380508105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:23:58.866253+0000","modified":"2024-09-10T23:26:41.694795+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34724,"mds_1":34682,"mds_2":34652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24649":{"gid":24649,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/739730313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":739730313},{"type":"v1","addr":"172.21.15.194:6837","nonce":739730313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/3198777710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3198777710},{"type":"v1","addr":"172.21.15.194:6839","nonce":3198777710}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34619":{"gid":34619,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6833/1194099617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1194099617},{"type":"v1","addr":"172.21.15.38:6833","nonce":1194099617}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34652":{"gid":34652,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.38:6835/218783320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":218783320},{"type":"v1","addr":"172.21.15.38:6835","nonce":218783320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34682":{"gid":34682,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":21,"addr":"172.21.15.38:6837/1821839397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":1821839397},{"type":"v1","addr":"172.21.15.38:6837","nonce":1821839397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34724":{"gid":34724,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.38:6839/458259815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":458259815},{"type":"v1","addr":"172.21.15.38:6839","nonce":458259815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34724,"qdb_cluster":[34724,34682,34652]},"id":1}]} 2024-09-10T23:27:22.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.774+0000 7efd33e00640 1 -- 172.21.15.3:0/3855044829 <== mon.2 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11891 (secure 0 0 0) 0x7efd3c1a0790 con 0x7efd3c108620 2024-09-10T23:27:22.776 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 26 2024-09-10T23:27:22.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.777+0000 7efd40c00640 1 -- 172.21.15.3:0/3855044829 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7efd200b5600 msgr2=0x7efd200b7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:22.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.777+0000 7efd40c00640 1 --2- 172.21.15.3:0/3855044829 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7efd200b5600 0x7efd200b7ac0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efd2c032fd0 tx=0x7efd2c009580 comp rx=0 tx=0).stop 2024-09-10T23:27:22.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.777+0000 7efd40c00640 1 -- 172.21.15.3:0/3855044829 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd3c108620 msgr2=0x7efd3c10f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:22.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.777+0000 7efd40c00640 1 --2- 172.21.15.3:0/3855044829 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd3c108620 0x7efd3c10f000 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efd2800e9f0 tx=0x7efd2800eeb0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.778+0000 7efd40c00640 1 -- 172.21.15.3:0/3855044829 shutdown_connections 2024-09-10T23:27:22.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.778+0000 7efd40c00640 1 --2- 172.21.15.3:0/3855044829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd3c108fa0 0x7efd3c1a1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.778+0000 7efd40c00640 1 --2- 172.21.15.3:0/3855044829 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd3c108620 0x7efd3c10f000 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.778+0000 7efd40c00640 1 --2- 172.21.15.3:0/3855044829 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7efd200b5600 0x7efd200b7ac0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.778+0000 7efd40c00640 1 --2- 172.21.15.3:0/3855044829 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efd3c102c10 0x7efd3c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.778+0000 7efd40c00640 1 -- 172.21.15.3:0/3855044829 >> 172.21.15.3:0/3855044829 conn(0x7efd3c0fe660 msgr2=0x7efd3c104bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:22.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.778+0000 7efd40c00640 1 -- 172.21.15.3:0/3855044829 shutdown_connections 2024-09-10T23:27:22.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:22.778+0000 7efd40c00640 1 -- 172.21.15.3:0/3855044829 wait complete. 2024-09-10T23:27:22.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:22 smithi038 ceph-mon[34225]: pgmap v408: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:27:23.627 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34724 quiesce db / --timeout 90 --expiration 145.2 --await-for 45.0' 2024-09-10T23:27:23.627 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34724 quiesce db / --timeout 90 --expiration 145.2 --await-for 45.0 2024-09-10T23:27:23.690 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:23 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3855044829' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:27:23.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:23 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3855044829' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:27:23.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:23 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3855044829' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:27:24.153 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:27:24.647 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:24 smithi003 ceph-mon[30348]: pgmap v409: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-10T23:27:24.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:24 smithi194 ceph-mon[33904]: pgmap v409: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-10T23:27:24.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:24 smithi038 ceph-mon[34225]: pgmap v409: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-10T23:27:24.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.869+0000 7f62f8c00640 1 -- 172.21.15.3:0/1464720381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f4102c10 msgr2=0x7f62f4102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:24.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.869+0000 7f62f8c00640 1 --2- 172.21.15.3:0/1464720381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f4102c10 0x7f62f4102ff0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f62e4009900 tx=0x7f62e402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:27:24.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.870+0000 7f62f8c00640 1 -- 172.21.15.3:0/1464720381 shutdown_connections 2024-09-10T23:27:24.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.870+0000 7f62f8c00640 1 --2- 172.21.15.3:0/1464720381 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f62f4108fa0 0x7f62f410f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:24.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.870+0000 7f62f8c00640 1 --2- 172.21.15.3:0/1464720381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62f4108620 0x7f62f4108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:24.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.870+0000 7f62f8c00640 1 --2- 172.21.15.3:0/1464720381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f4102c10 0x7f62f4102ff0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:24.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.870+0000 7f62f8c00640 1 -- 172.21.15.3:0/1464720381 >> 172.21.15.3:0/1464720381 conn(0x7f62f40fe660 msgr2=0x7f62f4100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:24.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.870+0000 7f62f8c00640 1 -- 172.21.15.3:0/1464720381 shutdown_connections 2024-09-10T23:27:24.872 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.870+0000 7f62f8c00640 1 -- 172.21.15.3:0/1464720381 wait complete. 2024-09-10T23:27:24.872 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.872+0000 7f62f8c00640 1 Processor -- start 2024-09-10T23:27:24.873 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.872+0000 7f62f8c00640 1 -- start start 2024-09-10T23:27:24.873 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.872+0000 7f62f8c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62f4102c10 0x7f62f40754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:24.874 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.872+0000 7f62f8c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f62f4108620 0x7f62f40759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:24.874 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.872+0000 7f62f8c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f4108fa0 0x7f62f4075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:24.874 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.872+0000 7f62f8c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f62f4112b60 con 0x7f62f4108620 2024-09-10T23:27:24.874 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.872+0000 7f62f8c00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f62f41129e0 con 0x7f62f4108fa0 2024-09-10T23:27:24.874 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.872+0000 7f62f8c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f62f4112ce0 con 0x7f62f4102c10 2024-09-10T23:27:24.875 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.873+0000 7f62f3400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62f4102c10 0x7f62f40754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:24.875 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.873+0000 7f62f3400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62f4102c10 0x7f62f40754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.3:52850/0 (socket says 172.21.15.3:52850) 2024-09-10T23:27:24.875 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.873+0000 7f62f3400640 1 -- 172.21.15.3:0/368862141 learned_addr learned my addr 172.21.15.3:0/368862141 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:27:24.875 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.873+0000 7f62f3e00640 1 --2- 172.21.15.3:0/368862141 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f4108fa0 0x7f62f4075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:24.875 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.874+0000 7f62f2a00640 1 --2- 172.21.15.3:0/368862141 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f62f4108620 0x7f62f40759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:24.875 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.874+0000 7f62f3400640 1 -- 172.21.15.3:0/368862141 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f4108fa0 msgr2=0x7f62f4075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:24.875 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.874+0000 7f62f3400640 1 --2- 172.21.15.3:0/368862141 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f4108fa0 0x7f62f4075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:24.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.874+0000 7f62f3400640 1 -- 172.21.15.3:0/368862141 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f62f4108620 msgr2=0x7f62f40759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:24.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.874+0000 7f62f3400640 1 --2- 172.21.15.3:0/368862141 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f62f4108620 0x7f62f40759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:24.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.874+0000 7f62f3400640 1 -- 172.21.15.3:0/368862141 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f41a73b0 con 0x7f62f4102c10 2024-09-10T23:27:24.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.874+0000 7f62f3400640 1 --2- 172.21.15.3:0/368862141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62f4102c10 0x7f62f40754a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f62e402a910 tx=0x7f62e4003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:24.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.875+0000 7f62ebe00640 1 -- 172.21.15.3:0/368862141 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e403f070 con 0x7f62f4102c10 2024-09-10T23:27:24.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.875+0000 7f62ebe00640 1 -- 172.21.15.3:0/368862141 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f62e403baf0 con 0x7f62f4102c10 2024-09-10T23:27:24.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.875+0000 7f62ebe00640 1 -- 172.21.15.3:0/368862141 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e4035030 con 0x7f62f4102c10 2024-09-10T23:27:24.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.875+0000 7f62f8c00640 1 -- 172.21.15.3:0/368862141 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62f41a7640 con 0x7f62f4102c10 2024-09-10T23:27:24.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.875+0000 7f62f8c00640 1 -- 172.21.15.3:0/368862141 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62f41a7ad0 con 0x7f62f4102c10 2024-09-10T23:27:24.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.880+0000 7f62fcdc4740 1 Processor -- start 2024-09-10T23:27:24.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.880+0000 7f62fcdc4740 1 -- start start 2024-09-10T23:27:24.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.880+0000 7f62fcdc4740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556ed6332f0 0x5556ed6336d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:24.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.880+0000 7f62fcdc4740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5556ed633c10 0x5556ed647e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:24.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.880+0000 7f62fcdc4740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5556ed6483b0 0x5556ed64a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:24.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.880+0000 7f62fcdc4740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5556ed5a8ca0 con 0x5556ed633c10 2024-09-10T23:27:24.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.880+0000 7f62fcdc4740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5556ed5980d0 con 0x5556ed6483b0 2024-09-10T23:27:24.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.880+0000 7f62fcdc4740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5556ed59bee0 con 0x5556ed6332f0 2024-09-10T23:27:24.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.881+0000 7f62f3e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556ed6332f0 0x5556ed6336d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:24.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.881+0000 7f62f3e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556ed6332f0 0x5556ed6336d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.3:52856/0 (socket says 172.21.15.3:52856) 2024-09-10T23:27:24.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.881+0000 7f62f3e00640 1 -- 172.21.15.3:0/1709791487 learned_addr learned my addr 172.21.15.3:0/1709791487 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:27:24.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.881+0000 7f62f3e00640 1 -- 172.21.15.3:0/1709791487 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5556ed6483b0 msgr2=0x5556ed64a7a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T23:27:24.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.881+0000 7f62f3e00640 1 --2- 172.21.15.3:0/1709791487 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5556ed6483b0 0x5556ed64a7a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:24.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.881+0000 7f62f3e00640 1 -- 172.21.15.3:0/1709791487 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5556ed633c10 msgr2=0x5556ed647e70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T23:27:24.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.881+0000 7f62f3e00640 1 --2- 172.21.15.3:0/1709791487 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5556ed633c10 0x5556ed647e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:24.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.881+0000 7f62f3e00640 1 -- 172.21.15.3:0/1709791487 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556ed54a400 con 0x5556ed6332f0 2024-09-10T23:27:24.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.882+0000 7f62ebe00640 1 -- 172.21.15.3:0/368862141 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 153431+0+0 (secure 0 0 0) 0x7f62e403b660 con 0x7f62f4102c10 2024-09-10T23:27:24.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.882+0000 7f62f3e00640 1 --2- 172.21.15.3:0/1709791487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556ed6332f0 0x5556ed6336d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f62ec009fa0 tx=0x7f62ec0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=121d94dc5fba3179 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:24.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.883+0000 7f62dfe00640 1 -- 172.21.15.3:0/1709791487 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ec004d20 con 0x5556ed6332f0 2024-09-10T23:27:24.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.883+0000 7f62dfe00640 1 -- 172.21.15.3:0/1709791487 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f62ec004050 con 0x5556ed6332f0 2024-09-10T23:27:24.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.883+0000 7f62dfe00640 1 -- 172.21.15.3:0/1709791487 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ec005260 con 0x5556ed6332f0 2024-09-10T23:27:24.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.884+0000 7f62fcdc4740 1 -- 172.21.15.3:0/1709791487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556ed6332f0 msgr2=0x5556ed6336d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:24.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.884+0000 7f62fcdc4740 1 --2- 172.21.15.3:0/1709791487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556ed6332f0 0x5556ed6336d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f62ec009fa0 tx=0x7f62ec0118d0 comp rx=0 tx=0).stop 2024-09-10T23:27:24.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.884+0000 7f62ebe00640 1 --2- 172.21.15.3:0/368862141 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f62d80b5600 0x7f62d80b7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:24.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.885+0000 7f62ebe00640 1 -- 172.21.15.3:0/368862141 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f62e4106ec0 con 0x7f62f4102c10 2024-09-10T23:27:24.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.885+0000 7f62fcdc4740 1 -- 172.21.15.3:0/1709791487 shutdown_connections 2024-09-10T23:27:24.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.885+0000 7f62fcdc4740 1 --2- 172.21.15.3:0/1709791487 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5556ed6483b0 0x5556ed64a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:24.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.885+0000 7f62fcdc4740 1 --2- 172.21.15.3:0/1709791487 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5556ed633c10 0x5556ed647e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:24.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.885+0000 7f62fcdc4740 1 --2- 172.21.15.3:0/1709791487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556ed6332f0 0x5556ed6336d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:24.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.885+0000 7f62fcdc4740 1 -- 172.21.15.3:0/1709791487 >> 172.21.15.3:0/1709791487 conn(0x5556ed631120 msgr2=0x5556ed6322c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:24.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.885+0000 7f62f3e00640 1 --2- 172.21.15.3:0/368862141 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f62d80b5600 0x7f62d80b7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:24.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.886+0000 7f62fcdc4740 1 -- 172.21.15.3:0/1709791487 shutdown_connections 2024-09-10T23:27:24.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.886+0000 7f62fcdc4740 1 -- 172.21.15.3:0/1709791487 wait complete. 2024-09-10T23:27:24.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.887+0000 7f62fcdc4740 1 -- start start 2024-09-10T23:27:24.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.887+0000 7f62f3e00640 1 --2- 172.21.15.3:0/368862141 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f62d80b5600 0x7f62d80b7ac0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f62ec004910 tx=0x7f62ec000f40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:24.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.887+0000 7f62fcdc4740 1 Processor -- start 2024-09-10T23:27:24.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.888+0000 7f62fcdc4740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5556ed6332f0 0x5556ed647d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:24.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.888+0000 7f62fcdc4740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5556ed633c10 0x5556ed6451a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:24.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.888+0000 7f62fcdc4740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556ed6483b0 0x5556ed645850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:24.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.888+0000 7f62fcdc4740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5556ed3f97a0 con 0x5556ed633c10 2024-09-10T23:27:24.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.888+0000 7f62fcdc4740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5556ed53da10 con 0x5556ed6332f0 2024-09-10T23:27:24.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.888+0000 7f62f3400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5556ed6332f0 0x5556ed647d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:24.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.888+0000 7f62f3400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5556ed6332f0 0x5556ed647d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.3:57302/0 (socket says 172.21.15.3:57302) 2024-09-10T23:27:24.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.888+0000 7f62f3400640 1 -- 172.21.15.3:0/2430356016 learned_addr learned my addr 172.21.15.3:0/2430356016 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:27:24.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.888+0000 7f62f2a00640 1 --2- 172.21.15.3:0/2430356016 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5556ed633c10 0x5556ed6451a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:24.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.888+0000 7f62fcdc4740 1 -- 172.21.15.3:0/2430356016 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5556ed64b030 con 0x5556ed6483b0 2024-09-10T23:27:24.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.888+0000 7f62f3e00640 1 --2- 172.21.15.3:0/2430356016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556ed6483b0 0x5556ed645850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:24.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.889+0000 7f62fcdc4740 10 client.0 _ll_register_callbacks cb 0x5556ed54dbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:24.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.890+0000 7f62f3400640 1 -- 172.21.15.3:0/2430356016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556ed6483b0 msgr2=0x5556ed645850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:24.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.890+0000 7f62f3400640 1 --2- 172.21.15.3:0/2430356016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556ed6483b0 0x5556ed645850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:24.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.890+0000 7f62f3400640 1 -- 172.21.15.3:0/2430356016 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5556ed633c10 msgr2=0x5556ed6451a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:24.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.890+0000 7f62f3400640 1 --2- 172.21.15.3:0/2430356016 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5556ed633c10 0x5556ed6451a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:24.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.890+0000 7f62f3400640 1 -- 172.21.15.3:0/2430356016 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556ed305b90 con 0x5556ed6332f0 2024-09-10T23:27:24.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.890+0000 7f62f2a00640 1 --2- 172.21.15.3:0/2430356016 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5556ed633c10 0x5556ed6451a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:27:24.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.891+0000 7f62f3400640 1 --2- 172.21.15.3:0/2430356016 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5556ed6332f0 0x5556ed647d50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f62e40ccb00 tx=0x7f62e40c8d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed5e39f5d4e968ba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:24.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.891+0000 7f62dcc00640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-10T23:27:24.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.891+0000 7f62dcc00640 1 -- 172.21.15.3:0/2430356016 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e4049070 con 0x5556ed6332f0 2024-09-10T23:27:24.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.891+0000 7f62dcc00640 1 -- 172.21.15.3:0/2430356016 <== mon.2 v2:172.21.15.38:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f62e40b40f0 con 0x5556ed6332f0 2024-09-10T23:27:24.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.891+0000 7f62fcdc4740 1 -- 172.21.15.3:0/2430356016 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62ec004050 con 0x5556ed6332f0 2024-09-10T23:27:24.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.892+0000 7f62dcc00640 1 -- 172.21.15.3:0/2430356016 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f62e40cc910 con 0x5556ed6332f0 2024-09-10T23:27:24.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.892+0000 7f62fcdc4740 10 client.35450 fetch_fsmap learned FSMap version 26 2024-09-10T23:27:24.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.892+0000 7f62fcdc4740 1 -- 172.21.15.3:0/2430356016 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5556ed6569d0 con 0x5556ed6332f0 2024-09-10T23:27:24.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.892+0000 7f62dcc00640 1 -- 172.21.15.3:0/2430356016 <== mon.2 v2:172.21.15.38:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f62ec004050 con 0x5556ed6332f0 2024-09-10T23:27:24.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.892+0000 7f62dcc00640 1 -- 172.21.15.3:0/2430356016 <== mon.2 v2:172.21.15.38:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f62e40c9070 con 0x5556ed6332f0 2024-09-10T23:27:24.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.893+0000 7f62fcdc4740 10 client.35450 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:27:24.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.893+0000 7f62fcdc4740 10 client.35450 resolve_mds: validated gid 34724 aka daemon mds.b 2024-09-10T23:27:24.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.893+0000 7f62fcdc4740 20 client.35450 populate_metadata read hostname 'smithi003' 2024-09-10T23:27:24.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.893+0000 7f62fcdc4740 1 --2- 172.21.15.3:0/2430356016 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x5556ed657e80 0x5556ed65a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:24.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.893+0000 7f62fcdc4740 4 client.35450 mds_command: new command op to 34724 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:27:24.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.893+0000 7f62fcdc4740 1 -- 172.21.15.3:0/2430356016 --> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556ed5aabf0 con 0x5556ed657e80 2024-09-10T23:27:24.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.894+0000 7f62f2a00640 1 --2- 172.21.15.3:0/2430356016 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x5556ed657e80 0x5556ed65a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:24.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.894+0000 7f62f2a00640 1 --2- 172.21.15.3:0/2430356016 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x5556ed657e80 0x5556ed65a2d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32de43d670f716fb server_cookie=1052c9a4151d87cd in_seq=0 out_seq=0 2024-09-10T23:27:24.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.894+0000 7f62dcc00640 10 client.35450 ms_handle_connect on v2:172.21.15.38:6838/458259815 2024-09-10T23:27:24.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.895+0000 7f62dcc00640 1 -- 172.21.15.3:0/2430356016 <== mds.0 v2:172.21.15.38:6838/458259815 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5556ed5aabf0 con 0x5556ed657e80 2024-09-10T23:27:24.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.895+0000 7f62dcc00640 10 client.35450 handle_command_reply: tid=0 2024-09-10T23:27:24.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.895+0000 7f62fcdc4740 1 client.35450 shutdown 2024-09-10T23:27:24.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.896+0000 7f62fcdc4740 1 -- 172.21.15.3:0/2430356016 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5556ed6332f0 msgr2=0x5556ed647d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:24.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.896+0000 7f62fcdc4740 1 --2- 172.21.15.3:0/2430356016 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5556ed6332f0 0x5556ed647d50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f62e40ccb00 tx=0x7f62e40c8d60 comp rx=0 tx=0).stop 2024-09-10T23:27:24.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.896+0000 7f62fcdc4740 1 -- 172.21.15.3:0/2430356016 shutdown_connections 2024-09-10T23:27:24.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.897+0000 7f62fcdc4740 1 --2- 172.21.15.3:0/2430356016 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x5556ed657e80 0x5556ed65a2d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:24.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.897+0000 7f62fcdc4740 1 --2- 172.21.15.3:0/2430356016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556ed6483b0 0x5556ed645850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:24.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.897+0000 7f62fcdc4740 1 --2- 172.21.15.3:0/2430356016 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5556ed633c10 0x5556ed6451a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:24.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.897+0000 7f62fcdc4740 1 --2- 172.21.15.3:0/2430356016 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5556ed6332f0 0x5556ed647d50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:24.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.897+0000 7f62fcdc4740 1 -- 172.21.15.3:0/2430356016 >> 172.21.15.3:0/2430356016 conn(0x5556ed631120 msgr2=0x5556ed636cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:24.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.897+0000 7f62dcc00640 0 client.35450 ms_handle_reset on v2:172.21.15.38:6838/458259815 2024-09-10T23:27:24.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.898+0000 7f62fcdc4740 1 -- 172.21.15.3:0/2430356016 shutdown_connections 2024-09-10T23:27:24.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.898+0000 7f62fcdc4740 1 -- 172.21.15.3:0/2430356016 wait complete. 2024-09-10T23:27:24.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.899+0000 7f62fcdc4740 20 client.35450 trim_cache size 0 max 16384 2024-09-10T23:27:24.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.926+0000 7f62fcdc4740 1 Processor -- start 2024-09-10T23:27:24.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.926+0000 7f62fcdc4740 1 -- start start 2024-09-10T23:27:24.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.926+0000 7f62fcdc4740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556ed6332f0 0x5556ed654260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:24.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.926+0000 7f62fcdc4740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5556ed633c10 0x5556ed632030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:24.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.926+0000 7f62fcdc4740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5556ed6483b0 0x5556ed643a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:24.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.926+0000 7f62fcdc4740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f62f41b0120 con 0x5556ed6483b0 2024-09-10T23:27:24.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.926+0000 7f62fcdc4740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f62f41ad9f0 con 0x5556ed633c10 2024-09-10T23:27:24.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.926+0000 7f62fcdc4740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f62f41ab860 con 0x5556ed6332f0 2024-09-10T23:27:24.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.927+0000 7f62f3e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5556ed6483b0 0x5556ed643a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:24.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.927+0000 7f62f3e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5556ed6483b0 0x5556ed643a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58176/0 (socket says 172.21.15.3:58176) 2024-09-10T23:27:24.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.927+0000 7f62f3e00640 1 -- 172.21.15.3:0/2687578720 learned_addr learned my addr 172.21.15.3:0/2687578720 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:27:24.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.927+0000 7f62f3400640 1 --2- 172.21.15.3:0/2687578720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556ed6332f0 0x5556ed654260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:24.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.927+0000 7f62f2a00640 1 --2- 172.21.15.3:0/2687578720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5556ed633c10 0x5556ed632030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:24.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.928+0000 7f62f3e00640 1 -- 172.21.15.3:0/2687578720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556ed6332f0 msgr2=0x5556ed654260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:24.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.928+0000 7f62f3e00640 1 --2- 172.21.15.3:0/2687578720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556ed6332f0 0x5556ed654260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:24.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.928+0000 7f62f3e00640 1 -- 172.21.15.3:0/2687578720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5556ed633c10 msgr2=0x5556ed632030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:24.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.928+0000 7f62f3e00640 1 --2- 172.21.15.3:0/2687578720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5556ed633c10 0x5556ed632030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:24.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.928+0000 7f62f3e00640 1 -- 172.21.15.3:0/2687578720 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556ed632800 con 0x5556ed6483b0 2024-09-10T23:27:24.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.928+0000 7f62f3e00640 1 --2- 172.21.15.3:0/2687578720 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5556ed6483b0 0x5556ed643a40 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f62ec009fa0 tx=0x7f62ec023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e420df5ec59b26 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:24.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.929+0000 7f62df400640 1 -- 172.21.15.3:0/2687578720 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ec01d040 con 0x5556ed6483b0 2024-09-10T23:27:24.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.929+0000 7f62df400640 1 -- 172.21.15.3:0/2687578720 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f62ec029030 con 0x5556ed6483b0 2024-09-10T23:27:24.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.929+0000 7f62df400640 1 -- 172.21.15.3:0/2687578720 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ec00f4e0 con 0x5556ed6483b0 2024-09-10T23:27:24.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.930+0000 7f62fcdc4740 1 -- 172.21.15.3:0/2687578720 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5556ed6483b0 msgr2=0x5556ed643a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:24.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.930+0000 7f62fcdc4740 1 --2- 172.21.15.3:0/2687578720 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5556ed6483b0 0x5556ed643a40 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f62ec009fa0 tx=0x7f62ec023000 comp rx=0 tx=0).stop 2024-09-10T23:27:24.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.930+0000 7f62fcdc4740 1 -- 172.21.15.3:0/2687578720 shutdown_connections 2024-09-10T23:27:24.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.930+0000 7f62fcdc4740 1 --2- 172.21.15.3:0/2687578720 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5556ed6483b0 0x5556ed643a40 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:24.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.930+0000 7f62fcdc4740 1 --2- 172.21.15.3:0/2687578720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5556ed633c10 0x5556ed632030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:24.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.930+0000 7f62fcdc4740 1 --2- 172.21.15.3:0/2687578720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556ed6332f0 0x5556ed654260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:24.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.930+0000 7f62fcdc4740 1 -- 172.21.15.3:0/2687578720 >> 172.21.15.3:0/2687578720 conn(0x5556ed631120 msgr2=0x5556ed649280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:24.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.930+0000 7f62fcdc4740 1 -- 172.21.15.3:0/2687578720 shutdown_connections 2024-09-10T23:27:24.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.930+0000 7f62fcdc4740 1 -- 172.21.15.3:0/2687578720 wait complete. 2024-09-10T23:27:24.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.931+0000 7f62fcdc4740 1 -- start start 2024-09-10T23:27:24.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.931+0000 7f62fcdc4740 1 Processor -- start 2024-09-10T23:27:24.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.931+0000 7f62fcdc4740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556ed6332f0 0x5556ed6bfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:24.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.932+0000 7f62fcdc4740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5556ed633c10 0x5556ed6c0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:24.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.932+0000 7f62fcdc4740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5556ed6483b0 0x5556ed6c07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:24.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.932+0000 7f62fcdc4740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f62f41abeb0 con 0x5556ed6483b0 2024-09-10T23:27:24.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.932+0000 7f62fcdc4740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f62f41ad320 con 0x5556ed633c10 2024-09-10T23:27:24.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.932+0000 7f62fcdc4740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f62f41ac580 con 0x5556ed6332f0 2024-09-10T23:27:24.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.932+0000 7f62fcdc4740 10 client.0 _ll_register_callbacks cb 0x7f62e4104010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:24.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.932+0000 7f62f3e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5556ed6483b0 0x5556ed6c07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:24.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.932+0000 7f62f2a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5556ed633c10 0x5556ed6c0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:24.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.932+0000 7f62f2a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5556ed633c10 0x5556ed6c0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.3:57320/0 (socket says 172.21.15.3:57320) 2024-09-10T23:27:24.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.932+0000 7f62f2a00640 1 -- 172.21.15.3:0/2349479768 learned_addr learned my addr 172.21.15.3:0/2349479768 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:27:24.935 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.933+0000 7f62f2a00640 1 -- 172.21.15.3:0/2349479768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556ed6332f0 msgr2=0x5556ed6bfd40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T23:27:24.935 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.933+0000 7f62f2a00640 1 --2- 172.21.15.3:0/2349479768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556ed6332f0 0x5556ed6bfd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:24.935 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.933+0000 7f62f2a00640 1 -- 172.21.15.3:0/2349479768 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5556ed6483b0 msgr2=0x5556ed6c07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:24.935 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.933+0000 7f62f2a00640 1 --2- 172.21.15.3:0/2349479768 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5556ed6483b0 0x5556ed6c07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:24.935 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.933+0000 7f62f2a00640 1 -- 172.21.15.3:0/2349479768 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556ed64f9b0 con 0x5556ed633c10 2024-09-10T23:27:24.935 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.933+0000 7f62f2a00640 1 --2- 172.21.15.3:0/2349479768 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5556ed633c10 0x5556ed6c0280 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f62e0004270 tx=0x7f62e00039c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4037be81969a9e67 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:24.935 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.933+0000 7f62dcc00640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-10T23:27:24.935 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.933+0000 7f62dcc00640 1 -- 172.21.15.3:0/2349479768 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e0012660 con 0x5556ed633c10 2024-09-10T23:27:24.935 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.933+0000 7f62dcc00640 1 -- 172.21.15.3:0/2349479768 <== mon.2 v2:172.21.15.38:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f62e0012800 con 0x5556ed633c10 2024-09-10T23:27:24.935 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.933+0000 7f62fcdc4740 1 -- 172.21.15.3:0/2349479768 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62ec029030 con 0x5556ed633c10 2024-09-10T23:27:24.936 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.934+0000 7f62dcc00640 1 -- 172.21.15.3:0/2349479768 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f62e002c050 con 0x5556ed633c10 2024-09-10T23:27:24.936 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.934+0000 7f62fcdc4740 10 client.35456 fetch_fsmap learned FSMap version 26 2024-09-10T23:27:24.936 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.934+0000 7f62fcdc4740 1 -- 172.21.15.3:0/2349479768 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5556ed63f9e0 con 0x5556ed633c10 2024-09-10T23:27:24.936 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.934+0000 7f62dcc00640 1 -- 172.21.15.3:0/2349479768 <== mon.2 v2:172.21.15.38:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f62ec029030 con 0x5556ed633c10 2024-09-10T23:27:24.936 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.935+0000 7f62dcc00640 1 -- 172.21.15.3:0/2349479768 <== mon.2 v2:172.21.15.38:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f62e000f040 con 0x5556ed633c10 2024-09-10T23:27:24.936 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.935+0000 7f62fcdc4740 10 client.35456 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:27:24.936 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.935+0000 7f62fcdc4740 10 client.35456 resolve_mds: validated gid 34724 aka daemon mds.b 2024-09-10T23:27:24.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.935+0000 7f62fcdc4740 20 client.35456 populate_metadata read hostname 'smithi003' 2024-09-10T23:27:24.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.935+0000 7f62fcdc4740 1 --2- 172.21.15.3:0/2349479768 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x5556ed640230 0x5556ed642650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:24.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.935+0000 7f62fcdc4740 4 client.35456 mds_command: new command op to 34724 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.2, "await_for": 45.0}] 2024-09-10T23:27:24.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.935+0000 7f62fcdc4740 1 -- 172.21.15.3:0/2349479768 --> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.2, "await_for": 45.0}) -- 0x5556ed5a66a0 con 0x5556ed640230 2024-09-10T23:27:24.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.935+0000 7f62f3400640 1 --2- 172.21.15.3:0/2349479768 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x5556ed640230 0x5556ed642650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:24.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.936+0000 7f62f3400640 1 --2- 172.21.15.3:0/2349479768 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x5556ed640230 0x5556ed642650 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9f7e8e79ddad703 server_cookie=cb5dcf3a4a2bf5db in_seq=0 out_seq=0 2024-09-10T23:27:24.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.936+0000 7f62dcc00640 10 client.35456 ms_handle_connect on v2:172.21.15.38:6838/458259815 2024-09-10T23:27:24.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.947+0000 7f62dcc00640 1 -- 172.21.15.3:0/2349479768 <== mds.0 v2:172.21.15.38:6838/458259815 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5556ed5a66a0 con 0x5556ed640230 2024-09-10T23:27:24.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.947+0000 7f62dcc00640 10 client.35456 handle_command_reply: tid=0 2024-09-10T23:27:24.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.947+0000 7f62fcdc4740 1 client.35456 shutdown 2024-09-10T23:27:24.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.948+0000 7f62fcdc4740 1 -- 172.21.15.3:0/2349479768 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5556ed633c10 msgr2=0x5556ed6c0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:24.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.948+0000 7f62fcdc4740 1 --2- 172.21.15.3:0/2349479768 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5556ed633c10 0x5556ed6c0280 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f62e0004270 tx=0x7f62e00039c0 comp rx=0 tx=0).stop 2024-09-10T23:27:24.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.948+0000 7f62fcdc4740 1 -- 172.21.15.3:0/2349479768 shutdown_connections 2024-09-10T23:27:24.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.948+0000 7f62fcdc4740 1 --2- 172.21.15.3:0/2349479768 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x5556ed640230 0x5556ed642650 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:24.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.948+0000 7f62fcdc4740 1 --2- 172.21.15.3:0/2349479768 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5556ed6483b0 0x5556ed6c07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:24.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.948+0000 7f62fcdc4740 1 --2- 172.21.15.3:0/2349479768 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5556ed633c10 0x5556ed6c0280 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:24.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.948+0000 7f62fcdc4740 1 --2- 172.21.15.3:0/2349479768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556ed6332f0 0x5556ed6bfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:24.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.948+0000 7f62fcdc4740 1 -- 172.21.15.3:0/2349479768 >> 172.21.15.3:0/2349479768 conn(0x5556ed631120 msgr2=0x5556ed649280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:24.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.948+0000 7f62dcc00640 0 client.35456 ms_handle_reset on v2:172.21.15.38:6838/458259815 2024-09-10T23:27:24.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.948+0000 7f62fcdc4740 1 -- 172.21.15.3:0/2349479768 shutdown_connections 2024-09-10T23:27:24.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.948+0000 7f62fcdc4740 1 -- 172.21.15.3:0/2349479768 wait complete. 2024-09-10T23:27:24.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.948+0000 7f62fcdc4740 20 client.35456 trim_cache size 0 max 16384 2024-09-10T23:27:24.951 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-10T23:27:24.951 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 26, 2024-09-10T23:27:24.951 INFO:teuthology.orchestra.run.smithi003.stdout: "leader": 34724, 2024-09-10T23:27:24.951 INFO:teuthology.orchestra.run.smithi003.stdout: "set_version": 2, 2024-09-10T23:27:24.951 INFO:teuthology.orchestra.run.smithi003.stdout: "sets": { 2024-09-10T23:27:24.951 INFO:teuthology.orchestra.run.smithi003.stdout: "b3413b26": { 2024-09-10T23:27:24.951 INFO:teuthology.orchestra.run.smithi003.stdout: "version": 2, 2024-09-10T23:27:24.951 INFO:teuthology.orchestra.run.smithi003.stdout: "age_ref": 0.0, 2024-09-10T23:27:24.951 INFO:teuthology.orchestra.run.smithi003.stdout: "state": { 2024-09-10T23:27:24.951 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "QUIESCED", 2024-09-10T23:27:24.952 INFO:teuthology.orchestra.run.smithi003.stdout: "age": 0.0 2024-09-10T23:27:24.952 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:27:24.952 INFO:teuthology.orchestra.run.smithi003.stdout: "timeout": 90.0, 2024-09-10T23:27:24.952 INFO:teuthology.orchestra.run.smithi003.stdout: "expiration": 145.2, 2024-09-10T23:27:24.952 INFO:teuthology.orchestra.run.smithi003.stdout: "members": { 2024-09-10T23:27:24.952 INFO:teuthology.orchestra.run.smithi003.stdout: "file:/": { 2024-09-10T23:27:24.952 INFO:teuthology.orchestra.run.smithi003.stdout: "excluded": false, 2024-09-10T23:27:24.952 INFO:teuthology.orchestra.run.smithi003.stdout: "state": { 2024-09-10T23:27:24.952 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "QUIESCED", 2024-09-10T23:27:24.952 INFO:teuthology.orchestra.run.smithi003.stdout: "age": 0.0 2024-09-10T23:27:24.952 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:27:24.952 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:27:24.952 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:27:24.952 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:27:24.953 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:27:24.953 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-10T23:27:24.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.949+0000 7f62f8c00640 1 -- 172.21.15.3:0/368862141 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f62d80b5600 msgr2=0x7f62d80b7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:24.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.949+0000 7f62f8c00640 1 --2- 172.21.15.3:0/368862141 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f62d80b5600 0x7f62d80b7ac0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f62ec004910 tx=0x7f62ec000f40 comp rx=0 tx=0).stop 2024-09-10T23:27:24.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.949+0000 7f62f8c00640 1 -- 172.21.15.3:0/368862141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62f4102c10 msgr2=0x7f62f40754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:24.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.949+0000 7f62f8c00640 1 --2- 172.21.15.3:0/368862141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62f4102c10 0x7f62f40754a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f62e402a910 tx=0x7f62e4003b90 comp rx=0 tx=0).stop 2024-09-10T23:27:24.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.949+0000 7f62f8c00640 1 -- 172.21.15.3:0/368862141 shutdown_connections 2024-09-10T23:27:24.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.949+0000 7f62f8c00640 1 --2- 172.21.15.3:0/368862141 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f4108fa0 0x7f62f4075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:24.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.949+0000 7f62f8c00640 1 --2- 172.21.15.3:0/368862141 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f62d80b5600 0x7f62d80b7ac0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:24.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.949+0000 7f62f8c00640 1 --2- 172.21.15.3:0/368862141 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f62f4108620 0x7f62f40759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:24.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.949+0000 7f62f8c00640 1 --2- 172.21.15.3:0/368862141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62f4102c10 0x7f62f40754a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:24.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.949+0000 7f62f8c00640 1 -- 172.21.15.3:0/368862141 >> 172.21.15.3:0/368862141 conn(0x7f62f40fe660 msgr2=0x7f62f4100a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:24.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.950+0000 7f62f8c00640 1 -- 172.21.15.3:0/368862141 shutdown_connections 2024-09-10T23:27:24.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:24.950+0000 7f62f8c00640 1 -- 172.21.15.3:0/368862141 wait complete. 2024-09-10T23:27:25.738 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'b3413b26', quiesce took 4.3 seconds. Will release after: 20.9 2024-09-10T23:27:26.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:26 smithi194 ceph-mon[33904]: pgmap v410: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:27:26.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:26 smithi003 ceph-mon[30348]: pgmap v410: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:27:26.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:26 smithi038 ceph-mon[34225]: pgmap v410: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:27:28.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:28 smithi194 ceph-mon[33904]: pgmap v411: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:27:28.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:28 smithi003 ceph-mon[30348]: pgmap v411: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:27:28.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:28 smithi038 ceph-mon[34225]: pgmap v411: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:27:30.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:30 smithi194 ceph-mon[33904]: pgmap v412: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-10T23:27:30.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:30 smithi003 ceph-mon[30348]: pgmap v412: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-10T23:27:30.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:30 smithi038 ceph-mon[34225]: pgmap v412: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-10T23:27:32.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:32 smithi194 ceph-mon[33904]: pgmap v413: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T23:27:32.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:32 smithi003 ceph-mon[30348]: pgmap v413: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T23:27:32.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:32 smithi038 ceph-mon[34225]: pgmap v413: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T23:27:34.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:34 smithi194 ceph-mon[33904]: pgmap v414: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-10T23:27:34.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:34 smithi003 ceph-mon[30348]: pgmap v414: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-10T23:27:34.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:34 smithi038 ceph-mon[34225]: pgmap v414: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-10T23:27:36.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:36 smithi194 ceph-mon[33904]: pgmap v415: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T23:27:36.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:36 smithi003 ceph-mon[30348]: pgmap v415: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T23:27:36.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:36 smithi038 ceph-mon[34225]: pgmap v415: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T23:27:38.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:38 smithi194 ceph-mon[33904]: pgmap v416: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-10T23:27:38.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:38 smithi003 ceph-mon[30348]: pgmap v416: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-10T23:27:38.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:38 smithi038 ceph-mon[34225]: pgmap v416: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-10T23:27:40.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:40 smithi003 ceph-mon[30348]: pgmap v417: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-10T23:27:40.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:40 smithi038 ceph-mon[34225]: pgmap v417: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-10T23:27:40.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:40 smithi194 ceph-mon[33904]: pgmap v417: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-10T23:27:42.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:42 smithi003 ceph-mon[30348]: pgmap v418: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:27:42.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:42 smithi038 ceph-mon[34225]: pgmap v418: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:27:42.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:42 smithi194 ceph-mon[33904]: pgmap v418: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:27:44.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:44 smithi003 ceph-mon[30348]: pgmap v419: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:27:44.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:44 smithi038 ceph-mon[34225]: pgmap v419: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:27:44.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:44 smithi194 ceph-mon[33904]: pgmap v419: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:27:46.640 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:27:46.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:46 smithi003 ceph-mon[30348]: pgmap v420: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:27:46.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:46 smithi038 ceph-mon[34225]: pgmap v420: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:27:46.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:46 smithi194 ceph-mon[33904]: pgmap v420: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:27:47.100 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:27:47.797 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.796+0000 7fd832000640 1 -- 172.21.15.3:0/3529986911 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd82c077ff0 msgr2=0x7fd82c113450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:47.797 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.796+0000 7fd832000640 1 --2- 172.21.15.3:0/3529986911 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd82c077ff0 0x7fd82c113450 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd818009900 tx=0x7fd81802a410 comp rx=0 tx=0).stop 2024-09-10T23:27:47.797 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.796+0000 7fd832000640 1 -- 172.21.15.3:0/3529986911 shutdown_connections 2024-09-10T23:27:47.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.796+0000 7fd832000640 1 --2- 172.21.15.3:0/3529986911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd82c113990 0x7fd82c115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.796+0000 7fd832000640 1 --2- 172.21.15.3:0/3529986911 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd82c077ff0 0x7fd82c113450 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.796+0000 7fd832000640 1 --2- 172.21.15.3:0/3529986911 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd82c0776d0 0x7fd82c077ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.796+0000 7fd832000640 1 -- 172.21.15.3:0/3529986911 >> 172.21.15.3:0/3529986911 conn(0x7fd82c100a50 msgr2=0x7fd82c102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:47.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.797+0000 7fd832000640 1 -- 172.21.15.3:0/3529986911 shutdown_connections 2024-09-10T23:27:47.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.797+0000 7fd832000640 1 -- 172.21.15.3:0/3529986911 wait complete. 2024-09-10T23:27:47.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.798+0000 7fd832000640 1 Processor -- start 2024-09-10T23:27:47.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.798+0000 7fd832000640 1 -- start start 2024-09-10T23:27:47.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.799+0000 7fd832000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd82c0776d0 0x7fd82c19f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:47.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.799+0000 7fd832000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd82c077ff0 0x7fd82c19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:47.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.799+0000 7fd832000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd82c113990 0x7fd82c1a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:47.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.799+0000 7fd832000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c119290 con 0x7fd82c113990 2024-09-10T23:27:47.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.799+0000 7fd832000640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c119110 con 0x7fd82c0776d0 2024-09-10T23:27:47.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.799+0000 7fd832000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c119410 con 0x7fd82c077ff0 2024-09-10T23:27:47.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.799+0000 7fd82b400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd82c0776d0 0x7fd82c19f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:47.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.799+0000 7fd82b400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd82c0776d0 0x7fd82c19f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.3:54596/0 (socket says 172.21.15.3:54596) 2024-09-10T23:27:47.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.799+0000 7fd82b400640 1 -- 172.21.15.3:0/2311304770 learned_addr learned my addr 172.21.15.3:0/2311304770 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:27:47.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.800+0000 7fd82aa00640 1 --2- 172.21.15.3:0/2311304770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd82c077ff0 0x7fd82c19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:47.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.800+0000 7fd82be00640 1 --2- 172.21.15.3:0/2311304770 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd82c113990 0x7fd82c1a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:47.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.800+0000 7fd82aa00640 1 -- 172.21.15.3:0/2311304770 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd82c0776d0 msgr2=0x7fd82c19f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:47.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.800+0000 7fd82aa00640 1 --2- 172.21.15.3:0/2311304770 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd82c0776d0 0x7fd82c19f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.800+0000 7fd82aa00640 1 -- 172.21.15.3:0/2311304770 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd82c113990 msgr2=0x7fd82c1a50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:47.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.800+0000 7fd82aa00640 1 --2- 172.21.15.3:0/2311304770 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd82c113990 0x7fd82c1a50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:47.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.800+0000 7fd82aa00640 1 -- 172.21.15.3:0/2311304770 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd82c1a58b0 con 0x7fd82c077ff0 2024-09-10T23:27:47.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.801+0000 7fd82aa00640 1 --2- 172.21.15.3:0/2311304770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd82c077ff0 0x7fd82c19fd40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd818009850 tx=0x7fd818003c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:47.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.802+0000 7fd823e00640 1 -- 172.21.15.3:0/2311304770 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81803f070 con 0x7fd82c077ff0 2024-09-10T23:27:47.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.802+0000 7fd823e00640 1 -- 172.21.15.3:0/2311304770 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd81803baf0 con 0x7fd82c077ff0 2024-09-10T23:27:47.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.802+0000 7fd823e00640 1 -- 172.21.15.3:0/2311304770 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd818035030 con 0x7fd82c077ff0 2024-09-10T23:27:47.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.802+0000 7fd832000640 1 -- 172.21.15.3:0/2311304770 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd82c1a5b40 con 0x7fd82c077ff0 2024-09-10T23:27:47.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.803+0000 7fd832000640 1 -- 172.21.15.3:0/2311304770 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd82c1ac260 con 0x7fd82c077ff0 2024-09-10T23:27:47.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.804+0000 7fd832000640 1 -- 172.21.15.3:0/2311304770 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd82c077ab0 con 0x7fd82c077ff0 2024-09-10T23:27:47.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.808+0000 7fd823e00640 1 -- 172.21.15.3:0/2311304770 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 153431+0+0 (secure 0 0 0) 0x7fd818031b90 con 0x7fd82c077ff0 2024-09-10T23:27:47.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.809+0000 7fd823e00640 1 --2- 172.21.15.3:0/2311304770 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd8100b5660 0x7fd8100b7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:47.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.810+0000 7fd823e00640 1 -- 172.21.15.3:0/2311304770 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7fd8181070e0 con 0x7fd82c077ff0 2024-09-10T23:27:47.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.810+0000 7fd82b400640 1 --2- 172.21.15.3:0/2311304770 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd8100b5660 0x7fd8100b7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:47.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.810+0000 7fd823e00640 1 -- 172.21.15.3:0/2311304770 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd8180cd7a0 con 0x7fd82c077ff0 2024-09-10T23:27:47.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:47.811+0000 7fd82b400640 1 --2- 172.21.15.3:0/2311304770 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd8100b5660 0x7fd8100b7b20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd81c009cd0 tx=0x7fd81c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:48.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:48.143+0000 7fd832000640 1 -- 172.21.15.3:0/2311304770 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd82c1ac500 con 0x7fd82c077ff0 2024-09-10T23:27:48.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:48.144+0000 7fd823e00640 1 -- 172.21.15.3:0/2311304770 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11891 (secure 0 0 0) 0x7fd8180cd0a0 con 0x7fd82c077ff0 2024-09-10T23:27:48.145 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:27:48.145 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":26,"btime":"2024-09-10T23:26:42:260644+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/1495411512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":1495411512},{"type":"v1","addr":"172.21.15.3:6835","nonce":1495411512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/1857372777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1857372777},{"type":"v1","addr":"172.21.15.3:6837","nonce":1857372777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14862,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6839/493850676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":493850676},{"type":"v1","addr":"172.21.15.3:6839","nonce":493850676}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14874,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6841/1580524358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":1580524358},{"type":"v1","addr":"172.21.15.3:6841","nonce":1580524358}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/352514665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":352514665},{"type":"v1","addr":"172.21.15.194:6833","nonce":352514665}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2380508105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2380508105},{"type":"v1","addr":"172.21.15.194:6835","nonce":2380508105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:23:58.866253+0000","modified":"2024-09-10T23:26:41.694795+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34724,"mds_1":34682,"mds_2":34652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24649":{"gid":24649,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/739730313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":739730313},{"type":"v1","addr":"172.21.15.194:6837","nonce":739730313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/3198777710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3198777710},{"type":"v1","addr":"172.21.15.194:6839","nonce":3198777710}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34619":{"gid":34619,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6833/1194099617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1194099617},{"type":"v1","addr":"172.21.15.38:6833","nonce":1194099617}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34652":{"gid":34652,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.38:6835/218783320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":218783320},{"type":"v1","addr":"172.21.15.38:6835","nonce":218783320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34682":{"gid":34682,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":21,"addr":"172.21.15.38:6837/1821839397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":1821839397},{"type":"v1","addr":"172.21.15.38:6837","nonce":1821839397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34724":{"gid":34724,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.38:6839/458259815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":458259815},{"type":"v1","addr":"172.21.15.38:6839","nonce":458259815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34724,"qdb_cluster":[34724,34682,34652]},"id":1}]} 2024-09-10T23:27:48.145 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 26 2024-09-10T23:27:48.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:48.148+0000 7fd832000640 1 -- 172.21.15.3:0/2311304770 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd8100b5660 msgr2=0x7fd8100b7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:48.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:48.148+0000 7fd832000640 1 --2- 172.21.15.3:0/2311304770 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd8100b5660 0x7fd8100b7b20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd81c009cd0 tx=0x7fd81c005f90 comp rx=0 tx=0).stop 2024-09-10T23:27:48.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:48.148+0000 7fd832000640 1 -- 172.21.15.3:0/2311304770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd82c077ff0 msgr2=0x7fd82c19fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:48.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:48.148+0000 7fd832000640 1 --2- 172.21.15.3:0/2311304770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd82c077ff0 0x7fd82c19fd40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd818009850 tx=0x7fd818003c00 comp rx=0 tx=0).stop 2024-09-10T23:27:48.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:48.148+0000 7fd832000640 1 -- 172.21.15.3:0/2311304770 shutdown_connections 2024-09-10T23:27:48.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:48.148+0000 7fd832000640 1 --2- 172.21.15.3:0/2311304770 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fd8100b5660 0x7fd8100b7b20 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:48.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:48.148+0000 7fd832000640 1 --2- 172.21.15.3:0/2311304770 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd82c113990 0x7fd82c1a50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:48.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:48.148+0000 7fd832000640 1 --2- 172.21.15.3:0/2311304770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd82c077ff0 0x7fd82c19fd40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:48.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:48.148+0000 7fd832000640 1 --2- 172.21.15.3:0/2311304770 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd82c0776d0 0x7fd82c19f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:48.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:48.148+0000 7fd832000640 1 -- 172.21.15.3:0/2311304770 >> 172.21.15.3:0/2311304770 conn(0x7fd82c100a50 msgr2=0x7fd82c102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:48.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:48.149+0000 7fd832000640 1 -- 172.21.15.3:0/2311304770 shutdown_connections 2024-09-10T23:27:48.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:48.149+0000 7fd832000640 1 -- 172.21.15.3:0/2311304770 wait complete. 2024-09-10T23:27:48.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:48 smithi003 ceph-mon[30348]: pgmap v421: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:27:48.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:48 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2311304770' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:27:48.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:48 smithi038 ceph-mon[34225]: pgmap v421: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:27:48.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:48 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2311304770' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:27:48.946 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34724 quiesce db --set-id b3413b26 --release --await' 2024-09-10T23:27:48.947 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34724 quiesce db --set-id b3413b26 --release --await 2024-09-10T23:27:48.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:48 smithi194 ceph-mon[33904]: pgmap v421: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:27:48.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:48 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2311304770' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:27:49.502 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:27:50.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.221+0000 7f633ea00640 1 -- 172.21.15.3:0/2145139774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f633810a820 msgr2=0x7f633810ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:50.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.221+0000 7f633ea00640 1 --2- 172.21.15.3:0/2145139774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f633810a820 0x7f633810ac60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6324009860 tx=0x7f632402a340 comp rx=0 tx=0).stop 2024-09-10T23:27:50.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.221+0000 7f633ea00640 1 -- 172.21.15.3:0/2145139774 shutdown_connections 2024-09-10T23:27:50.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.221+0000 7f633ea00640 1 --2- 172.21.15.3:0/2145139774 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f633810b1a0 0x7f63381119a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.221+0000 7f633ea00640 1 --2- 172.21.15.3:0/2145139774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f633810a820 0x7f633810ac60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.221+0000 7f633ea00640 1 --2- 172.21.15.3:0/2145139774 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6338104e10 0x7f63381051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.221+0000 7f633ea00640 1 -- 172.21.15.3:0/2145139774 >> 172.21.15.3:0/2145139774 conn(0x7f6338100840 msgr2=0x7f6338102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:50.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.222+0000 7f633ea00640 1 -- 172.21.15.3:0/2145139774 shutdown_connections 2024-09-10T23:27:50.224 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.222+0000 7f633ea00640 1 -- 172.21.15.3:0/2145139774 wait complete. 2024-09-10T23:27:50.224 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.223+0000 7f633ea00640 1 Processor -- start 2024-09-10T23:27:50.224 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.223+0000 7f633ea00640 1 -- start start 2024-09-10T23:27:50.225 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.224+0000 7f633ea00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6338104e10 0x7f633819b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:50.225 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.224+0000 7f633ea00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f633810a820 0x7f633819b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:50.225 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.224+0000 7f633ea00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f633810b1a0 0x7f63381a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:50.225 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.224+0000 7f633ea00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6338114ca0 con 0x7f633810b1a0 2024-09-10T23:27:50.225 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.224+0000 7f633ea00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6338114b20 con 0x7f633810a820 2024-09-10T23:27:50.225 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.224+0000 7f633ea00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6338114e20 con 0x7f6338104e10 2024-09-10T23:27:50.226 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.224+0000 7f633cc00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f633810a820 0x7f633819b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:50.226 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.224+0000 7f633cc00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f633810a820 0x7f633819b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.3:54622/0 (socket says 172.21.15.3:54622) 2024-09-10T23:27:50.226 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.224+0000 7f633cc00640 1 -- 172.21.15.3:0/3286933200 learned_addr learned my addr 172.21.15.3:0/3286933200 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:27:50.226 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.224+0000 7f633e000640 1 --2- 172.21.15.3:0/3286933200 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f633810b1a0 0x7f63381a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:50.226 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.224+0000 7f633d600640 1 --2- 172.21.15.3:0/3286933200 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6338104e10 0x7f633819b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:50.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.225+0000 7f633d600640 1 -- 172.21.15.3:0/3286933200 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f633810a820 msgr2=0x7f633819b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:50.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.225+0000 7f633d600640 1 --2- 172.21.15.3:0/3286933200 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f633810a820 0x7f633819b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.225+0000 7f633d600640 1 -- 172.21.15.3:0/3286933200 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f633810b1a0 msgr2=0x7f63381a0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:50.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.225+0000 7f633d600640 1 --2- 172.21.15.3:0/3286933200 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f633810b1a0 0x7f63381a0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.225+0000 7f633d600640 1 -- 172.21.15.3:0/3286933200 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63381a1220 con 0x7f6338104e10 2024-09-10T23:27:50.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.225+0000 7f633d600640 1 --2- 172.21.15.3:0/3286933200 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6338104e10 0x7f633819b170 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f632c005fd0 tx=0x7f632c00ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:50.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.226+0000 7f6336000640 1 -- 172.21.15.3:0/3286933200 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c00cd00 con 0x7f6338104e10 2024-09-10T23:27:50.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.226+0000 7f633ea00640 1 -- 172.21.15.3:0/3286933200 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63381a1510 con 0x7f6338104e10 2024-09-10T23:27:50.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.226+0000 7f633ea00640 1 -- 172.21.15.3:0/3286933200 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63381a7da0 con 0x7f6338104e10 2024-09-10T23:27:50.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.226+0000 7f6336000640 1 -- 172.21.15.3:0/3286933200 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f632c0035f0 con 0x7f6338104e10 2024-09-10T23:27:50.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.226+0000 7f6336000640 1 -- 172.21.15.3:0/3286933200 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c010690 con 0x7f6338104e10 2024-09-10T23:27:50.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.230+0000 7f6342ac0740 1 Processor -- start 2024-09-10T23:27:50.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.230+0000 7f6342ac0740 1 -- start start 2024-09-10T23:27:50.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.231+0000 7f6342ac0740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56427f1d21d0 0x56427f1d25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:50.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.231+0000 7f6342ac0740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56427f1d2af0 0x56427f1de540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:50.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.231+0000 7f6342ac0740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56427f1dea80 0x56427f1e0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:50.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.231+0000 7f6342ac0740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56427f149290 con 0x56427f1d2af0 2024-09-10T23:27:50.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.231+0000 7f633e000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56427f1d21d0 0x56427f1d25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:50.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.231+0000 7f633e000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56427f1d21d0 0x56427f1d25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.3:54638/0 (socket says 172.21.15.3:54638) 2024-09-10T23:27:50.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.231+0000 7f633e000640 1 -- 172.21.15.3:0/3990791876 learned_addr learned my addr 172.21.15.3:0/3990791876 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:27:50.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.231+0000 7f6342ac0740 1 -- 172.21.15.3:0/3990791876 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x56427f1386c0 con 0x56427f1d21d0 2024-09-10T23:27:50.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.231+0000 7f6342ac0740 1 -- 172.21.15.3:0/3990791876 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56427f13c4d0 con 0x56427f1dea80 2024-09-10T23:27:50.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.232+0000 7f633e000640 1 -- 172.21.15.3:0/3990791876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56427f1dea80 msgr2=0x56427f1e0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:50.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.232+0000 7f633e000640 1 --2- 172.21.15.3:0/3990791876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56427f1dea80 0x56427f1e0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.232+0000 7f633e000640 1 -- 172.21.15.3:0/3990791876 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56427f1d2af0 msgr2=0x56427f1de540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T23:27:50.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.232+0000 7f633e000640 1 --2- 172.21.15.3:0/3990791876 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56427f1d2af0 0x56427f1de540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.232+0000 7f633e000640 1 -- 172.21.15.3:0/3990791876 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56427f0c5460 con 0x56427f1d21d0 2024-09-10T23:27:50.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.232+0000 7f633e000640 1 --2- 172.21.15.3:0/3990791876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56427f1d21d0 0x56427f1d25b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f63300039f0 tx=0x7f6330003eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c86e2d7d51237b36 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:50.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.233+0000 7f6336000640 1 -- 172.21.15.3:0/3286933200 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 153431+0+0 (secure 0 0 0) 0x7f632c004000 con 0x7f6338104e10 2024-09-10T23:27:50.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.233+0000 7f632a600640 1 -- 172.21.15.3:0/3990791876 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633001a470 con 0x56427f1d21d0 2024-09-10T23:27:50.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.233+0000 7f632a600640 1 -- 172.21.15.3:0/3990791876 <== mon.2 v2:172.21.15.38:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6330015070 con 0x56427f1d21d0 2024-09-10T23:27:50.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.233+0000 7f632a600640 1 -- 172.21.15.3:0/3990791876 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63300107c0 con 0x56427f1d21d0 2024-09-10T23:27:50.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.234+0000 7f6342ac0740 1 -- 172.21.15.3:0/3990791876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56427f1d21d0 msgr2=0x56427f1d25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:50.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.234+0000 7f6342ac0740 1 --2- 172.21.15.3:0/3990791876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56427f1d21d0 0x56427f1d25b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f63300039f0 tx=0x7f6330003eb0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.234+0000 7f6342ac0740 1 -- 172.21.15.3:0/3990791876 shutdown_connections 2024-09-10T23:27:50.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.234+0000 7f6342ac0740 1 --2- 172.21.15.3:0/3990791876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56427f1dea80 0x56427f1e0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.234+0000 7f6342ac0740 1 --2- 172.21.15.3:0/3990791876 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56427f1d2af0 0x56427f1de540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.234+0000 7f6342ac0740 1 --2- 172.21.15.3:0/3990791876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56427f1d21d0 0x56427f1d25b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.234+0000 7f6342ac0740 1 -- 172.21.15.3:0/3990791876 >> 172.21.15.3:0/3990791876 conn(0x56427f1d0000 msgr2=0x56427f1d11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:50.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.235+0000 7f6342ac0740 1 -- 172.21.15.3:0/3990791876 shutdown_connections 2024-09-10T23:27:50.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.235+0000 7f6336000640 1 --2- 172.21.15.3:0/3286933200 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f63200b5510 0x7f63200b79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:50.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.235+0000 7f6336000640 1 -- 172.21.15.3:0/3286933200 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f632c0e6490 con 0x7f6338104e10 2024-09-10T23:27:50.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.235+0000 7f6342ac0740 1 -- 172.21.15.3:0/3990791876 wait complete. 2024-09-10T23:27:50.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.235+0000 7f633cc00640 1 --2- 172.21.15.3:0/3286933200 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f63200b5510 0x7f63200b79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:50.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.235+0000 7f6342ac0740 1 -- start start 2024-09-10T23:27:50.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.236+0000 7f6342ac0740 1 Processor -- start 2024-09-10T23:27:50.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.236+0000 7f6342ac0740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56427f1d21d0 0x56427f1db9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:50.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.236+0000 7f6342ac0740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56427f1d2af0 0x56427f1dbee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:50.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.236+0000 7f6342ac0740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56427f1dea80 0x56427f1dc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:50.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.236+0000 7f6342ac0740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56427ef99bb0 con 0x56427f1d2af0 2024-09-10T23:27:50.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.236+0000 7f6342ac0740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x56427f0d36c0 con 0x56427f1d21d0 2024-09-10T23:27:50.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.236+0000 7f6342ac0740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56427f1e1730 con 0x56427f1dea80 2024-09-10T23:27:50.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.236+0000 7f6342ac0740 10 client.0 _ll_register_callbacks cb 0x56427f0ee490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:50.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.237+0000 7f633e000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56427f1dea80 0x56427f1dc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:50.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.237+0000 7f633e000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56427f1dea80 0x56427f1dc420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.3:46112/0 (socket says 172.21.15.3:46112) 2024-09-10T23:27:50.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.237+0000 7f633e000640 1 -- 172.21.15.3:0/3720256094 learned_addr learned my addr 172.21.15.3:0/3720256094 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:27:50.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.237+0000 7f633d600640 1 --2- 172.21.15.3:0/3720256094 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56427f1d21d0 0x56427f1db9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:50.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.237+0000 7f633cc00640 1 --2- 172.21.15.3:0/3720256094 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56427f1d2af0 0x56427f1dbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:50.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.237+0000 7f633d600640 1 -- 172.21.15.3:0/3720256094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56427f1dea80 msgr2=0x56427f1dc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:50.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.237+0000 7f633d600640 1 --2- 172.21.15.3:0/3720256094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56427f1dea80 0x56427f1dc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.237+0000 7f633d600640 1 -- 172.21.15.3:0/3720256094 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56427f1d2af0 msgr2=0x56427f1dbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:50.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.237+0000 7f633d600640 1 --2- 172.21.15.3:0/3720256094 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56427f1d2af0 0x56427f1dbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.237+0000 7f633d600640 1 -- 172.21.15.3:0/3720256094 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56427ee96b00 con 0x56427f1d21d0 2024-09-10T23:27:50.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.237+0000 7f633cc00640 1 --2- 172.21.15.3:0/3720256094 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56427f1d2af0 0x56427f1dbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:50.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.238+0000 7f633d600640 1 --2- 172.21.15.3:0/3720256094 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56427f1d21d0 0x56427f1db9a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f632c0e3750 tx=0x7f632c0abde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5377d0b870a7305 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:50.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.238+0000 7f631ea00640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-10T23:27:50.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.238+0000 7f633cc00640 1 --2- 172.21.15.3:0/3286933200 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f63200b5510 0x7f63200b79d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6324005cd0 tx=0x7f6324005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:50.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.238+0000 7f631ea00640 1 -- 172.21.15.3:0/3720256094 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c0e3c00 con 0x56427f1d21d0 2024-09-10T23:27:50.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.238+0000 7f631ea00640 1 -- 172.21.15.3:0/3720256094 <== mon.2 v2:172.21.15.38:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f632c0ab630 con 0x56427f1d21d0 2024-09-10T23:27:50.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.238+0000 7f6342ac0740 1 -- 172.21.15.3:0/3720256094 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6330015070 con 0x56427f1d21d0 2024-09-10T23:27:50.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.238+0000 7f631ea00640 1 -- 172.21.15.3:0/3720256094 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f632c0acad0 con 0x56427f1d21d0 2024-09-10T23:27:50.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.238+0000 7f6342ac0740 10 client.35474 fetch_fsmap learned FSMap version 26 2024-09-10T23:27:50.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.238+0000 7f6342ac0740 1 -- 172.21.15.3:0/3720256094 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56427ef0d960 con 0x56427f1d21d0 2024-09-10T23:27:50.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.239+0000 7f631ea00640 1 -- 172.21.15.3:0/3720256094 <== mon.2 v2:172.21.15.38:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6330015070 con 0x56427f1d21d0 2024-09-10T23:27:50.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.240+0000 7f631ea00640 1 -- 172.21.15.3:0/3720256094 <== mon.2 v2:172.21.15.38:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f632c0d31a0 con 0x56427f1d21d0 2024-09-10T23:27:50.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.240+0000 7f6342ac0740 10 client.35474 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:27:50.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.240+0000 7f6342ac0740 10 client.35474 resolve_mds: validated gid 34724 aka daemon mds.b 2024-09-10T23:27:50.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.240+0000 7f6342ac0740 20 client.35474 populate_metadata read hostname 'smithi003' 2024-09-10T23:27:50.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.240+0000 7f6342ac0740 1 --2- 172.21.15.3:0/3720256094 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x56427f1e5a60 0x56427f1e7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:50.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.240+0000 7f6342ac0740 4 client.35474 mds_command: new command op to 34724 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:27:50.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.240+0000 7f6342ac0740 1 -- 172.21.15.3:0/3720256094 --> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56427f14b1e0 con 0x56427f1e5a60 2024-09-10T23:27:50.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.240+0000 7f633cc00640 1 --2- 172.21.15.3:0/3720256094 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x56427f1e5a60 0x56427f1e7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:50.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.241+0000 7f633cc00640 1 --2- 172.21.15.3:0/3720256094 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x56427f1e5a60 0x56427f1e7e80 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60fbff3d7c75ec01 server_cookie=e8311a893ec986e8 in_seq=0 out_seq=0 2024-09-10T23:27:50.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.241+0000 7f631ea00640 10 client.35474 ms_handle_connect on v2:172.21.15.38:6838/458259815 2024-09-10T23:27:50.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.242+0000 7f631ea00640 1 -- 172.21.15.3:0/3720256094 <== mds.0 v2:172.21.15.38:6838/458259815 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56427f14b1e0 con 0x56427f1e5a60 2024-09-10T23:27:50.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.242+0000 7f631ea00640 10 client.35474 handle_command_reply: tid=0 2024-09-10T23:27:50.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.242+0000 7f6342ac0740 1 client.35474 shutdown 2024-09-10T23:27:50.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.242+0000 7f6342ac0740 1 -- 172.21.15.3:0/3720256094 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56427f1d21d0 msgr2=0x56427f1db9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:50.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.242+0000 7f6342ac0740 1 --2- 172.21.15.3:0/3720256094 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56427f1d21d0 0x56427f1db9a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f632c0e3750 tx=0x7f632c0abde0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.242+0000 7f6342ac0740 1 -- 172.21.15.3:0/3720256094 shutdown_connections 2024-09-10T23:27:50.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.242+0000 7f6342ac0740 1 --2- 172.21.15.3:0/3720256094 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x56427f1e5a60 0x56427f1e7e80 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.242+0000 7f6342ac0740 1 --2- 172.21.15.3:0/3720256094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56427f1dea80 0x56427f1dc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.242+0000 7f6342ac0740 1 --2- 172.21.15.3:0/3720256094 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56427f1d2af0 0x56427f1dbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.242+0000 7f6342ac0740 1 --2- 172.21.15.3:0/3720256094 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56427f1d21d0 0x56427f1db9a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.242+0000 7f6342ac0740 1 -- 172.21.15.3:0/3720256094 >> 172.21.15.3:0/3720256094 conn(0x56427f1d0000 msgr2=0x56427f1d5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:50.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.243+0000 7f631ea00640 0 client.35474 ms_handle_reset on v2:172.21.15.38:6838/458259815 2024-09-10T23:27:50.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.243+0000 7f6342ac0740 1 -- 172.21.15.3:0/3720256094 shutdown_connections 2024-09-10T23:27:50.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.243+0000 7f6342ac0740 1 -- 172.21.15.3:0/3720256094 wait complete. 2024-09-10T23:27:50.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.243+0000 7f6342ac0740 20 client.35474 trim_cache size 0 max 16384 2024-09-10T23:27:50.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.261+0000 7f6342ac0740 1 Processor -- start 2024-09-10T23:27:50.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.262+0000 7f6342ac0740 1 -- start start 2024-09-10T23:27:50.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.262+0000 7f6342ac0740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56427f1d21d0 0x56427f1f2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:50.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.262+0000 7f6342ac0740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56427f1d2af0 0x56427f1da220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:50.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.262+0000 7f6342ac0740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56427f1dea80 0x56427f1dd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:50.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.262+0000 7f6342ac0740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6318012790 con 0x56427f1dea80 2024-09-10T23:27:50.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.262+0000 7f6342ac0740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6318010060 con 0x56427f1d21d0 2024-09-10T23:27:50.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.262+0000 7f6342ac0740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f631800deb0 con 0x56427f1d2af0 2024-09-10T23:27:50.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.262+0000 7f633d600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56427f1d21d0 0x56427f1f2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:50.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.262+0000 7f633d600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56427f1d21d0 0x56427f1f2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.3:54652/0 (socket says 172.21.15.3:54652) 2024-09-10T23:27:50.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.263+0000 7f633cc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56427f1d2af0 0x56427f1da220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:50.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.263+0000 7f633cc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56427f1d2af0 0x56427f1da220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.3:46120/0 (socket says 172.21.15.3:46120) 2024-09-10T23:27:50.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.263+0000 7f633cc00640 1 -- 172.21.15.3:0/570518904 learned_addr learned my addr 172.21.15.3:0/570518904 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:27:50.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.263+0000 7f633e000640 1 --2- 172.21.15.3:0/570518904 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56427f1dea80 0x56427f1dd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:50.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.263+0000 7f633d600640 1 -- 172.21.15.3:0/570518904 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56427f1d2af0 msgr2=0x56427f1da220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:50.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.263+0000 7f633d600640 1 --2- 172.21.15.3:0/570518904 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56427f1d2af0 0x56427f1da220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.263+0000 7f633d600640 1 -- 172.21.15.3:0/570518904 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56427f1dea80 msgr2=0x56427f1dd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:50.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.263+0000 7f633d600640 1 --2- 172.21.15.3:0/570518904 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56427f1dea80 0x56427f1dd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.263+0000 7f633d600640 1 -- 172.21.15.3:0/570518904 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56427f1d7310 con 0x56427f1d21d0 2024-09-10T23:27:50.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.264+0000 7f633d600640 1 --2- 172.21.15.3:0/570518904 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56427f1d21d0 0x56427f1f2c60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f632c0a9640 tx=0x7f632c009820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bf4f8d030235e92 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:50.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.264+0000 7f6329c00640 1 -- 172.21.15.3:0/570518904 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c0b5960 con 0x56427f1d21d0 2024-09-10T23:27:50.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.264+0000 7f6329c00640 1 -- 172.21.15.3:0/570518904 <== mon.2 v2:172.21.15.38:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f632c0ac3d0 con 0x56427f1d21d0 2024-09-10T23:27:50.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.264+0000 7f6329c00640 1 -- 172.21.15.3:0/570518904 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c0e3a00 con 0x56427f1d21d0 2024-09-10T23:27:50.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.265+0000 7f6342ac0740 1 -- 172.21.15.3:0/570518904 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56427f1d21d0 msgr2=0x56427f1f2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:50.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.265+0000 7f6342ac0740 1 --2- 172.21.15.3:0/570518904 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56427f1d21d0 0x56427f1f2c60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f632c0a9640 tx=0x7f632c009820 comp rx=0 tx=0).stop 2024-09-10T23:27:50.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.265+0000 7f6342ac0740 1 -- 172.21.15.3:0/570518904 shutdown_connections 2024-09-10T23:27:50.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.265+0000 7f6342ac0740 1 --2- 172.21.15.3:0/570518904 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56427f1dea80 0x56427f1dd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.265+0000 7f6342ac0740 1 --2- 172.21.15.3:0/570518904 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56427f1d2af0 0x56427f1da220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.265+0000 7f6342ac0740 1 --2- 172.21.15.3:0/570518904 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56427f1d21d0 0x56427f1f2c60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.265+0000 7f6342ac0740 1 -- 172.21.15.3:0/570518904 >> 172.21.15.3:0/570518904 conn(0x56427f1d0000 msgr2=0x56427f1dcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:50.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.265+0000 7f6342ac0740 1 -- 172.21.15.3:0/570518904 shutdown_connections 2024-09-10T23:27:50.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.265+0000 7f6342ac0740 1 -- 172.21.15.3:0/570518904 wait complete. 2024-09-10T23:27:50.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.266+0000 7f6342ac0740 1 -- start start 2024-09-10T23:27:50.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.266+0000 7f6342ac0740 1 Processor -- start 2024-09-10T23:27:50.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.266+0000 7f6342ac0740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56427f1d21d0 0x56427f1ea470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:50.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.266+0000 7f6342ac0740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56427f1d2af0 0x56427f1ea9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:50.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.266+0000 7f6342ac0740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56427f1dea80 0x56427f1eaef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:50.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.266+0000 7f6342ac0740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f631800e520 con 0x56427f1dea80 2024-09-10T23:27:50.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.266+0000 7f6342ac0740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f631800f990 con 0x56427f1d2af0 2024-09-10T23:27:50.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.266+0000 7f6342ac0740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f631800ebf0 con 0x56427f1d21d0 2024-09-10T23:27:50.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.266+0000 7f6342ac0740 10 client.0 _ll_register_callbacks cb 0x7f632c0e35e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:50.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.267+0000 7f633d600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56427f1d21d0 0x56427f1ea470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:50.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.267+0000 7f633d600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56427f1d21d0 0x56427f1ea470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.3:46124/0 (socket says 172.21.15.3:46124) 2024-09-10T23:27:50.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.267+0000 7f633d600640 1 -- 172.21.15.3:0/1592671155 learned_addr learned my addr 172.21.15.3:0/1592671155 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:27:50.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.267+0000 7f633e000640 1 --2- 172.21.15.3:0/1592671155 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56427f1dea80 0x56427f1eaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:50.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.267+0000 7f633cc00640 1 --2- 172.21.15.3:0/1592671155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56427f1d2af0 0x56427f1ea9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:50.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.268+0000 7f633cc00640 1 -- 172.21.15.3:0/1592671155 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56427f1d21d0 msgr2=0x56427f1ea470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:50.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.268+0000 7f633cc00640 1 --2- 172.21.15.3:0/1592671155 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56427f1d21d0 0x56427f1ea470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.268+0000 7f633cc00640 1 -- 172.21.15.3:0/1592671155 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56427f1dea80 msgr2=0x56427f1eaef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:50.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.268+0000 7f633cc00640 1 --2- 172.21.15.3:0/1592671155 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56427f1dea80 0x56427f1eaef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.268+0000 7f633cc00640 1 -- 172.21.15.3:0/1592671155 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56427f1da900 con 0x56427f1d2af0 2024-09-10T23:27:50.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.268+0000 7f633d600640 1 --2- 172.21.15.3:0/1592671155 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56427f1d21d0 0x56427f1ea470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:27:50.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.268+0000 7f633e000640 1 --2- 172.21.15.3:0/1592671155 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56427f1dea80 0x56427f1eaef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:50.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.268+0000 7f633cc00640 1 --2- 172.21.15.3:0/1592671155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56427f1d2af0 0x56427f1ea9b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f63240095f0 tx=0x7f632403c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1721f6e31162998 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:50.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.268+0000 7f631ea00640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-10T23:27:50.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.269+0000 7f631ea00640 1 -- 172.21.15.3:0/1592671155 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6324037040 con 0x56427f1d2af0 2024-09-10T23:27:50.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.269+0000 7f631ea00640 1 -- 172.21.15.3:0/1592671155 <== mon.2 v2:172.21.15.38:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f6324003800 con 0x56427f1d2af0 2024-09-10T23:27:50.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.269+0000 7f6342ac0740 1 -- 172.21.15.3:0/1592671155 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f632c0ac3d0 con 0x56427f1d2af0 2024-09-10T23:27:50.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.270+0000 7f631ea00640 1 -- 172.21.15.3:0/1592671155 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6324003a00 con 0x56427f1d2af0 2024-09-10T23:27:50.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.270+0000 7f6342ac0740 10 client.35480 fetch_fsmap learned FSMap version 26 2024-09-10T23:27:50.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.270+0000 7f6342ac0740 1 -- 172.21.15.3:0/1592671155 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56427f1d16e0 con 0x56427f1d2af0 2024-09-10T23:27:50.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.270+0000 7f631ea00640 1 -- 172.21.15.3:0/1592671155 <== mon.2 v2:172.21.15.38:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f632c0ac3d0 con 0x56427f1d2af0 2024-09-10T23:27:50.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.270+0000 7f631ea00640 1 -- 172.21.15.3:0/1592671155 <== mon.2 v2:172.21.15.38:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f6324057070 con 0x56427f1d2af0 2024-09-10T23:27:50.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.271+0000 7f6342ac0740 10 client.35480 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:27:50.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.271+0000 7f6342ac0740 10 client.35480 resolve_mds: validated gid 34724 aka daemon mds.b 2024-09-10T23:27:50.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.271+0000 7f6342ac0740 20 client.35480 populate_metadata read hostname 'smithi003' 2024-09-10T23:27:50.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.271+0000 7f6342ac0740 1 --2- 172.21.15.3:0/1592671155 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x56427f26dcc0 0x56427f2700e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:50.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.271+0000 7f6342ac0740 4 client.35480 mds_command: new command op to 34724 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "b3413b26", "release": true, "await": true}] 2024-09-10T23:27:50.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.271+0000 7f6342ac0740 1 -- 172.21.15.3:0/1592671155 --> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] -- command(tid 0: {"prefix": "quiesce db", "set_id": "b3413b26", "release": true, "await": true}) -- 0x56427f146c90 con 0x56427f26dcc0 2024-09-10T23:27:50.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.271+0000 7f633d600640 1 --2- 172.21.15.3:0/1592671155 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x56427f26dcc0 0x56427f2700e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:50.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.272+0000 7f633d600640 1 --2- 172.21.15.3:0/1592671155 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x56427f26dcc0 0x56427f2700e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36e99d7beb1eb578 server_cookie=eac6c46f13fd580b in_seq=0 out_seq=0 2024-09-10T23:27:50.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.272+0000 7f631ea00640 10 client.35480 ms_handle_connect on v2:172.21.15.38:6838/458259815 2024-09-10T23:27:50.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.274+0000 7f631ea00640 1 -- 172.21.15.3:0/1592671155 <== mds.0 v2:172.21.15.38:6838/458259815 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x56427f146c90 con 0x56427f26dcc0 2024-09-10T23:27:50.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.275+0000 7f631ea00640 10 client.35480 handle_command_reply: tid=0 2024-09-10T23:27:50.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.275+0000 7f6342ac0740 1 client.35480 shutdown 2024-09-10T23:27:50.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.275+0000 7f6342ac0740 1 -- 172.21.15.3:0/1592671155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56427f1d2af0 msgr2=0x56427f1ea9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:50.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.275+0000 7f6342ac0740 1 --2- 172.21.15.3:0/1592671155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56427f1d2af0 0x56427f1ea9b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f63240095f0 tx=0x7f632403c000 comp rx=0 tx=0).stop 2024-09-10T23:27:50.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.275+0000 7f6342ac0740 1 -- 172.21.15.3:0/1592671155 shutdown_connections 2024-09-10T23:27:50.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.275+0000 7f6342ac0740 1 --2- 172.21.15.3:0/1592671155 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x56427f26dcc0 0x56427f2700e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.275+0000 7f631ea00640 0 client.35480 ms_handle_reset on v2:172.21.15.38:6838/458259815 2024-09-10T23:27:50.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.275+0000 7f6342ac0740 1 --2- 172.21.15.3:0/1592671155 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56427f1dea80 0x56427f1eaef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.275+0000 7f6342ac0740 1 --2- 172.21.15.3:0/1592671155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56427f1d2af0 0x56427f1ea9b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.275+0000 7f6342ac0740 1 --2- 172.21.15.3:0/1592671155 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56427f1d21d0 0x56427f1ea470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.275+0000 7f6342ac0740 1 -- 172.21.15.3:0/1592671155 >> 172.21.15.3:0/1592671155 conn(0x56427f1d0000 msgr2=0x56427f1dcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:50.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.275+0000 7f6342ac0740 1 -- 172.21.15.3:0/1592671155 shutdown_connections 2024-09-10T23:27:50.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.275+0000 7f6342ac0740 1 -- 172.21.15.3:0/1592671155 wait complete. 2024-09-10T23:27:50.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.276+0000 7f6342ac0740 20 client.35480 trim_cache size 0 max 16384 2024-09-10T23:27:50.282 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-10T23:27:50.282 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 26, 2024-09-10T23:27:50.282 INFO:teuthology.orchestra.run.smithi003.stdout: "leader": 34724, 2024-09-10T23:27:50.283 INFO:teuthology.orchestra.run.smithi003.stdout: "set_version": 4, 2024-09-10T23:27:50.283 INFO:teuthology.orchestra.run.smithi003.stdout: "sets": { 2024-09-10T23:27:50.283 INFO:teuthology.orchestra.run.smithi003.stdout: "b3413b26": { 2024-09-10T23:27:50.283 INFO:teuthology.orchestra.run.smithi003.stdout: "version": 4, 2024-09-10T23:27:50.283 INFO:teuthology.orchestra.run.smithi003.stdout: "age_ref": 0.0, 2024-09-10T23:27:50.283 INFO:teuthology.orchestra.run.smithi003.stdout: "state": { 2024-09-10T23:27:50.283 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "RELEASED", 2024-09-10T23:27:50.283 INFO:teuthology.orchestra.run.smithi003.stdout: "age": 0.0 2024-09-10T23:27:50.283 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:27:50.283 INFO:teuthology.orchestra.run.smithi003.stdout: "timeout": 90.0, 2024-09-10T23:27:50.283 INFO:teuthology.orchestra.run.smithi003.stdout: "expiration": 145.2, 2024-09-10T23:27:50.283 INFO:teuthology.orchestra.run.smithi003.stdout: "members": { 2024-09-10T23:27:50.283 INFO:teuthology.orchestra.run.smithi003.stdout: "file:/": { 2024-09-10T23:27:50.284 INFO:teuthology.orchestra.run.smithi003.stdout: "excluded": false, 2024-09-10T23:27:50.284 INFO:teuthology.orchestra.run.smithi003.stdout: "state": { 2024-09-10T23:27:50.284 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "RELEASED", 2024-09-10T23:27:50.284 INFO:teuthology.orchestra.run.smithi003.stdout: "age": 0.0 2024-09-10T23:27:50.284 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:27:50.284 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:27:50.284 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:27:50.284 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:27:50.284 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:27:50.284 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-10T23:27:50.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.276+0000 7f633ea00640 1 -- 172.21.15.3:0/3286933200 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f63200b5510 msgr2=0x7f63200b79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:50.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.276+0000 7f633ea00640 1 --2- 172.21.15.3:0/3286933200 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f63200b5510 0x7f63200b79d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6324005cd0 tx=0x7f6324005f90 comp rx=0 tx=0).stop 2024-09-10T23:27:50.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.277+0000 7f633ea00640 1 -- 172.21.15.3:0/3286933200 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6338104e10 msgr2=0x7f633819b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:50.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.277+0000 7f633ea00640 1 --2- 172.21.15.3:0/3286933200 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6338104e10 0x7f633819b170 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f632c005fd0 tx=0x7f632c00ee50 comp rx=0 tx=0).stop 2024-09-10T23:27:50.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.277+0000 7f633ea00640 1 -- 172.21.15.3:0/3286933200 shutdown_connections 2024-09-10T23:27:50.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.277+0000 7f633ea00640 1 --2- 172.21.15.3:0/3286933200 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f63200b5510 0x7f63200b79d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.277+0000 7f633ea00640 1 --2- 172.21.15.3:0/3286933200 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f633810b1a0 0x7f63381a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.277+0000 7f633ea00640 1 --2- 172.21.15.3:0/3286933200 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f633810a820 0x7f633819b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.277+0000 7f633ea00640 1 --2- 172.21.15.3:0/3286933200 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6338104e10 0x7f633819b170 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.277+0000 7f633ea00640 1 -- 172.21.15.3:0/3286933200 >> 172.21.15.3:0/3286933200 conn(0x7f6338100840 msgr2=0x7f6338102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:50.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.277+0000 7f633ea00640 1 -- 172.21.15.3:0/3286933200 shutdown_connections 2024-09-10T23:27:50.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:27:50.277+0000 7f633ea00640 1 -- 172.21.15.3:0/3286933200 wait complete. 2024-09-10T23:27:50.657 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:50 smithi003 ceph-mon[30348]: pgmap v422: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-09-10T23:27:50.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:50 smithi038 ceph-mon[34225]: pgmap v422: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-09-10T23:27:50.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:50 smithi194 ceph-mon[33904]: pgmap v422: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-09-10T23:27:51.076 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'b3413b26', total seconds elapsed: 29.7 2024-09-10T23:27:52.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:52 smithi003 ceph-mon[30348]: pgmap v423: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-10T23:27:52.749 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:52 smithi194 ceph-mon[33904]: pgmap v423: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-10T23:27:52.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:52 smithi038 ceph-mon[34225]: pgmap v423: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-10T23:27:54.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:54 smithi038 ceph-mon[34225]: pgmap v424: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-10T23:27:54.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:54 smithi038 ceph-mon[34225]: mgrmap e26: x(active, since 11m), standbys: z, y 2024-09-10T23:27:54.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:54 smithi194 ceph-mon[33904]: pgmap v424: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-10T23:27:54.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:54 smithi194 ceph-mon[33904]: mgrmap e26: x(active, since 11m), standbys: z, y 2024-09-10T23:27:54.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:54 smithi003 ceph-mon[30348]: pgmap v424: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-10T23:27:54.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:54 smithi003 ceph-mon[30348]: mgrmap e26: x(active, since 11m), standbys: z, y 2024-09-10T23:27:56.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:56 smithi038 ceph-mon[34225]: pgmap v425: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-10T23:27:56.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:56 smithi194 ceph-mon[33904]: pgmap v425: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-10T23:27:56.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:56 smithi003 ceph-mon[30348]: pgmap v425: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-10T23:27:58.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:27:58 smithi038 ceph-mon[34225]: pgmap v426: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-10T23:27:58.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:27:58 smithi194 ceph-mon[33904]: pgmap v426: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-10T23:27:58.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:27:58 smithi003 ceph-mon[30348]: pgmap v426: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-10T23:27:59.301 INFO:tasks.workunit.client.0.smithi003.stderr:Updating files: 63% (7686/12088) Updating files: 64% (7737/12088) Updating files: 65% (7858/12088) Updating files: 66% (7979/12088) Updating files: 67% (8099/12088) Updating files: 68% (8220/12088) Updating files: 69% (8341/12088) Updating files: 70% (8462/12088) Updating files: 71% (8583/12088) Updating files: 72% (8704/12088) Updating files: 73% (8825/12088) Updating files: 74% (8946/12088) Updating files: 75% (9066/12088) Updating files: 76% (9187/12088) Updating files: 77% (9308/12088) Updating files: 78% (9429/12088) Updating files: 79% (9550/12088) Updating files: 80% (9671/12088) Updating files: 81% (9792/12088) Updating files: 82% (9913/12088) Updating files: 83% (10034/12088) Updating files: 84% (10154/12088) Updating files: 85% (10275/12088) Updating files: 86% (10396/12088) Updating files: 87% (10517/12088) Updating files: 88% (10638/12088) Updating files: 89% (10759/12088) Updating files: 90% (10880/12088) Updating files: 91% (11001/12088) Updating files: 92% (11121/12088) Updating files: 93% (11242/12088) Updating files: 94% (11363/12088) Updating files: 95% (11484/12088) Updating files: 96% (11605/12088) Updating files: 97% (11726/12088) Updating files: 98% (11847/12088) Updating files: 99% (11968/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-09-10T23:28:00.392 INFO:tasks.workunit.client.0.smithi003.stderr:Note: switching to '8f219c476cb4f26fc5719c661c0323719a45cb30'. 2024-09-10T23:28:00.392 INFO:tasks.workunit.client.0.smithi003.stderr: 2024-09-10T23:28:00.392 INFO:tasks.workunit.client.0.smithi003.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-10T23:28:00.392 INFO:tasks.workunit.client.0.smithi003.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-10T23:28:00.392 INFO:tasks.workunit.client.0.smithi003.stderr:state without impacting any branches by switching back to a branch. 2024-09-10T23:28:00.392 INFO:tasks.workunit.client.0.smithi003.stderr: 2024-09-10T23:28:00.392 INFO:tasks.workunit.client.0.smithi003.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-10T23:28:00.392 INFO:tasks.workunit.client.0.smithi003.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-10T23:28:00.392 INFO:tasks.workunit.client.0.smithi003.stderr: 2024-09-10T23:28:00.392 INFO:tasks.workunit.client.0.smithi003.stderr: git switch -c 2024-09-10T23:28:00.393 INFO:tasks.workunit.client.0.smithi003.stderr: 2024-09-10T23:28:00.393 INFO:tasks.workunit.client.0.smithi003.stderr:Or undo this operation with: 2024-09-10T23:28:00.393 INFO:tasks.workunit.client.0.smithi003.stderr: 2024-09-10T23:28:00.393 INFO:tasks.workunit.client.0.smithi003.stderr: git switch - 2024-09-10T23:28:00.393 INFO:tasks.workunit.client.0.smithi003.stderr: 2024-09-10T23:28:00.393 INFO:tasks.workunit.client.0.smithi003.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-10T23:28:00.393 INFO:tasks.workunit.client.0.smithi003.stderr: 2024-09-10T23:28:00.393 INFO:tasks.workunit.client.0.smithi003.stderr:HEAD is now at 8f219c476cb Merge branch 'mgr-vol-mod-disable' of https://github.com/rishabh-d-dave/ceph into wip-hemanth-testing-2024-09-10-0723 2024-09-10T23:28:00.404 DEBUG:teuthology.orchestra.run.smithi003:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-10T23:28:00.452 INFO:tasks.workunit.client.0.smithi003.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-10T23:28:00.457 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T23:28:00.457 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-10T23:28:00.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:00 smithi038 ceph-mon[34225]: pgmap v427: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-10T23:28:00.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:00 smithi194 ceph-mon[33904]: pgmap v427: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-10T23:28:00.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:00 smithi003 ceph-mon[30348]: pgmap v427: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-10T23:28:01.133 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-10T23:28:01.246 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-10T23:28:01.312 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T23:28:01.316 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T23:28:01.316 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-10T23:28:01.382 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T23:28:01.389 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-10T23:28:01.389 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-10T23:28:01.425 INFO:tasks.workunit:Running workunits matching suites/fsync-tester.sh on client.0... 2024-09-10T23:28:01.426 INFO:tasks.workunit:Running workunit suites/fsync-tester.sh... 2024-09-10T23:28:01.427 DEBUG:teuthology.orchestra.run.smithi003:workunit test suites/fsync-tester.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8f219c476cb4f26fc5719c661c0323719a45cb30 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2024-09-10T23:28:01.527 INFO:tasks.workunit.client.0.smithi003.stderr:+ wget http://download.ceph.com/qa/fsync-tester.c 2024-09-10T23:28:01.600 INFO:tasks.workunit.client.0.smithi003.stderr:--2024-09-10 23:28:01-- http://download.ceph.com/qa/fsync-tester.c 2024-09-10T23:28:01.609 INFO:tasks.workunit.client.0.smithi003.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-09-10T23:28:01.630 INFO:tasks.workunit.client.0.smithi003.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-09-10T23:28:01.651 INFO:tasks.workunit.client.0.smithi003.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-10T23:28:01.652 INFO:tasks.workunit.client.0.smithi003.stderr:Length: 3024 (3.0K) [application/octet-stream] 2024-09-10T23:28:01.655 INFO:tasks.workunit.client.0.smithi003.stderr:Saving to: ‘fsync-tester.c’ 2024-09-10T23:28:01.660 INFO:tasks.workunit.client.0.smithi003.stderr: 2024-09-10T23:28:01.660 INFO:tasks.workunit.client.0.smithi003.stderr: 0K .. 100% 289M=0s 2024-09-10T23:28:01.660 INFO:tasks.workunit.client.0.smithi003.stderr: 2024-09-10T23:28:01.661 INFO:tasks.workunit.client.0.smithi003.stderr:2024-09-10 23:28:01 (289 MB/s) - ‘fsync-tester.c’ saved [3024/3024] 2024-09-10T23:28:01.661 INFO:tasks.workunit.client.0.smithi003.stderr: 2024-09-10T23:28:01.661 INFO:tasks.workunit.client.0.smithi003.stderr:+ gcc -D_GNU_SOURCE fsync-tester.c -o fsync-tester 2024-09-10T23:28:01.791 INFO:tasks.workunit.client.0.smithi003.stderr:+ ./fsync-tester 2024-09-10T23:28:02.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:02 smithi038 ceph-mon[34225]: pgmap v428: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-10T23:28:02.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:02 smithi194 ceph-mon[33904]: pgmap v428: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-10T23:28:02.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:02 smithi003 ceph-mon[30348]: pgmap v428: 129 pgs: 129 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-10T23:28:04.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:04 smithi038 ceph-mon[34225]: pgmap v429: 129 pgs: 129 active+clean; 5.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 367 KiB/s wr, 24 op/s 2024-09-10T23:28:04.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:04 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:28:04.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:04 smithi194 ceph-mon[33904]: pgmap v429: 129 pgs: 129 active+clean; 5.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 367 KiB/s wr, 24 op/s 2024-09-10T23:28:04.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:04 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:28:04.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:04 smithi003 ceph-mon[30348]: pgmap v429: 129 pgs: 129 active+clean; 5.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 367 KiB/s wr, 24 op/s 2024-09-10T23:28:04.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:04 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:28:05.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:05 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:28:05.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:05 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:28:05.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:05 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:28:05.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:05 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:28:05.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:05 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:28:05.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:05 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:28:05.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:05 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:28:05.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:05 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:28:05.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:05 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:28:06.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:06 smithi038 ceph-mon[34225]: pgmap v430: 129 pgs: 129 active+clean; 9.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 708 KiB/s wr, 21 op/s 2024-09-10T23:28:06.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:06 smithi194 ceph-mon[33904]: pgmap v430: 129 pgs: 129 active+clean; 9.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 708 KiB/s wr, 21 op/s 2024-09-10T23:28:06.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:06 smithi003 ceph-mon[30348]: pgmap v430: 129 pgs: 129 active+clean; 9.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 708 KiB/s wr, 21 op/s 2024-09-10T23:28:08.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:08 smithi038 ceph-mon[34225]: pgmap v431: 129 pgs: 129 active+clean; 17 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.4 MiB/s wr, 23 op/s 2024-09-10T23:28:08.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:08 smithi194 ceph-mon[33904]: pgmap v431: 129 pgs: 129 active+clean; 17 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.4 MiB/s wr, 23 op/s 2024-09-10T23:28:08.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:08 smithi003 ceph-mon[30348]: pgmap v431: 129 pgs: 129 active+clean; 17 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.4 MiB/s wr, 23 op/s 2024-09-10T23:28:10.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:10 smithi038 ceph-mon[34225]: pgmap v432: 129 pgs: 129 active+clean; 77 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.4 MiB/s wr, 24 op/s 2024-09-10T23:28:10.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:10 smithi194 ceph-mon[33904]: pgmap v432: 129 pgs: 129 active+clean; 77 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.4 MiB/s wr, 24 op/s 2024-09-10T23:28:10.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:10 smithi003 ceph-mon[30348]: pgmap v432: 129 pgs: 129 active+clean; 77 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.4 MiB/s wr, 24 op/s 2024-09-10T23:28:12.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:12 smithi038 ceph-mon[34225]: pgmap v433: 129 pgs: 129 active+clean; 85 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.0 MiB/s wr, 23 op/s 2024-09-10T23:28:12.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:12 smithi194 ceph-mon[33904]: pgmap v433: 129 pgs: 129 active+clean; 85 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.0 MiB/s wr, 23 op/s 2024-09-10T23:28:12.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:12 smithi003 ceph-mon[30348]: pgmap v433: 129 pgs: 129 active+clean; 85 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.0 MiB/s wr, 23 op/s 2024-09-10T23:28:14.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:14 smithi038 ceph-mon[34225]: pgmap v434: 129 pgs: 129 active+clean; 142 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 27 op/s 2024-09-10T23:28:14.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:14 smithi194 ceph-mon[33904]: pgmap v434: 129 pgs: 129 active+clean; 142 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 27 op/s 2024-09-10T23:28:14.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:14 smithi003 ceph-mon[30348]: pgmap v434: 129 pgs: 129 active+clean; 142 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 27 op/s 2024-09-10T23:28:16.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:16 smithi038 ceph-mon[34225]: pgmap v435: 129 pgs: 129 active+clean; 162 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 13 MiB/s wr, 10 op/s 2024-09-10T23:28:16.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:16 smithi194 ceph-mon[33904]: pgmap v435: 129 pgs: 129 active+clean; 162 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 13 MiB/s wr, 10 op/s 2024-09-10T23:28:16.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:16 smithi003 ceph-mon[30348]: pgmap v435: 129 pgs: 129 active+clean; 162 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 13 MiB/s wr, 10 op/s 2024-09-10T23:28:18.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:18 smithi038 ceph-mon[34225]: pgmap v436: 129 pgs: 129 active+clean; 178 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 11 op/s 2024-09-10T23:28:18.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:18 smithi194 ceph-mon[33904]: pgmap v436: 129 pgs: 129 active+clean; 178 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 11 op/s 2024-09-10T23:28:18.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:18 smithi003 ceph-mon[30348]: pgmap v436: 129 pgs: 129 active+clean; 178 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 11 op/s 2024-09-10T23:28:20.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:20 smithi038 ceph-mon[34225]: pgmap v437: 129 pgs: 129 active+clean; 238 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 18 MiB/s wr, 11 op/s 2024-09-10T23:28:20.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:20 smithi194 ceph-mon[33904]: pgmap v437: 129 pgs: 129 active+clean; 238 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 18 MiB/s wr, 11 op/s 2024-09-10T23:28:20.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:20 smithi003 ceph-mon[30348]: pgmap v437: 129 pgs: 129 active+clean; 238 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 18 MiB/s wr, 11 op/s 2024-09-10T23:28:22.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:22 smithi038 ceph-mon[34225]: pgmap v438: 129 pgs: 129 active+clean; 251 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 15 MiB/s wr, 43 op/s 2024-09-10T23:28:22.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:22 smithi194 ceph-mon[33904]: pgmap v438: 129 pgs: 129 active+clean; 251 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 15 MiB/s wr, 43 op/s 2024-09-10T23:28:22.973 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:22 smithi003 ceph-mon[30348]: pgmap v438: 129 pgs: 129 active+clean; 251 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 15 MiB/s wr, 43 op/s 2024-09-10T23:28:24.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:24 smithi038 ceph-mon[34225]: pgmap v439: 129 pgs: 129 active+clean; 259 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 489 op/s 2024-09-10T23:28:24.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:24 smithi194 ceph-mon[33904]: pgmap v439: 129 pgs: 129 active+clean; 259 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 489 op/s 2024-09-10T23:28:24.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:24 smithi003 ceph-mon[30348]: pgmap v439: 129 pgs: 129 active+clean; 259 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 489 op/s 2024-09-10T23:28:26.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:26 smithi038 ceph-mon[34225]: pgmap v440: 129 pgs: 129 active+clean; 259 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 MiB/s wr, 673 op/s 2024-09-10T23:28:26.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:26 smithi194 ceph-mon[33904]: pgmap v440: 129 pgs: 129 active+clean; 259 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 MiB/s wr, 673 op/s 2024-09-10T23:28:26.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:26 smithi003 ceph-mon[30348]: pgmap v440: 129 pgs: 129 active+clean; 259 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 MiB/s wr, 673 op/s 2024-09-10T23:28:28.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:28 smithi038 ceph-mon[34225]: pgmap v441: 129 pgs: 129 active+clean; 259 MiB data, 602 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 794 op/s 2024-09-10T23:28:28.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:28 smithi194 ceph-mon[33904]: pgmap v441: 129 pgs: 129 active+clean; 259 MiB data, 602 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 794 op/s 2024-09-10T23:28:28.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:28 smithi003 ceph-mon[30348]: pgmap v441: 129 pgs: 129 active+clean; 259 MiB data, 602 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 794 op/s 2024-09-10T23:28:30.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:30 smithi038 ceph-mon[34225]: pgmap v442: 129 pgs: 129 active+clean; 259 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 1.47k op/s 2024-09-10T23:28:30.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:30 smithi194 ceph-mon[33904]: pgmap v442: 129 pgs: 129 active+clean; 259 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 1.47k op/s 2024-09-10T23:28:30.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:30 smithi003 ceph-mon[30348]: pgmap v442: 129 pgs: 129 active+clean; 259 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 1.47k op/s 2024-09-10T23:28:32.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:32 smithi038 ceph-mon[34225]: pgmap v443: 129 pgs: 129 active+clean; 259 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.3 MiB/s wr, 1.60k op/s 2024-09-10T23:28:32.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:32 smithi194 ceph-mon[33904]: pgmap v443: 129 pgs: 129 active+clean; 259 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.3 MiB/s wr, 1.60k op/s 2024-09-10T23:28:32.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:32 smithi003 ceph-mon[30348]: pgmap v443: 129 pgs: 129 active+clean; 259 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.3 MiB/s wr, 1.60k op/s 2024-09-10T23:28:34.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:34 smithi038 ceph-mon[34225]: pgmap v444: 129 pgs: 129 active+clean; 259 MiB data, 788 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 MiB/s wr, 2.12k op/s 2024-09-10T23:28:34.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:34 smithi194 ceph-mon[33904]: pgmap v444: 129 pgs: 129 active+clean; 259 MiB data, 788 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 MiB/s wr, 2.12k op/s 2024-09-10T23:28:34.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:34 smithi003 ceph-mon[30348]: pgmap v444: 129 pgs: 129 active+clean; 259 MiB data, 788 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 MiB/s wr, 2.12k op/s 2024-09-10T23:28:36.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:36 smithi038 ceph-mon[34225]: pgmap v445: 129 pgs: 129 active+clean; 259 MiB data, 845 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.0 MiB/s wr, 1.87k op/s 2024-09-10T23:28:36.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:36 smithi194 ceph-mon[33904]: pgmap v445: 129 pgs: 129 active+clean; 259 MiB data, 845 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.0 MiB/s wr, 1.87k op/s 2024-09-10T23:28:36.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:36 smithi003 ceph-mon[30348]: pgmap v445: 129 pgs: 129 active+clean; 259 MiB data, 845 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.0 MiB/s wr, 1.87k op/s 2024-09-10T23:28:37.877 INFO:tasks.quiescer.fs.[cephfs]:Total duration (41.0) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-10T23:28:37.877 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.5 2024-09-10T23:28:37.878 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:28:38.536 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:28:38.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:38 smithi038 ceph-mon[34225]: pgmap v446: 129 pgs: 129 active+clean; 259 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.3 MiB/s wr, 1.80k op/s 2024-09-10T23:28:38.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:38 smithi194 ceph-mon[33904]: pgmap v446: 129 pgs: 129 active+clean; 259 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.3 MiB/s wr, 1.80k op/s 2024-09-10T23:28:38.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:38 smithi003 ceph-mon[30348]: pgmap v446: 129 pgs: 129 active+clean; 259 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.3 MiB/s wr, 1.80k op/s 2024-09-10T23:28:40.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:40 smithi038 ceph-mon[34225]: pgmap v447: 129 pgs: 129 active+clean; 259 MiB data, 977 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 2.33k op/s 2024-09-10T23:28:40.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:40 smithi194 ceph-mon[33904]: pgmap v447: 129 pgs: 129 active+clean; 259 MiB data, 977 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 2.33k op/s 2024-09-10T23:28:40.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:40 smithi003 ceph-mon[30348]: pgmap v447: 129 pgs: 129 active+clean; 259 MiB data, 977 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 2.33k op/s 2024-09-10T23:28:42.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:42 smithi038 ceph-mon[34225]: pgmap v448: 129 pgs: 129 active+clean; 259 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.6 MiB/s wr, 1.78k op/s 2024-09-10T23:28:42.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:42 smithi194 ceph-mon[33904]: pgmap v448: 129 pgs: 129 active+clean; 259 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.6 MiB/s wr, 1.78k op/s 2024-09-10T23:28:42.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:42 smithi003 ceph-mon[30348]: pgmap v448: 129 pgs: 129 active+clean; 259 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.6 MiB/s wr, 1.78k op/s 2024-09-10T23:28:44.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:44 smithi194 ceph-mon[33904]: pgmap v449: 129 pgs: 129 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.8 MiB/s wr, 2.16k op/s 2024-09-10T23:28:44.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:44 smithi003 ceph-mon[30348]: pgmap v449: 129 pgs: 129 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.8 MiB/s wr, 2.16k op/s 2024-09-10T23:28:45.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:44 smithi038 ceph-mon[34225]: pgmap v449: 129 pgs: 129 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.8 MiB/s wr, 2.16k op/s 2024-09-10T23:28:46.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.154+0000 7f8b15200640 1 -- 172.21.15.3:0/2323699725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b10104fa0 msgr2=0x7f8b10105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:46.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.154+0000 7f8b15200640 1 --2- 172.21.15.3:0/2323699725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b10104fa0 0x7f8b10105380 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8af8009860 tx=0x7f8af802a340 comp rx=0 tx=0).stop 2024-09-10T23:28:46.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.158+0000 7f8b15200640 1 -- 172.21.15.3:0/2323699725 shutdown_connections 2024-09-10T23:28:46.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.158+0000 7f8b15200640 1 --2- 172.21.15.3:0/2323699725 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b1010b330 0x7f8b10111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:46.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.158+0000 7f8b15200640 1 --2- 172.21.15.3:0/2323699725 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1010a9b0 0x7f8b1010adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:46.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.158+0000 7f8b15200640 1 --2- 172.21.15.3:0/2323699725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b10104fa0 0x7f8b10105380 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:46.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.158+0000 7f8b15200640 1 -- 172.21.15.3:0/2323699725 >> 172.21.15.3:0/2323699725 conn(0x7f8b10100a50 msgr2=0x7f8b10102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:46.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.159+0000 7f8b15200640 1 -- 172.21.15.3:0/2323699725 shutdown_connections 2024-09-10T23:28:46.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.159+0000 7f8b15200640 1 -- 172.21.15.3:0/2323699725 wait complete. 2024-09-10T23:28:46.162 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.161+0000 7f8b15200640 1 Processor -- start 2024-09-10T23:28:46.162 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.161+0000 7f8b15200640 1 -- start start 2024-09-10T23:28:46.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.162+0000 7f8b15200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b10104fa0 0x7f8b1019b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:46.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.162+0000 7f8b15200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b1010a9b0 0x7f8b1019b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:46.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.162+0000 7f8b15200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1010b330 0x7f8b101a0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:46.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.162+0000 7f8b15200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8b10114df0 con 0x7f8b1010a9b0 2024-09-10T23:28:46.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.162+0000 7f8b15200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f8b10114c70 con 0x7f8b1010b330 2024-09-10T23:28:46.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.162+0000 7f8b15200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8b10114f70 con 0x7f8b10104fa0 2024-09-10T23:28:46.166 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.163+0000 7f8b0d400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b1010a9b0 0x7f8b1019b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:46.166 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.163+0000 7f8b0d400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b1010a9b0 0x7f8b1019b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38068/0 (socket says 172.21.15.3:38068) 2024-09-10T23:28:46.166 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.163+0000 7f8b0d400640 1 -- 172.21.15.3:0/3728020785 learned_addr learned my addr 172.21.15.3:0/3728020785 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:28:46.166 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.164+0000 7f8b0e800640 1 --2- 172.21.15.3:0/3728020785 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1010b330 0x7f8b101a0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:46.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.164+0000 7f8b0d400640 1 -- 172.21.15.3:0/3728020785 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b10104fa0 msgr2=0x7f8b1019b3a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T23:28:46.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.164+0000 7f8b0d400640 1 --2- 172.21.15.3:0/3728020785 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b10104fa0 0x7f8b1019b3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:46.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.164+0000 7f8b0d400640 1 -- 172.21.15.3:0/3728020785 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1010b330 msgr2=0x7f8b101a0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:46.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.164+0000 7f8b0d400640 1 --2- 172.21.15.3:0/3728020785 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1010b330 0x7f8b101a0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:46.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.164+0000 7f8b0d400640 1 -- 172.21.15.3:0/3728020785 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b101a1450 con 0x7f8b1010a9b0 2024-09-10T23:28:46.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.165+0000 7f8b0d400640 1 --2- 172.21.15.3:0/3728020785 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b1010a9b0 0x7f8b1019b8e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8b0000e9c0 tx=0x7f8b0000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:46.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.165+0000 7f8b06a00640 1 -- 172.21.15.3:0/3728020785 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0000cde0 con 0x7f8b1010a9b0 2024-09-10T23:28:46.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.166+0000 7f8b15200640 1 -- 172.21.15.3:0/3728020785 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b101a1740 con 0x7f8b1010a9b0 2024-09-10T23:28:46.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.166+0000 7f8b15200640 1 -- 172.21.15.3:0/3728020785 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b101a7e00 con 0x7f8b1010a9b0 2024-09-10T23:28:46.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.168+0000 7f8b06a00640 1 -- 172.21.15.3:0/3728020785 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8b000035f0 con 0x7f8b1010a9b0 2024-09-10T23:28:46.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.168+0000 7f8b06a00640 1 -- 172.21.15.3:0/3728020785 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b00010690 con 0x7f8b1010a9b0 2024-09-10T23:28:46.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.170+0000 7f8b15200640 1 -- 172.21.15.3:0/3728020785 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8aec0052c0 con 0x7f8b1010a9b0 2024-09-10T23:28:46.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.174+0000 7f8b06a00640 1 -- 172.21.15.3:0/3728020785 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 26) ==== 153380+0+0 (secure 0 0 0) 0x7f8b00004000 con 0x7f8b1010a9b0 2024-09-10T23:28:46.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.176+0000 7f8b06a00640 1 --2- 172.21.15.3:0/3728020785 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f8af40b55a0 0x7f8af40b7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:46.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.176+0000 7f8b06a00640 1 -- 172.21.15.3:0/3728020785 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f8b000e63e0 con 0x7f8b1010a9b0 2024-09-10T23:28:46.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.178+0000 7f8b0de00640 1 --2- 172.21.15.3:0/3728020785 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f8af40b55a0 0x7f8af40b7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:46.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.181+0000 7f8b0de00640 1 --2- 172.21.15.3:0/3728020785 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f8af40b55a0 0x7f8af40b7a60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8af80095f0 tx=0x7f8af8005c90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:46.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.182+0000 7f8b06a00640 1 -- 172.21.15.3:0/3728020785 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8b000acc70 con 0x7f8b1010a9b0 2024-09-10T23:28:46.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.641+0000 7f8b15200640 1 -- 172.21.15.3:0/3728020785 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8aec0055b0 con 0x7f8b1010a9b0 2024-09-10T23:28:46.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.642+0000 7f8b06a00640 1 -- 172.21.15.3:0/3728020785 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11891 (secure 0 0 0) 0x7f8b000ac570 con 0x7f8b1010a9b0 2024-09-10T23:28:46.644 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:28:46.644 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 26 2024-09-10T23:28:46.645 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":26,"btime":"2024-09-10T23:26:42:260644+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/1495411512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":1495411512},{"type":"v1","addr":"172.21.15.3:6835","nonce":1495411512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/1857372777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1857372777},{"type":"v1","addr":"172.21.15.3:6837","nonce":1857372777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14862,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6839/493850676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":493850676},{"type":"v1","addr":"172.21.15.3:6839","nonce":493850676}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14874,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6841/1580524358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":1580524358},{"type":"v1","addr":"172.21.15.3:6841","nonce":1580524358}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/352514665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":352514665},{"type":"v1","addr":"172.21.15.194:6833","nonce":352514665}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2380508105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2380508105},{"type":"v1","addr":"172.21.15.194:6835","nonce":2380508105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:23:58.866253+0000","modified":"2024-09-10T23:26:41.694795+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34724,"mds_1":34682,"mds_2":34652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24649":{"gid":24649,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/739730313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":739730313},{"type":"v1","addr":"172.21.15.194:6837","nonce":739730313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/3198777710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3198777710},{"type":"v1","addr":"172.21.15.194:6839","nonce":3198777710}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34619":{"gid":34619,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6833/1194099617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1194099617},{"type":"v1","addr":"172.21.15.38:6833","nonce":1194099617}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34652":{"gid":34652,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.38:6835/218783320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":218783320},{"type":"v1","addr":"172.21.15.38:6835","nonce":218783320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34682":{"gid":34682,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":21,"addr":"172.21.15.38:6837/1821839397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":1821839397},{"type":"v1","addr":"172.21.15.38:6837","nonce":1821839397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34724":{"gid":34724,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.38:6839/458259815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":458259815},{"type":"v1","addr":"172.21.15.38:6839","nonce":458259815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34724,"qdb_cluster":[34724,34682,34652]},"id":1}]} 2024-09-10T23:28:46.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.646+0000 7f8b15200640 1 -- 172.21.15.3:0/3728020785 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f8af40b55a0 msgr2=0x7f8af40b7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:46.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.646+0000 7f8b15200640 1 --2- 172.21.15.3:0/3728020785 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f8af40b55a0 0x7f8af40b7a60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8af80095f0 tx=0x7f8af8005c90 comp rx=0 tx=0).stop 2024-09-10T23:28:46.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.646+0000 7f8b15200640 1 -- 172.21.15.3:0/3728020785 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b1010a9b0 msgr2=0x7f8b1019b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:46.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.646+0000 7f8b15200640 1 --2- 172.21.15.3:0/3728020785 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b1010a9b0 0x7f8b1019b8e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8b0000e9c0 tx=0x7f8b0000ee80 comp rx=0 tx=0).stop 2024-09-10T23:28:46.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.647+0000 7f8b15200640 1 -- 172.21.15.3:0/3728020785 shutdown_connections 2024-09-10T23:28:46.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.647+0000 7f8b15200640 1 --2- 172.21.15.3:0/3728020785 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1010b330 0x7f8b101a0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:46.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.647+0000 7f8b15200640 1 --2- 172.21.15.3:0/3728020785 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f8af40b55a0 0x7f8af40b7a60 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:46.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.647+0000 7f8b15200640 1 --2- 172.21.15.3:0/3728020785 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b1010a9b0 0x7f8b1019b8e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:46.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.647+0000 7f8b15200640 1 --2- 172.21.15.3:0/3728020785 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b10104fa0 0x7f8b1019b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:46.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.647+0000 7f8b15200640 1 -- 172.21.15.3:0/3728020785 >> 172.21.15.3:0/3728020785 conn(0x7f8b10100a50 msgr2=0x7f8b10101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:46.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.649+0000 7f8b15200640 1 -- 172.21.15.3:0/3728020785 shutdown_connections 2024-09-10T23:28:46.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:46.650+0000 7f8b15200640 1 -- 172.21.15.3:0/3728020785 wait complete. 2024-09-10T23:28:46.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:46 smithi194 ceph-mon[33904]: pgmap v450: 129 pgs: 129 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.1 MiB/s wr, 1.75k op/s 2024-09-10T23:28:46.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:46 smithi003 ceph-mon[30348]: pgmap v450: 129 pgs: 129 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.1 MiB/s wr, 1.75k op/s 2024-09-10T23:28:47.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:46 smithi038 ceph-mon[34225]: pgmap v450: 129 pgs: 129 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.1 MiB/s wr, 1.75k op/s 2024-09-10T23:28:47.640 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34724 quiesce db / --timeout 90 --expiration 140.5 --await-for 45.0' 2024-09-10T23:28:47.640 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34724 quiesce db / --timeout 90 --expiration 140.5 --await-for 45.0 2024-09-10T23:28:47.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:47 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3728020785' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:28:47.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:47 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3728020785' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:28:48.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:47 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3728020785' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:28:48.297 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:28:48.817 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:48 smithi003 ceph-mon[30348]: pgmap v451: 129 pgs: 129 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.8 MiB/s wr, 1.70k op/s 2024-09-10T23:28:48.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:48 smithi194 ceph-mon[33904]: pgmap v451: 129 pgs: 129 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.8 MiB/s wr, 1.70k op/s 2024-09-10T23:28:49.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:48 smithi038 ceph-mon[34225]: pgmap v451: 129 pgs: 129 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.8 MiB/s wr, 1.70k op/s 2024-09-10T23:28:50.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:50 smithi194 ceph-mon[33904]: pgmap v452: 129 pgs: 129 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 2.28k op/s 2024-09-10T23:28:50.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:50 smithi003 ceph-mon[30348]: pgmap v452: 129 pgs: 129 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 2.28k op/s 2024-09-10T23:28:51.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:50 smithi038 ceph-mon[34225]: pgmap v452: 129 pgs: 129 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 2.28k op/s 2024-09-10T23:28:52.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:52 smithi194 ceph-mon[33904]: pgmap v453: 129 pgs: 129 active+clean; 259 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.3 MiB/s wr, 1.73k op/s 2024-09-10T23:28:52.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:52 smithi003 ceph-mon[30348]: pgmap v453: 129 pgs: 129 active+clean; 259 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.3 MiB/s wr, 1.73k op/s 2024-09-10T23:28:53.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:52 smithi038 ceph-mon[34225]: pgmap v453: 129 pgs: 129 active+clean; 259 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.3 MiB/s wr, 1.73k op/s 2024-09-10T23:28:54.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.038+0000 7fc3d0c00640 1 -- 172.21.15.3:0/2885812960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3cc113980 msgr2=0x7fc3cc115d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:54.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.039+0000 7fc3d0c00640 1 --2- 172.21.15.3:0/2885812960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3cc113980 0x7fc3cc115d70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4009be0 tx=0x7fc3c402a6c0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.039+0000 7fc3d0c00640 1 -- 172.21.15.3:0/2885812960 shutdown_connections 2024-09-10T23:28:54.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.039+0000 7fc3d0c00640 1 --2- 172.21.15.3:0/2885812960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3cc113980 0x7fc3cc115d70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.039+0000 7fc3d0c00640 1 --2- 172.21.15.3:0/2885812960 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3cc077ff0 0x7fc3cc113440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.039+0000 7fc3d0c00640 1 --2- 172.21.15.3:0/2885812960 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3cc0776d0 0x7fc3cc077ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.039+0000 7fc3d0c00640 1 -- 172.21.15.3:0/2885812960 >> 172.21.15.3:0/2885812960 conn(0x7fc3cc100a00 msgr2=0x7fc3cc102e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:54.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.040+0000 7fc3d0c00640 1 -- 172.21.15.3:0/2885812960 shutdown_connections 2024-09-10T23:28:54.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.040+0000 7fc3d0c00640 1 -- 172.21.15.3:0/2885812960 wait complete. 2024-09-10T23:28:54.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.041+0000 7fc3d0c00640 1 Processor -- start 2024-09-10T23:28:54.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.041+0000 7fc3d0c00640 1 -- start start 2024-09-10T23:28:54.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.042+0000 7fc3d0c00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3cc0776d0 0x7fc3cc19f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.042+0000 7fc3d0c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3cc077ff0 0x7fc3cc19fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.042+0000 7fc3d0c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3cc113980 0x7fc3cc1a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.042+0000 7fc3d0c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc119200 con 0x7fc3cc113980 2024-09-10T23:28:54.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.042+0000 7fc3ca800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3cc113980 0x7fc3cc1a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.042+0000 7fc3ca800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3cc113980 0x7fc3cc1a50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38078/0 (socket says 172.21.15.3:38078) 2024-09-10T23:28:54.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.042+0000 7fc3ca800640 1 -- 172.21.15.3:0/4035871920 learned_addr learned my addr 172.21.15.3:0/4035871920 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:28:54.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.043+0000 7fc3c9e00640 1 --2- 172.21.15.3:0/4035871920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3cc0776d0 0x7fc3cc19f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.043+0000 7fc3d0c00640 1 -- 172.21.15.3:0/4035871920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc119080 con 0x7fc3cc0776d0 2024-09-10T23:28:54.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.043+0000 7fc3d0c00640 1 -- 172.21.15.3:0/4035871920 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc119380 con 0x7fc3cc077ff0 2024-09-10T23:28:54.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.043+0000 7fc3c9400640 1 --2- 172.21.15.3:0/4035871920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3cc077ff0 0x7fc3cc19fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.043+0000 7fc3c9e00640 1 -- 172.21.15.3:0/4035871920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3cc077ff0 msgr2=0x7fc3cc19fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:54.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.043+0000 7fc3c9e00640 1 --2- 172.21.15.3:0/4035871920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3cc077ff0 0x7fc3cc19fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.044+0000 7fc3c9e00640 1 -- 172.21.15.3:0/4035871920 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3cc113980 msgr2=0x7fc3cc1a50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:54.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.044+0000 7fc3c9e00640 1 --2- 172.21.15.3:0/4035871920 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3cc113980 0x7fc3cc1a50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.044+0000 7fc3c9e00640 1 -- 172.21.15.3:0/4035871920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3cc1a58a0 con 0x7fc3cc0776d0 2024-09-10T23:28:54.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.044+0000 7fc3ca800640 1 --2- 172.21.15.3:0/4035871920 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3cc113980 0x7fc3cc1a50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:28:54.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.044+0000 7fc3c9400640 1 --2- 172.21.15.3:0/4035871920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3cc077ff0 0x7fc3cc19fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:54.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.044+0000 7fc3c9e00640 1 --2- 172.21.15.3:0/4035871920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3cc0776d0 0x7fc3cc19f7f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800c970 tx=0x7fc3b800ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:54.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.045+0000 7fc3c2a00640 1 -- 172.21.15.3:0/4035871920 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8007bb0 con 0x7fc3cc0776d0 2024-09-10T23:28:54.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.045+0000 7fc3c2a00640 1 -- 172.21.15.3:0/4035871920 <== mon.2 v2:172.21.15.38:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc3b8007d50 con 0x7fc3cc0776d0 2024-09-10T23:28:54.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.045+0000 7fc3c2a00640 1 -- 172.21.15.3:0/4035871920 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8004d20 con 0x7fc3cc0776d0 2024-09-10T23:28:54.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.046+0000 7fc3d0c00640 1 -- 172.21.15.3:0/4035871920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3cc1a5b90 con 0x7fc3cc0776d0 2024-09-10T23:28:54.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.046+0000 7fc3d0c00640 1 -- 172.21.15.3:0/4035871920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3cc1ac250 con 0x7fc3cc0776d0 2024-09-10T23:28:54.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.054+0000 7fc3d37e4740 1 Processor -- start 2024-09-10T23:28:54.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.056+0000 7fc3d37e4740 1 -- start start 2024-09-10T23:28:54.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.056+0000 7fc3d37e4740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b7b52a5180 0x55b7b52a5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.057+0000 7fc3c2a00640 1 -- 172.21.15.3:0/4035871920 <== mon.2 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 26) ==== 153380+0+0 (secure 0 0 0) 0x7fc3b8004ec0 con 0x7fc3cc0776d0 2024-09-10T23:28:54.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.059+0000 7fc3c2a00640 1 --2- 172.21.15.3:0/4035871920 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc3b00b5620 0x7fc3b00b7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.060+0000 7fc3c2a00640 1 -- 172.21.15.3:0/4035871920 <== mon.2 v2:172.21.15.38:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7fc3b80e62c0 con 0x7fc3cc0776d0 2024-09-10T23:28:54.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.060+0000 7fc3ca800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b7b52a5180 0x55b7b52a5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.060+0000 7fc3d37e4740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b7b52a5aa0 0x55b7b52b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.060+0000 7fc3d37e4740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b7b52b1a30 0x55b7b52b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.060+0000 7fc3d37e4740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b7b521aca0 con 0x55b7b52b1a30 2024-09-10T23:28:54.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.061+0000 7fc3d37e4740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b7b520a0d0 con 0x55b7b52a5aa0 2024-09-10T23:28:54.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.061+0000 7fc3d37e4740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55b7b520dee0 con 0x55b7b52a5180 2024-09-10T23:28:54.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.061+0000 7fc3c9e00640 1 --2- 172.21.15.3:0/4035871920 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc3b00b5620 0x7fc3b00b7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.062+0000 7fc3c9400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b7b52a5aa0 0x55b7b52b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.063+0000 7fc3c9400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b7b52a5aa0 0x55b7b52b14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.3:49740/0 (socket says 172.21.15.3:49740) 2024-09-10T23:28:54.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.063+0000 7fc3c9400640 1 -- 172.21.15.3:0/1515743303 learned_addr learned my addr 172.21.15.3:0/1515743303 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:28:54.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.063+0000 7fc3c9e00640 1 --2- 172.21.15.3:0/4035871920 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc3b00b5620 0x7fc3b00b7ae0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80e36a0 tx=0x7fc3b8007f00 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:54.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.064+0000 7fc3ca800640 1 --2- 172.21.15.3:0/1515743303 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b7b52b1a30 0x55b7b52b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.066+0000 7fc3c9400640 1 -- 172.21.15.3:0/1515743303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b7b52a5180 msgr2=0x55b7b52a5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:54.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.066+0000 7fc3c9400640 1 --2- 172.21.15.3:0/1515743303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b7b52a5180 0x55b7b52a5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.067+0000 7fc3c9400640 1 -- 172.21.15.3:0/1515743303 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b7b52b1a30 msgr2=0x55b7b52b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:54.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.067+0000 7fc3c9400640 1 --2- 172.21.15.3:0/1515743303 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b7b52b1a30 0x55b7b52b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.068+0000 7fc3c9400640 1 -- 172.21.15.3:0/1515743303 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7b51bc400 con 0x55b7b52a5aa0 2024-09-10T23:28:54.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.068+0000 7fc3ca800640 1 --2- 172.21.15.3:0/1515743303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b7b52a5180 0x55b7b52a5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:28:54.630 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.069+0000 7fc3c9400640 1 --2- 172.21.15.3:0/1515743303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b7b52a5aa0 0x55b7b52b14f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc009cc0 tx=0x7fc3bc0107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34ede89d8ace8f9e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:54.630 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.069+0000 7fc3b7000640 1 -- 172.21.15.3:0/1515743303 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc01c480 con 0x55b7b52a5aa0 2024-09-10T23:28:54.630 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.070+0000 7fc3b7000640 1 -- 172.21.15.3:0/1515743303 <== mon.2 v2:172.21.15.38:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc3bc01cab0 con 0x55b7b52a5aa0 2024-09-10T23:28:54.630 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.070+0000 7fc3b7000640 1 -- 172.21.15.3:0/1515743303 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc011b10 con 0x55b7b52a5aa0 2024-09-10T23:28:54.630 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.071+0000 7fc3d37e4740 1 -- 172.21.15.3:0/1515743303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b7b52a5aa0 msgr2=0x55b7b52b14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:54.630 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.071+0000 7fc3d37e4740 1 --2- 172.21.15.3:0/1515743303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b7b52a5aa0 0x55b7b52b14f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc009cc0 tx=0x7fc3bc0107a0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.630 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.072+0000 7fc3d37e4740 1 -- 172.21.15.3:0/1515743303 shutdown_connections 2024-09-10T23:28:54.630 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.072+0000 7fc3d37e4740 1 --2- 172.21.15.3:0/1515743303 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b7b52b1a30 0x55b7b52b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.630 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.072+0000 7fc3d37e4740 1 --2- 172.21.15.3:0/1515743303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b7b52a5aa0 0x55b7b52b14f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.630 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.072+0000 7fc3d37e4740 1 --2- 172.21.15.3:0/1515743303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b7b52a5180 0x55b7b52a5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.630 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.072+0000 7fc3d37e4740 1 -- 172.21.15.3:0/1515743303 >> 172.21.15.3:0/1515743303 conn(0x55b7b52a2fb0 msgr2=0x55b7b52a4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:54.630 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.072+0000 7fc3d37e4740 1 -- 172.21.15.3:0/1515743303 shutdown_connections 2024-09-10T23:28:54.630 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.072+0000 7fc3d37e4740 1 -- 172.21.15.3:0/1515743303 wait complete. 2024-09-10T23:28:54.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.073+0000 7fc3d37e4740 1 -- start start 2024-09-10T23:28:54.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.073+0000 7fc3d37e4740 1 Processor -- start 2024-09-10T23:28:54.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.074+0000 7fc3d37e4740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b7b52a5180 0x55b7b52b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.074+0000 7fc3d37e4740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b7b52a5aa0 0x55b7b52ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.074+0000 7fc3d37e4740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b7b52b1a30 0x55b7b52aec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.074+0000 7fc3d37e4740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b7b506b7a0 con 0x55b7b52b1a30 2024-09-10T23:28:54.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.074+0000 7fc3d37e4740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b7b51afa10 con 0x55b7b52a5180 2024-09-10T23:28:54.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.074+0000 7fc3d37e4740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55b7b52b46b0 con 0x55b7b52a5aa0 2024-09-10T23:28:54.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.074+0000 7fc3d37e4740 10 client.0 _ll_register_callbacks cb 0x55b7b51bfbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:54.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.074+0000 7fc3ca800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b7b52a5180 0x55b7b52b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.074+0000 7fc3ca800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b7b52a5180 0x55b7b52b12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.3:49748/0 (socket says 172.21.15.3:49748) 2024-09-10T23:28:54.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.074+0000 7fc3ca800640 1 -- 172.21.15.3:0/2683934443 learned_addr learned my addr 172.21.15.3:0/2683934443 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:28:54.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.075+0000 7fc3ca800640 1 --2- 172.21.15.3:0/2683934443 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b7b52b1a30 0x55b7b52aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.075+0000 7fc3c9400640 1 --2- 172.21.15.3:0/2683934443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b7b52a5aa0 0x55b7b52ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.075+0000 7fc3c9400640 1 -- 172.21.15.3:0/2683934443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b7b52a5180 msgr2=0x55b7b52b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:54.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.075+0000 7fc3c9400640 1 --2- 172.21.15.3:0/2683934443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b7b52a5180 0x55b7b52b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.075+0000 7fc3c9400640 1 -- 172.21.15.3:0/2683934443 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b7b52b1a30 msgr2=0x55b7b52aec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:54.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.075+0000 7fc3c9400640 1 --2- 172.21.15.3:0/2683934443 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b7b52b1a30 0x55b7b52aec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.075+0000 7fc3c9400640 1 -- 172.21.15.3:0/2683934443 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7b4f77b90 con 0x55b7b52a5aa0 2024-09-10T23:28:54.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.076+0000 7fc3c9400640 1 --2- 172.21.15.3:0/2683934443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b7b52a5aa0 0x55b7b52ae6f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc006010 tx=0x7fc3bc0114b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c742954f2ba9f2b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:54.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.076+0000 7fc3ab400640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-10T23:28:54.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.076+0000 7fc3ab400640 1 -- 172.21.15.3:0/2683934443 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc01c890 con 0x55b7b52a5aa0 2024-09-10T23:28:54.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.076+0000 7fc3ab400640 1 -- 172.21.15.3:0/2683934443 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7fc3bc011890 con 0x55b7b52a5aa0 2024-09-10T23:28:54.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.076+0000 7fc3d37e4740 1 -- 172.21.15.3:0/2683934443 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3bc01cab0 con 0x55b7b52a5aa0 2024-09-10T23:28:54.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.077+0000 7fc3ab400640 1 -- 172.21.15.3:0/2683934443 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc3bc045050 con 0x55b7b52a5aa0 2024-09-10T23:28:54.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.077+0000 7fc3d37e4740 10 client.25456 fetch_fsmap learned FSMap version 26 2024-09-10T23:28:54.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.077+0000 7fc3d37e4740 1 -- 172.21.15.3:0/2683934443 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b7b52bff90 con 0x55b7b52a5aa0 2024-09-10T23:28:54.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.077+0000 7fc3ab400640 1 -- 172.21.15.3:0/2683934443 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc3bc005040 con 0x55b7b52a5aa0 2024-09-10T23:28:54.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.078+0000 7fc3ab400640 1 -- 172.21.15.3:0/2683934443 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fc3bc040030 con 0x55b7b52a5aa0 2024-09-10T23:28:54.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.079+0000 7fc3d37e4740 10 client.25456 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:28:54.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.079+0000 7fc3d37e4740 10 client.25456 resolve_mds: validated gid 34724 aka daemon mds.b 2024-09-10T23:28:54.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.079+0000 7fc3d37e4740 20 client.25456 populate_metadata read hostname 'smithi003' 2024-09-10T23:28:54.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.079+0000 7fc3d37e4740 1 --2- 172.21.15.3:0/2683934443 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x55b7b52c1390 0x55b7b52c3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.079+0000 7fc3d37e4740 4 client.25456 mds_command: new command op to 34724 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:28:54.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.079+0000 7fc3d37e4740 1 -- 172.21.15.3:0/2683934443 --> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc3bc01cab0 con 0x55b7b52c1390 2024-09-10T23:28:54.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.083+0000 7fc3ca800640 1 --2- 172.21.15.3:0/2683934443 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x55b7b52c1390 0x55b7b52c3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.087+0000 7fc3ab400640 10 client.25456 ms_handle_connect on v2:172.21.15.38:6838/458259815 2024-09-10T23:28:54.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.087+0000 7fc3ca800640 1 --2- 172.21.15.3:0/2683934443 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x55b7b52c1390 0x55b7b52c3780 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7da8a4769eea388a server_cookie=16a263c523fefed0 in_seq=0 out_seq=0 2024-09-10T23:28:54.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.091+0000 7fc3ab400640 1 -- 172.21.15.3:0/2683934443 <== mds.0 v2:172.21.15.38:6838/458259815 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fc3bc01cab0 con 0x55b7b52c1390 2024-09-10T23:28:54.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.091+0000 7fc3ab400640 10 client.25456 handle_command_reply: tid=0 2024-09-10T23:28:54.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.091+0000 7fc3d37e4740 1 client.25456 shutdown 2024-09-10T23:28:54.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.092+0000 7fc3d37e4740 1 -- 172.21.15.3:0/2683934443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b7b52a5aa0 msgr2=0x55b7b52ae6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:54.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.092+0000 7fc3d37e4740 1 --2- 172.21.15.3:0/2683934443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b7b52a5aa0 0x55b7b52ae6f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc006010 tx=0x7fc3bc0114b0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.092+0000 7fc3d37e4740 1 -- 172.21.15.3:0/2683934443 shutdown_connections 2024-09-10T23:28:54.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.092+0000 7fc3d37e4740 1 --2- 172.21.15.3:0/2683934443 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x55b7b52c1390 0x55b7b52c3780 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.092+0000 7fc3d37e4740 1 --2- 172.21.15.3:0/2683934443 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b7b52b1a30 0x55b7b52aec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.092+0000 7fc3d37e4740 1 --2- 172.21.15.3:0/2683934443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b7b52a5aa0 0x55b7b52ae6f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.092+0000 7fc3d37e4740 1 --2- 172.21.15.3:0/2683934443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b7b52a5180 0x55b7b52b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.092+0000 7fc3d37e4740 1 -- 172.21.15.3:0/2683934443 >> 172.21.15.3:0/2683934443 conn(0x55b7b52a2fb0 msgr2=0x55b7b52a8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:54.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.092+0000 7fc3ab400640 0 client.25456 ms_handle_reset on v2:172.21.15.38:6838/458259815 2024-09-10T23:28:54.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.093+0000 7fc3d37e4740 1 -- 172.21.15.3:0/2683934443 shutdown_connections 2024-09-10T23:28:54.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.093+0000 7fc3d37e4740 1 -- 172.21.15.3:0/2683934443 wait complete. 2024-09-10T23:28:54.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.093+0000 7fc3d37e4740 20 client.25456 trim_cache size 0 max 16384 2024-09-10T23:28:54.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.135+0000 7fc3d37e4740 1 Processor -- start 2024-09-10T23:28:54.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.135+0000 7fc3d37e4740 1 -- start start 2024-09-10T23:28:54.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.136+0000 7fc3d37e4740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b7b52a5180 0x55b7b52a28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.136+0000 7fc3d37e4740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b7b52a5aa0 0x55b7b52a43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.136+0000 7fc3d37e4740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b7b52b1a30 0x55b7b52ab900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.136+0000 7fc3d37e4740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc1b0490 con 0x55b7b52a5180 2024-09-10T23:28:54.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.136+0000 7fc3d37e4740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc1add60 con 0x55b7b52b1a30 2024-09-10T23:28:54.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.136+0000 7fc3d37e4740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc10e400 con 0x55b7b52a5aa0 2024-09-10T23:28:54.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.136+0000 7fc3ca800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b7b52a5180 0x55b7b52a28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.136+0000 7fc3ca800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b7b52b1a30 0x55b7b52ab900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.136+0000 7fc3c9400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b7b52a5aa0 0x55b7b52a43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.136+0000 7fc3ca800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b7b52b1a30 0x55b7b52ab900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.3:49756/0 (socket says 172.21.15.3:49756) 2024-09-10T23:28:54.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.137+0000 7fc3ca800640 1 -- 172.21.15.3:0/519054311 learned_addr learned my addr 172.21.15.3:0/519054311 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:28:54.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.137+0000 7fc3c9400640 1 -- 172.21.15.3:0/519054311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b7b52b1a30 msgr2=0x55b7b52ab900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:54.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.137+0000 7fc3c9400640 1 --2- 172.21.15.3:0/519054311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b7b52b1a30 0x55b7b52ab900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.137+0000 7fc3c9400640 1 -- 172.21.15.3:0/519054311 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b7b52a5180 msgr2=0x55b7b52a28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:54.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.137+0000 7fc3c9400640 1 --2- 172.21.15.3:0/519054311 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b7b52a5180 0x55b7b52a28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.137+0000 7fc3c9400640 1 -- 172.21.15.3:0/519054311 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7b52aa040 con 0x55b7b52a5aa0 2024-09-10T23:28:54.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.137+0000 7fc3ca800640 1 --2- 172.21.15.3:0/519054311 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b7b52a5180 0x55b7b52a28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:28:54.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.138+0000 7fc3c9400640 1 --2- 172.21.15.3:0/519054311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b7b52a5aa0 0x55b7b52a43a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55b7b52a3af0 tx=0x7fc3bc0095f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ac76dfb0aef01bd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:54.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.138+0000 7fc3b6600640 1 -- 172.21.15.3:0/519054311 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc04d070 con 0x55b7b52a5aa0 2024-09-10T23:28:54.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.138+0000 7fc3b6600640 1 -- 172.21.15.3:0/519054311 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc3bc0092b0 con 0x55b7b52a5aa0 2024-09-10T23:28:54.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.138+0000 7fc3b6600640 1 -- 172.21.15.3:0/519054311 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc011c30 con 0x55b7b52a5aa0 2024-09-10T23:28:54.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.139+0000 7fc3d37e4740 1 -- 172.21.15.3:0/519054311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b7b52a5aa0 msgr2=0x55b7b52a43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:54.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.139+0000 7fc3d37e4740 1 --2- 172.21.15.3:0/519054311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b7b52a5aa0 0x55b7b52a43a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55b7b52a3af0 tx=0x7fc3bc0095f0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.139+0000 7fc3d37e4740 1 -- 172.21.15.3:0/519054311 shutdown_connections 2024-09-10T23:28:54.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.139+0000 7fc3d37e4740 1 --2- 172.21.15.3:0/519054311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b7b52b1a30 0x55b7b52ab900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.139+0000 7fc3d37e4740 1 --2- 172.21.15.3:0/519054311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b7b52a5aa0 0x55b7b52a43a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.139+0000 7fc3d37e4740 1 --2- 172.21.15.3:0/519054311 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b7b52a5180 0x55b7b52a28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.139+0000 7fc3d37e4740 1 -- 172.21.15.3:0/519054311 >> 172.21.15.3:0/519054311 conn(0x55b7b52a2fb0 msgr2=0x55b7b52a3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:54.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.139+0000 7fc3d37e4740 1 -- 172.21.15.3:0/519054311 shutdown_connections 2024-09-10T23:28:54.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.139+0000 7fc3d37e4740 1 -- 172.21.15.3:0/519054311 wait complete. 2024-09-10T23:28:54.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.140+0000 7fc3d37e4740 1 -- start start 2024-09-10T23:28:54.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.140+0000 7fc3d37e4740 1 Processor -- start 2024-09-10T23:28:54.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.141+0000 7fc3d37e4740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b7b52a5180 0x55b7b52b9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.141+0000 7fc3d37e4740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b7b52a5aa0 0x55b7b52b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.141+0000 7fc3d37e4740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b7b52b1a30 0x55b7b52b6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.141+0000 7fc3d37e4740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc10ea70 con 0x55b7b52b1a30 2024-09-10T23:28:54.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.141+0000 7fc3d37e4740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc1ad690 con 0x55b7b52a5180 2024-09-10T23:28:54.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.141+0000 7fc3d37e4740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc1ac8f0 con 0x55b7b52a5aa0 2024-09-10T23:28:54.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.141+0000 7fc3d37e4740 10 client.0 _ll_register_callbacks cb 0x7fc3c4034070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:54.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.141+0000 7fc3ca800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b7b52a5180 0x55b7b52b9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.141+0000 7fc3ca800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b7b52a5180 0x55b7b52b9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.3:49758/0 (socket says 172.21.15.3:49758) 2024-09-10T23:28:54.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.141+0000 7fc3ca800640 1 -- 172.21.15.3:0/2733343917 learned_addr learned my addr 172.21.15.3:0/2733343917 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:28:54.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.141+0000 7fc3ca800640 1 --2- 172.21.15.3:0/2733343917 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b7b52b1a30 0x55b7b52b6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.142+0000 7fc3c9400640 1 --2- 172.21.15.3:0/2733343917 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b7b52a5aa0 0x55b7b52b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.142+0000 7fc3ca800640 1 -- 172.21.15.3:0/2733343917 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b7b52a5aa0 msgr2=0x55b7b52b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:54.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.142+0000 7fc3ca800640 1 --2- 172.21.15.3:0/2733343917 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b7b52a5aa0 0x55b7b52b63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.142+0000 7fc3ca800640 1 -- 172.21.15.3:0/2733343917 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b7b52b1a30 msgr2=0x55b7b52b6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:54.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.142+0000 7fc3ca800640 1 --2- 172.21.15.3:0/2733343917 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b7b52b1a30 0x55b7b52b6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.142+0000 7fc3ca800640 1 -- 172.21.15.3:0/2733343917 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7b52a58d0 con 0x55b7b52a5180 2024-09-10T23:28:54.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.143+0000 7fc3c9400640 1 --2- 172.21.15.3:0/2733343917 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b7b52a5aa0 0x55b7b52b63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:28:54.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.143+0000 7fc3ca800640 1 --2- 172.21.15.3:0/2733343917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b7b52a5180 0x55b7b52b9f10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4006010 tx=0x7fc3c4046040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=882c9491acebbdc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:54.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.143+0000 7fc3ab400640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-10T23:28:54.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.144+0000 7fc3ab400640 1 -- 172.21.15.3:0/2733343917 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4053060 con 0x55b7b52a5180 2024-09-10T23:28:54.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.144+0000 7fc3ab400640 1 -- 172.21.15.3:0/2733343917 <== mon.2 v2:172.21.15.38:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7fc3c4031440 con 0x55b7b52a5180 2024-09-10T23:28:54.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.144+0000 7fc3d37e4740 1 -- 172.21.15.3:0/2733343917 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3bc0092b0 con 0x55b7b52a5180 2024-09-10T23:28:54.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.144+0000 7fc3ab400640 1 -- 172.21.15.3:0/2733343917 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc3c4036040 con 0x55b7b52a5180 2024-09-10T23:28:54.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.144+0000 7fc3d37e4740 10 client.35504 fetch_fsmap learned FSMap version 26 2024-09-10T23:28:54.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.144+0000 7fc3d37e4740 1 -- 172.21.15.3:0/2733343917 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b7b532ec40 con 0x55b7b52a5180 2024-09-10T23:28:54.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.146+0000 7fc3ab400640 1 -- 172.21.15.3:0/2733343917 <== mon.2 v2:172.21.15.38:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc3bc0092b0 con 0x55b7b52a5180 2024-09-10T23:28:54.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.146+0000 7fc3ab400640 1 -- 172.21.15.3:0/2733343917 <== mon.2 v2:172.21.15.38:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fc3c404d030 con 0x55b7b52a5180 2024-09-10T23:28:54.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.147+0000 7fc3d37e4740 10 client.35504 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:28:54.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.147+0000 7fc3d37e4740 10 client.35504 resolve_mds: validated gid 34724 aka daemon mds.b 2024-09-10T23:28:54.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.147+0000 7fc3d37e4740 20 client.35504 populate_metadata read hostname 'smithi003' 2024-09-10T23:28:54.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.147+0000 7fc3d37e4740 1 --2- 172.21.15.3:0/2733343917 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x55b7b532f3b0 0x55b7b53317d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:54.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.147+0000 7fc3d37e4740 4 client.35504 mds_command: new command op to 34724 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.5, "await_for": 45.0}] 2024-09-10T23:28:54.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.147+0000 7fc3d37e4740 1 -- 172.21.15.3:0/2733343917 --> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.5, "await_for": 45.0}) -- 0x55b7b521cbf0 con 0x55b7b532f3b0 2024-09-10T23:28:54.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.148+0000 7fc3c9400640 1 --2- 172.21.15.3:0/2733343917 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x55b7b532f3b0 0x55b7b53317d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:54.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.149+0000 7fc3c9400640 1 --2- 172.21.15.3:0/2733343917 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x55b7b532f3b0 0x55b7b53317d0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9deecf46db1bad11 server_cookie=bdf809f356cd4af0 in_seq=0 out_seq=0 2024-09-10T23:28:54.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.149+0000 7fc3ab400640 10 client.35504 ms_handle_connect on v2:172.21.15.38:6838/458259815 2024-09-10T23:28:54.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.178+0000 7fc3ab400640 1 -- 172.21.15.3:0/2733343917 <== mds.0 v2:172.21.15.38:6838/458259815 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55b7b521cbf0 con 0x55b7b532f3b0 2024-09-10T23:28:54.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.178+0000 7fc3ab400640 10 client.35504 handle_command_reply: tid=0 2024-09-10T23:28:54.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.178+0000 7fc3d37e4740 1 client.35504 shutdown 2024-09-10T23:28:54.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.179+0000 7fc3d37e4740 1 -- 172.21.15.3:0/2733343917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b7b52a5180 msgr2=0x55b7b52b9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:54.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.179+0000 7fc3d37e4740 1 --2- 172.21.15.3:0/2733343917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b7b52a5180 0x55b7b52b9f10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4006010 tx=0x7fc3c4046040 comp rx=0 tx=0).stop 2024-09-10T23:28:54.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.179+0000 7fc3d37e4740 1 -- 172.21.15.3:0/2733343917 shutdown_connections 2024-09-10T23:28:54.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.179+0000 7fc3d37e4740 1 --2- 172.21.15.3:0/2733343917 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x55b7b532f3b0 0x55b7b53317d0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.641 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-10T23:28:54.641 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 26, 2024-09-10T23:28:54.641 INFO:teuthology.orchestra.run.smithi003.stdout: "leader": 34724, 2024-09-10T23:28:54.641 INFO:teuthology.orchestra.run.smithi003.stdout: "set_version": 6, 2024-09-10T23:28:54.641 INFO:teuthology.orchestra.run.smithi003.stdout: "sets": { 2024-09-10T23:28:54.641 INFO:teuthology.orchestra.run.smithi003.stdout: "5c006e51": { 2024-09-10T23:28:54.641 INFO:teuthology.orchestra.run.smithi003.stdout: "version": 6, 2024-09-10T23:28:54.642 INFO:teuthology.orchestra.run.smithi003.stdout: "age_ref": 0.0, 2024-09-10T23:28:54.642 INFO:teuthology.orchestra.run.smithi003.stdout: "state": { 2024-09-10T23:28:54.642 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "QUIESCED", 2024-09-10T23:28:54.642 INFO:teuthology.orchestra.run.smithi003.stdout: "age": 0.0 2024-09-10T23:28:54.642 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:28:54.642 INFO:teuthology.orchestra.run.smithi003.stdout: "timeout": 90.0, 2024-09-10T23:28:54.642 INFO:teuthology.orchestra.run.smithi003.stdout: "expiration": 140.5, 2024-09-10T23:28:54.642 INFO:teuthology.orchestra.run.smithi003.stdout: "members": { 2024-09-10T23:28:54.642 INFO:teuthology.orchestra.run.smithi003.stdout: "file:/": { 2024-09-10T23:28:54.642 INFO:teuthology.orchestra.run.smithi003.stdout: "excluded": false, 2024-09-10T23:28:54.642 INFO:teuthology.orchestra.run.smithi003.stdout: "state": { 2024-09-10T23:28:54.642 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "QUIESCED", 2024-09-10T23:28:54.642 INFO:teuthology.orchestra.run.smithi003.stdout: "age": 0.0 2024-09-10T23:28:54.642 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:28:54.642 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:28:54.643 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:28:54.643 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:28:54.643 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:28:54.643 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-10T23:28:54.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.179+0000 7fc3d37e4740 1 --2- 172.21.15.3:0/2733343917 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b7b52b1a30 0x55b7b52b6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.179+0000 7fc3d37e4740 1 --2- 172.21.15.3:0/2733343917 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b7b52a5aa0 0x55b7b52b63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.179+0000 7fc3d37e4740 1 --2- 172.21.15.3:0/2733343917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b7b52a5180 0x55b7b52b9f10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.179+0000 7fc3d37e4740 1 -- 172.21.15.3:0/2733343917 >> 172.21.15.3:0/2733343917 conn(0x55b7b52a2fb0 msgr2=0x55b7b52a44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:54.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.179+0000 7fc3ab400640 0 client.35504 ms_handle_reset on v2:172.21.15.38:6838/458259815 2024-09-10T23:28:54.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.179+0000 7fc3d37e4740 1 -- 172.21.15.3:0/2733343917 shutdown_connections 2024-09-10T23:28:54.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.179+0000 7fc3d37e4740 1 -- 172.21.15.3:0/2733343917 wait complete. 2024-09-10T23:28:54.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.179+0000 7fc3d37e4740 20 client.35504 trim_cache size 0 max 16384 2024-09-10T23:28:54.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.182+0000 7fc3d0c00640 1 -- 172.21.15.3:0/4035871920 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc3b00b5620 msgr2=0x7fc3b00b7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:54.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.182+0000 7fc3d0c00640 1 --2- 172.21.15.3:0/4035871920 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc3b00b5620 0x7fc3b00b7ae0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80e36a0 tx=0x7fc3b8007f00 comp rx=0 tx=0).stop 2024-09-10T23:28:54.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.182+0000 7fc3d0c00640 1 -- 172.21.15.3:0/4035871920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3cc0776d0 msgr2=0x7fc3cc19f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:54.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.182+0000 7fc3d0c00640 1 --2- 172.21.15.3:0/4035871920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3cc0776d0 0x7fc3cc19f7f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800c970 tx=0x7fc3b800ce30 comp rx=0 tx=0).stop 2024-09-10T23:28:54.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.182+0000 7fc3d0c00640 1 -- 172.21.15.3:0/4035871920 shutdown_connections 2024-09-10T23:28:54.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.183+0000 7fc3d0c00640 1 --2- 172.21.15.3:0/4035871920 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc3b00b5620 0x7fc3b00b7ae0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.183+0000 7fc3d0c00640 1 --2- 172.21.15.3:0/4035871920 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3cc113980 0x7fc3cc1a50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.183+0000 7fc3d0c00640 1 --2- 172.21.15.3:0/4035871920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3cc077ff0 0x7fc3cc19fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.183+0000 7fc3d0c00640 1 --2- 172.21.15.3:0/4035871920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3cc0776d0 0x7fc3cc19f7f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:54.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.183+0000 7fc3d0c00640 1 -- 172.21.15.3:0/4035871920 >> 172.21.15.3:0/4035871920 conn(0x7fc3cc100a00 msgr2=0x7fc3cc102df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:54.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.183+0000 7fc3d0c00640 1 -- 172.21.15.3:0/4035871920 shutdown_connections 2024-09-10T23:28:54.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:49.183+0000 7fc3d0c00640 1 -- 172.21.15.3:0/4035871920 wait complete. 2024-09-10T23:28:54.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:54 smithi194 ceph-mon[33904]: pgmap v454: 129 pgs: 129 active+clean; 259 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.1 MiB/s wr, 1.79k op/s 2024-09-10T23:28:54.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:54 smithi003 ceph-mon[30348]: pgmap v454: 129 pgs: 129 active+clean; 259 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.1 MiB/s wr, 1.79k op/s 2024-09-10T23:28:55.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:54 smithi038 ceph-mon[34225]: pgmap v454: 129 pgs: 129 active+clean; 259 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.1 MiB/s wr, 1.79k op/s 2024-09-10T23:28:56.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:56 smithi194 ceph-mon[33904]: pgmap v455: 129 pgs: 129 active+clean; 259 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 1.31k op/s 2024-09-10T23:28:56.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:56 smithi003 ceph-mon[30348]: pgmap v455: 129 pgs: 129 active+clean; 259 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 1.31k op/s 2024-09-10T23:28:57.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:56 smithi038 ceph-mon[34225]: pgmap v455: 129 pgs: 129 active+clean; 259 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 1.31k op/s 2024-09-10T23:28:57.327 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '5c006e51', quiesce took 19.4 seconds. Will release after: 1.1000000000000014 2024-09-10T23:28:58.428 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:28:58.824 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:28:58.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:28:58 smithi194 ceph-mon[33904]: pgmap v456: 129 pgs: 129 active+clean; 259 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.5 MiB/s wr, 1.17k op/s 2024-09-10T23:28:58.964 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:28:58 smithi003 ceph-mon[30348]: pgmap v456: 129 pgs: 129 active+clean; 259 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.5 MiB/s wr, 1.17k op/s 2024-09-10T23:28:59.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:28:58 smithi038 ceph-mon[34225]: pgmap v456: 129 pgs: 129 active+clean; 259 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.5 MiB/s wr, 1.17k op/s 2024-09-10T23:28:59.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.413+0000 7f0cabe00640 1 -- 172.21.15.3:0/4108983875 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0cac10a800 msgr2=0x7f0cac10ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:59.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.413+0000 7f0cabe00640 1 --2- 172.21.15.3:0/4108983875 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0cac10a800 0x7f0cac10ac40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0c94009900 tx=0x7f0c9402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.414+0000 7f0cabe00640 1 -- 172.21.15.3:0/4108983875 shutdown_connections 2024-09-10T23:28:59.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.414+0000 7f0cabe00640 1 --2- 172.21.15.3:0/4108983875 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0cac10b180 0x7f0cac111980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.414+0000 7f0cabe00640 1 --2- 172.21.15.3:0/4108983875 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0cac10a800 0x7f0cac10ac40 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.414+0000 7f0cabe00640 1 --2- 172.21.15.3:0/4108983875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cac104df0 0x7f0cac1051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.414+0000 7f0cabe00640 1 -- 172.21.15.3:0/4108983875 >> 172.21.15.3:0/4108983875 conn(0x7f0cac100840 msgr2=0x7f0cac102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:59.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.414+0000 7f0cabe00640 1 -- 172.21.15.3:0/4108983875 shutdown_connections 2024-09-10T23:28:59.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.414+0000 7f0cabe00640 1 -- 172.21.15.3:0/4108983875 wait complete. 2024-09-10T23:28:59.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.415+0000 7f0cabe00640 1 Processor -- start 2024-09-10T23:28:59.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.415+0000 7f0cabe00640 1 -- start start 2024-09-10T23:28:59.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.415+0000 7f0cabe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cac104df0 0x7f0cac19b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:59.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.415+0000 7f0cabe00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0cac10a800 0x7f0cac19b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:59.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.415+0000 7f0cabe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0cac10b180 0x7f0cac1a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:59.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.415+0000 7f0cabe00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0cac114cf0 con 0x7f0cac10b180 2024-09-10T23:28:59.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.415+0000 7f0cabe00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0cac114b70 con 0x7f0cac10a800 2024-09-10T23:28:59.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.415+0000 7f0cabe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0cac114e70 con 0x7f0cac104df0 2024-09-10T23:28:59.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.415+0000 7f0cab400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0cac10b180 0x7f0cac1a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:59.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.415+0000 7f0cab400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0cac10b180 0x7f0cac1a0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55562/0 (socket says 172.21.15.3:55562) 2024-09-10T23:28:59.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.416+0000 7f0cab400640 1 -- 172.21.15.3:0/1495308483 learned_addr learned my addr 172.21.15.3:0/1495308483 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:28:59.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.415+0000 7f0caaa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cac104df0 0x7f0cac19b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:59.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.416+0000 7f0ca2000640 1 --2- 172.21.15.3:0/1495308483 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0cac10a800 0x7f0cac19b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:59.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.416+0000 7f0cab400640 1 -- 172.21.15.3:0/1495308483 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cac104df0 msgr2=0x7f0cac19b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:59.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.416+0000 7f0cab400640 1 --2- 172.21.15.3:0/1495308483 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cac104df0 0x7f0cac19b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.416+0000 7f0cab400640 1 -- 172.21.15.3:0/1495308483 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0cac10a800 msgr2=0x7f0cac19b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:59.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.416+0000 7f0cab400640 1 --2- 172.21.15.3:0/1495308483 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0cac10a800 0x7f0cac19b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.416+0000 7f0cab400640 1 -- 172.21.15.3:0/1495308483 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cac1a1270 con 0x7f0cac10b180 2024-09-10T23:28:59.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.416+0000 7f0cab400640 1 --2- 172.21.15.3:0/1495308483 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0cac10b180 0x7f0cac1a0aa0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0ca400cce0 tx=0x7f0ca400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:59.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.417+0000 7f0ca3e00640 1 -- 172.21.15.3:0/1495308483 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca400f450 con 0x7f0cac10b180 2024-09-10T23:28:59.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.417+0000 7f0ca3e00640 1 -- 172.21.15.3:0/1495308483 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0ca400fa80 con 0x7f0cac10b180 2024-09-10T23:28:59.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.417+0000 7f0ca3e00640 1 -- 172.21.15.3:0/1495308483 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca40189c0 con 0x7f0cac10b180 2024-09-10T23:28:59.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.417+0000 7f0cabe00640 1 -- 172.21.15.3:0/1495308483 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cac1a1560 con 0x7f0cac10b180 2024-09-10T23:28:59.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.417+0000 7f0cabe00640 1 -- 172.21.15.3:0/1495308483 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cac1a7c20 con 0x7f0cac10b180 2024-09-10T23:28:59.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.418+0000 7f0cabe00640 1 -- 172.21.15.3:0/1495308483 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cac1051d0 con 0x7f0cac10b180 2024-09-10T23:28:59.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.422+0000 7f0ca3e00640 1 -- 172.21.15.3:0/1495308483 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 26) ==== 153380+0+0 (secure 0 0 0) 0x7f0ca4020030 con 0x7f0cac10b180 2024-09-10T23:28:59.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.423+0000 7f0ca3e00640 1 --2- 172.21.15.3:0/1495308483 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0c900b5500 0x7f0c900b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:59.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.423+0000 7f0ca3e00640 1 -- 172.21.15.3:0/1495308483 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f0ca40e65d0 con 0x7f0cac10b180 2024-09-10T23:28:59.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.423+0000 7f0caaa00640 1 --2- 172.21.15.3:0/1495308483 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0c900b5500 0x7f0c900b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:59.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.424+0000 7f0caaa00640 1 --2- 172.21.15.3:0/1495308483 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0c900b5500 0x7f0c900b79c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c009990 tx=0x7f0c9c009110 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:59.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.425+0000 7f0ca3e00640 1 -- 172.21.15.3:0/1495308483 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0ca4014030 con 0x7f0cac10b180 2024-09-10T23:28:59.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.657+0000 7f0cabe00640 1 -- 172.21.15.3:0/1495308483 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0cac02e5c0 con 0x7f0cac10b180 2024-09-10T23:28:59.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.658+0000 7f0ca3e00640 1 -- 172.21.15.3:0/1495308483 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11891 (secure 0 0 0) 0x7f0ca40acd80 con 0x7f0cac10b180 2024-09-10T23:28:59.658 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:28:59.658 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":26,"btime":"2024-09-10T23:26:42:260644+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/1495411512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":1495411512},{"type":"v1","addr":"172.21.15.3:6835","nonce":1495411512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/1857372777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1857372777},{"type":"v1","addr":"172.21.15.3:6837","nonce":1857372777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14862,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6839/493850676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":493850676},{"type":"v1","addr":"172.21.15.3:6839","nonce":493850676}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14874,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6841/1580524358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":1580524358},{"type":"v1","addr":"172.21.15.3:6841","nonce":1580524358}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/352514665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":352514665},{"type":"v1","addr":"172.21.15.194:6833","nonce":352514665}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2380508105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2380508105},{"type":"v1","addr":"172.21.15.194:6835","nonce":2380508105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:23:58.866253+0000","modified":"2024-09-10T23:26:41.694795+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34724,"mds_1":34682,"mds_2":34652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24649":{"gid":24649,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/739730313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":739730313},{"type":"v1","addr":"172.21.15.194:6837","nonce":739730313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/3198777710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3198777710},{"type":"v1","addr":"172.21.15.194:6839","nonce":3198777710}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34619":{"gid":34619,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6833/1194099617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1194099617},{"type":"v1","addr":"172.21.15.38:6833","nonce":1194099617}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34652":{"gid":34652,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.38:6835/218783320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":218783320},{"type":"v1","addr":"172.21.15.38:6835","nonce":218783320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34682":{"gid":34682,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":21,"addr":"172.21.15.38:6837/1821839397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":1821839397},{"type":"v1","addr":"172.21.15.38:6837","nonce":1821839397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34724":{"gid":34724,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.38:6839/458259815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":458259815},{"type":"v1","addr":"172.21.15.38:6839","nonce":458259815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34724,"qdb_cluster":[34724,34682,34652]},"id":1}]} 2024-09-10T23:28:59.658 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 26 2024-09-10T23:28:59.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.661+0000 7f0cabe00640 1 -- 172.21.15.3:0/1495308483 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0c900b5500 msgr2=0x7f0c900b79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:59.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.661+0000 7f0cabe00640 1 --2- 172.21.15.3:0/1495308483 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0c900b5500 0x7f0c900b79c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c009990 tx=0x7f0c9c009110 comp rx=0 tx=0).stop 2024-09-10T23:28:59.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.661+0000 7f0cabe00640 1 -- 172.21.15.3:0/1495308483 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0cac10b180 msgr2=0x7f0cac1a0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:59.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.661+0000 7f0cabe00640 1 --2- 172.21.15.3:0/1495308483 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0cac10b180 0x7f0cac1a0aa0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0ca400cce0 tx=0x7f0ca400a620 comp rx=0 tx=0).stop 2024-09-10T23:28:59.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.661+0000 7f0cabe00640 1 -- 172.21.15.3:0/1495308483 shutdown_connections 2024-09-10T23:28:59.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.661+0000 7f0cabe00640 1 --2- 172.21.15.3:0/1495308483 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0c900b5500 0x7f0c900b79c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.661+0000 7f0cabe00640 1 --2- 172.21.15.3:0/1495308483 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0cac10b180 0x7f0cac1a0aa0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.661+0000 7f0cabe00640 1 --2- 172.21.15.3:0/1495308483 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0cac10a800 0x7f0cac19b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.661+0000 7f0cabe00640 1 --2- 172.21.15.3:0/1495308483 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cac104df0 0x7f0cac19b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:59.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.661+0000 7f0cabe00640 1 -- 172.21.15.3:0/1495308483 >> 172.21.15.3:0/1495308483 conn(0x7f0cac100840 msgr2=0x7f0cac107ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:59.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.662+0000 7f0cabe00640 1 -- 172.21.15.3:0/1495308483 shutdown_connections 2024-09-10T23:28:59.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:28:59.662+0000 7f0cabe00640 1 -- 172.21.15.3:0/1495308483 wait complete. 2024-09-10T23:29:00.463 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34724 quiesce db --set-id 5c006e51 --release --await' 2024-09-10T23:29:00.463 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34724 quiesce db --set-id 5c006e51 --release --await 2024-09-10T23:29:00.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:00 smithi003 ceph-mon[30348]: pgmap v457: 129 pgs: 129 active+clean; 259 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.6 MiB/s wr, 1.03k op/s 2024-09-10T23:29:00.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:00 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1495308483' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:29:00.854 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:29:00.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:00 smithi194 ceph-mon[33904]: pgmap v457: 129 pgs: 129 active+clean; 259 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.6 MiB/s wr, 1.03k op/s 2024-09-10T23:29:00.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:00 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/1495308483' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:29:01.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:00 smithi038 ceph-mon[34225]: pgmap v457: 129 pgs: 129 active+clean; 259 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.6 MiB/s wr, 1.03k op/s 2024-09-10T23:29:01.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:00 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/1495308483' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:29:01.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.422+0000 7ffb73200640 1 -- 172.21.15.3:0/3545821018 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb7410b180 msgr2=0x7ffb74111980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:01.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.422+0000 7ffb73200640 1 --2- 172.21.15.3:0/3545821018 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb7410b180 0x7ffb74111980 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009900 tx=0x7ffb6c02a400 comp rx=0 tx=0).stop 2024-09-10T23:29:01.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.422+0000 7ffb73200640 1 -- 172.21.15.3:0/3545821018 shutdown_connections 2024-09-10T23:29:01.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.422+0000 7ffb73200640 1 --2- 172.21.15.3:0/3545821018 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb7410b180 0x7ffb74111980 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.422+0000 7ffb73200640 1 --2- 172.21.15.3:0/3545821018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb7410a800 0x7ffb7410ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.422+0000 7ffb73200640 1 --2- 172.21.15.3:0/3545821018 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb74104df0 0x7ffb741051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.422+0000 7ffb73200640 1 -- 172.21.15.3:0/3545821018 >> 172.21.15.3:0/3545821018 conn(0x7ffb74100840 msgr2=0x7ffb74102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:01.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.422+0000 7ffb73200640 1 -- 172.21.15.3:0/3545821018 shutdown_connections 2024-09-10T23:29:01.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.423+0000 7ffb73200640 1 -- 172.21.15.3:0/3545821018 wait complete. 2024-09-10T23:29:01.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.423+0000 7ffb73200640 1 Processor -- start 2024-09-10T23:29:01.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.424+0000 7ffb73200640 1 -- start start 2024-09-10T23:29:01.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.424+0000 7ffb73200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb74104df0 0x7ffb7419af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:01.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.424+0000 7ffb73200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb7410a800 0x7ffb7419b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:01.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.424+0000 7ffb73200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb7410b180 0x7ffb741a0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:01.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.424+0000 7ffb73200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ffb74114d00 con 0x7ffb7410a800 2024-09-10T23:29:01.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.424+0000 7ffb73200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ffb74114b80 con 0x7ffb74104df0 2024-09-10T23:29:01.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.424+0000 7ffb73200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ffb74114e80 con 0x7ffb7410b180 2024-09-10T23:29:01.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.424+0000 7ffb69400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb7410a800 0x7ffb7419b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:01.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.424+0000 7ffb69400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb7410a800 0x7ffb7419b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42982/0 (socket says 172.21.15.3:42982) 2024-09-10T23:29:01.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.424+0000 7ffb69400640 1 -- 172.21.15.3:0/3140852596 learned_addr learned my addr 172.21.15.3:0/3140852596 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:29:01.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.424+0000 7ffb72800640 1 --2- 172.21.15.3:0/3140852596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb7410b180 0x7ffb741a0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:01.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.424+0000 7ffb71e00640 1 --2- 172.21.15.3:0/3140852596 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb74104df0 0x7ffb7419af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:01.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.425+0000 7ffb69400640 1 -- 172.21.15.3:0/3140852596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb7410b180 msgr2=0x7ffb741a0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:01.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.425+0000 7ffb69400640 1 --2- 172.21.15.3:0/3140852596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb7410b180 0x7ffb741a0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.425+0000 7ffb69400640 1 -- 172.21.15.3:0/3140852596 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb74104df0 msgr2=0x7ffb7419af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:01.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.425+0000 7ffb69400640 1 --2- 172.21.15.3:0/3140852596 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb74104df0 0x7ffb7419af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.425+0000 7ffb69400640 1 -- 172.21.15.3:0/3140852596 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb741a1020 con 0x7ffb7410a800 2024-09-10T23:29:01.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.425+0000 7ffb71e00640 1 --2- 172.21.15.3:0/3140852596 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb74104df0 0x7ffb7419af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:01.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.425+0000 7ffb69400640 1 --2- 172.21.15.3:0/3140852596 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb7410a800 0x7ffb7419b4b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c00cce0 tx=0x7ffb5c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:01.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.425+0000 7ffb6b400640 1 -- 172.21.15.3:0/3140852596 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c00f650 con 0x7ffb7410a800 2024-09-10T23:29:01.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.425+0000 7ffb6b400640 1 -- 172.21.15.3:0/3140852596 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffb5c00fc80 con 0x7ffb7410a800 2024-09-10T23:29:01.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.425+0000 7ffb73200640 1 -- 172.21.15.3:0/3140852596 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb741a1310 con 0x7ffb7410a800 2024-09-10T23:29:01.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.425+0000 7ffb6b400640 1 -- 172.21.15.3:0/3140852596 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c018ae0 con 0x7ffb7410a800 2024-09-10T23:29:01.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.426+0000 7ffb73200640 1 -- 172.21.15.3:0/3140852596 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb741a79d0 con 0x7ffb7410a800 2024-09-10T23:29:01.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.430+0000 7ffb7b3c6740 1 Processor -- start 2024-09-10T23:29:01.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.430+0000 7ffb7b3c6740 1 -- start start 2024-09-10T23:29:01.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.430+0000 7ffb7b3c6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4c31bb1d0 0x55b4c31bb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:01.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.430+0000 7ffb7b3c6740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b4c31bbaf0 0x55b4c31c7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:01.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.430+0000 7ffb7b3c6740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4c31c7a80 0x55b4c31c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:01.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.430+0000 7ffb7b3c6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b4c3132290 con 0x55b4c31bb1d0 2024-09-10T23:29:01.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.430+0000 7ffb7b3c6740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b4c31216c0 con 0x55b4c31c7a80 2024-09-10T23:29:01.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.430+0000 7ffb7b3c6740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55b4c31254d0 con 0x55b4c31bbaf0 2024-09-10T23:29:01.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.431+0000 7ffb6b400640 1 -- 172.21.15.3:0/3140852596 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 26) ==== 153380+0+0 (secure 0 0 0) 0x7ffb5c018c80 con 0x7ffb7410a800 2024-09-10T23:29:01.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.431+0000 7ffb72800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4c31bb1d0 0x55b4c31bb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:01.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.431+0000 7ffb72800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4c31bb1d0 0x55b4c31bb5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42986/0 (socket says 172.21.15.3:42986) 2024-09-10T23:29:01.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.431+0000 7ffb72800640 1 -- 172.21.15.3:0/884211028 learned_addr learned my addr 172.21.15.3:0/884211028 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:29:01.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.431+0000 7ffb71e00640 1 --2- 172.21.15.3:0/884211028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b4c31bbaf0 0x55b4c31c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:01.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.431+0000 7ffb72800640 1 -- 172.21.15.3:0/884211028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b4c31bbaf0 msgr2=0x55b4c31c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:01.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.431+0000 7ffb72800640 1 --2- 172.21.15.3:0/884211028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b4c31bbaf0 0x55b4c31c7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.431+0000 7ffb72800640 1 -- 172.21.15.3:0/884211028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4c31c7a80 msgr2=0x55b4c31c9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:01.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.431+0000 7ffb72800640 1 --2- 172.21.15.3:0/884211028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4c31c7a80 0x55b4c31c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.431+0000 7ffb72800640 1 -- 172.21.15.3:0/884211028 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4c30ae460 con 0x55b4c31bb1d0 2024-09-10T23:29:01.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.431+0000 7ffb72800640 1 --2- 172.21.15.3:0/884211028 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4c31bb1d0 0x55b4c31bb5b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c033000 tx=0x7ffb6c0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c5fcc065918fe32 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:01.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.432+0000 7ffb63000640 1 -- 172.21.15.3:0/884211028 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c035070 con 0x55b4c31bb1d0 2024-09-10T23:29:01.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.432+0000 7ffb63000640 1 -- 172.21.15.3:0/884211028 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffb6c040030 con 0x55b4c31bb1d0 2024-09-10T23:29:01.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.432+0000 7ffb63000640 1 -- 172.21.15.3:0/884211028 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c03c9c0 con 0x55b4c31bb1d0 2024-09-10T23:29:01.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.432+0000 7ffb7b3c6740 1 -- 172.21.15.3:0/884211028 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4c31bb1d0 msgr2=0x55b4c31bb5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:01.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.432+0000 7ffb7b3c6740 1 --2- 172.21.15.3:0/884211028 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4c31bb1d0 0x55b4c31bb5b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c033000 tx=0x7ffb6c0043b0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.432+0000 7ffb7b3c6740 1 -- 172.21.15.3:0/884211028 shutdown_connections 2024-09-10T23:29:01.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.432+0000 7ffb7b3c6740 1 --2- 172.21.15.3:0/884211028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4c31c7a80 0x55b4c31c9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.432+0000 7ffb7b3c6740 1 --2- 172.21.15.3:0/884211028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b4c31bbaf0 0x55b4c31c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.432+0000 7ffb7b3c6740 1 --2- 172.21.15.3:0/884211028 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4c31bb1d0 0x55b4c31bb5b0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.432+0000 7ffb7b3c6740 1 -- 172.21.15.3:0/884211028 >> 172.21.15.3:0/884211028 conn(0x55b4c31b9000 msgr2=0x55b4c31ba1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:01.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.433+0000 7ffb7b3c6740 1 -- 172.21.15.3:0/884211028 shutdown_connections 2024-09-10T23:29:01.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.433+0000 7ffb6b400640 1 --2- 172.21.15.3:0/3140852596 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ffb580b5410 0x7ffb580b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:01.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.433+0000 7ffb6b400640 1 -- 172.21.15.3:0/3140852596 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7ffb5c0e6870 con 0x7ffb7410a800 2024-09-10T23:29:01.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.433+0000 7ffb7b3c6740 1 -- 172.21.15.3:0/884211028 wait complete. 2024-09-10T23:29:01.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.433+0000 7ffb71e00640 1 --2- 172.21.15.3:0/3140852596 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ffb580b5410 0x7ffb580b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:01.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.433+0000 7ffb7b3c6740 1 -- start start 2024-09-10T23:29:01.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.434+0000 7ffb7b3c6740 1 Processor -- start 2024-09-10T23:29:01.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.434+0000 7ffb71e00640 1 --2- 172.21.15.3:0/3140852596 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ffb580b5410 0x7ffb580b78d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55b4c31be350 tx=0x7ffb6400e520 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:01.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.434+0000 7ffb7b3c6740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4c31bb1d0 0x55b4c31c4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:01.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.434+0000 7ffb7b3c6740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b4c31bbaf0 0x55b4c31c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:01.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.434+0000 7ffb7b3c6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4c31c7a80 0x55b4c31c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:01.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.434+0000 7ffb7b3c6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b4c2f82bb0 con 0x55b4c31c7a80 2024-09-10T23:29:01.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.434+0000 7ffb7b3c6740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b4c30bc6c0 con 0x55b4c31bb1d0 2024-09-10T23:29:01.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.434+0000 7ffb7b3c6740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55b4c31ca6d0 con 0x55b4c31bbaf0 2024-09-10T23:29:01.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.434+0000 7ffb7b3c6740 10 client.0 _ll_register_callbacks cb 0x55b4c30d7490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:01.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.434+0000 7ffb72800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4c31c7a80 0x55b4c31c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:01.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.434+0000 7ffb72800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4c31c7a80 0x55b4c31c54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42988/0 (socket says 172.21.15.3:42988) 2024-09-10T23:29:01.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.434+0000 7ffb72800640 1 -- 172.21.15.3:0/309856830 learned_addr learned my addr 172.21.15.3:0/309856830 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:29:01.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.435+0000 7ffb69400640 1 --2- 172.21.15.3:0/309856830 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b4c31bbaf0 0x55b4c31c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:01.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.435+0000 7ffb71e00640 1 --2- 172.21.15.3:0/309856830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4c31bb1d0 0x55b4c31c4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:01.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.435+0000 7ffb72800640 1 -- 172.21.15.3:0/309856830 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b4c31bbaf0 msgr2=0x55b4c31c4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:01.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.435+0000 7ffb72800640 1 --2- 172.21.15.3:0/309856830 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b4c31bbaf0 0x55b4c31c4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.435+0000 7ffb72800640 1 -- 172.21.15.3:0/309856830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4c31bb1d0 msgr2=0x55b4c31c4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:01.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.435+0000 7ffb72800640 1 --2- 172.21.15.3:0/309856830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4c31bb1d0 0x55b4c31c4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.435+0000 7ffb72800640 1 -- 172.21.15.3:0/309856830 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4c2e7fb00 con 0x55b4c31c7a80 2024-09-10T23:29:01.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.435+0000 7ffb72800640 1 --2- 172.21.15.3:0/309856830 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4c31c7a80 0x55b4c31c54e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009850 tx=0x7ffb6c03c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e27a1dccf48ffd0e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:01.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.435+0000 7ffb57400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-10T23:29:01.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.436+0000 7ffb57400640 1 -- 172.21.15.3:0/309856830 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c035040 con 0x55b4c31c7a80 2024-09-10T23:29:01.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.436+0000 7ffb7b3c6740 1 -- 172.21.15.3:0/309856830 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb6c040030 con 0x55b4c31c7a80 2024-09-10T23:29:01.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.436+0000 7ffb57400640 1 -- 172.21.15.3:0/309856830 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7ffb6c03c990 con 0x55b4c31c7a80 2024-09-10T23:29:01.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.436+0000 7ffb57400640 1 -- 172.21.15.3:0/309856830 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ffb6c03cb90 con 0x55b4c31c7a80 2024-09-10T23:29:01.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.436+0000 7ffb7b3c6740 10 client.15720 fetch_fsmap learned FSMap version 26 2024-09-10T23:29:01.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.436+0000 7ffb7b3c6740 1 -- 172.21.15.3:0/309856830 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b4c2ef6960 con 0x55b4c31c7a80 2024-09-10T23:29:01.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.436+0000 7ffb57400640 1 -- 172.21.15.3:0/309856830 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffb6c040030 con 0x55b4c31c7a80 2024-09-10T23:29:01.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.436+0000 7ffb57400640 1 -- 172.21.15.3:0/309856830 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7ffb6c0454b0 con 0x55b4c31c7a80 2024-09-10T23:29:01.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.437+0000 7ffb7b3c6740 10 client.15720 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:29:01.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.437+0000 7ffb7b3c6740 10 client.15720 resolve_mds: validated gid 34724 aka daemon mds.b 2024-09-10T23:29:01.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.437+0000 7ffb7b3c6740 20 client.15720 populate_metadata read hostname 'smithi003' 2024-09-10T23:29:01.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.437+0000 7ffb7b3c6740 1 --2- 172.21.15.3:0/309856830 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x55b4c31d7460 0x55b4c31d9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:01.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.437+0000 7ffb7b3c6740 4 client.15720 mds_command: new command op to 34724 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:29:01.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.437+0000 7ffb7b3c6740 1 -- 172.21.15.3:0/309856830 --> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4c31341e0 con 0x55b4c31d7460 2024-09-10T23:29:01.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.437+0000 7ffb71e00640 1 --2- 172.21.15.3:0/309856830 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x55b4c31d7460 0x55b4c31d9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:01.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.438+0000 7ffb71e00640 1 --2- 172.21.15.3:0/309856830 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x55b4c31d7460 0x55b4c31d9850 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=805e9cd4859c6225 server_cookie=ed69dd644ce83237 in_seq=0 out_seq=0 2024-09-10T23:29:01.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.438+0000 7ffb57400640 10 client.15720 ms_handle_connect on v2:172.21.15.38:6838/458259815 2024-09-10T23:29:01.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.439+0000 7ffb57400640 1 -- 172.21.15.3:0/309856830 <== mds.0 v2:172.21.15.38:6838/458259815 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b4c31341e0 con 0x55b4c31d7460 2024-09-10T23:29:01.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.439+0000 7ffb57400640 10 client.15720 handle_command_reply: tid=0 2024-09-10T23:29:01.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.439+0000 7ffb7b3c6740 1 client.15720 shutdown 2024-09-10T23:29:01.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.439+0000 7ffb7b3c6740 1 -- 172.21.15.3:0/309856830 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4c31c7a80 msgr2=0x55b4c31c54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:01.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.439+0000 7ffb7b3c6740 1 --2- 172.21.15.3:0/309856830 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4c31c7a80 0x55b4c31c54e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009850 tx=0x7ffb6c03c440 comp rx=0 tx=0).stop 2024-09-10T23:29:01.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.439+0000 7ffb7b3c6740 1 -- 172.21.15.3:0/309856830 shutdown_connections 2024-09-10T23:29:01.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.439+0000 7ffb7b3c6740 1 --2- 172.21.15.3:0/309856830 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x55b4c31d7460 0x55b4c31d9850 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.439+0000 7ffb7b3c6740 1 --2- 172.21.15.3:0/309856830 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4c31c7a80 0x55b4c31c54e0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.439+0000 7ffb7b3c6740 1 --2- 172.21.15.3:0/309856830 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b4c31bbaf0 0x55b4c31c4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.439+0000 7ffb7b3c6740 1 --2- 172.21.15.3:0/309856830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4c31bb1d0 0x55b4c31c4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.439+0000 7ffb57400640 0 client.15720 ms_handle_reset on v2:172.21.15.38:6838/458259815 2024-09-10T23:29:01.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.439+0000 7ffb7b3c6740 1 -- 172.21.15.3:0/309856830 >> 172.21.15.3:0/309856830 conn(0x55b4c31b9000 msgr2=0x55b4c31beba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:01.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.439+0000 7ffb7b3c6740 1 -- 172.21.15.3:0/309856830 shutdown_connections 2024-09-10T23:29:01.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.439+0000 7ffb7b3c6740 1 -- 172.21.15.3:0/309856830 wait complete. 2024-09-10T23:29:01.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.439+0000 7ffb7b3c6740 20 client.15720 trim_cache size 0 max 16384 2024-09-10T23:29:01.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.457+0000 7ffb7b3c6740 1 Processor -- start 2024-09-10T23:29:01.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.457+0000 7ffb7b3c6740 1 -- start start 2024-09-10T23:29:01.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.458+0000 7ffb7b3c6740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4c31bb1d0 0x55b4c31d30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:01.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.458+0000 7ffb7b3c6740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b4c31bbaf0 0x55b4c31c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:01.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.458+0000 7ffb7b3c6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4c31c7a80 0x55b4c31c21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:01.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.458+0000 7ffb7b3c6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ffb741b4360 con 0x55b4c31c7a80 2024-09-10T23:29:01.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.458+0000 7ffb7b3c6740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ffb741b1c30 con 0x55b4c31bb1d0 2024-09-10T23:29:01.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.458+0000 7ffb7b3c6740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ffb741afa80 con 0x55b4c31bbaf0 2024-09-10T23:29:01.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.458+0000 7ffb72800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4c31c7a80 0x55b4c31c21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:01.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.458+0000 7ffb72800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4c31c7a80 0x55b4c31c21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42994/0 (socket says 172.21.15.3:42994) 2024-09-10T23:29:01.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.458+0000 7ffb72800640 1 -- 172.21.15.3:0/2977310139 learned_addr learned my addr 172.21.15.3:0/2977310139 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:29:01.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.458+0000 7ffb71e00640 1 --2- 172.21.15.3:0/2977310139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4c31bb1d0 0x55b4c31d30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:01.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.458+0000 7ffb69400640 1 --2- 172.21.15.3:0/2977310139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b4c31bbaf0 0x55b4c31c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:01.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.458+0000 7ffb72800640 1 -- 172.21.15.3:0/2977310139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b4c31bbaf0 msgr2=0x55b4c31c1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:01.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.458+0000 7ffb72800640 1 --2- 172.21.15.3:0/2977310139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b4c31bbaf0 0x55b4c31c1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.458+0000 7ffb72800640 1 -- 172.21.15.3:0/2977310139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4c31bb1d0 msgr2=0x55b4c31d30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:01.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.458+0000 7ffb72800640 1 --2- 172.21.15.3:0/2977310139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4c31bb1d0 0x55b4c31d30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.458+0000 7ffb72800640 1 -- 172.21.15.3:0/2977310139 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4c31b9a80 con 0x55b4c31c7a80 2024-09-10T23:29:01.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.459+0000 7ffb72800640 1 --2- 172.21.15.3:0/2977310139 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4c31c7a80 0x55b4c31c21d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c0092a0 tx=0x7ffb6c0095a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ef769196e8a8d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:01.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.459+0000 7ffb62600640 1 -- 172.21.15.3:0/2977310139 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c035040 con 0x55b4c31c7a80 2024-09-10T23:29:01.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.459+0000 7ffb62600640 1 -- 172.21.15.3:0/2977310139 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffb6c040070 con 0x55b4c31c7a80 2024-09-10T23:29:01.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.459+0000 7ffb62600640 1 -- 172.21.15.3:0/2977310139 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c045680 con 0x55b4c31c7a80 2024-09-10T23:29:01.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.460+0000 7ffb7b3c6740 1 -- 172.21.15.3:0/2977310139 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4c31c7a80 msgr2=0x55b4c31c21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:01.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.460+0000 7ffb7b3c6740 1 --2- 172.21.15.3:0/2977310139 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4c31c7a80 0x55b4c31c21d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c0092a0 tx=0x7ffb6c0095a0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.460+0000 7ffb7b3c6740 1 -- 172.21.15.3:0/2977310139 shutdown_connections 2024-09-10T23:29:01.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.460+0000 7ffb7b3c6740 1 --2- 172.21.15.3:0/2977310139 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4c31c7a80 0x55b4c31c21d0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.460+0000 7ffb7b3c6740 1 --2- 172.21.15.3:0/2977310139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b4c31bbaf0 0x55b4c31c1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.460+0000 7ffb7b3c6740 1 --2- 172.21.15.3:0/2977310139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4c31bb1d0 0x55b4c31d30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.460+0000 7ffb7b3c6740 1 -- 172.21.15.3:0/2977310139 >> 172.21.15.3:0/2977310139 conn(0x55b4c31b9000 msgr2=0x55b4c31d2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:01.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.460+0000 7ffb7b3c6740 1 -- 172.21.15.3:0/2977310139 shutdown_connections 2024-09-10T23:29:01.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.460+0000 7ffb7b3c6740 1 -- 172.21.15.3:0/2977310139 wait complete. 2024-09-10T23:29:01.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.460+0000 7ffb7b3c6740 1 -- start start 2024-09-10T23:29:01.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.461+0000 7ffb7b3c6740 1 Processor -- start 2024-09-10T23:29:01.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.461+0000 7ffb7b3c6740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b4c31bb1d0 0x55b4c31dd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:01.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.461+0000 7ffb7b3c6740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4c31bbaf0 0x55b4c31db7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:01.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.461+0000 7ffb7b3c6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4c31c7a80 0x55b4c31dbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:01.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.461+0000 7ffb7b3c6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ffb741b00f0 con 0x55b4c31c7a80 2024-09-10T23:29:01.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.461+0000 7ffb7b3c6740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ffb741b1560 con 0x55b4c31bbaf0 2024-09-10T23:29:01.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.461+0000 7ffb7b3c6740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ffb741b07c0 con 0x55b4c31bb1d0 2024-09-10T23:29:01.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.461+0000 7ffb7b3c6740 10 client.0 _ll_register_callbacks cb 0x7ffb6c004300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:01.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.461+0000 7ffb72800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4c31c7a80 0x55b4c31dbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:01.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.461+0000 7ffb72800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4c31c7a80 0x55b4c31dbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42998/0 (socket says 172.21.15.3:42998) 2024-09-10T23:29:01.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.461+0000 7ffb72800640 1 -- 172.21.15.3:0/1307252899 learned_addr learned my addr 172.21.15.3:0/1307252899 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:29:01.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.461+0000 7ffb69400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4c31bbaf0 0x55b4c31db7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:01.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.462+0000 7ffb71e00640 1 --2- 172.21.15.3:0/1307252899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b4c31bb1d0 0x55b4c31dd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:01.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.462+0000 7ffb72800640 1 -- 172.21.15.3:0/1307252899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b4c31bb1d0 msgr2=0x55b4c31dd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:01.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.462+0000 7ffb72800640 1 --2- 172.21.15.3:0/1307252899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b4c31bb1d0 0x55b4c31dd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.462+0000 7ffb72800640 1 -- 172.21.15.3:0/1307252899 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4c31bbaf0 msgr2=0x55b4c31db7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:01.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.462+0000 7ffb72800640 1 --2- 172.21.15.3:0/1307252899 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4c31bbaf0 0x55b4c31db7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.462+0000 7ffb72800640 1 -- 172.21.15.3:0/1307252899 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4c3243fe0 con 0x55b4c31c7a80 2024-09-10T23:29:01.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.462+0000 7ffb71e00640 1 --2- 172.21.15.3:0/1307252899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b4c31bb1d0 0x55b4c31dd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:01.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.462+0000 7ffb72800640 1 --2- 172.21.15.3:0/1307252899 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4c31c7a80 0x55b4c31dbf40 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c0058c0 tx=0x7ffb6c045650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ce3e724f92a2593 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:01.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.462+0000 7ffb57400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-10T23:29:01.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.463+0000 7ffb57400640 1 -- 172.21.15.3:0/1307252899 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c035070 con 0x55b4c31c7a80 2024-09-10T23:29:01.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.463+0000 7ffb7b3c6740 1 -- 172.21.15.3:0/1307252899 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb6c040070 con 0x55b4c31c7a80 2024-09-10T23:29:01.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.463+0000 7ffb57400640 1 -- 172.21.15.3:0/1307252899 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7ffb6c045c00 con 0x55b4c31c7a80 2024-09-10T23:29:01.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.463+0000 7ffb57400640 1 -- 172.21.15.3:0/1307252899 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ffb6c06c050 con 0x55b4c31c7a80 2024-09-10T23:29:01.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.463+0000 7ffb7b3c6740 10 client.15726 fetch_fsmap learned FSMap version 26 2024-09-10T23:29:01.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.463+0000 7ffb7b3c6740 1 -- 172.21.15.3:0/1307252899 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b4c32452f0 con 0x55b4c31c7a80 2024-09-10T23:29:01.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.463+0000 7ffb57400640 1 -- 172.21.15.3:0/1307252899 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffb6c040070 con 0x55b4c31c7a80 2024-09-10T23:29:01.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.463+0000 7ffb57400640 1 -- 172.21.15.3:0/1307252899 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7ffb6c05c430 con 0x55b4c31c7a80 2024-09-10T23:29:01.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.463+0000 7ffb7b3c6740 10 client.15726 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:29:01.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.463+0000 7ffb7b3c6740 10 client.15726 resolve_mds: validated gid 34724 aka daemon mds.b 2024-09-10T23:29:01.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.463+0000 7ffb7b3c6740 20 client.15726 populate_metadata read hostname 'smithi003' 2024-09-10T23:29:01.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.463+0000 7ffb7b3c6740 1 --2- 172.21.15.3:0/1307252899 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x55b4c32457c0 0x55b4c3247bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:01.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.463+0000 7ffb7b3c6740 4 client.15726 mds_command: new command op to 34724 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "5c006e51", "release": true, "await": true}] 2024-09-10T23:29:01.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.463+0000 7ffb7b3c6740 1 -- 172.21.15.3:0/1307252899 --> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] -- command(tid 0: {"prefix": "quiesce db", "set_id": "5c006e51", "release": true, "await": true}) -- 0x55b4c312fc90 con 0x55b4c32457c0 2024-09-10T23:29:01.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.464+0000 7ffb71e00640 1 --2- 172.21.15.3:0/1307252899 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x55b4c32457c0 0x55b4c3247bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:01.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.464+0000 7ffb71e00640 1 --2- 172.21.15.3:0/1307252899 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x55b4c32457c0 0x55b4c3247bb0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5c07af4e89265fa server_cookie=59a9fadb66823885 in_seq=0 out_seq=0 2024-09-10T23:29:01.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.464+0000 7ffb57400640 10 client.15726 ms_handle_connect on v2:172.21.15.38:6838/458259815 2024-09-10T23:29:01.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.467+0000 7ffb57400640 1 -- 172.21.15.3:0/1307252899 <== mds.0 v2:172.21.15.38:6838/458259815 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55b4c312fc90 con 0x55b4c32457c0 2024-09-10T23:29:01.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.467+0000 7ffb57400640 10 client.15726 handle_command_reply: tid=0 2024-09-10T23:29:01.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.467+0000 7ffb7b3c6740 1 client.15726 shutdown 2024-09-10T23:29:01.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.467+0000 7ffb7b3c6740 1 -- 172.21.15.3:0/1307252899 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4c31c7a80 msgr2=0x55b4c31dbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:01.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.467+0000 7ffb7b3c6740 1 --2- 172.21.15.3:0/1307252899 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4c31c7a80 0x55b4c31dbf40 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c0058c0 tx=0x7ffb6c045650 comp rx=0 tx=0).stop 2024-09-10T23:29:01.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.468+0000 7ffb7b3c6740 1 -- 172.21.15.3:0/1307252899 shutdown_connections 2024-09-10T23:29:01.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.468+0000 7ffb7b3c6740 1 --2- 172.21.15.3:0/1307252899 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x55b4c32457c0 0x55b4c3247bb0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.468+0000 7ffb7b3c6740 1 --2- 172.21.15.3:0/1307252899 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4c31c7a80 0x55b4c31dbf40 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.468+0000 7ffb7b3c6740 1 --2- 172.21.15.3:0/1307252899 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b4c31bbaf0 0x55b4c31db7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.468+0000 7ffb7b3c6740 1 --2- 172.21.15.3:0/1307252899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b4c31bb1d0 0x55b4c31dd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.468+0000 7ffb57400640 0 client.15726 ms_handle_reset on v2:172.21.15.38:6838/458259815 2024-09-10T23:29:01.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.468+0000 7ffb7b3c6740 1 -- 172.21.15.3:0/1307252899 >> 172.21.15.3:0/1307252899 conn(0x55b4c31b9000 msgr2=0x55b4c31d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:01.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.468+0000 7ffb7b3c6740 1 -- 172.21.15.3:0/1307252899 shutdown_connections 2024-09-10T23:29:01.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.468+0000 7ffb7b3c6740 1 -- 172.21.15.3:0/1307252899 wait complete. 2024-09-10T23:29:01.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.468+0000 7ffb7b3c6740 20 client.15726 trim_cache size 0 max 16384 2024-09-10T23:29:01.470 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-10T23:29:01.470 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 26, 2024-09-10T23:29:01.471 INFO:teuthology.orchestra.run.smithi003.stdout: "leader": 34724, 2024-09-10T23:29:01.471 INFO:teuthology.orchestra.run.smithi003.stdout: "set_version": 8, 2024-09-10T23:29:01.471 INFO:teuthology.orchestra.run.smithi003.stdout: "sets": { 2024-09-10T23:29:01.471 INFO:teuthology.orchestra.run.smithi003.stdout: "5c006e51": { 2024-09-10T23:29:01.471 INFO:teuthology.orchestra.run.smithi003.stdout: "version": 8, 2024-09-10T23:29:01.471 INFO:teuthology.orchestra.run.smithi003.stdout: "age_ref": 0.0, 2024-09-10T23:29:01.471 INFO:teuthology.orchestra.run.smithi003.stdout: "state": { 2024-09-10T23:29:01.471 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "RELEASED", 2024-09-10T23:29:01.471 INFO:teuthology.orchestra.run.smithi003.stdout: "age": 0.0 2024-09-10T23:29:01.471 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:29:01.471 INFO:teuthology.orchestra.run.smithi003.stdout: "timeout": 90.0, 2024-09-10T23:29:01.471 INFO:teuthology.orchestra.run.smithi003.stdout: "expiration": 140.5, 2024-09-10T23:29:01.471 INFO:teuthology.orchestra.run.smithi003.stdout: "members": { 2024-09-10T23:29:01.472 INFO:teuthology.orchestra.run.smithi003.stdout: "file:/": { 2024-09-10T23:29:01.472 INFO:teuthology.orchestra.run.smithi003.stdout: "excluded": false, 2024-09-10T23:29:01.472 INFO:teuthology.orchestra.run.smithi003.stdout: "state": { 2024-09-10T23:29:01.472 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "RELEASED", 2024-09-10T23:29:01.472 INFO:teuthology.orchestra.run.smithi003.stdout: "age": 0.0 2024-09-10T23:29:01.472 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:29:01.472 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:29:01.472 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:29:01.472 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:29:01.472 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:29:01.472 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-10T23:29:01.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.469+0000 7ffb73200640 1 -- 172.21.15.3:0/3140852596 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ffb580b5410 msgr2=0x7ffb580b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:01.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.469+0000 7ffb73200640 1 --2- 172.21.15.3:0/3140852596 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ffb580b5410 0x7ffb580b78d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55b4c31be350 tx=0x7ffb6400e520 comp rx=0 tx=0).stop 2024-09-10T23:29:01.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.469+0000 7ffb73200640 1 -- 172.21.15.3:0/3140852596 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb7410a800 msgr2=0x7ffb7419b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:01.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.469+0000 7ffb73200640 1 --2- 172.21.15.3:0/3140852596 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb7410a800 0x7ffb7419b4b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c00cce0 tx=0x7ffb5c00a620 comp rx=0 tx=0).stop 2024-09-10T23:29:01.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.470+0000 7ffb73200640 1 -- 172.21.15.3:0/3140852596 shutdown_connections 2024-09-10T23:29:01.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.470+0000 7ffb73200640 1 --2- 172.21.15.3:0/3140852596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb7410b180 0x7ffb741a0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.470+0000 7ffb73200640 1 --2- 172.21.15.3:0/3140852596 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ffb580b5410 0x7ffb580b78d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.470+0000 7ffb73200640 1 --2- 172.21.15.3:0/3140852596 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb7410a800 0x7ffb7419b4b0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.470+0000 7ffb73200640 1 --2- 172.21.15.3:0/3140852596 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb74104df0 0x7ffb7419af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.470+0000 7ffb73200640 1 -- 172.21.15.3:0/3140852596 >> 172.21.15.3:0/3140852596 conn(0x7ffb74100840 msgr2=0x7ffb74100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:01.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.470+0000 7ffb73200640 1 -- 172.21.15.3:0/3140852596 shutdown_connections 2024-09-10T23:29:01.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:01.470+0000 7ffb73200640 1 -- 172.21.15.3:0/3140852596 wait complete. 2024-09-10T23:29:02.482 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '5c006e51', total seconds elapsed: 24.6 2024-09-10T23:29:02.482 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.5 2024-09-10T23:29:02.482 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:29:02.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:02 smithi194 ceph-mon[33904]: pgmap v458: 129 pgs: 129 active+clean; 259 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.7 MiB/s wr, 336 op/s 2024-09-10T23:29:02.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:02 smithi003 ceph-mon[30348]: pgmap v458: 129 pgs: 129 active+clean; 259 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.7 MiB/s wr, 336 op/s 2024-09-10T23:29:03.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:02 smithi038 ceph-mon[34225]: pgmap v458: 129 pgs: 129 active+clean; 259 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.7 MiB/s wr, 336 op/s 2024-09-10T23:29:03.187 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:29:03.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.946+0000 7f4149800640 1 -- 172.21.15.3:0/958095806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4144104fc0 msgr2=0x7f41441053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:03.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.946+0000 7f4149800640 1 --2- 172.21.15.3:0/958095806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4144104fc0 0x7f41441053a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4130009860 tx=0x7f413002a340 comp rx=0 tx=0).stop 2024-09-10T23:29:03.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.947+0000 7f4149800640 1 -- 172.21.15.3:0/958095806 shutdown_connections 2024-09-10T23:29:03.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.947+0000 7f4149800640 1 --2- 172.21.15.3:0/958095806 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f414410b350 0x7f4144111b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:03.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.947+0000 7f4149800640 1 --2- 172.21.15.3:0/958095806 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f414410a9d0 0x7f414410ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:03.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.947+0000 7f4149800640 1 --2- 172.21.15.3:0/958095806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4144104fc0 0x7f41441053a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:03.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.947+0000 7f4149800640 1 -- 172.21.15.3:0/958095806 >> 172.21.15.3:0/958095806 conn(0x7f41441009f0 msgr2=0x7f4144102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:03.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.948+0000 7f4149800640 1 -- 172.21.15.3:0/958095806 shutdown_connections 2024-09-10T23:29:03.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.948+0000 7f4149800640 1 -- 172.21.15.3:0/958095806 wait complete. 2024-09-10T23:29:03.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.949+0000 7f4149800640 1 Processor -- start 2024-09-10T23:29:03.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.952+0000 7f4149800640 1 -- start start 2024-09-10T23:29:03.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.954+0000 7f4149800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4144104fc0 0x7f41440747e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:03.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.954+0000 7f4149800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f414410a9d0 0x7f4144074d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:03.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.955+0000 7f4149800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f414410b350 0x7f414406eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:03.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.955+0000 7f4142a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4144104fc0 0x7f41440747e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:03.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.955+0000 7f4142000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f414410a9d0 0x7f4144074d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:03.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.955+0000 7f4142000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f414410a9d0 0x7f4144074d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.3:54654/0 (socket says 172.21.15.3:54654) 2024-09-10T23:29:03.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.956+0000 7f4149800640 1 -- 172.21.15.3:0/1305381306 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f414406d2d0 con 0x7f4144104fc0 2024-09-10T23:29:03.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.955+0000 7f4142000640 1 -- 172.21.15.3:0/1305381306 learned_addr learned my addr 172.21.15.3:0/1305381306 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:29:03.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.957+0000 7f4143400640 1 --2- 172.21.15.3:0/1305381306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f414410b350 0x7f414406eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:03.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.957+0000 7f4149800640 1 -- 172.21.15.3:0/1305381306 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f414406d150 con 0x7f414410a9d0 2024-09-10T23:29:03.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.957+0000 7f4149800640 1 -- 172.21.15.3:0/1305381306 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f414406d450 con 0x7f414410b350 2024-09-10T23:29:03.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.958+0000 7f4142000640 1 -- 172.21.15.3:0/1305381306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f414410b350 msgr2=0x7f414406eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:03.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.958+0000 7f4142000640 1 --2- 172.21.15.3:0/1305381306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f414410b350 0x7f414406eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:03.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.958+0000 7f4142000640 1 -- 172.21.15.3:0/1305381306 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4144104fc0 msgr2=0x7f41440747e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:03.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.958+0000 7f4142000640 1 --2- 172.21.15.3:0/1305381306 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4144104fc0 0x7f41440747e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:03.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.958+0000 7f4142000640 1 -- 172.21.15.3:0/1305381306 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f414406f430 con 0x7f414410a9d0 2024-09-10T23:29:03.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.959+0000 7f4142000640 1 --2- 172.21.15.3:0/1305381306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f414410a9d0 0x7f4144074d20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f413400d950 tx=0x7f413400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:03.961 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.960+0000 7f413b400640 1 -- 172.21.15.3:0/1305381306 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4134017070 con 0x7f414410a9d0 2024-09-10T23:29:03.963 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.963+0000 7f4149800640 1 -- 172.21.15.3:0/1305381306 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f414406f720 con 0x7f414410a9d0 2024-09-10T23:29:03.963 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.963+0000 7f4149800640 1 -- 172.21.15.3:0/1305381306 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41441b06d0 con 0x7f414410a9d0 2024-09-10T23:29:03.963 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.963+0000 7f413b400640 1 -- 172.21.15.3:0/1305381306 <== mon.2 v2:172.21.15.38:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4134009c30 con 0x7f414410a9d0 2024-09-10T23:29:03.963 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.963+0000 7f413b400640 1 -- 172.21.15.3:0/1305381306 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413400f620 con 0x7f414410a9d0 2024-09-10T23:29:03.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.969+0000 7f413b400640 1 -- 172.21.15.3:0/1305381306 <== mon.2 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 26) ==== 153380+0+0 (secure 0 0 0) 0x7f4134010460 con 0x7f414410a9d0 2024-09-10T23:29:03.975 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.971+0000 7f4149800640 1 -- 172.21.15.3:0/1305381306 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41240052c0 con 0x7f414410a9d0 2024-09-10T23:29:03.976 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.974+0000 7f413b400640 1 --2- 172.21.15.3:0/1305381306 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f41280b55d0 0x7f41280b7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:03.976 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.975+0000 7f413b400640 1 -- 172.21.15.3:0/1305381306 <== mon.2 v2:172.21.15.38:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f41340e5c50 con 0x7f414410a9d0 2024-09-10T23:29:03.976 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.975+0000 7f4142a00640 1 --2- 172.21.15.3:0/1305381306 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f41280b55d0 0x7f41280b7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:03.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.977+0000 7f4142a00640 1 --2- 172.21.15.3:0/1305381306 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f41280b55d0 0x7f41280b7a90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4130009830 tx=0x7f4130005c90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:03.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:03.978+0000 7f413b400640 1 -- 172.21.15.3:0/1305381306 <== mon.2 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f41340eb020 con 0x7f414410a9d0 2024-09-10T23:29:04.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:04.467+0000 7f4149800640 1 -- 172.21.15.3:0/1305381306 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4124005880 con 0x7f414410a9d0 2024-09-10T23:29:04.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:04.469+0000 7f413b400640 1 -- 172.21.15.3:0/1305381306 <== mon.2 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11891 (secure 0 0 0) 0x7f4134009de0 con 0x7f414410a9d0 2024-09-10T23:29:04.473 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:29:04.473 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 26 2024-09-10T23:29:04.474 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":26,"btime":"2024-09-10T23:26:42:260644+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/1495411512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":1495411512},{"type":"v1","addr":"172.21.15.3:6835","nonce":1495411512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/1857372777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1857372777},{"type":"v1","addr":"172.21.15.3:6837","nonce":1857372777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14862,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6839/493850676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":493850676},{"type":"v1","addr":"172.21.15.3:6839","nonce":493850676}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14874,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6841/1580524358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":1580524358},{"type":"v1","addr":"172.21.15.3:6841","nonce":1580524358}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/352514665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":352514665},{"type":"v1","addr":"172.21.15.194:6833","nonce":352514665}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2380508105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2380508105},{"type":"v1","addr":"172.21.15.194:6835","nonce":2380508105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:23:58.866253+0000","modified":"2024-09-10T23:26:41.694795+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34724,"mds_1":34682,"mds_2":34652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24649":{"gid":24649,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/739730313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":739730313},{"type":"v1","addr":"172.21.15.194:6837","nonce":739730313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/3198777710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3198777710},{"type":"v1","addr":"172.21.15.194:6839","nonce":3198777710}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34619":{"gid":34619,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6833/1194099617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1194099617},{"type":"v1","addr":"172.21.15.38:6833","nonce":1194099617}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34652":{"gid":34652,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.38:6835/218783320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":218783320},{"type":"v1","addr":"172.21.15.38:6835","nonce":218783320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34682":{"gid":34682,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":21,"addr":"172.21.15.38:6837/1821839397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":1821839397},{"type":"v1","addr":"172.21.15.38:6837","nonce":1821839397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34724":{"gid":34724,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.38:6839/458259815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":458259815},{"type":"v1","addr":"172.21.15.38:6839","nonce":458259815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34724,"qdb_cluster":[34724,34682,34652]},"id":1}]} 2024-09-10T23:29:04.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:04.473+0000 7f4149800640 1 -- 172.21.15.3:0/1305381306 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f41280b55d0 msgr2=0x7f41280b7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:04.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:04.473+0000 7f4149800640 1 --2- 172.21.15.3:0/1305381306 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f41280b55d0 0x7f41280b7a90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4130009830 tx=0x7f4130005c90 comp rx=0 tx=0).stop 2024-09-10T23:29:04.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:04.474+0000 7f4149800640 1 -- 172.21.15.3:0/1305381306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f414410a9d0 msgr2=0x7f4144074d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:04.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:04.474+0000 7f4149800640 1 --2- 172.21.15.3:0/1305381306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f414410a9d0 0x7f4144074d20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f413400d950 tx=0x7f413400de10 comp rx=0 tx=0).stop 2024-09-10T23:29:04.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:04.474+0000 7f4149800640 1 -- 172.21.15.3:0/1305381306 shutdown_connections 2024-09-10T23:29:04.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:04.474+0000 7f4149800640 1 --2- 172.21.15.3:0/1305381306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f414410b350 0x7f414406eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:04.474+0000 7f4149800640 1 --2- 172.21.15.3:0/1305381306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f414410a9d0 0x7f4144074d20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:04.474+0000 7f4149800640 1 --2- 172.21.15.3:0/1305381306 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f41280b55d0 0x7f41280b7a90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:04.474+0000 7f4149800640 1 --2- 172.21.15.3:0/1305381306 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4144104fc0 0x7f41440747e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:04.474+0000 7f4149800640 1 -- 172.21.15.3:0/1305381306 >> 172.21.15.3:0/1305381306 conn(0x7f41441009f0 msgr2=0x7f4144101380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:04.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:04.474+0000 7f4149800640 1 -- 172.21.15.3:0/1305381306 shutdown_connections 2024-09-10T23:29:04.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:04.474+0000 7f4149800640 1 -- 172.21.15.3:0/1305381306 wait complete. 2024-09-10T23:29:04.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:04 smithi003 ceph-mon[30348]: pgmap v459: 129 pgs: 129 active+clean; 263 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 MiB/s wr, 340 op/s 2024-09-10T23:29:04.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:04 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1305381306' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:29:04.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:04 smithi194 ceph-mon[33904]: pgmap v459: 129 pgs: 129 active+clean; 263 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 MiB/s wr, 340 op/s 2024-09-10T23:29:04.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:04 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/1305381306' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:29:05.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:04 smithi038 ceph-mon[34225]: pgmap v459: 129 pgs: 129 active+clean; 263 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 MiB/s wr, 340 op/s 2024-09-10T23:29:05.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:04 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/1305381306' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:29:05.473 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34724 quiesce db / --timeout 90 --expiration 140.5 --await-for 45.0' 2024-09-10T23:29:05.473 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34724 quiesce db / --timeout 90 --expiration 140.5 --await-for 45.0 2024-09-10T23:29:05.681 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:05 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:29:05.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:05 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:29:06.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:05 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:29:06.259 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:29:06.684 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:06 smithi003 ceph-mon[30348]: pgmap v460: 129 pgs: 129 active+clean; 265 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 842 KiB/s wr, 214 op/s 2024-09-10T23:29:06.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:06 smithi194 ceph-mon[33904]: pgmap v460: 129 pgs: 129 active+clean; 265 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 842 KiB/s wr, 214 op/s 2024-09-10T23:29:06.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:06 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:29:06.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:06 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:29:06.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:06 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:29:06.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:06 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:29:06.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:06 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:29:06.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:06 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:29:07.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.062+0000 7ff785600640 1 -- 172.21.15.3:0/2808018292 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff774037070 con 0x7ff78810a530 2024-09-10T23:29:07.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.063+0000 7ff78d600640 1 -- 172.21.15.3:0/2808018292 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff78810a530 msgr2=0x7ff78810a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:07.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.063+0000 7ff78d600640 1 --2- 172.21.15.3:0/2808018292 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff78810a530 0x7ff78810a970 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff774009860 tx=0x7ff77402a360 comp rx=0 tx=0).stop 2024-09-10T23:29:07.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.064+0000 7ff78d600640 1 -- 172.21.15.3:0/2808018292 shutdown_connections 2024-09-10T23:29:07.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.064+0000 7ff78d600640 1 --2- 172.21.15.3:0/2808018292 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff78811c0a0 0x7ff78811e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.064+0000 7ff78d600640 1 --2- 172.21.15.3:0/2808018292 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff78810a530 0x7ff78810a970 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.064+0000 7ff78d600640 1 --2- 172.21.15.3:0/2808018292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff78810a150 0x7ff7881111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.064+0000 7ff78d600640 1 -- 172.21.15.3:0/2808018292 >> 172.21.15.3:0/2808018292 conn(0x7ff78806e410 msgr2=0x7ff78806e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:07.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.065+0000 7ff78d600640 1 -- 172.21.15.3:0/2808018292 shutdown_connections 2024-09-10T23:29:07.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.065+0000 7ff78d600640 1 -- 172.21.15.3:0/2808018292 wait complete. 2024-09-10T23:29:07.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.066+0000 7ff78d600640 1 Processor -- start 2024-09-10T23:29:07.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.067+0000 7ff78d600640 1 -- start start 2024-09-10T23:29:07.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.069+0000 7ff78d600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff78810a150 0x7ff7881a8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:07.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.069+0000 7ff78d600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff78810a530 0x7ff7881a8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:07.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.069+0000 7ff78d600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff78811c0a0 0x7ff7881ad920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:07.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.069+0000 7ff78d600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff788121a10 con 0x7ff78810a530 2024-09-10T23:29:07.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.069+0000 7ff787400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff78811c0a0 0x7ff7881ad920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:07.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.069+0000 7ff787400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff78811c0a0 0x7ff7881ad920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.3:54678/0 (socket says 172.21.15.3:54678) 2024-09-10T23:29:07.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.069+0000 7ff787400640 1 -- 172.21.15.3:0/1503568563 learned_addr learned my addr 172.21.15.3:0/1503568563 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:29:07.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.069+0000 7ff786a00640 1 --2- 172.21.15.3:0/1503568563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff78810a150 0x7ff7881a8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:07.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.070+0000 7ff78d600640 1 -- 172.21.15.3:0/1503568563 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff788121890 con 0x7ff78811c0a0 2024-09-10T23:29:07.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.070+0000 7ff78d600640 1 -- 172.21.15.3:0/1503568563 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff788121b90 con 0x7ff78810a150 2024-09-10T23:29:07.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.070+0000 7ff786000640 1 --2- 172.21.15.3:0/1503568563 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff78810a530 0x7ff7881a8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:07.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.071+0000 7ff786000640 1 -- 172.21.15.3:0/1503568563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff78810a150 msgr2=0x7ff7881a8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:07.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.071+0000 7ff786000640 1 --2- 172.21.15.3:0/1503568563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff78810a150 0x7ff7881a8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.071+0000 7ff786000640 1 -- 172.21.15.3:0/1503568563 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff78811c0a0 msgr2=0x7ff7881ad920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:07.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.071+0000 7ff786000640 1 --2- 172.21.15.3:0/1503568563 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff78811c0a0 0x7ff7881ad920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.071+0000 7ff786000640 1 -- 172.21.15.3:0/1503568563 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7881ae0f0 con 0x7ff78810a530 2024-09-10T23:29:07.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.071+0000 7ff787400640 1 --2- 172.21.15.3:0/1503568563 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff78811c0a0 0x7ff7881ad920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:29:07.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.072+0000 7ff786000640 1 --2- 172.21.15.3:0/1503568563 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff78810a530 0x7ff7881a8580 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff774035040 tx=0x7ff774032cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:07.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.073+0000 7ff77f400640 1 -- 172.21.15.3:0/1503568563 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff774037040 con 0x7ff78810a530 2024-09-10T23:29:07.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.073+0000 7ff77f400640 1 -- 172.21.15.3:0/1503568563 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff7740044d0 con 0x7ff78810a530 2024-09-10T23:29:07.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.073+0000 7ff78d600640 1 -- 172.21.15.3:0/1503568563 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7881ae380 con 0x7ff78810a530 2024-09-10T23:29:07.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.073+0000 7ff78d600640 1 -- 172.21.15.3:0/1503568563 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7881b4aa0 con 0x7ff78810a530 2024-09-10T23:29:07.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.074+0000 7ff77f400640 1 -- 172.21.15.3:0/1503568563 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff774030970 con 0x7ff78810a530 2024-09-10T23:29:07.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.082+0000 7ff77f400640 1 -- 172.21.15.3:0/1503568563 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 26) ==== 153380+0+0 (secure 0 0 0) 0x7ff774004040 con 0x7ff78810a530 2024-09-10T23:29:07.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.082+0000 7ff790205740 1 Processor -- start 2024-09-10T23:29:07.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.083+0000 7ff790205740 1 -- start start 2024-09-10T23:29:07.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.084+0000 7ff790205740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560479fe3180 0x560479fe3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:07.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.084+0000 7ff790205740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560479fe3aa0 0x560479fef4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:07.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.084+0000 7ff790205740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560479fefa30 0x560479ff1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:07.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.084+0000 7ff790205740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x560479f58ca0 con 0x560479fe3aa0 2024-09-10T23:29:07.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.084+0000 7ff790205740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x560479f480d0 con 0x560479fe3180 2024-09-10T23:29:07.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.084+0000 7ff790205740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x560479f4bee0 con 0x560479fefa30 2024-09-10T23:29:07.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.085+0000 7ff786a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560479fe3aa0 0x560479fef4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:07.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.085+0000 7ff786a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560479fe3aa0 0x560479fef4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43050/0 (socket says 172.21.15.3:43050) 2024-09-10T23:29:07.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.085+0000 7ff786a00640 1 -- 172.21.15.3:0/1841756323 learned_addr learned my addr 172.21.15.3:0/1841756323 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:29:07.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.086+0000 7ff787400640 1 --2- 172.21.15.3:0/1841756323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560479fe3180 0x560479fe3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:07.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.086+0000 7ff786000640 1 --2- 172.21.15.3:0/1841756323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560479fefa30 0x560479ff1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:07.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.086+0000 7ff786000640 1 -- 172.21.15.3:0/1841756323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560479fe3180 msgr2=0x560479fe3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:07.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.086+0000 7ff786000640 1 --2- 172.21.15.3:0/1841756323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560479fe3180 0x560479fe3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.086+0000 7ff786000640 1 -- 172.21.15.3:0/1841756323 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560479fe3aa0 msgr2=0x560479fef4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:07.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.086+0000 7ff77f400640 1 --2- 172.21.15.3:0/1503568563 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff76c0b54d0 0x7ff76c0b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:07.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.086+0000 7ff786000640 1 --2- 172.21.15.3:0/1841756323 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560479fe3aa0 0x560479fef4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.086+0000 7ff786000640 1 -- 172.21.15.3:0/1841756323 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560479efa400 con 0x560479fefa30 2024-09-10T23:29:07.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.087+0000 7ff77f400640 1 -- 172.21.15.3:0/1503568563 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7ff774105360 con 0x7ff78810a530 2024-09-10T23:29:07.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.087+0000 7ff786000640 1 --2- 172.21.15.3:0/1841756323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560479fefa30 0x560479ff1e20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff774102740 tx=0x7ff7740c7c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d264b91b5bd9fcc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:07.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.088+0000 7ff773400640 1 -- 172.21.15.3:0/1841756323 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7740cb2c0 con 0x560479fefa30 2024-09-10T23:29:07.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.088+0000 7ff773400640 1 -- 172.21.15.3:0/1841756323 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff7740cb000 con 0x560479fefa30 2024-09-10T23:29:07.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.088+0000 7ff773400640 1 -- 172.21.15.3:0/1841756323 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7740cac60 con 0x560479fefa30 2024-09-10T23:29:07.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.088+0000 7ff790205740 1 -- 172.21.15.3:0/1841756323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560479fefa30 msgr2=0x560479ff1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:07.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.088+0000 7ff790205740 1 --2- 172.21.15.3:0/1841756323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560479fefa30 0x560479ff1e20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff774102740 tx=0x7ff7740c7c00 comp rx=0 tx=0).stop 2024-09-10T23:29:07.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.089+0000 7ff790205740 1 -- 172.21.15.3:0/1841756323 shutdown_connections 2024-09-10T23:29:07.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.089+0000 7ff790205740 1 --2- 172.21.15.3:0/1841756323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560479fefa30 0x560479ff1e20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.089+0000 7ff790205740 1 --2- 172.21.15.3:0/1841756323 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560479fe3aa0 0x560479fef4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.089+0000 7ff790205740 1 --2- 172.21.15.3:0/1841756323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560479fe3180 0x560479fe3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.089+0000 7ff790205740 1 -- 172.21.15.3:0/1841756323 >> 172.21.15.3:0/1841756323 conn(0x560479fe0fb0 msgr2=0x560479fe2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:07.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.090+0000 7ff790205740 1 -- 172.21.15.3:0/1841756323 shutdown_connections 2024-09-10T23:29:07.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.090+0000 7ff787400640 1 --2- 172.21.15.3:0/1503568563 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff76c0b54d0 0x7ff76c0b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:07.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.090+0000 7ff790205740 1 -- 172.21.15.3:0/1841756323 wait complete. 2024-09-10T23:29:07.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.090+0000 7ff790205740 1 -- start start 2024-09-10T23:29:07.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.091+0000 7ff790205740 1 Processor -- start 2024-09-10T23:29:07.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.092+0000 7ff790205740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560479fe3180 0x560479fef2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:07.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.092+0000 7ff790205740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560479fe3aa0 0x560479fec700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:07.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.092+0000 7ff790205740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560479fefa30 0x560479fecc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:07.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.092+0000 7ff790205740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x560479da97a0 con 0x560479fefa30 2024-09-10T23:29:07.093 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.092+0000 7ff790205740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x560479eeda10 con 0x560479fe3aa0 2024-09-10T23:29:07.093 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.092+0000 7ff790205740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x560479ff2470 con 0x560479fe3180 2024-09-10T23:29:07.093 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.092+0000 7ff787400640 1 --2- 172.21.15.3:0/1503568563 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff76c0b54d0 0x7ff76c0b7990 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff780009a70 tx=0x7ff7800095c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:07.093 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.092+0000 7ff790205740 10 client.0 _ll_register_callbacks cb 0x560479efdbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:07.093 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.093+0000 7ff786a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560479fe3180 0x560479fef2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:07.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.093+0000 7ff786a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560479fe3180 0x560479fef2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.3:49734/0 (socket says 172.21.15.3:49734) 2024-09-10T23:29:07.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.093+0000 7ff786a00640 1 -- 172.21.15.3:0/668990030 learned_addr learned my addr 172.21.15.3:0/668990030 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:29:07.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.093+0000 7ff786000640 1 --2- 172.21.15.3:0/668990030 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560479fe3aa0 0x560479fec700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:07.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.094+0000 7ff786a00640 1 -- 172.21.15.3:0/668990030 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560479fe3aa0 msgr2=0x560479fec700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:07.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.094+0000 7ff786a00640 1 --2- 172.21.15.3:0/668990030 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560479fe3aa0 0x560479fec700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.095 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.094+0000 7ff786a00640 1 -- 172.21.15.3:0/668990030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560479fefa30 msgr2=0x560479fecc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:07.095 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.094+0000 7ff786a00640 1 --2- 172.21.15.3:0/668990030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560479fefa30 0x560479fecc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.095 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.094+0000 7ff786a00640 1 -- 172.21.15.3:0/668990030 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560479cb5b90 con 0x560479fe3180 2024-09-10T23:29:07.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.094+0000 7ff786000640 1 --2- 172.21.15.3:0/668990030 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560479fe3aa0 0x560479fec700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:07.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.095+0000 7ff786a00640 1 --2- 172.21.15.3:0/668990030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560479fe3180 0x560479fef2b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff77800bae0 tx=0x7ff7780045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=169dfe4d62cd83c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:07.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.095+0000 7ff767e00640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-10T23:29:07.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:06 smithi038 ceph-mon[34225]: pgmap v460: 129 pgs: 129 active+clean; 265 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 842 KiB/s wr, 214 op/s 2024-09-10T23:29:07.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:06 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:29:07.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:06 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:29:07.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:06 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:29:07.098 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.097+0000 7ff767e00640 1 -- 172.21.15.3:0/668990030 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff778011440 con 0x560479fe3180 2024-09-10T23:29:07.098 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.097+0000 7ff767e00640 1 -- 172.21.15.3:0/668990030 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7ff7780115e0 con 0x560479fe3180 2024-09-10T23:29:07.098 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.097+0000 7ff790205740 1 -- 172.21.15.3:0/668990030 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7740cb000 con 0x560479fe3180 2024-09-10T23:29:07.098 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.098+0000 7ff767e00640 1 -- 172.21.15.3:0/668990030 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff7780117e0 con 0x560479fe3180 2024-09-10T23:29:07.098 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.098+0000 7ff790205740 10 client.25495 fetch_fsmap learned FSMap version 26 2024-09-10T23:29:07.098 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.098+0000 7ff790205740 1 -- 172.21.15.3:0/668990030 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56047a00eda0 con 0x560479fe3180 2024-09-10T23:29:07.099 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.099+0000 7ff767e00640 1 -- 172.21.15.3:0/668990030 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff7740cb000 con 0x560479fe3180 2024-09-10T23:29:07.101 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.100+0000 7ff767e00640 1 -- 172.21.15.3:0/668990030 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7ff778025a60 con 0x560479fe3180 2024-09-10T23:29:07.101 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.100+0000 7ff790205740 10 client.25495 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:29:07.101 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.100+0000 7ff790205740 10 client.25495 resolve_mds: validated gid 34724 aka daemon mds.b 2024-09-10T23:29:07.101 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.100+0000 7ff790205740 20 client.25495 populate_metadata read hostname 'smithi003' 2024-09-10T23:29:07.101 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.101+0000 7ff790205740 1 --2- 172.21.15.3:0/668990030 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x56047a010220 0x56047a0126c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:07.101 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.101+0000 7ff790205740 4 client.25495 mds_command: new command op to 34724 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:29:07.101 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.101+0000 7ff790205740 1 -- 172.21.15.3:0/668990030 --> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560479f5abf0 con 0x56047a010220 2024-09-10T23:29:07.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.101+0000 7ff786000640 1 --2- 172.21.15.3:0/668990030 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x56047a010220 0x56047a0126c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:07.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.102+0000 7ff786000640 1 --2- 172.21.15.3:0/668990030 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x56047a010220 0x56047a0126c0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28f7b581997c6941 server_cookie=1db91e0051dd4dc9 in_seq=0 out_seq=0 2024-09-10T23:29:07.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.102+0000 7ff767e00640 10 client.25495 ms_handle_connect on v2:172.21.15.38:6838/458259815 2024-09-10T23:29:07.104 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.104+0000 7ff767e00640 1 -- 172.21.15.3:0/668990030 <== mds.0 v2:172.21.15.38:6838/458259815 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560479f5abf0 con 0x56047a010220 2024-09-10T23:29:07.104 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.104+0000 7ff767e00640 10 client.25495 handle_command_reply: tid=0 2024-09-10T23:29:07.104 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.104+0000 7ff790205740 1 client.25495 shutdown 2024-09-10T23:29:07.104 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.104+0000 7ff790205740 1 -- 172.21.15.3:0/668990030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560479fe3180 msgr2=0x560479fef2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:07.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.105+0000 7ff790205740 1 --2- 172.21.15.3:0/668990030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560479fe3180 0x560479fef2b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff77800bae0 tx=0x7ff7780045e0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.105+0000 7ff790205740 1 -- 172.21.15.3:0/668990030 shutdown_connections 2024-09-10T23:29:07.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.105+0000 7ff790205740 1 --2- 172.21.15.3:0/668990030 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x56047a010220 0x56047a0126c0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.105+0000 7ff790205740 1 --2- 172.21.15.3:0/668990030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560479fefa30 0x560479fecc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.105+0000 7ff790205740 1 --2- 172.21.15.3:0/668990030 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560479fe3aa0 0x560479fec700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.105+0000 7ff790205740 1 --2- 172.21.15.3:0/668990030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560479fe3180 0x560479fef2b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.105+0000 7ff790205740 1 -- 172.21.15.3:0/668990030 >> 172.21.15.3:0/668990030 conn(0x560479fe0fb0 msgr2=0x560479fe6b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:07.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.105+0000 7ff767e00640 0 client.25495 ms_handle_reset on v2:172.21.15.38:6838/458259815 2024-09-10T23:29:07.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.106+0000 7ff790205740 1 -- 172.21.15.3:0/668990030 shutdown_connections 2024-09-10T23:29:07.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.106+0000 7ff790205740 1 -- 172.21.15.3:0/668990030 wait complete. 2024-09-10T23:29:07.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.106+0000 7ff790205740 20 client.25495 trim_cache size 0 max 16384 2024-09-10T23:29:07.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.145+0000 7ff790205740 1 Processor -- start 2024-09-10T23:29:07.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.146+0000 7ff790205740 1 -- start start 2024-09-10T23:29:07.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.146+0000 7ff790205740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560479fe3180 0x560479feaf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:07.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.146+0000 7ff790205740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560479fe3aa0 0x560479feb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:07.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.146+0000 7ff790205740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560479fefa30 0x560479ff0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:07.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.146+0000 7ff790205740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff768012690 con 0x560479fe3180 2024-09-10T23:29:07.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.146+0000 7ff790205740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff76800ff60 con 0x560479fefa30 2024-09-10T23:29:07.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.146+0000 7ff790205740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff76800de60 con 0x560479fe3aa0 2024-09-10T23:29:07.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.147+0000 7ff786a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560479fe3180 0x560479feaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:07.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.147+0000 7ff786a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560479fe3180 0x560479feaf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43072/0 (socket says 172.21.15.3:43072) 2024-09-10T23:29:07.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.147+0000 7ff786a00640 1 -- 172.21.15.3:0/3403633673 learned_addr learned my addr 172.21.15.3:0/3403633673 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:29:07.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.147+0000 7ff786000640 1 --2- 172.21.15.3:0/3403633673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560479fe3aa0 0x560479feb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:07.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.147+0000 7ff787400640 1 --2- 172.21.15.3:0/3403633673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560479fefa30 0x560479ff0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:07.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.148+0000 7ff786a00640 1 -- 172.21.15.3:0/3403633673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560479fe3aa0 msgr2=0x560479feb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:07.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.148+0000 7ff786a00640 1 --2- 172.21.15.3:0/3403633673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560479fe3aa0 0x560479feb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.148+0000 7ff786a00640 1 -- 172.21.15.3:0/3403633673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560479fefa30 msgr2=0x560479ff0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:07.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.148+0000 7ff786a00640 1 --2- 172.21.15.3:0/3403633673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560479fefa30 0x560479ff0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.148+0000 7ff786a00640 1 -- 172.21.15.3:0/3403633673 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560479fef5e0 con 0x560479fe3180 2024-09-10T23:29:07.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.149+0000 7ff786a00640 1 --2- 172.21.15.3:0/3403633673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560479fe3180 0x560479feaf80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff778025e30 tx=0x7ff778004500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8c4de9ba6d4f7d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:07.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.151+0000 7ff772a00640 1 -- 172.21.15.3:0/3403633673 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff778005870 con 0x560479fe3180 2024-09-10T23:29:07.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.151+0000 7ff772a00640 1 -- 172.21.15.3:0/3403633673 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff778005870 con 0x560479fe3180 2024-09-10T23:29:07.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.151+0000 7ff772a00640 1 -- 172.21.15.3:0/3403633673 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77801b8c0 con 0x560479fe3180 2024-09-10T23:29:07.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.152+0000 7ff790205740 1 -- 172.21.15.3:0/3403633673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560479fe3180 msgr2=0x560479feaf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:07.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.152+0000 7ff790205740 1 --2- 172.21.15.3:0/3403633673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560479fe3180 0x560479feaf80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff778025e30 tx=0x7ff778004500 comp rx=0 tx=0).stop 2024-09-10T23:29:07.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.152+0000 7ff790205740 1 -- 172.21.15.3:0/3403633673 shutdown_connections 2024-09-10T23:29:07.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.152+0000 7ff790205740 1 --2- 172.21.15.3:0/3403633673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560479fefa30 0x560479ff0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.152+0000 7ff790205740 1 --2- 172.21.15.3:0/3403633673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560479fe3aa0 0x560479feb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.152+0000 7ff790205740 1 --2- 172.21.15.3:0/3403633673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560479fe3180 0x560479feaf80 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.152+0000 7ff790205740 1 -- 172.21.15.3:0/3403633673 >> 172.21.15.3:0/3403633673 conn(0x560479fe0fb0 msgr2=0x560479fe20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:07.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.153+0000 7ff790205740 1 -- 172.21.15.3:0/3403633673 shutdown_connections 2024-09-10T23:29:07.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.153+0000 7ff790205740 1 -- 172.21.15.3:0/3403633673 wait complete. 2024-09-10T23:29:07.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.154+0000 7ff790205740 1 -- start start 2024-09-10T23:29:07.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.154+0000 7ff790205740 1 Processor -- start 2024-09-10T23:29:07.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.155+0000 7ff790205740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560479fe3180 0x560479ff7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:07.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.155+0000 7ff790205740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560479fe3aa0 0x560479ff38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:07.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.155+0000 7ff790205740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560479fefa30 0x560479ff3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:07.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.155+0000 7ff790205740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff76800e420 con 0x560479fefa30 2024-09-10T23:29:07.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.155+0000 7ff790205740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff76800f890 con 0x560479fe3aa0 2024-09-10T23:29:07.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.155+0000 7ff790205740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff76800eaf0 con 0x560479fe3180 2024-09-10T23:29:07.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.155+0000 7ff790205740 10 client.0 _ll_register_callbacks cb 0x7ff7780040a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:07.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.156+0000 7ff786000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560479fe3aa0 0x560479ff38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:07.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.156+0000 7ff786000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560479fe3aa0 0x560479ff38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.3:54722/0 (socket says 172.21.15.3:54722) 2024-09-10T23:29:07.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.156+0000 7ff786000640 1 -- 172.21.15.3:0/1213277040 learned_addr learned my addr 172.21.15.3:0/1213277040 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:29:07.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.156+0000 7ff787400640 1 --2- 172.21.15.3:0/1213277040 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560479fefa30 0x560479ff3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:07.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.156+0000 7ff786a00640 1 --2- 172.21.15.3:0/1213277040 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560479fe3180 0x560479ff7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:07.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.157+0000 7ff786000640 1 -- 172.21.15.3:0/1213277040 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560479fe3180 msgr2=0x560479ff7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:07.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.157+0000 7ff786000640 1 --2- 172.21.15.3:0/1213277040 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560479fe3180 0x560479ff7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.157+0000 7ff786000640 1 -- 172.21.15.3:0/1213277040 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560479fefa30 msgr2=0x560479ff3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:07.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.157+0000 7ff786000640 1 --2- 172.21.15.3:0/1213277040 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560479fefa30 0x560479ff3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.157+0000 7ff786000640 1 -- 172.21.15.3:0/1213277040 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560479ff4610 con 0x560479fe3aa0 2024-09-10T23:29:07.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.158+0000 7ff786000640 1 --2- 172.21.15.3:0/1213277040 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560479fe3aa0 0x560479ff38a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff7740d4550 tx=0x7ff774005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0db39f6ce0bef98 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:07.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.158+0000 7ff767e00640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-10T23:29:07.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.158+0000 7ff767e00640 1 -- 172.21.15.3:0/1213277040 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7740cae40 con 0x560479fe3aa0 2024-09-10T23:29:07.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.158+0000 7ff767e00640 1 -- 172.21.15.3:0/1213277040 <== mon.2 v2:172.21.15.38:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7ff7740c7760 con 0x560479fe3aa0 2024-09-10T23:29:07.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.158+0000 7ff790205740 1 -- 172.21.15.3:0/1213277040 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff778005870 con 0x560479fe3aa0 2024-09-10T23:29:07.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.159+0000 7ff767e00640 1 -- 172.21.15.3:0/1213277040 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff7740cac60 con 0x560479fe3aa0 2024-09-10T23:29:07.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.159+0000 7ff790205740 10 client.35543 fetch_fsmap learned FSMap version 26 2024-09-10T23:29:07.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.159+0000 7ff790205740 1 -- 172.21.15.3:0/1213277040 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56047a07e1e0 con 0x560479fe3aa0 2024-09-10T23:29:07.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.159+0000 7ff767e00640 1 -- 172.21.15.3:0/1213277040 <== mon.2 v2:172.21.15.38:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff778005870 con 0x560479fe3aa0 2024-09-10T23:29:07.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.160+0000 7ff767e00640 1 -- 172.21.15.3:0/1213277040 <== mon.2 v2:172.21.15.38:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7ff7740f2240 con 0x560479fe3aa0 2024-09-10T23:29:07.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.160+0000 7ff790205740 10 client.35543 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:29:07.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.160+0000 7ff790205740 10 client.35543 resolve_mds: validated gid 34724 aka daemon mds.b 2024-09-10T23:29:07.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.160+0000 7ff790205740 20 client.35543 populate_metadata read hostname 'smithi003' 2024-09-10T23:29:07.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.160+0000 7ff790205740 1 --2- 172.21.15.3:0/1213277040 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x56047a07e7a0 0x56047a080bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:07.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.160+0000 7ff790205740 4 client.35543 mds_command: new command op to 34724 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.5, "await_for": 45.0}] 2024-09-10T23:29:07.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.160+0000 7ff790205740 1 -- 172.21.15.3:0/1213277040 --> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.5, "await_for": 45.0}) -- 0x560479f566a0 con 0x56047a07e7a0 2024-09-10T23:29:07.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.161+0000 7ff786a00640 1 --2- 172.21.15.3:0/1213277040 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x56047a07e7a0 0x56047a080bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:07.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.162+0000 7ff767e00640 10 client.35543 ms_handle_connect on v2:172.21.15.38:6838/458259815 2024-09-10T23:29:07.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.163+0000 7ff786a00640 1 --2- 172.21.15.3:0/1213277040 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x56047a07e7a0 0x56047a080bc0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51e53f89fbc9567e server_cookie=7b3f98222b3d6824 in_seq=0 out_seq=0 2024-09-10T23:29:07.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.187+0000 7ff767e00640 1 -- 172.21.15.3:0/1213277040 <== mds.0 v2:172.21.15.38:6838/458259815 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x560479f566a0 con 0x56047a07e7a0 2024-09-10T23:29:07.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.187+0000 7ff767e00640 10 client.35543 handle_command_reply: tid=0 2024-09-10T23:29:07.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.187+0000 7ff790205740 1 client.35543 shutdown 2024-09-10T23:29:07.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.188+0000 7ff790205740 1 -- 172.21.15.3:0/1213277040 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560479fe3aa0 msgr2=0x560479ff38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:07.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.188+0000 7ff790205740 1 --2- 172.21.15.3:0/1213277040 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560479fe3aa0 0x560479ff38a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff7740d4550 tx=0x7ff774005f90 comp rx=0 tx=0).stop 2024-09-10T23:29:07.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.188+0000 7ff790205740 1 -- 172.21.15.3:0/1213277040 shutdown_connections 2024-09-10T23:29:07.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.188+0000 7ff790205740 1 --2- 172.21.15.3:0/1213277040 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x56047a07e7a0 0x56047a080bc0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.188+0000 7ff790205740 1 --2- 172.21.15.3:0/1213277040 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560479fefa30 0x560479ff3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.188+0000 7ff790205740 1 --2- 172.21.15.3:0/1213277040 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560479fe3aa0 0x560479ff38a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.188+0000 7ff790205740 1 --2- 172.21.15.3:0/1213277040 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560479fe3180 0x560479ff7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.188+0000 7ff767e00640 0 client.35543 ms_handle_reset on v2:172.21.15.38:6838/458259815 2024-09-10T23:29:07.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.188+0000 7ff790205740 1 -- 172.21.15.3:0/1213277040 >> 172.21.15.3:0/1213277040 conn(0x560479fe0fb0 msgr2=0x560479feaee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:07.191 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.188+0000 7ff790205740 1 -- 172.21.15.3:0/1213277040 shutdown_connections 2024-09-10T23:29:07.191 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.188+0000 7ff790205740 1 -- 172.21.15.3:0/1213277040 wait complete. 2024-09-10T23:29:07.191 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.188+0000 7ff790205740 20 client.35543 trim_cache size 0 max 16384 2024-09-10T23:29:07.192 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-10T23:29:07.192 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 26, 2024-09-10T23:29:07.192 INFO:teuthology.orchestra.run.smithi003.stdout: "leader": 34724, 2024-09-10T23:29:07.192 INFO:teuthology.orchestra.run.smithi003.stdout: "set_version": 10, 2024-09-10T23:29:07.192 INFO:teuthology.orchestra.run.smithi003.stdout: "sets": { 2024-09-10T23:29:07.192 INFO:teuthology.orchestra.run.smithi003.stdout: "2e33a07a": { 2024-09-10T23:29:07.192 INFO:teuthology.orchestra.run.smithi003.stdout: "version": 10, 2024-09-10T23:29:07.193 INFO:teuthology.orchestra.run.smithi003.stdout: "age_ref": 0.0, 2024-09-10T23:29:07.193 INFO:teuthology.orchestra.run.smithi003.stdout: "state": { 2024-09-10T23:29:07.193 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "QUIESCED", 2024-09-10T23:29:07.193 INFO:teuthology.orchestra.run.smithi003.stdout: "age": 0.0 2024-09-10T23:29:07.193 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:29:07.193 INFO:teuthology.orchestra.run.smithi003.stdout: "timeout": 90.0, 2024-09-10T23:29:07.194 INFO:teuthology.orchestra.run.smithi003.stdout: "expiration": 140.5, 2024-09-10T23:29:07.194 INFO:teuthology.orchestra.run.smithi003.stdout: "members": { 2024-09-10T23:29:07.194 INFO:teuthology.orchestra.run.smithi003.stdout: "file:/": { 2024-09-10T23:29:07.194 INFO:teuthology.orchestra.run.smithi003.stdout: "excluded": false, 2024-09-10T23:29:07.194 INFO:teuthology.orchestra.run.smithi003.stdout: "state": { 2024-09-10T23:29:07.194 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "QUIESCED", 2024-09-10T23:29:07.195 INFO:teuthology.orchestra.run.smithi003.stdout: "age": 0.0 2024-09-10T23:29:07.195 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:29:07.195 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:29:07.195 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:29:07.195 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:29:07.195 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:29:07.195 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-10T23:29:07.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.189+0000 7ff78d600640 1 -- 172.21.15.3:0/1503568563 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff76c0b54d0 msgr2=0x7ff76c0b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:07.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.190+0000 7ff78d600640 1 --2- 172.21.15.3:0/1503568563 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff76c0b54d0 0x7ff76c0b7990 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff780009a70 tx=0x7ff7800095c0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.190+0000 7ff78d600640 1 -- 172.21.15.3:0/1503568563 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff78810a530 msgr2=0x7ff7881a8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:07.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.190+0000 7ff78d600640 1 --2- 172.21.15.3:0/1503568563 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff78810a530 0x7ff7881a8580 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff774035040 tx=0x7ff774032cb0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.190+0000 7ff78d600640 1 -- 172.21.15.3:0/1503568563 shutdown_connections 2024-09-10T23:29:07.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.190+0000 7ff78d600640 1 --2- 172.21.15.3:0/1503568563 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff78811c0a0 0x7ff7881ad920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.190+0000 7ff78d600640 1 --2- 172.21.15.3:0/1503568563 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ff76c0b54d0 0x7ff76c0b7990 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.190+0000 7ff78d600640 1 --2- 172.21.15.3:0/1503568563 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff78810a530 0x7ff7881a8580 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.190+0000 7ff78d600640 1 --2- 172.21.15.3:0/1503568563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff78810a150 0x7ff7881a8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.190+0000 7ff78d600640 1 -- 172.21.15.3:0/1503568563 >> 172.21.15.3:0/1503568563 conn(0x7ff78806e410 msgr2=0x7ff78811c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:07.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.192+0000 7ff78d600640 1 -- 172.21.15.3:0/1503568563 shutdown_connections 2024-09-10T23:29:07.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:07.192+0000 7ff78d600640 1 -- 172.21.15.3:0/1503568563 wait complete. 2024-09-10T23:29:08.289 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '2e33a07a', quiesce took 5.8 seconds. Will release after: 14.7 2024-09-10T23:29:08.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:08 smithi194 ceph-mon[33904]: pgmap v461: 129 pgs: 129 active+clean; 271 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.5 MiB/s wr, 301 op/s 2024-09-10T23:29:08.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:08 smithi003 ceph-mon[30348]: pgmap v461: 129 pgs: 129 active+clean; 271 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.5 MiB/s wr, 301 op/s 2024-09-10T23:29:09.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:08 smithi038 ceph-mon[34225]: pgmap v461: 129 pgs: 129 active+clean; 271 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.5 MiB/s wr, 301 op/s 2024-09-10T23:29:10.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:09 smithi038 ceph-mon[34225]: pgmap v462: 129 pgs: 129 active+clean; 298 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.9 MiB/s wr, 867 op/s 2024-09-10T23:29:10.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:09 smithi194 ceph-mon[33904]: pgmap v462: 129 pgs: 129 active+clean; 298 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.9 MiB/s wr, 867 op/s 2024-09-10T23:29:10.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:09 smithi003 ceph-mon[30348]: pgmap v462: 129 pgs: 129 active+clean; 298 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.9 MiB/s wr, 867 op/s 2024-09-10T23:29:12.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:11 smithi194 ceph-mon[33904]: pgmap v463: 129 pgs: 129 active+clean; 300 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.2 MiB/s wr, 899 op/s 2024-09-10T23:29:12.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:11 smithi003 ceph-mon[30348]: pgmap v463: 129 pgs: 129 active+clean; 300 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.2 MiB/s wr, 899 op/s 2024-09-10T23:29:12.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:11 smithi038 ceph-mon[34225]: pgmap v463: 129 pgs: 129 active+clean; 300 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.2 MiB/s wr, 899 op/s 2024-09-10T23:29:14.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:13 smithi194 ceph-mon[33904]: pgmap v464: 129 pgs: 129 active+clean; 300 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.2 MiB/s wr, 906 op/s 2024-09-10T23:29:14.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:13 smithi003 ceph-mon[30348]: pgmap v464: 129 pgs: 129 active+clean; 300 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.2 MiB/s wr, 906 op/s 2024-09-10T23:29:14.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:13 smithi038 ceph-mon[34225]: pgmap v464: 129 pgs: 129 active+clean; 300 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.2 MiB/s wr, 906 op/s 2024-09-10T23:29:16.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:15 smithi194 ceph-mon[33904]: pgmap v465: 129 pgs: 129 active+clean; 300 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.8 MiB/s wr, 792 op/s 2024-09-10T23:29:16.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:15 smithi003 ceph-mon[30348]: pgmap v465: 129 pgs: 129 active+clean; 300 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.8 MiB/s wr, 792 op/s 2024-09-10T23:29:16.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:15 smithi038 ceph-mon[34225]: pgmap v465: 129 pgs: 129 active+clean; 300 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.8 MiB/s wr, 792 op/s 2024-09-10T23:29:18.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:17 smithi194 ceph-mon[33904]: pgmap v466: 129 pgs: 129 active+clean; 300 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.5 MiB/s wr, 737 op/s 2024-09-10T23:29:18.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:17 smithi003 ceph-mon[30348]: pgmap v466: 129 pgs: 129 active+clean; 300 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.5 MiB/s wr, 737 op/s 2024-09-10T23:29:18.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:17 smithi038 ceph-mon[34225]: pgmap v466: 129 pgs: 129 active+clean; 300 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.5 MiB/s wr, 737 op/s 2024-09-10T23:29:20.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:19 smithi194 ceph-mon[33904]: pgmap v467: 129 pgs: 129 active+clean; 301 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.8 MiB/s wr, 630 op/s 2024-09-10T23:29:20.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:19 smithi003 ceph-mon[30348]: pgmap v467: 129 pgs: 129 active+clean; 301 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.8 MiB/s wr, 630 op/s 2024-09-10T23:29:20.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:19 smithi038 ceph-mon[34225]: pgmap v467: 129 pgs: 129 active+clean; 301 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.8 MiB/s wr, 630 op/s 2024-09-10T23:29:22.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:21 smithi194 ceph-mon[33904]: pgmap v468: 129 pgs: 129 active+clean; 301 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 491 KiB/s wr, 79 op/s 2024-09-10T23:29:22.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:21 smithi003 ceph-mon[30348]: pgmap v468: 129 pgs: 129 active+clean; 301 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 491 KiB/s wr, 79 op/s 2024-09-10T23:29:22.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:21 smithi038 ceph-mon[34225]: pgmap v468: 129 pgs: 129 active+clean; 301 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 491 KiB/s wr, 79 op/s 2024-09-10T23:29:22.992 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:29:23.383 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:29:23.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.947+0000 7f2a0b600640 1 -- 172.21.15.3:0/1407129445 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a04102dc0 msgr2=0x7f2a041031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:23.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.947+0000 7f2a0b600640 1 --2- 172.21.15.3:0/1407129445 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a04102dc0 0x7f2a041031a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f29f8009900 tx=0x7f29f802a3f0 comp rx=0 tx=0).stop 2024-09-10T23:29:23.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.947+0000 7f2a0b600640 1 -- 172.21.15.3:0/1407129445 shutdown_connections 2024-09-10T23:29:23.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.947+0000 7f2a0b600640 1 --2- 172.21.15.3:0/1407129445 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a04109150 0x7f2a0410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:23.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.947+0000 7f2a0b600640 1 --2- 172.21.15.3:0/1407129445 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a041087d0 0x7f2a04108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:23.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.947+0000 7f2a0b600640 1 --2- 172.21.15.3:0/1407129445 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a04102dc0 0x7f2a041031a0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:23.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.947+0000 7f2a0b600640 1 -- 172.21.15.3:0/1407129445 >> 172.21.15.3:0/1407129445 conn(0x7f2a040fe830 msgr2=0x7f2a04100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:23.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.947+0000 7f2a0b600640 1 -- 172.21.15.3:0/1407129445 shutdown_connections 2024-09-10T23:29:23.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.947+0000 7f2a0b600640 1 -- 172.21.15.3:0/1407129445 wait complete. 2024-09-10T23:29:23.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.948+0000 7f2a0b600640 1 Processor -- start 2024-09-10T23:29:23.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.948+0000 7f2a0b600640 1 -- start start 2024-09-10T23:29:23.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.949+0000 7f2a0b600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a04102dc0 0x7f2a040754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:23.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.949+0000 7f2a0b600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a041087d0 0x7f2a040759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:23.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.949+0000 7f2a0b600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a04109150 0x7f2a04075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:23.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.949+0000 7f2a0b600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2a04112c80 con 0x7f2a041087d0 2024-09-10T23:29:23.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.949+0000 7f2a0b600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2a04112b00 con 0x7f2a04109150 2024-09-10T23:29:23.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.949+0000 7f2a0b600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2a04112e00 con 0x7f2a04102dc0 2024-09-10T23:29:23.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.949+0000 7f2a03e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a041087d0 0x7f2a040759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:23.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.949+0000 7f2a03e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a041087d0 0x7f2a040759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42146/0 (socket says 172.21.15.3:42146) 2024-09-10T23:29:23.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.949+0000 7f2a03e00640 1 -- 172.21.15.3:0/3943798097 learned_addr learned my addr 172.21.15.3:0/3943798097 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:29:23.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.949+0000 7f2a08c00640 1 --2- 172.21.15.3:0/3943798097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a04102dc0 0x7f2a040754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:23.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.949+0000 7f2a09600640 1 --2- 172.21.15.3:0/3943798097 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a04109150 0x7f2a04075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:23.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.950+0000 7f2a03e00640 1 -- 172.21.15.3:0/3943798097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a04102dc0 msgr2=0x7f2a040754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:23.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.950+0000 7f2a03e00640 1 --2- 172.21.15.3:0/3943798097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a04102dc0 0x7f2a040754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:23.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.950+0000 7f2a03e00640 1 -- 172.21.15.3:0/3943798097 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a04109150 msgr2=0x7f2a04075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:23.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.950+0000 7f2a03e00640 1 --2- 172.21.15.3:0/3943798097 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a04109150 0x7f2a04075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:23.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.950+0000 7f2a03e00640 1 -- 172.21.15.3:0/3943798097 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a041a74f0 con 0x7f2a041087d0 2024-09-10T23:29:23.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.950+0000 7f2a03e00640 1 --2- 172.21.15.3:0/3943798097 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a041087d0 0x7f2a040759e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f29f000c920 tx=0x7f29f000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:23.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.950+0000 7f2a01600640 1 -- 172.21.15.3:0/3943798097 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f0007c70 con 0x7f2a041087d0 2024-09-10T23:29:23.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.950+0000 7f2a01600640 1 -- 172.21.15.3:0/3943798097 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29f0007e10 con 0x7f2a041087d0 2024-09-10T23:29:23.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.950+0000 7f2a0b600640 1 -- 172.21.15.3:0/3943798097 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a041a77e0 con 0x7f2a041087d0 2024-09-10T23:29:23.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.950+0000 7f2a01600640 1 -- 172.21.15.3:0/3943798097 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f0018710 con 0x7f2a041087d0 2024-09-10T23:29:23.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.951+0000 7f2a0b600640 1 -- 172.21.15.3:0/3943798097 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a041a7d20 con 0x7f2a041087d0 2024-09-10T23:29:23.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.952+0000 7f2a0b600640 1 -- 172.21.15.3:0/3943798097 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a041031a0 con 0x7f2a041087d0 2024-09-10T23:29:23.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.954+0000 7f2a01600640 1 -- 172.21.15.3:0/3943798097 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 26) ==== 153380+0+0 (secure 0 0 0) 0x7f29f000f450 con 0x7f2a041087d0 2024-09-10T23:29:23.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.956+0000 7f2a01600640 1 --2- 172.21.15.3:0/3943798097 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f29ec0b5450 0x7f29ec0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:23.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.956+0000 7f2a01600640 1 -- 172.21.15.3:0/3943798097 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f29f00e6810 con 0x7f2a041087d0 2024-09-10T23:29:23.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.956+0000 7f2a08c00640 1 --2- 172.21.15.3:0/3943798097 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f29ec0b5450 0x7f29ec0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:23.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.957+0000 7f2a08c00640 1 --2- 172.21.15.3:0/3943798097 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f29ec0b5450 0x7f29ec0b7910 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f29f80057c0 tx=0x7f29f80058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:23.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:23.958+0000 7f2a01600640 1 -- 172.21.15.3:0/3943798097 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f29f0014030 con 0x7f2a041087d0 2024-09-10T23:29:24.194 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:24.193+0000 7f2a0b600640 1 -- 172.21.15.3:0/3943798097 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a040767a0 con 0x7f2a041087d0 2024-09-10T23:29:24.194 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:23 smithi003 ceph-mon[30348]: pgmap v469: 129 pgs: 129 active+clean; 305 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 542 KiB/s wr, 136 op/s 2024-09-10T23:29:24.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:24.194+0000 7f2a01600640 1 -- 172.21.15.3:0/3943798097 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11891 (secure 0 0 0) 0x7f29f00ad050 con 0x7f2a041087d0 2024-09-10T23:29:24.195 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:29:24.195 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":26,"btime":"2024-09-10T23:26:42:260644+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/1495411512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":1495411512},{"type":"v1","addr":"172.21.15.3:6835","nonce":1495411512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/1857372777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1857372777},{"type":"v1","addr":"172.21.15.3:6837","nonce":1857372777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14862,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6839/493850676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":493850676},{"type":"v1","addr":"172.21.15.3:6839","nonce":493850676}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14874,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6841/1580524358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":1580524358},{"type":"v1","addr":"172.21.15.3:6841","nonce":1580524358}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/352514665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":352514665},{"type":"v1","addr":"172.21.15.194:6833","nonce":352514665}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2380508105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2380508105},{"type":"v1","addr":"172.21.15.194:6835","nonce":2380508105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:23:58.866253+0000","modified":"2024-09-10T23:26:41.694795+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34724,"mds_1":34682,"mds_2":34652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24649":{"gid":24649,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/739730313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":739730313},{"type":"v1","addr":"172.21.15.194:6837","nonce":739730313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/3198777710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3198777710},{"type":"v1","addr":"172.21.15.194:6839","nonce":3198777710}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34619":{"gid":34619,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6833/1194099617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1194099617},{"type":"v1","addr":"172.21.15.38:6833","nonce":1194099617}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34652":{"gid":34652,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.38:6835/218783320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":218783320},{"type":"v1","addr":"172.21.15.38:6835","nonce":218783320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34682":{"gid":34682,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":21,"addr":"172.21.15.38:6837/1821839397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":1821839397},{"type":"v1","addr":"172.21.15.38:6837","nonce":1821839397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34724":{"gid":34724,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.38:6839/458259815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":458259815},{"type":"v1","addr":"172.21.15.38:6839","nonce":458259815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34724,"qdb_cluster":[34724,34682,34652]},"id":1}]} 2024-09-10T23:29:24.196 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 26 2024-09-10T23:29:24.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:23 smithi194 ceph-mon[33904]: pgmap v469: 129 pgs: 129 active+clean; 305 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 542 KiB/s wr, 136 op/s 2024-09-10T23:29:24.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:24.196+0000 7f2a0b600640 1 -- 172.21.15.3:0/3943798097 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f29ec0b5450 msgr2=0x7f29ec0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:24.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:24.196+0000 7f2a0b600640 1 --2- 172.21.15.3:0/3943798097 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f29ec0b5450 0x7f29ec0b7910 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f29f80057c0 tx=0x7f29f80058d0 comp rx=0 tx=0).stop 2024-09-10T23:29:24.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:24.196+0000 7f2a0b600640 1 -- 172.21.15.3:0/3943798097 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a041087d0 msgr2=0x7f2a040759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:24.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:24.196+0000 7f2a0b600640 1 --2- 172.21.15.3:0/3943798097 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a041087d0 0x7f2a040759e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f29f000c920 tx=0x7f29f000cde0 comp rx=0 tx=0).stop 2024-09-10T23:29:24.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:24.197+0000 7f2a0b600640 1 -- 172.21.15.3:0/3943798097 shutdown_connections 2024-09-10T23:29:24.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:24.197+0000 7f2a0b600640 1 --2- 172.21.15.3:0/3943798097 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a04109150 0x7f2a04075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:24.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:24.197+0000 7f2a0b600640 1 --2- 172.21.15.3:0/3943798097 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f29ec0b5450 0x7f29ec0b7910 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:24.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:24.197+0000 7f2a0b600640 1 --2- 172.21.15.3:0/3943798097 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a041087d0 0x7f2a040759e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:24.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:24.197+0000 7f2a0b600640 1 --2- 172.21.15.3:0/3943798097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a04102dc0 0x7f2a040754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:24.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:24.197+0000 7f2a0b600640 1 -- 172.21.15.3:0/3943798097 >> 172.21.15.3:0/3943798097 conn(0x7f2a040fe830 msgr2=0x7f2a04100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:24.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:24.197+0000 7f2a0b600640 1 -- 172.21.15.3:0/3943798097 shutdown_connections 2024-09-10T23:29:24.199 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:24.197+0000 7f2a0b600640 1 -- 172.21.15.3:0/3943798097 wait complete. 2024-09-10T23:29:24.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:23 smithi038 ceph-mon[34225]: pgmap v469: 129 pgs: 129 active+clean; 305 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 542 KiB/s wr, 136 op/s 2024-09-10T23:29:25.038 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34724 quiesce db --set-id 2e33a07a --release --await' 2024-09-10T23:29:25.038 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34724 quiesce db --set-id 2e33a07a --release --await 2024-09-10T23:29:25.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:24 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3943798097' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:29:25.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:24 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3943798097' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:29:25.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:24 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3943798097' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:29:25.423 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:29:26.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:25 smithi194 ceph-mon[33904]: pgmap v470: 129 pgs: 129 active+clean; 307 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 639 KiB/s wr, 156 op/s 2024-09-10T23:29:26.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:25 smithi003 ceph-mon[30348]: pgmap v470: 129 pgs: 129 active+clean; 307 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 639 KiB/s wr, 156 op/s 2024-09-10T23:29:26.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:25 smithi038 ceph-mon[34225]: pgmap v470: 129 pgs: 129 active+clean; 307 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 639 KiB/s wr, 156 op/s 2024-09-10T23:29:26.931 INFO:tasks.workunit.client.0.smithi003.stdout:setting up random write file 2024-09-10T23:29:26.932 INFO:tasks.workunit.client.0.smithi003.stdout:done setting up random write file 2024-09-10T23:29:26.932 INFO:tasks.workunit.client.0.smithi003.stdout:starting fsync run 2024-09-10T23:29:26.932 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0090s fsync time: 0.0116s 2024-09-10T23:29:26.932 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0059s fsync time: 0.0090s 2024-09-10T23:29:26.932 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0060s fsync time: 0.0098s 2024-09-10T23:29:26.932 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0054s fsync time: 0.0479s 2024-09-10T23:29:26.932 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0038s fsync time: 0.0146s 2024-09-10T23:29:26.932 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0044s fsync time: 0.0153s 2024-09-10T23:29:26.932 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0039s fsync time: 0.0086s 2024-09-10T23:29:26.932 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0043s fsync time: 0.0429s 2024-09-10T23:29:26.932 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0038s fsync time: 0.0484s 2024-09-10T23:29:26.933 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0040s fsync time: 0.0249s 2024-09-10T23:29:26.933 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0042s fsync time: 0.0104s 2024-09-10T23:29:26.933 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0033s fsync time: 0.0077s 2024-09-10T23:29:26.933 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0035s fsync time: 0.0405s 2024-09-10T23:29:26.933 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0044s fsync time: 0.0376s 2024-09-10T23:29:26.933 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0034s fsync time: 0.0174s 2024-09-10T23:29:26.933 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0024s fsync time: 0.0186s 2024-09-10T23:29:26.933 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0036s fsync time: 0.0111s 2024-09-10T23:29:26.933 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0041s fsync time: 0.0137s 2024-09-10T23:29:26.933 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0046s fsync time: 0.0146s 2024-09-10T23:29:26.933 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0039s fsync time: 0.0115s 2024-09-10T23:29:26.933 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0064s fsync time: 0.0239s 2024-09-10T23:29:26.933 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0040s fsync time: 0.0236s 2024-09-10T23:29:26.934 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0038s fsync time: 0.0129s 2024-09-10T23:29:26.934 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0033s fsync time: 0.0091s 2024-09-10T23:29:26.934 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0468s fsync time: 0.0244s 2024-09-10T23:29:26.934 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0039s fsync time: 0.2828s 2024-09-10T23:29:26.934 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0051s fsync time: 0.7075s 2024-09-10T23:29:26.934 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0049s fsync time: 0.0587s 2024-09-10T23:29:26.934 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0035s fsync time: 0.0112s 2024-09-10T23:29:26.934 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0037s fsync time: 0.0174s 2024-09-10T23:29:26.934 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 11.8757s fsync time: 0.0126s 2024-09-10T23:29:26.934 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0053s fsync time: 0.0599s 2024-09-10T23:29:26.934 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0050s fsync time: 0.0247s 2024-09-10T23:29:26.934 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0036s fsync time: 0.0459s 2024-09-10T23:29:26.934 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0046s fsync time: 0.0188s 2024-09-10T23:29:26.934 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 0.0043s fsync time: 0.0688s 2024-09-10T23:29:26.935 INFO:tasks.workunit.client.0.smithi003.stdout:write time: 19.1977s fsync time: 0.0107s 2024-09-10T23:29:26.935 INFO:tasks.workunit.client.0.smithi003.stdout:run done 37 fsyncs total, killing random writer 2024-09-10T23:29:26.935 INFO:tasks.workunit.client.0.smithi003.stdout:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-10T23:29:26.936 INFO:tasks.workunit.client.0.smithi003.stderr:+ echo /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-10T23:29:26.936 INFO:tasks.workunit.client.0.smithi003.stderr:+ whereis lsof 2024-09-10T23:29:27.399 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.871+0000 7fcddfa00640 1 -- 172.21.15.3:0/2531867233 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdd8075f40 msgr2=0x7fcdd810edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:27.400 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.871+0000 7fcddfa00640 1 --2- 172.21.15.3:0/2531867233 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdd8075f40 0x7fcdd810edf0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4009900 tx=0x7fcdc402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.400 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.872+0000 7fcddfa00640 1 -- 172.21.15.3:0/2531867233 shutdown_connections 2024-09-10T23:29:27.400 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.872+0000 7fcddfa00640 1 --2- 172.21.15.3:0/2531867233 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdd810f3c0 0x7fcdd81117b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.400 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.872+0000 7fcddfa00640 1 --2- 172.21.15.3:0/2531867233 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdd8075f40 0x7fcdd810edf0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.400 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.872+0000 7fcddfa00640 1 --2- 172.21.15.3:0/2531867233 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdd8075540 0x7fcdd8075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.400 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.872+0000 7fcddfa00640 1 -- 172.21.15.3:0/2531867233 >> 172.21.15.3:0/2531867233 conn(0x7fcdd80fe810 msgr2=0x7fcdd8100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:27.400 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.872+0000 7fcddfa00640 1 -- 172.21.15.3:0/2531867233 shutdown_connections 2024-09-10T23:29:27.400 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.872+0000 7fcddfa00640 1 -- 172.21.15.3:0/2531867233 wait complete. 2024-09-10T23:29:27.400 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.873+0000 7fcddfa00640 1 Processor -- start 2024-09-10T23:29:27.400 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.873+0000 7fcddfa00640 1 -- start start 2024-09-10T23:29:27.400 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.873+0000 7fcddfa00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdd8075540 0x7fcdd819b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:27.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.873+0000 7fcddfa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdd8075f40 0x7fcdd819b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:27.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.873+0000 7fcddfa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdd810f3c0 0x7fcdd81a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:27.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.873+0000 7fcddfa00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd8114e60 con 0x7fcdd8075f40 2024-09-10T23:29:27.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.873+0000 7fcddfa00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd8114ce0 con 0x7fcdd8075540 2024-09-10T23:29:27.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.873+0000 7fcddfa00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd8114fe0 con 0x7fcdd810f3c0 2024-09-10T23:29:27.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.874+0000 7fcddd000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdd8075540 0x7fcdd819b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:27.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.874+0000 7fcdd7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdd8075f40 0x7fcdd819b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:27.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.874+0000 7fcddd000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdd8075540 0x7fcdd819b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.3:50190/0 (socket says 172.21.15.3:50190) 2024-09-10T23:29:27.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.874+0000 7fcddd000640 1 -- 172.21.15.3:0/1744573476 learned_addr learned my addr 172.21.15.3:0/1744573476 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:29:27.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.874+0000 7fcddda00640 1 --2- 172.21.15.3:0/1744573476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdd810f3c0 0x7fcdd81a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:27.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.874+0000 7fcddd000640 1 -- 172.21.15.3:0/1744573476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdd810f3c0 msgr2=0x7fcdd81a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:27.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.874+0000 7fcddd000640 1 --2- 172.21.15.3:0/1744573476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdd810f3c0 0x7fcdd81a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.874+0000 7fcddd000640 1 -- 172.21.15.3:0/1744573476 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdd8075f40 msgr2=0x7fcdd819b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:27.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.874+0000 7fcddd000640 1 --2- 172.21.15.3:0/1744573476 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdd8075f40 0x7fcdd819b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.874+0000 7fcddd000640 1 -- 172.21.15.3:0/1744573476 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd81a14c0 con 0x7fcdd8075540 2024-09-10T23:29:27.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.874+0000 7fcdd7e00640 1 --2- 172.21.15.3:0/1744573476 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdd8075f40 0x7fcdd819b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:29:27.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.875+0000 7fcddd000640 1 --2- 172.21.15.3:0/1744573476 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdd8075540 0x7fcdd819b410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcdc800d950 tx=0x7fcdc800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:27.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.875+0000 7fcdd5600640 1 -- 172.21.15.3:0/1744573476 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc8017070 con 0x7fcdd8075540 2024-09-10T23:29:27.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.875+0000 7fcddfa00640 1 -- 172.21.15.3:0/1744573476 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdd81a17b0 con 0x7fcdd8075540 2024-09-10T23:29:27.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.875+0000 7fcdd5600640 1 -- 172.21.15.3:0/1744573476 <== mon.2 v2:172.21.15.38:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcdc8009c30 con 0x7fcdd8075540 2024-09-10T23:29:27.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.875+0000 7fcdd5600640 1 -- 172.21.15.3:0/1744573476 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc800f620 con 0x7fcdd8075540 2024-09-10T23:29:27.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.875+0000 7fcddfa00640 1 -- 172.21.15.3:0/1744573476 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdd81a8040 con 0x7fcdd8075540 2024-09-10T23:29:27.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.878+0000 7fcde24d8740 1 Processor -- start 2024-09-10T23:29:27.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.878+0000 7fcde24d8740 1 -- start start 2024-09-10T23:29:27.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.878+0000 7fcde24d8740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cc1c91ff0 0x561cc1c923d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:27.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.878+0000 7fcde24d8740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cc1c92910 0x561cc1c9e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:27.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.878+0000 7fcde24d8740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561cc1c9e8a0 0x561cc1ca0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:27.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.879+0000 7fcde24d8740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x561cc1c09290 con 0x561cc1c91ff0 2024-09-10T23:29:27.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.879+0000 7fcde24d8740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x561cc1bf86c0 con 0x561cc1c9e8a0 2024-09-10T23:29:27.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.879+0000 7fcde24d8740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x561cc1bfc4d0 con 0x561cc1c92910 2024-09-10T23:29:27.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.879+0000 7fcddda00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cc1c91ff0 0x561cc1c923d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:27.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.879+0000 7fcddda00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cc1c91ff0 0x561cc1c923d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42186/0 (socket says 172.21.15.3:42186) 2024-09-10T23:29:27.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.879+0000 7fcddda00640 1 -- 172.21.15.3:0/884960410 learned_addr learned my addr 172.21.15.3:0/884960410 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:29:27.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.879+0000 7fcdd7e00640 1 --2- 172.21.15.3:0/884960410 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561cc1c9e8a0 0x561cc1ca0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:27.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.879+0000 7fcddda00640 1 -- 172.21.15.3:0/884960410 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cc1c92910 msgr2=0x561cc1c9e360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T23:29:27.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.879+0000 7fcddda00640 1 --2- 172.21.15.3:0/884960410 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cc1c92910 0x561cc1c9e360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.879+0000 7fcddda00640 1 -- 172.21.15.3:0/884960410 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561cc1c9e8a0 msgr2=0x561cc1ca0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:27.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.879+0000 7fcddda00640 1 --2- 172.21.15.3:0/884960410 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561cc1c9e8a0 0x561cc1ca0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.879+0000 7fcddda00640 1 -- 172.21.15.3:0/884960410 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cc1b85460 con 0x561cc1c91ff0 2024-09-10T23:29:27.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.879+0000 7fcddda00640 1 --2- 172.21.15.3:0/884960410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cc1c91ff0 0x561cc1c923d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fcdd00103a0 tx=0x7fcdd0010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad5dd2799fd5c2a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:27.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.879+0000 7fcdd5600640 1 -- 172.21.15.3:0/1744573476 <== mon.2 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 26) ==== 153380+0+0 (secure 0 0 0) 0x7fcdc8010460 con 0x7fcdd8075540 2024-09-10T23:29:27.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.880+0000 7fcdce000640 1 -- 172.21.15.3:0/884960410 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd0016070 con 0x561cc1c91ff0 2024-09-10T23:29:27.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.880+0000 7fcdce000640 1 -- 172.21.15.3:0/884960410 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcdd0004d20 con 0x561cc1c91ff0 2024-09-10T23:29:27.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.880+0000 7fcdce000640 1 -- 172.21.15.3:0/884960410 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd0005340 con 0x561cc1c91ff0 2024-09-10T23:29:27.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.880+0000 7fcde24d8740 1 -- 172.21.15.3:0/884960410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cc1c91ff0 msgr2=0x561cc1c923d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:27.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.880+0000 7fcde24d8740 1 --2- 172.21.15.3:0/884960410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cc1c91ff0 0x561cc1c923d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fcdd00103a0 tx=0x7fcdd0010860 comp rx=0 tx=0).stop 2024-09-10T23:29:27.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.881+0000 7fcde24d8740 1 -- 172.21.15.3:0/884960410 shutdown_connections 2024-09-10T23:29:27.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.881+0000 7fcde24d8740 1 --2- 172.21.15.3:0/884960410 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561cc1c9e8a0 0x561cc1ca0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.881+0000 7fcde24d8740 1 --2- 172.21.15.3:0/884960410 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cc1c92910 0x561cc1c9e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.881+0000 7fcde24d8740 1 --2- 172.21.15.3:0/884960410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cc1c91ff0 0x561cc1c923d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.881+0000 7fcde24d8740 1 -- 172.21.15.3:0/884960410 >> 172.21.15.3:0/884960410 conn(0x561cc1c8fe20 msgr2=0x561cc1c90fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:27.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.881+0000 7fcde24d8740 1 -- 172.21.15.3:0/884960410 shutdown_connections 2024-09-10T23:29:27.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.881+0000 7fcde24d8740 1 -- 172.21.15.3:0/884960410 wait complete. 2024-09-10T23:29:27.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.881+0000 7fcde24d8740 1 -- start start 2024-09-10T23:29:27.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.881+0000 7fcdd5600640 1 --2- 172.21.15.3:0/1744573476 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcdbc0b5360 0x7fcdbc0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:27.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.881+0000 7fcdd5600640 1 -- 172.21.15.3:0/1744573476 <== mon.2 v2:172.21.15.38:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7fcdc80e5f40 con 0x7fcdd8075540 2024-09-10T23:29:27.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.881+0000 7fcde24d8740 1 Processor -- start 2024-09-10T23:29:27.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.882+0000 7fcddda00640 1 --2- 172.21.15.3:0/1744573476 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcdbc0b5360 0x7fcdbc0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:27.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.882+0000 7fcde24d8740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561cc1c91ff0 0x561cc1c9b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:27.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.882+0000 7fcde24d8740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cc1c92910 0x561cc1c9be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:27.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.882+0000 7fcde24d8740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cc1c9e8a0 0x561cc1c9c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:27.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.882+0000 7fcde24d8740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x561cc1a59bb0 con 0x561cc1c92910 2024-09-10T23:29:27.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.882+0000 7fcde24d8740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x561cc1b936c0 con 0x561cc1c91ff0 2024-09-10T23:29:27.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.882+0000 7fcde24d8740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x561cc1ca1550 con 0x561cc1c9e8a0 2024-09-10T23:29:27.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.882+0000 7fcde24d8740 10 client.0 _ll_register_callbacks cb 0x561cc1bae490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:27.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.882+0000 7fcddda00640 1 --2- 172.21.15.3:0/1744573476 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcdbc0b5360 0x7fcdbc0b7820 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0009d50 tx=0x7fcdd0000f40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:27.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.883+0000 7fcdd7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cc1c92910 0x561cc1c9be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:27.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.883+0000 7fcdd7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cc1c92910 0x561cc1c9be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42190/0 (socket says 172.21.15.3:42190) 2024-09-10T23:29:27.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.883+0000 7fcdd7e00640 1 -- 172.21.15.3:0/4091019741 learned_addr learned my addr 172.21.15.3:0/4091019741 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:29:27.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.883+0000 7fcddd000640 1 --2- 172.21.15.3:0/4091019741 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561cc1c91ff0 0x561cc1c9b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:27.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.883+0000 7fcddda00640 1 --2- 172.21.15.3:0/4091019741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cc1c9e8a0 0x561cc1c9c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:27.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.883+0000 7fcdd7e00640 1 -- 172.21.15.3:0/4091019741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cc1c9e8a0 msgr2=0x561cc1c9c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:27.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.883+0000 7fcdd7e00640 1 --2- 172.21.15.3:0/4091019741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cc1c9e8a0 0x561cc1c9c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.883+0000 7fcdd7e00640 1 -- 172.21.15.3:0/4091019741 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561cc1c91ff0 msgr2=0x561cc1c9b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:27.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.883+0000 7fcdd7e00640 1 --2- 172.21.15.3:0/4091019741 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561cc1c91ff0 0x561cc1c9b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.883+0000 7fcdd7e00640 1 -- 172.21.15.3:0/4091019741 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cc1956b00 con 0x561cc1c92910 2024-09-10T23:29:27.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.884+0000 7fcdd7e00640 1 --2- 172.21.15.3:0/4091019741 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cc1c92910 0x561cc1c9be30 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4033000 tx=0x7fcdc4003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b533a3b5ce304d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:27.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.884+0000 7fcdc2a00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-10T23:29:27.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.884+0000 7fcdc2a00640 1 -- 172.21.15.3:0/4091019741 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4035040 con 0x561cc1c92910 2024-09-10T23:29:27.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.884+0000 7fcdc2a00640 1 -- 172.21.15.3:0/4091019741 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7fcdc4003c50 con 0x561cc1c92910 2024-09-10T23:29:27.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.884+0000 7fcde24d8740 1 -- 172.21.15.3:0/4091019741 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcdd0004d20 con 0x561cc1c92910 2024-09-10T23:29:27.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.884+0000 7fcdc2a00640 1 -- 172.21.15.3:0/4091019741 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fcdc4003e50 con 0x561cc1c92910 2024-09-10T23:29:27.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.884+0000 7fcde24d8740 10 client.15762 fetch_fsmap learned FSMap version 26 2024-09-10T23:29:27.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.884+0000 7fcde24d8740 1 -- 172.21.15.3:0/4091019741 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561cc19cd960 con 0x561cc1c92910 2024-09-10T23:29:27.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.885+0000 7fcdc2a00640 1 -- 172.21.15.3:0/4091019741 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcdd0004d20 con 0x561cc1c92910 2024-09-10T23:29:27.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.885+0000 7fcdc2a00640 1 -- 172.21.15.3:0/4091019741 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fcdc403d610 con 0x561cc1c92910 2024-09-10T23:29:27.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.885+0000 7fcde24d8740 10 client.15762 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:29:27.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.885+0000 7fcde24d8740 10 client.15762 resolve_mds: validated gid 34724 aka daemon mds.b 2024-09-10T23:29:27.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.885+0000 7fcde24d8740 20 client.15762 populate_metadata read hostname 'smithi003' 2024-09-10T23:29:27.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.885+0000 7fcde24d8740 1 --2- 172.21.15.3:0/4091019741 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x561cc1cae420 0x561cc1cb0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:27.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.885+0000 7fcde24d8740 4 client.15762 mds_command: new command op to 34724 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:29:27.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.885+0000 7fcde24d8740 1 -- 172.21.15.3:0/4091019741 --> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561cc1c0b1e0 con 0x561cc1cae420 2024-09-10T23:29:27.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.885+0000 7fcddd000640 1 --2- 172.21.15.3:0/4091019741 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x561cc1cae420 0x561cc1cb0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:27.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.886+0000 7fcddd000640 1 --2- 172.21.15.3:0/4091019741 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x561cc1cae420 0x561cc1cb0870 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97c3d49914682671 server_cookie=80cc5da44f004d10 in_seq=0 out_seq=0 2024-09-10T23:29:27.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.886+0000 7fcdc2a00640 10 client.15762 ms_handle_connect on v2:172.21.15.38:6838/458259815 2024-09-10T23:29:27.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.887+0000 7fcdc2a00640 1 -- 172.21.15.3:0/4091019741 <== mds.0 v2:172.21.15.38:6838/458259815 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561cc1c0b1e0 con 0x561cc1cae420 2024-09-10T23:29:27.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.887+0000 7fcdc2a00640 10 client.15762 handle_command_reply: tid=0 2024-09-10T23:29:27.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.887+0000 7fcde24d8740 1 client.15762 shutdown 2024-09-10T23:29:27.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.887+0000 7fcde24d8740 1 -- 172.21.15.3:0/4091019741 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cc1c92910 msgr2=0x561cc1c9be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:27.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.887+0000 7fcde24d8740 1 --2- 172.21.15.3:0/4091019741 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cc1c92910 0x561cc1c9be30 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4033000 tx=0x7fcdc4003820 comp rx=0 tx=0).stop 2024-09-10T23:29:27.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.887+0000 7fcde24d8740 1 -- 172.21.15.3:0/4091019741 shutdown_connections 2024-09-10T23:29:27.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.887+0000 7fcde24d8740 1 --2- 172.21.15.3:0/4091019741 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x561cc1cae420 0x561cc1cb0870 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.887+0000 7fcde24d8740 1 --2- 172.21.15.3:0/4091019741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cc1c9e8a0 0x561cc1c9c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.887+0000 7fcde24d8740 1 --2- 172.21.15.3:0/4091019741 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cc1c92910 0x561cc1c9be30 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.887+0000 7fcdc2a00640 0 client.15762 ms_handle_reset on v2:172.21.15.38:6838/458259815 2024-09-10T23:29:27.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.887+0000 7fcde24d8740 1 --2- 172.21.15.3:0/4091019741 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561cc1c91ff0 0x561cc1c9b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.887+0000 7fcde24d8740 1 -- 172.21.15.3:0/4091019741 >> 172.21.15.3:0/4091019741 conn(0x561cc1c8fe20 msgr2=0x561cc1c959c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:27.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.887+0000 7fcde24d8740 1 -- 172.21.15.3:0/4091019741 shutdown_connections 2024-09-10T23:29:27.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.887+0000 7fcde24d8740 1 -- 172.21.15.3:0/4091019741 wait complete. 2024-09-10T23:29:27.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.888+0000 7fcde24d8740 20 client.15762 trim_cache size 0 max 16384 2024-09-10T23:29:27.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.906+0000 7fcde24d8740 1 Processor -- start 2024-09-10T23:29:27.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.906+0000 7fcde24d8740 1 -- start start 2024-09-10T23:29:27.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.906+0000 7fcde24d8740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cc1c91ff0 0x561cc1c98b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:27.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.906+0000 7fcde24d8740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561cc1c92910 0x561cc1c99060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:27.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.906+0000 7fcde24d8740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cc1c9e8a0 0x561cc1cb6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:27.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.906+0000 7fcde24d8740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd81b0430 con 0x561cc1c91ff0 2024-09-10T23:29:27.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.906+0000 7fcde24d8740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd81add00 con 0x561cc1c92910 2024-09-10T23:29:27.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.906+0000 7fcde24d8740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd81abb50 con 0x561cc1c9e8a0 2024-09-10T23:29:27.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.906+0000 7fcddd000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cc1c91ff0 0x561cc1c98b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:27.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.906+0000 7fcddd000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cc1c91ff0 0x561cc1c98b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42202/0 (socket says 172.21.15.3:42202) 2024-09-10T23:29:27.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.906+0000 7fcddd000640 1 -- 172.21.15.3:0/987206410 learned_addr learned my addr 172.21.15.3:0/987206410 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:29:27.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.907+0000 7fcdd7e00640 1 --2- 172.21.15.3:0/987206410 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561cc1c92910 0x561cc1c99060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:27.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.907+0000 7fcddda00640 1 --2- 172.21.15.3:0/987206410 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cc1c9e8a0 0x561cc1cb6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:27.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.907+0000 7fcddd000640 1 -- 172.21.15.3:0/987206410 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cc1c9e8a0 msgr2=0x561cc1cb6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:27.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.907+0000 7fcddd000640 1 --2- 172.21.15.3:0/987206410 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cc1c9e8a0 0x561cc1cb6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.907+0000 7fcddd000640 1 -- 172.21.15.3:0/987206410 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561cc1c92910 msgr2=0x561cc1c99060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:27.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.907+0000 7fcddd000640 1 --2- 172.21.15.3:0/987206410 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561cc1c92910 0x561cc1c99060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.907+0000 7fcddd000640 1 -- 172.21.15.3:0/987206410 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cc1caa780 con 0x561cc1c91ff0 2024-09-10T23:29:27.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.907+0000 7fcdd7e00640 1 --2- 172.21.15.3:0/987206410 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561cc1c92910 0x561cc1c99060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:27.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.907+0000 7fcddd000640 1 --2- 172.21.15.3:0/987206410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cc1c91ff0 0x561cc1c98b20 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80058c0 tx=0x7fcdc80cf040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef1565650f396ac server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:27.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.907+0000 7fcdcd600640 1 -- 172.21.15.3:0/987206410 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc8020040 con 0x561cc1c91ff0 2024-09-10T23:29:27.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.907+0000 7fcdcd600640 1 -- 172.21.15.3:0/987206410 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcdc80b3e50 con 0x561cc1c91ff0 2024-09-10T23:29:27.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.907+0000 7fcdcd600640 1 -- 172.21.15.3:0/987206410 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc80b5580 con 0x561cc1c91ff0 2024-09-10T23:29:27.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.908+0000 7fcde24d8740 1 -- 172.21.15.3:0/987206410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cc1c91ff0 msgr2=0x561cc1c98b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:27.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.908+0000 7fcde24d8740 1 --2- 172.21.15.3:0/987206410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cc1c91ff0 0x561cc1c98b20 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80058c0 tx=0x7fcdc80cf040 comp rx=0 tx=0).stop 2024-09-10T23:29:27.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.908+0000 7fcde24d8740 1 -- 172.21.15.3:0/987206410 shutdown_connections 2024-09-10T23:29:27.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.908+0000 7fcde24d8740 1 --2- 172.21.15.3:0/987206410 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cc1c9e8a0 0x561cc1cb6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.908+0000 7fcde24d8740 1 --2- 172.21.15.3:0/987206410 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561cc1c92910 0x561cc1c99060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.908+0000 7fcde24d8740 1 --2- 172.21.15.3:0/987206410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cc1c91ff0 0x561cc1c98b20 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.908+0000 7fcde24d8740 1 -- 172.21.15.3:0/987206410 >> 172.21.15.3:0/987206410 conn(0x561cc1c8fe20 msgr2=0x561cc1c9d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:27.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.908+0000 7fcde24d8740 1 -- 172.21.15.3:0/987206410 shutdown_connections 2024-09-10T23:29:27.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.908+0000 7fcde24d8740 1 -- 172.21.15.3:0/987206410 wait complete. 2024-09-10T23:29:27.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.909+0000 7fcde24d8740 1 -- start start 2024-09-10T23:29:27.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.909+0000 7fcde24d8740 1 Processor -- start 2024-09-10T23:29:27.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.909+0000 7fcde24d8740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cc1c91ff0 0x561cc1ca1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:27.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.909+0000 7fcde24d8740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cc1c92910 0x561cc1ca2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:27.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.909+0000 7fcde24d8740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561cc1c9e8a0 0x561cc1d1b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:27.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.909+0000 7fcde24d8740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd81ac1c0 con 0x561cc1c91ff0 2024-09-10T23:29:27.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.909+0000 7fcde24d8740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd81ad630 con 0x561cc1c9e8a0 2024-09-10T23:29:27.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.909+0000 7fcde24d8740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd81ac890 con 0x561cc1c92910 2024-09-10T23:29:27.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.909+0000 7fcde24d8740 10 client.0 _ll_register_callbacks cb 0x7fcdc4009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:27.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.910+0000 7fcddd000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cc1c91ff0 0x561cc1ca1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:27.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.910+0000 7fcdd7e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cc1c92910 0x561cc1ca2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:27.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.910+0000 7fcdd7e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cc1c92910 0x561cc1ca2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.3:39030/0 (socket says 172.21.15.3:39030) 2024-09-10T23:29:27.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.910+0000 7fcdd7e00640 1 -- 172.21.15.3:0/2125668286 learned_addr learned my addr 172.21.15.3:0/2125668286 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:29:27.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.910+0000 7fcddda00640 1 --2- 172.21.15.3:0/2125668286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561cc1c9e8a0 0x561cc1d1b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:27.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.910+0000 7fcdd7e00640 1 -- 172.21.15.3:0/2125668286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561cc1c9e8a0 msgr2=0x561cc1d1b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:27.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.910+0000 7fcdd7e00640 1 --2- 172.21.15.3:0/2125668286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561cc1c9e8a0 0x561cc1d1b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.910+0000 7fcdd7e00640 1 -- 172.21.15.3:0/2125668286 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cc1c91ff0 msgr2=0x561cc1ca1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:27.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.910+0000 7fcdd7e00640 1 --2- 172.21.15.3:0/2125668286 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cc1c91ff0 0x561cc1ca1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.910+0000 7fcdd7e00640 1 -- 172.21.15.3:0/2125668286 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cc1d1b8c0 con 0x561cc1c92910 2024-09-10T23:29:27.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.910+0000 7fcddd000640 1 --2- 172.21.15.3:0/2125668286 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cc1c91ff0 0x561cc1ca1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:29:27.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.910+0000 7fcdd7e00640 1 --2- 172.21.15.3:0/2125668286 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cc1c92910 0x561cc1ca2110 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcdc40057c0 tx=0x7fcdc4003890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3ee2cabe3b8ba11 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:27.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.910+0000 7fcdc2a00640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-10T23:29:27.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.911+0000 7fcdc2a00640 1 -- 172.21.15.3:0/2125668286 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4035030 con 0x561cc1c92910 2024-09-10T23:29:27.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.911+0000 7fcde24d8740 1 -- 172.21.15.3:0/2125668286 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcdc80b3e50 con 0x561cc1c92910 2024-09-10T23:29:27.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.911+0000 7fcdc2a00640 1 -- 172.21.15.3:0/2125668286 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7fcdc403d650 con 0x561cc1c92910 2024-09-10T23:29:27.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.911+0000 7fcdc2a00640 1 -- 172.21.15.3:0/2125668286 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fcdc4060050 con 0x561cc1c92910 2024-09-10T23:29:27.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.911+0000 7fcde24d8740 10 client.25519 fetch_fsmap learned FSMap version 26 2024-09-10T23:29:27.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.911+0000 7fcde24d8740 1 -- 172.21.15.3:0/2125668286 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561cc1d1cb00 con 0x561cc1c92910 2024-09-10T23:29:27.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.912+0000 7fcdc2a00640 1 -- 172.21.15.3:0/2125668286 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcdc80b3e50 con 0x561cc1c92910 2024-09-10T23:29:27.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.912+0000 7fcdc2a00640 1 -- 172.21.15.3:0/2125668286 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fcdc405b030 con 0x561cc1c92910 2024-09-10T23:29:27.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.912+0000 7fcde24d8740 10 client.25519 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:29:27.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.912+0000 7fcde24d8740 10 client.25519 resolve_mds: validated gid 34724 aka daemon mds.b 2024-09-10T23:29:27.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.912+0000 7fcde24d8740 20 client.25519 populate_metadata read hostname 'smithi003' 2024-09-10T23:29:27.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.912+0000 7fcde24d8740 1 --2- 172.21.15.3:0/2125668286 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x561cc1d1d2a0 0x561cc1d1f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:27.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.912+0000 7fcde24d8740 4 client.25519 mds_command: new command op to 34724 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "2e33a07a", "release": true, "await": true}] 2024-09-10T23:29:27.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.912+0000 7fcde24d8740 1 -- 172.21.15.3:0/2125668286 --> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] -- command(tid 0: {"prefix": "quiesce db", "set_id": "2e33a07a", "release": true, "await": true}) -- 0x561cc1c06c90 con 0x561cc1d1d2a0 2024-09-10T23:29:27.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.912+0000 7fcddd000640 1 --2- 172.21.15.3:0/2125668286 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x561cc1d1d2a0 0x561cc1d1f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:27.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.913+0000 7fcddd000640 1 --2- 172.21.15.3:0/2125668286 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x561cc1d1d2a0 0x561cc1d1f6c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d7c8cd2e212668b server_cookie=a036854fb5fce902 in_seq=0 out_seq=0 2024-09-10T23:29:27.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.913+0000 7fcdc2a00640 10 client.25519 ms_handle_connect on v2:172.21.15.38:6838/458259815 2024-09-10T23:29:27.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.916+0000 7fcdc2a00640 1 -- 172.21.15.3:0/2125668286 <== mds.0 v2:172.21.15.38:6838/458259815 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x561cc1c06c90 con 0x561cc1d1d2a0 2024-09-10T23:29:27.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.916+0000 7fcdc2a00640 10 client.25519 handle_command_reply: tid=0 2024-09-10T23:29:27.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.916+0000 7fcde24d8740 1 client.25519 shutdown 2024-09-10T23:29:27.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.916+0000 7fcde24d8740 1 -- 172.21.15.3:0/2125668286 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cc1c92910 msgr2=0x561cc1ca2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:27.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.916+0000 7fcde24d8740 1 --2- 172.21.15.3:0/2125668286 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cc1c92910 0x561cc1ca2110 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcdc40057c0 tx=0x7fcdc4003890 comp rx=0 tx=0).stop 2024-09-10T23:29:27.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.916+0000 7fcde24d8740 1 -- 172.21.15.3:0/2125668286 shutdown_connections 2024-09-10T23:29:27.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.916+0000 7fcde24d8740 1 --2- 172.21.15.3:0/2125668286 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x561cc1d1d2a0 0x561cc1d1f6c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.916+0000 7fcde24d8740 1 --2- 172.21.15.3:0/2125668286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561cc1c9e8a0 0x561cc1d1b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.916+0000 7fcde24d8740 1 --2- 172.21.15.3:0/2125668286 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cc1c92910 0x561cc1ca2110 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.916+0000 7fcde24d8740 1 --2- 172.21.15.3:0/2125668286 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cc1c91ff0 0x561cc1ca1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.916+0000 7fcde24d8740 1 -- 172.21.15.3:0/2125668286 >> 172.21.15.3:0/2125668286 conn(0x561cc1c8fe20 msgr2=0x561cc1c9b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:27.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.916+0000 7fcdc2a00640 0 client.25519 ms_handle_reset on v2:172.21.15.38:6838/458259815 2024-09-10T23:29:27.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.916+0000 7fcde24d8740 1 -- 172.21.15.3:0/2125668286 shutdown_connections 2024-09-10T23:29:27.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.916+0000 7fcde24d8740 1 -- 172.21.15.3:0/2125668286 wait complete. 2024-09-10T23:29:27.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.916+0000 7fcde24d8740 20 client.25519 trim_cache size 0 max 16384 2024-09-10T23:29:27.417 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-10T23:29:27.417 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 26, 2024-09-10T23:29:27.417 INFO:teuthology.orchestra.run.smithi003.stdout: "leader": 34724, 2024-09-10T23:29:27.417 INFO:teuthology.orchestra.run.smithi003.stdout: "set_version": 12, 2024-09-10T23:29:27.417 INFO:teuthology.orchestra.run.smithi003.stdout: "sets": { 2024-09-10T23:29:27.417 INFO:teuthology.orchestra.run.smithi003.stdout: "2e33a07a": { 2024-09-10T23:29:27.417 INFO:teuthology.orchestra.run.smithi003.stdout: "version": 12, 2024-09-10T23:29:27.417 INFO:teuthology.orchestra.run.smithi003.stdout: "age_ref": 0.0, 2024-09-10T23:29:27.417 INFO:teuthology.orchestra.run.smithi003.stdout: "state": { 2024-09-10T23:29:27.417 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "RELEASED", 2024-09-10T23:29:27.418 INFO:teuthology.orchestra.run.smithi003.stdout: "age": 0.0 2024-09-10T23:29:27.418 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:29:27.418 INFO:teuthology.orchestra.run.smithi003.stdout: "timeout": 90.0, 2024-09-10T23:29:27.418 INFO:teuthology.orchestra.run.smithi003.stdout: "expiration": 140.5, 2024-09-10T23:29:27.418 INFO:teuthology.orchestra.run.smithi003.stdout: "members": { 2024-09-10T23:29:27.418 INFO:teuthology.orchestra.run.smithi003.stdout: "file:/": { 2024-09-10T23:29:27.418 INFO:teuthology.orchestra.run.smithi003.stdout: "excluded": false, 2024-09-10T23:29:27.418 INFO:teuthology.orchestra.run.smithi003.stdout: "state": { 2024-09-10T23:29:27.418 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "RELEASED", 2024-09-10T23:29:27.418 INFO:teuthology.orchestra.run.smithi003.stdout: "age": 0.0 2024-09-10T23:29:27.418 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:29:27.418 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:29:27.418 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:29:27.419 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:29:27.419 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:29:27.419 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-10T23:29:27.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.917+0000 7fcddfa00640 1 -- 172.21.15.3:0/1744573476 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcdbc0b5360 msgr2=0x7fcdbc0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:27.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.917+0000 7fcddfa00640 1 --2- 172.21.15.3:0/1744573476 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcdbc0b5360 0x7fcdbc0b7820 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0009d50 tx=0x7fcdd0000f40 comp rx=0 tx=0).stop 2024-09-10T23:29:27.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.917+0000 7fcddfa00640 1 -- 172.21.15.3:0/1744573476 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdd8075540 msgr2=0x7fcdd819b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:27.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.917+0000 7fcddfa00640 1 --2- 172.21.15.3:0/1744573476 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdd8075540 0x7fcdd819b410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcdc800d950 tx=0x7fcdc800de10 comp rx=0 tx=0).stop 2024-09-10T23:29:27.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.917+0000 7fcddfa00640 1 -- 172.21.15.3:0/1744573476 shutdown_connections 2024-09-10T23:29:27.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.917+0000 7fcddfa00640 1 --2- 172.21.15.3:0/1744573476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdd810f3c0 0x7fcdd81a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.917+0000 7fcddfa00640 1 --2- 172.21.15.3:0/1744573476 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcdbc0b5360 0x7fcdbc0b7820 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.917+0000 7fcddfa00640 1 --2- 172.21.15.3:0/1744573476 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdd8075f40 0x7fcdd819b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.917+0000 7fcddfa00640 1 --2- 172.21.15.3:0/1744573476 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdd8075540 0x7fcdd819b410 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.917+0000 7fcddfa00640 1 -- 172.21.15.3:0/1744573476 >> 172.21.15.3:0/1744573476 conn(0x7fcdd80fe810 msgr2=0x7fcdd80ff470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:27.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.917+0000 7fcddfa00640 1 -- 172.21.15.3:0/1744573476 shutdown_connections 2024-09-10T23:29:27.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:26.917+0000 7fcddfa00640 1 -- 172.21.15.3:0/1744573476 wait complete. 2024-09-10T23:29:27.455 INFO:tasks.workunit.client.0.smithi003.stdout:lsof: /usr/bin/lsof /usr/share/man/man1/lsof.1.gz 2024-09-10T23:29:27.455 INFO:tasks.workunit.client.0.smithi003.stderr:+ lsof 2024-09-10T23:29:27.541 INFO:tasks.workunit.client.0.smithi003.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/77a52a37e8f88462cea6771d4aa25e63ac6d837ba398cf6f00e776111cc2de6c/merged 2024-09-10T23:29:27.541 INFO:tasks.workunit.client.0.smithi003.stderr: Output information may be incomplete. 2024-09-10T23:29:27.541 INFO:tasks.workunit.client.0.smithi003.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/2be80f4f7316ca8a5c459cb75da698a51fd97ddeee5287fced694a5cf5f140d6/merged 2024-09-10T23:29:27.541 INFO:tasks.workunit.client.0.smithi003.stderr: Output information may be incomplete. 2024-09-10T23:29:27.541 INFO:tasks.workunit.client.0.smithi003.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/66878287880ab44aac3a698d632b53d186ef96bd229817e2c32daf048dd97f92/merged 2024-09-10T23:29:27.542 INFO:tasks.workunit.client.0.smithi003.stderr: Output information may be incomplete. 2024-09-10T23:29:27.542 INFO:tasks.workunit.client.0.smithi003.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/b40eef2d3fcd560ad2ef7624aab75a55df76bba8f030a4902fdfa408775bcac1/merged 2024-09-10T23:29:27.542 INFO:tasks.workunit.client.0.smithi003.stderr: Output information may be incomplete. 2024-09-10T23:29:27.542 INFO:tasks.workunit.client.0.smithi003.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/149be40fb418ab1c50a85b04773165856107476c82452a4214334bcb0c68f990/merged 2024-09-10T23:29:27.542 INFO:tasks.workunit.client.0.smithi003.stderr: Output information may be incomplete. 2024-09-10T23:29:27.542 INFO:tasks.workunit.client.0.smithi003.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/c99549f2a487791a4307554b64eaaf405a56145721c6c639f26838d93dbcae27/merged 2024-09-10T23:29:27.542 INFO:tasks.workunit.client.0.smithi003.stderr: Output information may be incomplete. 2024-09-10T23:29:27.542 INFO:tasks.workunit.client.0.smithi003.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/5d955b957d4a0e77655edc5bca007d7b5205d27be8e86779763ae4c28882193b/merged 2024-09-10T23:29:27.543 INFO:tasks.workunit.client.0.smithi003.stderr: Output information may be incomplete. 2024-09-10T23:29:27.543 INFO:tasks.workunit.client.0.smithi003.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/8dc267f2e57c5e4611917f0bf3096933c3206bb6dfbc875fbefb8c38a037f015/merged 2024-09-10T23:29:27.543 INFO:tasks.workunit.client.0.smithi003.stderr: Output information may be incomplete. 2024-09-10T23:29:27.543 INFO:tasks.workunit.client.0.smithi003.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/79206fec5c2e5e2f4ebd93c5b5af04de66191d2569b256cb135f90cfd0f322ce/merged 2024-09-10T23:29:27.543 INFO:tasks.workunit.client.0.smithi003.stderr: Output information may be incomplete. 2024-09-10T23:29:27.543 INFO:tasks.workunit.client.0.smithi003.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/a7c378ff9d49bdc46d1c11d67a029b08e6cd1ab59462f0d54c417e00a17cf5c4/merged 2024-09-10T23:29:27.543 INFO:tasks.workunit.client.0.smithi003.stderr: Output information may be incomplete. 2024-09-10T23:29:27.543 INFO:tasks.workunit.client.0.smithi003.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/a429eb44e75c306303e58568cc84601f31de83898ad9b5e24ca524ec3fd16760/merged 2024-09-10T23:29:27.543 INFO:tasks.workunit.client.0.smithi003.stderr: Output information may be incomplete. 2024-09-10T23:29:27.689 INFO:tasks.workunit.client.0.smithi003.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2024-09-10T23:29:27.689 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 1 root cwd unknown /proc/1/cwd (readlink: Permission denied) 2024-09-10T23:29:27.689 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 1 root rtd unknown /proc/1/root (readlink: Permission denied) 2024-09-10T23:29:27.690 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 1 root txt unknown /proc/1/exe (readlink: Permission denied) 2024-09-10T23:29:27.690 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 1 root NOFD /proc/1/fd (opendir: Permission denied) 2024-09-10T23:29:27.690 INFO:tasks.workunit.client.0.smithi003.stdout:kthreadd 2 root cwd unknown /proc/2/cwd (readlink: Permission denied) 2024-09-10T23:29:27.690 INFO:tasks.workunit.client.0.smithi003.stdout:kthreadd 2 root rtd unknown /proc/2/root (readlink: Permission denied) 2024-09-10T23:29:27.690 INFO:tasks.workunit.client.0.smithi003.stdout:kthreadd 2 root txt unknown /proc/2/exe (readlink: Permission denied) 2024-09-10T23:29:27.690 INFO:tasks.workunit.client.0.smithi003.stdout:kthreadd 2 root NOFD /proc/2/fd (opendir: Permission denied) 2024-09-10T23:29:27.690 INFO:tasks.workunit.client.0.smithi003.stdout:pool_work 3 root cwd unknown /proc/3/cwd (readlink: Permission denied) 2024-09-10T23:29:27.690 INFO:tasks.workunit.client.0.smithi003.stdout:pool_work 3 root rtd unknown /proc/3/root (readlink: Permission denied) 2024-09-10T23:29:27.690 INFO:tasks.workunit.client.0.smithi003.stdout:pool_work 3 root txt unknown /proc/3/exe (readlink: Permission denied) 2024-09-10T23:29:27.690 INFO:tasks.workunit.client.0.smithi003.stdout:pool_work 3 root NOFD /proc/3/fd (opendir: Permission denied) 2024-09-10T23:29:27.690 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 4 root cwd unknown /proc/4/cwd (readlink: Permission denied) 2024-09-10T23:29:27.691 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 4 root rtd unknown /proc/4/root (readlink: Permission denied) 2024-09-10T23:29:27.691 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 4 root txt unknown /proc/4/exe (readlink: Permission denied) 2024-09-10T23:29:27.691 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 4 root NOFD /proc/4/fd (opendir: Permission denied) 2024-09-10T23:29:27.691 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 5 root cwd unknown /proc/5/cwd (readlink: Permission denied) 2024-09-10T23:29:27.691 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 5 root rtd unknown /proc/5/root (readlink: Permission denied) 2024-09-10T23:29:27.691 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 5 root txt unknown /proc/5/exe (readlink: Permission denied) 2024-09-10T23:29:27.691 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 5 root NOFD /proc/5/fd (opendir: Permission denied) 2024-09-10T23:29:27.691 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 6 root cwd unknown /proc/6/cwd (readlink: Permission denied) 2024-09-10T23:29:27.691 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 6 root rtd unknown /proc/6/root (readlink: Permission denied) 2024-09-10T23:29:27.691 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 6 root txt unknown /proc/6/exe (readlink: Permission denied) 2024-09-10T23:29:27.691 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 6 root NOFD /proc/6/fd (opendir: Permission denied) 2024-09-10T23:29:27.691 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 7 root cwd unknown /proc/7/cwd (readlink: Permission denied) 2024-09-10T23:29:27.691 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 7 root rtd unknown /proc/7/root (readlink: Permission denied) 2024-09-10T23:29:27.691 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 7 root txt unknown /proc/7/exe (readlink: Permission denied) 2024-09-10T23:29:27.691 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 7 root NOFD /proc/7/fd (opendir: Permission denied) 2024-09-10T23:29:27.692 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/0 8 root cwd unknown /proc/8/cwd (readlink: Permission denied) 2024-09-10T23:29:27.692 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/0 8 root rtd unknown /proc/8/root (readlink: Permission denied) 2024-09-10T23:29:27.692 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/0 8 root txt unknown /proc/8/exe (readlink: Permission denied) 2024-09-10T23:29:27.692 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/0 8 root NOFD /proc/8/fd (opendir: Permission denied) 2024-09-10T23:29:27.692 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/0 10 root cwd unknown /proc/10/cwd (readlink: Permission denied) 2024-09-10T23:29:27.692 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/0 10 root rtd unknown /proc/10/root (readlink: Permission denied) 2024-09-10T23:29:27.692 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/0 10 root txt unknown /proc/10/exe (readlink: Permission denied) 2024-09-10T23:29:27.692 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/0 10 root NOFD /proc/10/fd (opendir: Permission denied) 2024-09-10T23:29:27.692 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 11 root cwd unknown /proc/11/cwd (readlink: Permission denied) 2024-09-10T23:29:27.692 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 11 root rtd unknown /proc/11/root (readlink: Permission denied) 2024-09-10T23:29:27.692 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 11 root txt unknown /proc/11/exe (readlink: Permission denied) 2024-09-10T23:29:27.692 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 11 root NOFD /proc/11/fd (opendir: Permission denied) 2024-09-10T23:29:27.692 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 12 root cwd unknown /proc/12/cwd (readlink: Permission denied) 2024-09-10T23:29:27.692 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 12 root rtd unknown /proc/12/root (readlink: Permission denied) 2024-09-10T23:29:27.692 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 12 root txt unknown /proc/12/exe (readlink: Permission denied) 2024-09-10T23:29:27.693 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 12 root NOFD /proc/12/fd (opendir: Permission denied) 2024-09-10T23:29:27.693 INFO:tasks.workunit.client.0.smithi003.stdout:rcu_tasks 13 root cwd unknown /proc/13/cwd (readlink: Permission denied) 2024-09-10T23:29:27.693 INFO:tasks.workunit.client.0.smithi003.stdout:rcu_tasks 13 root rtd unknown /proc/13/root (readlink: Permission denied) 2024-09-10T23:29:27.693 INFO:tasks.workunit.client.0.smithi003.stdout:rcu_tasks 13 root txt unknown /proc/13/exe (readlink: Permission denied) 2024-09-10T23:29:27.693 INFO:tasks.workunit.client.0.smithi003.stdout:rcu_tasks 13 root NOFD /proc/13/fd (opendir: Permission denied) 2024-09-10T23:29:27.693 INFO:tasks.workunit.client.0.smithi003.stdout:rcu_tasks 14 root cwd unknown /proc/14/cwd (readlink: Permission denied) 2024-09-10T23:29:27.693 INFO:tasks.workunit.client.0.smithi003.stdout:rcu_tasks 14 root rtd unknown /proc/14/root (readlink: Permission denied) 2024-09-10T23:29:27.693 INFO:tasks.workunit.client.0.smithi003.stdout:rcu_tasks 14 root txt unknown /proc/14/exe (readlink: Permission denied) 2024-09-10T23:29:27.693 INFO:tasks.workunit.client.0.smithi003.stdout:rcu_tasks 14 root NOFD /proc/14/fd (opendir: Permission denied) 2024-09-10T23:29:27.693 INFO:tasks.workunit.client.0.smithi003.stdout:rcu_tasks 15 root cwd unknown /proc/15/cwd (readlink: Permission denied) 2024-09-10T23:29:27.693 INFO:tasks.workunit.client.0.smithi003.stdout:rcu_tasks 15 root rtd unknown /proc/15/root (readlink: Permission denied) 2024-09-10T23:29:27.693 INFO:tasks.workunit.client.0.smithi003.stdout:rcu_tasks 15 root txt unknown /proc/15/exe (readlink: Permission denied) 2024-09-10T23:29:27.694 INFO:tasks.workunit.client.0.smithi003.stdout:rcu_tasks 15 root NOFD /proc/15/fd (opendir: Permission denied) 2024-09-10T23:29:27.694 INFO:tasks.workunit.client.0.smithi003.stdout:ksoftirqd 16 root cwd unknown /proc/16/cwd (readlink: Permission denied) 2024-09-10T23:29:27.694 INFO:tasks.workunit.client.0.smithi003.stdout:ksoftirqd 16 root rtd unknown /proc/16/root (readlink: Permission denied) 2024-09-10T23:29:27.694 INFO:tasks.workunit.client.0.smithi003.stdout:ksoftirqd 16 root txt unknown /proc/16/exe (readlink: Permission denied) 2024-09-10T23:29:27.694 INFO:tasks.workunit.client.0.smithi003.stdout:ksoftirqd 16 root NOFD /proc/16/fd (opendir: Permission denied) 2024-09-10T23:29:27.694 INFO:tasks.workunit.client.0.smithi003.stdout:rcu_preem 17 root cwd unknown /proc/17/cwd (readlink: Permission denied) 2024-09-10T23:29:27.694 INFO:tasks.workunit.client.0.smithi003.stdout:rcu_preem 17 root rtd unknown /proc/17/root (readlink: Permission denied) 2024-09-10T23:29:27.694 INFO:tasks.workunit.client.0.smithi003.stdout:rcu_preem 17 root txt unknown /proc/17/exe (readlink: Permission denied) 2024-09-10T23:29:27.694 INFO:tasks.workunit.client.0.smithi003.stdout:rcu_preem 17 root NOFD /proc/17/fd (opendir: Permission denied) 2024-09-10T23:29:27.694 INFO:tasks.workunit.client.0.smithi003.stdout:rcu_exp_p 18 root cwd unknown /proc/18/cwd (readlink: Permission denied) 2024-09-10T23:29:27.694 INFO:tasks.workunit.client.0.smithi003.stdout:rcu_exp_p 18 root rtd unknown /proc/18/root (readlink: Permission denied) 2024-09-10T23:29:27.694 INFO:tasks.workunit.client.0.smithi003.stdout:rcu_exp_p 18 root txt unknown /proc/18/exe (readlink: Permission denied) 2024-09-10T23:29:27.695 INFO:tasks.workunit.client.0.smithi003.stdout:rcu_exp_p 18 root NOFD /proc/18/fd (opendir: Permission denied) 2024-09-10T23:29:27.695 INFO:tasks.workunit.client.0.smithi003.stdout:rcu_exp_g 19 root cwd unknown /proc/19/cwd (readlink: Permission denied) 2024-09-10T23:29:27.695 INFO:tasks.workunit.client.0.smithi003.stdout:rcu_exp_g 19 root rtd unknown /proc/19/root (readlink: Permission denied) 2024-09-10T23:29:27.695 INFO:tasks.workunit.client.0.smithi003.stdout:rcu_exp_g 19 root txt unknown /proc/19/exe (readlink: Permission denied) 2024-09-10T23:29:27.695 INFO:tasks.workunit.client.0.smithi003.stdout:rcu_exp_g 19 root NOFD /proc/19/fd (opendir: Permission denied) 2024-09-10T23:29:27.695 INFO:tasks.workunit.client.0.smithi003.stdout:migration 20 root cwd unknown /proc/20/cwd (readlink: Permission denied) 2024-09-10T23:29:27.695 INFO:tasks.workunit.client.0.smithi003.stdout:migration 20 root rtd unknown /proc/20/root (readlink: Permission denied) 2024-09-10T23:29:27.695 INFO:tasks.workunit.client.0.smithi003.stdout:migration 20 root txt unknown /proc/20/exe (readlink: Permission denied) 2024-09-10T23:29:27.695 INFO:tasks.workunit.client.0.smithi003.stdout:migration 20 root NOFD /proc/20/fd (opendir: Permission denied) 2024-09-10T23:29:27.695 INFO:tasks.workunit.client.0.smithi003.stdout:cpuhp/0 21 root cwd unknown /proc/21/cwd (readlink: Permission denied) 2024-09-10T23:29:27.695 INFO:tasks.workunit.client.0.smithi003.stdout:cpuhp/0 21 root rtd unknown /proc/21/root (readlink: Permission denied) 2024-09-10T23:29:27.696 INFO:tasks.workunit.client.0.smithi003.stdout:cpuhp/0 21 root txt unknown /proc/21/exe (readlink: Permission denied) 2024-09-10T23:29:27.696 INFO:tasks.workunit.client.0.smithi003.stdout:cpuhp/0 21 root NOFD /proc/21/fd (opendir: Permission denied) 2024-09-10T23:29:27.696 INFO:tasks.workunit.client.0.smithi003.stdout:cpuhp/1 22 root cwd unknown /proc/22/cwd (readlink: Permission denied) 2024-09-10T23:29:27.696 INFO:tasks.workunit.client.0.smithi003.stdout:cpuhp/1 22 root rtd unknown /proc/22/root (readlink: Permission denied) 2024-09-10T23:29:27.696 INFO:tasks.workunit.client.0.smithi003.stdout:cpuhp/1 22 root txt unknown /proc/22/exe (readlink: Permission denied) 2024-09-10T23:29:27.696 INFO:tasks.workunit.client.0.smithi003.stdout:cpuhp/1 22 root NOFD /proc/22/fd (opendir: Permission denied) 2024-09-10T23:29:27.696 INFO:tasks.workunit.client.0.smithi003.stdout:migration 23 root cwd unknown /proc/23/cwd (readlink: Permission denied) 2024-09-10T23:29:27.696 INFO:tasks.workunit.client.0.smithi003.stdout:migration 23 root rtd unknown /proc/23/root (readlink: Permission denied) 2024-09-10T23:29:27.696 INFO:tasks.workunit.client.0.smithi003.stdout:migration 23 root txt unknown /proc/23/exe (readlink: Permission denied) 2024-09-10T23:29:27.696 INFO:tasks.workunit.client.0.smithi003.stdout:migration 23 root NOFD /proc/23/fd (opendir: Permission denied) 2024-09-10T23:29:27.696 INFO:tasks.workunit.client.0.smithi003.stdout:ksoftirqd 24 root cwd unknown /proc/24/cwd (readlink: Permission denied) 2024-09-10T23:29:27.696 INFO:tasks.workunit.client.0.smithi003.stdout:ksoftirqd 24 root rtd unknown /proc/24/root (readlink: Permission denied) 2024-09-10T23:29:27.697 INFO:tasks.workunit.client.0.smithi003.stdout:ksoftirqd 24 root txt unknown /proc/24/exe (readlink: Permission denied) 2024-09-10T23:29:27.697 INFO:tasks.workunit.client.0.smithi003.stdout:ksoftirqd 24 root NOFD /proc/24/fd (opendir: Permission denied) 2024-09-10T23:29:27.697 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/1 26 root cwd unknown /proc/26/cwd (readlink: Permission denied) 2024-09-10T23:29:27.697 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/1 26 root rtd unknown /proc/26/root (readlink: Permission denied) 2024-09-10T23:29:27.697 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/1 26 root txt unknown /proc/26/exe (readlink: Permission denied) 2024-09-10T23:29:27.697 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/1 26 root NOFD /proc/26/fd (opendir: Permission denied) 2024-09-10T23:29:27.697 INFO:tasks.workunit.client.0.smithi003.stdout:cpuhp/2 27 root cwd unknown /proc/27/cwd (readlink: Permission denied) 2024-09-10T23:29:27.697 INFO:tasks.workunit.client.0.smithi003.stdout:cpuhp/2 27 root rtd unknown /proc/27/root (readlink: Permission denied) 2024-09-10T23:29:27.697 INFO:tasks.workunit.client.0.smithi003.stdout:cpuhp/2 27 root txt unknown /proc/27/exe (readlink: Permission denied) 2024-09-10T23:29:27.697 INFO:tasks.workunit.client.0.smithi003.stdout:cpuhp/2 27 root NOFD /proc/27/fd (opendir: Permission denied) 2024-09-10T23:29:27.697 INFO:tasks.workunit.client.0.smithi003.stdout:migration 28 root cwd unknown /proc/28/cwd (readlink: Permission denied) 2024-09-10T23:29:27.697 INFO:tasks.workunit.client.0.smithi003.stdout:migration 28 root rtd unknown /proc/28/root (readlink: Permission denied) 2024-09-10T23:29:27.697 INFO:tasks.workunit.client.0.smithi003.stdout:migration 28 root txt unknown /proc/28/exe (readlink: Permission denied) 2024-09-10T23:29:27.698 INFO:tasks.workunit.client.0.smithi003.stdout:migration 28 root NOFD /proc/28/fd (opendir: Permission denied) 2024-09-10T23:29:27.698 INFO:tasks.workunit.client.0.smithi003.stdout:ksoftirqd 29 root cwd unknown /proc/29/cwd (readlink: Permission denied) 2024-09-10T23:29:27.698 INFO:tasks.workunit.client.0.smithi003.stdout:ksoftirqd 29 root rtd unknown /proc/29/root (readlink: Permission denied) 2024-09-10T23:29:27.698 INFO:tasks.workunit.client.0.smithi003.stdout:ksoftirqd 29 root txt unknown /proc/29/exe (readlink: Permission denied) 2024-09-10T23:29:27.698 INFO:tasks.workunit.client.0.smithi003.stdout:ksoftirqd 29 root NOFD /proc/29/fd (opendir: Permission denied) 2024-09-10T23:29:27.698 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/2 31 root cwd unknown /proc/31/cwd (readlink: Permission denied) 2024-09-10T23:29:27.698 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/2 31 root rtd unknown /proc/31/root (readlink: Permission denied) 2024-09-10T23:29:27.698 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/2 31 root txt unknown /proc/31/exe (readlink: Permission denied) 2024-09-10T23:29:27.698 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/2 31 root NOFD /proc/31/fd (opendir: Permission denied) 2024-09-10T23:29:27.698 INFO:tasks.workunit.client.0.smithi003.stdout:cpuhp/3 32 root cwd unknown /proc/32/cwd (readlink: Permission denied) 2024-09-10T23:29:27.698 INFO:tasks.workunit.client.0.smithi003.stdout:cpuhp/3 32 root rtd unknown /proc/32/root (readlink: Permission denied) 2024-09-10T23:29:27.698 INFO:tasks.workunit.client.0.smithi003.stdout:cpuhp/3 32 root txt unknown /proc/32/exe (readlink: Permission denied) 2024-09-10T23:29:27.699 INFO:tasks.workunit.client.0.smithi003.stdout:cpuhp/3 32 root NOFD /proc/32/fd (opendir: Permission denied) 2024-09-10T23:29:27.699 INFO:tasks.workunit.client.0.smithi003.stdout:migration 33 root cwd unknown /proc/33/cwd (readlink: Permission denied) 2024-09-10T23:29:27.699 INFO:tasks.workunit.client.0.smithi003.stdout:migration 33 root rtd unknown /proc/33/root (readlink: Permission denied) 2024-09-10T23:29:27.699 INFO:tasks.workunit.client.0.smithi003.stdout:migration 33 root txt unknown /proc/33/exe (readlink: Permission denied) 2024-09-10T23:29:27.699 INFO:tasks.workunit.client.0.smithi003.stdout:migration 33 root NOFD /proc/33/fd (opendir: Permission denied) 2024-09-10T23:29:27.699 INFO:tasks.workunit.client.0.smithi003.stdout:ksoftirqd 34 root cwd unknown /proc/34/cwd (readlink: Permission denied) 2024-09-10T23:29:27.699 INFO:tasks.workunit.client.0.smithi003.stdout:ksoftirqd 34 root rtd unknown /proc/34/root (readlink: Permission denied) 2024-09-10T23:29:27.699 INFO:tasks.workunit.client.0.smithi003.stdout:ksoftirqd 34 root txt unknown /proc/34/exe (readlink: Permission denied) 2024-09-10T23:29:27.699 INFO:tasks.workunit.client.0.smithi003.stdout:ksoftirqd 34 root NOFD /proc/34/fd (opendir: Permission denied) 2024-09-10T23:29:27.699 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/3 35 root cwd unknown /proc/35/cwd (readlink: Permission denied) 2024-09-10T23:29:27.699 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/3 35 root rtd unknown /proc/35/root (readlink: Permission denied) 2024-09-10T23:29:27.699 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/3 35 root txt unknown /proc/35/exe (readlink: Permission denied) 2024-09-10T23:29:27.699 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/3 35 root NOFD /proc/35/fd (opendir: Permission denied) 2024-09-10T23:29:27.700 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/3 36 root cwd unknown /proc/36/cwd (readlink: Permission denied) 2024-09-10T23:29:27.700 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/3 36 root rtd unknown /proc/36/root (readlink: Permission denied) 2024-09-10T23:29:27.700 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/3 36 root txt unknown /proc/36/exe (readlink: Permission denied) 2024-09-10T23:29:27.700 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/3 36 root NOFD /proc/36/fd (opendir: Permission denied) 2024-09-10T23:29:27.700 INFO:tasks.workunit.client.0.smithi003.stdout:cpuhp/4 37 root cwd unknown /proc/37/cwd (readlink: Permission denied) 2024-09-10T23:29:27.700 INFO:tasks.workunit.client.0.smithi003.stdout:cpuhp/4 37 root rtd unknown /proc/37/root (readlink: Permission denied) 2024-09-10T23:29:27.700 INFO:tasks.workunit.client.0.smithi003.stdout:cpuhp/4 37 root txt unknown /proc/37/exe (readlink: Permission denied) 2024-09-10T23:29:27.700 INFO:tasks.workunit.client.0.smithi003.stdout:cpuhp/4 37 root NOFD /proc/37/fd (opendir: Permission denied) 2024-09-10T23:29:27.700 INFO:tasks.workunit.client.0.smithi003.stdout:migration 38 root cwd unknown /proc/38/cwd (readlink: Permission denied) 2024-09-10T23:29:27.700 INFO:tasks.workunit.client.0.smithi003.stdout:migration 38 root rtd unknown /proc/38/root (readlink: Permission denied) 2024-09-10T23:29:27.700 INFO:tasks.workunit.client.0.smithi003.stdout:migration 38 root txt unknown /proc/38/exe (readlink: Permission denied) 2024-09-10T23:29:27.701 INFO:tasks.workunit.client.0.smithi003.stdout:migration 38 root NOFD /proc/38/fd (opendir: Permission denied) 2024-09-10T23:29:27.701 INFO:tasks.workunit.client.0.smithi003.stdout:ksoftirqd 39 root cwd unknown /proc/39/cwd (readlink: Permission denied) 2024-09-10T23:29:27.701 INFO:tasks.workunit.client.0.smithi003.stdout:ksoftirqd 39 root rtd unknown /proc/39/root (readlink: Permission denied) 2024-09-10T23:29:27.701 INFO:tasks.workunit.client.0.smithi003.stdout:ksoftirqd 39 root txt unknown /proc/39/exe (readlink: Permission denied) 2024-09-10T23:29:27.701 INFO:tasks.workunit.client.0.smithi003.stdout:ksoftirqd 39 root NOFD /proc/39/fd (opendir: Permission denied) 2024-09-10T23:29:27.701 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/4 41 root cwd unknown /proc/41/cwd (readlink: Permission denied) 2024-09-10T23:29:27.701 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/4 41 root rtd unknown /proc/41/root (readlink: Permission denied) 2024-09-10T23:29:27.701 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/4 41 root txt unknown /proc/41/exe (readlink: Permission denied) 2024-09-10T23:29:27.701 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/4 41 root NOFD /proc/41/fd (opendir: Permission denied) 2024-09-10T23:29:27.701 INFO:tasks.workunit.client.0.smithi003.stdout:cpuhp/5 42 root cwd unknown /proc/42/cwd (readlink: Permission denied) 2024-09-10T23:29:27.701 INFO:tasks.workunit.client.0.smithi003.stdout:cpuhp/5 42 root rtd unknown /proc/42/root (readlink: Permission denied) 2024-09-10T23:29:27.701 INFO:tasks.workunit.client.0.smithi003.stdout:cpuhp/5 42 root txt unknown /proc/42/exe (readlink: Permission denied) 2024-09-10T23:29:27.701 INFO:tasks.workunit.client.0.smithi003.stdout:cpuhp/5 42 root NOFD /proc/42/fd (opendir: Permission denied) 2024-09-10T23:29:27.702 INFO:tasks.workunit.client.0.smithi003.stdout:migration 43 root cwd unknown /proc/43/cwd (readlink: Permission denied) 2024-09-10T23:29:27.702 INFO:tasks.workunit.client.0.smithi003.stdout:migration 43 root rtd unknown /proc/43/root (readlink: Permission denied) 2024-09-10T23:29:27.702 INFO:tasks.workunit.client.0.smithi003.stdout:migration 43 root txt unknown /proc/43/exe (readlink: Permission denied) 2024-09-10T23:29:27.702 INFO:tasks.workunit.client.0.smithi003.stdout:migration 43 root NOFD /proc/43/fd (opendir: Permission denied) 2024-09-10T23:29:27.702 INFO:tasks.workunit.client.0.smithi003.stdout:ksoftirqd 44 root cwd unknown /proc/44/cwd (readlink: Permission denied) 2024-09-10T23:29:27.702 INFO:tasks.workunit.client.0.smithi003.stdout:ksoftirqd 44 root rtd unknown /proc/44/root (readlink: Permission denied) 2024-09-10T23:29:27.702 INFO:tasks.workunit.client.0.smithi003.stdout:ksoftirqd 44 root txt unknown /proc/44/exe (readlink: Permission denied) 2024-09-10T23:29:27.702 INFO:tasks.workunit.client.0.smithi003.stdout:ksoftirqd 44 root NOFD /proc/44/fd (opendir: Permission denied) 2024-09-10T23:29:27.702 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/5 46 root cwd unknown /proc/46/cwd (readlink: Permission denied) 2024-09-10T23:29:27.702 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/5 46 root rtd unknown /proc/46/root (readlink: Permission denied) 2024-09-10T23:29:27.702 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/5 46 root txt unknown /proc/46/exe (readlink: Permission denied) 2024-09-10T23:29:27.702 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/5 46 root NOFD /proc/46/fd (opendir: Permission denied) 2024-09-10T23:29:27.703 INFO:tasks.workunit.client.0.smithi003.stdout:cpuhp/6 47 root cwd unknown /proc/47/cwd (readlink: Permission denied) 2024-09-10T23:29:27.703 INFO:tasks.workunit.client.0.smithi003.stdout:cpuhp/6 47 root rtd unknown /proc/47/root (readlink: Permission denied) 2024-09-10T23:29:27.703 INFO:tasks.workunit.client.0.smithi003.stdout:cpuhp/6 47 root txt unknown /proc/47/exe (readlink: Permission denied) 2024-09-10T23:29:27.703 INFO:tasks.workunit.client.0.smithi003.stdout:cpuhp/6 47 root NOFD /proc/47/fd (opendir: Permission denied) 2024-09-10T23:29:27.703 INFO:tasks.workunit.client.0.smithi003.stdout:migration 48 root cwd unknown /proc/48/cwd (readlink: Permission denied) 2024-09-10T23:29:27.703 INFO:tasks.workunit.client.0.smithi003.stdout:migration 48 root rtd unknown /proc/48/root (readlink: Permission denied) 2024-09-10T23:29:27.703 INFO:tasks.workunit.client.0.smithi003.stdout:migration 48 root txt unknown /proc/48/exe (readlink: Permission denied) 2024-09-10T23:29:27.703 INFO:tasks.workunit.client.0.smithi003.stdout:migration 48 root NOFD /proc/48/fd (opendir: Permission denied) 2024-09-10T23:29:27.704 INFO:tasks.workunit.client.0.smithi003.stdout:ksoftirqd 49 root cwd unknown /proc/49/cwd (readlink: Permission denied) 2024-09-10T23:29:27.704 INFO:tasks.workunit.client.0.smithi003.stdout:ksoftirqd 49 root rtd unknown /proc/49/root (readlink: Permission denied) 2024-09-10T23:29:27.704 INFO:tasks.workunit.client.0.smithi003.stdout:ksoftirqd 49 root txt unknown /proc/49/exe (readlink: Permission denied) 2024-09-10T23:29:27.704 INFO:tasks.workunit.client.0.smithi003.stdout:ksoftirqd 49 root NOFD /proc/49/fd (opendir: Permission denied) 2024-09-10T23:29:27.704 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/6 51 root cwd unknown /proc/51/cwd (readlink: Permission denied) 2024-09-10T23:29:27.704 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/6 51 root rtd unknown /proc/51/root (readlink: Permission denied) 2024-09-10T23:29:27.704 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/6 51 root txt unknown /proc/51/exe (readlink: Permission denied) 2024-09-10T23:29:27.704 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/6 51 root NOFD /proc/51/fd (opendir: Permission denied) 2024-09-10T23:29:27.705 INFO:tasks.workunit.client.0.smithi003.stdout:cpuhp/7 52 root cwd unknown /proc/52/cwd (readlink: Permission denied) 2024-09-10T23:29:27.705 INFO:tasks.workunit.client.0.smithi003.stdout:cpuhp/7 52 root rtd unknown /proc/52/root (readlink: Permission denied) 2024-09-10T23:29:27.705 INFO:tasks.workunit.client.0.smithi003.stdout:cpuhp/7 52 root txt unknown /proc/52/exe (readlink: Permission denied) 2024-09-10T23:29:27.705 INFO:tasks.workunit.client.0.smithi003.stdout:cpuhp/7 52 root NOFD /proc/52/fd (opendir: Permission denied) 2024-09-10T23:29:27.705 INFO:tasks.workunit.client.0.smithi003.stdout:migration 53 root cwd unknown /proc/53/cwd (readlink: Permission denied) 2024-09-10T23:29:27.705 INFO:tasks.workunit.client.0.smithi003.stdout:migration 53 root rtd unknown /proc/53/root (readlink: Permission denied) 2024-09-10T23:29:27.705 INFO:tasks.workunit.client.0.smithi003.stdout:migration 53 root txt unknown /proc/53/exe (readlink: Permission denied) 2024-09-10T23:29:27.705 INFO:tasks.workunit.client.0.smithi003.stdout:migration 53 root NOFD /proc/53/fd (opendir: Permission denied) 2024-09-10T23:29:27.705 INFO:tasks.workunit.client.0.smithi003.stdout:ksoftirqd 54 root cwd unknown /proc/54/cwd (readlink: Permission denied) 2024-09-10T23:29:27.705 INFO:tasks.workunit.client.0.smithi003.stdout:ksoftirqd 54 root rtd unknown /proc/54/root (readlink: Permission denied) 2024-09-10T23:29:27.705 INFO:tasks.workunit.client.0.smithi003.stdout:ksoftirqd 54 root txt unknown /proc/54/exe (readlink: Permission denied) 2024-09-10T23:29:27.705 INFO:tasks.workunit.client.0.smithi003.stdout:ksoftirqd 54 root NOFD /proc/54/fd (opendir: Permission denied) 2024-09-10T23:29:27.705 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/7 56 root cwd unknown /proc/56/cwd (readlink: Permission denied) 2024-09-10T23:29:27.706 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/7 56 root rtd unknown /proc/56/root (readlink: Permission denied) 2024-09-10T23:29:27.706 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/7 56 root txt unknown /proc/56/exe (readlink: Permission denied) 2024-09-10T23:29:27.706 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/7 56 root NOFD /proc/56/fd (opendir: Permission denied) 2024-09-10T23:29:27.706 INFO:tasks.workunit.client.0.smithi003.stdout:kdevtmpfs 57 root cwd unknown /proc/57/cwd (readlink: Permission denied) 2024-09-10T23:29:27.706 INFO:tasks.workunit.client.0.smithi003.stdout:kdevtmpfs 57 root rtd unknown /proc/57/root (readlink: Permission denied) 2024-09-10T23:29:27.706 INFO:tasks.workunit.client.0.smithi003.stdout:kdevtmpfs 57 root txt unknown /proc/57/exe (readlink: Permission denied) 2024-09-10T23:29:27.706 INFO:tasks.workunit.client.0.smithi003.stdout:kdevtmpfs 57 root NOFD /proc/57/fd (opendir: Permission denied) 2024-09-10T23:29:27.706 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 58 root cwd unknown /proc/58/cwd (readlink: Permission denied) 2024-09-10T23:29:27.706 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 58 root rtd unknown /proc/58/root (readlink: Permission denied) 2024-09-10T23:29:27.706 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 58 root txt unknown /proc/58/exe (readlink: Permission denied) 2024-09-10T23:29:27.706 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 58 root NOFD /proc/58/fd (opendir: Permission denied) 2024-09-10T23:29:27.706 INFO:tasks.workunit.client.0.smithi003.stdout:kauditd 59 root cwd unknown /proc/59/cwd (readlink: Permission denied) 2024-09-10T23:29:27.707 INFO:tasks.workunit.client.0.smithi003.stdout:kauditd 59 root rtd unknown /proc/59/root (readlink: Permission denied) 2024-09-10T23:29:27.707 INFO:tasks.workunit.client.0.smithi003.stdout:kauditd 59 root txt unknown /proc/59/exe (readlink: Permission denied) 2024-09-10T23:29:27.707 INFO:tasks.workunit.client.0.smithi003.stdout:kauditd 59 root NOFD /proc/59/fd (opendir: Permission denied) 2024-09-10T23:29:27.707 INFO:tasks.workunit.client.0.smithi003.stdout:khungtask 60 root cwd unknown /proc/60/cwd (readlink: Permission denied) 2024-09-10T23:29:27.707 INFO:tasks.workunit.client.0.smithi003.stdout:khungtask 60 root rtd unknown /proc/60/root (readlink: Permission denied) 2024-09-10T23:29:27.707 INFO:tasks.workunit.client.0.smithi003.stdout:khungtask 60 root txt unknown /proc/60/exe (readlink: Permission denied) 2024-09-10T23:29:27.707 INFO:tasks.workunit.client.0.smithi003.stdout:khungtask 60 root NOFD /proc/60/fd (opendir: Permission denied) 2024-09-10T23:29:27.707 INFO:tasks.workunit.client.0.smithi003.stdout:oom_reape 62 root cwd unknown /proc/62/cwd (readlink: Permission denied) 2024-09-10T23:29:27.707 INFO:tasks.workunit.client.0.smithi003.stdout:oom_reape 62 root rtd unknown /proc/62/root (readlink: Permission denied) 2024-09-10T23:29:27.707 INFO:tasks.workunit.client.0.smithi003.stdout:oom_reape 62 root txt unknown /proc/62/exe (readlink: Permission denied) 2024-09-10T23:29:27.707 INFO:tasks.workunit.client.0.smithi003.stdout:oom_reape 62 root NOFD /proc/62/fd (opendir: Permission denied) 2024-09-10T23:29:27.707 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 64 root cwd unknown /proc/64/cwd (readlink: Permission denied) 2024-09-10T23:29:27.707 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 64 root rtd unknown /proc/64/root (readlink: Permission denied) 2024-09-10T23:29:27.708 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 64 root txt unknown /proc/64/exe (readlink: Permission denied) 2024-09-10T23:29:27.708 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 64 root NOFD /proc/64/fd (opendir: Permission denied) 2024-09-10T23:29:27.708 INFO:tasks.workunit.client.0.smithi003.stdout:kcompactd 65 root cwd unknown /proc/65/cwd (readlink: Permission denied) 2024-09-10T23:29:27.708 INFO:tasks.workunit.client.0.smithi003.stdout:kcompactd 65 root rtd unknown /proc/65/root (readlink: Permission denied) 2024-09-10T23:29:27.708 INFO:tasks.workunit.client.0.smithi003.stdout:kcompactd 65 root txt unknown /proc/65/exe (readlink: Permission denied) 2024-09-10T23:29:27.708 INFO:tasks.workunit.client.0.smithi003.stdout:kcompactd 65 root NOFD /proc/65/fd (opendir: Permission denied) 2024-09-10T23:29:27.708 INFO:tasks.workunit.client.0.smithi003.stdout:ksmd 66 root cwd unknown /proc/66/cwd (readlink: Permission denied) 2024-09-10T23:29:27.708 INFO:tasks.workunit.client.0.smithi003.stdout:ksmd 66 root rtd unknown /proc/66/root (readlink: Permission denied) 2024-09-10T23:29:27.708 INFO:tasks.workunit.client.0.smithi003.stdout:ksmd 66 root txt unknown /proc/66/exe (readlink: Permission denied) 2024-09-10T23:29:27.708 INFO:tasks.workunit.client.0.smithi003.stdout:ksmd 66 root NOFD /proc/66/fd (opendir: Permission denied) 2024-09-10T23:29:27.708 INFO:tasks.workunit.client.0.smithi003.stdout:khugepage 67 root cwd unknown /proc/67/cwd (readlink: Permission denied) 2024-09-10T23:29:27.708 INFO:tasks.workunit.client.0.smithi003.stdout:khugepage 67 root rtd unknown /proc/67/root (readlink: Permission denied) 2024-09-10T23:29:27.709 INFO:tasks.workunit.client.0.smithi003.stdout:khugepage 67 root txt unknown /proc/67/exe (readlink: Permission denied) 2024-09-10T23:29:27.709 INFO:tasks.workunit.client.0.smithi003.stdout:khugepage 67 root NOFD /proc/67/fd (opendir: Permission denied) 2024-09-10T23:29:27.709 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 68 root cwd unknown /proc/68/cwd (readlink: Permission denied) 2024-09-10T23:29:27.709 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 68 root rtd unknown /proc/68/root (readlink: Permission denied) 2024-09-10T23:29:27.709 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 68 root txt unknown /proc/68/exe (readlink: Permission denied) 2024-09-10T23:29:27.709 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 68 root NOFD /proc/68/fd (opendir: Permission denied) 2024-09-10T23:29:27.709 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 69 root cwd unknown /proc/69/cwd (readlink: Permission denied) 2024-09-10T23:29:27.709 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 69 root rtd unknown /proc/69/root (readlink: Permission denied) 2024-09-10T23:29:27.709 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 69 root txt unknown /proc/69/exe (readlink: Permission denied) 2024-09-10T23:29:27.710 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 69 root NOFD /proc/69/fd (opendir: Permission denied) 2024-09-10T23:29:27.710 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 70 root cwd unknown /proc/70/cwd (readlink: Permission denied) 2024-09-10T23:29:27.710 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 70 root rtd unknown /proc/70/root (readlink: Permission denied) 2024-09-10T23:29:27.710 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 70 root txt unknown /proc/70/exe (readlink: Permission denied) 2024-09-10T23:29:27.710 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 70 root NOFD /proc/70/fd (opendir: Permission denied) 2024-09-10T23:29:27.710 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 71 root cwd unknown /proc/71/cwd (readlink: Permission denied) 2024-09-10T23:29:27.710 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 71 root rtd unknown /proc/71/root (readlink: Permission denied) 2024-09-10T23:29:27.710 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 71 root txt unknown /proc/71/exe (readlink: Permission denied) 2024-09-10T23:29:27.710 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 71 root NOFD /proc/71/fd (opendir: Permission denied) 2024-09-10T23:29:27.710 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/7 78 root cwd unknown /proc/78/cwd (readlink: Permission denied) 2024-09-10T23:29:27.711 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/7 78 root rtd unknown /proc/78/root (readlink: Permission denied) 2024-09-10T23:29:27.711 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/7 78 root txt unknown /proc/78/exe (readlink: Permission denied) 2024-09-10T23:29:27.711 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/7 78 root NOFD /proc/78/fd (opendir: Permission denied) 2024-09-10T23:29:27.711 INFO:tasks.workunit.client.0.smithi003.stdout:irq/9-acp 79 root cwd unknown /proc/79/cwd (readlink: Permission denied) 2024-09-10T23:29:27.711 INFO:tasks.workunit.client.0.smithi003.stdout:irq/9-acp 79 root rtd unknown /proc/79/root (readlink: Permission denied) 2024-09-10T23:29:27.711 INFO:tasks.workunit.client.0.smithi003.stdout:irq/9-acp 79 root txt unknown /proc/79/exe (readlink: Permission denied) 2024-09-10T23:29:27.711 INFO:tasks.workunit.client.0.smithi003.stdout:irq/9-acp 79 root NOFD /proc/79/fd (opendir: Permission denied) 2024-09-10T23:29:27.711 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 80 root cwd unknown /proc/80/cwd (readlink: Permission denied) 2024-09-10T23:29:27.711 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 80 root rtd unknown /proc/80/root (readlink: Permission denied) 2024-09-10T23:29:27.711 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 80 root txt unknown /proc/80/exe (readlink: Permission denied) 2024-09-10T23:29:27.711 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 80 root NOFD /proc/80/fd (opendir: Permission denied) 2024-09-10T23:29:27.711 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 81 root cwd unknown /proc/81/cwd (readlink: Permission denied) 2024-09-10T23:29:27.711 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 81 root rtd unknown /proc/81/root (readlink: Permission denied) 2024-09-10T23:29:27.711 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 81 root txt unknown /proc/81/exe (readlink: Permission denied) 2024-09-10T23:29:27.711 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 81 root NOFD /proc/81/fd (opendir: Permission denied) 2024-09-10T23:29:27.712 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 82 root cwd unknown /proc/82/cwd (readlink: Permission denied) 2024-09-10T23:29:27.712 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 82 root rtd unknown /proc/82/root (readlink: Permission denied) 2024-09-10T23:29:27.712 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 82 root txt unknown /proc/82/exe (readlink: Permission denied) 2024-09-10T23:29:27.712 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 82 root NOFD /proc/82/fd (opendir: Permission denied) 2024-09-10T23:29:27.712 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 83 root cwd unknown /proc/83/cwd (readlink: Permission denied) 2024-09-10T23:29:27.712 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 83 root rtd unknown /proc/83/root (readlink: Permission denied) 2024-09-10T23:29:27.712 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 83 root txt unknown /proc/83/exe (readlink: Permission denied) 2024-09-10T23:29:27.712 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 83 root NOFD /proc/83/fd (opendir: Permission denied) 2024-09-10T23:29:27.712 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 84 root cwd unknown /proc/84/cwd (readlink: Permission denied) 2024-09-10T23:29:27.712 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 84 root rtd unknown /proc/84/root (readlink: Permission denied) 2024-09-10T23:29:27.712 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 84 root txt unknown /proc/84/exe (readlink: Permission denied) 2024-09-10T23:29:27.712 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 84 root NOFD /proc/84/fd (opendir: Permission denied) 2024-09-10T23:29:27.713 INFO:tasks.workunit.client.0.smithi003.stdout:watchdogd 85 root cwd unknown /proc/85/cwd (readlink: Permission denied) 2024-09-10T23:29:27.713 INFO:tasks.workunit.client.0.smithi003.stdout:watchdogd 85 root rtd unknown /proc/85/root (readlink: Permission denied) 2024-09-10T23:29:27.713 INFO:tasks.workunit.client.0.smithi003.stdout:watchdogd 85 root txt unknown /proc/85/exe (readlink: Permission denied) 2024-09-10T23:29:27.713 INFO:tasks.workunit.client.0.smithi003.stdout:watchdogd 85 root NOFD /proc/85/fd (opendir: Permission denied) 2024-09-10T23:29:27.713 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/0 86 root cwd unknown /proc/86/cwd (readlink: Permission denied) 2024-09-10T23:29:27.713 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/0 86 root rtd unknown /proc/86/root (readlink: Permission denied) 2024-09-10T23:29:27.713 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/0 86 root txt unknown /proc/86/exe (readlink: Permission denied) 2024-09-10T23:29:27.713 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/0 86 root NOFD /proc/86/fd (opendir: Permission denied) 2024-09-10T23:29:27.713 INFO:tasks.workunit.client.0.smithi003.stdout:kswapd0 87 root cwd unknown /proc/87/cwd (readlink: Permission denied) 2024-09-10T23:29:27.713 INFO:tasks.workunit.client.0.smithi003.stdout:kswapd0 87 root rtd unknown /proc/87/root (readlink: Permission denied) 2024-09-10T23:29:27.713 INFO:tasks.workunit.client.0.smithi003.stdout:kswapd0 87 root txt unknown /proc/87/exe (readlink: Permission denied) 2024-09-10T23:29:27.713 INFO:tasks.workunit.client.0.smithi003.stdout:kswapd0 87 root NOFD /proc/87/fd (opendir: Permission denied) 2024-09-10T23:29:27.714 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 89 root cwd unknown /proc/89/cwd (readlink: Permission denied) 2024-09-10T23:29:27.714 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 89 root rtd unknown /proc/89/root (readlink: Permission denied) 2024-09-10T23:29:27.714 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 89 root txt unknown /proc/89/exe (readlink: Permission denied) 2024-09-10T23:29:27.714 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 89 root NOFD /proc/89/fd (opendir: Permission denied) 2024-09-10T23:29:27.714 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 92 root cwd unknown /proc/92/cwd (readlink: Permission denied) 2024-09-10T23:29:27.714 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 92 root rtd unknown /proc/92/root (readlink: Permission denied) 2024-09-10T23:29:27.714 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 92 root txt unknown /proc/92/exe (readlink: Permission denied) 2024-09-10T23:29:27.714 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 92 root NOFD /proc/92/fd (opendir: Permission denied) 2024-09-10T23:29:27.714 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_0 94 root cwd unknown /proc/94/cwd (readlink: Permission denied) 2024-09-10T23:29:27.714 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_0 94 root rtd unknown /proc/94/root (readlink: Permission denied) 2024-09-10T23:29:27.715 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_0 94 root txt unknown /proc/94/exe (readlink: Permission denied) 2024-09-10T23:29:27.715 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_0 94 root NOFD /proc/94/fd (opendir: Permission denied) 2024-09-10T23:29:27.715 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 95 root cwd unknown /proc/95/cwd (readlink: Permission denied) 2024-09-10T23:29:27.715 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 95 root rtd unknown /proc/95/root (readlink: Permission denied) 2024-09-10T23:29:27.715 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 95 root txt unknown /proc/95/exe (readlink: Permission denied) 2024-09-10T23:29:27.715 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 95 root NOFD /proc/95/fd (opendir: Permission denied) 2024-09-10T23:29:27.715 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_1 96 root cwd unknown /proc/96/cwd (readlink: Permission denied) 2024-09-10T23:29:27.715 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_1 96 root rtd unknown /proc/96/root (readlink: Permission denied) 2024-09-10T23:29:27.715 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_1 96 root txt unknown /proc/96/exe (readlink: Permission denied) 2024-09-10T23:29:27.715 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_1 96 root NOFD /proc/96/fd (opendir: Permission denied) 2024-09-10T23:29:27.715 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 97 root cwd unknown /proc/97/cwd (readlink: Permission denied) 2024-09-10T23:29:27.715 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 97 root rtd unknown /proc/97/root (readlink: Permission denied) 2024-09-10T23:29:27.716 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 97 root txt unknown /proc/97/exe (readlink: Permission denied) 2024-09-10T23:29:27.716 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 97 root NOFD /proc/97/fd (opendir: Permission denied) 2024-09-10T23:29:27.716 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_2 98 root cwd unknown /proc/98/cwd (readlink: Permission denied) 2024-09-10T23:29:27.716 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_2 98 root rtd unknown /proc/98/root (readlink: Permission denied) 2024-09-10T23:29:27.716 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_2 98 root txt unknown /proc/98/exe (readlink: Permission denied) 2024-09-10T23:29:27.716 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_2 98 root NOFD /proc/98/fd (opendir: Permission denied) 2024-09-10T23:29:27.716 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 99 root cwd unknown /proc/99/cwd (readlink: Permission denied) 2024-09-10T23:29:27.716 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 99 root rtd unknown /proc/99/root (readlink: Permission denied) 2024-09-10T23:29:27.716 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 99 root txt unknown /proc/99/exe (readlink: Permission denied) 2024-09-10T23:29:27.716 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 99 root NOFD /proc/99/fd (opendir: Permission denied) 2024-09-10T23:29:27.716 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_3 100 root cwd unknown /proc/100/cwd (readlink: Permission denied) 2024-09-10T23:29:27.717 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_3 100 root rtd unknown /proc/100/root (readlink: Permission denied) 2024-09-10T23:29:27.717 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_3 100 root txt unknown /proc/100/exe (readlink: Permission denied) 2024-09-10T23:29:27.717 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_3 100 root NOFD /proc/100/fd (opendir: Permission denied) 2024-09-10T23:29:27.717 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 101 root cwd unknown /proc/101/cwd (readlink: Permission denied) 2024-09-10T23:29:27.717 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 101 root rtd unknown /proc/101/root (readlink: Permission denied) 2024-09-10T23:29:27.717 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 101 root txt unknown /proc/101/exe (readlink: Permission denied) 2024-09-10T23:29:27.717 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 101 root NOFD /proc/101/fd (opendir: Permission denied) 2024-09-10T23:29:27.717 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 103 root cwd unknown /proc/103/cwd (readlink: Permission denied) 2024-09-10T23:29:27.717 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 103 root rtd unknown /proc/103/root (readlink: Permission denied) 2024-09-10T23:29:27.717 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 103 root txt unknown /proc/103/exe (readlink: Permission denied) 2024-09-10T23:29:27.717 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 103 root NOFD /proc/103/fd (opendir: Permission denied) 2024-09-10T23:29:27.718 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_4 105 root cwd unknown /proc/105/cwd (readlink: Permission denied) 2024-09-10T23:29:27.718 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_4 105 root rtd unknown /proc/105/root (readlink: Permission denied) 2024-09-10T23:29:27.718 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_4 105 root txt unknown /proc/105/exe (readlink: Permission denied) 2024-09-10T23:29:27.718 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_4 105 root NOFD /proc/105/fd (opendir: Permission denied) 2024-09-10T23:29:27.718 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 106 root cwd unknown /proc/106/cwd (readlink: Permission denied) 2024-09-10T23:29:27.718 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 106 root rtd unknown /proc/106/root (readlink: Permission denied) 2024-09-10T23:29:27.718 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 106 root txt unknown /proc/106/exe (readlink: Permission denied) 2024-09-10T23:29:27.718 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 106 root NOFD /proc/106/fd (opendir: Permission denied) 2024-09-10T23:29:27.718 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_5 107 root cwd unknown /proc/107/cwd (readlink: Permission denied) 2024-09-10T23:29:27.718 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_5 107 root rtd unknown /proc/107/root (readlink: Permission denied) 2024-09-10T23:29:27.718 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_5 107 root txt unknown /proc/107/exe (readlink: Permission denied) 2024-09-10T23:29:27.718 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_5 107 root NOFD /proc/107/fd (opendir: Permission denied) 2024-09-10T23:29:27.718 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 108 root cwd unknown /proc/108/cwd (readlink: Permission denied) 2024-09-10T23:29:27.719 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 108 root rtd unknown /proc/108/root (readlink: Permission denied) 2024-09-10T23:29:27.719 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 108 root txt unknown /proc/108/exe (readlink: Permission denied) 2024-09-10T23:29:27.719 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 108 root NOFD /proc/108/fd (opendir: Permission denied) 2024-09-10T23:29:27.719 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_6 109 root cwd unknown /proc/109/cwd (readlink: Permission denied) 2024-09-10T23:29:27.719 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_6 109 root rtd unknown /proc/109/root (readlink: Permission denied) 2024-09-10T23:29:27.719 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_6 109 root txt unknown /proc/109/exe (readlink: Permission denied) 2024-09-10T23:29:27.719 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_6 109 root NOFD /proc/109/fd (opendir: Permission denied) 2024-09-10T23:29:27.719 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 110 root cwd unknown /proc/110/cwd (readlink: Permission denied) 2024-09-10T23:29:27.719 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 110 root rtd unknown /proc/110/root (readlink: Permission denied) 2024-09-10T23:29:27.719 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 110 root txt unknown /proc/110/exe (readlink: Permission denied) 2024-09-10T23:29:27.719 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 110 root NOFD /proc/110/fd (opendir: Permission denied) 2024-09-10T23:29:27.720 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_7 111 root cwd unknown /proc/111/cwd (readlink: Permission denied) 2024-09-10T23:29:27.720 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_7 111 root rtd unknown /proc/111/root (readlink: Permission denied) 2024-09-10T23:29:27.720 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_7 111 root txt unknown /proc/111/exe (readlink: Permission denied) 2024-09-10T23:29:27.720 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_7 111 root NOFD /proc/111/fd (opendir: Permission denied) 2024-09-10T23:29:27.720 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 112 root cwd unknown /proc/112/cwd (readlink: Permission denied) 2024-09-10T23:29:27.720 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 112 root rtd unknown /proc/112/root (readlink: Permission denied) 2024-09-10T23:29:27.720 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 112 root txt unknown /proc/112/exe (readlink: Permission denied) 2024-09-10T23:29:27.720 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 112 root NOFD /proc/112/fd (opendir: Permission denied) 2024-09-10T23:29:27.720 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_8 113 root cwd unknown /proc/113/cwd (readlink: Permission denied) 2024-09-10T23:29:27.720 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_8 113 root rtd unknown /proc/113/root (readlink: Permission denied) 2024-09-10T23:29:27.720 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_8 113 root txt unknown /proc/113/exe (readlink: Permission denied) 2024-09-10T23:29:27.720 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_8 113 root NOFD /proc/113/fd (opendir: Permission denied) 2024-09-10T23:29:27.720 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 114 root cwd unknown /proc/114/cwd (readlink: Permission denied) 2024-09-10T23:29:27.721 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 114 root rtd unknown /proc/114/root (readlink: Permission denied) 2024-09-10T23:29:27.721 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 114 root txt unknown /proc/114/exe (readlink: Permission denied) 2024-09-10T23:29:27.721 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 114 root NOFD /proc/114/fd (opendir: Permission denied) 2024-09-10T23:29:27.721 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_9 115 root cwd unknown /proc/115/cwd (readlink: Permission denied) 2024-09-10T23:29:27.721 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_9 115 root rtd unknown /proc/115/root (readlink: Permission denied) 2024-09-10T23:29:27.721 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_9 115 root txt unknown /proc/115/exe (readlink: Permission denied) 2024-09-10T23:29:27.721 INFO:tasks.workunit.client.0.smithi003.stdout:scsi_eh_9 115 root NOFD /proc/115/fd (opendir: Permission denied) 2024-09-10T23:29:27.721 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 116 root cwd unknown /proc/116/cwd (readlink: Permission denied) 2024-09-10T23:29:27.721 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 116 root rtd unknown /proc/116/root (readlink: Permission denied) 2024-09-10T23:29:27.721 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 116 root txt unknown /proc/116/exe (readlink: Permission denied) 2024-09-10T23:29:27.721 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 116 root NOFD /proc/116/fd (opendir: Permission denied) 2024-09-10T23:29:27.722 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 119 root cwd unknown /proc/119/cwd (readlink: Permission denied) 2024-09-10T23:29:27.722 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 119 root rtd unknown /proc/119/root (readlink: Permission denied) 2024-09-10T23:29:27.722 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 119 root txt unknown /proc/119/exe (readlink: Permission denied) 2024-09-10T23:29:27.722 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 119 root NOFD /proc/119/fd (opendir: Permission denied) 2024-09-10T23:29:27.722 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 123 root cwd unknown /proc/123/cwd (readlink: Permission denied) 2024-09-10T23:29:27.722 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 123 root rtd unknown /proc/123/root (readlink: Permission denied) 2024-09-10T23:29:27.722 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 123 root txt unknown /proc/123/exe (readlink: Permission denied) 2024-09-10T23:29:27.722 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 123 root NOFD /proc/123/fd (opendir: Permission denied) 2024-09-10T23:29:27.723 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/1 126 root cwd unknown /proc/126/cwd (readlink: Permission denied) 2024-09-10T23:29:27.723 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/1 126 root rtd unknown /proc/126/root (readlink: Permission denied) 2024-09-10T23:29:27.723 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/1 126 root txt unknown /proc/126/exe (readlink: Permission denied) 2024-09-10T23:29:27.723 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/1 126 root NOFD /proc/126/fd (opendir: Permission denied) 2024-09-10T23:29:27.723 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 128 root cwd unknown /proc/128/cwd (readlink: Permission denied) 2024-09-10T23:29:27.723 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 128 root rtd unknown /proc/128/root (readlink: Permission denied) 2024-09-10T23:29:27.723 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 128 root txt unknown /proc/128/exe (readlink: Permission denied) 2024-09-10T23:29:27.723 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 128 root NOFD /proc/128/fd (opendir: Permission denied) 2024-09-10T23:29:27.724 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 129 root cwd unknown /proc/129/cwd (readlink: Permission denied) 2024-09-10T23:29:27.724 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 129 root rtd unknown /proc/129/root (readlink: Permission denied) 2024-09-10T23:29:27.724 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 129 root txt unknown /proc/129/exe (readlink: Permission denied) 2024-09-10T23:29:27.724 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 129 root NOFD /proc/129/fd (opendir: Permission denied) 2024-09-10T23:29:27.724 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/6 131 root cwd unknown /proc/131/cwd (readlink: Permission denied) 2024-09-10T23:29:27.724 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/6 131 root rtd unknown /proc/131/root (readlink: Permission denied) 2024-09-10T23:29:27.724 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/6 131 root txt unknown /proc/131/exe (readlink: Permission denied) 2024-09-10T23:29:27.724 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/6 131 root NOFD /proc/131/fd (opendir: Permission denied) 2024-09-10T23:29:27.725 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 132 root cwd unknown /proc/132/cwd (readlink: Permission denied) 2024-09-10T23:29:27.725 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 132 root rtd unknown /proc/132/root (readlink: Permission denied) 2024-09-10T23:29:27.725 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 132 root txt unknown /proc/132/exe (readlink: Permission denied) 2024-09-10T23:29:27.725 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 132 root NOFD /proc/132/fd (opendir: Permission denied) 2024-09-10T23:29:27.725 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 139 root cwd unknown /proc/139/cwd (readlink: Permission denied) 2024-09-10T23:29:27.725 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 139 root rtd unknown /proc/139/root (readlink: Permission denied) 2024-09-10T23:29:27.725 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 139 root txt unknown /proc/139/exe (readlink: Permission denied) 2024-09-10T23:29:27.725 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 139 root NOFD /proc/139/fd (opendir: Permission denied) 2024-09-10T23:29:27.725 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/2 259 root cwd unknown /proc/259/cwd (readlink: Permission denied) 2024-09-10T23:29:27.726 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/2 259 root rtd unknown /proc/259/root (readlink: Permission denied) 2024-09-10T23:29:27.726 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/2 259 root txt unknown /proc/259/exe (readlink: Permission denied) 2024-09-10T23:29:27.726 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/2 259 root NOFD /proc/259/fd (opendir: Permission denied) 2024-09-10T23:29:27.726 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/3 261 root cwd unknown /proc/261/cwd (readlink: Permission denied) 2024-09-10T23:29:27.726 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/3 261 root rtd unknown /proc/261/root (readlink: Permission denied) 2024-09-10T23:29:27.726 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/3 261 root txt unknown /proc/261/exe (readlink: Permission denied) 2024-09-10T23:29:27.726 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/3 261 root NOFD /proc/261/fd (opendir: Permission denied) 2024-09-10T23:29:27.726 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/1 264 root cwd unknown /proc/264/cwd (readlink: Permission denied) 2024-09-10T23:29:27.727 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/1 264 root rtd unknown /proc/264/root (readlink: Permission denied) 2024-09-10T23:29:27.727 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/1 264 root txt unknown /proc/264/exe (readlink: Permission denied) 2024-09-10T23:29:27.727 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/1 264 root NOFD /proc/264/fd (opendir: Permission denied) 2024-09-10T23:29:27.727 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/4 270 root cwd unknown /proc/270/cwd (readlink: Permission denied) 2024-09-10T23:29:27.727 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/4 270 root rtd unknown /proc/270/root (readlink: Permission denied) 2024-09-10T23:29:27.727 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/4 270 root txt unknown /proc/270/exe (readlink: Permission denied) 2024-09-10T23:29:27.727 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/4 270 root NOFD /proc/270/fd (opendir: Permission denied) 2024-09-10T23:29:27.727 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/2 275 root cwd unknown /proc/275/cwd (readlink: Permission denied) 2024-09-10T23:29:27.728 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/2 275 root rtd unknown /proc/275/root (readlink: Permission denied) 2024-09-10T23:29:27.728 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/2 275 root txt unknown /proc/275/exe (readlink: Permission denied) 2024-09-10T23:29:27.728 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/2 275 root NOFD /proc/275/fd (opendir: Permission denied) 2024-09-10T23:29:27.728 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/5 294 root cwd unknown /proc/294/cwd (readlink: Permission denied) 2024-09-10T23:29:27.728 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/5 294 root rtd unknown /proc/294/root (readlink: Permission denied) 2024-09-10T23:29:27.728 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/5 294 root txt unknown /proc/294/exe (readlink: Permission denied) 2024-09-10T23:29:27.728 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/5 294 root NOFD /proc/294/fd (opendir: Permission denied) 2024-09-10T23:29:27.728 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/7 297 root cwd unknown /proc/297/cwd (readlink: Permission denied) 2024-09-10T23:29:27.728 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/7 297 root rtd unknown /proc/297/root (readlink: Permission denied) 2024-09-10T23:29:27.729 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/7 297 root txt unknown /proc/297/exe (readlink: Permission denied) 2024-09-10T23:29:27.729 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/7 297 root NOFD /proc/297/fd (opendir: Permission denied) 2024-09-10T23:29:27.729 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 419 root cwd unknown /proc/419/cwd (readlink: Permission denied) 2024-09-10T23:29:27.729 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 419 root rtd unknown /proc/419/root (readlink: Permission denied) 2024-09-10T23:29:27.729 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 419 root txt unknown /proc/419/exe (readlink: Permission denied) 2024-09-10T23:29:27.729 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 419 root NOFD /proc/419/fd (opendir: Permission denied) 2024-09-10T23:29:27.729 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 421 root cwd unknown /proc/421/cwd (readlink: Permission denied) 2024-09-10T23:29:27.730 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 421 root rtd unknown /proc/421/root (readlink: Permission denied) 2024-09-10T23:29:27.730 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 421 root txt unknown /proc/421/exe (readlink: Permission denied) 2024-09-10T23:29:27.730 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 421 root NOFD /proc/421/fd (opendir: Permission denied) 2024-09-10T23:29:27.730 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 422 root cwd unknown /proc/422/cwd (readlink: Permission denied) 2024-09-10T23:29:27.730 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 422 root rtd unknown /proc/422/root (readlink: Permission denied) 2024-09-10T23:29:27.730 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 422 root txt unknown /proc/422/exe (readlink: Permission denied) 2024-09-10T23:29:27.730 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 422 root NOFD /proc/422/fd (opendir: Permission denied) 2024-09-10T23:29:27.730 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 447 root cwd unknown /proc/447/cwd (readlink: Permission denied) 2024-09-10T23:29:27.730 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 447 root rtd unknown /proc/447/root (readlink: Permission denied) 2024-09-10T23:29:27.731 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 447 root txt unknown /proc/447/exe (readlink: Permission denied) 2024-09-10T23:29:27.731 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 447 root NOFD /proc/447/fd (opendir: Permission denied) 2024-09-10T23:29:27.731 INFO:tasks.workunit.client.0.smithi003.stdout:jbd2/sda1 461 root cwd unknown /proc/461/cwd (readlink: Permission denied) 2024-09-10T23:29:27.731 INFO:tasks.workunit.client.0.smithi003.stdout:jbd2/sda1 461 root rtd unknown /proc/461/root (readlink: Permission denied) 2024-09-10T23:29:27.731 INFO:tasks.workunit.client.0.smithi003.stdout:jbd2/sda1 461 root txt unknown /proc/461/exe (readlink: Permission denied) 2024-09-10T23:29:27.731 INFO:tasks.workunit.client.0.smithi003.stdout:jbd2/sda1 461 root NOFD /proc/461/fd (opendir: Permission denied) 2024-09-10T23:29:27.731 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 462 root cwd unknown /proc/462/cwd (readlink: Permission denied) 2024-09-10T23:29:27.731 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 462 root rtd unknown /proc/462/root (readlink: Permission denied) 2024-09-10T23:29:27.731 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 462 root txt unknown /proc/462/exe (readlink: Permission denied) 2024-09-10T23:29:27.732 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 462 root NOFD /proc/462/fd (opendir: Permission denied) 2024-09-10T23:29:27.732 INFO:tasks.workunit.client.0.smithi003.stdout:systemd-j 538 root cwd unknown /proc/538/cwd (readlink: Permission denied) 2024-09-10T23:29:27.732 INFO:tasks.workunit.client.0.smithi003.stdout:systemd-j 538 root rtd unknown /proc/538/root (readlink: Permission denied) 2024-09-10T23:29:27.732 INFO:tasks.workunit.client.0.smithi003.stdout:systemd-j 538 root txt unknown /proc/538/exe (readlink: Permission denied) 2024-09-10T23:29:27.732 INFO:tasks.workunit.client.0.smithi003.stdout:systemd-j 538 root NOFD /proc/538/fd (opendir: Permission denied) 2024-09-10T23:29:27.732 INFO:tasks.workunit.client.0.smithi003.stdout:ext4lazyi 548 root cwd unknown /proc/548/cwd (readlink: Permission denied) 2024-09-10T23:29:27.732 INFO:tasks.workunit.client.0.smithi003.stdout:ext4lazyi 548 root rtd unknown /proc/548/root (readlink: Permission denied) 2024-09-10T23:29:27.732 INFO:tasks.workunit.client.0.smithi003.stdout:ext4lazyi 548 root txt unknown /proc/548/exe (readlink: Permission denied) 2024-09-10T23:29:27.733 INFO:tasks.workunit.client.0.smithi003.stdout:ext4lazyi 548 root NOFD /proc/548/fd (opendir: Permission denied) 2024-09-10T23:29:27.733 INFO:tasks.workunit.client.0.smithi003.stdout:systemd-u 553 root cwd unknown /proc/553/cwd (readlink: Permission denied) 2024-09-10T23:29:27.733 INFO:tasks.workunit.client.0.smithi003.stdout:systemd-u 553 root rtd unknown /proc/553/root (readlink: Permission denied) 2024-09-10T23:29:27.733 INFO:tasks.workunit.client.0.smithi003.stdout:systemd-u 553 root txt unknown /proc/553/exe (readlink: Permission denied) 2024-09-10T23:29:27.733 INFO:tasks.workunit.client.0.smithi003.stdout:systemd-u 553 root NOFD /proc/553/fd (opendir: Permission denied) 2024-09-10T23:29:27.733 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/3 554 root cwd unknown /proc/554/cwd (readlink: Permission denied) 2024-09-10T23:29:27.733 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/3 554 root rtd unknown /proc/554/root (readlink: Permission denied) 2024-09-10T23:29:27.733 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/3 554 root txt unknown /proc/554/exe (readlink: Permission denied) 2024-09-10T23:29:27.734 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/3 554 root NOFD /proc/554/fd (opendir: Permission denied) 2024-09-10T23:29:27.734 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 598 root cwd unknown /proc/598/cwd (readlink: Permission denied) 2024-09-10T23:29:27.734 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 598 root rtd unknown /proc/598/root (readlink: Permission denied) 2024-09-10T23:29:27.734 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 598 root txt unknown /proc/598/exe (readlink: Permission denied) 2024-09-10T23:29:27.734 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 598 root NOFD /proc/598/fd (opendir: Permission denied) 2024-09-10T23:29:27.734 INFO:tasks.workunit.client.0.smithi003.stdout:kipmi0 618 root cwd unknown /proc/618/cwd (readlink: Permission denied) 2024-09-10T23:29:27.734 INFO:tasks.workunit.client.0.smithi003.stdout:kipmi0 618 root rtd unknown /proc/618/root (readlink: Permission denied) 2024-09-10T23:29:27.734 INFO:tasks.workunit.client.0.smithi003.stdout:kipmi0 618 root txt unknown /proc/618/exe (readlink: Permission denied) 2024-09-10T23:29:27.735 INFO:tasks.workunit.client.0.smithi003.stdout:kipmi0 618 root NOFD /proc/618/fd (opendir: Permission denied) 2024-09-10T23:29:27.735 INFO:tasks.workunit.client.0.smithi003.stdout:rpcbind 619 rpc cwd unknown /proc/619/cwd (readlink: Permission denied) 2024-09-10T23:29:27.735 INFO:tasks.workunit.client.0.smithi003.stdout:rpcbind 619 rpc rtd unknown /proc/619/root (readlink: Permission denied) 2024-09-10T23:29:27.735 INFO:tasks.workunit.client.0.smithi003.stdout:rpcbind 619 rpc txt unknown /proc/619/exe (readlink: Permission denied) 2024-09-10T23:29:27.735 INFO:tasks.workunit.client.0.smithi003.stdout:rpcbind 619 rpc NOFD /proc/619/fd (opendir: Permission denied) 2024-09-10T23:29:27.735 INFO:tasks.workunit.client.0.smithi003.stdout:auditd 622 root cwd unknown /proc/622/cwd (readlink: Permission denied) 2024-09-10T23:29:27.735 INFO:tasks.workunit.client.0.smithi003.stdout:auditd 622 root rtd unknown /proc/622/root (readlink: Permission denied) 2024-09-10T23:29:27.735 INFO:tasks.workunit.client.0.smithi003.stdout:auditd 622 root txt unknown /proc/622/exe (readlink: Permission denied) 2024-09-10T23:29:27.735 INFO:tasks.workunit.client.0.smithi003.stdout:auditd 622 root NOFD /proc/622/fd (opendir: Permission denied) 2024-09-10T23:29:27.735 INFO:tasks.workunit.client.0.smithi003.stdout:auditd 622 623 auditd root cwd unknown /proc/622/task/623/cwd (readlink: Permission denied) 2024-09-10T23:29:27.736 INFO:tasks.workunit.client.0.smithi003.stdout:auditd 622 623 auditd root rtd unknown /proc/622/task/623/root (readlink: Permission denied) 2024-09-10T23:29:27.736 INFO:tasks.workunit.client.0.smithi003.stdout:auditd 622 623 auditd root txt unknown /proc/622/task/623/exe (readlink: Permission denied) 2024-09-10T23:29:27.736 INFO:tasks.workunit.client.0.smithi003.stdout:auditd 622 623 auditd root NOFD /proc/622/task/623/fd (opendir: Permission denied) 2024-09-10T23:29:27.736 INFO:tasks.workunit.client.0.smithi003.stdout:auditd 622 629 auditd root cwd unknown /proc/622/task/629/cwd (readlink: Permission denied) 2024-09-10T23:29:27.736 INFO:tasks.workunit.client.0.smithi003.stdout:auditd 622 629 auditd root rtd unknown /proc/622/task/629/root (readlink: Permission denied) 2024-09-10T23:29:27.736 INFO:tasks.workunit.client.0.smithi003.stdout:auditd 622 629 auditd root txt unknown /proc/622/task/629/exe (readlink: Permission denied) 2024-09-10T23:29:27.736 INFO:tasks.workunit.client.0.smithi003.stdout:auditd 622 629 auditd root NOFD /proc/622/task/629/fd (opendir: Permission denied) 2024-09-10T23:29:27.736 INFO:tasks.workunit.client.0.smithi003.stdout:sedispatc 628 root cwd unknown /proc/628/cwd (readlink: Permission denied) 2024-09-10T23:29:27.736 INFO:tasks.workunit.client.0.smithi003.stdout:sedispatc 628 root rtd unknown /proc/628/root (readlink: Permission denied) 2024-09-10T23:29:27.736 INFO:tasks.workunit.client.0.smithi003.stdout:sedispatc 628 root txt unknown /proc/628/exe (readlink: Permission denied) 2024-09-10T23:29:27.736 INFO:tasks.workunit.client.0.smithi003.stdout:sedispatc 628 root NOFD /proc/628/fd (opendir: Permission denied) 2024-09-10T23:29:27.737 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 641 root cwd unknown /proc/641/cwd (readlink: Permission denied) 2024-09-10T23:29:27.737 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 641 root rtd unknown /proc/641/root (readlink: Permission denied) 2024-09-10T23:29:27.737 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 641 root txt unknown /proc/641/exe (readlink: Permission denied) 2024-09-10T23:29:27.737 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 641 root NOFD /proc/641/fd (opendir: Permission denied) 2024-09-10T23:29:27.737 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 642 root cwd unknown /proc/642/cwd (readlink: Permission denied) 2024-09-10T23:29:27.737 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 642 root rtd unknown /proc/642/root (readlink: Permission denied) 2024-09-10T23:29:27.737 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 642 root txt unknown /proc/642/exe (readlink: Permission denied) 2024-09-10T23:29:27.737 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 642 root NOFD /proc/642/fd (opendir: Permission denied) 2024-09-10T23:29:27.737 INFO:tasks.workunit.client.0.smithi003.stdout:dbus-brok 674 dbus cwd unknown /proc/674/cwd (readlink: Permission denied) 2024-09-10T23:29:27.737 INFO:tasks.workunit.client.0.smithi003.stdout:dbus-brok 674 dbus rtd unknown /proc/674/root (readlink: Permission denied) 2024-09-10T23:29:27.737 INFO:tasks.workunit.client.0.smithi003.stdout:dbus-brok 674 dbus txt unknown /proc/674/exe (readlink: Permission denied) 2024-09-10T23:29:27.737 INFO:tasks.workunit.client.0.smithi003.stdout:dbus-brok 674 dbus NOFD /proc/674/fd (opendir: Permission denied) 2024-09-10T23:29:27.738 INFO:tasks.workunit.client.0.smithi003.stdout:dbus-brok 675 dbus cwd unknown /proc/675/cwd (readlink: Permission denied) 2024-09-10T23:29:27.738 INFO:tasks.workunit.client.0.smithi003.stdout:dbus-brok 675 dbus rtd unknown /proc/675/root (readlink: Permission denied) 2024-09-10T23:29:27.738 INFO:tasks.workunit.client.0.smithi003.stdout:dbus-brok 675 dbus txt unknown /proc/675/exe (readlink: Permission denied) 2024-09-10T23:29:27.738 INFO:tasks.workunit.client.0.smithi003.stdout:dbus-brok 675 dbus NOFD /proc/675/fd (opendir: Permission denied) 2024-09-10T23:29:27.738 INFO:tasks.workunit.client.0.smithi003.stdout:NetworkMa 676 root cwd unknown /proc/676/cwd (readlink: Permission denied) 2024-09-10T23:29:27.738 INFO:tasks.workunit.client.0.smithi003.stdout:NetworkMa 676 root rtd unknown /proc/676/root (readlink: Permission denied) 2024-09-10T23:29:27.738 INFO:tasks.workunit.client.0.smithi003.stdout:NetworkMa 676 root txt unknown /proc/676/exe (readlink: Permission denied) 2024-09-10T23:29:27.738 INFO:tasks.workunit.client.0.smithi003.stdout:NetworkMa 676 root NOFD /proc/676/fd (opendir: Permission denied) 2024-09-10T23:29:27.738 INFO:tasks.workunit.client.0.smithi003.stdout:NetworkMa 676 692 gmain root cwd unknown /proc/676/task/692/cwd (readlink: Permission denied) 2024-09-10T23:29:27.738 INFO:tasks.workunit.client.0.smithi003.stdout:NetworkMa 676 692 gmain root rtd unknown /proc/676/task/692/root (readlink: Permission denied) 2024-09-10T23:29:27.738 INFO:tasks.workunit.client.0.smithi003.stdout:NetworkMa 676 692 gmain root txt unknown /proc/676/task/692/exe (readlink: Permission denied) 2024-09-10T23:29:27.738 INFO:tasks.workunit.client.0.smithi003.stdout:NetworkMa 676 692 gmain root NOFD /proc/676/task/692/fd (opendir: Permission denied) 2024-09-10T23:29:27.738 INFO:tasks.workunit.client.0.smithi003.stdout:NetworkMa 676 693 gdbus root cwd unknown /proc/676/task/693/cwd (readlink: Permission denied) 2024-09-10T23:29:27.738 INFO:tasks.workunit.client.0.smithi003.stdout:NetworkMa 676 693 gdbus root rtd unknown /proc/676/task/693/root (readlink: Permission denied) 2024-09-10T23:29:27.739 INFO:tasks.workunit.client.0.smithi003.stdout:NetworkMa 676 693 gdbus root txt unknown /proc/676/task/693/exe (readlink: Permission denied) 2024-09-10T23:29:27.739 INFO:tasks.workunit.client.0.smithi003.stdout:NetworkMa 676 693 gdbus root NOFD /proc/676/task/693/fd (opendir: Permission denied) 2024-09-10T23:29:27.739 INFO:tasks.workunit.client.0.smithi003.stdout:irqbalanc 679 root cwd unknown /proc/679/cwd (readlink: Permission denied) 2024-09-10T23:29:27.739 INFO:tasks.workunit.client.0.smithi003.stdout:irqbalanc 679 root rtd unknown /proc/679/root (readlink: Permission denied) 2024-09-10T23:29:27.739 INFO:tasks.workunit.client.0.smithi003.stdout:irqbalanc 679 root txt unknown /proc/679/exe (readlink: Permission denied) 2024-09-10T23:29:27.739 INFO:tasks.workunit.client.0.smithi003.stdout:irqbalanc 679 root NOFD /proc/679/fd (opendir: Permission denied) 2024-09-10T23:29:27.739 INFO:tasks.workunit.client.0.smithi003.stdout:irqbalanc 679 685 gmain root cwd unknown /proc/679/task/685/cwd (readlink: Permission denied) 2024-09-10T23:29:27.739 INFO:tasks.workunit.client.0.smithi003.stdout:irqbalanc 679 685 gmain root rtd unknown /proc/679/task/685/root (readlink: Permission denied) 2024-09-10T23:29:27.739 INFO:tasks.workunit.client.0.smithi003.stdout:irqbalanc 679 685 gmain root txt unknown /proc/679/task/685/exe (readlink: Permission denied) 2024-09-10T23:29:27.739 INFO:tasks.workunit.client.0.smithi003.stdout:irqbalanc 679 685 gmain root NOFD /proc/679/task/685/fd (opendir: Permission denied) 2024-09-10T23:29:27.739 INFO:tasks.workunit.client.0.smithi003.stdout:lsmd 680 libstoragemgmt cwd unknown /proc/680/cwd (readlink: Permission denied) 2024-09-10T23:29:27.739 INFO:tasks.workunit.client.0.smithi003.stdout:lsmd 680 libstoragemgmt rtd unknown /proc/680/root (readlink: Permission denied) 2024-09-10T23:29:27.739 INFO:tasks.workunit.client.0.smithi003.stdout:lsmd 680 libstoragemgmt txt unknown /proc/680/exe (readlink: Permission denied) 2024-09-10T23:29:27.739 INFO:tasks.workunit.client.0.smithi003.stdout:lsmd 680 libstoragemgmt NOFD /proc/680/fd (opendir: Permission denied) 2024-09-10T23:29:27.740 INFO:tasks.workunit.client.0.smithi003.stdout:smartd 682 root cwd unknown /proc/682/cwd (readlink: Permission denied) 2024-09-10T23:29:27.740 INFO:tasks.workunit.client.0.smithi003.stdout:smartd 682 root rtd unknown /proc/682/root (readlink: Permission denied) 2024-09-10T23:29:27.740 INFO:tasks.workunit.client.0.smithi003.stdout:smartd 682 root txt unknown /proc/682/exe (readlink: Permission denied) 2024-09-10T23:29:27.740 INFO:tasks.workunit.client.0.smithi003.stdout:smartd 682 root NOFD /proc/682/fd (opendir: Permission denied) 2024-09-10T23:29:27.740 INFO:tasks.workunit.client.0.smithi003.stdout:systemd-l 684 root cwd unknown /proc/684/cwd (readlink: Permission denied) 2024-09-10T23:29:27.740 INFO:tasks.workunit.client.0.smithi003.stdout:systemd-l 684 root rtd unknown /proc/684/root (readlink: Permission denied) 2024-09-10T23:29:27.740 INFO:tasks.workunit.client.0.smithi003.stdout:systemd-l 684 root txt unknown /proc/684/exe (readlink: Permission denied) 2024-09-10T23:29:27.740 INFO:tasks.workunit.client.0.smithi003.stdout:systemd-l 684 root NOFD /proc/684/fd (opendir: Permission denied) 2024-09-10T23:29:27.740 INFO:tasks.workunit.client.0.smithi003.stdout:sshd 730 root cwd unknown /proc/730/cwd (readlink: Permission denied) 2024-09-10T23:29:27.740 INFO:tasks.workunit.client.0.smithi003.stdout:sshd 730 root rtd unknown /proc/730/root (readlink: Permission denied) 2024-09-10T23:29:27.740 INFO:tasks.workunit.client.0.smithi003.stdout:sshd 730 root txt unknown /proc/730/exe (readlink: Permission denied) 2024-09-10T23:29:27.740 INFO:tasks.workunit.client.0.smithi003.stdout:sshd 730 root NOFD /proc/730/fd (opendir: Permission denied) 2024-09-10T23:29:27.741 INFO:tasks.workunit.client.0.smithi003.stdout:gssproxy 734 root cwd unknown /proc/734/cwd (readlink: Permission denied) 2024-09-10T23:29:27.741 INFO:tasks.workunit.client.0.smithi003.stdout:gssproxy 734 root rtd unknown /proc/734/root (readlink: Permission denied) 2024-09-10T23:29:27.741 INFO:tasks.workunit.client.0.smithi003.stdout:gssproxy 734 root txt unknown /proc/734/exe (readlink: Permission denied) 2024-09-10T23:29:27.741 INFO:tasks.workunit.client.0.smithi003.stdout:gssproxy 734 root NOFD /proc/734/fd (opendir: Permission denied) 2024-09-10T23:29:27.741 INFO:tasks.workunit.client.0.smithi003.stdout:gssproxy 734 735 gssproxy root cwd unknown /proc/734/task/735/cwd (readlink: Permission denied) 2024-09-10T23:29:27.741 INFO:tasks.workunit.client.0.smithi003.stdout:gssproxy 734 735 gssproxy root rtd unknown /proc/734/task/735/root (readlink: Permission denied) 2024-09-10T23:29:27.741 INFO:tasks.workunit.client.0.smithi003.stdout:gssproxy 734 735 gssproxy root txt unknown /proc/734/task/735/exe (readlink: Permission denied) 2024-09-10T23:29:27.741 INFO:tasks.workunit.client.0.smithi003.stdout:gssproxy 734 735 gssproxy root NOFD /proc/734/task/735/fd (opendir: Permission denied) 2024-09-10T23:29:27.741 INFO:tasks.workunit.client.0.smithi003.stdout:gssproxy 734 736 gssproxy root cwd unknown /proc/734/task/736/cwd (readlink: Permission denied) 2024-09-10T23:29:27.741 INFO:tasks.workunit.client.0.smithi003.stdout:gssproxy 734 736 gssproxy root rtd unknown /proc/734/task/736/root (readlink: Permission denied) 2024-09-10T23:29:27.741 INFO:tasks.workunit.client.0.smithi003.stdout:gssproxy 734 736 gssproxy root txt unknown /proc/734/task/736/exe (readlink: Permission denied) 2024-09-10T23:29:27.741 INFO:tasks.workunit.client.0.smithi003.stdout:gssproxy 734 736 gssproxy root NOFD /proc/734/task/736/fd (opendir: Permission denied) 2024-09-10T23:29:27.741 INFO:tasks.workunit.client.0.smithi003.stdout:gssproxy 734 737 gssproxy root cwd unknown /proc/734/task/737/cwd (readlink: Permission denied) 2024-09-10T23:29:27.741 INFO:tasks.workunit.client.0.smithi003.stdout:gssproxy 734 737 gssproxy root rtd unknown /proc/734/task/737/root (readlink: Permission denied) 2024-09-10T23:29:27.742 INFO:tasks.workunit.client.0.smithi003.stdout:gssproxy 734 737 gssproxy root txt unknown /proc/734/task/737/exe (readlink: Permission denied) 2024-09-10T23:29:27.742 INFO:tasks.workunit.client.0.smithi003.stdout:gssproxy 734 737 gssproxy root NOFD /proc/734/task/737/fd (opendir: Permission denied) 2024-09-10T23:29:27.742 INFO:tasks.workunit.client.0.smithi003.stdout:gssproxy 734 738 gssproxy root cwd unknown /proc/734/task/738/cwd (readlink: Permission denied) 2024-09-10T23:29:27.742 INFO:tasks.workunit.client.0.smithi003.stdout:gssproxy 734 738 gssproxy root rtd unknown /proc/734/task/738/root (readlink: Permission denied) 2024-09-10T23:29:27.742 INFO:tasks.workunit.client.0.smithi003.stdout:gssproxy 734 738 gssproxy root txt unknown /proc/734/task/738/exe (readlink: Permission denied) 2024-09-10T23:29:27.742 INFO:tasks.workunit.client.0.smithi003.stdout:gssproxy 734 738 gssproxy root NOFD /proc/734/task/738/fd (opendir: Permission denied) 2024-09-10T23:29:27.742 INFO:tasks.workunit.client.0.smithi003.stdout:gssproxy 734 739 gssproxy root cwd unknown /proc/734/task/739/cwd (readlink: Permission denied) 2024-09-10T23:29:27.742 INFO:tasks.workunit.client.0.smithi003.stdout:gssproxy 734 739 gssproxy root rtd unknown /proc/734/task/739/root (readlink: Permission denied) 2024-09-10T23:29:27.742 INFO:tasks.workunit.client.0.smithi003.stdout:gssproxy 734 739 gssproxy root txt unknown /proc/734/task/739/exe (readlink: Permission denied) 2024-09-10T23:29:27.742 INFO:tasks.workunit.client.0.smithi003.stdout:gssproxy 734 739 gssproxy root NOFD /proc/734/task/739/fd (opendir: Permission denied) 2024-09-10T23:29:27.742 INFO:tasks.workunit.client.0.smithi003.stdout:atd 741 root cwd unknown /proc/741/cwd (readlink: Permission denied) 2024-09-10T23:29:27.742 INFO:tasks.workunit.client.0.smithi003.stdout:atd 741 root rtd unknown /proc/741/root (readlink: Permission denied) 2024-09-10T23:29:27.742 INFO:tasks.workunit.client.0.smithi003.stdout:atd 741 root txt unknown /proc/741/exe (readlink: Permission denied) 2024-09-10T23:29:27.742 INFO:tasks.workunit.client.0.smithi003.stdout:atd 741 root NOFD /proc/741/fd (opendir: Permission denied) 2024-09-10T23:29:27.742 INFO:tasks.workunit.client.0.smithi003.stdout:crond 742 root cwd unknown /proc/742/cwd (readlink: Permission denied) 2024-09-10T23:29:27.743 INFO:tasks.workunit.client.0.smithi003.stdout:crond 742 root rtd unknown /proc/742/root (readlink: Permission denied) 2024-09-10T23:29:27.743 INFO:tasks.workunit.client.0.smithi003.stdout:crond 742 root txt unknown /proc/742/exe (readlink: Permission denied) 2024-09-10T23:29:27.743 INFO:tasks.workunit.client.0.smithi003.stdout:crond 742 root NOFD /proc/742/fd (opendir: Permission denied) 2024-09-10T23:29:27.743 INFO:tasks.workunit.client.0.smithi003.stdout:nrpe 761 nrpe cwd unknown /proc/761/cwd (readlink: Permission denied) 2024-09-10T23:29:27.743 INFO:tasks.workunit.client.0.smithi003.stdout:nrpe 761 nrpe rtd unknown /proc/761/root (readlink: Permission denied) 2024-09-10T23:29:27.743 INFO:tasks.workunit.client.0.smithi003.stdout:nrpe 761 nrpe txt unknown /proc/761/exe (readlink: Permission denied) 2024-09-10T23:29:27.743 INFO:tasks.workunit.client.0.smithi003.stdout:nrpe 761 nrpe NOFD /proc/761/fd (opendir: Permission denied) 2024-09-10T23:29:27.743 INFO:tasks.workunit.client.0.smithi003.stdout:agetty 1094 root cwd unknown /proc/1094/cwd (readlink: Permission denied) 2024-09-10T23:29:27.743 INFO:tasks.workunit.client.0.smithi003.stdout:agetty 1094 root rtd unknown /proc/1094/root (readlink: Permission denied) 2024-09-10T23:29:27.743 INFO:tasks.workunit.client.0.smithi003.stdout:agetty 1094 root txt unknown /proc/1094/exe (readlink: Permission denied) 2024-09-10T23:29:27.743 INFO:tasks.workunit.client.0.smithi003.stdout:agetty 1094 root NOFD /proc/1094/fd (opendir: Permission denied) 2024-09-10T23:29:27.743 INFO:tasks.workunit.client.0.smithi003.stdout:agetty 1095 root cwd unknown /proc/1095/cwd (readlink: Permission denied) 2024-09-10T23:29:27.743 INFO:tasks.workunit.client.0.smithi003.stdout:agetty 1095 root rtd unknown /proc/1095/root (readlink: Permission denied) 2024-09-10T23:29:27.744 INFO:tasks.workunit.client.0.smithi003.stdout:agetty 1095 root txt unknown /proc/1095/exe (readlink: Permission denied) 2024-09-10T23:29:27.744 INFO:tasks.workunit.client.0.smithi003.stdout:agetty 1095 root NOFD /proc/1095/fd (opendir: Permission denied) 2024-09-10T23:29:27.744 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu cwd DIR 8,1 4096 2 / 2024-09-10T23:29:27.744 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu rtd DIR 8,1 4096 2 / 2024-09-10T23:29:27.744 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu txt REG 8,1 98208 22394 /usr/lib/systemd/systemd 2024-09-10T23:29:27.744 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu DEL REG 8,1 2229 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-09-10T23:29:27.744 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-09-10T23:29:27.744 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu mem REG 8,1 912440 11215 /usr/lib64/libm.so.6 2024-09-10T23:29:27.744 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu mem REG 8,1 1714208 11376 /usr/lib64/libp11-kit.so.0.3.1 2024-09-10T23:29:27.744 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu DEL REG 8,1 11595 /usr/lib64/libcrypto.so.3.2.2 2024-09-10T23:29:27.744 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu mem REG 8,1 882376 11287 /usr/lib64/libzstd.so.1.5.1 2024-09-10T23:29:27.744 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-10T23:29:27.744 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu DEL REG 8,1 2232 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-09-10T23:29:27.745 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu mem REG 8,1 44784 11373 /usr/lib64/libffi.so.8.1.0 2024-09-10T23:29:27.745 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu mem REG 8,1 153600 11397 /usr/lib64/libgpg-error.so.0.32.0 2024-09-10T23:29:27.745 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu mem REG 8,1 28552 11392 /usr/lib64/libattr.so.1.1.2501 2024-09-10T23:29:27.745 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-09-10T23:29:27.745 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu mem REG 8,1 32528 11311 /usr/lib64/libcap-ng.so.0.0.0 2024-09-10T23:29:27.745 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu mem REG 8,1 40520 12544 /usr/lib64/libeconf.so.0.4.1 2024-09-10T23:29:27.745 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu mem REG 8,1 1304864 11471 /usr/lib64/libgcrypt.so.20.4.0 2024-09-10T23:29:27.745 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu mem REG 8,1 3826840 50305 /usr/lib64/systemd/libsystemd-shared-252.so 2024-09-10T23:29:27.745 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu mem REG 8,1 178728 11282 /usr/lib64/liblzma.so.5.2.5 2024-09-10T23:29:27.746 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu mem REG 8,1 201808 11284 /usr/lib64/libcrypt.so.2.0.0 2024-09-10T23:29:27.746 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu mem REG 8,1 2162040 50302 /usr/lib64/systemd/libsystemd-core-252.so 2024-09-10T23:29:27.746 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu mem REG 8,1 144120 11455 /usr/lib64/liblz4.so.1.9.3 2024-09-10T23:29:27.746 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu mem REG 8,1 36296 11290 /usr/lib64/libcap.so.2.48 2024-09-10T23:29:27.746 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu mem REG 8,1 229424 11714 /usr/lib64/libblkid.so.1.1.0 2024-09-10T23:29:27.746 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu mem REG 8,1 40496 11393 /usr/lib64/libacl.so.1.1.2301 2024-09-10T23:29:27.746 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu mem REG 8,1 291496 11744 /usr/lib64/libmount.so.1.1.0 2024-09-10T23:29:27.746 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-09-10T23:29:27.746 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu mem REG 8,1 107528 11768 /usr/lib64/libkmod.so.2.3.6 2024-09-10T23:29:27.746 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu mem REG 8,1 163464 11315 /usr/lib64/libaudit.so.1.0.0 2024-09-10T23:29:27.746 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu mem REG 8,1 69592 12553 /usr/lib64/libpam.so.0.85.1 2024-09-10T23:29:27.746 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu mem REG 8,1 127680 11560 /usr/lib64/libseccomp.so.2.5.2 2024-09-10T23:29:27.746 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu mem REG 8,1 108136 14698 /usr/lib64/libgcc_s-11-20240719.so.1 2024-09-10T23:29:27.746 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu mem REG 0,20 0 19 /sys/fs/selinux/status 2024-09-10T23:29:27.747 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-10T23:29:27.747 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2024-09-10T23:29:27.747 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu 1u unix 0x0000000000000000 0t0 4817 type=STREAM (CONNECTED) 2024-09-10T23:29:27.747 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu 2u unix 0x0000000000000000 0t0 4817 type=STREAM (CONNECTED) 2024-09-10T23:29:27.747 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu 3u unix 0x0000000000000000 0t0 4845 type=DGRAM (CONNECTED) 2024-09-10T23:29:27.747 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu 4u a_inode 0,15 0 50 [eventpoll:5,6,8,9,11,12,14,15,16,17,19,20,21] 2024-09-10T23:29:27.747 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu 5u a_inode 0,15 0 50 [signalfd] 2024-09-10T23:29:27.747 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu 6r a_inode 0,15 0 50 inotify 2024-09-10T23:29:27.747 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu 7r DIR 0,26 0 3674 /sys/fs/cgroup/user.slice/user-1000.slice/user@1000.service 2024-09-10T23:29:27.747 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu 8u a_inode 0,15 0 50 [timerfd] 2024-09-10T23:29:27.747 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu 9u a_inode 0,15 0 50 [eventpoll:10,13] 2024-09-10T23:29:27.747 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu 10r REG 0,21 0 4834 /proc/4240/mountinfo 2024-09-10T23:29:27.747 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu 11r a_inode 0,15 0 50 inotify 2024-09-10T23:29:27.747 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu 12u unix 0x0000000000000000 0t0 4867 /run/user/1000/bus type=STREAM (LISTEN) 2024-09-10T23:29:27.748 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu 13r a_inode 0,15 0 50 inotify 2024-09-10T23:29:27.748 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu 14r REG 0,21 0 4026532070 /proc/swaps 2024-09-10T23:29:27.748 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu 15u netlink 0t0 4849 KOBJECT_UEVENT 2024-09-10T23:29:27.748 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu 16u unix 0x0000000000000000 0t0 4854 /run/user/1000/systemd/notify type=DGRAM (UNCONNECTED) 2024-09-10T23:29:27.748 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu 17u unix 0x0000000000000000 0t0 4855 type=DGRAM (CONNECTED) 2024-09-10T23:29:27.748 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu 18u unix 0x0000000000000000 0t0 4856 type=DGRAM (CONNECTED) 2024-09-10T23:29:27.748 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu 19u unix 0x0000000000000000 0t0 4857 /run/user/1000/systemd/private type=STREAM (LISTEN) 2024-09-10T23:29:27.748 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu 20u unix 0x0000000000000000 0t0 4859 type=STREAM (CONNECTED) 2024-09-10T23:29:27.748 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 4240 ubuntu 21u a_inode 0,15 0 50 [timerfd] 2024-09-10T23:29:27.748 INFO:tasks.workunit.client.0.smithi003.stdout:(sd-pam) 4243 ubuntu cwd unknown /proc/4243/cwd (readlink: Permission denied) 2024-09-10T23:29:27.748 INFO:tasks.workunit.client.0.smithi003.stdout:(sd-pam) 4243 ubuntu rtd unknown /proc/4243/root (readlink: Permission denied) 2024-09-10T23:29:27.748 INFO:tasks.workunit.client.0.smithi003.stdout:(sd-pam) 4243 ubuntu txt unknown /proc/4243/exe (readlink: Permission denied) 2024-09-10T23:29:27.748 INFO:tasks.workunit.client.0.smithi003.stdout:(sd-pam) 4243 ubuntu NOFD /proc/4243/fd (opendir: Permission denied) 2024-09-10T23:29:27.749 INFO:tasks.workunit.client.0.smithi003.stdout:rsyslogd 4506 root cwd unknown /proc/4506/cwd (readlink: Permission denied) 2024-09-10T23:29:27.749 INFO:tasks.workunit.client.0.smithi003.stdout:rsyslogd 4506 root rtd unknown /proc/4506/root (readlink: Permission denied) 2024-09-10T23:29:27.749 INFO:tasks.workunit.client.0.smithi003.stdout:rsyslogd 4506 root txt unknown /proc/4506/exe (readlink: Permission denied) 2024-09-10T23:29:27.749 INFO:tasks.workunit.client.0.smithi003.stdout:rsyslogd 4506 root NOFD /proc/4506/fd (opendir: Permission denied) 2024-09-10T23:29:27.749 INFO:tasks.workunit.client.0.smithi003.stdout:rsyslogd 4506 4508 in:imjour root cwd unknown /proc/4506/task/4508/cwd (readlink: Permission denied) 2024-09-10T23:29:27.749 INFO:tasks.workunit.client.0.smithi003.stdout:rsyslogd 4506 4508 in:imjour root rtd unknown /proc/4506/task/4508/root (readlink: Permission denied) 2024-09-10T23:29:27.749 INFO:tasks.workunit.client.0.smithi003.stdout:rsyslogd 4506 4508 in:imjour root txt unknown /proc/4506/task/4508/exe (readlink: Permission denied) 2024-09-10T23:29:27.749 INFO:tasks.workunit.client.0.smithi003.stdout:rsyslogd 4506 4508 in:imjour root NOFD /proc/4506/task/4508/fd (opendir: Permission denied) 2024-09-10T23:29:27.749 INFO:tasks.workunit.client.0.smithi003.stdout:rsyslogd 4506 4509 rs:main root cwd unknown /proc/4506/task/4509/cwd (readlink: Permission denied) 2024-09-10T23:29:27.749 INFO:tasks.workunit.client.0.smithi003.stdout:rsyslogd 4506 4509 rs:main root rtd unknown /proc/4506/task/4509/root (readlink: Permission denied) 2024-09-10T23:29:27.749 INFO:tasks.workunit.client.0.smithi003.stdout:rsyslogd 4506 4509 rs:main root txt unknown /proc/4506/task/4509/exe (readlink: Permission denied) 2024-09-10T23:29:27.749 INFO:tasks.workunit.client.0.smithi003.stdout:rsyslogd 4506 4509 rs:main root NOFD /proc/4506/task/4509/fd (opendir: Permission denied) 2024-09-10T23:29:27.750 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 polkitd cwd unknown /proc/18539/cwd (readlink: Permission denied) 2024-09-10T23:29:27.750 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 polkitd rtd unknown /proc/18539/root (readlink: Permission denied) 2024-09-10T23:29:27.750 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 polkitd txt unknown /proc/18539/exe (readlink: Permission denied) 2024-09-10T23:29:27.750 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 polkitd NOFD /proc/18539/fd (opendir: Permission denied) 2024-09-10T23:29:27.750 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18541 gmain polkitd cwd unknown /proc/18539/task/18541/cwd (readlink: Permission denied) 2024-09-10T23:29:27.750 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18541 gmain polkitd rtd unknown /proc/18539/task/18541/root (readlink: Permission denied) 2024-09-10T23:29:27.750 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18541 gmain polkitd txt unknown /proc/18539/task/18541/exe (readlink: Permission denied) 2024-09-10T23:29:27.750 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18541 gmain polkitd NOFD /proc/18539/task/18541/fd (opendir: Permission denied) 2024-09-10T23:29:27.750 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18542 gdbus polkitd cwd unknown /proc/18539/task/18542/cwd (readlink: Permission denied) 2024-09-10T23:29:27.750 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18542 gdbus polkitd rtd unknown /proc/18539/task/18542/root (readlink: Permission denied) 2024-09-10T23:29:27.750 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18542 gdbus polkitd txt unknown /proc/18539/task/18542/exe (readlink: Permission denied) 2024-09-10T23:29:27.750 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18542 gdbus polkitd NOFD /proc/18539/task/18542/fd (opendir: Permission denied) 2024-09-10T23:29:27.751 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18543 JS\x20Hel polkitd cwd unknown /proc/18539/task/18543/cwd (readlink: Permission denied) 2024-09-10T23:29:27.751 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18543 JS\x20Hel polkitd rtd unknown /proc/18539/task/18543/root (readlink: Permission denied) 2024-09-10T23:29:27.751 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18543 JS\x20Hel polkitd txt unknown /proc/18539/task/18543/exe (readlink: Permission denied) 2024-09-10T23:29:27.751 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18543 JS\x20Hel polkitd NOFD /proc/18539/task/18543/fd (opendir: Permission denied) 2024-09-10T23:29:27.751 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18544 JS\x20Hel polkitd cwd unknown /proc/18539/task/18544/cwd (readlink: Permission denied) 2024-09-10T23:29:27.751 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18544 JS\x20Hel polkitd rtd unknown /proc/18539/task/18544/root (readlink: Permission denied) 2024-09-10T23:29:27.751 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18544 JS\x20Hel polkitd txt unknown /proc/18539/task/18544/exe (readlink: Permission denied) 2024-09-10T23:29:27.751 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18544 JS\x20Hel polkitd NOFD /proc/18539/task/18544/fd (opendir: Permission denied) 2024-09-10T23:29:27.751 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18545 JS\x20Hel polkitd cwd unknown /proc/18539/task/18545/cwd (readlink: Permission denied) 2024-09-10T23:29:27.751 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18545 JS\x20Hel polkitd rtd unknown /proc/18539/task/18545/root (readlink: Permission denied) 2024-09-10T23:29:27.751 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18545 JS\x20Hel polkitd txt unknown /proc/18539/task/18545/exe (readlink: Permission denied) 2024-09-10T23:29:27.751 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18545 JS\x20Hel polkitd NOFD /proc/18539/task/18545/fd (opendir: Permission denied) 2024-09-10T23:29:27.751 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18546 JS\x20Hel polkitd cwd unknown /proc/18539/task/18546/cwd (readlink: Permission denied) 2024-09-10T23:29:27.751 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18546 JS\x20Hel polkitd rtd unknown /proc/18539/task/18546/root (readlink: Permission denied) 2024-09-10T23:29:27.752 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18546 JS\x20Hel polkitd txt unknown /proc/18539/task/18546/exe (readlink: Permission denied) 2024-09-10T23:29:27.752 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18546 JS\x20Hel polkitd NOFD /proc/18539/task/18546/fd (opendir: Permission denied) 2024-09-10T23:29:27.752 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18547 JS\x20Hel polkitd cwd unknown /proc/18539/task/18547/cwd (readlink: Permission denied) 2024-09-10T23:29:27.752 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18547 JS\x20Hel polkitd rtd unknown /proc/18539/task/18547/root (readlink: Permission denied) 2024-09-10T23:29:27.752 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18547 JS\x20Hel polkitd txt unknown /proc/18539/task/18547/exe (readlink: Permission denied) 2024-09-10T23:29:27.752 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18547 JS\x20Hel polkitd NOFD /proc/18539/task/18547/fd (opendir: Permission denied) 2024-09-10T23:29:27.752 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18548 JS\x20Hel polkitd cwd unknown /proc/18539/task/18548/cwd (readlink: Permission denied) 2024-09-10T23:29:27.752 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18548 JS\x20Hel polkitd rtd unknown /proc/18539/task/18548/root (readlink: Permission denied) 2024-09-10T23:29:27.752 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18548 JS\x20Hel polkitd txt unknown /proc/18539/task/18548/exe (readlink: Permission denied) 2024-09-10T23:29:27.752 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18548 JS\x20Hel polkitd NOFD /proc/18539/task/18548/fd (opendir: Permission denied) 2024-09-10T23:29:27.752 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18549 JS\x20Hel polkitd cwd unknown /proc/18539/task/18549/cwd (readlink: Permission denied) 2024-09-10T23:29:27.752 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18549 JS\x20Hel polkitd rtd unknown /proc/18539/task/18549/root (readlink: Permission denied) 2024-09-10T23:29:27.752 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18549 JS\x20Hel polkitd txt unknown /proc/18539/task/18549/exe (readlink: Permission denied) 2024-09-10T23:29:27.752 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18549 JS\x20Hel polkitd NOFD /proc/18539/task/18549/fd (opendir: Permission denied) 2024-09-10T23:29:27.753 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18550 JS\x20Hel polkitd cwd unknown /proc/18539/task/18550/cwd (readlink: Permission denied) 2024-09-10T23:29:27.753 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18550 JS\x20Hel polkitd rtd unknown /proc/18539/task/18550/root (readlink: Permission denied) 2024-09-10T23:29:27.753 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18550 JS\x20Hel polkitd txt unknown /proc/18539/task/18550/exe (readlink: Permission denied) 2024-09-10T23:29:27.753 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18550 JS\x20Hel polkitd NOFD /proc/18539/task/18550/fd (opendir: Permission denied) 2024-09-10T23:29:27.753 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18551 polkitd polkitd cwd unknown /proc/18539/task/18551/cwd (readlink: Permission denied) 2024-09-10T23:29:27.753 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18551 polkitd polkitd rtd unknown /proc/18539/task/18551/root (readlink: Permission denied) 2024-09-10T23:29:27.753 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18551 polkitd polkitd txt unknown /proc/18539/task/18551/exe (readlink: Permission denied) 2024-09-10T23:29:27.753 INFO:tasks.workunit.client.0.smithi003.stdout:polkitd 18539 18551 polkitd polkitd NOFD /proc/18539/task/18551/fd (opendir: Permission denied) 2024-09-10T23:29:27.753 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20445 root cwd unknown /proc/20445/cwd (readlink: Permission denied) 2024-09-10T23:29:27.753 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20445 root rtd unknown /proc/20445/root (readlink: Permission denied) 2024-09-10T23:29:27.753 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20445 root txt unknown /proc/20445/exe (readlink: Permission denied) 2024-09-10T23:29:27.753 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20445 root NOFD /proc/20445/fd (opendir: Permission denied) 2024-09-10T23:29:27.753 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20475 root cwd unknown /proc/20475/cwd (readlink: Permission denied) 2024-09-10T23:29:27.753 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20475 root rtd unknown /proc/20475/root (readlink: Permission denied) 2024-09-10T23:29:27.754 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20475 root txt unknown /proc/20475/exe (readlink: Permission denied) 2024-09-10T23:29:27.754 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20475 root NOFD /proc/20475/fd (opendir: Permission denied) 2024-09-10T23:29:27.754 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20504 root cwd unknown /proc/20504/cwd (readlink: Permission denied) 2024-09-10T23:29:27.754 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20504 root rtd unknown /proc/20504/root (readlink: Permission denied) 2024-09-10T23:29:27.754 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20504 root txt unknown /proc/20504/exe (readlink: Permission denied) 2024-09-10T23:29:27.754 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20504 root NOFD /proc/20504/fd (opendir: Permission denied) 2024-09-10T23:29:27.754 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20533 root cwd unknown /proc/20533/cwd (readlink: Permission denied) 2024-09-10T23:29:27.754 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20533 root rtd unknown /proc/20533/root (readlink: Permission denied) 2024-09-10T23:29:27.754 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20533 root txt unknown /proc/20533/exe (readlink: Permission denied) 2024-09-10T23:29:27.754 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20533 root NOFD /proc/20533/fd (opendir: Permission denied) 2024-09-10T23:29:27.754 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20562 root cwd unknown /proc/20562/cwd (readlink: Permission denied) 2024-09-10T23:29:27.754 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20562 root rtd unknown /proc/20562/root (readlink: Permission denied) 2024-09-10T23:29:27.754 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20562 root txt unknown /proc/20562/exe (readlink: Permission denied) 2024-09-10T23:29:27.755 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20562 root NOFD /proc/20562/fd (opendir: Permission denied) 2024-09-10T23:29:27.755 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20726 root cwd unknown /proc/20726/cwd (readlink: Permission denied) 2024-09-10T23:29:27.755 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20726 root rtd unknown /proc/20726/root (readlink: Permission denied) 2024-09-10T23:29:27.755 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20726 root txt unknown /proc/20726/exe (readlink: Permission denied) 2024-09-10T23:29:27.755 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20726 root NOFD /proc/20726/fd (opendir: Permission denied) 2024-09-10T23:29:27.755 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20727 root cwd unknown /proc/20727/cwd (readlink: Permission denied) 2024-09-10T23:29:27.755 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20727 root rtd unknown /proc/20727/root (readlink: Permission denied) 2024-09-10T23:29:27.755 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20727 root txt unknown /proc/20727/exe (readlink: Permission denied) 2024-09-10T23:29:27.755 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20727 root NOFD /proc/20727/fd (opendir: Permission denied) 2024-09-10T23:29:27.755 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20728 root cwd unknown /proc/20728/cwd (readlink: Permission denied) 2024-09-10T23:29:27.755 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20728 root rtd unknown /proc/20728/root (readlink: Permission denied) 2024-09-10T23:29:27.755 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20728 root txt unknown /proc/20728/exe (readlink: Permission denied) 2024-09-10T23:29:27.755 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20728 root NOFD /proc/20728/fd (opendir: Permission denied) 2024-09-10T23:29:27.755 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20729 root cwd unknown /proc/20729/cwd (readlink: Permission denied) 2024-09-10T23:29:27.755 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20729 root rtd unknown /proc/20729/root (readlink: Permission denied) 2024-09-10T23:29:27.756 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20729 root txt unknown /proc/20729/exe (readlink: Permission denied) 2024-09-10T23:29:27.756 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20729 root NOFD /proc/20729/fd (opendir: Permission denied) 2024-09-10T23:29:27.756 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20730 root cwd unknown /proc/20730/cwd (readlink: Permission denied) 2024-09-10T23:29:27.756 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20730 root rtd unknown /proc/20730/root (readlink: Permission denied) 2024-09-10T23:29:27.756 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20730 root txt unknown /proc/20730/exe (readlink: Permission denied) 2024-09-10T23:29:27.756 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20730 root NOFD /proc/20730/fd (opendir: Permission denied) 2024-09-10T23:29:27.756 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20731 root cwd unknown /proc/20731/cwd (readlink: Permission denied) 2024-09-10T23:29:27.756 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20731 root rtd unknown /proc/20731/root (readlink: Permission denied) 2024-09-10T23:29:27.756 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20731 root txt unknown /proc/20731/exe (readlink: Permission denied) 2024-09-10T23:29:27.756 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20731 root NOFD /proc/20731/fd (opendir: Permission denied) 2024-09-10T23:29:27.756 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20732 root cwd unknown /proc/20732/cwd (readlink: Permission denied) 2024-09-10T23:29:27.756 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20732 root rtd unknown /proc/20732/root (readlink: Permission denied) 2024-09-10T23:29:27.756 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20732 root txt unknown /proc/20732/exe (readlink: Permission denied) 2024-09-10T23:29:27.756 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20732 root NOFD /proc/20732/fd (opendir: Permission denied) 2024-09-10T23:29:27.756 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20733 root cwd unknown /proc/20733/cwd (readlink: Permission denied) 2024-09-10T23:29:27.757 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20733 root rtd unknown /proc/20733/root (readlink: Permission denied) 2024-09-10T23:29:27.757 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20733 root txt unknown /proc/20733/exe (readlink: Permission denied) 2024-09-10T23:29:27.757 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20733 root NOFD /proc/20733/fd (opendir: Permission denied) 2024-09-10T23:29:27.757 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20734 root cwd unknown /proc/20734/cwd (readlink: Permission denied) 2024-09-10T23:29:27.757 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20734 root rtd unknown /proc/20734/root (readlink: Permission denied) 2024-09-10T23:29:27.757 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20734 root txt unknown /proc/20734/exe (readlink: Permission denied) 2024-09-10T23:29:27.757 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/R 20734 root NOFD /proc/20734/fd (opendir: Permission denied) 2024-09-10T23:29:27.757 INFO:tasks.workunit.client.0.smithi003.stdout:xfsaild/d 20735 root cwd unknown /proc/20735/cwd (readlink: Permission denied) 2024-09-10T23:29:27.757 INFO:tasks.workunit.client.0.smithi003.stdout:xfsaild/d 20735 root rtd unknown /proc/20735/root (readlink: Permission denied) 2024-09-10T23:29:27.757 INFO:tasks.workunit.client.0.smithi003.stdout:xfsaild/d 20735 root txt unknown /proc/20735/exe (readlink: Permission denied) 2024-09-10T23:29:27.757 INFO:tasks.workunit.client.0.smithi003.stdout:xfsaild/d 20735 root NOFD /proc/20735/fd (opendir: Permission denied) 2024-09-10T23:29:27.757 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/4 21158 root cwd unknown /proc/21158/cwd (readlink: Permission denied) 2024-09-10T23:29:27.757 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/4 21158 root rtd unknown /proc/21158/root (readlink: Permission denied) 2024-09-10T23:29:27.757 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/4 21158 root txt unknown /proc/21158/exe (readlink: Permission denied) 2024-09-10T23:29:27.758 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/4 21158 root NOFD /proc/21158/fd (opendir: Permission denied) 2024-09-10T23:29:27.758 INFO:tasks.workunit.client.0.smithi003.stdout:sshd 21672 root cwd unknown /proc/21672/cwd (readlink: Permission denied) 2024-09-10T23:29:27.758 INFO:tasks.workunit.client.0.smithi003.stdout:sshd 21672 root rtd unknown /proc/21672/root (readlink: Permission denied) 2024-09-10T23:29:27.758 INFO:tasks.workunit.client.0.smithi003.stdout:sshd 21672 root txt unknown /proc/21672/exe (readlink: Permission denied) 2024-09-10T23:29:27.758 INFO:tasks.workunit.client.0.smithi003.stdout:sshd 21672 root NOFD /proc/21672/fd (opendir: Permission denied) 2024-09-10T23:29:27.758 INFO:tasks.workunit.client.0.smithi003.stdout:sshd 21675 ubuntu cwd unknown /proc/21675/cwd (readlink: Permission denied) 2024-09-10T23:29:27.758 INFO:tasks.workunit.client.0.smithi003.stdout:sshd 21675 ubuntu rtd unknown /proc/21675/root (readlink: Permission denied) 2024-09-10T23:29:27.758 INFO:tasks.workunit.client.0.smithi003.stdout:sshd 21675 ubuntu txt unknown /proc/21675/exe (readlink: Permission denied) 2024-09-10T23:29:27.758 INFO:tasks.workunit.client.0.smithi003.stdout:sshd 21675 ubuntu NOFD /proc/21675/fd (opendir: Permission denied) 2024-09-10T23:29:27.758 INFO:tasks.workunit.client.0.smithi003.stdout:chronyd 21735 chrony cwd unknown /proc/21735/cwd (readlink: Permission denied) 2024-09-10T23:29:27.758 INFO:tasks.workunit.client.0.smithi003.stdout:chronyd 21735 chrony rtd unknown /proc/21735/root (readlink: Permission denied) 2024-09-10T23:29:27.758 INFO:tasks.workunit.client.0.smithi003.stdout:chronyd 21735 chrony txt unknown /proc/21735/exe (readlink: Permission denied) 2024-09-10T23:29:27.758 INFO:tasks.workunit.client.0.smithi003.stdout:chronyd 21735 chrony NOFD /proc/21735/fd (opendir: Permission denied) 2024-09-10T23:29:27.758 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-cras 22070 ceph cwd unknown /proc/22070/cwd (readlink: Permission denied) 2024-09-10T23:29:27.759 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-cras 22070 ceph rtd unknown /proc/22070/root (readlink: Permission denied) 2024-09-10T23:29:27.759 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-cras 22070 ceph txt unknown /proc/22070/exe (readlink: Permission denied) 2024-09-10T23:29:27.759 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-cras 22070 ceph NOFD /proc/22070/fd (opendir: Permission denied) 2024-09-10T23:29:27.759 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/6 22578 root cwd unknown /proc/22578/cwd (readlink: Permission denied) 2024-09-10T23:29:27.759 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/6 22578 root rtd unknown /proc/22578/root (readlink: Permission denied) 2024-09-10T23:29:27.759 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/6 22578 root txt unknown /proc/22578/exe (readlink: Permission denied) 2024-09-10T23:29:27.759 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/6 22578 root NOFD /proc/22578/fd (opendir: Permission denied) 2024-09-10T23:29:27.759 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/5 23547 root cwd unknown /proc/23547/cwd (readlink: Permission denied) 2024-09-10T23:29:27.759 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/5 23547 root rtd unknown /proc/23547/root (readlink: Permission denied) 2024-09-10T23:29:27.759 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/5 23547 root txt unknown /proc/23547/exe (readlink: Permission denied) 2024-09-10T23:29:27.759 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/5 23547 root NOFD /proc/23547/fd (opendir: Permission denied) 2024-09-10T23:29:27.759 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/5 23557 root cwd unknown /proc/23557/cwd (readlink: Permission denied) 2024-09-10T23:29:27.759 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/5 23557 root rtd unknown /proc/23557/root (readlink: Permission denied) 2024-09-10T23:29:27.759 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/5 23557 root txt unknown /proc/23557/exe (readlink: Permission denied) 2024-09-10T23:29:27.760 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/5 23557 root NOFD /proc/23557/fd (opendir: Permission denied) 2024-09-10T23:29:27.760 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/2 28979 root cwd unknown /proc/28979/cwd (readlink: Permission denied) 2024-09-10T23:29:27.760 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/2 28979 root rtd unknown /proc/28979/root (readlink: Permission denied) 2024-09-10T23:29:27.760 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/2 28979 root txt unknown /proc/28979/exe (readlink: Permission denied) 2024-09-10T23:29:27.760 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/2 28979 root NOFD /proc/28979/fd (opendir: Permission denied) 2024-09-10T23:29:27.760 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 29365 root cwd unknown /proc/29365/cwd (readlink: Permission denied) 2024-09-10T23:29:27.760 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 29365 root rtd unknown /proc/29365/root (readlink: Permission denied) 2024-09-10T23:29:27.760 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 29365 root txt unknown /proc/29365/exe (readlink: Permission denied) 2024-09-10T23:29:27.760 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 29365 root NOFD /proc/29365/fd (opendir: Permission denied) 2024-09-10T23:29:27.760 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 29382 root cwd unknown /proc/29382/cwd (readlink: Permission denied) 2024-09-10T23:29:27.760 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 29382 root rtd unknown /proc/29382/root (readlink: Permission denied) 2024-09-10T23:29:27.760 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 29382 root txt unknown /proc/29382/exe (readlink: Permission denied) 2024-09-10T23:29:27.760 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 29382 root NOFD /proc/29382/fd (opendir: Permission denied) 2024-09-10T23:29:27.761 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 29383 root cwd unknown /proc/29383/cwd (readlink: Permission denied) 2024-09-10T23:29:27.761 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 29383 root rtd unknown /proc/29383/root (readlink: Permission denied) 2024-09-10T23:29:27.761 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 29383 root txt unknown /proc/29383/exe (readlink: Permission denied) 2024-09-10T23:29:27.761 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 29383 root NOFD /proc/29383/fd (opendir: Permission denied) 2024-09-10T23:29:27.761 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 29401 root cwd unknown /proc/29401/cwd (readlink: Permission denied) 2024-09-10T23:29:27.761 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 29401 root rtd unknown /proc/29401/root (readlink: Permission denied) 2024-09-10T23:29:27.761 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 29401 root txt unknown /proc/29401/exe (readlink: Permission denied) 2024-09-10T23:29:27.761 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 29401 root NOFD /proc/29401/fd (opendir: Permission denied) 2024-09-10T23:29:27.761 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/1 29702 root cwd unknown /proc/29702/cwd (readlink: Permission denied) 2024-09-10T23:29:27.761 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/1 29702 root rtd unknown /proc/29702/root (readlink: Permission denied) 2024-09-10T23:29:27.761 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/1 29702 root txt unknown /proc/29702/exe (readlink: Permission denied) 2024-09-10T23:29:27.761 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/1 29702 root NOFD /proc/29702/fd (opendir: Permission denied) 2024-09-10T23:29:27.762 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 30344 root cwd unknown /proc/30344/cwd (readlink: Permission denied) 2024-09-10T23:29:27.762 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 30344 root rtd unknown /proc/30344/root (readlink: Permission denied) 2024-09-10T23:29:27.762 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 30344 root txt unknown /proc/30344/exe (readlink: Permission denied) 2024-09-10T23:29:27.762 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 30344 root NOFD /proc/30344/fd (opendir: Permission denied) 2024-09-10T23:29:27.762 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 30346 root cwd unknown /proc/30346/cwd (readlink: Permission denied) 2024-09-10T23:29:27.762 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 30346 root rtd unknown /proc/30346/root (readlink: Permission denied) 2024-09-10T23:29:27.762 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 30346 root txt unknown /proc/30346/exe (readlink: Permission denied) 2024-09-10T23:29:27.762 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 30346 root NOFD /proc/30346/fd (opendir: Permission denied) 2024-09-10T23:29:27.762 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 ceph cwd unknown /proc/30348/cwd (readlink: Permission denied) 2024-09-10T23:29:27.762 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 ceph rtd unknown /proc/30348/root (readlink: Permission denied) 2024-09-10T23:29:27.762 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 ceph txt unknown /proc/30348/exe (readlink: Permission denied) 2024-09-10T23:29:27.762 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 ceph NOFD /proc/30348/fd (opendir: Permission denied) 2024-09-10T23:29:27.762 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30349 log ceph cwd unknown /proc/30348/task/30349/cwd (readlink: Permission denied) 2024-09-10T23:29:27.763 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30349 log ceph rtd unknown /proc/30348/task/30349/root (readlink: Permission denied) 2024-09-10T23:29:27.763 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30349 log ceph txt unknown /proc/30348/task/30349/exe (readlink: Permission denied) 2024-09-10T23:29:27.763 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30349 log ceph NOFD /proc/30348/task/30349/fd (opendir: Permission denied) 2024-09-10T23:29:27.763 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30350 service ceph cwd unknown /proc/30348/task/30350/cwd (readlink: Permission denied) 2024-09-10T23:29:27.763 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30350 service ceph rtd unknown /proc/30348/task/30350/root (readlink: Permission denied) 2024-09-10T23:29:27.763 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30350 service ceph txt unknown /proc/30348/task/30350/exe (readlink: Permission denied) 2024-09-10T23:29:27.763 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30350 service ceph NOFD /proc/30348/task/30350/fd (opendir: Permission denied) 2024-09-10T23:29:27.763 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30351 admin_soc ceph cwd unknown /proc/30348/task/30351/cwd (readlink: Permission denied) 2024-09-10T23:29:27.763 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30351 admin_soc ceph rtd unknown /proc/30348/task/30351/root (readlink: Permission denied) 2024-09-10T23:29:27.763 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30351 admin_soc ceph txt unknown /proc/30348/task/30351/exe (readlink: Permission denied) 2024-09-10T23:29:27.763 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30351 admin_soc ceph NOFD /proc/30348/task/30351/fd (opendir: Permission denied) 2024-09-10T23:29:27.763 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30352 signal_ha ceph cwd unknown /proc/30348/task/30352/cwd (readlink: Permission denied) 2024-09-10T23:29:27.763 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30352 signal_ha ceph rtd unknown /proc/30348/task/30352/root (readlink: Permission denied) 2024-09-10T23:29:27.763 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30352 signal_ha ceph txt unknown /proc/30348/task/30352/exe (readlink: Permission denied) 2024-09-10T23:29:27.764 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30352 signal_ha ceph NOFD /proc/30348/task/30352/fd (opendir: Permission denied) 2024-09-10T23:29:27.764 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30353 rocksdb:l ceph cwd unknown /proc/30348/task/30353/cwd (readlink: Permission denied) 2024-09-10T23:29:27.764 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30353 rocksdb:l ceph rtd unknown /proc/30348/task/30353/root (readlink: Permission denied) 2024-09-10T23:29:27.764 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30353 rocksdb:l ceph txt unknown /proc/30348/task/30353/exe (readlink: Permission denied) 2024-09-10T23:29:27.764 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30353 rocksdb:l ceph NOFD /proc/30348/task/30353/fd (opendir: Permission denied) 2024-09-10T23:29:27.764 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30354 rocksdb:h ceph cwd unknown /proc/30348/task/30354/cwd (readlink: Permission denied) 2024-09-10T23:29:27.764 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30354 rocksdb:h ceph rtd unknown /proc/30348/task/30354/root (readlink: Permission denied) 2024-09-10T23:29:27.764 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30354 rocksdb:h ceph txt unknown /proc/30348/task/30354/exe (readlink: Permission denied) 2024-09-10T23:29:27.764 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30354 rocksdb:h ceph NOFD /proc/30348/task/30354/fd (opendir: Permission denied) 2024-09-10T23:29:27.764 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30370 ceph-mon ceph cwd unknown /proc/30348/task/30370/cwd (readlink: Permission denied) 2024-09-10T23:29:27.764 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30370 ceph-mon ceph rtd unknown /proc/30348/task/30370/root (readlink: Permission denied) 2024-09-10T23:29:27.764 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30370 ceph-mon ceph txt unknown /proc/30348/task/30370/exe (readlink: Permission denied) 2024-09-10T23:29:27.765 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30370 ceph-mon ceph NOFD /proc/30348/task/30370/fd (opendir: Permission denied) 2024-09-10T23:29:27.765 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30371 fn_monsto ceph cwd unknown /proc/30348/task/30371/cwd (readlink: Permission denied) 2024-09-10T23:29:27.765 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30371 fn_monsto ceph rtd unknown /proc/30348/task/30371/root (readlink: Permission denied) 2024-09-10T23:29:27.765 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30371 fn_monsto ceph txt unknown /proc/30348/task/30371/exe (readlink: Permission denied) 2024-09-10T23:29:27.765 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30371 fn_monsto ceph NOFD /proc/30348/task/30371/fd (opendir: Permission denied) 2024-09-10T23:29:27.765 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30372 msgr-work ceph cwd unknown /proc/30348/task/30372/cwd (readlink: Permission denied) 2024-09-10T23:29:27.765 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30372 msgr-work ceph rtd unknown /proc/30348/task/30372/root (readlink: Permission denied) 2024-09-10T23:29:27.765 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30372 msgr-work ceph txt unknown /proc/30348/task/30372/exe (readlink: Permission denied) 2024-09-10T23:29:27.765 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30372 msgr-work ceph NOFD /proc/30348/task/30372/fd (opendir: Permission denied) 2024-09-10T23:29:27.765 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30373 msgr-work ceph cwd unknown /proc/30348/task/30373/cwd (readlink: Permission denied) 2024-09-10T23:29:27.765 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30373 msgr-work ceph rtd unknown /proc/30348/task/30373/root (readlink: Permission denied) 2024-09-10T23:29:27.765 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30373 msgr-work ceph txt unknown /proc/30348/task/30373/exe (readlink: Permission denied) 2024-09-10T23:29:27.765 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30373 msgr-work ceph NOFD /proc/30348/task/30373/fd (opendir: Permission denied) 2024-09-10T23:29:27.766 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30374 msgr-work ceph cwd unknown /proc/30348/task/30374/cwd (readlink: Permission denied) 2024-09-10T23:29:27.766 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30374 msgr-work ceph rtd unknown /proc/30348/task/30374/root (readlink: Permission denied) 2024-09-10T23:29:27.766 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30374 msgr-work ceph txt unknown /proc/30348/task/30374/exe (readlink: Permission denied) 2024-09-10T23:29:27.766 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30374 msgr-work ceph NOFD /proc/30348/task/30374/fd (opendir: Permission denied) 2024-09-10T23:29:27.766 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30375 OpHistory ceph cwd unknown /proc/30348/task/30375/cwd (readlink: Permission denied) 2024-09-10T23:29:27.766 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30375 OpHistory ceph rtd unknown /proc/30348/task/30375/root (readlink: Permission denied) 2024-09-10T23:29:27.766 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30375 OpHistory ceph txt unknown /proc/30348/task/30375/exe (readlink: Permission denied) 2024-09-10T23:29:27.766 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30375 OpHistory ceph NOFD /proc/30348/task/30375/fd (opendir: Permission denied) 2024-09-10T23:29:27.767 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30376 fin ceph cwd unknown /proc/30348/task/30376/cwd (readlink: Permission denied) 2024-09-10T23:29:27.767 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30376 fin ceph rtd unknown /proc/30348/task/30376/root (readlink: Permission denied) 2024-09-10T23:29:27.767 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30376 fin ceph txt unknown /proc/30348/task/30376/exe (readlink: Permission denied) 2024-09-10T23:29:27.767 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30376 fin ceph NOFD /proc/30348/task/30376/fd (opendir: Permission denied) 2024-09-10T23:29:27.767 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30377 safe_time ceph cwd unknown /proc/30348/task/30377/cwd (readlink: Permission denied) 2024-09-10T23:29:27.767 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30377 safe_time ceph rtd unknown /proc/30348/task/30377/root (readlink: Permission denied) 2024-09-10T23:29:27.768 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30377 safe_time ceph txt unknown /proc/30348/task/30377/exe (readlink: Permission denied) 2024-09-10T23:29:27.768 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30377 safe_time ceph NOFD /proc/30348/task/30377/fd (opendir: Permission denied) 2024-09-10T23:29:27.768 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30378 cpu_tp ceph cwd unknown /proc/30348/task/30378/cwd (readlink: Permission denied) 2024-09-10T23:29:27.768 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30378 cpu_tp ceph rtd unknown /proc/30348/task/30378/root (readlink: Permission denied) 2024-09-10T23:29:27.768 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30378 cpu_tp ceph txt unknown /proc/30348/task/30378/exe (readlink: Permission denied) 2024-09-10T23:29:27.768 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30378 cpu_tp ceph NOFD /proc/30348/task/30378/fd (opendir: Permission denied) 2024-09-10T23:29:27.769 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30379 cpu_tp ceph cwd unknown /proc/30348/task/30379/cwd (readlink: Permission denied) 2024-09-10T23:29:27.769 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30379 cpu_tp ceph rtd unknown /proc/30348/task/30379/root (readlink: Permission denied) 2024-09-10T23:29:27.769 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30379 cpu_tp ceph txt unknown /proc/30348/task/30379/exe (readlink: Permission denied) 2024-09-10T23:29:27.769 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30379 cpu_tp ceph NOFD /proc/30348/task/30379/fd (opendir: Permission denied) 2024-09-10T23:29:27.769 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30380 cpu_tp ceph cwd unknown /proc/30348/task/30380/cwd (readlink: Permission denied) 2024-09-10T23:29:27.769 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30380 cpu_tp ceph rtd unknown /proc/30348/task/30380/root (readlink: Permission denied) 2024-09-10T23:29:27.770 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30380 cpu_tp ceph txt unknown /proc/30348/task/30380/exe (readlink: Permission denied) 2024-09-10T23:29:27.770 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30380 cpu_tp ceph NOFD /proc/30348/task/30380/fd (opendir: Permission denied) 2024-09-10T23:29:27.770 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30381 cpu_tp ceph cwd unknown /proc/30348/task/30381/cwd (readlink: Permission denied) 2024-09-10T23:29:27.770 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30381 cpu_tp ceph rtd unknown /proc/30348/task/30381/root (readlink: Permission denied) 2024-09-10T23:29:27.770 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30381 cpu_tp ceph txt unknown /proc/30348/task/30381/exe (readlink: Permission denied) 2024-09-10T23:29:27.770 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30381 cpu_tp ceph NOFD /proc/30348/task/30381/fd (opendir: Permission denied) 2024-09-10T23:29:27.771 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30382 ms_dispat ceph cwd unknown /proc/30348/task/30382/cwd (readlink: Permission denied) 2024-09-10T23:29:27.771 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30382 ms_dispat ceph rtd unknown /proc/30348/task/30382/root (readlink: Permission denied) 2024-09-10T23:29:27.771 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30382 ms_dispat ceph txt unknown /proc/30348/task/30382/exe (readlink: Permission denied) 2024-09-10T23:29:27.771 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30382 ms_dispat ceph NOFD /proc/30348/task/30382/fd (opendir: Permission denied) 2024-09-10T23:29:27.771 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30383 ms_local ceph cwd unknown /proc/30348/task/30383/cwd (readlink: Permission denied) 2024-09-10T23:29:27.771 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30383 ms_local ceph rtd unknown /proc/30348/task/30383/root (readlink: Permission denied) 2024-09-10T23:29:27.771 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30383 ms_local ceph txt unknown /proc/30348/task/30383/exe (readlink: Permission denied) 2024-09-10T23:29:27.771 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30383 ms_local ceph NOFD /proc/30348/task/30383/fd (opendir: Permission denied) 2024-09-10T23:29:27.771 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30384 safe_time ceph cwd unknown /proc/30348/task/30384/cwd (readlink: Permission denied) 2024-09-10T23:29:27.772 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30384 safe_time ceph rtd unknown /proc/30348/task/30384/root (readlink: Permission denied) 2024-09-10T23:29:27.772 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30384 safe_time ceph txt unknown /proc/30348/task/30384/exe (readlink: Permission denied) 2024-09-10T23:29:27.772 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30384 safe_time ceph NOFD /proc/30348/task/30384/fd (opendir: Permission denied) 2024-09-10T23:29:27.772 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30385 ms_dispat ceph cwd unknown /proc/30348/task/30385/cwd (readlink: Permission denied) 2024-09-10T23:29:27.772 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30385 ms_dispat ceph rtd unknown /proc/30348/task/30385/root (readlink: Permission denied) 2024-09-10T23:29:27.772 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30385 ms_dispat ceph txt unknown /proc/30348/task/30385/exe (readlink: Permission denied) 2024-09-10T23:29:27.772 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30385 ms_dispat ceph NOFD /proc/30348/task/30385/fd (opendir: Permission denied) 2024-09-10T23:29:27.772 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30386 ms_local ceph cwd unknown /proc/30348/task/30386/cwd (readlink: Permission denied) 2024-09-10T23:29:27.772 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30386 ms_local ceph rtd unknown /proc/30348/task/30386/root (readlink: Permission denied) 2024-09-10T23:29:27.772 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30386 ms_local ceph txt unknown /proc/30348/task/30386/exe (readlink: Permission denied) 2024-09-10T23:29:27.772 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 30386 ms_local ceph NOFD /proc/30348/task/30386/fd (opendir: Permission denied) 2024-09-10T23:29:27.772 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 66852 rstore_co ceph cwd unknown /proc/30348/task/66852/cwd (readlink: Permission denied) 2024-09-10T23:29:27.773 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 66852 rstore_co ceph rtd unknown /proc/30348/task/66852/root (readlink: Permission denied) 2024-09-10T23:29:27.773 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 66852 rstore_co ceph txt unknown /proc/30348/task/66852/exe (readlink: Permission denied) 2024-09-10T23:29:27.773 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mon 30348 66852 rstore_co ceph NOFD /proc/30348/task/66852/fd (opendir: Permission denied) 2024-09-10T23:29:27.773 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 30576 root cwd unknown /proc/30576/cwd (readlink: Permission denied) 2024-09-10T23:29:27.773 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 30576 root rtd unknown /proc/30576/root (readlink: Permission denied) 2024-09-10T23:29:27.773 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 30576 root txt unknown /proc/30576/exe (readlink: Permission denied) 2024-09-10T23:29:27.773 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 30576 root NOFD /proc/30576/fd (opendir: Permission denied) 2024-09-10T23:29:27.773 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 30578 root cwd unknown /proc/30578/cwd (readlink: Permission denied) 2024-09-10T23:29:27.773 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 30578 root rtd unknown /proc/30578/root (readlink: Permission denied) 2024-09-10T23:29:27.773 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 30578 root txt unknown /proc/30578/exe (readlink: Permission denied) 2024-09-10T23:29:27.773 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 30578 root NOFD /proc/30578/fd (opendir: Permission denied) 2024-09-10T23:29:27.773 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 ceph cwd unknown /proc/30581/cwd (readlink: Permission denied) 2024-09-10T23:29:27.774 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 ceph rtd unknown /proc/30581/root (readlink: Permission denied) 2024-09-10T23:29:27.774 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 ceph txt unknown /proc/30581/exe (readlink: Permission denied) 2024-09-10T23:29:27.774 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 ceph NOFD /proc/30581/fd (opendir: Permission denied) 2024-09-10T23:29:27.774 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41441 log ceph cwd unknown /proc/30581/task/41441/cwd (readlink: Permission denied) 2024-09-10T23:29:27.774 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41441 log ceph rtd unknown /proc/30581/task/41441/root (readlink: Permission denied) 2024-09-10T23:29:27.774 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41441 log ceph txt unknown /proc/30581/task/41441/exe (readlink: Permission denied) 2024-09-10T23:29:27.774 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41441 log ceph NOFD /proc/30581/task/41441/fd (opendir: Permission denied) 2024-09-10T23:29:27.774 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41443 msgr-work ceph cwd unknown /proc/30581/task/41443/cwd (readlink: Permission denied) 2024-09-10T23:29:27.774 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41443 msgr-work ceph rtd unknown /proc/30581/task/41443/root (readlink: Permission denied) 2024-09-10T23:29:27.774 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41443 msgr-work ceph txt unknown /proc/30581/task/41443/exe (readlink: Permission denied) 2024-09-10T23:29:27.774 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41443 msgr-work ceph NOFD /proc/30581/task/41443/fd (opendir: Permission denied) 2024-09-10T23:29:27.774 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41444 msgr-work ceph cwd unknown /proc/30581/task/41444/cwd (readlink: Permission denied) 2024-09-10T23:29:27.774 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41444 msgr-work ceph rtd unknown /proc/30581/task/41444/root (readlink: Permission denied) 2024-09-10T23:29:27.774 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41444 msgr-work ceph txt unknown /proc/30581/task/41444/exe (readlink: Permission denied) 2024-09-10T23:29:27.775 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41444 msgr-work ceph NOFD /proc/30581/task/41444/fd (opendir: Permission denied) 2024-09-10T23:29:27.775 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41445 msgr-work ceph cwd unknown /proc/30581/task/41445/cwd (readlink: Permission denied) 2024-09-10T23:29:27.775 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41445 msgr-work ceph rtd unknown /proc/30581/task/41445/root (readlink: Permission denied) 2024-09-10T23:29:27.775 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41445 msgr-work ceph txt unknown /proc/30581/task/41445/exe (readlink: Permission denied) 2024-09-10T23:29:27.775 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41445 msgr-work ceph NOFD /proc/30581/task/41445/fd (opendir: Permission denied) 2024-09-10T23:29:27.775 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41449 service ceph cwd unknown /proc/30581/task/41449/cwd (readlink: Permission denied) 2024-09-10T23:29:27.775 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41449 service ceph rtd unknown /proc/30581/task/41449/root (readlink: Permission denied) 2024-09-10T23:29:27.775 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41449 service ceph txt unknown /proc/30581/task/41449/exe (readlink: Permission denied) 2024-09-10T23:29:27.775 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41449 service ceph NOFD /proc/30581/task/41449/fd (opendir: Permission denied) 2024-09-10T23:29:27.775 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41450 admin_soc ceph cwd unknown /proc/30581/task/41450/cwd (readlink: Permission denied) 2024-09-10T23:29:27.775 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41450 admin_soc ceph rtd unknown /proc/30581/task/41450/root (readlink: Permission denied) 2024-09-10T23:29:27.775 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41450 admin_soc ceph txt unknown /proc/30581/task/41450/exe (readlink: Permission denied) 2024-09-10T23:29:27.775 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41450 admin_soc ceph NOFD /proc/30581/task/41450/fd (opendir: Permission denied) 2024-09-10T23:29:27.776 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41451 ceph_time ceph cwd unknown /proc/30581/task/41451/cwd (readlink: Permission denied) 2024-09-10T23:29:27.776 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41451 ceph_time ceph rtd unknown /proc/30581/task/41451/root (readlink: Permission denied) 2024-09-10T23:29:27.776 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41451 ceph_time ceph txt unknown /proc/30581/task/41451/exe (readlink: Permission denied) 2024-09-10T23:29:27.776 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41451 ceph_time ceph NOFD /proc/30581/task/41451/fd (opendir: Permission denied) 2024-09-10T23:29:27.776 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41452 fn_anonym ceph cwd unknown /proc/30581/task/41452/cwd (readlink: Permission denied) 2024-09-10T23:29:27.776 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41452 fn_anonym ceph rtd unknown /proc/30581/task/41452/root (readlink: Permission denied) 2024-09-10T23:29:27.776 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41452 fn_anonym ceph txt unknown /proc/30581/task/41452/exe (readlink: Permission denied) 2024-09-10T23:29:27.776 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41452 fn_anonym ceph NOFD /proc/30581/task/41452/fd (opendir: Permission denied) 2024-09-10T23:29:27.776 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41453 signal_ha ceph cwd unknown /proc/30581/task/41453/cwd (readlink: Permission denied) 2024-09-10T23:29:27.776 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41453 signal_ha ceph rtd unknown /proc/30581/task/41453/root (readlink: Permission denied) 2024-09-10T23:29:27.776 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41453 signal_ha ceph txt unknown /proc/30581/task/41453/exe (readlink: Permission denied) 2024-09-10T23:29:27.777 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41453 signal_ha ceph NOFD /proc/30581/task/41453/fd (opendir: Permission denied) 2024-09-10T23:29:27.777 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41454 mgrsb-fin ceph cwd unknown /proc/30581/task/41454/cwd (readlink: Permission denied) 2024-09-10T23:29:27.777 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41454 mgrsb-fin ceph rtd unknown /proc/30581/task/41454/root (readlink: Permission denied) 2024-09-10T23:29:27.777 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41454 mgrsb-fin ceph txt unknown /proc/30581/task/41454/exe (readlink: Permission denied) 2024-09-10T23:29:27.777 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41454 mgrsb-fin ceph NOFD /proc/30581/task/41454/fd (opendir: Permission denied) 2024-09-10T23:29:27.777 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41455 ms_dispat ceph cwd unknown /proc/30581/task/41455/cwd (readlink: Permission denied) 2024-09-10T23:29:27.777 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41455 ms_dispat ceph rtd unknown /proc/30581/task/41455/root (readlink: Permission denied) 2024-09-10T23:29:27.777 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41455 ms_dispat ceph txt unknown /proc/30581/task/41455/exe (readlink: Permission denied) 2024-09-10T23:29:27.777 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41455 ms_dispat ceph NOFD /proc/30581/task/41455/fd (opendir: Permission denied) 2024-09-10T23:29:27.777 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41456 ms_local ceph cwd unknown /proc/30581/task/41456/cwd (readlink: Permission denied) 2024-09-10T23:29:27.777 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41456 ms_local ceph rtd unknown /proc/30581/task/41456/root (readlink: Permission denied) 2024-09-10T23:29:27.777 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41456 ms_local ceph txt unknown /proc/30581/task/41456/exe (readlink: Permission denied) 2024-09-10T23:29:27.777 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41456 ms_local ceph NOFD /proc/30581/task/41456/fd (opendir: Permission denied) 2024-09-10T23:29:27.777 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41457 io_contex ceph cwd unknown /proc/30581/task/41457/cwd (readlink: Permission denied) 2024-09-10T23:29:27.778 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41457 io_contex ceph rtd unknown /proc/30581/task/41457/root (readlink: Permission denied) 2024-09-10T23:29:27.778 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41457 io_contex ceph txt unknown /proc/30581/task/41457/exe (readlink: Permission denied) 2024-09-10T23:29:27.778 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41457 io_contex ceph NOFD /proc/30581/task/41457/fd (opendir: Permission denied) 2024-09-10T23:29:27.778 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41458 io_contex ceph cwd unknown /proc/30581/task/41458/cwd (readlink: Permission denied) 2024-09-10T23:29:27.778 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41458 io_contex ceph rtd unknown /proc/30581/task/41458/root (readlink: Permission denied) 2024-09-10T23:29:27.778 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41458 io_contex ceph txt unknown /proc/30581/task/41458/exe (readlink: Permission denied) 2024-09-10T23:29:27.778 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41458 io_contex ceph NOFD /proc/30581/task/41458/fd (opendir: Permission denied) 2024-09-10T23:29:27.778 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41459 safe_time ceph cwd unknown /proc/30581/task/41459/cwd (readlink: Permission denied) 2024-09-10T23:29:27.778 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41459 safe_time ceph rtd unknown /proc/30581/task/41459/root (readlink: Permission denied) 2024-09-10T23:29:27.778 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41459 safe_time ceph txt unknown /proc/30581/task/41459/exe (readlink: Permission denied) 2024-09-10T23:29:27.778 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41459 safe_time ceph NOFD /proc/30581/task/41459/fd (opendir: Permission denied) 2024-09-10T23:29:27.778 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41460 safe_time ceph cwd unknown /proc/30581/task/41460/cwd (readlink: Permission denied) 2024-09-10T23:29:27.779 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41460 safe_time ceph rtd unknown /proc/30581/task/41460/root (readlink: Permission denied) 2024-09-10T23:29:27.779 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41460 safe_time ceph txt unknown /proc/30581/task/41460/exe (readlink: Permission denied) 2024-09-10T23:29:27.779 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41460 safe_time ceph NOFD /proc/30581/task/41460/fd (opendir: Permission denied) 2024-09-10T23:29:27.779 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41461 safe_time ceph cwd unknown /proc/30581/task/41461/cwd (readlink: Permission denied) 2024-09-10T23:29:27.779 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41461 safe_time ceph rtd unknown /proc/30581/task/41461/root (readlink: Permission denied) 2024-09-10T23:29:27.779 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41461 safe_time ceph txt unknown /proc/30581/task/41461/exe (readlink: Permission denied) 2024-09-10T23:29:27.779 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41461 safe_time ceph NOFD /proc/30581/task/41461/fd (opendir: Permission denied) 2024-09-10T23:29:27.779 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41462 fn_anonym ceph cwd unknown /proc/30581/task/41462/cwd (readlink: Permission denied) 2024-09-10T23:29:27.779 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41462 fn_anonym ceph rtd unknown /proc/30581/task/41462/root (readlink: Permission denied) 2024-09-10T23:29:27.780 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41462 fn_anonym ceph txt unknown /proc/30581/task/41462/exe (readlink: Permission denied) 2024-09-10T23:29:27.780 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41462 fn_anonym ceph NOFD /proc/30581/task/41462/fd (opendir: Permission denied) 2024-09-10T23:29:27.780 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41463 flusher ceph cwd unknown /proc/30581/task/41463/cwd (readlink: Permission denied) 2024-09-10T23:29:27.780 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41463 flusher ceph rtd unknown /proc/30581/task/41463/root (readlink: Permission denied) 2024-09-10T23:29:27.780 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41463 flusher ceph txt unknown /proc/30581/task/41463/exe (readlink: Permission denied) 2024-09-10T23:29:27.780 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41463 flusher ceph NOFD /proc/30581/task/41463/fd (opendir: Permission denied) 2024-09-10T23:29:27.780 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41464 safe_time ceph cwd unknown /proc/30581/task/41464/cwd (readlink: Permission denied) 2024-09-10T23:29:27.780 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41464 safe_time ceph rtd unknown /proc/30581/task/41464/root (readlink: Permission denied) 2024-09-10T23:29:27.780 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41464 safe_time ceph txt unknown /proc/30581/task/41464/exe (readlink: Permission denied) 2024-09-10T23:29:27.780 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41464 safe_time ceph NOFD /proc/30581/task/41464/fd (opendir: Permission denied) 2024-09-10T23:29:27.780 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41477 OpHistory ceph cwd unknown /proc/30581/task/41477/cwd (readlink: Permission denied) 2024-09-10T23:29:27.780 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41477 OpHistory ceph rtd unknown /proc/30581/task/41477/root (readlink: Permission denied) 2024-09-10T23:29:27.780 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41477 OpHistory ceph txt unknown /proc/30581/task/41477/exe (readlink: Permission denied) 2024-09-10T23:29:27.781 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41477 OpHistory ceph NOFD /proc/30581/task/41477/fd (opendir: Permission denied) 2024-09-10T23:29:27.781 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41478 mgr-fin ceph cwd unknown /proc/30581/task/41478/cwd (readlink: Permission denied) 2024-09-10T23:29:27.781 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41478 mgr-fin ceph rtd unknown /proc/30581/task/41478/root (readlink: Permission denied) 2024-09-10T23:29:27.781 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41478 mgr-fin ceph txt unknown /proc/30581/task/41478/exe (readlink: Permission denied) 2024-09-10T23:29:27.781 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41478 mgr-fin ceph NOFD /proc/30581/task/41478/fd (opendir: Permission denied) 2024-09-10T23:29:27.781 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41479 ms_dispat ceph cwd unknown /proc/30581/task/41479/cwd (readlink: Permission denied) 2024-09-10T23:29:27.781 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41479 ms_dispat ceph rtd unknown /proc/30581/task/41479/root (readlink: Permission denied) 2024-09-10T23:29:27.781 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41479 ms_dispat ceph txt unknown /proc/30581/task/41479/exe (readlink: Permission denied) 2024-09-10T23:29:27.781 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41479 ms_dispat ceph NOFD /proc/30581/task/41479/fd (opendir: Permission denied) 2024-09-10T23:29:27.781 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41480 ms_local ceph cwd unknown /proc/30581/task/41480/cwd (readlink: Permission denied) 2024-09-10T23:29:27.781 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41480 ms_local ceph rtd unknown /proc/30581/task/41480/root (readlink: Permission denied) 2024-09-10T23:29:27.781 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41480 ms_local ceph txt unknown /proc/30581/task/41480/exe (readlink: Permission denied) 2024-09-10T23:29:27.782 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41480 ms_local ceph NOFD /proc/30581/task/41480/fd (opendir: Permission denied) 2024-09-10T23:29:27.782 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41481 safe_time ceph cwd unknown /proc/30581/task/41481/cwd (readlink: Permission denied) 2024-09-10T23:29:27.782 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41481 safe_time ceph rtd unknown /proc/30581/task/41481/root (readlink: Permission denied) 2024-09-10T23:29:27.782 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41481 safe_time ceph txt unknown /proc/30581/task/41481/exe (readlink: Permission denied) 2024-09-10T23:29:27.782 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41481 safe_time ceph NOFD /proc/30581/task/41481/fd (opendir: Permission denied) 2024-09-10T23:29:27.782 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41482 cmdfin ceph cwd unknown /proc/30581/task/41482/cwd (readlink: Permission denied) 2024-09-10T23:29:27.782 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41482 cmdfin ceph rtd unknown /proc/30581/task/41482/root (readlink: Permission denied) 2024-09-10T23:29:27.782 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41482 cmdfin ceph txt unknown /proc/30581/task/41482/exe (readlink: Permission denied) 2024-09-10T23:29:27.782 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41482 cmdfin ceph NOFD /proc/30581/task/41482/fd (opendir: Permission denied) 2024-09-10T23:29:27.782 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41486 io_contex ceph cwd unknown /proc/30581/task/41486/cwd (readlink: Permission denied) 2024-09-10T23:29:27.782 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41486 io_contex ceph rtd unknown /proc/30581/task/41486/root (readlink: Permission denied) 2024-09-10T23:29:27.782 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41486 io_contex ceph txt unknown /proc/30581/task/41486/exe (readlink: Permission denied) 2024-09-10T23:29:27.782 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41486 io_contex ceph NOFD /proc/30581/task/41486/fd (opendir: Permission denied) 2024-09-10T23:29:27.782 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41487 io_contex ceph cwd unknown /proc/30581/task/41487/cwd (readlink: Permission denied) 2024-09-10T23:29:27.783 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41487 io_contex ceph rtd unknown /proc/30581/task/41487/root (readlink: Permission denied) 2024-09-10T23:29:27.783 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41487 io_contex ceph txt unknown /proc/30581/task/41487/exe (readlink: Permission denied) 2024-09-10T23:29:27.783 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41487 io_contex ceph NOFD /proc/30581/task/41487/fd (opendir: Permission denied) 2024-09-10T23:29:27.783 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41488 ceph_time ceph cwd unknown /proc/30581/task/41488/cwd (readlink: Permission denied) 2024-09-10T23:29:27.783 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41488 ceph_time ceph rtd unknown /proc/30581/task/41488/root (readlink: Permission denied) 2024-09-10T23:29:27.783 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41488 ceph_time ceph txt unknown /proc/30581/task/41488/exe (readlink: Permission denied) 2024-09-10T23:29:27.783 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41488 ceph_time ceph NOFD /proc/30581/task/41488/fd (opendir: Permission denied) 2024-09-10T23:29:27.783 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41489 ms_dispat ceph cwd unknown /proc/30581/task/41489/cwd (readlink: Permission denied) 2024-09-10T23:29:27.783 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41489 ms_dispat ceph rtd unknown /proc/30581/task/41489/root (readlink: Permission denied) 2024-09-10T23:29:27.783 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41489 ms_dispat ceph txt unknown /proc/30581/task/41489/exe (readlink: Permission denied) 2024-09-10T23:29:27.783 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41489 ms_dispat ceph NOFD /proc/30581/task/41489/fd (opendir: Permission denied) 2024-09-10T23:29:27.783 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41490 ms_local ceph cwd unknown /proc/30581/task/41490/cwd (readlink: Permission denied) 2024-09-10T23:29:27.783 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41490 ms_local ceph rtd unknown /proc/30581/task/41490/root (readlink: Permission denied) 2024-09-10T23:29:27.784 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41490 ms_local ceph txt unknown /proc/30581/task/41490/exe (readlink: Permission denied) 2024-09-10T23:29:27.784 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41490 ms_local ceph NOFD /proc/30581/task/41490/fd (opendir: Permission denied) 2024-09-10T23:29:27.784 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41491 safe_time ceph cwd unknown /proc/30581/task/41491/cwd (readlink: Permission denied) 2024-09-10T23:29:27.784 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41491 safe_time ceph rtd unknown /proc/30581/task/41491/root (readlink: Permission denied) 2024-09-10T23:29:27.784 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41491 safe_time ceph txt unknown /proc/30581/task/41491/exe (readlink: Permission denied) 2024-09-10T23:29:27.784 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41491 safe_time ceph NOFD /proc/30581/task/41491/fd (opendir: Permission denied) 2024-09-10T23:29:27.784 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41492 safe_time ceph cwd unknown /proc/30581/task/41492/cwd (readlink: Permission denied) 2024-09-10T23:29:27.784 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41492 safe_time ceph rtd unknown /proc/30581/task/41492/root (readlink: Permission denied) 2024-09-10T23:29:27.784 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41492 safe_time ceph txt unknown /proc/30581/task/41492/exe (readlink: Permission denied) 2024-09-10T23:29:27.784 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41492 safe_time ceph NOFD /proc/30581/task/41492/fd (opendir: Permission denied) 2024-09-10T23:29:27.784 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41493 balancer ceph cwd unknown /proc/30581/task/41493/cwd (readlink: Permission denied) 2024-09-10T23:29:27.784 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41493 balancer ceph rtd unknown /proc/30581/task/41493/root (readlink: Permission denied) 2024-09-10T23:29:27.784 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41493 balancer ceph txt unknown /proc/30581/task/41493/exe (readlink: Permission denied) 2024-09-10T23:29:27.785 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41493 balancer ceph NOFD /proc/30581/task/41493/fd (opendir: Permission denied) 2024-09-10T23:29:27.785 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41494 m-fin-bal ceph cwd unknown /proc/30581/task/41494/cwd (readlink: Permission denied) 2024-09-10T23:29:27.785 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41494 m-fin-bal ceph rtd unknown /proc/30581/task/41494/root (readlink: Permission denied) 2024-09-10T23:29:27.785 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41494 m-fin-bal ceph txt unknown /proc/30581/task/41494/exe (readlink: Permission denied) 2024-09-10T23:29:27.785 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41494 m-fin-bal ceph NOFD /proc/30581/task/41494/fd (opendir: Permission denied) 2024-09-10T23:29:27.785 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41495 mgr-fin ceph cwd unknown /proc/30581/task/41495/cwd (readlink: Permission denied) 2024-09-10T23:29:27.785 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41495 mgr-fin ceph rtd unknown /proc/30581/task/41495/root (readlink: Permission denied) 2024-09-10T23:29:27.785 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41495 mgr-fin ceph txt unknown /proc/30581/task/41495/exe (readlink: Permission denied) 2024-09-10T23:29:27.785 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41495 mgr-fin ceph NOFD /proc/30581/task/41495/fd (opendir: Permission denied) 2024-09-10T23:29:27.785 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41496 mgr-fin ceph cwd unknown /proc/30581/task/41496/cwd (readlink: Permission denied) 2024-09-10T23:29:27.785 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41496 mgr-fin ceph rtd unknown /proc/30581/task/41496/root (readlink: Permission denied) 2024-09-10T23:29:27.785 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41496 mgr-fin ceph txt unknown /proc/30581/task/41496/exe (readlink: Permission denied) 2024-09-10T23:29:27.785 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41496 mgr-fin ceph NOFD /proc/30581/task/41496/fd (opendir: Permission denied) 2024-09-10T23:29:27.785 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41497 mgr-fin ceph cwd unknown /proc/30581/task/41497/cwd (readlink: Permission denied) 2024-09-10T23:29:27.786 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41497 mgr-fin ceph rtd unknown /proc/30581/task/41497/root (readlink: Permission denied) 2024-09-10T23:29:27.786 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41497 mgr-fin ceph txt unknown /proc/30581/task/41497/exe (readlink: Permission denied) 2024-09-10T23:29:27.786 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41497 mgr-fin ceph NOFD /proc/30581/task/41497/fd (opendir: Permission denied) 2024-09-10T23:29:27.786 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41498 mgr-fin ceph cwd unknown /proc/30581/task/41498/cwd (readlink: Permission denied) 2024-09-10T23:29:27.786 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41498 mgr-fin ceph rtd unknown /proc/30581/task/41498/root (readlink: Permission denied) 2024-09-10T23:29:27.786 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41498 mgr-fin ceph txt unknown /proc/30581/task/41498/exe (readlink: Permission denied) 2024-09-10T23:29:27.786 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41498 mgr-fin ceph NOFD /proc/30581/task/41498/fd (opendir: Permission denied) 2024-09-10T23:29:27.786 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41499 mgr-fin ceph cwd unknown /proc/30581/task/41499/cwd (readlink: Permission denied) 2024-09-10T23:29:27.786 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41499 mgr-fin ceph rtd unknown /proc/30581/task/41499/root (readlink: Permission denied) 2024-09-10T23:29:27.786 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41499 mgr-fin ceph txt unknown /proc/30581/task/41499/exe (readlink: Permission denied) 2024-09-10T23:29:27.786 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41499 mgr-fin ceph NOFD /proc/30581/task/41499/fd (opendir: Permission denied) 2024-09-10T23:29:27.786 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41500 mgr-fin ceph cwd unknown /proc/30581/task/41500/cwd (readlink: Permission denied) 2024-09-10T23:29:27.786 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41500 mgr-fin ceph rtd unknown /proc/30581/task/41500/root (readlink: Permission denied) 2024-09-10T23:29:27.786 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41500 mgr-fin ceph txt unknown /proc/30581/task/41500/exe (readlink: Permission denied) 2024-09-10T23:29:27.786 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41500 mgr-fin ceph NOFD /proc/30581/task/41500/fd (opendir: Permission denied) 2024-09-10T23:29:27.787 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41501 mgr-fin ceph cwd unknown /proc/30581/task/41501/cwd (readlink: Permission denied) 2024-09-10T23:29:27.787 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41501 mgr-fin ceph rtd unknown /proc/30581/task/41501/root (readlink: Permission denied) 2024-09-10T23:29:27.787 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41501 mgr-fin ceph txt unknown /proc/30581/task/41501/exe (readlink: Permission denied) 2024-09-10T23:29:27.787 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41501 mgr-fin ceph NOFD /proc/30581/task/41501/fd (opendir: Permission denied) 2024-09-10T23:29:27.787 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41502 mgr-fin ceph cwd unknown /proc/30581/task/41502/cwd (readlink: Permission denied) 2024-09-10T23:29:27.787 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41502 mgr-fin ceph rtd unknown /proc/30581/task/41502/root (readlink: Permission denied) 2024-09-10T23:29:27.787 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41502 mgr-fin ceph txt unknown /proc/30581/task/41502/exe (readlink: Permission denied) 2024-09-10T23:29:27.787 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41502 mgr-fin ceph NOFD /proc/30581/task/41502/fd (opendir: Permission denied) 2024-09-10T23:29:27.787 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41503 mgr-fin ceph cwd unknown /proc/30581/task/41503/cwd (readlink: Permission denied) 2024-09-10T23:29:27.788 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41503 mgr-fin ceph rtd unknown /proc/30581/task/41503/root (readlink: Permission denied) 2024-09-10T23:29:27.788 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41503 mgr-fin ceph txt unknown /proc/30581/task/41503/exe (readlink: Permission denied) 2024-09-10T23:29:27.788 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41503 mgr-fin ceph NOFD /proc/30581/task/41503/fd (opendir: Permission denied) 2024-09-10T23:29:27.788 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41504 mgr-fin ceph cwd unknown /proc/30581/task/41504/cwd (readlink: Permission denied) 2024-09-10T23:29:27.788 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41504 mgr-fin ceph rtd unknown /proc/30581/task/41504/root (readlink: Permission denied) 2024-09-10T23:29:27.788 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41504 mgr-fin ceph txt unknown /proc/30581/task/41504/exe (readlink: Permission denied) 2024-09-10T23:29:27.788 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41504 mgr-fin ceph NOFD /proc/30581/task/41504/fd (opendir: Permission denied) 2024-09-10T23:29:27.788 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41505 mgr-fin ceph cwd unknown /proc/30581/task/41505/cwd (readlink: Permission denied) 2024-09-10T23:29:27.788 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41505 mgr-fin ceph rtd unknown /proc/30581/task/41505/root (readlink: Permission denied) 2024-09-10T23:29:27.788 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41505 mgr-fin ceph txt unknown /proc/30581/task/41505/exe (readlink: Permission denied) 2024-09-10T23:29:27.788 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41505 mgr-fin ceph NOFD /proc/30581/task/41505/fd (opendir: Permission denied) 2024-09-10T23:29:27.788 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41506 mgr-fin ceph cwd unknown /proc/30581/task/41506/cwd (readlink: Permission denied) 2024-09-10T23:29:27.789 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41506 mgr-fin ceph rtd unknown /proc/30581/task/41506/root (readlink: Permission denied) 2024-09-10T23:29:27.789 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41506 mgr-fin ceph txt unknown /proc/30581/task/41506/exe (readlink: Permission denied) 2024-09-10T23:29:27.789 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41506 mgr-fin ceph NOFD /proc/30581/task/41506/fd (opendir: Permission denied) 2024-09-10T23:29:27.789 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41507 mgr-fin ceph cwd unknown /proc/30581/task/41507/cwd (readlink: Permission denied) 2024-09-10T23:29:27.789 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41507 mgr-fin ceph rtd unknown /proc/30581/task/41507/root (readlink: Permission denied) 2024-09-10T23:29:27.789 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41507 mgr-fin ceph txt unknown /proc/30581/task/41507/exe (readlink: Permission denied) 2024-09-10T23:29:27.789 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41507 mgr-fin ceph NOFD /proc/30581/task/41507/fd (opendir: Permission denied) 2024-09-10T23:29:27.789 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41508 mgr-fin ceph cwd unknown /proc/30581/task/41508/cwd (readlink: Permission denied) 2024-09-10T23:29:27.789 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41508 mgr-fin ceph rtd unknown /proc/30581/task/41508/root (readlink: Permission denied) 2024-09-10T23:29:27.789 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41508 mgr-fin ceph txt unknown /proc/30581/task/41508/exe (readlink: Permission denied) 2024-09-10T23:29:27.789 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41508 mgr-fin ceph NOFD /proc/30581/task/41508/fd (opendir: Permission denied) 2024-09-10T23:29:27.789 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41509 mgr-fin ceph cwd unknown /proc/30581/task/41509/cwd (readlink: Permission denied) 2024-09-10T23:29:27.789 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41509 mgr-fin ceph rtd unknown /proc/30581/task/41509/root (readlink: Permission denied) 2024-09-10T23:29:27.790 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41509 mgr-fin ceph txt unknown /proc/30581/task/41509/exe (readlink: Permission denied) 2024-09-10T23:29:27.790 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41509 mgr-fin ceph NOFD /proc/30581/task/41509/fd (opendir: Permission denied) 2024-09-10T23:29:27.790 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41510 cephadm ceph cwd unknown /proc/30581/task/41510/cwd (readlink: Permission denied) 2024-09-10T23:29:27.790 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41510 cephadm ceph rtd unknown /proc/30581/task/41510/root (readlink: Permission denied) 2024-09-10T23:29:27.790 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41510 cephadm ceph txt unknown /proc/30581/task/41510/exe (readlink: Permission denied) 2024-09-10T23:29:27.790 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41510 cephadm ceph NOFD /proc/30581/task/41510/fd (opendir: Permission denied) 2024-09-10T23:29:27.790 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41511 m-fin-cep ceph cwd unknown /proc/30581/task/41511/cwd (readlink: Permission denied) 2024-09-10T23:29:27.790 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41511 m-fin-cep ceph rtd unknown /proc/30581/task/41511/root (readlink: Permission denied) 2024-09-10T23:29:27.790 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41511 m-fin-cep ceph txt unknown /proc/30581/task/41511/exe (readlink: Permission denied) 2024-09-10T23:29:27.790 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41511 m-fin-cep ceph NOFD /proc/30581/task/41511/fd (opendir: Permission denied) 2024-09-10T23:29:27.790 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41512 mgr-fin ceph cwd unknown /proc/30581/task/41512/cwd (readlink: Permission denied) 2024-09-10T23:29:27.790 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41512 mgr-fin ceph rtd unknown /proc/30581/task/41512/root (readlink: Permission denied) 2024-09-10T23:29:27.790 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41512 mgr-fin ceph txt unknown /proc/30581/task/41512/exe (readlink: Permission denied) 2024-09-10T23:29:27.790 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41512 mgr-fin ceph NOFD /proc/30581/task/41512/fd (opendir: Permission denied) 2024-09-10T23:29:27.791 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41513 mgr-fin ceph cwd unknown /proc/30581/task/41513/cwd (readlink: Permission denied) 2024-09-10T23:29:27.791 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41513 mgr-fin ceph rtd unknown /proc/30581/task/41513/root (readlink: Permission denied) 2024-09-10T23:29:27.791 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41513 mgr-fin ceph txt unknown /proc/30581/task/41513/exe (readlink: Permission denied) 2024-09-10T23:29:27.791 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41513 mgr-fin ceph NOFD /proc/30581/task/41513/fd (opendir: Permission denied) 2024-09-10T23:29:27.791 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41514 crash ceph cwd unknown /proc/30581/task/41514/cwd (readlink: Permission denied) 2024-09-10T23:29:27.791 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41514 crash ceph rtd unknown /proc/30581/task/41514/root (readlink: Permission denied) 2024-09-10T23:29:27.791 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41514 crash ceph txt unknown /proc/30581/task/41514/exe (readlink: Permission denied) 2024-09-10T23:29:27.791 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41514 crash ceph NOFD /proc/30581/task/41514/fd (opendir: Permission denied) 2024-09-10T23:29:27.791 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41515 cephadm ceph cwd unknown /proc/30581/task/41515/cwd (readlink: Permission denied) 2024-09-10T23:29:27.791 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41515 cephadm ceph rtd unknown /proc/30581/task/41515/root (readlink: Permission denied) 2024-09-10T23:29:27.791 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41515 cephadm ceph txt unknown /proc/30581/task/41515/exe (readlink: Permission denied) 2024-09-10T23:29:27.791 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41515 cephadm ceph NOFD /proc/30581/task/41515/fd (opendir: Permission denied) 2024-09-10T23:29:27.791 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41516 m-fin-cra ceph cwd unknown /proc/30581/task/41516/cwd (readlink: Permission denied) 2024-09-10T23:29:27.791 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41516 m-fin-cra ceph rtd unknown /proc/30581/task/41516/root (readlink: Permission denied) 2024-09-10T23:29:27.792 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41516 m-fin-cra ceph txt unknown /proc/30581/task/41516/exe (readlink: Permission denied) 2024-09-10T23:29:27.792 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41516 m-fin-cra ceph NOFD /proc/30581/task/41516/fd (opendir: Permission denied) 2024-09-10T23:29:27.792 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41517 mgr-fin ceph cwd unknown /proc/30581/task/41517/cwd (readlink: Permission denied) 2024-09-10T23:29:27.792 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41517 mgr-fin ceph rtd unknown /proc/30581/task/41517/root (readlink: Permission denied) 2024-09-10T23:29:27.792 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41517 mgr-fin ceph txt unknown /proc/30581/task/41517/exe (readlink: Permission denied) 2024-09-10T23:29:27.792 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41517 mgr-fin ceph NOFD /proc/30581/task/41517/fd (opendir: Permission denied) 2024-09-10T23:29:27.792 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41518 mgr-fin ceph cwd unknown /proc/30581/task/41518/cwd (readlink: Permission denied) 2024-09-10T23:29:27.792 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41518 mgr-fin ceph rtd unknown /proc/30581/task/41518/root (readlink: Permission denied) 2024-09-10T23:29:27.792 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41518 mgr-fin ceph txt unknown /proc/30581/task/41518/exe (readlink: Permission denied) 2024-09-10T23:29:27.792 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41518 mgr-fin ceph NOFD /proc/30581/task/41518/fd (opendir: Permission denied) 2024-09-10T23:29:27.792 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41519 mgr-fin ceph cwd unknown /proc/30581/task/41519/cwd (readlink: Permission denied) 2024-09-10T23:29:27.792 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41519 mgr-fin ceph rtd unknown /proc/30581/task/41519/root (readlink: Permission denied) 2024-09-10T23:29:27.792 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41519 mgr-fin ceph txt unknown /proc/30581/task/41519/exe (readlink: Permission denied) 2024-09-10T23:29:27.793 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41519 mgr-fin ceph NOFD /proc/30581/task/41519/fd (opendir: Permission denied) 2024-09-10T23:29:27.793 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41520 mgr-fin ceph cwd unknown /proc/30581/task/41520/cwd (readlink: Permission denied) 2024-09-10T23:29:27.793 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41520 mgr-fin ceph rtd unknown /proc/30581/task/41520/root (readlink: Permission denied) 2024-09-10T23:29:27.793 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41520 mgr-fin ceph txt unknown /proc/30581/task/41520/exe (readlink: Permission denied) 2024-09-10T23:29:27.793 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41520 mgr-fin ceph NOFD /proc/30581/task/41520/fd (opendir: Permission denied) 2024-09-10T23:29:27.793 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41521 mgr-fin ceph cwd unknown /proc/30581/task/41521/cwd (readlink: Permission denied) 2024-09-10T23:29:27.793 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41521 mgr-fin ceph rtd unknown /proc/30581/task/41521/root (readlink: Permission denied) 2024-09-10T23:29:27.793 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41521 mgr-fin ceph txt unknown /proc/30581/task/41521/exe (readlink: Permission denied) 2024-09-10T23:29:27.793 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41521 mgr-fin ceph NOFD /proc/30581/task/41521/fd (opendir: Permission denied) 2024-09-10T23:29:27.793 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41522 mgr-fin ceph cwd unknown /proc/30581/task/41522/cwd (readlink: Permission denied) 2024-09-10T23:29:27.793 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41522 mgr-fin ceph rtd unknown /proc/30581/task/41522/root (readlink: Permission denied) 2024-09-10T23:29:27.793 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41522 mgr-fin ceph txt unknown /proc/30581/task/41522/exe (readlink: Permission denied) 2024-09-10T23:29:27.793 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41522 mgr-fin ceph NOFD /proc/30581/task/41522/fd (opendir: Permission denied) 2024-09-10T23:29:27.793 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41523 mgr-fin ceph cwd unknown /proc/30581/task/41523/cwd (readlink: Permission denied) 2024-09-10T23:29:27.794 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41523 mgr-fin ceph rtd unknown /proc/30581/task/41523/root (readlink: Permission denied) 2024-09-10T23:29:27.794 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41523 mgr-fin ceph txt unknown /proc/30581/task/41523/exe (readlink: Permission denied) 2024-09-10T23:29:27.794 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41523 mgr-fin ceph NOFD /proc/30581/task/41523/fd (opendir: Permission denied) 2024-09-10T23:29:27.794 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41524 mgr-fin ceph cwd unknown /proc/30581/task/41524/cwd (readlink: Permission denied) 2024-09-10T23:29:27.794 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41524 mgr-fin ceph rtd unknown /proc/30581/task/41524/root (readlink: Permission denied) 2024-09-10T23:29:27.794 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41524 mgr-fin ceph txt unknown /proc/30581/task/41524/exe (readlink: Permission denied) 2024-09-10T23:29:27.794 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41524 mgr-fin ceph NOFD /proc/30581/task/41524/fd (opendir: Permission denied) 2024-09-10T23:29:27.794 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41525 mgr-fin ceph cwd unknown /proc/30581/task/41525/cwd (readlink: Permission denied) 2024-09-10T23:29:27.794 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41525 mgr-fin ceph rtd unknown /proc/30581/task/41525/root (readlink: Permission denied) 2024-09-10T23:29:27.794 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41525 mgr-fin ceph txt unknown /proc/30581/task/41525/exe (readlink: Permission denied) 2024-09-10T23:29:27.794 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41525 mgr-fin ceph NOFD /proc/30581/task/41525/fd (opendir: Permission denied) 2024-09-10T23:29:27.794 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41526 dashboard ceph cwd unknown /proc/30581/task/41526/cwd (readlink: Permission denied) 2024-09-10T23:29:27.794 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41526 dashboard ceph rtd unknown /proc/30581/task/41526/root (readlink: Permission denied) 2024-09-10T23:29:27.794 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41526 dashboard ceph txt unknown /proc/30581/task/41526/exe (readlink: Permission denied) 2024-09-10T23:29:27.795 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41526 dashboard ceph NOFD /proc/30581/task/41526/fd (opendir: Permission denied) 2024-09-10T23:29:27.795 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41527 m-fin-das ceph cwd unknown /proc/30581/task/41527/cwd (readlink: Permission denied) 2024-09-10T23:29:27.795 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41527 m-fin-das ceph rtd unknown /proc/30581/task/41527/root (readlink: Permission denied) 2024-09-10T23:29:27.795 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41527 m-fin-das ceph txt unknown /proc/30581/task/41527/exe (readlink: Permission denied) 2024-09-10T23:29:27.795 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41527 m-fin-das ceph NOFD /proc/30581/task/41527/fd (opendir: Permission denied) 2024-09-10T23:29:27.795 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41528 mgr-fin ceph cwd unknown /proc/30581/task/41528/cwd (readlink: Permission denied) 2024-09-10T23:29:27.795 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41528 mgr-fin ceph rtd unknown /proc/30581/task/41528/root (readlink: Permission denied) 2024-09-10T23:29:27.795 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41528 mgr-fin ceph txt unknown /proc/30581/task/41528/exe (readlink: Permission denied) 2024-09-10T23:29:27.795 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41528 mgr-fin ceph NOFD /proc/30581/task/41528/fd (opendir: Permission denied) 2024-09-10T23:29:27.795 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41529 mgr-fin ceph cwd unknown /proc/30581/task/41529/cwd (readlink: Permission denied) 2024-09-10T23:29:27.795 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41529 mgr-fin ceph rtd unknown /proc/30581/task/41529/root (readlink: Permission denied) 2024-09-10T23:29:27.795 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41529 mgr-fin ceph txt unknown /proc/30581/task/41529/exe (readlink: Permission denied) 2024-09-10T23:29:27.795 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41529 mgr-fin ceph NOFD /proc/30581/task/41529/fd (opendir: Permission denied) 2024-09-10T23:29:27.796 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41530 devicehea ceph cwd unknown /proc/30581/task/41530/cwd (readlink: Permission denied) 2024-09-10T23:29:27.796 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41530 devicehea ceph rtd unknown /proc/30581/task/41530/root (readlink: Permission denied) 2024-09-10T23:29:27.796 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41530 devicehea ceph txt unknown /proc/30581/task/41530/exe (readlink: Permission denied) 2024-09-10T23:29:27.796 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41530 devicehea ceph NOFD /proc/30581/task/41530/fd (opendir: Permission denied) 2024-09-10T23:29:27.796 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41531 m-fin-dev ceph cwd unknown /proc/30581/task/41531/cwd (readlink: Permission denied) 2024-09-10T23:29:27.796 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41531 m-fin-dev ceph rtd unknown /proc/30581/task/41531/root (readlink: Permission denied) 2024-09-10T23:29:27.796 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41531 m-fin-dev ceph txt unknown /proc/30581/task/41531/exe (readlink: Permission denied) 2024-09-10T23:29:27.796 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41531 m-fin-dev ceph NOFD /proc/30581/task/41531/fd (opendir: Permission denied) 2024-09-10T23:29:27.796 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41533 m-fin-ios ceph cwd unknown /proc/30581/task/41533/cwd (readlink: Permission denied) 2024-09-10T23:29:27.796 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41533 m-fin-ios ceph rtd unknown /proc/30581/task/41533/root (readlink: Permission denied) 2024-09-10T23:29:27.796 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41533 m-fin-ios ceph txt unknown /proc/30581/task/41533/exe (readlink: Permission denied) 2024-09-10T23:29:27.797 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41533 m-fin-ios ceph NOFD /proc/30581/task/41533/fd (opendir: Permission denied) 2024-09-10T23:29:27.797 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41535 m-fin-nfs ceph cwd unknown /proc/30581/task/41535/cwd (readlink: Permission denied) 2024-09-10T23:29:27.797 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41535 m-fin-nfs ceph rtd unknown /proc/30581/task/41535/root (readlink: Permission denied) 2024-09-10T23:29:27.797 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41535 m-fin-nfs ceph txt unknown /proc/30581/task/41535/exe (readlink: Permission denied) 2024-09-10T23:29:27.797 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41535 m-fin-nfs ceph NOFD /proc/30581/task/41535/fd (opendir: Permission denied) 2024-09-10T23:29:27.797 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41537 m-fin-orc ceph cwd unknown /proc/30581/task/41537/cwd (readlink: Permission denied) 2024-09-10T23:29:27.797 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41537 m-fin-orc ceph rtd unknown /proc/30581/task/41537/root (readlink: Permission denied) 2024-09-10T23:29:27.797 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41537 m-fin-orc ceph txt unknown /proc/30581/task/41537/exe (readlink: Permission denied) 2024-09-10T23:29:27.797 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41537 m-fin-orc ceph NOFD /proc/30581/task/41537/fd (opendir: Permission denied) 2024-09-10T23:29:27.797 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41538 pg_autosc ceph cwd unknown /proc/30581/task/41538/cwd (readlink: Permission denied) 2024-09-10T23:29:27.797 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41538 pg_autosc ceph rtd unknown /proc/30581/task/41538/root (readlink: Permission denied) 2024-09-10T23:29:27.797 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41538 pg_autosc ceph txt unknown /proc/30581/task/41538/exe (readlink: Permission denied) 2024-09-10T23:29:27.797 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41538 pg_autosc ceph NOFD /proc/30581/task/41538/fd (opendir: Permission denied) 2024-09-10T23:29:27.798 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41539 m-fin-pg_ ceph cwd unknown /proc/30581/task/41539/cwd (readlink: Permission denied) 2024-09-10T23:29:27.798 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41539 m-fin-pg_ ceph rtd unknown /proc/30581/task/41539/root (readlink: Permission denied) 2024-09-10T23:29:27.798 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41539 m-fin-pg_ ceph txt unknown /proc/30581/task/41539/exe (readlink: Permission denied) 2024-09-10T23:29:27.798 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41539 m-fin-pg_ ceph NOFD /proc/30581/task/41539/fd (opendir: Permission denied) 2024-09-10T23:29:27.798 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41540 progress ceph cwd unknown /proc/30581/task/41540/cwd (readlink: Permission denied) 2024-09-10T23:29:27.798 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41540 progress ceph rtd unknown /proc/30581/task/41540/root (readlink: Permission denied) 2024-09-10T23:29:27.798 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41540 progress ceph txt unknown /proc/30581/task/41540/exe (readlink: Permission denied) 2024-09-10T23:29:27.798 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41540 progress ceph NOFD /proc/30581/task/41540/fd (opendir: Permission denied) 2024-09-10T23:29:27.798 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41541 m-fin-pro ceph cwd unknown /proc/30581/task/41541/cwd (readlink: Permission denied) 2024-09-10T23:29:27.798 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41541 m-fin-pro ceph rtd unknown /proc/30581/task/41541/root (readlink: Permission denied) 2024-09-10T23:29:27.798 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41541 m-fin-pro ceph txt unknown /proc/30581/task/41541/exe (readlink: Permission denied) 2024-09-10T23:29:27.798 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41541 m-fin-pro ceph NOFD /proc/30581/task/41541/fd (opendir: Permission denied) 2024-09-10T23:29:27.798 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41542 cephadm ceph cwd unknown /proc/30581/task/41542/cwd (readlink: Permission denied) 2024-09-10T23:29:27.799 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41542 cephadm ceph rtd unknown /proc/30581/task/41542/root (readlink: Permission denied) 2024-09-10T23:29:27.799 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41542 cephadm ceph txt unknown /proc/30581/task/41542/exe (readlink: Permission denied) 2024-09-10T23:29:27.799 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41542 cephadm ceph NOFD /proc/30581/task/41542/fd (opendir: Permission denied) 2024-09-10T23:29:27.799 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41546 cephadm ceph cwd unknown /proc/30581/task/41546/cwd (readlink: Permission denied) 2024-09-10T23:29:27.799 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41546 cephadm ceph rtd unknown /proc/30581/task/41546/root (readlink: Permission denied) 2024-09-10T23:29:27.799 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41546 cephadm ceph txt unknown /proc/30581/task/41546/exe (readlink: Permission denied) 2024-09-10T23:29:27.799 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41546 cephadm ceph NOFD /proc/30581/task/41546/fd (opendir: Permission denied) 2024-09-10T23:29:27.799 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41547 io_contex ceph cwd unknown /proc/30581/task/41547/cwd (readlink: Permission denied) 2024-09-10T23:29:27.799 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41547 io_contex ceph rtd unknown /proc/30581/task/41547/root (readlink: Permission denied) 2024-09-10T23:29:27.799 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41547 io_contex ceph txt unknown /proc/30581/task/41547/exe (readlink: Permission denied) 2024-09-10T23:29:27.799 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41547 io_contex ceph NOFD /proc/30581/task/41547/fd (opendir: Permission denied) 2024-09-10T23:29:27.799 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41548 io_contex ceph cwd unknown /proc/30581/task/41548/cwd (readlink: Permission denied) 2024-09-10T23:29:27.799 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41548 io_contex ceph rtd unknown /proc/30581/task/41548/root (readlink: Permission denied) 2024-09-10T23:29:27.800 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41548 io_contex ceph txt unknown /proc/30581/task/41548/exe (readlink: Permission denied) 2024-09-10T23:29:27.800 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41548 io_contex ceph NOFD /proc/30581/task/41548/fd (opendir: Permission denied) 2024-09-10T23:29:27.800 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41549 ceph_time ceph cwd unknown /proc/30581/task/41549/cwd (readlink: Permission denied) 2024-09-10T23:29:27.800 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41549 ceph_time ceph rtd unknown /proc/30581/task/41549/root (readlink: Permission denied) 2024-09-10T23:29:27.800 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41549 ceph_time ceph txt unknown /proc/30581/task/41549/exe (readlink: Permission denied) 2024-09-10T23:29:27.800 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41549 ceph_time ceph NOFD /proc/30581/task/41549/fd (opendir: Permission denied) 2024-09-10T23:29:27.800 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41550 ms_dispat ceph cwd unknown /proc/30581/task/41550/cwd (readlink: Permission denied) 2024-09-10T23:29:27.800 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41550 ms_dispat ceph rtd unknown /proc/30581/task/41550/root (readlink: Permission denied) 2024-09-10T23:29:27.800 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41550 ms_dispat ceph txt unknown /proc/30581/task/41550/exe (readlink: Permission denied) 2024-09-10T23:29:27.800 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41550 ms_dispat ceph NOFD /proc/30581/task/41550/fd (opendir: Permission denied) 2024-09-10T23:29:27.800 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41551 ms_local ceph cwd unknown /proc/30581/task/41551/cwd (readlink: Permission denied) 2024-09-10T23:29:27.800 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41551 ms_local ceph rtd unknown /proc/30581/task/41551/root (readlink: Permission denied) 2024-09-10T23:29:27.801 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41551 ms_local ceph txt unknown /proc/30581/task/41551/exe (readlink: Permission denied) 2024-09-10T23:29:27.801 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41551 ms_local ceph NOFD /proc/30581/task/41551/fd (opendir: Permission denied) 2024-09-10T23:29:27.801 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41552 safe_time ceph cwd unknown /proc/30581/task/41552/cwd (readlink: Permission denied) 2024-09-10T23:29:27.801 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41552 safe_time ceph rtd unknown /proc/30581/task/41552/root (readlink: Permission denied) 2024-09-10T23:29:27.801 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41552 safe_time ceph txt unknown /proc/30581/task/41552/exe (readlink: Permission denied) 2024-09-10T23:29:27.801 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41552 safe_time ceph NOFD /proc/30581/task/41552/fd (opendir: Permission denied) 2024-09-10T23:29:27.801 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41553 cephadm ceph cwd unknown /proc/30581/task/41553/cwd (readlink: Permission denied) 2024-09-10T23:29:27.801 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41553 cephadm ceph rtd unknown /proc/30581/task/41553/root (readlink: Permission denied) 2024-09-10T23:29:27.801 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41553 cephadm ceph txt unknown /proc/30581/task/41553/exe (readlink: Permission denied) 2024-09-10T23:29:27.801 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41553 cephadm ceph NOFD /proc/30581/task/41553/fd (opendir: Permission denied) 2024-09-10T23:29:27.801 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41554 safe_time ceph cwd unknown /proc/30581/task/41554/cwd (readlink: Permission denied) 2024-09-10T23:29:27.801 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41554 safe_time ceph rtd unknown /proc/30581/task/41554/root (readlink: Permission denied) 2024-09-10T23:29:27.801 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41554 safe_time ceph txt unknown /proc/30581/task/41554/exe (readlink: Permission denied) 2024-09-10T23:29:27.802 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41554 safe_time ceph NOFD /proc/30581/task/41554/fd (opendir: Permission denied) 2024-09-10T23:29:27.802 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41555 mgr-fin ceph cwd unknown /proc/30581/task/41555/cwd (readlink: Permission denied) 2024-09-10T23:29:27.802 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41555 mgr-fin ceph rtd unknown /proc/30581/task/41555/root (readlink: Permission denied) 2024-09-10T23:29:27.802 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41555 mgr-fin ceph txt unknown /proc/30581/task/41555/exe (readlink: Permission denied) 2024-09-10T23:29:27.802 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41555 mgr-fin ceph NOFD /proc/30581/task/41555/fd (opendir: Permission denied) 2024-09-10T23:29:27.802 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41557 m-fin-rbd ceph cwd unknown /proc/30581/task/41557/cwd (readlink: Permission denied) 2024-09-10T23:29:27.802 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41557 m-fin-rbd ceph rtd unknown /proc/30581/task/41557/root (readlink: Permission denied) 2024-09-10T23:29:27.802 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41557 m-fin-rbd ceph txt unknown /proc/30581/task/41557/exe (readlink: Permission denied) 2024-09-10T23:29:27.802 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41557 m-fin-rbd ceph NOFD /proc/30581/task/41557/fd (opendir: Permission denied) 2024-09-10T23:29:27.802 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41558 restful ceph cwd unknown /proc/30581/task/41558/cwd (readlink: Permission denied) 2024-09-10T23:29:27.802 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41558 restful ceph rtd unknown /proc/30581/task/41558/root (readlink: Permission denied) 2024-09-10T23:29:27.803 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41558 restful ceph txt unknown /proc/30581/task/41558/exe (readlink: Permission denied) 2024-09-10T23:29:27.803 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41558 restful ceph NOFD /proc/30581/task/41558/fd (opendir: Permission denied) 2024-09-10T23:29:27.803 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41559 m-fin-res ceph cwd unknown /proc/30581/task/41559/cwd (readlink: Permission denied) 2024-09-10T23:29:27.803 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41559 m-fin-res ceph rtd unknown /proc/30581/task/41559/root (readlink: Permission denied) 2024-09-10T23:29:27.803 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41559 m-fin-res ceph txt unknown /proc/30581/task/41559/exe (readlink: Permission denied) 2024-09-10T23:29:27.803 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41559 m-fin-res ceph NOFD /proc/30581/task/41559/fd (opendir: Permission denied) 2024-09-10T23:29:27.803 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41560 mgr-fin ceph cwd unknown /proc/30581/task/41560/cwd (readlink: Permission denied) 2024-09-10T23:29:27.803 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41560 mgr-fin ceph rtd unknown /proc/30581/task/41560/root (readlink: Permission denied) 2024-09-10T23:29:27.803 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41560 mgr-fin ceph txt unknown /proc/30581/task/41560/exe (readlink: Permission denied) 2024-09-10T23:29:27.803 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41560 mgr-fin ceph NOFD /proc/30581/task/41560/fd (opendir: Permission denied) 2024-09-10T23:29:27.804 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41561 mgr-fin ceph cwd unknown /proc/30581/task/41561/cwd (readlink: Permission denied) 2024-09-10T23:29:27.804 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41561 mgr-fin ceph rtd unknown /proc/30581/task/41561/root (readlink: Permission denied) 2024-09-10T23:29:27.804 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41561 mgr-fin ceph txt unknown /proc/30581/task/41561/exe (readlink: Permission denied) 2024-09-10T23:29:27.804 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41561 mgr-fin ceph NOFD /proc/30581/task/41561/fd (opendir: Permission denied) 2024-09-10T23:29:27.804 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41563 mgr-fin ceph cwd unknown /proc/30581/task/41563/cwd (readlink: Permission denied) 2024-09-10T23:29:27.804 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41563 mgr-fin ceph rtd unknown /proc/30581/task/41563/root (readlink: Permission denied) 2024-09-10T23:29:27.804 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41563 mgr-fin ceph txt unknown /proc/30581/task/41563/exe (readlink: Permission denied) 2024-09-10T23:29:27.804 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41563 mgr-fin ceph NOFD /proc/30581/task/41563/fd (opendir: Permission denied) 2024-09-10T23:29:27.804 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41564 m-fin-sna ceph cwd unknown /proc/30581/task/41564/cwd (readlink: Permission denied) 2024-09-10T23:29:27.804 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41564 m-fin-sna ceph rtd unknown /proc/30581/task/41564/root (readlink: Permission denied) 2024-09-10T23:29:27.804 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41564 m-fin-sna ceph txt unknown /proc/30581/task/41564/exe (readlink: Permission denied) 2024-09-10T23:29:27.804 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41564 m-fin-sna ceph NOFD /proc/30581/task/41564/fd (opendir: Permission denied) 2024-09-10T23:29:27.805 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41566 m-fin-sta ceph cwd unknown /proc/30581/task/41566/cwd (readlink: Permission denied) 2024-09-10T23:29:27.805 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41566 m-fin-sta ceph rtd unknown /proc/30581/task/41566/root (readlink: Permission denied) 2024-09-10T23:29:27.805 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41566 m-fin-sta ceph txt unknown /proc/30581/task/41566/exe (readlink: Permission denied) 2024-09-10T23:29:27.805 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41566 m-fin-sta ceph NOFD /proc/30581/task/41566/fd (opendir: Permission denied) 2024-09-10T23:29:27.805 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41567 mgr-fin ceph cwd unknown /proc/30581/task/41567/cwd (readlink: Permission denied) 2024-09-10T23:29:27.805 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41567 mgr-fin ceph rtd unknown /proc/30581/task/41567/root (readlink: Permission denied) 2024-09-10T23:29:27.805 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41567 mgr-fin ceph txt unknown /proc/30581/task/41567/exe (readlink: Permission denied) 2024-09-10T23:29:27.805 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41567 mgr-fin ceph NOFD /proc/30581/task/41567/fd (opendir: Permission denied) 2024-09-10T23:29:27.805 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41568 telemetry ceph cwd unknown /proc/30581/task/41568/cwd (readlink: Permission denied) 2024-09-10T23:29:27.805 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41568 telemetry ceph rtd unknown /proc/30581/task/41568/root (readlink: Permission denied) 2024-09-10T23:29:27.805 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41568 telemetry ceph txt unknown /proc/30581/task/41568/exe (readlink: Permission denied) 2024-09-10T23:29:27.805 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41568 telemetry ceph NOFD /proc/30581/task/41568/fd (opendir: Permission denied) 2024-09-10T23:29:27.806 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41569 m-fin-tel ceph cwd unknown /proc/30581/task/41569/cwd (readlink: Permission denied) 2024-09-10T23:29:27.806 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41569 m-fin-tel ceph rtd unknown /proc/30581/task/41569/root (readlink: Permission denied) 2024-09-10T23:29:27.806 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41569 m-fin-tel ceph txt unknown /proc/30581/task/41569/exe (readlink: Permission denied) 2024-09-10T23:29:27.806 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41569 m-fin-tel ceph NOFD /proc/30581/task/41569/fd (opendir: Permission denied) 2024-09-10T23:29:27.806 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41570 mgr-fin ceph cwd unknown /proc/30581/task/41570/cwd (readlink: Permission denied) 2024-09-10T23:29:27.806 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41570 mgr-fin ceph rtd unknown /proc/30581/task/41570/root (readlink: Permission denied) 2024-09-10T23:29:27.806 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41570 mgr-fin ceph txt unknown /proc/30581/task/41570/exe (readlink: Permission denied) 2024-09-10T23:29:27.806 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41570 mgr-fin ceph NOFD /proc/30581/task/41570/fd (opendir: Permission denied) 2024-09-10T23:29:27.806 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41571 mgr-fin ceph cwd unknown /proc/30581/task/41571/cwd (readlink: Permission denied) 2024-09-10T23:29:27.806 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41571 mgr-fin ceph rtd unknown /proc/30581/task/41571/root (readlink: Permission denied) 2024-09-10T23:29:27.806 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41571 mgr-fin ceph txt unknown /proc/30581/task/41571/exe (readlink: Permission denied) 2024-09-10T23:29:27.806 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41571 mgr-fin ceph NOFD /proc/30581/task/41571/fd (opendir: Permission denied) 2024-09-10T23:29:27.806 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41575 io_contex ceph cwd unknown /proc/30581/task/41575/cwd (readlink: Permission denied) 2024-09-10T23:29:27.807 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41575 io_contex ceph rtd unknown /proc/30581/task/41575/root (readlink: Permission denied) 2024-09-10T23:29:27.807 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41575 io_contex ceph txt unknown /proc/30581/task/41575/exe (readlink: Permission denied) 2024-09-10T23:29:27.807 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41575 io_contex ceph NOFD /proc/30581/task/41575/fd (opendir: Permission denied) 2024-09-10T23:29:27.807 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41576 io_contex ceph cwd unknown /proc/30581/task/41576/cwd (readlink: Permission denied) 2024-09-10T23:29:27.807 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41576 io_contex ceph rtd unknown /proc/30581/task/41576/root (readlink: Permission denied) 2024-09-10T23:29:27.807 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41576 io_contex ceph txt unknown /proc/30581/task/41576/exe (readlink: Permission denied) 2024-09-10T23:29:27.807 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41576 io_contex ceph NOFD /proc/30581/task/41576/fd (opendir: Permission denied) 2024-09-10T23:29:27.807 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41577 ceph_time ceph cwd unknown /proc/30581/task/41577/cwd (readlink: Permission denied) 2024-09-10T23:29:27.807 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41577 ceph_time ceph rtd unknown /proc/30581/task/41577/root (readlink: Permission denied) 2024-09-10T23:29:27.807 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41577 ceph_time ceph txt unknown /proc/30581/task/41577/exe (readlink: Permission denied) 2024-09-10T23:29:27.807 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41577 ceph_time ceph NOFD /proc/30581/task/41577/fd (opendir: Permission denied) 2024-09-10T23:29:27.807 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41578 ms_dispat ceph cwd unknown /proc/30581/task/41578/cwd (readlink: Permission denied) 2024-09-10T23:29:27.807 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41578 ms_dispat ceph rtd unknown /proc/30581/task/41578/root (readlink: Permission denied) 2024-09-10T23:29:27.807 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41578 ms_dispat ceph txt unknown /proc/30581/task/41578/exe (readlink: Permission denied) 2024-09-10T23:29:27.808 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41578 ms_dispat ceph NOFD /proc/30581/task/41578/fd (opendir: Permission denied) 2024-09-10T23:29:27.808 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41579 ms_local ceph cwd unknown /proc/30581/task/41579/cwd (readlink: Permission denied) 2024-09-10T23:29:27.808 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41579 ms_local ceph rtd unknown /proc/30581/task/41579/root (readlink: Permission denied) 2024-09-10T23:29:27.808 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41579 ms_local ceph txt unknown /proc/30581/task/41579/exe (readlink: Permission denied) 2024-09-10T23:29:27.808 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41579 ms_local ceph NOFD /proc/30581/task/41579/fd (opendir: Permission denied) 2024-09-10T23:29:27.808 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41580 safe_time ceph cwd unknown /proc/30581/task/41580/cwd (readlink: Permission denied) 2024-09-10T23:29:27.808 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41580 safe_time ceph rtd unknown /proc/30581/task/41580/root (readlink: Permission denied) 2024-09-10T23:29:27.808 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41580 safe_time ceph txt unknown /proc/30581/task/41580/exe (readlink: Permission denied) 2024-09-10T23:29:27.808 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41580 safe_time ceph NOFD /proc/30581/task/41580/fd (opendir: Permission denied) 2024-09-10T23:29:27.808 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41581 safe_time ceph cwd unknown /proc/30581/task/41581/cwd (readlink: Permission denied) 2024-09-10T23:29:27.808 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41581 safe_time ceph rtd unknown /proc/30581/task/41581/root (readlink: Permission denied) 2024-09-10T23:29:27.808 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41581 safe_time ceph txt unknown /proc/30581/task/41581/exe (readlink: Permission denied) 2024-09-10T23:29:27.808 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41581 safe_time ceph NOFD /proc/30581/task/41581/fd (opendir: Permission denied) 2024-09-10T23:29:27.809 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41582 mgr-fin ceph cwd unknown /proc/30581/task/41582/cwd (readlink: Permission denied) 2024-09-10T23:29:27.809 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41582 mgr-fin ceph rtd unknown /proc/30581/task/41582/root (readlink: Permission denied) 2024-09-10T23:29:27.809 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41582 mgr-fin ceph txt unknown /proc/30581/task/41582/exe (readlink: Permission denied) 2024-09-10T23:29:27.809 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41582 mgr-fin ceph NOFD /proc/30581/task/41582/fd (opendir: Permission denied) 2024-09-10T23:29:27.809 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41583 mgr-fin ceph cwd unknown /proc/30581/task/41583/cwd (readlink: Permission denied) 2024-09-10T23:29:27.809 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41583 mgr-fin ceph rtd unknown /proc/30581/task/41583/root (readlink: Permission denied) 2024-09-10T23:29:27.809 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41583 mgr-fin ceph txt unknown /proc/30581/task/41583/exe (readlink: Permission denied) 2024-09-10T23:29:27.809 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41583 mgr-fin ceph NOFD /proc/30581/task/41583/fd (opendir: Permission denied) 2024-09-10T23:29:27.809 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41584 mgr-fin ceph cwd unknown /proc/30581/task/41584/cwd (readlink: Permission denied) 2024-09-10T23:29:27.809 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41584 mgr-fin ceph rtd unknown /proc/30581/task/41584/root (readlink: Permission denied) 2024-09-10T23:29:27.809 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41584 mgr-fin ceph txt unknown /proc/30581/task/41584/exe (readlink: Permission denied) 2024-09-10T23:29:27.809 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41584 mgr-fin ceph NOFD /proc/30581/task/41584/fd (opendir: Permission denied) 2024-09-10T23:29:27.809 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41585 mgr-fin ceph cwd unknown /proc/30581/task/41585/cwd (readlink: Permission denied) 2024-09-10T23:29:27.810 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41585 mgr-fin ceph rtd unknown /proc/30581/task/41585/root (readlink: Permission denied) 2024-09-10T23:29:27.810 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41585 mgr-fin ceph txt unknown /proc/30581/task/41585/exe (readlink: Permission denied) 2024-09-10T23:29:27.810 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41585 mgr-fin ceph NOFD /proc/30581/task/41585/fd (opendir: Permission denied) 2024-09-10T23:29:27.810 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41586 mgr-fin ceph cwd unknown /proc/30581/task/41586/cwd (readlink: Permission denied) 2024-09-10T23:29:27.810 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41586 mgr-fin ceph rtd unknown /proc/30581/task/41586/root (readlink: Permission denied) 2024-09-10T23:29:27.810 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41586 mgr-fin ceph txt unknown /proc/30581/task/41586/exe (readlink: Permission denied) 2024-09-10T23:29:27.810 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41586 mgr-fin ceph NOFD /proc/30581/task/41586/fd (opendir: Permission denied) 2024-09-10T23:29:27.810 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41587 mgr-fin ceph cwd unknown /proc/30581/task/41587/cwd (readlink: Permission denied) 2024-09-10T23:29:27.811 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41587 mgr-fin ceph rtd unknown /proc/30581/task/41587/root (readlink: Permission denied) 2024-09-10T23:29:27.811 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41587 mgr-fin ceph txt unknown /proc/30581/task/41587/exe (readlink: Permission denied) 2024-09-10T23:29:27.811 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41587 mgr-fin ceph NOFD /proc/30581/task/41587/fd (opendir: Permission denied) 2024-09-10T23:29:27.811 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41588 mgr-fin ceph cwd unknown /proc/30581/task/41588/cwd (readlink: Permission denied) 2024-09-10T23:29:27.811 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41588 mgr-fin ceph rtd unknown /proc/30581/task/41588/root (readlink: Permission denied) 2024-09-10T23:29:27.811 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41588 mgr-fin ceph txt unknown /proc/30581/task/41588/exe (readlink: Permission denied) 2024-09-10T23:29:27.811 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41588 mgr-fin ceph NOFD /proc/30581/task/41588/fd (opendir: Permission denied) 2024-09-10T23:29:27.811 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41589 mgr-fin ceph cwd unknown /proc/30581/task/41589/cwd (readlink: Permission denied) 2024-09-10T23:29:27.811 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41589 mgr-fin ceph rtd unknown /proc/30581/task/41589/root (readlink: Permission denied) 2024-09-10T23:29:27.811 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41589 mgr-fin ceph txt unknown /proc/30581/task/41589/exe (readlink: Permission denied) 2024-09-10T23:29:27.811 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41589 mgr-fin ceph NOFD /proc/30581/task/41589/fd (opendir: Permission denied) 2024-09-10T23:29:27.811 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41590 mgr-fin ceph cwd unknown /proc/30581/task/41590/cwd (readlink: Permission denied) 2024-09-10T23:29:27.811 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41590 mgr-fin ceph rtd unknown /proc/30581/task/41590/root (readlink: Permission denied) 2024-09-10T23:29:27.812 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41590 mgr-fin ceph txt unknown /proc/30581/task/41590/exe (readlink: Permission denied) 2024-09-10T23:29:27.812 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41590 mgr-fin ceph NOFD /proc/30581/task/41590/fd (opendir: Permission denied) 2024-09-10T23:29:27.812 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41591 mgr-fin ceph cwd unknown /proc/30581/task/41591/cwd (readlink: Permission denied) 2024-09-10T23:29:27.812 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41591 mgr-fin ceph rtd unknown /proc/30581/task/41591/root (readlink: Permission denied) 2024-09-10T23:29:27.812 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41591 mgr-fin ceph txt unknown /proc/30581/task/41591/exe (readlink: Permission denied) 2024-09-10T23:29:27.812 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41591 mgr-fin ceph NOFD /proc/30581/task/41591/fd (opendir: Permission denied) 2024-09-10T23:29:27.812 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41592 mgr-fin ceph cwd unknown /proc/30581/task/41592/cwd (readlink: Permission denied) 2024-09-10T23:29:27.812 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41592 mgr-fin ceph rtd unknown /proc/30581/task/41592/root (readlink: Permission denied) 2024-09-10T23:29:27.812 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41592 mgr-fin ceph txt unknown /proc/30581/task/41592/exe (readlink: Permission denied) 2024-09-10T23:29:27.812 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41592 mgr-fin ceph NOFD /proc/30581/task/41592/fd (opendir: Permission denied) 2024-09-10T23:29:27.812 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41593 mgr-fin ceph cwd unknown /proc/30581/task/41593/cwd (readlink: Permission denied) 2024-09-10T23:29:27.812 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41593 mgr-fin ceph rtd unknown /proc/30581/task/41593/root (readlink: Permission denied) 2024-09-10T23:29:27.812 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41593 mgr-fin ceph txt unknown /proc/30581/task/41593/exe (readlink: Permission denied) 2024-09-10T23:29:27.813 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41593 mgr-fin ceph NOFD /proc/30581/task/41593/fd (opendir: Permission denied) 2024-09-10T23:29:27.813 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41595 m-fin-vol ceph cwd unknown /proc/30581/task/41595/cwd (readlink: Permission denied) 2024-09-10T23:29:27.813 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41595 m-fin-vol ceph rtd unknown /proc/30581/task/41595/root (readlink: Permission denied) 2024-09-10T23:29:27.813 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41595 m-fin-vol ceph txt unknown /proc/30581/task/41595/exe (readlink: Permission denied) 2024-09-10T23:29:27.813 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41595 m-fin-vol ceph NOFD /proc/30581/task/41595/fd (opendir: Permission denied) 2024-09-10T23:29:27.813 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41667 dashboard ceph cwd unknown /proc/30581/task/41667/cwd (readlink: Permission denied) 2024-09-10T23:29:27.813 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41667 dashboard ceph rtd unknown /proc/30581/task/41667/root (readlink: Permission denied) 2024-09-10T23:29:27.813 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41667 dashboard ceph txt unknown /proc/30581/task/41667/exe (readlink: Permission denied) 2024-09-10T23:29:27.813 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41667 dashboard ceph NOFD /proc/30581/task/41667/fd (opendir: Permission denied) 2024-09-10T23:29:27.813 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41668 dashboard ceph cwd unknown /proc/30581/task/41668/cwd (readlink: Permission denied) 2024-09-10T23:29:27.813 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41668 dashboard ceph rtd unknown /proc/30581/task/41668/root (readlink: Permission denied) 2024-09-10T23:29:27.813 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41668 dashboard ceph txt unknown /proc/30581/task/41668/exe (readlink: Permission denied) 2024-09-10T23:29:27.813 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41668 dashboard ceph NOFD /proc/30581/task/41668/fd (opendir: Permission denied) 2024-09-10T23:29:27.814 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41669 dashboard ceph cwd unknown /proc/30581/task/41669/cwd (readlink: Permission denied) 2024-09-10T23:29:27.814 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41669 dashboard ceph rtd unknown /proc/30581/task/41669/root (readlink: Permission denied) 2024-09-10T23:29:27.814 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41669 dashboard ceph txt unknown /proc/30581/task/41669/exe (readlink: Permission denied) 2024-09-10T23:29:27.814 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41669 dashboard ceph NOFD /proc/30581/task/41669/fd (opendir: Permission denied) 2024-09-10T23:29:27.814 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41670 dashboard ceph cwd unknown /proc/30581/task/41670/cwd (readlink: Permission denied) 2024-09-10T23:29:27.814 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41670 dashboard ceph rtd unknown /proc/30581/task/41670/root (readlink: Permission denied) 2024-09-10T23:29:27.814 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41670 dashboard ceph txt unknown /proc/30581/task/41670/exe (readlink: Permission denied) 2024-09-10T23:29:27.814 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41670 dashboard ceph NOFD /proc/30581/task/41670/fd (opendir: Permission denied) 2024-09-10T23:29:27.814 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41671 dashboard ceph cwd unknown /proc/30581/task/41671/cwd (readlink: Permission denied) 2024-09-10T23:29:27.814 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41671 dashboard ceph rtd unknown /proc/30581/task/41671/root (readlink: Permission denied) 2024-09-10T23:29:27.814 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41671 dashboard ceph txt unknown /proc/30581/task/41671/exe (readlink: Permission denied) 2024-09-10T23:29:27.814 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41671 dashboard ceph NOFD /proc/30581/task/41671/fd (opendir: Permission denied) 2024-09-10T23:29:27.814 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41672 dashboard ceph cwd unknown /proc/30581/task/41672/cwd (readlink: Permission denied) 2024-09-10T23:29:27.814 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41672 dashboard ceph rtd unknown /proc/30581/task/41672/root (readlink: Permission denied) 2024-09-10T23:29:27.814 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41672 dashboard ceph txt unknown /proc/30581/task/41672/exe (readlink: Permission denied) 2024-09-10T23:29:27.815 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41672 dashboard ceph NOFD /proc/30581/task/41672/fd (opendir: Permission denied) 2024-09-10T23:29:27.815 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41673 dashboard ceph cwd unknown /proc/30581/task/41673/cwd (readlink: Permission denied) 2024-09-10T23:29:27.815 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41673 dashboard ceph rtd unknown /proc/30581/task/41673/root (readlink: Permission denied) 2024-09-10T23:29:27.815 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41673 dashboard ceph txt unknown /proc/30581/task/41673/exe (readlink: Permission denied) 2024-09-10T23:29:27.815 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41673 dashboard ceph NOFD /proc/30581/task/41673/fd (opendir: Permission denied) 2024-09-10T23:29:27.815 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41674 dashboard ceph cwd unknown /proc/30581/task/41674/cwd (readlink: Permission denied) 2024-09-10T23:29:27.815 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41674 dashboard ceph rtd unknown /proc/30581/task/41674/root (readlink: Permission denied) 2024-09-10T23:29:27.815 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41674 dashboard ceph txt unknown /proc/30581/task/41674/exe (readlink: Permission denied) 2024-09-10T23:29:27.815 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41674 dashboard ceph NOFD /proc/30581/task/41674/fd (opendir: Permission denied) 2024-09-10T23:29:27.815 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41675 dashboard ceph cwd unknown /proc/30581/task/41675/cwd (readlink: Permission denied) 2024-09-10T23:29:27.815 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41675 dashboard ceph rtd unknown /proc/30581/task/41675/root (readlink: Permission denied) 2024-09-10T23:29:27.815 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41675 dashboard ceph txt unknown /proc/30581/task/41675/exe (readlink: Permission denied) 2024-09-10T23:29:27.816 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41675 dashboard ceph NOFD /proc/30581/task/41675/fd (opendir: Permission denied) 2024-09-10T23:29:27.816 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41676 dashboard ceph cwd unknown /proc/30581/task/41676/cwd (readlink: Permission denied) 2024-09-10T23:29:27.816 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41676 dashboard ceph rtd unknown /proc/30581/task/41676/root (readlink: Permission denied) 2024-09-10T23:29:27.816 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41676 dashboard ceph txt unknown /proc/30581/task/41676/exe (readlink: Permission denied) 2024-09-10T23:29:27.816 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41676 dashboard ceph NOFD /proc/30581/task/41676/fd (opendir: Permission denied) 2024-09-10T23:29:27.816 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41677 dashboard ceph cwd unknown /proc/30581/task/41677/cwd (readlink: Permission denied) 2024-09-10T23:29:27.816 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41677 dashboard ceph rtd unknown /proc/30581/task/41677/root (readlink: Permission denied) 2024-09-10T23:29:27.816 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41677 dashboard ceph txt unknown /proc/30581/task/41677/exe (readlink: Permission denied) 2024-09-10T23:29:27.816 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41677 dashboard ceph NOFD /proc/30581/task/41677/fd (opendir: Permission denied) 2024-09-10T23:29:27.816 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41703 dashboard ceph cwd unknown /proc/30581/task/41703/cwd (readlink: Permission denied) 2024-09-10T23:29:27.816 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41703 dashboard ceph rtd unknown /proc/30581/task/41703/root (readlink: Permission denied) 2024-09-10T23:29:27.816 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41703 dashboard ceph txt unknown /proc/30581/task/41703/exe (readlink: Permission denied) 2024-09-10T23:29:27.817 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41703 dashboard ceph NOFD /proc/30581/task/41703/fd (opendir: Permission denied) 2024-09-10T23:29:27.817 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41804 mgr-fin ceph cwd unknown /proc/30581/task/41804/cwd (readlink: Permission denied) 2024-09-10T23:29:27.817 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41804 mgr-fin ceph rtd unknown /proc/30581/task/41804/root (readlink: Permission denied) 2024-09-10T23:29:27.817 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41804 mgr-fin ceph txt unknown /proc/30581/task/41804/exe (readlink: Permission denied) 2024-09-10T23:29:27.817 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41804 mgr-fin ceph NOFD /proc/30581/task/41804/fd (opendir: Permission denied) 2024-09-10T23:29:27.817 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41806 mgr-fin ceph cwd unknown /proc/30581/task/41806/cwd (readlink: Permission denied) 2024-09-10T23:29:27.817 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41806 mgr-fin ceph rtd unknown /proc/30581/task/41806/root (readlink: Permission denied) 2024-09-10T23:29:27.817 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41806 mgr-fin ceph txt unknown /proc/30581/task/41806/exe (readlink: Permission denied) 2024-09-10T23:29:27.817 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41806 mgr-fin ceph NOFD /proc/30581/task/41806/fd (opendir: Permission denied) 2024-09-10T23:29:27.817 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41807 mgr-fin ceph cwd unknown /proc/30581/task/41807/cwd (readlink: Permission denied) 2024-09-10T23:29:27.817 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41807 mgr-fin ceph rtd unknown /proc/30581/task/41807/root (readlink: Permission denied) 2024-09-10T23:29:27.817 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41807 mgr-fin ceph txt unknown /proc/30581/task/41807/exe (readlink: Permission denied) 2024-09-10T23:29:27.818 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41807 mgr-fin ceph NOFD /proc/30581/task/41807/fd (opendir: Permission denied) 2024-09-10T23:29:27.818 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41808 mgr-fin ceph cwd unknown /proc/30581/task/41808/cwd (readlink: Permission denied) 2024-09-10T23:29:27.818 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41808 mgr-fin ceph rtd unknown /proc/30581/task/41808/root (readlink: Permission denied) 2024-09-10T23:29:27.818 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41808 mgr-fin ceph txt unknown /proc/30581/task/41808/exe (readlink: Permission denied) 2024-09-10T23:29:27.818 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41808 mgr-fin ceph NOFD /proc/30581/task/41808/fd (opendir: Permission denied) 2024-09-10T23:29:27.818 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41809 mgr-fin ceph cwd unknown /proc/30581/task/41809/cwd (readlink: Permission denied) 2024-09-10T23:29:27.818 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41809 mgr-fin ceph rtd unknown /proc/30581/task/41809/root (readlink: Permission denied) 2024-09-10T23:29:27.818 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41809 mgr-fin ceph txt unknown /proc/30581/task/41809/exe (readlink: Permission denied) 2024-09-10T23:29:27.818 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41809 mgr-fin ceph NOFD /proc/30581/task/41809/fd (opendir: Permission denied) 2024-09-10T23:29:27.818 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41810 mgr-fin ceph cwd unknown /proc/30581/task/41810/cwd (readlink: Permission denied) 2024-09-10T23:29:27.818 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41810 mgr-fin ceph rtd unknown /proc/30581/task/41810/root (readlink: Permission denied) 2024-09-10T23:29:27.818 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41810 mgr-fin ceph txt unknown /proc/30581/task/41810/exe (readlink: Permission denied) 2024-09-10T23:29:27.818 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41810 mgr-fin ceph NOFD /proc/30581/task/41810/fd (opendir: Permission denied) 2024-09-10T23:29:27.818 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41811 mgr-fin ceph cwd unknown /proc/30581/task/41811/cwd (readlink: Permission denied) 2024-09-10T23:29:27.818 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41811 mgr-fin ceph rtd unknown /proc/30581/task/41811/root (readlink: Permission denied) 2024-09-10T23:29:27.818 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41811 mgr-fin ceph txt unknown /proc/30581/task/41811/exe (readlink: Permission denied) 2024-09-10T23:29:27.819 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41811 mgr-fin ceph NOFD /proc/30581/task/41811/fd (opendir: Permission denied) 2024-09-10T23:29:27.819 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41812 mgr-fin ceph cwd unknown /proc/30581/task/41812/cwd (readlink: Permission denied) 2024-09-10T23:29:27.819 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41812 mgr-fin ceph rtd unknown /proc/30581/task/41812/root (readlink: Permission denied) 2024-09-10T23:29:27.819 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41812 mgr-fin ceph txt unknown /proc/30581/task/41812/exe (readlink: Permission denied) 2024-09-10T23:29:27.819 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41812 mgr-fin ceph NOFD /proc/30581/task/41812/fd (opendir: Permission denied) 2024-09-10T23:29:27.819 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41813 mgr-fin ceph cwd unknown /proc/30581/task/41813/cwd (readlink: Permission denied) 2024-09-10T23:29:27.819 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41813 mgr-fin ceph rtd unknown /proc/30581/task/41813/root (readlink: Permission denied) 2024-09-10T23:29:27.819 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41813 mgr-fin ceph txt unknown /proc/30581/task/41813/exe (readlink: Permission denied) 2024-09-10T23:29:27.819 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41813 mgr-fin ceph NOFD /proc/30581/task/41813/fd (opendir: Permission denied) 2024-09-10T23:29:27.819 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41814 mgr-fin ceph cwd unknown /proc/30581/task/41814/cwd (readlink: Permission denied) 2024-09-10T23:29:27.819 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41814 mgr-fin ceph rtd unknown /proc/30581/task/41814/root (readlink: Permission denied) 2024-09-10T23:29:27.819 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41814 mgr-fin ceph txt unknown /proc/30581/task/41814/exe (readlink: Permission denied) 2024-09-10T23:29:27.819 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41814 mgr-fin ceph NOFD /proc/30581/task/41814/fd (opendir: Permission denied) 2024-09-10T23:29:27.820 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41815 mgr-fin ceph cwd unknown /proc/30581/task/41815/cwd (readlink: Permission denied) 2024-09-10T23:29:27.820 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41815 mgr-fin ceph rtd unknown /proc/30581/task/41815/root (readlink: Permission denied) 2024-09-10T23:29:27.820 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41815 mgr-fin ceph txt unknown /proc/30581/task/41815/exe (readlink: Permission denied) 2024-09-10T23:29:27.820 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41815 mgr-fin ceph NOFD /proc/30581/task/41815/fd (opendir: Permission denied) 2024-09-10T23:29:27.820 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41874 mgr-fin ceph cwd unknown /proc/30581/task/41874/cwd (readlink: Permission denied) 2024-09-10T23:29:27.820 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41874 mgr-fin ceph rtd unknown /proc/30581/task/41874/root (readlink: Permission denied) 2024-09-10T23:29:27.820 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41874 mgr-fin ceph txt unknown /proc/30581/task/41874/exe (readlink: Permission denied) 2024-09-10T23:29:27.820 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41874 mgr-fin ceph NOFD /proc/30581/task/41874/fd (opendir: Permission denied) 2024-09-10T23:29:27.820 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41875 mgr-fin ceph cwd unknown /proc/30581/task/41875/cwd (readlink: Permission denied) 2024-09-10T23:29:27.820 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41875 mgr-fin ceph rtd unknown /proc/30581/task/41875/root (readlink: Permission denied) 2024-09-10T23:29:27.820 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41875 mgr-fin ceph txt unknown /proc/30581/task/41875/exe (readlink: Permission denied) 2024-09-10T23:29:27.820 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41875 mgr-fin ceph NOFD /proc/30581/task/41875/fd (opendir: Permission denied) 2024-09-10T23:29:27.821 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41877 mgr-fin ceph cwd unknown /proc/30581/task/41877/cwd (readlink: Permission denied) 2024-09-10T23:29:27.821 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41877 mgr-fin ceph rtd unknown /proc/30581/task/41877/root (readlink: Permission denied) 2024-09-10T23:29:27.821 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41877 mgr-fin ceph txt unknown /proc/30581/task/41877/exe (readlink: Permission denied) 2024-09-10T23:29:27.821 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41877 mgr-fin ceph NOFD /proc/30581/task/41877/fd (opendir: Permission denied) 2024-09-10T23:29:27.821 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41879 mgr-fin ceph cwd unknown /proc/30581/task/41879/cwd (readlink: Permission denied) 2024-09-10T23:29:27.821 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41879 mgr-fin ceph rtd unknown /proc/30581/task/41879/root (readlink: Permission denied) 2024-09-10T23:29:27.821 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41879 mgr-fin ceph txt unknown /proc/30581/task/41879/exe (readlink: Permission denied) 2024-09-10T23:29:27.821 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41879 mgr-fin ceph NOFD /proc/30581/task/41879/fd (opendir: Permission denied) 2024-09-10T23:29:27.821 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41880 mgr-fin ceph cwd unknown /proc/30581/task/41880/cwd (readlink: Permission denied) 2024-09-10T23:29:27.821 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41880 mgr-fin ceph rtd unknown /proc/30581/task/41880/root (readlink: Permission denied) 2024-09-10T23:29:27.821 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41880 mgr-fin ceph txt unknown /proc/30581/task/41880/exe (readlink: Permission denied) 2024-09-10T23:29:27.821 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41880 mgr-fin ceph NOFD /proc/30581/task/41880/fd (opendir: Permission denied) 2024-09-10T23:29:27.822 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41881 mgr-fin ceph cwd unknown /proc/30581/task/41881/cwd (readlink: Permission denied) 2024-09-10T23:29:27.822 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41881 mgr-fin ceph rtd unknown /proc/30581/task/41881/root (readlink: Permission denied) 2024-09-10T23:29:27.822 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41881 mgr-fin ceph txt unknown /proc/30581/task/41881/exe (readlink: Permission denied) 2024-09-10T23:29:27.822 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41881 mgr-fin ceph NOFD /proc/30581/task/41881/fd (opendir: Permission denied) 2024-09-10T23:29:27.822 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41882 mgr-fin ceph cwd unknown /proc/30581/task/41882/cwd (readlink: Permission denied) 2024-09-10T23:29:27.822 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41882 mgr-fin ceph rtd unknown /proc/30581/task/41882/root (readlink: Permission denied) 2024-09-10T23:29:27.822 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41882 mgr-fin ceph txt unknown /proc/30581/task/41882/exe (readlink: Permission denied) 2024-09-10T23:29:27.822 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41882 mgr-fin ceph NOFD /proc/30581/task/41882/fd (opendir: Permission denied) 2024-09-10T23:29:27.822 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41884 mgr-fin ceph cwd unknown /proc/30581/task/41884/cwd (readlink: Permission denied) 2024-09-10T23:29:27.822 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41884 mgr-fin ceph rtd unknown /proc/30581/task/41884/root (readlink: Permission denied) 2024-09-10T23:29:27.822 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41884 mgr-fin ceph txt unknown /proc/30581/task/41884/exe (readlink: Permission denied) 2024-09-10T23:29:27.822 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41884 mgr-fin ceph NOFD /proc/30581/task/41884/fd (opendir: Permission denied) 2024-09-10T23:29:27.822 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41885 mgr-fin ceph cwd unknown /proc/30581/task/41885/cwd (readlink: Permission denied) 2024-09-10T23:29:27.823 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41885 mgr-fin ceph rtd unknown /proc/30581/task/41885/root (readlink: Permission denied) 2024-09-10T23:29:27.823 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41885 mgr-fin ceph txt unknown /proc/30581/task/41885/exe (readlink: Permission denied) 2024-09-10T23:29:27.823 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41885 mgr-fin ceph NOFD /proc/30581/task/41885/fd (opendir: Permission denied) 2024-09-10T23:29:27.823 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41886 mgr-fin ceph cwd unknown /proc/30581/task/41886/cwd (readlink: Permission denied) 2024-09-10T23:29:27.823 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41886 mgr-fin ceph rtd unknown /proc/30581/task/41886/root (readlink: Permission denied) 2024-09-10T23:29:27.823 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41886 mgr-fin ceph txt unknown /proc/30581/task/41886/exe (readlink: Permission denied) 2024-09-10T23:29:27.823 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41886 mgr-fin ceph NOFD /proc/30581/task/41886/fd (opendir: Permission denied) 2024-09-10T23:29:27.823 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41887 mgr-fin ceph cwd unknown /proc/30581/task/41887/cwd (readlink: Permission denied) 2024-09-10T23:29:27.823 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41887 mgr-fin ceph rtd unknown /proc/30581/task/41887/root (readlink: Permission denied) 2024-09-10T23:29:27.823 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41887 mgr-fin ceph txt unknown /proc/30581/task/41887/exe (readlink: Permission denied) 2024-09-10T23:29:27.823 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 41887 mgr-fin ceph NOFD /proc/30581/task/41887/fd (opendir: Permission denied) 2024-09-10T23:29:27.823 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 53402 devicehea ceph cwd unknown /proc/30581/task/53402/cwd (readlink: Permission denied) 2024-09-10T23:29:27.824 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 53402 devicehea ceph rtd unknown /proc/30581/task/53402/root (readlink: Permission denied) 2024-09-10T23:29:27.824 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 53402 devicehea ceph txt unknown /proc/30581/task/53402/exe (readlink: Permission denied) 2024-09-10T23:29:27.824 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 53402 devicehea ceph NOFD /proc/30581/task/53402/fd (opendir: Permission denied) 2024-09-10T23:29:27.824 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 53416 io_contex ceph cwd unknown /proc/30581/task/53416/cwd (readlink: Permission denied) 2024-09-10T23:29:27.824 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 53416 io_contex ceph rtd unknown /proc/30581/task/53416/root (readlink: Permission denied) 2024-09-10T23:29:27.824 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 53416 io_contex ceph txt unknown /proc/30581/task/53416/exe (readlink: Permission denied) 2024-09-10T23:29:27.824 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 53416 io_contex ceph NOFD /proc/30581/task/53416/fd (opendir: Permission denied) 2024-09-10T23:29:27.824 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 53417 io_contex ceph cwd unknown /proc/30581/task/53417/cwd (readlink: Permission denied) 2024-09-10T23:29:27.824 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 53417 io_contex ceph rtd unknown /proc/30581/task/53417/root (readlink: Permission denied) 2024-09-10T23:29:27.824 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 53417 io_contex ceph txt unknown /proc/30581/task/53417/exe (readlink: Permission denied) 2024-09-10T23:29:27.824 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 53417 io_contex ceph NOFD /proc/30581/task/53417/fd (opendir: Permission denied) 2024-09-10T23:29:27.824 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 53418 ceph_time ceph cwd unknown /proc/30581/task/53418/cwd (readlink: Permission denied) 2024-09-10T23:29:27.825 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 53418 ceph_time ceph rtd unknown /proc/30581/task/53418/root (readlink: Permission denied) 2024-09-10T23:29:27.825 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 53418 ceph_time ceph txt unknown /proc/30581/task/53418/exe (readlink: Permission denied) 2024-09-10T23:29:27.825 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 53418 ceph_time ceph NOFD /proc/30581/task/53418/fd (opendir: Permission denied) 2024-09-10T23:29:27.825 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 53419 ms_dispat ceph cwd unknown /proc/30581/task/53419/cwd (readlink: Permission denied) 2024-09-10T23:29:27.825 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 53419 ms_dispat ceph rtd unknown /proc/30581/task/53419/root (readlink: Permission denied) 2024-09-10T23:29:27.825 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 53419 ms_dispat ceph txt unknown /proc/30581/task/53419/exe (readlink: Permission denied) 2024-09-10T23:29:27.825 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 53419 ms_dispat ceph NOFD /proc/30581/task/53419/fd (opendir: Permission denied) 2024-09-10T23:29:27.825 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 53420 ms_local ceph cwd unknown /proc/30581/task/53420/cwd (readlink: Permission denied) 2024-09-10T23:29:27.825 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 53420 ms_local ceph rtd unknown /proc/30581/task/53420/root (readlink: Permission denied) 2024-09-10T23:29:27.825 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 53420 ms_local ceph txt unknown /proc/30581/task/53420/exe (readlink: Permission denied) 2024-09-10T23:29:27.825 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 53420 ms_local ceph NOFD /proc/30581/task/53420/fd (opendir: Permission denied) 2024-09-10T23:29:27.825 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 53421 safe_time ceph cwd unknown /proc/30581/task/53421/cwd (readlink: Permission denied) 2024-09-10T23:29:27.825 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 53421 safe_time ceph rtd unknown /proc/30581/task/53421/root (readlink: Permission denied) 2024-09-10T23:29:27.826 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 53421 safe_time ceph txt unknown /proc/30581/task/53421/exe (readlink: Permission denied) 2024-09-10T23:29:27.826 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 53421 safe_time ceph NOFD /proc/30581/task/53421/fd (opendir: Permission denied) 2024-09-10T23:29:27.826 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 53422 safe_time ceph cwd unknown /proc/30581/task/53422/cwd (readlink: Permission denied) 2024-09-10T23:29:27.826 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 53422 safe_time ceph rtd unknown /proc/30581/task/53422/root (readlink: Permission denied) 2024-09-10T23:29:27.826 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 53422 safe_time ceph txt unknown /proc/30581/task/53422/exe (readlink: Permission denied) 2024-09-10T23:29:27.826 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 53422 safe_time ceph NOFD /proc/30581/task/53422/fd (opendir: Permission denied) 2024-09-10T23:29:27.826 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89528 io_contex ceph cwd unknown /proc/30581/task/89528/cwd (readlink: Permission denied) 2024-09-10T23:29:27.826 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89528 io_contex ceph rtd unknown /proc/30581/task/89528/root (readlink: Permission denied) 2024-09-10T23:29:27.826 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89528 io_contex ceph txt unknown /proc/30581/task/89528/exe (readlink: Permission denied) 2024-09-10T23:29:27.826 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89528 io_contex ceph NOFD /proc/30581/task/89528/fd (opendir: Permission denied) 2024-09-10T23:29:27.826 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89529 io_contex ceph cwd unknown /proc/30581/task/89529/cwd (readlink: Permission denied) 2024-09-10T23:29:27.826 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89529 io_contex ceph rtd unknown /proc/30581/task/89529/root (readlink: Permission denied) 2024-09-10T23:29:27.826 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89529 io_contex ceph txt unknown /proc/30581/task/89529/exe (readlink: Permission denied) 2024-09-10T23:29:27.826 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89529 io_contex ceph NOFD /proc/30581/task/89529/fd (opendir: Permission denied) 2024-09-10T23:29:27.826 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89581 m-fin-sna ceph cwd unknown /proc/30581/task/89581/cwd (readlink: Permission denied) 2024-09-10T23:29:27.827 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89581 m-fin-sna ceph rtd unknown /proc/30581/task/89581/root (readlink: Permission denied) 2024-09-10T23:29:27.827 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89581 m-fin-sna ceph txt unknown /proc/30581/task/89581/exe (readlink: Permission denied) 2024-09-10T23:29:27.827 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89581 m-fin-sna ceph NOFD /proc/30581/task/89581/fd (opendir: Permission denied) 2024-09-10T23:29:27.827 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89585 io_contex ceph cwd unknown /proc/30581/task/89585/cwd (readlink: Permission denied) 2024-09-10T23:29:27.827 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89585 io_contex ceph rtd unknown /proc/30581/task/89585/root (readlink: Permission denied) 2024-09-10T23:29:27.827 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89585 io_contex ceph txt unknown /proc/30581/task/89585/exe (readlink: Permission denied) 2024-09-10T23:29:27.827 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89585 io_contex ceph NOFD /proc/30581/task/89585/fd (opendir: Permission denied) 2024-09-10T23:29:27.827 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89586 io_contex ceph cwd unknown /proc/30581/task/89586/cwd (readlink: Permission denied) 2024-09-10T23:29:27.827 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89586 io_contex ceph rtd unknown /proc/30581/task/89586/root (readlink: Permission denied) 2024-09-10T23:29:27.827 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89586 io_contex ceph txt unknown /proc/30581/task/89586/exe (readlink: Permission denied) 2024-09-10T23:29:27.827 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89586 io_contex ceph NOFD /proc/30581/task/89586/fd (opendir: Permission denied) 2024-09-10T23:29:27.827 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89587 ceph_time ceph cwd unknown /proc/30581/task/89587/cwd (readlink: Permission denied) 2024-09-10T23:29:27.827 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89587 ceph_time ceph rtd unknown /proc/30581/task/89587/root (readlink: Permission denied) 2024-09-10T23:29:27.828 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89587 ceph_time ceph txt unknown /proc/30581/task/89587/exe (readlink: Permission denied) 2024-09-10T23:29:27.828 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89587 ceph_time ceph NOFD /proc/30581/task/89587/fd (opendir: Permission denied) 2024-09-10T23:29:27.828 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89588 ms_dispat ceph cwd unknown /proc/30581/task/89588/cwd (readlink: Permission denied) 2024-09-10T23:29:27.828 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89588 ms_dispat ceph rtd unknown /proc/30581/task/89588/root (readlink: Permission denied) 2024-09-10T23:29:27.828 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89588 ms_dispat ceph txt unknown /proc/30581/task/89588/exe (readlink: Permission denied) 2024-09-10T23:29:27.828 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89588 ms_dispat ceph NOFD /proc/30581/task/89588/fd (opendir: Permission denied) 2024-09-10T23:29:27.828 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89589 ms_local ceph cwd unknown /proc/30581/task/89589/cwd (readlink: Permission denied) 2024-09-10T23:29:27.828 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89589 ms_local ceph rtd unknown /proc/30581/task/89589/root (readlink: Permission denied) 2024-09-10T23:29:27.828 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89589 ms_local ceph txt unknown /proc/30581/task/89589/exe (readlink: Permission denied) 2024-09-10T23:29:27.828 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89589 ms_local ceph NOFD /proc/30581/task/89589/fd (opendir: Permission denied) 2024-09-10T23:29:27.828 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89590 safe_time ceph cwd unknown /proc/30581/task/89590/cwd (readlink: Permission denied) 2024-09-10T23:29:27.828 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89590 safe_time ceph rtd unknown /proc/30581/task/89590/root (readlink: Permission denied) 2024-09-10T23:29:27.828 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89590 safe_time ceph txt unknown /proc/30581/task/89590/exe (readlink: Permission denied) 2024-09-10T23:29:27.829 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89590 safe_time ceph NOFD /proc/30581/task/89590/fd (opendir: Permission denied) 2024-09-10T23:29:27.829 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89591 safe_time ceph cwd unknown /proc/30581/task/89591/cwd (readlink: Permission denied) 2024-09-10T23:29:27.829 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89591 safe_time ceph rtd unknown /proc/30581/task/89591/root (readlink: Permission denied) 2024-09-10T23:29:27.829 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89591 safe_time ceph txt unknown /proc/30581/task/89591/exe (readlink: Permission denied) 2024-09-10T23:29:27.829 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 89591 safe_time ceph NOFD /proc/30581/task/89591/fd (opendir: Permission denied) 2024-09-10T23:29:27.829 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90689 ceph_time ceph cwd unknown /proc/30581/task/90689/cwd (readlink: Permission denied) 2024-09-10T23:29:27.829 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90689 ceph_time ceph rtd unknown /proc/30581/task/90689/root (readlink: Permission denied) 2024-09-10T23:29:27.829 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90689 ceph_time ceph txt unknown /proc/30581/task/90689/exe (readlink: Permission denied) 2024-09-10T23:29:27.829 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90689 ceph_time ceph NOFD /proc/30581/task/90689/fd (opendir: Permission denied) 2024-09-10T23:29:27.829 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90690 fn_anonym ceph cwd unknown /proc/30581/task/90690/cwd (readlink: Permission denied) 2024-09-10T23:29:27.829 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90690 fn_anonym ceph rtd unknown /proc/30581/task/90690/root (readlink: Permission denied) 2024-09-10T23:29:27.830 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90690 fn_anonym ceph txt unknown /proc/30581/task/90690/exe (readlink: Permission denied) 2024-09-10T23:29:27.830 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90690 fn_anonym ceph NOFD /proc/30581/task/90690/fd (opendir: Permission denied) 2024-09-10T23:29:27.830 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90691 safe_time ceph cwd unknown /proc/30581/task/90691/cwd (readlink: Permission denied) 2024-09-10T23:29:27.830 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90691 safe_time ceph rtd unknown /proc/30581/task/90691/root (readlink: Permission denied) 2024-09-10T23:29:27.830 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90691 safe_time ceph txt unknown /proc/30581/task/90691/exe (readlink: Permission denied) 2024-09-10T23:29:27.830 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90691 safe_time ceph NOFD /proc/30581/task/90691/fd (opendir: Permission denied) 2024-09-10T23:29:27.830 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90692 fn_anonym ceph cwd unknown /proc/30581/task/90692/cwd (readlink: Permission denied) 2024-09-10T23:29:27.830 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90692 fn_anonym ceph rtd unknown /proc/30581/task/90692/root (readlink: Permission denied) 2024-09-10T23:29:27.830 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90692 fn_anonym ceph txt unknown /proc/30581/task/90692/exe (readlink: Permission denied) 2024-09-10T23:29:27.830 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90692 fn_anonym ceph NOFD /proc/30581/task/90692/fd (opendir: Permission denied) 2024-09-10T23:29:27.830 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90693 flusher ceph cwd unknown /proc/30581/task/90693/cwd (readlink: Permission denied) 2024-09-10T23:29:27.830 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90693 flusher ceph rtd unknown /proc/30581/task/90693/root (readlink: Permission denied) 2024-09-10T23:29:27.830 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90693 flusher ceph txt unknown /proc/30581/task/90693/exe (readlink: Permission denied) 2024-09-10T23:29:27.830 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90693 flusher ceph NOFD /proc/30581/task/90693/fd (opendir: Permission denied) 2024-09-10T23:29:27.831 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90694 ms_dispat ceph cwd unknown /proc/30581/task/90694/cwd (readlink: Permission denied) 2024-09-10T23:29:27.831 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90694 ms_dispat ceph rtd unknown /proc/30581/task/90694/root (readlink: Permission denied) 2024-09-10T23:29:27.831 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90694 ms_dispat ceph txt unknown /proc/30581/task/90694/exe (readlink: Permission denied) 2024-09-10T23:29:27.831 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90694 ms_dispat ceph NOFD /proc/30581/task/90694/fd (opendir: Permission denied) 2024-09-10T23:29:27.831 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90695 ms_local ceph cwd unknown /proc/30581/task/90695/cwd (readlink: Permission denied) 2024-09-10T23:29:27.831 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90695 ms_local ceph rtd unknown /proc/30581/task/90695/root (readlink: Permission denied) 2024-09-10T23:29:27.831 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90695 ms_local ceph txt unknown /proc/30581/task/90695/exe (readlink: Permission denied) 2024-09-10T23:29:27.831 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90695 ms_local ceph NOFD /proc/30581/task/90695/fd (opendir: Permission denied) 2024-09-10T23:29:27.831 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90696 safe_time ceph cwd unknown /proc/30581/task/90696/cwd (readlink: Permission denied) 2024-09-10T23:29:27.831 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90696 safe_time ceph rtd unknown /proc/30581/task/90696/root (readlink: Permission denied) 2024-09-10T23:29:27.831 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90696 safe_time ceph txt unknown /proc/30581/task/90696/exe (readlink: Permission denied) 2024-09-10T23:29:27.831 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90696 safe_time ceph NOFD /proc/30581/task/90696/fd (opendir: Permission denied) 2024-09-10T23:29:27.832 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90697 m-fin-sna ceph cwd unknown /proc/30581/task/90697/cwd (readlink: Permission denied) 2024-09-10T23:29:27.832 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90697 m-fin-sna ceph rtd unknown /proc/30581/task/90697/root (readlink: Permission denied) 2024-09-10T23:29:27.832 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90697 m-fin-sna ceph txt unknown /proc/30581/task/90697/exe (readlink: Permission denied) 2024-09-10T23:29:27.832 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 90697 m-fin-sna ceph NOFD /proc/30581/task/90697/fd (opendir: Permission denied) 2024-09-10T23:29:27.832 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 92341 m-fin-sna ceph cwd unknown /proc/30581/task/92341/cwd (readlink: Permission denied) 2024-09-10T23:29:27.832 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 92341 m-fin-sna ceph rtd unknown /proc/30581/task/92341/root (readlink: Permission denied) 2024-09-10T23:29:27.832 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 92341 m-fin-sna ceph txt unknown /proc/30581/task/92341/exe (readlink: Permission denied) 2024-09-10T23:29:27.832 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mgr 30581 92341 m-fin-sna ceph NOFD /proc/30581/task/92341/fd (opendir: Permission denied) 2024-09-10T23:29:27.832 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 31538 root cwd unknown /proc/31538/cwd (readlink: Permission denied) 2024-09-10T23:29:27.832 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 31538 root rtd unknown /proc/31538/root (readlink: Permission denied) 2024-09-10T23:29:27.832 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 31538 root txt unknown /proc/31538/exe (readlink: Permission denied) 2024-09-10T23:29:27.832 INFO:tasks.workunit.client.0.smithi003.stdout:systemd 31538 root NOFD /proc/31538/fd (opendir: Permission denied) 2024-09-10T23:29:27.833 INFO:tasks.workunit.client.0.smithi003.stdout:(sd-pam) 31540 root cwd unknown /proc/31540/cwd (readlink: Permission denied) 2024-09-10T23:29:27.833 INFO:tasks.workunit.client.0.smithi003.stdout:(sd-pam) 31540 root rtd unknown /proc/31540/root (readlink: Permission denied) 2024-09-10T23:29:27.833 INFO:tasks.workunit.client.0.smithi003.stdout:(sd-pam) 31540 root txt unknown /proc/31540/exe (readlink: Permission denied) 2024-09-10T23:29:27.833 INFO:tasks.workunit.client.0.smithi003.stdout:(sd-pam) 31540 root NOFD /proc/31540/fd (opendir: Permission denied) 2024-09-10T23:29:27.833 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/0 40584 root cwd unknown /proc/40584/cwd (readlink: Permission denied) 2024-09-10T23:29:27.833 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/0 40584 root rtd unknown /proc/40584/root (readlink: Permission denied) 2024-09-10T23:29:27.833 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/0 40584 root txt unknown /proc/40584/exe (readlink: Permission denied) 2024-09-10T23:29:27.833 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/0 40584 root NOFD /proc/40584/fd (opendir: Permission denied) 2024-09-10T23:29:27.833 INFO:tasks.workunit.client.0.smithi003.stdout:sshd 41596 root cwd unknown /proc/41596/cwd (readlink: Permission denied) 2024-09-10T23:29:27.833 INFO:tasks.workunit.client.0.smithi003.stdout:sshd 41596 root rtd unknown /proc/41596/root (readlink: Permission denied) 2024-09-10T23:29:27.833 INFO:tasks.workunit.client.0.smithi003.stdout:sshd 41596 root txt unknown /proc/41596/exe (readlink: Permission denied) 2024-09-10T23:29:27.833 INFO:tasks.workunit.client.0.smithi003.stdout:sshd 41596 root NOFD /proc/41596/fd (opendir: Permission denied) 2024-09-10T23:29:27.833 INFO:tasks.workunit.client.0.smithi003.stdout:sshd 41599 root cwd unknown /proc/41599/cwd (readlink: Permission denied) 2024-09-10T23:29:27.834 INFO:tasks.workunit.client.0.smithi003.stdout:sshd 41599 root rtd unknown /proc/41599/root (readlink: Permission denied) 2024-09-10T23:29:27.834 INFO:tasks.workunit.client.0.smithi003.stdout:sshd 41599 root txt unknown /proc/41599/exe (readlink: Permission denied) 2024-09-10T23:29:27.834 INFO:tasks.workunit.client.0.smithi003.stdout:sshd 41599 root NOFD /proc/41599/fd (opendir: Permission denied) 2024-09-10T23:29:27.834 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/4 44667 root cwd unknown /proc/44667/cwd (readlink: Permission denied) 2024-09-10T23:29:27.834 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/4 44667 root rtd unknown /proc/44667/root (readlink: Permission denied) 2024-09-10T23:29:27.834 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/4 44667 root txt unknown /proc/44667/exe (readlink: Permission denied) 2024-09-10T23:29:27.834 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/4 44667 root NOFD /proc/44667/fd (opendir: Permission denied) 2024-09-10T23:29:27.834 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 48724 root cwd unknown /proc/48724/cwd (readlink: Permission denied) 2024-09-10T23:29:27.834 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 48724 root rtd unknown /proc/48724/root (readlink: Permission denied) 2024-09-10T23:29:27.834 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 48724 root txt unknown /proc/48724/exe (readlink: Permission denied) 2024-09-10T23:29:27.834 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 48724 root NOFD /proc/48724/fd (opendir: Permission denied) 2024-09-10T23:29:27.834 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 48726 root cwd unknown /proc/48726/cwd (readlink: Permission denied) 2024-09-10T23:29:27.834 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 48726 root rtd unknown /proc/48726/root (readlink: Permission denied) 2024-09-10T23:29:27.835 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 48726 root txt unknown /proc/48726/exe (readlink: Permission denied) 2024-09-10T23:29:27.835 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 48726 root NOFD /proc/48726/fd (opendir: Permission denied) 2024-09-10T23:29:27.835 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 ceph cwd unknown /proc/48728/cwd (readlink: Permission denied) 2024-09-10T23:29:27.835 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 ceph rtd unknown /proc/48728/root (readlink: Permission denied) 2024-09-10T23:29:27.835 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 ceph txt unknown /proc/48728/exe (readlink: Permission denied) 2024-09-10T23:29:27.835 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 ceph NOFD /proc/48728/fd (opendir: Permission denied) 2024-09-10T23:29:27.835 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 48729 log ceph cwd unknown /proc/48728/task/48729/cwd (readlink: Permission denied) 2024-09-10T23:29:27.835 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 48729 log ceph rtd unknown /proc/48728/task/48729/root (readlink: Permission denied) 2024-09-10T23:29:27.835 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 48729 log ceph txt unknown /proc/48728/task/48729/exe (readlink: Permission denied) 2024-09-10T23:29:27.835 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 48729 log ceph NOFD /proc/48728/task/48729/fd (opendir: Permission denied) 2024-09-10T23:29:27.835 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 48731 msgr-work ceph cwd unknown /proc/48728/task/48731/cwd (readlink: Permission denied) 2024-09-10T23:29:27.835 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 48731 msgr-work ceph rtd unknown /proc/48728/task/48731/root (readlink: Permission denied) 2024-09-10T23:29:27.835 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 48731 msgr-work ceph txt unknown /proc/48728/task/48731/exe (readlink: Permission denied) 2024-09-10T23:29:27.835 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 48731 msgr-work ceph NOFD /proc/48728/task/48731/fd (opendir: Permission denied) 2024-09-10T23:29:27.836 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 48732 msgr-work ceph cwd unknown /proc/48728/task/48732/cwd (readlink: Permission denied) 2024-09-10T23:29:27.836 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 48732 msgr-work ceph rtd unknown /proc/48728/task/48732/root (readlink: Permission denied) 2024-09-10T23:29:27.836 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 48732 msgr-work ceph txt unknown /proc/48728/task/48732/exe (readlink: Permission denied) 2024-09-10T23:29:27.836 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 48732 msgr-work ceph NOFD /proc/48728/task/48732/fd (opendir: Permission denied) 2024-09-10T23:29:27.836 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 48733 msgr-work ceph cwd unknown /proc/48728/task/48733/cwd (readlink: Permission denied) 2024-09-10T23:29:27.836 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 48733 msgr-work ceph rtd unknown /proc/48728/task/48733/root (readlink: Permission denied) 2024-09-10T23:29:27.836 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 48733 msgr-work ceph txt unknown /proc/48728/task/48733/exe (readlink: Permission denied) 2024-09-10T23:29:27.836 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 48733 msgr-work ceph NOFD /proc/48728/task/48733/fd (opendir: Permission denied) 2024-09-10T23:29:27.836 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 48737 service ceph cwd unknown /proc/48728/task/48737/cwd (readlink: Permission denied) 2024-09-10T23:29:27.836 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 48737 service ceph rtd unknown /proc/48728/task/48737/root (readlink: Permission denied) 2024-09-10T23:29:27.836 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 48737 service ceph txt unknown /proc/48728/task/48737/exe (readlink: Permission denied) 2024-09-10T23:29:27.836 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 48737 service ceph NOFD /proc/48728/task/48737/fd (opendir: Permission denied) 2024-09-10T23:29:27.837 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 48738 admin_soc ceph cwd unknown /proc/48728/task/48738/cwd (readlink: Permission denied) 2024-09-10T23:29:27.837 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 48738 admin_soc ceph rtd unknown /proc/48728/task/48738/root (readlink: Permission denied) 2024-09-10T23:29:27.837 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 48738 admin_soc ceph txt unknown /proc/48728/task/48738/exe (readlink: Permission denied) 2024-09-10T23:29:27.837 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 48738 admin_soc ceph NOFD /proc/48728/task/48738/fd (opendir: Permission denied) 2024-09-10T23:29:27.837 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49059 signal_ha ceph cwd unknown /proc/48728/task/49059/cwd (readlink: Permission denied) 2024-09-10T23:29:27.837 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49059 signal_ha ceph rtd unknown /proc/48728/task/49059/root (readlink: Permission denied) 2024-09-10T23:29:27.837 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49059 signal_ha ceph txt unknown /proc/48728/task/49059/exe (readlink: Permission denied) 2024-09-10T23:29:27.837 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49059 signal_ha ceph NOFD /proc/48728/task/49059/fd (opendir: Permission denied) 2024-09-10T23:29:27.837 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49060 io_contex ceph cwd unknown /proc/48728/task/49060/cwd (readlink: Permission denied) 2024-09-10T23:29:27.837 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49060 io_contex ceph rtd unknown /proc/48728/task/49060/root (readlink: Permission denied) 2024-09-10T23:29:27.838 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49060 io_contex ceph txt unknown /proc/48728/task/49060/exe (readlink: Permission denied) 2024-09-10T23:29:27.838 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49060 io_contex ceph NOFD /proc/48728/task/49060/fd (opendir: Permission denied) 2024-09-10T23:29:27.838 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49061 io_contex ceph cwd unknown /proc/48728/task/49061/cwd (readlink: Permission denied) 2024-09-10T23:29:27.838 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49061 io_contex ceph rtd unknown /proc/48728/task/49061/root (readlink: Permission denied) 2024-09-10T23:29:27.838 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49061 io_contex ceph txt unknown /proc/48728/task/49061/exe (readlink: Permission denied) 2024-09-10T23:29:27.838 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49061 io_contex ceph NOFD /proc/48728/task/49061/fd (opendir: Permission denied) 2024-09-10T23:29:27.838 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49069 OpHistory ceph cwd unknown /proc/48728/task/49069/cwd (readlink: Permission denied) 2024-09-10T23:29:27.838 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49069 OpHistory ceph rtd unknown /proc/48728/task/49069/root (readlink: Permission denied) 2024-09-10T23:29:27.838 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49069 OpHistory ceph txt unknown /proc/48728/task/49069/exe (readlink: Permission denied) 2024-09-10T23:29:27.838 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49069 OpHistory ceph NOFD /proc/48728/task/49069/fd (opendir: Permission denied) 2024-09-10T23:29:27.838 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49070 ceph_time ceph cwd unknown /proc/48728/task/49070/cwd (readlink: Permission denied) 2024-09-10T23:29:27.838 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49070 ceph_time ceph rtd unknown /proc/48728/task/49070/root (readlink: Permission denied) 2024-09-10T23:29:27.838 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49070 ceph_time ceph txt unknown /proc/48728/task/49070/exe (readlink: Permission denied) 2024-09-10T23:29:27.839 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49070 ceph_time ceph NOFD /proc/48728/task/49070/fd (opendir: Permission denied) 2024-09-10T23:29:27.839 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49091 ceph-osd ceph cwd unknown /proc/48728/task/49091/cwd (readlink: Permission denied) 2024-09-10T23:29:27.839 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49091 ceph-osd ceph rtd unknown /proc/48728/task/49091/root (readlink: Permission denied) 2024-09-10T23:29:27.839 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49091 ceph-osd ceph txt unknown /proc/48728/task/49091/exe (readlink: Permission denied) 2024-09-10T23:29:27.839 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49091 ceph-osd ceph NOFD /proc/48728/task/49091/fd (opendir: Permission denied) 2024-09-10T23:29:27.839 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49116 ceph-osd ceph cwd unknown /proc/48728/task/49116/cwd (readlink: Permission denied) 2024-09-10T23:29:27.839 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49116 ceph-osd ceph rtd unknown /proc/48728/task/49116/root (readlink: Permission denied) 2024-09-10T23:29:27.839 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49116 ceph-osd ceph txt unknown /proc/48728/task/49116/exe (readlink: Permission denied) 2024-09-10T23:29:27.839 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49116 ceph-osd ceph NOFD /proc/48728/task/49116/fd (opendir: Permission denied) 2024-09-10T23:29:27.839 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49143 ceph-osd ceph cwd unknown /proc/48728/task/49143/cwd (readlink: Permission denied) 2024-09-10T23:29:27.839 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49143 ceph-osd ceph rtd unknown /proc/48728/task/49143/root (readlink: Permission denied) 2024-09-10T23:29:27.839 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49143 ceph-osd ceph txt unknown /proc/48728/task/49143/exe (readlink: Permission denied) 2024-09-10T23:29:27.839 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49143 ceph-osd ceph NOFD /proc/48728/task/49143/fd (opendir: Permission denied) 2024-09-10T23:29:27.839 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49193 ceph-osd ceph cwd unknown /proc/48728/task/49193/cwd (readlink: Permission denied) 2024-09-10T23:29:27.839 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49193 ceph-osd ceph rtd unknown /proc/48728/task/49193/root (readlink: Permission denied) 2024-09-10T23:29:27.840 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49193 ceph-osd ceph txt unknown /proc/48728/task/49193/exe (readlink: Permission denied) 2024-09-10T23:29:27.840 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49193 ceph-osd ceph NOFD /proc/48728/task/49193/fd (opendir: Permission denied) 2024-09-10T23:29:27.840 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49205 ceph-osd ceph cwd unknown /proc/48728/task/49205/cwd (readlink: Permission denied) 2024-09-10T23:29:27.840 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49205 ceph-osd ceph rtd unknown /proc/48728/task/49205/root (readlink: Permission denied) 2024-09-10T23:29:27.840 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49205 ceph-osd ceph txt unknown /proc/48728/task/49205/exe (readlink: Permission denied) 2024-09-10T23:29:27.840 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49205 ceph-osd ceph NOFD /proc/48728/task/49205/fd (opendir: Permission denied) 2024-09-10T23:29:27.840 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49215 ceph-osd ceph cwd unknown /proc/48728/task/49215/cwd (readlink: Permission denied) 2024-09-10T23:29:27.840 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49215 ceph-osd ceph rtd unknown /proc/48728/task/49215/root (readlink: Permission denied) 2024-09-10T23:29:27.840 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49215 ceph-osd ceph txt unknown /proc/48728/task/49215/exe (readlink: Permission denied) 2024-09-10T23:29:27.840 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49215 ceph-osd ceph NOFD /proc/48728/task/49215/fd (opendir: Permission denied) 2024-09-10T23:29:27.840 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49221 ceph-osd ceph cwd unknown /proc/48728/task/49221/cwd (readlink: Permission denied) 2024-09-10T23:29:27.841 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49221 ceph-osd ceph rtd unknown /proc/48728/task/49221/root (readlink: Permission denied) 2024-09-10T23:29:27.841 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49221 ceph-osd ceph txt unknown /proc/48728/task/49221/exe (readlink: Permission denied) 2024-09-10T23:29:27.841 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49221 ceph-osd ceph NOFD /proc/48728/task/49221/fd (opendir: Permission denied) 2024-09-10T23:29:27.841 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49244 ceph-osd ceph cwd unknown /proc/48728/task/49244/cwd (readlink: Permission denied) 2024-09-10T23:29:27.841 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49244 ceph-osd ceph rtd unknown /proc/48728/task/49244/root (readlink: Permission denied) 2024-09-10T23:29:27.841 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49244 ceph-osd ceph txt unknown /proc/48728/task/49244/exe (readlink: Permission denied) 2024-09-10T23:29:27.841 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49244 ceph-osd ceph NOFD /proc/48728/task/49244/fd (opendir: Permission denied) 2024-09-10T23:29:27.841 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49245 ceph-osd ceph cwd unknown /proc/48728/task/49245/cwd (readlink: Permission denied) 2024-09-10T23:29:27.841 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49245 ceph-osd ceph rtd unknown /proc/48728/task/49245/root (readlink: Permission denied) 2024-09-10T23:29:27.841 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49245 ceph-osd ceph txt unknown /proc/48728/task/49245/exe (readlink: Permission denied) 2024-09-10T23:29:27.841 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49245 ceph-osd ceph NOFD /proc/48728/task/49245/fd (opendir: Permission denied) 2024-09-10T23:29:27.841 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49246 safe_time ceph cwd unknown /proc/48728/task/49246/cwd (readlink: Permission denied) 2024-09-10T23:29:27.841 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49246 safe_time ceph rtd unknown /proc/48728/task/49246/root (readlink: Permission denied) 2024-09-10T23:29:27.842 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49246 safe_time ceph txt unknown /proc/48728/task/49246/exe (readlink: Permission denied) 2024-09-10T23:29:27.842 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49246 safe_time ceph NOFD /proc/48728/task/49246/fd (opendir: Permission denied) 2024-09-10T23:29:27.842 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49247 safe_time ceph cwd unknown /proc/48728/task/49247/cwd (readlink: Permission denied) 2024-09-10T23:29:27.842 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49247 safe_time ceph rtd unknown /proc/48728/task/49247/root (readlink: Permission denied) 2024-09-10T23:29:27.842 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49247 safe_time ceph txt unknown /proc/48728/task/49247/exe (readlink: Permission denied) 2024-09-10T23:29:27.842 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49247 safe_time ceph NOFD /proc/48728/task/49247/fd (opendir: Permission denied) 2024-09-10T23:29:27.842 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49248 safe_time ceph cwd unknown /proc/48728/task/49248/cwd (readlink: Permission denied) 2024-09-10T23:29:27.842 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49248 safe_time ceph rtd unknown /proc/48728/task/49248/root (readlink: Permission denied) 2024-09-10T23:29:27.842 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49248 safe_time ceph txt unknown /proc/48728/task/49248/exe (readlink: Permission denied) 2024-09-10T23:29:27.842 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49248 safe_time ceph NOFD /proc/48728/task/49248/fd (opendir: Permission denied) 2024-09-10T23:29:27.842 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49249 safe_time ceph cwd unknown /proc/48728/task/49249/cwd (readlink: Permission denied) 2024-09-10T23:29:27.842 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49249 safe_time ceph rtd unknown /proc/48728/task/49249/root (readlink: Permission denied) 2024-09-10T23:29:27.842 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49249 safe_time ceph txt unknown /proc/48728/task/49249/exe (readlink: Permission denied) 2024-09-10T23:29:27.842 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49249 safe_time ceph NOFD /proc/48728/task/49249/fd (opendir: Permission denied) 2024-09-10T23:29:27.843 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49250 fn_anonym ceph cwd unknown /proc/48728/task/49250/cwd (readlink: Permission denied) 2024-09-10T23:29:27.843 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49250 fn_anonym ceph rtd unknown /proc/48728/task/49250/root (readlink: Permission denied) 2024-09-10T23:29:27.843 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49250 fn_anonym ceph txt unknown /proc/48728/task/49250/exe (readlink: Permission denied) 2024-09-10T23:29:27.843 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49250 fn_anonym ceph NOFD /proc/48728/task/49250/fd (opendir: Permission denied) 2024-09-10T23:29:27.843 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49288 rocksdb:l ceph cwd unknown /proc/48728/task/49288/cwd (readlink: Permission denied) 2024-09-10T23:29:27.843 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49288 rocksdb:l ceph rtd unknown /proc/48728/task/49288/root (readlink: Permission denied) 2024-09-10T23:29:27.843 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49288 rocksdb:l ceph txt unknown /proc/48728/task/49288/exe (readlink: Permission denied) 2024-09-10T23:29:27.843 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49288 rocksdb:l ceph NOFD /proc/48728/task/49288/fd (opendir: Permission denied) 2024-09-10T23:29:27.843 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49289 rocksdb:l ceph cwd unknown /proc/48728/task/49289/cwd (readlink: Permission denied) 2024-09-10T23:29:27.843 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49289 rocksdb:l ceph rtd unknown /proc/48728/task/49289/root (readlink: Permission denied) 2024-09-10T23:29:27.843 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49289 rocksdb:l ceph txt unknown /proc/48728/task/49289/exe (readlink: Permission denied) 2024-09-10T23:29:27.843 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49289 rocksdb:l ceph NOFD /proc/48728/task/49289/fd (opendir: Permission denied) 2024-09-10T23:29:27.843 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49290 rocksdb:l ceph cwd unknown /proc/48728/task/49290/cwd (readlink: Permission denied) 2024-09-10T23:29:27.843 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49290 rocksdb:l ceph rtd unknown /proc/48728/task/49290/root (readlink: Permission denied) 2024-09-10T23:29:27.844 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49290 rocksdb:l ceph txt unknown /proc/48728/task/49290/exe (readlink: Permission denied) 2024-09-10T23:29:27.844 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49290 rocksdb:l ceph NOFD /proc/48728/task/49290/fd (opendir: Permission denied) 2024-09-10T23:29:27.844 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49291 rocksdb:h ceph cwd unknown /proc/48728/task/49291/cwd (readlink: Permission denied) 2024-09-10T23:29:27.844 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49291 rocksdb:h ceph rtd unknown /proc/48728/task/49291/root (readlink: Permission denied) 2024-09-10T23:29:27.844 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49291 rocksdb:h ceph txt unknown /proc/48728/task/49291/exe (readlink: Permission denied) 2024-09-10T23:29:27.844 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49291 rocksdb:h ceph NOFD /proc/48728/task/49291/fd (opendir: Permission denied) 2024-09-10T23:29:27.844 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49789 bstore_ai ceph cwd unknown /proc/48728/task/49789/cwd (readlink: Permission denied) 2024-09-10T23:29:27.844 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49789 bstore_ai ceph rtd unknown /proc/48728/task/49789/root (readlink: Permission denied) 2024-09-10T23:29:27.844 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49789 bstore_ai ceph txt unknown /proc/48728/task/49789/exe (readlink: Permission denied) 2024-09-10T23:29:27.844 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49789 bstore_ai ceph NOFD /proc/48728/task/49789/fd (opendir: Permission denied) 2024-09-10T23:29:27.844 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49988 bstore_ai ceph cwd unknown /proc/48728/task/49988/cwd (readlink: Permission denied) 2024-09-10T23:29:27.844 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49988 bstore_ai ceph rtd unknown /proc/48728/task/49988/root (readlink: Permission denied) 2024-09-10T23:29:27.844 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49988 bstore_ai ceph txt unknown /proc/48728/task/49988/exe (readlink: Permission denied) 2024-09-10T23:29:27.845 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 49988 bstore_ai ceph NOFD /proc/48728/task/49988/fd (opendir: Permission denied) 2024-09-10T23:29:27.845 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50171 ceph-osd ceph cwd unknown /proc/48728/task/50171/cwd (readlink: Permission denied) 2024-09-10T23:29:27.845 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50171 ceph-osd ceph rtd unknown /proc/48728/task/50171/root (readlink: Permission denied) 2024-09-10T23:29:27.845 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50171 ceph-osd ceph txt unknown /proc/48728/task/50171/exe (readlink: Permission denied) 2024-09-10T23:29:27.845 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50171 ceph-osd ceph NOFD /proc/48728/task/50171/fd (opendir: Permission denied) 2024-09-10T23:29:27.845 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50172 cfin ceph cwd unknown /proc/48728/task/50172/cwd (readlink: Permission denied) 2024-09-10T23:29:27.845 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50172 cfin ceph rtd unknown /proc/48728/task/50172/root (readlink: Permission denied) 2024-09-10T23:29:27.845 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50172 cfin ceph txt unknown /proc/48728/task/50172/exe (readlink: Permission denied) 2024-09-10T23:29:27.845 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50172 cfin ceph NOFD /proc/48728/task/50172/fd (opendir: Permission denied) 2024-09-10T23:29:27.845 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50173 bstore_kv ceph cwd unknown /proc/48728/task/50173/cwd (readlink: Permission denied) 2024-09-10T23:29:27.845 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50173 bstore_kv ceph rtd unknown /proc/48728/task/50173/root (readlink: Permission denied) 2024-09-10T23:29:27.845 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50173 bstore_kv ceph txt unknown /proc/48728/task/50173/exe (readlink: Permission denied) 2024-09-10T23:29:27.846 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50173 bstore_kv ceph NOFD /proc/48728/task/50173/fd (opendir: Permission denied) 2024-09-10T23:29:27.846 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50174 bstore_kv ceph cwd unknown /proc/48728/task/50174/cwd (readlink: Permission denied) 2024-09-10T23:29:27.846 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50174 bstore_kv ceph rtd unknown /proc/48728/task/50174/root (readlink: Permission denied) 2024-09-10T23:29:27.846 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50174 bstore_kv ceph txt unknown /proc/48728/task/50174/exe (readlink: Permission denied) 2024-09-10T23:29:27.846 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50174 bstore_kv ceph NOFD /proc/48728/task/50174/fd (opendir: Permission denied) 2024-09-10T23:29:27.846 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50175 bstore_me ceph cwd unknown /proc/48728/task/50175/cwd (readlink: Permission denied) 2024-09-10T23:29:27.847 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50175 bstore_me ceph rtd unknown /proc/48728/task/50175/root (readlink: Permission denied) 2024-09-10T23:29:27.847 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50175 bstore_me ceph txt unknown /proc/48728/task/50175/exe (readlink: Permission denied) 2024-09-10T23:29:27.847 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50175 bstore_me ceph NOFD /proc/48728/task/50175/fd (opendir: Permission denied) 2024-09-10T23:29:27.847 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50176 ms_dispat ceph cwd unknown /proc/48728/task/50176/cwd (readlink: Permission denied) 2024-09-10T23:29:27.847 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50176 ms_dispat ceph rtd unknown /proc/48728/task/50176/root (readlink: Permission denied) 2024-09-10T23:29:27.847 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50176 ms_dispat ceph txt unknown /proc/48728/task/50176/exe (readlink: Permission denied) 2024-09-10T23:29:27.847 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50176 ms_dispat ceph NOFD /proc/48728/task/50176/fd (opendir: Permission denied) 2024-09-10T23:29:27.847 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50177 ms_local ceph cwd unknown /proc/48728/task/50177/cwd (readlink: Permission denied) 2024-09-10T23:29:27.847 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50177 ms_local ceph rtd unknown /proc/48728/task/50177/root (readlink: Permission denied) 2024-09-10T23:29:27.847 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50177 ms_local ceph txt unknown /proc/48728/task/50177/exe (readlink: Permission denied) 2024-09-10T23:29:27.848 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50177 ms_local ceph NOFD /proc/48728/task/50177/fd (opendir: Permission denied) 2024-09-10T23:29:27.848 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50178 safe_time ceph cwd unknown /proc/48728/task/50178/cwd (readlink: Permission denied) 2024-09-10T23:29:27.848 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50178 safe_time ceph rtd unknown /proc/48728/task/50178/root (readlink: Permission denied) 2024-09-10T23:29:27.848 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50178 safe_time ceph txt unknown /proc/48728/task/50178/exe (readlink: Permission denied) 2024-09-10T23:29:27.848 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50178 safe_time ceph NOFD /proc/48728/task/50178/fd (opendir: Permission denied) 2024-09-10T23:29:27.848 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50179 safe_time ceph cwd unknown /proc/48728/task/50179/cwd (readlink: Permission denied) 2024-09-10T23:29:27.848 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50179 safe_time ceph rtd unknown /proc/48728/task/50179/root (readlink: Permission denied) 2024-09-10T23:29:27.848 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50179 safe_time ceph txt unknown /proc/48728/task/50179/exe (readlink: Permission denied) 2024-09-10T23:29:27.848 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50179 safe_time ceph NOFD /proc/48728/task/50179/fd (opendir: Permission denied) 2024-09-10T23:29:27.848 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50180 ms_dispat ceph cwd unknown /proc/48728/task/50180/cwd (readlink: Permission denied) 2024-09-10T23:29:27.848 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50180 ms_dispat ceph rtd unknown /proc/48728/task/50180/root (readlink: Permission denied) 2024-09-10T23:29:27.848 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50180 ms_dispat ceph txt unknown /proc/48728/task/50180/exe (readlink: Permission denied) 2024-09-10T23:29:27.849 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50180 ms_dispat ceph NOFD /proc/48728/task/50180/fd (opendir: Permission denied) 2024-09-10T23:29:27.849 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50181 ms_local ceph cwd unknown /proc/48728/task/50181/cwd (readlink: Permission denied) 2024-09-10T23:29:27.849 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50181 ms_local ceph rtd unknown /proc/48728/task/50181/root (readlink: Permission denied) 2024-09-10T23:29:27.849 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50181 ms_local ceph txt unknown /proc/48728/task/50181/exe (readlink: Permission denied) 2024-09-10T23:29:27.849 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50181 ms_local ceph NOFD /proc/48728/task/50181/fd (opendir: Permission denied) 2024-09-10T23:29:27.849 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50182 ms_dispat ceph cwd unknown /proc/48728/task/50182/cwd (readlink: Permission denied) 2024-09-10T23:29:27.849 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50182 ms_dispat ceph rtd unknown /proc/48728/task/50182/root (readlink: Permission denied) 2024-09-10T23:29:27.849 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50182 ms_dispat ceph txt unknown /proc/48728/task/50182/exe (readlink: Permission denied) 2024-09-10T23:29:27.849 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50182 ms_dispat ceph NOFD /proc/48728/task/50182/fd (opendir: Permission denied) 2024-09-10T23:29:27.850 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50183 ms_local ceph cwd unknown /proc/48728/task/50183/cwd (readlink: Permission denied) 2024-09-10T23:29:27.850 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50183 ms_local ceph rtd unknown /proc/48728/task/50183/root (readlink: Permission denied) 2024-09-10T23:29:27.850 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50183 ms_local ceph txt unknown /proc/48728/task/50183/exe (readlink: Permission denied) 2024-09-10T23:29:27.850 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50183 ms_local ceph NOFD /proc/48728/task/50183/fd (opendir: Permission denied) 2024-09-10T23:29:27.850 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50184 ms_dispat ceph cwd unknown /proc/48728/task/50184/cwd (readlink: Permission denied) 2024-09-10T23:29:27.850 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50184 ms_dispat ceph rtd unknown /proc/48728/task/50184/root (readlink: Permission denied) 2024-09-10T23:29:27.850 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50184 ms_dispat ceph txt unknown /proc/48728/task/50184/exe (readlink: Permission denied) 2024-09-10T23:29:27.850 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50184 ms_dispat ceph NOFD /proc/48728/task/50184/fd (opendir: Permission denied) 2024-09-10T23:29:27.850 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50185 ms_local ceph cwd unknown /proc/48728/task/50185/cwd (readlink: Permission denied) 2024-09-10T23:29:27.850 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50185 ms_local ceph rtd unknown /proc/48728/task/50185/root (readlink: Permission denied) 2024-09-10T23:29:27.850 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50185 ms_local ceph txt unknown /proc/48728/task/50185/exe (readlink: Permission denied) 2024-09-10T23:29:27.850 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50185 ms_local ceph NOFD /proc/48728/task/50185/fd (opendir: Permission denied) 2024-09-10T23:29:27.850 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50186 ms_dispat ceph cwd unknown /proc/48728/task/50186/cwd (readlink: Permission denied) 2024-09-10T23:29:27.851 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50186 ms_dispat ceph rtd unknown /proc/48728/task/50186/root (readlink: Permission denied) 2024-09-10T23:29:27.851 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50186 ms_dispat ceph txt unknown /proc/48728/task/50186/exe (readlink: Permission denied) 2024-09-10T23:29:27.851 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50186 ms_dispat ceph NOFD /proc/48728/task/50186/fd (opendir: Permission denied) 2024-09-10T23:29:27.851 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50187 ms_local ceph cwd unknown /proc/48728/task/50187/cwd (readlink: Permission denied) 2024-09-10T23:29:27.851 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50187 ms_local ceph rtd unknown /proc/48728/task/50187/root (readlink: Permission denied) 2024-09-10T23:29:27.851 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50187 ms_local ceph txt unknown /proc/48728/task/50187/exe (readlink: Permission denied) 2024-09-10T23:29:27.851 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50187 ms_local ceph NOFD /proc/48728/task/50187/fd (opendir: Permission denied) 2024-09-10T23:29:27.851 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50188 ms_dispat ceph cwd unknown /proc/48728/task/50188/cwd (readlink: Permission denied) 2024-09-10T23:29:27.851 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50188 ms_dispat ceph rtd unknown /proc/48728/task/50188/root (readlink: Permission denied) 2024-09-10T23:29:27.851 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50188 ms_dispat ceph txt unknown /proc/48728/task/50188/exe (readlink: Permission denied) 2024-09-10T23:29:27.851 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50188 ms_dispat ceph NOFD /proc/48728/task/50188/fd (opendir: Permission denied) 2024-09-10T23:29:27.851 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50189 ms_local ceph cwd unknown /proc/48728/task/50189/cwd (readlink: Permission denied) 2024-09-10T23:29:27.851 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50189 ms_local ceph rtd unknown /proc/48728/task/50189/root (readlink: Permission denied) 2024-09-10T23:29:27.851 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50189 ms_local ceph txt unknown /proc/48728/task/50189/exe (readlink: Permission denied) 2024-09-10T23:29:27.851 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50189 ms_local ceph NOFD /proc/48728/task/50189/fd (opendir: Permission denied) 2024-09-10T23:29:27.852 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50190 ms_dispat ceph cwd unknown /proc/48728/task/50190/cwd (readlink: Permission denied) 2024-09-10T23:29:27.852 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50190 ms_dispat ceph rtd unknown /proc/48728/task/50190/root (readlink: Permission denied) 2024-09-10T23:29:27.852 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50190 ms_dispat ceph txt unknown /proc/48728/task/50190/exe (readlink: Permission denied) 2024-09-10T23:29:27.852 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50190 ms_dispat ceph NOFD /proc/48728/task/50190/fd (opendir: Permission denied) 2024-09-10T23:29:27.852 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50191 ms_local ceph cwd unknown /proc/48728/task/50191/cwd (readlink: Permission denied) 2024-09-10T23:29:27.852 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50191 ms_local ceph rtd unknown /proc/48728/task/50191/root (readlink: Permission denied) 2024-09-10T23:29:27.852 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50191 ms_local ceph txt unknown /proc/48728/task/50191/exe (readlink: Permission denied) 2024-09-10T23:29:27.852 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50191 ms_local ceph NOFD /proc/48728/task/50191/fd (opendir: Permission denied) 2024-09-10T23:29:27.852 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50192 fn_anonym ceph cwd unknown /proc/48728/task/50192/cwd (readlink: Permission denied) 2024-09-10T23:29:27.853 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50192 fn_anonym ceph rtd unknown /proc/48728/task/50192/root (readlink: Permission denied) 2024-09-10T23:29:27.853 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50192 fn_anonym ceph txt unknown /proc/48728/task/50192/exe (readlink: Permission denied) 2024-09-10T23:29:27.853 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50192 fn_anonym ceph NOFD /proc/48728/task/50192/fd (opendir: Permission denied) 2024-09-10T23:29:27.853 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50193 finisher ceph cwd unknown /proc/48728/task/50193/cwd (readlink: Permission denied) 2024-09-10T23:29:27.853 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50193 finisher ceph rtd unknown /proc/48728/task/50193/root (readlink: Permission denied) 2024-09-10T23:29:27.853 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50193 finisher ceph txt unknown /proc/48728/task/50193/exe (readlink: Permission denied) 2024-09-10T23:29:27.854 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50193 finisher ceph NOFD /proc/48728/task/50193/fd (opendir: Permission denied) 2024-09-10T23:29:27.854 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50194 safe_time ceph cwd unknown /proc/48728/task/50194/cwd (readlink: Permission denied) 2024-09-10T23:29:27.854 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50194 safe_time ceph rtd unknown /proc/48728/task/50194/root (readlink: Permission denied) 2024-09-10T23:29:27.854 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50194 safe_time ceph txt unknown /proc/48728/task/50194/exe (readlink: Permission denied) 2024-09-10T23:29:27.854 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50194 safe_time ceph NOFD /proc/48728/task/50194/fd (opendir: Permission denied) 2024-09-10T23:29:27.854 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50195 safe_time ceph cwd unknown /proc/48728/task/50195/cwd (readlink: Permission denied) 2024-09-10T23:29:27.854 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50195 safe_time ceph rtd unknown /proc/48728/task/50195/root (readlink: Permission denied) 2024-09-10T23:29:27.854 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50195 safe_time ceph txt unknown /proc/48728/task/50195/exe (readlink: Permission denied) 2024-09-10T23:29:27.854 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50195 safe_time ceph NOFD /proc/48728/task/50195/fd (opendir: Permission denied) 2024-09-10T23:29:27.855 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50196 ceph-osd ceph cwd unknown /proc/48728/task/50196/cwd (readlink: Permission denied) 2024-09-10T23:29:27.855 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50196 ceph-osd ceph rtd unknown /proc/48728/task/50196/root (readlink: Permission denied) 2024-09-10T23:29:27.855 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50196 ceph-osd ceph txt unknown /proc/48728/task/50196/exe (readlink: Permission denied) 2024-09-10T23:29:27.855 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50196 ceph-osd ceph NOFD /proc/48728/task/50196/fd (opendir: Permission denied) 2024-09-10T23:29:27.855 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50197 osd_srv_a ceph cwd unknown /proc/48728/task/50197/cwd (readlink: Permission denied) 2024-09-10T23:29:27.855 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50197 osd_srv_a ceph rtd unknown /proc/48728/task/50197/root (readlink: Permission denied) 2024-09-10T23:29:27.855 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50197 osd_srv_a ceph txt unknown /proc/48728/task/50197/exe (readlink: Permission denied) 2024-09-10T23:29:27.855 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50197 osd_srv_a ceph NOFD /proc/48728/task/50197/fd (opendir: Permission denied) 2024-09-10T23:29:27.855 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50198 tp_osd_tp ceph cwd unknown /proc/48728/task/50198/cwd (readlink: Permission denied) 2024-09-10T23:29:27.855 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50198 tp_osd_tp ceph rtd unknown /proc/48728/task/50198/root (readlink: Permission denied) 2024-09-10T23:29:27.855 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50198 tp_osd_tp ceph txt unknown /proc/48728/task/50198/exe (readlink: Permission denied) 2024-09-10T23:29:27.855 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50198 tp_osd_tp ceph NOFD /proc/48728/task/50198/fd (opendir: Permission denied) 2024-09-10T23:29:27.856 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50199 tp_osd_tp ceph cwd unknown /proc/48728/task/50199/cwd (readlink: Permission denied) 2024-09-10T23:29:27.856 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50199 tp_osd_tp ceph rtd unknown /proc/48728/task/50199/root (readlink: Permission denied) 2024-09-10T23:29:27.856 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50199 tp_osd_tp ceph txt unknown /proc/48728/task/50199/exe (readlink: Permission denied) 2024-09-10T23:29:27.856 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50199 tp_osd_tp ceph NOFD /proc/48728/task/50199/fd (opendir: Permission denied) 2024-09-10T23:29:27.856 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50200 tp_osd_tp ceph cwd unknown /proc/48728/task/50200/cwd (readlink: Permission denied) 2024-09-10T23:29:27.856 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50200 tp_osd_tp ceph rtd unknown /proc/48728/task/50200/root (readlink: Permission denied) 2024-09-10T23:29:27.856 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50200 tp_osd_tp ceph txt unknown /proc/48728/task/50200/exe (readlink: Permission denied) 2024-09-10T23:29:27.856 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50200 tp_osd_tp ceph NOFD /proc/48728/task/50200/fd (opendir: Permission denied) 2024-09-10T23:29:27.856 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50201 tp_osd_tp ceph cwd unknown /proc/48728/task/50201/cwd (readlink: Permission denied) 2024-09-10T23:29:27.856 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50201 tp_osd_tp ceph rtd unknown /proc/48728/task/50201/root (readlink: Permission denied) 2024-09-10T23:29:27.856 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50201 tp_osd_tp ceph txt unknown /proc/48728/task/50201/exe (readlink: Permission denied) 2024-09-10T23:29:27.856 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50201 tp_osd_tp ceph NOFD /proc/48728/task/50201/fd (opendir: Permission denied) 2024-09-10T23:29:27.856 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50202 tp_osd_tp ceph cwd unknown /proc/48728/task/50202/cwd (readlink: Permission denied) 2024-09-10T23:29:27.857 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50202 tp_osd_tp ceph rtd unknown /proc/48728/task/50202/root (readlink: Permission denied) 2024-09-10T23:29:27.857 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50202 tp_osd_tp ceph txt unknown /proc/48728/task/50202/exe (readlink: Permission denied) 2024-09-10T23:29:27.857 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50202 tp_osd_tp ceph NOFD /proc/48728/task/50202/fd (opendir: Permission denied) 2024-09-10T23:29:27.857 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50203 tp_osd_tp ceph cwd unknown /proc/48728/task/50203/cwd (readlink: Permission denied) 2024-09-10T23:29:27.857 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50203 tp_osd_tp ceph rtd unknown /proc/48728/task/50203/root (readlink: Permission denied) 2024-09-10T23:29:27.857 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50203 tp_osd_tp ceph txt unknown /proc/48728/task/50203/exe (readlink: Permission denied) 2024-09-10T23:29:27.857 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50203 tp_osd_tp ceph NOFD /proc/48728/task/50203/fd (opendir: Permission denied) 2024-09-10T23:29:27.857 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50204 tp_osd_tp ceph cwd unknown /proc/48728/task/50204/cwd (readlink: Permission denied) 2024-09-10T23:29:27.857 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50204 tp_osd_tp ceph rtd unknown /proc/48728/task/50204/root (readlink: Permission denied) 2024-09-10T23:29:27.857 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50204 tp_osd_tp ceph txt unknown /proc/48728/task/50204/exe (readlink: Permission denied) 2024-09-10T23:29:27.857 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50204 tp_osd_tp ceph NOFD /proc/48728/task/50204/fd (opendir: Permission denied) 2024-09-10T23:29:27.857 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50205 tp_osd_tp ceph cwd unknown /proc/48728/task/50205/cwd (readlink: Permission denied) 2024-09-10T23:29:27.857 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50205 tp_osd_tp ceph rtd unknown /proc/48728/task/50205/root (readlink: Permission denied) 2024-09-10T23:29:27.858 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50205 tp_osd_tp ceph txt unknown /proc/48728/task/50205/exe (readlink: Permission denied) 2024-09-10T23:29:27.858 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50205 tp_osd_tp ceph NOFD /proc/48728/task/50205/fd (opendir: Permission denied) 2024-09-10T23:29:27.858 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50206 tp_osd_tp ceph cwd unknown /proc/48728/task/50206/cwd (readlink: Permission denied) 2024-09-10T23:29:27.858 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50206 tp_osd_tp ceph rtd unknown /proc/48728/task/50206/root (readlink: Permission denied) 2024-09-10T23:29:27.858 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50206 tp_osd_tp ceph txt unknown /proc/48728/task/50206/exe (readlink: Permission denied) 2024-09-10T23:29:27.858 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50206 tp_osd_tp ceph NOFD /proc/48728/task/50206/fd (opendir: Permission denied) 2024-09-10T23:29:27.858 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50207 tp_osd_tp ceph cwd unknown /proc/48728/task/50207/cwd (readlink: Permission denied) 2024-09-10T23:29:27.858 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50207 tp_osd_tp ceph rtd unknown /proc/48728/task/50207/root (readlink: Permission denied) 2024-09-10T23:29:27.858 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50207 tp_osd_tp ceph txt unknown /proc/48728/task/50207/exe (readlink: Permission denied) 2024-09-10T23:29:27.858 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50207 tp_osd_tp ceph NOFD /proc/48728/task/50207/fd (opendir: Permission denied) 2024-09-10T23:29:27.858 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50208 tp_osd_tp ceph cwd unknown /proc/48728/task/50208/cwd (readlink: Permission denied) 2024-09-10T23:29:27.859 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50208 tp_osd_tp ceph rtd unknown /proc/48728/task/50208/root (readlink: Permission denied) 2024-09-10T23:29:27.859 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50208 tp_osd_tp ceph txt unknown /proc/48728/task/50208/exe (readlink: Permission denied) 2024-09-10T23:29:27.859 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50208 tp_osd_tp ceph NOFD /proc/48728/task/50208/fd (opendir: Permission denied) 2024-09-10T23:29:27.859 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50209 tp_osd_tp ceph cwd unknown /proc/48728/task/50209/cwd (readlink: Permission denied) 2024-09-10T23:29:27.859 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50209 tp_osd_tp ceph rtd unknown /proc/48728/task/50209/root (readlink: Permission denied) 2024-09-10T23:29:27.859 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50209 tp_osd_tp ceph txt unknown /proc/48728/task/50209/exe (readlink: Permission denied) 2024-09-10T23:29:27.859 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50209 tp_osd_tp ceph NOFD /proc/48728/task/50209/fd (opendir: Permission denied) 2024-09-10T23:29:27.859 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50210 tp_osd_tp ceph cwd unknown /proc/48728/task/50210/cwd (readlink: Permission denied) 2024-09-10T23:29:27.859 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50210 tp_osd_tp ceph rtd unknown /proc/48728/task/50210/root (readlink: Permission denied) 2024-09-10T23:29:27.859 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50210 tp_osd_tp ceph txt unknown /proc/48728/task/50210/exe (readlink: Permission denied) 2024-09-10T23:29:27.859 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50210 tp_osd_tp ceph NOFD /proc/48728/task/50210/fd (opendir: Permission denied) 2024-09-10T23:29:27.860 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50211 tp_osd_tp ceph cwd unknown /proc/48728/task/50211/cwd (readlink: Permission denied) 2024-09-10T23:29:27.860 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50211 tp_osd_tp ceph rtd unknown /proc/48728/task/50211/root (readlink: Permission denied) 2024-09-10T23:29:27.860 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50211 tp_osd_tp ceph txt unknown /proc/48728/task/50211/exe (readlink: Permission denied) 2024-09-10T23:29:27.860 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50211 tp_osd_tp ceph NOFD /proc/48728/task/50211/fd (opendir: Permission denied) 2024-09-10T23:29:27.860 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50212 tp_osd_tp ceph cwd unknown /proc/48728/task/50212/cwd (readlink: Permission denied) 2024-09-10T23:29:27.860 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50212 tp_osd_tp ceph rtd unknown /proc/48728/task/50212/root (readlink: Permission denied) 2024-09-10T23:29:27.860 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50212 tp_osd_tp ceph txt unknown /proc/48728/task/50212/exe (readlink: Permission denied) 2024-09-10T23:29:27.860 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50212 tp_osd_tp ceph NOFD /proc/48728/task/50212/fd (opendir: Permission denied) 2024-09-10T23:29:27.860 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50213 tp_osd_tp ceph cwd unknown /proc/48728/task/50213/cwd (readlink: Permission denied) 2024-09-10T23:29:27.860 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50213 tp_osd_tp ceph rtd unknown /proc/48728/task/50213/root (readlink: Permission denied) 2024-09-10T23:29:27.860 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50213 tp_osd_tp ceph txt unknown /proc/48728/task/50213/exe (readlink: Permission denied) 2024-09-10T23:29:27.860 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50213 tp_osd_tp ceph NOFD /proc/48728/task/50213/fd (opendir: Permission denied) 2024-09-10T23:29:27.860 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50214 osd_srv_h ceph cwd unknown /proc/48728/task/50214/cwd (readlink: Permission denied) 2024-09-10T23:29:27.861 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50214 osd_srv_h ceph rtd unknown /proc/48728/task/50214/root (readlink: Permission denied) 2024-09-10T23:29:27.861 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50214 osd_srv_h ceph txt unknown /proc/48728/task/50214/exe (readlink: Permission denied) 2024-09-10T23:29:27.861 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 48728 50214 osd_srv_h ceph NOFD /proc/48728/task/50214/fd (opendir: Permission denied) 2024-09-10T23:29:27.861 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 49730 root cwd unknown /proc/49730/cwd (readlink: Permission denied) 2024-09-10T23:29:27.861 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 49730 root rtd unknown /proc/49730/root (readlink: Permission denied) 2024-09-10T23:29:27.861 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 49730 root txt unknown /proc/49730/exe (readlink: Permission denied) 2024-09-10T23:29:27.861 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 49730 root NOFD /proc/49730/fd (opendir: Permission denied) 2024-09-10T23:29:27.861 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 49758 root cwd unknown /proc/49758/cwd (readlink: Permission denied) 2024-09-10T23:29:27.861 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 49758 root rtd unknown /proc/49758/root (readlink: Permission denied) 2024-09-10T23:29:27.861 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 49758 root txt unknown /proc/49758/exe (readlink: Permission denied) 2024-09-10T23:29:27.861 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 49758 root NOFD /proc/49758/fd (opendir: Permission denied) 2024-09-10T23:29:27.861 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 55616 root cwd unknown /proc/55616/cwd (readlink: Permission denied) 2024-09-10T23:29:27.861 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 55616 root rtd unknown /proc/55616/root (readlink: Permission denied) 2024-09-10T23:29:27.861 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 55616 root txt unknown /proc/55616/exe (readlink: Permission denied) 2024-09-10T23:29:27.862 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 55616 root NOFD /proc/55616/fd (opendir: Permission denied) 2024-09-10T23:29:27.862 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 55618 root cwd unknown /proc/55618/cwd (readlink: Permission denied) 2024-09-10T23:29:27.862 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 55618 root rtd unknown /proc/55618/root (readlink: Permission denied) 2024-09-10T23:29:27.862 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 55618 root txt unknown /proc/55618/exe (readlink: Permission denied) 2024-09-10T23:29:27.862 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 55618 root NOFD /proc/55618/fd (opendir: Permission denied) 2024-09-10T23:29:27.862 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 ceph cwd unknown /proc/55620/cwd (readlink: Permission denied) 2024-09-10T23:29:27.862 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 ceph rtd unknown /proc/55620/root (readlink: Permission denied) 2024-09-10T23:29:27.862 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 ceph txt unknown /proc/55620/exe (readlink: Permission denied) 2024-09-10T23:29:27.862 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 ceph NOFD /proc/55620/fd (opendir: Permission denied) 2024-09-10T23:29:27.862 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55621 log ceph cwd unknown /proc/55620/task/55621/cwd (readlink: Permission denied) 2024-09-10T23:29:27.862 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55621 log ceph rtd unknown /proc/55620/task/55621/root (readlink: Permission denied) 2024-09-10T23:29:27.862 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55621 log ceph txt unknown /proc/55620/task/55621/exe (readlink: Permission denied) 2024-09-10T23:29:27.862 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55621 log ceph NOFD /proc/55620/task/55621/fd (opendir: Permission denied) 2024-09-10T23:29:27.863 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55623 msgr-work ceph cwd unknown /proc/55620/task/55623/cwd (readlink: Permission denied) 2024-09-10T23:29:27.863 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55623 msgr-work ceph rtd unknown /proc/55620/task/55623/root (readlink: Permission denied) 2024-09-10T23:29:27.863 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55623 msgr-work ceph txt unknown /proc/55620/task/55623/exe (readlink: Permission denied) 2024-09-10T23:29:27.863 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55623 msgr-work ceph NOFD /proc/55620/task/55623/fd (opendir: Permission denied) 2024-09-10T23:29:27.863 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55624 msgr-work ceph cwd unknown /proc/55620/task/55624/cwd (readlink: Permission denied) 2024-09-10T23:29:27.863 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55624 msgr-work ceph rtd unknown /proc/55620/task/55624/root (readlink: Permission denied) 2024-09-10T23:29:27.863 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55624 msgr-work ceph txt unknown /proc/55620/task/55624/exe (readlink: Permission denied) 2024-09-10T23:29:27.863 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55624 msgr-work ceph NOFD /proc/55620/task/55624/fd (opendir: Permission denied) 2024-09-10T23:29:27.863 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55625 msgr-work ceph cwd unknown /proc/55620/task/55625/cwd (readlink: Permission denied) 2024-09-10T23:29:27.863 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55625 msgr-work ceph rtd unknown /proc/55620/task/55625/root (readlink: Permission denied) 2024-09-10T23:29:27.863 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55625 msgr-work ceph txt unknown /proc/55620/task/55625/exe (readlink: Permission denied) 2024-09-10T23:29:27.863 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55625 msgr-work ceph NOFD /proc/55620/task/55625/fd (opendir: Permission denied) 2024-09-10T23:29:27.863 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55629 service ceph cwd unknown /proc/55620/task/55629/cwd (readlink: Permission denied) 2024-09-10T23:29:27.864 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55629 service ceph rtd unknown /proc/55620/task/55629/root (readlink: Permission denied) 2024-09-10T23:29:27.864 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55629 service ceph txt unknown /proc/55620/task/55629/exe (readlink: Permission denied) 2024-09-10T23:29:27.864 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55629 service ceph NOFD /proc/55620/task/55629/fd (opendir: Permission denied) 2024-09-10T23:29:27.864 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55630 admin_soc ceph cwd unknown /proc/55620/task/55630/cwd (readlink: Permission denied) 2024-09-10T23:29:27.864 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55630 admin_soc ceph rtd unknown /proc/55620/task/55630/root (readlink: Permission denied) 2024-09-10T23:29:27.864 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55630 admin_soc ceph txt unknown /proc/55620/task/55630/exe (readlink: Permission denied) 2024-09-10T23:29:27.864 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55630 admin_soc ceph NOFD /proc/55620/task/55630/fd (opendir: Permission denied) 2024-09-10T23:29:27.864 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55953 signal_ha ceph cwd unknown /proc/55620/task/55953/cwd (readlink: Permission denied) 2024-09-10T23:29:27.864 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55953 signal_ha ceph rtd unknown /proc/55620/task/55953/root (readlink: Permission denied) 2024-09-10T23:29:27.864 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55953 signal_ha ceph txt unknown /proc/55620/task/55953/exe (readlink: Permission denied) 2024-09-10T23:29:27.864 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55953 signal_ha ceph NOFD /proc/55620/task/55953/fd (opendir: Permission denied) 2024-09-10T23:29:27.864 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55954 io_contex ceph cwd unknown /proc/55620/task/55954/cwd (readlink: Permission denied) 2024-09-10T23:29:27.864 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55954 io_contex ceph rtd unknown /proc/55620/task/55954/root (readlink: Permission denied) 2024-09-10T23:29:27.864 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55954 io_contex ceph txt unknown /proc/55620/task/55954/exe (readlink: Permission denied) 2024-09-10T23:29:27.865 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55954 io_contex ceph NOFD /proc/55620/task/55954/fd (opendir: Permission denied) 2024-09-10T23:29:27.865 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55955 io_contex ceph cwd unknown /proc/55620/task/55955/cwd (readlink: Permission denied) 2024-09-10T23:29:27.865 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55955 io_contex ceph rtd unknown /proc/55620/task/55955/root (readlink: Permission denied) 2024-09-10T23:29:27.865 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55955 io_contex ceph txt unknown /proc/55620/task/55955/exe (readlink: Permission denied) 2024-09-10T23:29:27.865 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55955 io_contex ceph NOFD /proc/55620/task/55955/fd (opendir: Permission denied) 2024-09-10T23:29:27.865 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55960 OpHistory ceph cwd unknown /proc/55620/task/55960/cwd (readlink: Permission denied) 2024-09-10T23:29:27.865 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55960 OpHistory ceph rtd unknown /proc/55620/task/55960/root (readlink: Permission denied) 2024-09-10T23:29:27.865 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55960 OpHistory ceph txt unknown /proc/55620/task/55960/exe (readlink: Permission denied) 2024-09-10T23:29:27.865 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55960 OpHistory ceph NOFD /proc/55620/task/55960/fd (opendir: Permission denied) 2024-09-10T23:29:27.865 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55961 ceph_time ceph cwd unknown /proc/55620/task/55961/cwd (readlink: Permission denied) 2024-09-10T23:29:27.866 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55961 ceph_time ceph rtd unknown /proc/55620/task/55961/root (readlink: Permission denied) 2024-09-10T23:29:27.866 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55961 ceph_time ceph txt unknown /proc/55620/task/55961/exe (readlink: Permission denied) 2024-09-10T23:29:27.866 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55961 ceph_time ceph NOFD /proc/55620/task/55961/fd (opendir: Permission denied) 2024-09-10T23:29:27.866 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55985 ceph-osd ceph cwd unknown /proc/55620/task/55985/cwd (readlink: Permission denied) 2024-09-10T23:29:27.866 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55985 ceph-osd ceph rtd unknown /proc/55620/task/55985/root (readlink: Permission denied) 2024-09-10T23:29:27.866 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55985 ceph-osd ceph txt unknown /proc/55620/task/55985/exe (readlink: Permission denied) 2024-09-10T23:29:27.866 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 55985 ceph-osd ceph NOFD /proc/55620/task/55985/fd (opendir: Permission denied) 2024-09-10T23:29:27.866 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56009 ceph-osd ceph cwd unknown /proc/55620/task/56009/cwd (readlink: Permission denied) 2024-09-10T23:29:27.866 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56009 ceph-osd ceph rtd unknown /proc/55620/task/56009/root (readlink: Permission denied) 2024-09-10T23:29:27.866 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56009 ceph-osd ceph txt unknown /proc/55620/task/56009/exe (readlink: Permission denied) 2024-09-10T23:29:27.866 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56009 ceph-osd ceph NOFD /proc/55620/task/56009/fd (opendir: Permission denied) 2024-09-10T23:29:27.866 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56036 ceph-osd ceph cwd unknown /proc/55620/task/56036/cwd (readlink: Permission denied) 2024-09-10T23:29:27.867 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56036 ceph-osd ceph rtd unknown /proc/55620/task/56036/root (readlink: Permission denied) 2024-09-10T23:29:27.867 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56036 ceph-osd ceph txt unknown /proc/55620/task/56036/exe (readlink: Permission denied) 2024-09-10T23:29:27.867 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56036 ceph-osd ceph NOFD /proc/55620/task/56036/fd (opendir: Permission denied) 2024-09-10T23:29:27.867 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56108 ceph-osd ceph cwd unknown /proc/55620/task/56108/cwd (readlink: Permission denied) 2024-09-10T23:29:27.867 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56108 ceph-osd ceph rtd unknown /proc/55620/task/56108/root (readlink: Permission denied) 2024-09-10T23:29:27.867 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56108 ceph-osd ceph txt unknown /proc/55620/task/56108/exe (readlink: Permission denied) 2024-09-10T23:29:27.867 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56108 ceph-osd ceph NOFD /proc/55620/task/56108/fd (opendir: Permission denied) 2024-09-10T23:29:27.867 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56159 ceph-osd ceph cwd unknown /proc/55620/task/56159/cwd (readlink: Permission denied) 2024-09-10T23:29:27.867 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56159 ceph-osd ceph rtd unknown /proc/55620/task/56159/root (readlink: Permission denied) 2024-09-10T23:29:27.867 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56159 ceph-osd ceph txt unknown /proc/55620/task/56159/exe (readlink: Permission denied) 2024-09-10T23:29:27.867 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56159 ceph-osd ceph NOFD /proc/55620/task/56159/fd (opendir: Permission denied) 2024-09-10T23:29:27.867 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56188 ceph-osd ceph cwd unknown /proc/55620/task/56188/cwd (readlink: Permission denied) 2024-09-10T23:29:27.867 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56188 ceph-osd ceph rtd unknown /proc/55620/task/56188/root (readlink: Permission denied) 2024-09-10T23:29:27.867 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56188 ceph-osd ceph txt unknown /proc/55620/task/56188/exe (readlink: Permission denied) 2024-09-10T23:29:27.868 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56188 ceph-osd ceph NOFD /proc/55620/task/56188/fd (opendir: Permission denied) 2024-09-10T23:29:27.868 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56246 ceph-osd ceph cwd unknown /proc/55620/task/56246/cwd (readlink: Permission denied) 2024-09-10T23:29:27.868 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56246 ceph-osd ceph rtd unknown /proc/55620/task/56246/root (readlink: Permission denied) 2024-09-10T23:29:27.868 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56246 ceph-osd ceph txt unknown /proc/55620/task/56246/exe (readlink: Permission denied) 2024-09-10T23:29:27.868 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56246 ceph-osd ceph NOFD /proc/55620/task/56246/fd (opendir: Permission denied) 2024-09-10T23:29:27.868 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56252 ceph-osd ceph cwd unknown /proc/55620/task/56252/cwd (readlink: Permission denied) 2024-09-10T23:29:27.868 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56252 ceph-osd ceph rtd unknown /proc/55620/task/56252/root (readlink: Permission denied) 2024-09-10T23:29:27.868 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56252 ceph-osd ceph txt unknown /proc/55620/task/56252/exe (readlink: Permission denied) 2024-09-10T23:29:27.868 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56252 ceph-osd ceph NOFD /proc/55620/task/56252/fd (opendir: Permission denied) 2024-09-10T23:29:27.868 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56253 ceph-osd ceph cwd unknown /proc/55620/task/56253/cwd (readlink: Permission denied) 2024-09-10T23:29:27.868 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56253 ceph-osd ceph rtd unknown /proc/55620/task/56253/root (readlink: Permission denied) 2024-09-10T23:29:27.868 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56253 ceph-osd ceph txt unknown /proc/55620/task/56253/exe (readlink: Permission denied) 2024-09-10T23:29:27.868 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56253 ceph-osd ceph NOFD /proc/55620/task/56253/fd (opendir: Permission denied) 2024-09-10T23:29:27.869 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56254 safe_time ceph cwd unknown /proc/55620/task/56254/cwd (readlink: Permission denied) 2024-09-10T23:29:27.869 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56254 safe_time ceph rtd unknown /proc/55620/task/56254/root (readlink: Permission denied) 2024-09-10T23:29:27.869 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56254 safe_time ceph txt unknown /proc/55620/task/56254/exe (readlink: Permission denied) 2024-09-10T23:29:27.869 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56254 safe_time ceph NOFD /proc/55620/task/56254/fd (opendir: Permission denied) 2024-09-10T23:29:27.869 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56255 safe_time ceph cwd unknown /proc/55620/task/56255/cwd (readlink: Permission denied) 2024-09-10T23:29:27.869 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56255 safe_time ceph rtd unknown /proc/55620/task/56255/root (readlink: Permission denied) 2024-09-10T23:29:27.869 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56255 safe_time ceph txt unknown /proc/55620/task/56255/exe (readlink: Permission denied) 2024-09-10T23:29:27.869 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56255 safe_time ceph NOFD /proc/55620/task/56255/fd (opendir: Permission denied) 2024-09-10T23:29:27.869 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56256 safe_time ceph cwd unknown /proc/55620/task/56256/cwd (readlink: Permission denied) 2024-09-10T23:29:27.870 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56256 safe_time ceph rtd unknown /proc/55620/task/56256/root (readlink: Permission denied) 2024-09-10T23:29:27.870 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56256 safe_time ceph txt unknown /proc/55620/task/56256/exe (readlink: Permission denied) 2024-09-10T23:29:27.870 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56256 safe_time ceph NOFD /proc/55620/task/56256/fd (opendir: Permission denied) 2024-09-10T23:29:27.870 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56257 safe_time ceph cwd unknown /proc/55620/task/56257/cwd (readlink: Permission denied) 2024-09-10T23:29:27.870 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56257 safe_time ceph rtd unknown /proc/55620/task/56257/root (readlink: Permission denied) 2024-09-10T23:29:27.870 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56257 safe_time ceph txt unknown /proc/55620/task/56257/exe (readlink: Permission denied) 2024-09-10T23:29:27.870 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56257 safe_time ceph NOFD /proc/55620/task/56257/fd (opendir: Permission denied) 2024-09-10T23:29:27.870 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56258 fn_anonym ceph cwd unknown /proc/55620/task/56258/cwd (readlink: Permission denied) 2024-09-10T23:29:27.870 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56258 fn_anonym ceph rtd unknown /proc/55620/task/56258/root (readlink: Permission denied) 2024-09-10T23:29:27.870 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56258 fn_anonym ceph txt unknown /proc/55620/task/56258/exe (readlink: Permission denied) 2024-09-10T23:29:27.870 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56258 fn_anonym ceph NOFD /proc/55620/task/56258/fd (opendir: Permission denied) 2024-09-10T23:29:27.870 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56277 rocksdb:l ceph cwd unknown /proc/55620/task/56277/cwd (readlink: Permission denied) 2024-09-10T23:29:27.870 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56277 rocksdb:l ceph rtd unknown /proc/55620/task/56277/root (readlink: Permission denied) 2024-09-10T23:29:27.871 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56277 rocksdb:l ceph txt unknown /proc/55620/task/56277/exe (readlink: Permission denied) 2024-09-10T23:29:27.871 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56277 rocksdb:l ceph NOFD /proc/55620/task/56277/fd (opendir: Permission denied) 2024-09-10T23:29:27.871 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56278 rocksdb:l ceph cwd unknown /proc/55620/task/56278/cwd (readlink: Permission denied) 2024-09-10T23:29:27.871 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56278 rocksdb:l ceph rtd unknown /proc/55620/task/56278/root (readlink: Permission denied) 2024-09-10T23:29:27.871 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56278 rocksdb:l ceph txt unknown /proc/55620/task/56278/exe (readlink: Permission denied) 2024-09-10T23:29:27.871 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56278 rocksdb:l ceph NOFD /proc/55620/task/56278/fd (opendir: Permission denied) 2024-09-10T23:29:27.871 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56279 rocksdb:l ceph cwd unknown /proc/55620/task/56279/cwd (readlink: Permission denied) 2024-09-10T23:29:27.871 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56279 rocksdb:l ceph rtd unknown /proc/55620/task/56279/root (readlink: Permission denied) 2024-09-10T23:29:27.871 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56279 rocksdb:l ceph txt unknown /proc/55620/task/56279/exe (readlink: Permission denied) 2024-09-10T23:29:27.871 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56279 rocksdb:l ceph NOFD /proc/55620/task/56279/fd (opendir: Permission denied) 2024-09-10T23:29:27.871 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56280 rocksdb:h ceph cwd unknown /proc/55620/task/56280/cwd (readlink: Permission denied) 2024-09-10T23:29:27.871 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56280 rocksdb:h ceph rtd unknown /proc/55620/task/56280/root (readlink: Permission denied) 2024-09-10T23:29:27.871 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56280 rocksdb:h ceph txt unknown /proc/55620/task/56280/exe (readlink: Permission denied) 2024-09-10T23:29:27.871 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56280 rocksdb:h ceph NOFD /proc/55620/task/56280/fd (opendir: Permission denied) 2024-09-10T23:29:27.871 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56805 bstore_ai ceph cwd unknown /proc/55620/task/56805/cwd (readlink: Permission denied) 2024-09-10T23:29:27.872 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56805 bstore_ai ceph rtd unknown /proc/55620/task/56805/root (readlink: Permission denied) 2024-09-10T23:29:27.872 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56805 bstore_ai ceph txt unknown /proc/55620/task/56805/exe (readlink: Permission denied) 2024-09-10T23:29:27.872 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56805 bstore_ai ceph NOFD /proc/55620/task/56805/fd (opendir: Permission denied) 2024-09-10T23:29:27.872 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56995 bstore_ai ceph cwd unknown /proc/55620/task/56995/cwd (readlink: Permission denied) 2024-09-10T23:29:27.872 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56995 bstore_ai ceph rtd unknown /proc/55620/task/56995/root (readlink: Permission denied) 2024-09-10T23:29:27.872 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56995 bstore_ai ceph txt unknown /proc/55620/task/56995/exe (readlink: Permission denied) 2024-09-10T23:29:27.872 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 56995 bstore_ai ceph NOFD /proc/55620/task/56995/fd (opendir: Permission denied) 2024-09-10T23:29:27.872 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57179 ceph-osd ceph cwd unknown /proc/55620/task/57179/cwd (readlink: Permission denied) 2024-09-10T23:29:27.872 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57179 ceph-osd ceph rtd unknown /proc/55620/task/57179/root (readlink: Permission denied) 2024-09-10T23:29:27.873 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57179 ceph-osd ceph txt unknown /proc/55620/task/57179/exe (readlink: Permission denied) 2024-09-10T23:29:27.873 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57179 ceph-osd ceph NOFD /proc/55620/task/57179/fd (opendir: Permission denied) 2024-09-10T23:29:27.873 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57180 cfin ceph cwd unknown /proc/55620/task/57180/cwd (readlink: Permission denied) 2024-09-10T23:29:27.873 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57180 cfin ceph rtd unknown /proc/55620/task/57180/root (readlink: Permission denied) 2024-09-10T23:29:27.873 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57180 cfin ceph txt unknown /proc/55620/task/57180/exe (readlink: Permission denied) 2024-09-10T23:29:28.029 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57180 cfin ceph NOFD /proc/55620/task/57180/fd (opendir: Permission denied) 2024-09-10T23:29:28.029 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57181 bstore_kv ceph cwd unknown /proc/55620/task/57181/cwd (readlink: Permission denied) 2024-09-10T23:29:28.029 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57181 bstore_kv ceph rtd unknown /proc/55620/task/57181/root (readlink: Permission denied) 2024-09-10T23:29:28.029 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57181 bstore_kv ceph txt unknown /proc/55620/task/57181/exe (readlink: Permission denied) 2024-09-10T23:29:28.030 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57181 bstore_kv ceph NOFD /proc/55620/task/57181/fd (opendir: Permission denied) 2024-09-10T23:29:28.030 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57182 bstore_kv ceph cwd unknown /proc/55620/task/57182/cwd (readlink: Permission denied) 2024-09-10T23:29:28.030 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57182 bstore_kv ceph rtd unknown /proc/55620/task/57182/root (readlink: Permission denied) 2024-09-10T23:29:28.030 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57182 bstore_kv ceph txt unknown /proc/55620/task/57182/exe (readlink: Permission denied) 2024-09-10T23:29:28.030 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57182 bstore_kv ceph NOFD /proc/55620/task/57182/fd (opendir: Permission denied) 2024-09-10T23:29:28.030 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57183 bstore_me ceph cwd unknown /proc/55620/task/57183/cwd (readlink: Permission denied) 2024-09-10T23:29:28.031 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57183 bstore_me ceph rtd unknown /proc/55620/task/57183/root (readlink: Permission denied) 2024-09-10T23:29:28.031 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57183 bstore_me ceph txt unknown /proc/55620/task/57183/exe (readlink: Permission denied) 2024-09-10T23:29:28.031 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57183 bstore_me ceph NOFD /proc/55620/task/57183/fd (opendir: Permission denied) 2024-09-10T23:29:28.031 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57184 ms_dispat ceph cwd unknown /proc/55620/task/57184/cwd (readlink: Permission denied) 2024-09-10T23:29:28.031 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57184 ms_dispat ceph rtd unknown /proc/55620/task/57184/root (readlink: Permission denied) 2024-09-10T23:29:28.032 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57184 ms_dispat ceph txt unknown /proc/55620/task/57184/exe (readlink: Permission denied) 2024-09-10T23:29:28.032 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57184 ms_dispat ceph NOFD /proc/55620/task/57184/fd (opendir: Permission denied) 2024-09-10T23:29:28.032 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57185 ms_local ceph cwd unknown /proc/55620/task/57185/cwd (readlink: Permission denied) 2024-09-10T23:29:28.032 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57185 ms_local ceph rtd unknown /proc/55620/task/57185/root (readlink: Permission denied) 2024-09-10T23:29:28.032 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57185 ms_local ceph txt unknown /proc/55620/task/57185/exe (readlink: Permission denied) 2024-09-10T23:29:28.032 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57185 ms_local ceph NOFD /proc/55620/task/57185/fd (opendir: Permission denied) 2024-09-10T23:29:28.032 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57186 safe_time ceph cwd unknown /proc/55620/task/57186/cwd (readlink: Permission denied) 2024-09-10T23:29:28.033 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57186 safe_time ceph rtd unknown /proc/55620/task/57186/root (readlink: Permission denied) 2024-09-10T23:29:28.033 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57186 safe_time ceph txt unknown /proc/55620/task/57186/exe (readlink: Permission denied) 2024-09-10T23:29:28.033 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57186 safe_time ceph NOFD /proc/55620/task/57186/fd (opendir: Permission denied) 2024-09-10T23:29:28.033 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57187 safe_time ceph cwd unknown /proc/55620/task/57187/cwd (readlink: Permission denied) 2024-09-10T23:29:28.033 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57187 safe_time ceph rtd unknown /proc/55620/task/57187/root (readlink: Permission denied) 2024-09-10T23:29:28.033 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57187 safe_time ceph txt unknown /proc/55620/task/57187/exe (readlink: Permission denied) 2024-09-10T23:29:28.034 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57187 safe_time ceph NOFD /proc/55620/task/57187/fd (opendir: Permission denied) 2024-09-10T23:29:28.034 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57188 ms_dispat ceph cwd unknown /proc/55620/task/57188/cwd (readlink: Permission denied) 2024-09-10T23:29:28.034 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57188 ms_dispat ceph rtd unknown /proc/55620/task/57188/root (readlink: Permission denied) 2024-09-10T23:29:28.034 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57188 ms_dispat ceph txt unknown /proc/55620/task/57188/exe (readlink: Permission denied) 2024-09-10T23:29:28.034 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57188 ms_dispat ceph NOFD /proc/55620/task/57188/fd (opendir: Permission denied) 2024-09-10T23:29:28.034 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57189 ms_local ceph cwd unknown /proc/55620/task/57189/cwd (readlink: Permission denied) 2024-09-10T23:29:28.035 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57189 ms_local ceph rtd unknown /proc/55620/task/57189/root (readlink: Permission denied) 2024-09-10T23:29:28.035 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57189 ms_local ceph txt unknown /proc/55620/task/57189/exe (readlink: Permission denied) 2024-09-10T23:29:28.035 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57189 ms_local ceph NOFD /proc/55620/task/57189/fd (opendir: Permission denied) 2024-09-10T23:29:28.035 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57190 ms_dispat ceph cwd unknown /proc/55620/task/57190/cwd (readlink: Permission denied) 2024-09-10T23:29:28.035 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57190 ms_dispat ceph rtd unknown /proc/55620/task/57190/root (readlink: Permission denied) 2024-09-10T23:29:28.035 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57190 ms_dispat ceph txt unknown /proc/55620/task/57190/exe (readlink: Permission denied) 2024-09-10T23:29:28.036 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57190 ms_dispat ceph NOFD /proc/55620/task/57190/fd (opendir: Permission denied) 2024-09-10T23:29:28.036 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57191 ms_local ceph cwd unknown /proc/55620/task/57191/cwd (readlink: Permission denied) 2024-09-10T23:29:28.036 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57191 ms_local ceph rtd unknown /proc/55620/task/57191/root (readlink: Permission denied) 2024-09-10T23:29:28.036 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57191 ms_local ceph txt unknown /proc/55620/task/57191/exe (readlink: Permission denied) 2024-09-10T23:29:28.036 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57191 ms_local ceph NOFD /proc/55620/task/57191/fd (opendir: Permission denied) 2024-09-10T23:29:28.036 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57192 ms_dispat ceph cwd unknown /proc/55620/task/57192/cwd (readlink: Permission denied) 2024-09-10T23:29:28.036 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57192 ms_dispat ceph rtd unknown /proc/55620/task/57192/root (readlink: Permission denied) 2024-09-10T23:29:28.037 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57192 ms_dispat ceph txt unknown /proc/55620/task/57192/exe (readlink: Permission denied) 2024-09-10T23:29:28.037 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57192 ms_dispat ceph NOFD /proc/55620/task/57192/fd (opendir: Permission denied) 2024-09-10T23:29:28.037 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57193 ms_local ceph cwd unknown /proc/55620/task/57193/cwd (readlink: Permission denied) 2024-09-10T23:29:28.037 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57193 ms_local ceph rtd unknown /proc/55620/task/57193/root (readlink: Permission denied) 2024-09-10T23:29:28.037 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57193 ms_local ceph txt unknown /proc/55620/task/57193/exe (readlink: Permission denied) 2024-09-10T23:29:28.037 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57193 ms_local ceph NOFD /proc/55620/task/57193/fd (opendir: Permission denied) 2024-09-10T23:29:28.037 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57194 ms_dispat ceph cwd unknown /proc/55620/task/57194/cwd (readlink: Permission denied) 2024-09-10T23:29:28.038 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57194 ms_dispat ceph rtd unknown /proc/55620/task/57194/root (readlink: Permission denied) 2024-09-10T23:29:28.038 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57194 ms_dispat ceph txt unknown /proc/55620/task/57194/exe (readlink: Permission denied) 2024-09-10T23:29:28.038 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57194 ms_dispat ceph NOFD /proc/55620/task/57194/fd (opendir: Permission denied) 2024-09-10T23:29:28.038 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57195 ms_local ceph cwd unknown /proc/55620/task/57195/cwd (readlink: Permission denied) 2024-09-10T23:29:28.038 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57195 ms_local ceph rtd unknown /proc/55620/task/57195/root (readlink: Permission denied) 2024-09-10T23:29:28.038 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57195 ms_local ceph txt unknown /proc/55620/task/57195/exe (readlink: Permission denied) 2024-09-10T23:29:28.039 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57195 ms_local ceph NOFD /proc/55620/task/57195/fd (opendir: Permission denied) 2024-09-10T23:29:28.039 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57196 ms_dispat ceph cwd unknown /proc/55620/task/57196/cwd (readlink: Permission denied) 2024-09-10T23:29:28.039 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57196 ms_dispat ceph rtd unknown /proc/55620/task/57196/root (readlink: Permission denied) 2024-09-10T23:29:28.039 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57196 ms_dispat ceph txt unknown /proc/55620/task/57196/exe (readlink: Permission denied) 2024-09-10T23:29:28.039 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57196 ms_dispat ceph NOFD /proc/55620/task/57196/fd (opendir: Permission denied) 2024-09-10T23:29:28.039 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57197 ms_local ceph cwd unknown /proc/55620/task/57197/cwd (readlink: Permission denied) 2024-09-10T23:29:28.040 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57197 ms_local ceph rtd unknown /proc/55620/task/57197/root (readlink: Permission denied) 2024-09-10T23:29:28.040 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57197 ms_local ceph txt unknown /proc/55620/task/57197/exe (readlink: Permission denied) 2024-09-10T23:29:28.040 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57197 ms_local ceph NOFD /proc/55620/task/57197/fd (opendir: Permission denied) 2024-09-10T23:29:28.040 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57198 ms_dispat ceph cwd unknown /proc/55620/task/57198/cwd (readlink: Permission denied) 2024-09-10T23:29:28.040 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57198 ms_dispat ceph rtd unknown /proc/55620/task/57198/root (readlink: Permission denied) 2024-09-10T23:29:28.040 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57198 ms_dispat ceph txt unknown /proc/55620/task/57198/exe (readlink: Permission denied) 2024-09-10T23:29:28.040 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57198 ms_dispat ceph NOFD /proc/55620/task/57198/fd (opendir: Permission denied) 2024-09-10T23:29:28.041 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57199 ms_local ceph cwd unknown /proc/55620/task/57199/cwd (readlink: Permission denied) 2024-09-10T23:29:28.041 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57199 ms_local ceph rtd unknown /proc/55620/task/57199/root (readlink: Permission denied) 2024-09-10T23:29:28.041 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57199 ms_local ceph txt unknown /proc/55620/task/57199/exe (readlink: Permission denied) 2024-09-10T23:29:28.041 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57199 ms_local ceph NOFD /proc/55620/task/57199/fd (opendir: Permission denied) 2024-09-10T23:29:28.041 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57200 fn_anonym ceph cwd unknown /proc/55620/task/57200/cwd (readlink: Permission denied) 2024-09-10T23:29:28.041 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57200 fn_anonym ceph rtd unknown /proc/55620/task/57200/root (readlink: Permission denied) 2024-09-10T23:29:28.042 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57200 fn_anonym ceph txt unknown /proc/55620/task/57200/exe (readlink: Permission denied) 2024-09-10T23:29:28.042 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57200 fn_anonym ceph NOFD /proc/55620/task/57200/fd (opendir: Permission denied) 2024-09-10T23:29:28.042 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57201 finisher ceph cwd unknown /proc/55620/task/57201/cwd (readlink: Permission denied) 2024-09-10T23:29:28.042 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57201 finisher ceph rtd unknown /proc/55620/task/57201/root (readlink: Permission denied) 2024-09-10T23:29:28.042 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57201 finisher ceph txt unknown /proc/55620/task/57201/exe (readlink: Permission denied) 2024-09-10T23:29:28.042 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57201 finisher ceph NOFD /proc/55620/task/57201/fd (opendir: Permission denied) 2024-09-10T23:29:28.043 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57202 safe_time ceph cwd unknown /proc/55620/task/57202/cwd (readlink: Permission denied) 2024-09-10T23:29:28.043 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57202 safe_time ceph rtd unknown /proc/55620/task/57202/root (readlink: Permission denied) 2024-09-10T23:29:28.043 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57202 safe_time ceph txt unknown /proc/55620/task/57202/exe (readlink: Permission denied) 2024-09-10T23:29:28.043 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57202 safe_time ceph NOFD /proc/55620/task/57202/fd (opendir: Permission denied) 2024-09-10T23:29:28.043 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57203 safe_time ceph cwd unknown /proc/55620/task/57203/cwd (readlink: Permission denied) 2024-09-10T23:29:28.043 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57203 safe_time ceph rtd unknown /proc/55620/task/57203/root (readlink: Permission denied) 2024-09-10T23:29:28.043 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57203 safe_time ceph txt unknown /proc/55620/task/57203/exe (readlink: Permission denied) 2024-09-10T23:29:28.044 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57203 safe_time ceph NOFD /proc/55620/task/57203/fd (opendir: Permission denied) 2024-09-10T23:29:28.044 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57204 ceph-osd ceph cwd unknown /proc/55620/task/57204/cwd (readlink: Permission denied) 2024-09-10T23:29:28.044 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57204 ceph-osd ceph rtd unknown /proc/55620/task/57204/root (readlink: Permission denied) 2024-09-10T23:29:28.044 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57204 ceph-osd ceph txt unknown /proc/55620/task/57204/exe (readlink: Permission denied) 2024-09-10T23:29:28.044 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57204 ceph-osd ceph NOFD /proc/55620/task/57204/fd (opendir: Permission denied) 2024-09-10T23:29:28.044 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57205 osd_srv_a ceph cwd unknown /proc/55620/task/57205/cwd (readlink: Permission denied) 2024-09-10T23:29:28.045 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57205 osd_srv_a ceph rtd unknown /proc/55620/task/57205/root (readlink: Permission denied) 2024-09-10T23:29:28.045 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57205 osd_srv_a ceph txt unknown /proc/55620/task/57205/exe (readlink: Permission denied) 2024-09-10T23:29:28.045 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57205 osd_srv_a ceph NOFD /proc/55620/task/57205/fd (opendir: Permission denied) 2024-09-10T23:29:28.045 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57206 tp_osd_tp ceph cwd unknown /proc/55620/task/57206/cwd (readlink: Permission denied) 2024-09-10T23:29:28.045 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57206 tp_osd_tp ceph rtd unknown /proc/55620/task/57206/root (readlink: Permission denied) 2024-09-10T23:29:28.045 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57206 tp_osd_tp ceph txt unknown /proc/55620/task/57206/exe (readlink: Permission denied) 2024-09-10T23:29:28.046 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57206 tp_osd_tp ceph NOFD /proc/55620/task/57206/fd (opendir: Permission denied) 2024-09-10T23:29:28.046 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57207 tp_osd_tp ceph cwd unknown /proc/55620/task/57207/cwd (readlink: Permission denied) 2024-09-10T23:29:28.046 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57207 tp_osd_tp ceph rtd unknown /proc/55620/task/57207/root (readlink: Permission denied) 2024-09-10T23:29:28.046 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57207 tp_osd_tp ceph txt unknown /proc/55620/task/57207/exe (readlink: Permission denied) 2024-09-10T23:29:28.046 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57207 tp_osd_tp ceph NOFD /proc/55620/task/57207/fd (opendir: Permission denied) 2024-09-10T23:29:28.046 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57208 tp_osd_tp ceph cwd unknown /proc/55620/task/57208/cwd (readlink: Permission denied) 2024-09-10T23:29:28.046 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57208 tp_osd_tp ceph rtd unknown /proc/55620/task/57208/root (readlink: Permission denied) 2024-09-10T23:29:28.047 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57208 tp_osd_tp ceph txt unknown /proc/55620/task/57208/exe (readlink: Permission denied) 2024-09-10T23:29:28.047 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57208 tp_osd_tp ceph NOFD /proc/55620/task/57208/fd (opendir: Permission denied) 2024-09-10T23:29:28.047 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57209 tp_osd_tp ceph cwd unknown /proc/55620/task/57209/cwd (readlink: Permission denied) 2024-09-10T23:29:28.047 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57209 tp_osd_tp ceph rtd unknown /proc/55620/task/57209/root (readlink: Permission denied) 2024-09-10T23:29:28.047 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57209 tp_osd_tp ceph txt unknown /proc/55620/task/57209/exe (readlink: Permission denied) 2024-09-10T23:29:28.047 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57209 tp_osd_tp ceph NOFD /proc/55620/task/57209/fd (opendir: Permission denied) 2024-09-10T23:29:28.048 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57210 tp_osd_tp ceph cwd unknown /proc/55620/task/57210/cwd (readlink: Permission denied) 2024-09-10T23:29:28.048 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57210 tp_osd_tp ceph rtd unknown /proc/55620/task/57210/root (readlink: Permission denied) 2024-09-10T23:29:28.048 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57210 tp_osd_tp ceph txt unknown /proc/55620/task/57210/exe (readlink: Permission denied) 2024-09-10T23:29:28.048 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57210 tp_osd_tp ceph NOFD /proc/55620/task/57210/fd (opendir: Permission denied) 2024-09-10T23:29:28.048 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57211 tp_osd_tp ceph cwd unknown /proc/55620/task/57211/cwd (readlink: Permission denied) 2024-09-10T23:29:28.048 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57211 tp_osd_tp ceph rtd unknown /proc/55620/task/57211/root (readlink: Permission denied) 2024-09-10T23:29:28.048 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57211 tp_osd_tp ceph txt unknown /proc/55620/task/57211/exe (readlink: Permission denied) 2024-09-10T23:29:28.048 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57211 tp_osd_tp ceph NOFD /proc/55620/task/57211/fd (opendir: Permission denied) 2024-09-10T23:29:28.049 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57212 tp_osd_tp ceph cwd unknown /proc/55620/task/57212/cwd (readlink: Permission denied) 2024-09-10T23:29:28.049 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57212 tp_osd_tp ceph rtd unknown /proc/55620/task/57212/root (readlink: Permission denied) 2024-09-10T23:29:28.049 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57212 tp_osd_tp ceph txt unknown /proc/55620/task/57212/exe (readlink: Permission denied) 2024-09-10T23:29:28.049 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57212 tp_osd_tp ceph NOFD /proc/55620/task/57212/fd (opendir: Permission denied) 2024-09-10T23:29:28.049 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57213 tp_osd_tp ceph cwd unknown /proc/55620/task/57213/cwd (readlink: Permission denied) 2024-09-10T23:29:28.049 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57213 tp_osd_tp ceph rtd unknown /proc/55620/task/57213/root (readlink: Permission denied) 2024-09-10T23:29:28.049 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57213 tp_osd_tp ceph txt unknown /proc/55620/task/57213/exe (readlink: Permission denied) 2024-09-10T23:29:28.050 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57213 tp_osd_tp ceph NOFD /proc/55620/task/57213/fd (opendir: Permission denied) 2024-09-10T23:29:28.050 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57214 tp_osd_tp ceph cwd unknown /proc/55620/task/57214/cwd (readlink: Permission denied) 2024-09-10T23:29:28.050 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57214 tp_osd_tp ceph rtd unknown /proc/55620/task/57214/root (readlink: Permission denied) 2024-09-10T23:29:28.050 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57214 tp_osd_tp ceph txt unknown /proc/55620/task/57214/exe (readlink: Permission denied) 2024-09-10T23:29:28.050 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57214 tp_osd_tp ceph NOFD /proc/55620/task/57214/fd (opendir: Permission denied) 2024-09-10T23:29:28.050 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57215 tp_osd_tp ceph cwd unknown /proc/55620/task/57215/cwd (readlink: Permission denied) 2024-09-10T23:29:28.050 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57215 tp_osd_tp ceph rtd unknown /proc/55620/task/57215/root (readlink: Permission denied) 2024-09-10T23:29:28.051 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57215 tp_osd_tp ceph txt unknown /proc/55620/task/57215/exe (readlink: Permission denied) 2024-09-10T23:29:28.051 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57215 tp_osd_tp ceph NOFD /proc/55620/task/57215/fd (opendir: Permission denied) 2024-09-10T23:29:28.051 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57216 tp_osd_tp ceph cwd unknown /proc/55620/task/57216/cwd (readlink: Permission denied) 2024-09-10T23:29:28.051 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57216 tp_osd_tp ceph rtd unknown /proc/55620/task/57216/root (readlink: Permission denied) 2024-09-10T23:29:28.051 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57216 tp_osd_tp ceph txt unknown /proc/55620/task/57216/exe (readlink: Permission denied) 2024-09-10T23:29:28.051 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57216 tp_osd_tp ceph NOFD /proc/55620/task/57216/fd (opendir: Permission denied) 2024-09-10T23:29:28.051 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57217 tp_osd_tp ceph cwd unknown /proc/55620/task/57217/cwd (readlink: Permission denied) 2024-09-10T23:29:28.051 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57217 tp_osd_tp ceph rtd unknown /proc/55620/task/57217/root (readlink: Permission denied) 2024-09-10T23:29:28.051 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57217 tp_osd_tp ceph txt unknown /proc/55620/task/57217/exe (readlink: Permission denied) 2024-09-10T23:29:28.052 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57217 tp_osd_tp ceph NOFD /proc/55620/task/57217/fd (opendir: Permission denied) 2024-09-10T23:29:28.052 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57218 tp_osd_tp ceph cwd unknown /proc/55620/task/57218/cwd (readlink: Permission denied) 2024-09-10T23:29:28.052 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57218 tp_osd_tp ceph rtd unknown /proc/55620/task/57218/root (readlink: Permission denied) 2024-09-10T23:29:28.052 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57218 tp_osd_tp ceph txt unknown /proc/55620/task/57218/exe (readlink: Permission denied) 2024-09-10T23:29:28.052 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57218 tp_osd_tp ceph NOFD /proc/55620/task/57218/fd (opendir: Permission denied) 2024-09-10T23:29:28.052 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57219 tp_osd_tp ceph cwd unknown /proc/55620/task/57219/cwd (readlink: Permission denied) 2024-09-10T23:29:28.052 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57219 tp_osd_tp ceph rtd unknown /proc/55620/task/57219/root (readlink: Permission denied) 2024-09-10T23:29:28.052 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57219 tp_osd_tp ceph txt unknown /proc/55620/task/57219/exe (readlink: Permission denied) 2024-09-10T23:29:28.052 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57219 tp_osd_tp ceph NOFD /proc/55620/task/57219/fd (opendir: Permission denied) 2024-09-10T23:29:28.053 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57220 tp_osd_tp ceph cwd unknown /proc/55620/task/57220/cwd (readlink: Permission denied) 2024-09-10T23:29:28.053 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57220 tp_osd_tp ceph rtd unknown /proc/55620/task/57220/root (readlink: Permission denied) 2024-09-10T23:29:28.053 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57220 tp_osd_tp ceph txt unknown /proc/55620/task/57220/exe (readlink: Permission denied) 2024-09-10T23:29:28.053 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57220 tp_osd_tp ceph NOFD /proc/55620/task/57220/fd (opendir: Permission denied) 2024-09-10T23:29:28.053 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57221 tp_osd_tp ceph cwd unknown /proc/55620/task/57221/cwd (readlink: Permission denied) 2024-09-10T23:29:28.053 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57221 tp_osd_tp ceph rtd unknown /proc/55620/task/57221/root (readlink: Permission denied) 2024-09-10T23:29:28.054 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57221 tp_osd_tp ceph txt unknown /proc/55620/task/57221/exe (readlink: Permission denied) 2024-09-10T23:29:28.054 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57221 tp_osd_tp ceph NOFD /proc/55620/task/57221/fd (opendir: Permission denied) 2024-09-10T23:29:28.054 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57222 osd_srv_h ceph cwd unknown /proc/55620/task/57222/cwd (readlink: Permission denied) 2024-09-10T23:29:28.054 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57222 osd_srv_h ceph rtd unknown /proc/55620/task/57222/root (readlink: Permission denied) 2024-09-10T23:29:28.054 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57222 osd_srv_h ceph txt unknown /proc/55620/task/57222/exe (readlink: Permission denied) 2024-09-10T23:29:28.054 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 55620 57222 osd_srv_h ceph NOFD /proc/55620/task/57222/fd (opendir: Permission denied) 2024-09-10T23:29:28.054 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 56748 root cwd unknown /proc/56748/cwd (readlink: Permission denied) 2024-09-10T23:29:28.055 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 56748 root rtd unknown /proc/56748/root (readlink: Permission denied) 2024-09-10T23:29:28.055 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 56748 root txt unknown /proc/56748/exe (readlink: Permission denied) 2024-09-10T23:29:28.055 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 56748 root NOFD /proc/56748/fd (opendir: Permission denied) 2024-09-10T23:29:28.055 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 56777 root cwd unknown /proc/56777/cwd (readlink: Permission denied) 2024-09-10T23:29:28.055 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 56777 root rtd unknown /proc/56777/root (readlink: Permission denied) 2024-09-10T23:29:28.055 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 56777 root txt unknown /proc/56777/exe (readlink: Permission denied) 2024-09-10T23:29:28.055 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 56777 root NOFD /proc/56777/fd (opendir: Permission denied) 2024-09-10T23:29:28.056 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/4 59834 root cwd unknown /proc/59834/cwd (readlink: Permission denied) 2024-09-10T23:29:28.056 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/4 59834 root rtd unknown /proc/59834/root (readlink: Permission denied) 2024-09-10T23:29:28.056 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/4 59834 root txt unknown /proc/59834/exe (readlink: Permission denied) 2024-09-10T23:29:28.056 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/4 59834 root NOFD /proc/59834/fd (opendir: Permission denied) 2024-09-10T23:29:28.056 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 60208 root cwd unknown /proc/60208/cwd (readlink: Permission denied) 2024-09-10T23:29:28.056 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 60208 root rtd unknown /proc/60208/root (readlink: Permission denied) 2024-09-10T23:29:28.057 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 60208 root txt unknown /proc/60208/exe (readlink: Permission denied) 2024-09-10T23:29:28.057 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 60208 root NOFD /proc/60208/fd (opendir: Permission denied) 2024-09-10T23:29:28.057 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 60555 root cwd unknown /proc/60555/cwd (readlink: Permission denied) 2024-09-10T23:29:28.057 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 60555 root rtd unknown /proc/60555/root (readlink: Permission denied) 2024-09-10T23:29:28.057 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 60555 root txt unknown /proc/60555/exe (readlink: Permission denied) 2024-09-10T23:29:28.057 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 60555 root NOFD /proc/60555/fd (opendir: Permission denied) 2024-09-10T23:29:28.057 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/6 61942 root cwd unknown /proc/61942/cwd (readlink: Permission denied) 2024-09-10T23:29:28.057 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/6 61942 root rtd unknown /proc/61942/root (readlink: Permission denied) 2024-09-10T23:29:28.058 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/6 61942 root txt unknown /proc/61942/exe (readlink: Permission denied) 2024-09-10T23:29:28.058 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/6 61942 root NOFD /proc/61942/fd (opendir: Permission denied) 2024-09-10T23:29:28.058 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 62561 root cwd unknown /proc/62561/cwd (readlink: Permission denied) 2024-09-10T23:29:28.058 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 62561 root rtd unknown /proc/62561/root (readlink: Permission denied) 2024-09-10T23:29:28.058 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 62561 root txt unknown /proc/62561/exe (readlink: Permission denied) 2024-09-10T23:29:28.058 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 62561 root NOFD /proc/62561/fd (opendir: Permission denied) 2024-09-10T23:29:28.058 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 62563 root cwd unknown /proc/62563/cwd (readlink: Permission denied) 2024-09-10T23:29:28.059 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 62563 root rtd unknown /proc/62563/root (readlink: Permission denied) 2024-09-10T23:29:28.059 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 62563 root txt unknown /proc/62563/exe (readlink: Permission denied) 2024-09-10T23:29:28.059 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 62563 root NOFD /proc/62563/fd (opendir: Permission denied) 2024-09-10T23:29:28.059 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 ceph cwd unknown /proc/62565/cwd (readlink: Permission denied) 2024-09-10T23:29:28.059 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 ceph rtd unknown /proc/62565/root (readlink: Permission denied) 2024-09-10T23:29:28.059 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 ceph txt unknown /proc/62565/exe (readlink: Permission denied) 2024-09-10T23:29:28.059 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 ceph NOFD /proc/62565/fd (opendir: Permission denied) 2024-09-10T23:29:28.059 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62566 log ceph cwd unknown /proc/62565/task/62566/cwd (readlink: Permission denied) 2024-09-10T23:29:28.060 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62566 log ceph rtd unknown /proc/62565/task/62566/root (readlink: Permission denied) 2024-09-10T23:29:28.060 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62566 log ceph txt unknown /proc/62565/task/62566/exe (readlink: Permission denied) 2024-09-10T23:29:28.060 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62566 log ceph NOFD /proc/62565/task/62566/fd (opendir: Permission denied) 2024-09-10T23:29:28.060 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62568 msgr-work ceph cwd unknown /proc/62565/task/62568/cwd (readlink: Permission denied) 2024-09-10T23:29:28.060 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62568 msgr-work ceph rtd unknown /proc/62565/task/62568/root (readlink: Permission denied) 2024-09-10T23:29:28.060 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62568 msgr-work ceph txt unknown /proc/62565/task/62568/exe (readlink: Permission denied) 2024-09-10T23:29:28.060 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62568 msgr-work ceph NOFD /proc/62565/task/62568/fd (opendir: Permission denied) 2024-09-10T23:29:28.061 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62569 msgr-work ceph cwd unknown /proc/62565/task/62569/cwd (readlink: Permission denied) 2024-09-10T23:29:28.061 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62569 msgr-work ceph rtd unknown /proc/62565/task/62569/root (readlink: Permission denied) 2024-09-10T23:29:28.061 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62569 msgr-work ceph txt unknown /proc/62565/task/62569/exe (readlink: Permission denied) 2024-09-10T23:29:28.061 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62569 msgr-work ceph NOFD /proc/62565/task/62569/fd (opendir: Permission denied) 2024-09-10T23:29:28.061 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62570 msgr-work ceph cwd unknown /proc/62565/task/62570/cwd (readlink: Permission denied) 2024-09-10T23:29:28.061 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62570 msgr-work ceph rtd unknown /proc/62565/task/62570/root (readlink: Permission denied) 2024-09-10T23:29:28.062 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62570 msgr-work ceph txt unknown /proc/62565/task/62570/exe (readlink: Permission denied) 2024-09-10T23:29:28.062 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62570 msgr-work ceph NOFD /proc/62565/task/62570/fd (opendir: Permission denied) 2024-09-10T23:29:28.062 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62574 service ceph cwd unknown /proc/62565/task/62574/cwd (readlink: Permission denied) 2024-09-10T23:29:28.062 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62574 service ceph rtd unknown /proc/62565/task/62574/root (readlink: Permission denied) 2024-09-10T23:29:28.062 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62574 service ceph txt unknown /proc/62565/task/62574/exe (readlink: Permission denied) 2024-09-10T23:29:28.062 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62574 service ceph NOFD /proc/62565/task/62574/fd (opendir: Permission denied) 2024-09-10T23:29:28.062 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62575 admin_soc ceph cwd unknown /proc/62565/task/62575/cwd (readlink: Permission denied) 2024-09-10T23:29:28.063 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62575 admin_soc ceph rtd unknown /proc/62565/task/62575/root (readlink: Permission denied) 2024-09-10T23:29:28.063 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62575 admin_soc ceph txt unknown /proc/62565/task/62575/exe (readlink: Permission denied) 2024-09-10T23:29:28.063 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62575 admin_soc ceph NOFD /proc/62565/task/62575/fd (opendir: Permission denied) 2024-09-10T23:29:28.063 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62900 signal_ha ceph cwd unknown /proc/62565/task/62900/cwd (readlink: Permission denied) 2024-09-10T23:29:28.063 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62900 signal_ha ceph rtd unknown /proc/62565/task/62900/root (readlink: Permission denied) 2024-09-10T23:29:28.063 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62900 signal_ha ceph txt unknown /proc/62565/task/62900/exe (readlink: Permission denied) 2024-09-10T23:29:28.063 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62900 signal_ha ceph NOFD /proc/62565/task/62900/fd (opendir: Permission denied) 2024-09-10T23:29:28.064 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62901 io_contex ceph cwd unknown /proc/62565/task/62901/cwd (readlink: Permission denied) 2024-09-10T23:29:28.064 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62901 io_contex ceph rtd unknown /proc/62565/task/62901/root (readlink: Permission denied) 2024-09-10T23:29:28.064 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62901 io_contex ceph txt unknown /proc/62565/task/62901/exe (readlink: Permission denied) 2024-09-10T23:29:28.064 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62901 io_contex ceph NOFD /proc/62565/task/62901/fd (opendir: Permission denied) 2024-09-10T23:29:28.064 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62902 io_contex ceph cwd unknown /proc/62565/task/62902/cwd (readlink: Permission denied) 2024-09-10T23:29:28.064 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62902 io_contex ceph rtd unknown /proc/62565/task/62902/root (readlink: Permission denied) 2024-09-10T23:29:28.064 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62902 io_contex ceph txt unknown /proc/62565/task/62902/exe (readlink: Permission denied) 2024-09-10T23:29:28.065 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62902 io_contex ceph NOFD /proc/62565/task/62902/fd (opendir: Permission denied) 2024-09-10T23:29:28.065 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62911 OpHistory ceph cwd unknown /proc/62565/task/62911/cwd (readlink: Permission denied) 2024-09-10T23:29:28.065 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62911 OpHistory ceph rtd unknown /proc/62565/task/62911/root (readlink: Permission denied) 2024-09-10T23:29:28.065 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62911 OpHistory ceph txt unknown /proc/62565/task/62911/exe (readlink: Permission denied) 2024-09-10T23:29:28.066 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62911 OpHistory ceph NOFD /proc/62565/task/62911/fd (opendir: Permission denied) 2024-09-10T23:29:28.066 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62912 ceph_time ceph cwd unknown /proc/62565/task/62912/cwd (readlink: Permission denied) 2024-09-10T23:29:28.066 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62912 ceph_time ceph rtd unknown /proc/62565/task/62912/root (readlink: Permission denied) 2024-09-10T23:29:28.066 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62912 ceph_time ceph txt unknown /proc/62565/task/62912/exe (readlink: Permission denied) 2024-09-10T23:29:28.066 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 62912 ceph_time ceph NOFD /proc/62565/task/62912/fd (opendir: Permission denied) 2024-09-10T23:29:28.066 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63210 ceph-osd ceph cwd unknown /proc/62565/task/63210/cwd (readlink: Permission denied) 2024-09-10T23:29:28.066 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63210 ceph-osd ceph rtd unknown /proc/62565/task/63210/root (readlink: Permission denied) 2024-09-10T23:29:28.067 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63210 ceph-osd ceph txt unknown /proc/62565/task/63210/exe (readlink: Permission denied) 2024-09-10T23:29:28.067 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63210 ceph-osd ceph NOFD /proc/62565/task/63210/fd (opendir: Permission denied) 2024-09-10T23:29:28.067 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63211 safe_time ceph cwd unknown /proc/62565/task/63211/cwd (readlink: Permission denied) 2024-09-10T23:29:28.067 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63211 safe_time ceph rtd unknown /proc/62565/task/63211/root (readlink: Permission denied) 2024-09-10T23:29:28.067 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63211 safe_time ceph txt unknown /proc/62565/task/63211/exe (readlink: Permission denied) 2024-09-10T23:29:28.067 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63211 safe_time ceph NOFD /proc/62565/task/63211/fd (opendir: Permission denied) 2024-09-10T23:29:28.068 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63212 safe_time ceph cwd unknown /proc/62565/task/63212/cwd (readlink: Permission denied) 2024-09-10T23:29:28.068 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63212 safe_time ceph rtd unknown /proc/62565/task/63212/root (readlink: Permission denied) 2024-09-10T23:29:28.068 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63212 safe_time ceph txt unknown /proc/62565/task/63212/exe (readlink: Permission denied) 2024-09-10T23:29:28.068 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63212 safe_time ceph NOFD /proc/62565/task/63212/fd (opendir: Permission denied) 2024-09-10T23:29:28.068 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63213 safe_time ceph cwd unknown /proc/62565/task/63213/cwd (readlink: Permission denied) 2024-09-10T23:29:28.068 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63213 safe_time ceph rtd unknown /proc/62565/task/63213/root (readlink: Permission denied) 2024-09-10T23:29:28.068 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63213 safe_time ceph txt unknown /proc/62565/task/63213/exe (readlink: Permission denied) 2024-09-10T23:29:28.068 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63213 safe_time ceph NOFD /proc/62565/task/63213/fd (opendir: Permission denied) 2024-09-10T23:29:28.069 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63214 safe_time ceph cwd unknown /proc/62565/task/63214/cwd (readlink: Permission denied) 2024-09-10T23:29:28.069 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63214 safe_time ceph rtd unknown /proc/62565/task/63214/root (readlink: Permission denied) 2024-09-10T23:29:28.069 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63214 safe_time ceph txt unknown /proc/62565/task/63214/exe (readlink: Permission denied) 2024-09-10T23:29:28.069 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63214 safe_time ceph NOFD /proc/62565/task/63214/fd (opendir: Permission denied) 2024-09-10T23:29:28.069 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63215 fn_anonym ceph cwd unknown /proc/62565/task/63215/cwd (readlink: Permission denied) 2024-09-10T23:29:28.069 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63215 fn_anonym ceph rtd unknown /proc/62565/task/63215/root (readlink: Permission denied) 2024-09-10T23:29:28.069 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63215 fn_anonym ceph txt unknown /proc/62565/task/63215/exe (readlink: Permission denied) 2024-09-10T23:29:28.069 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63215 fn_anonym ceph NOFD /proc/62565/task/63215/fd (opendir: Permission denied) 2024-09-10T23:29:28.069 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63228 rocksdb:l ceph cwd unknown /proc/62565/task/63228/cwd (readlink: Permission denied) 2024-09-10T23:29:28.069 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63228 rocksdb:l ceph rtd unknown /proc/62565/task/63228/root (readlink: Permission denied) 2024-09-10T23:29:28.069 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63228 rocksdb:l ceph txt unknown /proc/62565/task/63228/exe (readlink: Permission denied) 2024-09-10T23:29:28.069 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63228 rocksdb:l ceph NOFD /proc/62565/task/63228/fd (opendir: Permission denied) 2024-09-10T23:29:28.070 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63229 rocksdb:l ceph cwd unknown /proc/62565/task/63229/cwd (readlink: Permission denied) 2024-09-10T23:29:28.070 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63229 rocksdb:l ceph rtd unknown /proc/62565/task/63229/root (readlink: Permission denied) 2024-09-10T23:29:28.070 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63229 rocksdb:l ceph txt unknown /proc/62565/task/63229/exe (readlink: Permission denied) 2024-09-10T23:29:28.070 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63229 rocksdb:l ceph NOFD /proc/62565/task/63229/fd (opendir: Permission denied) 2024-09-10T23:29:28.070 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63230 rocksdb:l ceph cwd unknown /proc/62565/task/63230/cwd (readlink: Permission denied) 2024-09-10T23:29:28.070 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63230 rocksdb:l ceph rtd unknown /proc/62565/task/63230/root (readlink: Permission denied) 2024-09-10T23:29:28.070 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63230 rocksdb:l ceph txt unknown /proc/62565/task/63230/exe (readlink: Permission denied) 2024-09-10T23:29:28.070 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63230 rocksdb:l ceph NOFD /proc/62565/task/63230/fd (opendir: Permission denied) 2024-09-10T23:29:28.070 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63231 rocksdb:h ceph cwd unknown /proc/62565/task/63231/cwd (readlink: Permission denied) 2024-09-10T23:29:28.070 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63231 rocksdb:h ceph rtd unknown /proc/62565/task/63231/root (readlink: Permission denied) 2024-09-10T23:29:28.070 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63231 rocksdb:h ceph txt unknown /proc/62565/task/63231/exe (readlink: Permission denied) 2024-09-10T23:29:28.070 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63231 rocksdb:h ceph NOFD /proc/62565/task/63231/fd (opendir: Permission denied) 2024-09-10T23:29:28.070 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63751 bstore_ai ceph cwd unknown /proc/62565/task/63751/cwd (readlink: Permission denied) 2024-09-10T23:29:28.071 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63751 bstore_ai ceph rtd unknown /proc/62565/task/63751/root (readlink: Permission denied) 2024-09-10T23:29:28.071 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63751 bstore_ai ceph txt unknown /proc/62565/task/63751/exe (readlink: Permission denied) 2024-09-10T23:29:28.071 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63751 bstore_ai ceph NOFD /proc/62565/task/63751/fd (opendir: Permission denied) 2024-09-10T23:29:28.071 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63941 bstore_ai ceph cwd unknown /proc/62565/task/63941/cwd (readlink: Permission denied) 2024-09-10T23:29:28.071 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63941 bstore_ai ceph rtd unknown /proc/62565/task/63941/root (readlink: Permission denied) 2024-09-10T23:29:28.071 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63941 bstore_ai ceph txt unknown /proc/62565/task/63941/exe (readlink: Permission denied) 2024-09-10T23:29:28.071 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 63941 bstore_ai ceph NOFD /proc/62565/task/63941/fd (opendir: Permission denied) 2024-09-10T23:29:28.071 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64124 ceph-osd ceph cwd unknown /proc/62565/task/64124/cwd (readlink: Permission denied) 2024-09-10T23:29:28.071 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64124 ceph-osd ceph rtd unknown /proc/62565/task/64124/root (readlink: Permission denied) 2024-09-10T23:29:28.071 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64124 ceph-osd ceph txt unknown /proc/62565/task/64124/exe (readlink: Permission denied) 2024-09-10T23:29:28.071 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64124 ceph-osd ceph NOFD /proc/62565/task/64124/fd (opendir: Permission denied) 2024-09-10T23:29:28.071 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64125 cfin ceph cwd unknown /proc/62565/task/64125/cwd (readlink: Permission denied) 2024-09-10T23:29:28.071 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64125 cfin ceph rtd unknown /proc/62565/task/64125/root (readlink: Permission denied) 2024-09-10T23:29:28.072 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64125 cfin ceph txt unknown /proc/62565/task/64125/exe (readlink: Permission denied) 2024-09-10T23:29:28.072 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64125 cfin ceph NOFD /proc/62565/task/64125/fd (opendir: Permission denied) 2024-09-10T23:29:28.072 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64126 bstore_kv ceph cwd unknown /proc/62565/task/64126/cwd (readlink: Permission denied) 2024-09-10T23:29:28.072 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64126 bstore_kv ceph rtd unknown /proc/62565/task/64126/root (readlink: Permission denied) 2024-09-10T23:29:28.072 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64126 bstore_kv ceph txt unknown /proc/62565/task/64126/exe (readlink: Permission denied) 2024-09-10T23:29:28.072 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64126 bstore_kv ceph NOFD /proc/62565/task/64126/fd (opendir: Permission denied) 2024-09-10T23:29:28.072 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64127 bstore_kv ceph cwd unknown /proc/62565/task/64127/cwd (readlink: Permission denied) 2024-09-10T23:29:28.072 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64127 bstore_kv ceph rtd unknown /proc/62565/task/64127/root (readlink: Permission denied) 2024-09-10T23:29:28.072 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64127 bstore_kv ceph txt unknown /proc/62565/task/64127/exe (readlink: Permission denied) 2024-09-10T23:29:28.072 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64127 bstore_kv ceph NOFD /proc/62565/task/64127/fd (opendir: Permission denied) 2024-09-10T23:29:28.072 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64128 bstore_me ceph cwd unknown /proc/62565/task/64128/cwd (readlink: Permission denied) 2024-09-10T23:29:28.072 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64128 bstore_me ceph rtd unknown /proc/62565/task/64128/root (readlink: Permission denied) 2024-09-10T23:29:28.072 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64128 bstore_me ceph txt unknown /proc/62565/task/64128/exe (readlink: Permission denied) 2024-09-10T23:29:28.072 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64128 bstore_me ceph NOFD /proc/62565/task/64128/fd (opendir: Permission denied) 2024-09-10T23:29:28.073 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64131 ms_dispat ceph cwd unknown /proc/62565/task/64131/cwd (readlink: Permission denied) 2024-09-10T23:29:28.073 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64131 ms_dispat ceph rtd unknown /proc/62565/task/64131/root (readlink: Permission denied) 2024-09-10T23:29:28.073 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64131 ms_dispat ceph txt unknown /proc/62565/task/64131/exe (readlink: Permission denied) 2024-09-10T23:29:28.073 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64131 ms_dispat ceph NOFD /proc/62565/task/64131/fd (opendir: Permission denied) 2024-09-10T23:29:28.073 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64132 ms_local ceph cwd unknown /proc/62565/task/64132/cwd (readlink: Permission denied) 2024-09-10T23:29:28.073 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64132 ms_local ceph rtd unknown /proc/62565/task/64132/root (readlink: Permission denied) 2024-09-10T23:29:28.073 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64132 ms_local ceph txt unknown /proc/62565/task/64132/exe (readlink: Permission denied) 2024-09-10T23:29:28.073 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64132 ms_local ceph NOFD /proc/62565/task/64132/fd (opendir: Permission denied) 2024-09-10T23:29:28.073 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64133 safe_time ceph cwd unknown /proc/62565/task/64133/cwd (readlink: Permission denied) 2024-09-10T23:29:28.073 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64133 safe_time ceph rtd unknown /proc/62565/task/64133/root (readlink: Permission denied) 2024-09-10T23:29:28.073 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64133 safe_time ceph txt unknown /proc/62565/task/64133/exe (readlink: Permission denied) 2024-09-10T23:29:28.073 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64133 safe_time ceph NOFD /proc/62565/task/64133/fd (opendir: Permission denied) 2024-09-10T23:29:28.074 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64134 safe_time ceph cwd unknown /proc/62565/task/64134/cwd (readlink: Permission denied) 2024-09-10T23:29:28.074 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64134 safe_time ceph rtd unknown /proc/62565/task/64134/root (readlink: Permission denied) 2024-09-10T23:29:28.074 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64134 safe_time ceph txt unknown /proc/62565/task/64134/exe (readlink: Permission denied) 2024-09-10T23:29:28.074 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64134 safe_time ceph NOFD /proc/62565/task/64134/fd (opendir: Permission denied) 2024-09-10T23:29:28.074 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64135 ms_dispat ceph cwd unknown /proc/62565/task/64135/cwd (readlink: Permission denied) 2024-09-10T23:29:28.074 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64135 ms_dispat ceph rtd unknown /proc/62565/task/64135/root (readlink: Permission denied) 2024-09-10T23:29:28.074 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64135 ms_dispat ceph txt unknown /proc/62565/task/64135/exe (readlink: Permission denied) 2024-09-10T23:29:28.074 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64135 ms_dispat ceph NOFD /proc/62565/task/64135/fd (opendir: Permission denied) 2024-09-10T23:29:28.074 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64136 ms_local ceph cwd unknown /proc/62565/task/64136/cwd (readlink: Permission denied) 2024-09-10T23:29:28.074 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64136 ms_local ceph rtd unknown /proc/62565/task/64136/root (readlink: Permission denied) 2024-09-10T23:29:28.074 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64136 ms_local ceph txt unknown /proc/62565/task/64136/exe (readlink: Permission denied) 2024-09-10T23:29:28.074 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64136 ms_local ceph NOFD /proc/62565/task/64136/fd (opendir: Permission denied) 2024-09-10T23:29:28.074 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64137 ms_dispat ceph cwd unknown /proc/62565/task/64137/cwd (readlink: Permission denied) 2024-09-10T23:29:28.074 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64137 ms_dispat ceph rtd unknown /proc/62565/task/64137/root (readlink: Permission denied) 2024-09-10T23:29:28.075 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64137 ms_dispat ceph txt unknown /proc/62565/task/64137/exe (readlink: Permission denied) 2024-09-10T23:29:28.075 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64137 ms_dispat ceph NOFD /proc/62565/task/64137/fd (opendir: Permission denied) 2024-09-10T23:29:28.075 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64138 ms_local ceph cwd unknown /proc/62565/task/64138/cwd (readlink: Permission denied) 2024-09-10T23:29:28.075 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64138 ms_local ceph rtd unknown /proc/62565/task/64138/root (readlink: Permission denied) 2024-09-10T23:29:28.075 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64138 ms_local ceph txt unknown /proc/62565/task/64138/exe (readlink: Permission denied) 2024-09-10T23:29:28.075 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64138 ms_local ceph NOFD /proc/62565/task/64138/fd (opendir: Permission denied) 2024-09-10T23:29:28.075 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64139 ms_dispat ceph cwd unknown /proc/62565/task/64139/cwd (readlink: Permission denied) 2024-09-10T23:29:28.075 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64139 ms_dispat ceph rtd unknown /proc/62565/task/64139/root (readlink: Permission denied) 2024-09-10T23:29:28.075 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64139 ms_dispat ceph txt unknown /proc/62565/task/64139/exe (readlink: Permission denied) 2024-09-10T23:29:28.075 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64139 ms_dispat ceph NOFD /proc/62565/task/64139/fd (opendir: Permission denied) 2024-09-10T23:29:28.075 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64140 ms_local ceph cwd unknown /proc/62565/task/64140/cwd (readlink: Permission denied) 2024-09-10T23:29:28.075 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64140 ms_local ceph rtd unknown /proc/62565/task/64140/root (readlink: Permission denied) 2024-09-10T23:29:28.075 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64140 ms_local ceph txt unknown /proc/62565/task/64140/exe (readlink: Permission denied) 2024-09-10T23:29:28.075 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64140 ms_local ceph NOFD /proc/62565/task/64140/fd (opendir: Permission denied) 2024-09-10T23:29:28.076 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64141 ms_dispat ceph cwd unknown /proc/62565/task/64141/cwd (readlink: Permission denied) 2024-09-10T23:29:28.076 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64141 ms_dispat ceph rtd unknown /proc/62565/task/64141/root (readlink: Permission denied) 2024-09-10T23:29:28.076 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64141 ms_dispat ceph txt unknown /proc/62565/task/64141/exe (readlink: Permission denied) 2024-09-10T23:29:28.076 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64141 ms_dispat ceph NOFD /proc/62565/task/64141/fd (opendir: Permission denied) 2024-09-10T23:29:28.076 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64142 ms_local ceph cwd unknown /proc/62565/task/64142/cwd (readlink: Permission denied) 2024-09-10T23:29:28.076 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64142 ms_local ceph rtd unknown /proc/62565/task/64142/root (readlink: Permission denied) 2024-09-10T23:29:28.076 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64142 ms_local ceph txt unknown /proc/62565/task/64142/exe (readlink: Permission denied) 2024-09-10T23:29:28.076 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64142 ms_local ceph NOFD /proc/62565/task/64142/fd (opendir: Permission denied) 2024-09-10T23:29:28.076 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64143 ms_dispat ceph cwd unknown /proc/62565/task/64143/cwd (readlink: Permission denied) 2024-09-10T23:29:28.076 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64143 ms_dispat ceph rtd unknown /proc/62565/task/64143/root (readlink: Permission denied) 2024-09-10T23:29:28.076 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64143 ms_dispat ceph txt unknown /proc/62565/task/64143/exe (readlink: Permission denied) 2024-09-10T23:29:28.076 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64143 ms_dispat ceph NOFD /proc/62565/task/64143/fd (opendir: Permission denied) 2024-09-10T23:29:28.076 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64144 ms_local ceph cwd unknown /proc/62565/task/64144/cwd (readlink: Permission denied) 2024-09-10T23:29:28.077 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64144 ms_local ceph rtd unknown /proc/62565/task/64144/root (readlink: Permission denied) 2024-09-10T23:29:28.077 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64144 ms_local ceph txt unknown /proc/62565/task/64144/exe (readlink: Permission denied) 2024-09-10T23:29:28.077 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64144 ms_local ceph NOFD /proc/62565/task/64144/fd (opendir: Permission denied) 2024-09-10T23:29:28.077 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64145 ms_dispat ceph cwd unknown /proc/62565/task/64145/cwd (readlink: Permission denied) 2024-09-10T23:29:28.077 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64145 ms_dispat ceph rtd unknown /proc/62565/task/64145/root (readlink: Permission denied) 2024-09-10T23:29:28.077 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64145 ms_dispat ceph txt unknown /proc/62565/task/64145/exe (readlink: Permission denied) 2024-09-10T23:29:28.077 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64145 ms_dispat ceph NOFD /proc/62565/task/64145/fd (opendir: Permission denied) 2024-09-10T23:29:28.077 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64146 ms_local ceph cwd unknown /proc/62565/task/64146/cwd (readlink: Permission denied) 2024-09-10T23:29:28.077 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64146 ms_local ceph rtd unknown /proc/62565/task/64146/root (readlink: Permission denied) 2024-09-10T23:29:28.077 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64146 ms_local ceph txt unknown /proc/62565/task/64146/exe (readlink: Permission denied) 2024-09-10T23:29:28.077 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64146 ms_local ceph NOFD /proc/62565/task/64146/fd (opendir: Permission denied) 2024-09-10T23:29:28.077 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64147 fn_anonym ceph cwd unknown /proc/62565/task/64147/cwd (readlink: Permission denied) 2024-09-10T23:29:28.077 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64147 fn_anonym ceph rtd unknown /proc/62565/task/64147/root (readlink: Permission denied) 2024-09-10T23:29:28.078 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64147 fn_anonym ceph txt unknown /proc/62565/task/64147/exe (readlink: Permission denied) 2024-09-10T23:29:28.078 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64147 fn_anonym ceph NOFD /proc/62565/task/64147/fd (opendir: Permission denied) 2024-09-10T23:29:28.078 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64148 finisher ceph cwd unknown /proc/62565/task/64148/cwd (readlink: Permission denied) 2024-09-10T23:29:28.078 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64148 finisher ceph rtd unknown /proc/62565/task/64148/root (readlink: Permission denied) 2024-09-10T23:29:28.078 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64148 finisher ceph txt unknown /proc/62565/task/64148/exe (readlink: Permission denied) 2024-09-10T23:29:28.078 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64148 finisher ceph NOFD /proc/62565/task/64148/fd (opendir: Permission denied) 2024-09-10T23:29:28.078 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64149 safe_time ceph cwd unknown /proc/62565/task/64149/cwd (readlink: Permission denied) 2024-09-10T23:29:28.078 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64149 safe_time ceph rtd unknown /proc/62565/task/64149/root (readlink: Permission denied) 2024-09-10T23:29:28.078 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64149 safe_time ceph txt unknown /proc/62565/task/64149/exe (readlink: Permission denied) 2024-09-10T23:29:28.078 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64149 safe_time ceph NOFD /proc/62565/task/64149/fd (opendir: Permission denied) 2024-09-10T23:29:28.078 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64150 safe_time ceph cwd unknown /proc/62565/task/64150/cwd (readlink: Permission denied) 2024-09-10T23:29:28.078 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64150 safe_time ceph rtd unknown /proc/62565/task/64150/root (readlink: Permission denied) 2024-09-10T23:29:28.078 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64150 safe_time ceph txt unknown /proc/62565/task/64150/exe (readlink: Permission denied) 2024-09-10T23:29:28.079 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64150 safe_time ceph NOFD /proc/62565/task/64150/fd (opendir: Permission denied) 2024-09-10T23:29:28.079 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64151 ceph-osd ceph cwd unknown /proc/62565/task/64151/cwd (readlink: Permission denied) 2024-09-10T23:29:28.079 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64151 ceph-osd ceph rtd unknown /proc/62565/task/64151/root (readlink: Permission denied) 2024-09-10T23:29:28.079 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64151 ceph-osd ceph txt unknown /proc/62565/task/64151/exe (readlink: Permission denied) 2024-09-10T23:29:28.079 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64151 ceph-osd ceph NOFD /proc/62565/task/64151/fd (opendir: Permission denied) 2024-09-10T23:29:28.079 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64152 osd_srv_a ceph cwd unknown /proc/62565/task/64152/cwd (readlink: Permission denied) 2024-09-10T23:29:28.079 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64152 osd_srv_a ceph rtd unknown /proc/62565/task/64152/root (readlink: Permission denied) 2024-09-10T23:29:28.079 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64152 osd_srv_a ceph txt unknown /proc/62565/task/64152/exe (readlink: Permission denied) 2024-09-10T23:29:28.079 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64152 osd_srv_a ceph NOFD /proc/62565/task/64152/fd (opendir: Permission denied) 2024-09-10T23:29:28.079 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64153 tp_osd_tp ceph cwd unknown /proc/62565/task/64153/cwd (readlink: Permission denied) 2024-09-10T23:29:28.079 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64153 tp_osd_tp ceph rtd unknown /proc/62565/task/64153/root (readlink: Permission denied) 2024-09-10T23:29:28.079 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64153 tp_osd_tp ceph txt unknown /proc/62565/task/64153/exe (readlink: Permission denied) 2024-09-10T23:29:28.079 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64153 tp_osd_tp ceph NOFD /proc/62565/task/64153/fd (opendir: Permission denied) 2024-09-10T23:29:28.079 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64154 tp_osd_tp ceph cwd unknown /proc/62565/task/64154/cwd (readlink: Permission denied) 2024-09-10T23:29:28.080 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64154 tp_osd_tp ceph rtd unknown /proc/62565/task/64154/root (readlink: Permission denied) 2024-09-10T23:29:28.080 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64154 tp_osd_tp ceph txt unknown /proc/62565/task/64154/exe (readlink: Permission denied) 2024-09-10T23:29:28.080 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64154 tp_osd_tp ceph NOFD /proc/62565/task/64154/fd (opendir: Permission denied) 2024-09-10T23:29:28.080 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64155 tp_osd_tp ceph cwd unknown /proc/62565/task/64155/cwd (readlink: Permission denied) 2024-09-10T23:29:28.080 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64155 tp_osd_tp ceph rtd unknown /proc/62565/task/64155/root (readlink: Permission denied) 2024-09-10T23:29:28.080 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64155 tp_osd_tp ceph txt unknown /proc/62565/task/64155/exe (readlink: Permission denied) 2024-09-10T23:29:28.080 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64155 tp_osd_tp ceph NOFD /proc/62565/task/64155/fd (opendir: Permission denied) 2024-09-10T23:29:28.080 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64156 tp_osd_tp ceph cwd unknown /proc/62565/task/64156/cwd (readlink: Permission denied) 2024-09-10T23:29:28.080 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64156 tp_osd_tp ceph rtd unknown /proc/62565/task/64156/root (readlink: Permission denied) 2024-09-10T23:29:28.080 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64156 tp_osd_tp ceph txt unknown /proc/62565/task/64156/exe (readlink: Permission denied) 2024-09-10T23:29:28.080 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64156 tp_osd_tp ceph NOFD /proc/62565/task/64156/fd (opendir: Permission denied) 2024-09-10T23:29:28.080 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64157 tp_osd_tp ceph cwd unknown /proc/62565/task/64157/cwd (readlink: Permission denied) 2024-09-10T23:29:28.081 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64157 tp_osd_tp ceph rtd unknown /proc/62565/task/64157/root (readlink: Permission denied) 2024-09-10T23:29:28.081 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64157 tp_osd_tp ceph txt unknown /proc/62565/task/64157/exe (readlink: Permission denied) 2024-09-10T23:29:28.081 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64157 tp_osd_tp ceph NOFD /proc/62565/task/64157/fd (opendir: Permission denied) 2024-09-10T23:29:28.081 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64158 tp_osd_tp ceph cwd unknown /proc/62565/task/64158/cwd (readlink: Permission denied) 2024-09-10T23:29:28.081 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64158 tp_osd_tp ceph rtd unknown /proc/62565/task/64158/root (readlink: Permission denied) 2024-09-10T23:29:28.081 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64158 tp_osd_tp ceph txt unknown /proc/62565/task/64158/exe (readlink: Permission denied) 2024-09-10T23:29:28.081 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64158 tp_osd_tp ceph NOFD /proc/62565/task/64158/fd (opendir: Permission denied) 2024-09-10T23:29:28.081 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64159 tp_osd_tp ceph cwd unknown /proc/62565/task/64159/cwd (readlink: Permission denied) 2024-09-10T23:29:28.081 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64159 tp_osd_tp ceph rtd unknown /proc/62565/task/64159/root (readlink: Permission denied) 2024-09-10T23:29:28.081 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64159 tp_osd_tp ceph txt unknown /proc/62565/task/64159/exe (readlink: Permission denied) 2024-09-10T23:29:28.081 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64159 tp_osd_tp ceph NOFD /proc/62565/task/64159/fd (opendir: Permission denied) 2024-09-10T23:29:28.081 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64160 tp_osd_tp ceph cwd unknown /proc/62565/task/64160/cwd (readlink: Permission denied) 2024-09-10T23:29:28.081 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64160 tp_osd_tp ceph rtd unknown /proc/62565/task/64160/root (readlink: Permission denied) 2024-09-10T23:29:28.082 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64160 tp_osd_tp ceph txt unknown /proc/62565/task/64160/exe (readlink: Permission denied) 2024-09-10T23:29:28.082 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64160 tp_osd_tp ceph NOFD /proc/62565/task/64160/fd (opendir: Permission denied) 2024-09-10T23:29:28.082 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64161 tp_osd_tp ceph cwd unknown /proc/62565/task/64161/cwd (readlink: Permission denied) 2024-09-10T23:29:28.082 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64161 tp_osd_tp ceph rtd unknown /proc/62565/task/64161/root (readlink: Permission denied) 2024-09-10T23:29:28.082 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64161 tp_osd_tp ceph txt unknown /proc/62565/task/64161/exe (readlink: Permission denied) 2024-09-10T23:29:28.082 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64161 tp_osd_tp ceph NOFD /proc/62565/task/64161/fd (opendir: Permission denied) 2024-09-10T23:29:28.082 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64162 tp_osd_tp ceph cwd unknown /proc/62565/task/64162/cwd (readlink: Permission denied) 2024-09-10T23:29:28.082 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64162 tp_osd_tp ceph rtd unknown /proc/62565/task/64162/root (readlink: Permission denied) 2024-09-10T23:29:28.082 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64162 tp_osd_tp ceph txt unknown /proc/62565/task/64162/exe (readlink: Permission denied) 2024-09-10T23:29:28.082 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64162 tp_osd_tp ceph NOFD /proc/62565/task/64162/fd (opendir: Permission denied) 2024-09-10T23:29:28.082 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64163 tp_osd_tp ceph cwd unknown /proc/62565/task/64163/cwd (readlink: Permission denied) 2024-09-10T23:29:28.082 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64163 tp_osd_tp ceph rtd unknown /proc/62565/task/64163/root (readlink: Permission denied) 2024-09-10T23:29:28.082 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64163 tp_osd_tp ceph txt unknown /proc/62565/task/64163/exe (readlink: Permission denied) 2024-09-10T23:29:28.082 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64163 tp_osd_tp ceph NOFD /proc/62565/task/64163/fd (opendir: Permission denied) 2024-09-10T23:29:28.083 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64164 tp_osd_tp ceph cwd unknown /proc/62565/task/64164/cwd (readlink: Permission denied) 2024-09-10T23:29:28.083 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64164 tp_osd_tp ceph rtd unknown /proc/62565/task/64164/root (readlink: Permission denied) 2024-09-10T23:29:28.083 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64164 tp_osd_tp ceph txt unknown /proc/62565/task/64164/exe (readlink: Permission denied) 2024-09-10T23:29:28.083 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64164 tp_osd_tp ceph NOFD /proc/62565/task/64164/fd (opendir: Permission denied) 2024-09-10T23:29:28.083 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64165 tp_osd_tp ceph cwd unknown /proc/62565/task/64165/cwd (readlink: Permission denied) 2024-09-10T23:29:28.083 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64165 tp_osd_tp ceph rtd unknown /proc/62565/task/64165/root (readlink: Permission denied) 2024-09-10T23:29:28.083 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64165 tp_osd_tp ceph txt unknown /proc/62565/task/64165/exe (readlink: Permission denied) 2024-09-10T23:29:28.083 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64165 tp_osd_tp ceph NOFD /proc/62565/task/64165/fd (opendir: Permission denied) 2024-09-10T23:29:28.083 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64166 tp_osd_tp ceph cwd unknown /proc/62565/task/64166/cwd (readlink: Permission denied) 2024-09-10T23:29:28.083 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64166 tp_osd_tp ceph rtd unknown /proc/62565/task/64166/root (readlink: Permission denied) 2024-09-10T23:29:28.083 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64166 tp_osd_tp ceph txt unknown /proc/62565/task/64166/exe (readlink: Permission denied) 2024-09-10T23:29:28.083 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64166 tp_osd_tp ceph NOFD /proc/62565/task/64166/fd (opendir: Permission denied) 2024-09-10T23:29:28.083 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64167 tp_osd_tp ceph cwd unknown /proc/62565/task/64167/cwd (readlink: Permission denied) 2024-09-10T23:29:28.084 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64167 tp_osd_tp ceph rtd unknown /proc/62565/task/64167/root (readlink: Permission denied) 2024-09-10T23:29:28.084 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64167 tp_osd_tp ceph txt unknown /proc/62565/task/64167/exe (readlink: Permission denied) 2024-09-10T23:29:28.084 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64167 tp_osd_tp ceph NOFD /proc/62565/task/64167/fd (opendir: Permission denied) 2024-09-10T23:29:28.084 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64168 tp_osd_tp ceph cwd unknown /proc/62565/task/64168/cwd (readlink: Permission denied) 2024-09-10T23:29:28.084 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64168 tp_osd_tp ceph rtd unknown /proc/62565/task/64168/root (readlink: Permission denied) 2024-09-10T23:29:28.084 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64168 tp_osd_tp ceph txt unknown /proc/62565/task/64168/exe (readlink: Permission denied) 2024-09-10T23:29:28.084 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64168 tp_osd_tp ceph NOFD /proc/62565/task/64168/fd (opendir: Permission denied) 2024-09-10T23:29:28.084 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64169 osd_srv_h ceph cwd unknown /proc/62565/task/64169/cwd (readlink: Permission denied) 2024-09-10T23:29:28.084 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64169 osd_srv_h ceph rtd unknown /proc/62565/task/64169/root (readlink: Permission denied) 2024-09-10T23:29:28.084 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64169 osd_srv_h ceph txt unknown /proc/62565/task/64169/exe (readlink: Permission denied) 2024-09-10T23:29:28.084 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 62565 64169 osd_srv_h ceph NOFD /proc/62565/task/64169/fd (opendir: Permission denied) 2024-09-10T23:29:28.084 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 63705 root cwd unknown /proc/63705/cwd (readlink: Permission denied) 2024-09-10T23:29:28.084 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 63705 root rtd unknown /proc/63705/root (readlink: Permission denied) 2024-09-10T23:29:28.085 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 63705 root txt unknown /proc/63705/exe (readlink: Permission denied) 2024-09-10T23:29:28.085 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 63705 root NOFD /proc/63705/fd (opendir: Permission denied) 2024-09-10T23:29:28.085 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 63729 root cwd unknown /proc/63729/cwd (readlink: Permission denied) 2024-09-10T23:29:28.085 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 63729 root rtd unknown /proc/63729/root (readlink: Permission denied) 2024-09-10T23:29:28.085 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 63729 root txt unknown /proc/63729/exe (readlink: Permission denied) 2024-09-10T23:29:28.085 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 63729 root NOFD /proc/63729/fd (opendir: Permission denied) 2024-09-10T23:29:28.085 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/2 66775 root cwd unknown /proc/66775/cwd (readlink: Permission denied) 2024-09-10T23:29:28.085 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/2 66775 root rtd unknown /proc/66775/root (readlink: Permission denied) 2024-09-10T23:29:28.085 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/2 66775 root txt unknown /proc/66775/exe (readlink: Permission denied) 2024-09-10T23:29:28.085 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/2 66775 root NOFD /proc/66775/fd (opendir: Permission denied) 2024-09-10T23:29:28.085 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/7 66853 root cwd unknown /proc/66853/cwd (readlink: Permission denied) 2024-09-10T23:29:28.085 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/7 66853 root rtd unknown /proc/66853/root (readlink: Permission denied) 2024-09-10T23:29:28.086 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/7 66853 root txt unknown /proc/66853/exe (readlink: Permission denied) 2024-09-10T23:29:28.086 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/7 66853 root NOFD /proc/66853/fd (opendir: Permission denied) 2024-09-10T23:29:28.086 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 69502 root cwd unknown /proc/69502/cwd (readlink: Permission denied) 2024-09-10T23:29:28.086 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 69502 root rtd unknown /proc/69502/root (readlink: Permission denied) 2024-09-10T23:29:28.086 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 69502 root txt unknown /proc/69502/exe (readlink: Permission denied) 2024-09-10T23:29:28.086 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 69502 root NOFD /proc/69502/fd (opendir: Permission denied) 2024-09-10T23:29:28.086 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 69504 root cwd unknown /proc/69504/cwd (readlink: Permission denied) 2024-09-10T23:29:28.086 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 69504 root rtd unknown /proc/69504/root (readlink: Permission denied) 2024-09-10T23:29:28.086 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 69504 root txt unknown /proc/69504/exe (readlink: Permission denied) 2024-09-10T23:29:28.086 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 69504 root NOFD /proc/69504/fd (opendir: Permission denied) 2024-09-10T23:29:28.086 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 ceph cwd unknown /proc/69506/cwd (readlink: Permission denied) 2024-09-10T23:29:28.086 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 ceph rtd unknown /proc/69506/root (readlink: Permission denied) 2024-09-10T23:29:28.086 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 ceph txt unknown /proc/69506/exe (readlink: Permission denied) 2024-09-10T23:29:28.087 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 ceph NOFD /proc/69506/fd (opendir: Permission denied) 2024-09-10T23:29:28.087 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69507 log ceph cwd unknown /proc/69506/task/69507/cwd (readlink: Permission denied) 2024-09-10T23:29:28.087 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69507 log ceph rtd unknown /proc/69506/task/69507/root (readlink: Permission denied) 2024-09-10T23:29:28.087 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69507 log ceph txt unknown /proc/69506/task/69507/exe (readlink: Permission denied) 2024-09-10T23:29:28.087 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69507 log ceph NOFD /proc/69506/task/69507/fd (opendir: Permission denied) 2024-09-10T23:29:28.087 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69509 msgr-work ceph cwd unknown /proc/69506/task/69509/cwd (readlink: Permission denied) 2024-09-10T23:29:28.087 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69509 msgr-work ceph rtd unknown /proc/69506/task/69509/root (readlink: Permission denied) 2024-09-10T23:29:28.087 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69509 msgr-work ceph txt unknown /proc/69506/task/69509/exe (readlink: Permission denied) 2024-09-10T23:29:28.087 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69509 msgr-work ceph NOFD /proc/69506/task/69509/fd (opendir: Permission denied) 2024-09-10T23:29:28.087 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69510 msgr-work ceph cwd unknown /proc/69506/task/69510/cwd (readlink: Permission denied) 2024-09-10T23:29:28.087 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69510 msgr-work ceph rtd unknown /proc/69506/task/69510/root (readlink: Permission denied) 2024-09-10T23:29:28.087 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69510 msgr-work ceph txt unknown /proc/69506/task/69510/exe (readlink: Permission denied) 2024-09-10T23:29:28.087 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69510 msgr-work ceph NOFD /proc/69506/task/69510/fd (opendir: Permission denied) 2024-09-10T23:29:28.087 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69511 msgr-work ceph cwd unknown /proc/69506/task/69511/cwd (readlink: Permission denied) 2024-09-10T23:29:28.088 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69511 msgr-work ceph rtd unknown /proc/69506/task/69511/root (readlink: Permission denied) 2024-09-10T23:29:28.088 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69511 msgr-work ceph txt unknown /proc/69506/task/69511/exe (readlink: Permission denied) 2024-09-10T23:29:28.088 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69511 msgr-work ceph NOFD /proc/69506/task/69511/fd (opendir: Permission denied) 2024-09-10T23:29:28.088 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69515 service ceph cwd unknown /proc/69506/task/69515/cwd (readlink: Permission denied) 2024-09-10T23:29:28.088 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69515 service ceph rtd unknown /proc/69506/task/69515/root (readlink: Permission denied) 2024-09-10T23:29:28.088 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69515 service ceph txt unknown /proc/69506/task/69515/exe (readlink: Permission denied) 2024-09-10T23:29:28.088 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69515 service ceph NOFD /proc/69506/task/69515/fd (opendir: Permission denied) 2024-09-10T23:29:28.088 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69516 admin_soc ceph cwd unknown /proc/69506/task/69516/cwd (readlink: Permission denied) 2024-09-10T23:29:28.088 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69516 admin_soc ceph rtd unknown /proc/69506/task/69516/root (readlink: Permission denied) 2024-09-10T23:29:28.088 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69516 admin_soc ceph txt unknown /proc/69506/task/69516/exe (readlink: Permission denied) 2024-09-10T23:29:28.088 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69516 admin_soc ceph NOFD /proc/69506/task/69516/fd (opendir: Permission denied) 2024-09-10T23:29:28.088 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69826 signal_ha ceph cwd unknown /proc/69506/task/69826/cwd (readlink: Permission denied) 2024-09-10T23:29:28.088 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69826 signal_ha ceph rtd unknown /proc/69506/task/69826/root (readlink: Permission denied) 2024-09-10T23:29:28.089 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69826 signal_ha ceph txt unknown /proc/69506/task/69826/exe (readlink: Permission denied) 2024-09-10T23:29:28.089 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69826 signal_ha ceph NOFD /proc/69506/task/69826/fd (opendir: Permission denied) 2024-09-10T23:29:28.089 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69827 io_contex ceph cwd unknown /proc/69506/task/69827/cwd (readlink: Permission denied) 2024-09-10T23:29:28.089 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69827 io_contex ceph rtd unknown /proc/69506/task/69827/root (readlink: Permission denied) 2024-09-10T23:29:28.089 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69827 io_contex ceph txt unknown /proc/69506/task/69827/exe (readlink: Permission denied) 2024-09-10T23:29:28.089 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69827 io_contex ceph NOFD /proc/69506/task/69827/fd (opendir: Permission denied) 2024-09-10T23:29:28.089 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69828 io_contex ceph cwd unknown /proc/69506/task/69828/cwd (readlink: Permission denied) 2024-09-10T23:29:28.089 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69828 io_contex ceph rtd unknown /proc/69506/task/69828/root (readlink: Permission denied) 2024-09-10T23:29:28.089 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69828 io_contex ceph txt unknown /proc/69506/task/69828/exe (readlink: Permission denied) 2024-09-10T23:29:28.089 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69828 io_contex ceph NOFD /proc/69506/task/69828/fd (opendir: Permission denied) 2024-09-10T23:29:28.089 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69847 OpHistory ceph cwd unknown /proc/69506/task/69847/cwd (readlink: Permission denied) 2024-09-10T23:29:28.089 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69847 OpHistory ceph rtd unknown /proc/69506/task/69847/root (readlink: Permission denied) 2024-09-10T23:29:28.089 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69847 OpHistory ceph txt unknown /proc/69506/task/69847/exe (readlink: Permission denied) 2024-09-10T23:29:28.089 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69847 OpHistory ceph NOFD /proc/69506/task/69847/fd (opendir: Permission denied) 2024-09-10T23:29:28.090 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69848 ceph_time ceph cwd unknown /proc/69506/task/69848/cwd (readlink: Permission denied) 2024-09-10T23:29:28.090 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69848 ceph_time ceph rtd unknown /proc/69506/task/69848/root (readlink: Permission denied) 2024-09-10T23:29:28.090 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69848 ceph_time ceph txt unknown /proc/69506/task/69848/exe (readlink: Permission denied) 2024-09-10T23:29:28.090 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 69848 ceph_time ceph NOFD /proc/69506/task/69848/fd (opendir: Permission denied) 2024-09-10T23:29:28.090 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70116 ceph-osd ceph cwd unknown /proc/69506/task/70116/cwd (readlink: Permission denied) 2024-09-10T23:29:28.090 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70116 ceph-osd ceph rtd unknown /proc/69506/task/70116/root (readlink: Permission denied) 2024-09-10T23:29:28.090 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70116 ceph-osd ceph txt unknown /proc/69506/task/70116/exe (readlink: Permission denied) 2024-09-10T23:29:28.090 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70116 ceph-osd ceph NOFD /proc/69506/task/70116/fd (opendir: Permission denied) 2024-09-10T23:29:28.090 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70117 safe_time ceph cwd unknown /proc/69506/task/70117/cwd (readlink: Permission denied) 2024-09-10T23:29:28.090 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70117 safe_time ceph rtd unknown /proc/69506/task/70117/root (readlink: Permission denied) 2024-09-10T23:29:28.090 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70117 safe_time ceph txt unknown /proc/69506/task/70117/exe (readlink: Permission denied) 2024-09-10T23:29:28.090 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70117 safe_time ceph NOFD /proc/69506/task/70117/fd (opendir: Permission denied) 2024-09-10T23:29:28.090 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70118 safe_time ceph cwd unknown /proc/69506/task/70118/cwd (readlink: Permission denied) 2024-09-10T23:29:28.090 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70118 safe_time ceph rtd unknown /proc/69506/task/70118/root (readlink: Permission denied) 2024-09-10T23:29:28.091 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70118 safe_time ceph txt unknown /proc/69506/task/70118/exe (readlink: Permission denied) 2024-09-10T23:29:28.091 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70118 safe_time ceph NOFD /proc/69506/task/70118/fd (opendir: Permission denied) 2024-09-10T23:29:28.091 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70119 safe_time ceph cwd unknown /proc/69506/task/70119/cwd (readlink: Permission denied) 2024-09-10T23:29:28.091 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70119 safe_time ceph rtd unknown /proc/69506/task/70119/root (readlink: Permission denied) 2024-09-10T23:29:28.091 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70119 safe_time ceph txt unknown /proc/69506/task/70119/exe (readlink: Permission denied) 2024-09-10T23:29:28.091 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70119 safe_time ceph NOFD /proc/69506/task/70119/fd (opendir: Permission denied) 2024-09-10T23:29:28.091 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70120 safe_time ceph cwd unknown /proc/69506/task/70120/cwd (readlink: Permission denied) 2024-09-10T23:29:28.091 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70120 safe_time ceph rtd unknown /proc/69506/task/70120/root (readlink: Permission denied) 2024-09-10T23:29:28.091 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70120 safe_time ceph txt unknown /proc/69506/task/70120/exe (readlink: Permission denied) 2024-09-10T23:29:28.091 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70120 safe_time ceph NOFD /proc/69506/task/70120/fd (opendir: Permission denied) 2024-09-10T23:29:28.091 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70121 fn_anonym ceph cwd unknown /proc/69506/task/70121/cwd (readlink: Permission denied) 2024-09-10T23:29:28.091 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70121 fn_anonym ceph rtd unknown /proc/69506/task/70121/root (readlink: Permission denied) 2024-09-10T23:29:28.091 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70121 fn_anonym ceph txt unknown /proc/69506/task/70121/exe (readlink: Permission denied) 2024-09-10T23:29:28.091 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70121 fn_anonym ceph NOFD /proc/69506/task/70121/fd (opendir: Permission denied) 2024-09-10T23:29:28.091 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70184 rocksdb:l ceph cwd unknown /proc/69506/task/70184/cwd (readlink: Permission denied) 2024-09-10T23:29:28.092 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70184 rocksdb:l ceph rtd unknown /proc/69506/task/70184/root (readlink: Permission denied) 2024-09-10T23:29:28.092 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70184 rocksdb:l ceph txt unknown /proc/69506/task/70184/exe (readlink: Permission denied) 2024-09-10T23:29:28.092 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70184 rocksdb:l ceph NOFD /proc/69506/task/70184/fd (opendir: Permission denied) 2024-09-10T23:29:28.092 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70185 rocksdb:l ceph cwd unknown /proc/69506/task/70185/cwd (readlink: Permission denied) 2024-09-10T23:29:28.092 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70185 rocksdb:l ceph rtd unknown /proc/69506/task/70185/root (readlink: Permission denied) 2024-09-10T23:29:28.092 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70185 rocksdb:l ceph txt unknown /proc/69506/task/70185/exe (readlink: Permission denied) 2024-09-10T23:29:28.092 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70185 rocksdb:l ceph NOFD /proc/69506/task/70185/fd (opendir: Permission denied) 2024-09-10T23:29:28.092 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70186 rocksdb:l ceph cwd unknown /proc/69506/task/70186/cwd (readlink: Permission denied) 2024-09-10T23:29:28.092 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70186 rocksdb:l ceph rtd unknown /proc/69506/task/70186/root (readlink: Permission denied) 2024-09-10T23:29:28.092 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70186 rocksdb:l ceph txt unknown /proc/69506/task/70186/exe (readlink: Permission denied) 2024-09-10T23:29:28.092 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70186 rocksdb:l ceph NOFD /proc/69506/task/70186/fd (opendir: Permission denied) 2024-09-10T23:29:28.092 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70187 rocksdb:h ceph cwd unknown /proc/69506/task/70187/cwd (readlink: Permission denied) 2024-09-10T23:29:28.093 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70187 rocksdb:h ceph rtd unknown /proc/69506/task/70187/root (readlink: Permission denied) 2024-09-10T23:29:28.093 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70187 rocksdb:h ceph txt unknown /proc/69506/task/70187/exe (readlink: Permission denied) 2024-09-10T23:29:28.093 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70187 rocksdb:h ceph NOFD /proc/69506/task/70187/fd (opendir: Permission denied) 2024-09-10T23:29:28.093 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70707 bstore_ai ceph cwd unknown /proc/69506/task/70707/cwd (readlink: Permission denied) 2024-09-10T23:29:28.093 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70707 bstore_ai ceph rtd unknown /proc/69506/task/70707/root (readlink: Permission denied) 2024-09-10T23:29:28.093 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70707 bstore_ai ceph txt unknown /proc/69506/task/70707/exe (readlink: Permission denied) 2024-09-10T23:29:28.093 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70707 bstore_ai ceph NOFD /proc/69506/task/70707/fd (opendir: Permission denied) 2024-09-10T23:29:28.093 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70896 bstore_ai ceph cwd unknown /proc/69506/task/70896/cwd (readlink: Permission denied) 2024-09-10T23:29:28.093 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70896 bstore_ai ceph rtd unknown /proc/69506/task/70896/root (readlink: Permission denied) 2024-09-10T23:29:28.093 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70896 bstore_ai ceph txt unknown /proc/69506/task/70896/exe (readlink: Permission denied) 2024-09-10T23:29:28.093 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 70896 bstore_ai ceph NOFD /proc/69506/task/70896/fd (opendir: Permission denied) 2024-09-10T23:29:28.093 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71079 ceph-osd ceph cwd unknown /proc/69506/task/71079/cwd (readlink: Permission denied) 2024-09-10T23:29:28.093 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71079 ceph-osd ceph rtd unknown /proc/69506/task/71079/root (readlink: Permission denied) 2024-09-10T23:29:28.093 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71079 ceph-osd ceph txt unknown /proc/69506/task/71079/exe (readlink: Permission denied) 2024-09-10T23:29:28.094 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71079 ceph-osd ceph NOFD /proc/69506/task/71079/fd (opendir: Permission denied) 2024-09-10T23:29:28.094 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71080 cfin ceph cwd unknown /proc/69506/task/71080/cwd (readlink: Permission denied) 2024-09-10T23:29:28.094 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71080 cfin ceph rtd unknown /proc/69506/task/71080/root (readlink: Permission denied) 2024-09-10T23:29:28.094 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71080 cfin ceph txt unknown /proc/69506/task/71080/exe (readlink: Permission denied) 2024-09-10T23:29:28.094 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71080 cfin ceph NOFD /proc/69506/task/71080/fd (opendir: Permission denied) 2024-09-10T23:29:28.094 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71081 bstore_kv ceph cwd unknown /proc/69506/task/71081/cwd (readlink: Permission denied) 2024-09-10T23:29:28.094 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71081 bstore_kv ceph rtd unknown /proc/69506/task/71081/root (readlink: Permission denied) 2024-09-10T23:29:28.094 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71081 bstore_kv ceph txt unknown /proc/69506/task/71081/exe (readlink: Permission denied) 2024-09-10T23:29:28.094 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71081 bstore_kv ceph NOFD /proc/69506/task/71081/fd (opendir: Permission denied) 2024-09-10T23:29:28.094 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71082 bstore_kv ceph cwd unknown /proc/69506/task/71082/cwd (readlink: Permission denied) 2024-09-10T23:29:28.094 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71082 bstore_kv ceph rtd unknown /proc/69506/task/71082/root (readlink: Permission denied) 2024-09-10T23:29:28.094 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71082 bstore_kv ceph txt unknown /proc/69506/task/71082/exe (readlink: Permission denied) 2024-09-10T23:29:28.094 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71082 bstore_kv ceph NOFD /proc/69506/task/71082/fd (opendir: Permission denied) 2024-09-10T23:29:28.094 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71083 bstore_me ceph cwd unknown /proc/69506/task/71083/cwd (readlink: Permission denied) 2024-09-10T23:29:28.095 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71083 bstore_me ceph rtd unknown /proc/69506/task/71083/root (readlink: Permission denied) 2024-09-10T23:29:28.095 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71083 bstore_me ceph txt unknown /proc/69506/task/71083/exe (readlink: Permission denied) 2024-09-10T23:29:28.095 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71083 bstore_me ceph NOFD /proc/69506/task/71083/fd (opendir: Permission denied) 2024-09-10T23:29:28.095 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71084 ms_dispat ceph cwd unknown /proc/69506/task/71084/cwd (readlink: Permission denied) 2024-09-10T23:29:28.095 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71084 ms_dispat ceph rtd unknown /proc/69506/task/71084/root (readlink: Permission denied) 2024-09-10T23:29:28.095 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71084 ms_dispat ceph txt unknown /proc/69506/task/71084/exe (readlink: Permission denied) 2024-09-10T23:29:28.095 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71084 ms_dispat ceph NOFD /proc/69506/task/71084/fd (opendir: Permission denied) 2024-09-10T23:29:28.095 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71085 ms_local ceph cwd unknown /proc/69506/task/71085/cwd (readlink: Permission denied) 2024-09-10T23:29:28.095 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71085 ms_local ceph rtd unknown /proc/69506/task/71085/root (readlink: Permission denied) 2024-09-10T23:29:28.095 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71085 ms_local ceph txt unknown /proc/69506/task/71085/exe (readlink: Permission denied) 2024-09-10T23:29:28.095 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71085 ms_local ceph NOFD /proc/69506/task/71085/fd (opendir: Permission denied) 2024-09-10T23:29:28.095 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71086 safe_time ceph cwd unknown /proc/69506/task/71086/cwd (readlink: Permission denied) 2024-09-10T23:29:28.095 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71086 safe_time ceph rtd unknown /proc/69506/task/71086/root (readlink: Permission denied) 2024-09-10T23:29:28.095 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71086 safe_time ceph txt unknown /proc/69506/task/71086/exe (readlink: Permission denied) 2024-09-10T23:29:28.096 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71086 safe_time ceph NOFD /proc/69506/task/71086/fd (opendir: Permission denied) 2024-09-10T23:29:28.096 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71087 safe_time ceph cwd unknown /proc/69506/task/71087/cwd (readlink: Permission denied) 2024-09-10T23:29:28.096 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71087 safe_time ceph rtd unknown /proc/69506/task/71087/root (readlink: Permission denied) 2024-09-10T23:29:28.096 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71087 safe_time ceph txt unknown /proc/69506/task/71087/exe (readlink: Permission denied) 2024-09-10T23:29:28.096 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71087 safe_time ceph NOFD /proc/69506/task/71087/fd (opendir: Permission denied) 2024-09-10T23:29:28.096 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71088 ms_dispat ceph cwd unknown /proc/69506/task/71088/cwd (readlink: Permission denied) 2024-09-10T23:29:28.096 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71088 ms_dispat ceph rtd unknown /proc/69506/task/71088/root (readlink: Permission denied) 2024-09-10T23:29:28.096 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71088 ms_dispat ceph txt unknown /proc/69506/task/71088/exe (readlink: Permission denied) 2024-09-10T23:29:28.096 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71088 ms_dispat ceph NOFD /proc/69506/task/71088/fd (opendir: Permission denied) 2024-09-10T23:29:28.096 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71089 ms_local ceph cwd unknown /proc/69506/task/71089/cwd (readlink: Permission denied) 2024-09-10T23:29:28.096 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71089 ms_local ceph rtd unknown /proc/69506/task/71089/root (readlink: Permission denied) 2024-09-10T23:29:28.096 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71089 ms_local ceph txt unknown /proc/69506/task/71089/exe (readlink: Permission denied) 2024-09-10T23:29:28.097 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71089 ms_local ceph NOFD /proc/69506/task/71089/fd (opendir: Permission denied) 2024-09-10T23:29:28.097 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71090 ms_dispat ceph cwd unknown /proc/69506/task/71090/cwd (readlink: Permission denied) 2024-09-10T23:29:28.097 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71090 ms_dispat ceph rtd unknown /proc/69506/task/71090/root (readlink: Permission denied) 2024-09-10T23:29:28.097 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71090 ms_dispat ceph txt unknown /proc/69506/task/71090/exe (readlink: Permission denied) 2024-09-10T23:29:28.097 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71090 ms_dispat ceph NOFD /proc/69506/task/71090/fd (opendir: Permission denied) 2024-09-10T23:29:28.097 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71091 ms_local ceph cwd unknown /proc/69506/task/71091/cwd (readlink: Permission denied) 2024-09-10T23:29:28.097 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71091 ms_local ceph rtd unknown /proc/69506/task/71091/root (readlink: Permission denied) 2024-09-10T23:29:28.097 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71091 ms_local ceph txt unknown /proc/69506/task/71091/exe (readlink: Permission denied) 2024-09-10T23:29:28.097 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71091 ms_local ceph NOFD /proc/69506/task/71091/fd (opendir: Permission denied) 2024-09-10T23:29:28.097 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71092 ms_dispat ceph cwd unknown /proc/69506/task/71092/cwd (readlink: Permission denied) 2024-09-10T23:29:28.097 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71092 ms_dispat ceph rtd unknown /proc/69506/task/71092/root (readlink: Permission denied) 2024-09-10T23:29:28.097 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71092 ms_dispat ceph txt unknown /proc/69506/task/71092/exe (readlink: Permission denied) 2024-09-10T23:29:28.098 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71092 ms_dispat ceph NOFD /proc/69506/task/71092/fd (opendir: Permission denied) 2024-09-10T23:29:28.098 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71093 ms_local ceph cwd unknown /proc/69506/task/71093/cwd (readlink: Permission denied) 2024-09-10T23:29:28.098 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71093 ms_local ceph rtd unknown /proc/69506/task/71093/root (readlink: Permission denied) 2024-09-10T23:29:28.098 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71093 ms_local ceph txt unknown /proc/69506/task/71093/exe (readlink: Permission denied) 2024-09-10T23:29:28.098 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71093 ms_local ceph NOFD /proc/69506/task/71093/fd (opendir: Permission denied) 2024-09-10T23:29:28.098 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71094 ms_dispat ceph cwd unknown /proc/69506/task/71094/cwd (readlink: Permission denied) 2024-09-10T23:29:28.098 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71094 ms_dispat ceph rtd unknown /proc/69506/task/71094/root (readlink: Permission denied) 2024-09-10T23:29:28.098 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71094 ms_dispat ceph txt unknown /proc/69506/task/71094/exe (readlink: Permission denied) 2024-09-10T23:29:28.098 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71094 ms_dispat ceph NOFD /proc/69506/task/71094/fd (opendir: Permission denied) 2024-09-10T23:29:28.098 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71095 ms_local ceph cwd unknown /proc/69506/task/71095/cwd (readlink: Permission denied) 2024-09-10T23:29:28.098 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71095 ms_local ceph rtd unknown /proc/69506/task/71095/root (readlink: Permission denied) 2024-09-10T23:29:28.098 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71095 ms_local ceph txt unknown /proc/69506/task/71095/exe (readlink: Permission denied) 2024-09-10T23:29:28.098 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71095 ms_local ceph NOFD /proc/69506/task/71095/fd (opendir: Permission denied) 2024-09-10T23:29:28.098 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71096 ms_dispat ceph cwd unknown /proc/69506/task/71096/cwd (readlink: Permission denied) 2024-09-10T23:29:28.099 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71096 ms_dispat ceph rtd unknown /proc/69506/task/71096/root (readlink: Permission denied) 2024-09-10T23:29:28.099 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71096 ms_dispat ceph txt unknown /proc/69506/task/71096/exe (readlink: Permission denied) 2024-09-10T23:29:28.099 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71096 ms_dispat ceph NOFD /proc/69506/task/71096/fd (opendir: Permission denied) 2024-09-10T23:29:28.099 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71097 ms_local ceph cwd unknown /proc/69506/task/71097/cwd (readlink: Permission denied) 2024-09-10T23:29:28.099 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71097 ms_local ceph rtd unknown /proc/69506/task/71097/root (readlink: Permission denied) 2024-09-10T23:29:28.099 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71097 ms_local ceph txt unknown /proc/69506/task/71097/exe (readlink: Permission denied) 2024-09-10T23:29:28.099 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71097 ms_local ceph NOFD /proc/69506/task/71097/fd (opendir: Permission denied) 2024-09-10T23:29:28.099 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71098 ms_dispat ceph cwd unknown /proc/69506/task/71098/cwd (readlink: Permission denied) 2024-09-10T23:29:28.099 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71098 ms_dispat ceph rtd unknown /proc/69506/task/71098/root (readlink: Permission denied) 2024-09-10T23:29:28.099 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71098 ms_dispat ceph txt unknown /proc/69506/task/71098/exe (readlink: Permission denied) 2024-09-10T23:29:28.099 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71098 ms_dispat ceph NOFD /proc/69506/task/71098/fd (opendir: Permission denied) 2024-09-10T23:29:28.099 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71099 ms_local ceph cwd unknown /proc/69506/task/71099/cwd (readlink: Permission denied) 2024-09-10T23:29:28.099 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71099 ms_local ceph rtd unknown /proc/69506/task/71099/root (readlink: Permission denied) 2024-09-10T23:29:28.100 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71099 ms_local ceph txt unknown /proc/69506/task/71099/exe (readlink: Permission denied) 2024-09-10T23:29:28.100 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71099 ms_local ceph NOFD /proc/69506/task/71099/fd (opendir: Permission denied) 2024-09-10T23:29:28.100 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71100 fn_anonym ceph cwd unknown /proc/69506/task/71100/cwd (readlink: Permission denied) 2024-09-10T23:29:28.100 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71100 fn_anonym ceph rtd unknown /proc/69506/task/71100/root (readlink: Permission denied) 2024-09-10T23:29:28.100 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71100 fn_anonym ceph txt unknown /proc/69506/task/71100/exe (readlink: Permission denied) 2024-09-10T23:29:28.100 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71100 fn_anonym ceph NOFD /proc/69506/task/71100/fd (opendir: Permission denied) 2024-09-10T23:29:28.100 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71101 finisher ceph cwd unknown /proc/69506/task/71101/cwd (readlink: Permission denied) 2024-09-10T23:29:28.100 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71101 finisher ceph rtd unknown /proc/69506/task/71101/root (readlink: Permission denied) 2024-09-10T23:29:28.100 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71101 finisher ceph txt unknown /proc/69506/task/71101/exe (readlink: Permission denied) 2024-09-10T23:29:28.100 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71101 finisher ceph NOFD /proc/69506/task/71101/fd (opendir: Permission denied) 2024-09-10T23:29:28.100 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71102 safe_time ceph cwd unknown /proc/69506/task/71102/cwd (readlink: Permission denied) 2024-09-10T23:29:28.100 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71102 safe_time ceph rtd unknown /proc/69506/task/71102/root (readlink: Permission denied) 2024-09-10T23:29:28.100 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71102 safe_time ceph txt unknown /proc/69506/task/71102/exe (readlink: Permission denied) 2024-09-10T23:29:28.101 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71102 safe_time ceph NOFD /proc/69506/task/71102/fd (opendir: Permission denied) 2024-09-10T23:29:28.101 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71103 safe_time ceph cwd unknown /proc/69506/task/71103/cwd (readlink: Permission denied) 2024-09-10T23:29:28.101 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71103 safe_time ceph rtd unknown /proc/69506/task/71103/root (readlink: Permission denied) 2024-09-10T23:29:28.101 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71103 safe_time ceph txt unknown /proc/69506/task/71103/exe (readlink: Permission denied) 2024-09-10T23:29:28.101 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71103 safe_time ceph NOFD /proc/69506/task/71103/fd (opendir: Permission denied) 2024-09-10T23:29:28.104 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71104 ceph-osd ceph cwd unknown /proc/69506/task/71104/cwd (readlink: Permission denied) 2024-09-10T23:29:28.104 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71104 ceph-osd ceph rtd unknown /proc/69506/task/71104/root (readlink: Permission denied) 2024-09-10T23:29:28.104 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71104 ceph-osd ceph txt unknown /proc/69506/task/71104/exe (readlink: Permission denied) 2024-09-10T23:29:28.104 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71104 ceph-osd ceph NOFD /proc/69506/task/71104/fd (opendir: Permission denied) 2024-09-10T23:29:28.104 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71105 osd_srv_a ceph cwd unknown /proc/69506/task/71105/cwd (readlink: Permission denied) 2024-09-10T23:29:28.105 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71105 osd_srv_a ceph rtd unknown /proc/69506/task/71105/root (readlink: Permission denied) 2024-09-10T23:29:28.105 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71105 osd_srv_a ceph txt unknown /proc/69506/task/71105/exe (readlink: Permission denied) 2024-09-10T23:29:28.105 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71105 osd_srv_a ceph NOFD /proc/69506/task/71105/fd (opendir: Permission denied) 2024-09-10T23:29:28.105 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71106 tp_osd_tp ceph cwd unknown /proc/69506/task/71106/cwd (readlink: Permission denied) 2024-09-10T23:29:28.105 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71106 tp_osd_tp ceph rtd unknown /proc/69506/task/71106/root (readlink: Permission denied) 2024-09-10T23:29:28.105 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71106 tp_osd_tp ceph txt unknown /proc/69506/task/71106/exe (readlink: Permission denied) 2024-09-10T23:29:28.105 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71106 tp_osd_tp ceph NOFD /proc/69506/task/71106/fd (opendir: Permission denied) 2024-09-10T23:29:28.105 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71107 tp_osd_tp ceph cwd unknown /proc/69506/task/71107/cwd (readlink: Permission denied) 2024-09-10T23:29:28.105 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71107 tp_osd_tp ceph rtd unknown /proc/69506/task/71107/root (readlink: Permission denied) 2024-09-10T23:29:28.105 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71107 tp_osd_tp ceph txt unknown /proc/69506/task/71107/exe (readlink: Permission denied) 2024-09-10T23:29:28.105 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71107 tp_osd_tp ceph NOFD /proc/69506/task/71107/fd (opendir: Permission denied) 2024-09-10T23:29:28.105 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71108 tp_osd_tp ceph cwd unknown /proc/69506/task/71108/cwd (readlink: Permission denied) 2024-09-10T23:29:28.105 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71108 tp_osd_tp ceph rtd unknown /proc/69506/task/71108/root (readlink: Permission denied) 2024-09-10T23:29:28.106 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71108 tp_osd_tp ceph txt unknown /proc/69506/task/71108/exe (readlink: Permission denied) 2024-09-10T23:29:28.106 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71108 tp_osd_tp ceph NOFD /proc/69506/task/71108/fd (opendir: Permission denied) 2024-09-10T23:29:28.106 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71109 tp_osd_tp ceph cwd unknown /proc/69506/task/71109/cwd (readlink: Permission denied) 2024-09-10T23:29:28.106 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71109 tp_osd_tp ceph rtd unknown /proc/69506/task/71109/root (readlink: Permission denied) 2024-09-10T23:29:28.106 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71109 tp_osd_tp ceph txt unknown /proc/69506/task/71109/exe (readlink: Permission denied) 2024-09-10T23:29:28.106 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71109 tp_osd_tp ceph NOFD /proc/69506/task/71109/fd (opendir: Permission denied) 2024-09-10T23:29:28.106 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71110 tp_osd_tp ceph cwd unknown /proc/69506/task/71110/cwd (readlink: Permission denied) 2024-09-10T23:29:28.106 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71110 tp_osd_tp ceph rtd unknown /proc/69506/task/71110/root (readlink: Permission denied) 2024-09-10T23:29:28.106 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71110 tp_osd_tp ceph txt unknown /proc/69506/task/71110/exe (readlink: Permission denied) 2024-09-10T23:29:28.106 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71110 tp_osd_tp ceph NOFD /proc/69506/task/71110/fd (opendir: Permission denied) 2024-09-10T23:29:28.106 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71111 tp_osd_tp ceph cwd unknown /proc/69506/task/71111/cwd (readlink: Permission denied) 2024-09-10T23:29:28.106 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71111 tp_osd_tp ceph rtd unknown /proc/69506/task/71111/root (readlink: Permission denied) 2024-09-10T23:29:28.106 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71111 tp_osd_tp ceph txt unknown /proc/69506/task/71111/exe (readlink: Permission denied) 2024-09-10T23:29:28.107 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71111 tp_osd_tp ceph NOFD /proc/69506/task/71111/fd (opendir: Permission denied) 2024-09-10T23:29:28.107 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71112 tp_osd_tp ceph cwd unknown /proc/69506/task/71112/cwd (readlink: Permission denied) 2024-09-10T23:29:28.107 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71112 tp_osd_tp ceph rtd unknown /proc/69506/task/71112/root (readlink: Permission denied) 2024-09-10T23:29:28.107 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71112 tp_osd_tp ceph txt unknown /proc/69506/task/71112/exe (readlink: Permission denied) 2024-09-10T23:29:28.107 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71112 tp_osd_tp ceph NOFD /proc/69506/task/71112/fd (opendir: Permission denied) 2024-09-10T23:29:28.107 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71113 tp_osd_tp ceph cwd unknown /proc/69506/task/71113/cwd (readlink: Permission denied) 2024-09-10T23:29:28.107 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71113 tp_osd_tp ceph rtd unknown /proc/69506/task/71113/root (readlink: Permission denied) 2024-09-10T23:29:28.107 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71113 tp_osd_tp ceph txt unknown /proc/69506/task/71113/exe (readlink: Permission denied) 2024-09-10T23:29:28.107 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71113 tp_osd_tp ceph NOFD /proc/69506/task/71113/fd (opendir: Permission denied) 2024-09-10T23:29:28.107 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71114 tp_osd_tp ceph cwd unknown /proc/69506/task/71114/cwd (readlink: Permission denied) 2024-09-10T23:29:28.107 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71114 tp_osd_tp ceph rtd unknown /proc/69506/task/71114/root (readlink: Permission denied) 2024-09-10T23:29:28.107 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71114 tp_osd_tp ceph txt unknown /proc/69506/task/71114/exe (readlink: Permission denied) 2024-09-10T23:29:28.108 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71114 tp_osd_tp ceph NOFD /proc/69506/task/71114/fd (opendir: Permission denied) 2024-09-10T23:29:28.108 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71115 tp_osd_tp ceph cwd unknown /proc/69506/task/71115/cwd (readlink: Permission denied) 2024-09-10T23:29:28.108 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71115 tp_osd_tp ceph rtd unknown /proc/69506/task/71115/root (readlink: Permission denied) 2024-09-10T23:29:28.108 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71115 tp_osd_tp ceph txt unknown /proc/69506/task/71115/exe (readlink: Permission denied) 2024-09-10T23:29:28.108 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71115 tp_osd_tp ceph NOFD /proc/69506/task/71115/fd (opendir: Permission denied) 2024-09-10T23:29:28.108 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71116 tp_osd_tp ceph cwd unknown /proc/69506/task/71116/cwd (readlink: Permission denied) 2024-09-10T23:29:28.108 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71116 tp_osd_tp ceph rtd unknown /proc/69506/task/71116/root (readlink: Permission denied) 2024-09-10T23:29:28.108 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71116 tp_osd_tp ceph txt unknown /proc/69506/task/71116/exe (readlink: Permission denied) 2024-09-10T23:29:28.108 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71116 tp_osd_tp ceph NOFD /proc/69506/task/71116/fd (opendir: Permission denied) 2024-09-10T23:29:28.108 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71117 tp_osd_tp ceph cwd unknown /proc/69506/task/71117/cwd (readlink: Permission denied) 2024-09-10T23:29:28.108 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71117 tp_osd_tp ceph rtd unknown /proc/69506/task/71117/root (readlink: Permission denied) 2024-09-10T23:29:28.108 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71117 tp_osd_tp ceph txt unknown /proc/69506/task/71117/exe (readlink: Permission denied) 2024-09-10T23:29:28.108 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71117 tp_osd_tp ceph NOFD /proc/69506/task/71117/fd (opendir: Permission denied) 2024-09-10T23:29:28.108 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71118 tp_osd_tp ceph cwd unknown /proc/69506/task/71118/cwd (readlink: Permission denied) 2024-09-10T23:29:28.109 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71118 tp_osd_tp ceph rtd unknown /proc/69506/task/71118/root (readlink: Permission denied) 2024-09-10T23:29:28.109 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71118 tp_osd_tp ceph txt unknown /proc/69506/task/71118/exe (readlink: Permission denied) 2024-09-10T23:29:28.109 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71118 tp_osd_tp ceph NOFD /proc/69506/task/71118/fd (opendir: Permission denied) 2024-09-10T23:29:28.109 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71119 tp_osd_tp ceph cwd unknown /proc/69506/task/71119/cwd (readlink: Permission denied) 2024-09-10T23:29:28.109 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71119 tp_osd_tp ceph rtd unknown /proc/69506/task/71119/root (readlink: Permission denied) 2024-09-10T23:29:28.109 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71119 tp_osd_tp ceph txt unknown /proc/69506/task/71119/exe (readlink: Permission denied) 2024-09-10T23:29:28.109 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71119 tp_osd_tp ceph NOFD /proc/69506/task/71119/fd (opendir: Permission denied) 2024-09-10T23:29:28.109 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71120 tp_osd_tp ceph cwd unknown /proc/69506/task/71120/cwd (readlink: Permission denied) 2024-09-10T23:29:28.109 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71120 tp_osd_tp ceph rtd unknown /proc/69506/task/71120/root (readlink: Permission denied) 2024-09-10T23:29:28.109 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71120 tp_osd_tp ceph txt unknown /proc/69506/task/71120/exe (readlink: Permission denied) 2024-09-10T23:29:28.109 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71120 tp_osd_tp ceph NOFD /proc/69506/task/71120/fd (opendir: Permission denied) 2024-09-10T23:29:28.109 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71121 tp_osd_tp ceph cwd unknown /proc/69506/task/71121/cwd (readlink: Permission denied) 2024-09-10T23:29:28.109 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71121 tp_osd_tp ceph rtd unknown /proc/69506/task/71121/root (readlink: Permission denied) 2024-09-10T23:29:28.110 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71121 tp_osd_tp ceph txt unknown /proc/69506/task/71121/exe (readlink: Permission denied) 2024-09-10T23:29:28.110 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71121 tp_osd_tp ceph NOFD /proc/69506/task/71121/fd (opendir: Permission denied) 2024-09-10T23:29:28.110 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71122 osd_srv_h ceph cwd unknown /proc/69506/task/71122/cwd (readlink: Permission denied) 2024-09-10T23:29:28.110 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71122 osd_srv_h ceph rtd unknown /proc/69506/task/71122/root (readlink: Permission denied) 2024-09-10T23:29:28.110 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71122 osd_srv_h ceph txt unknown /proc/69506/task/71122/exe (readlink: Permission denied) 2024-09-10T23:29:28.110 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-osd 69506 71122 osd_srv_h ceph NOFD /proc/69506/task/71122/fd (opendir: Permission denied) 2024-09-10T23:29:28.110 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 70662 root cwd unknown /proc/70662/cwd (readlink: Permission denied) 2024-09-10T23:29:28.110 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 70662 root rtd unknown /proc/70662/root (readlink: Permission denied) 2024-09-10T23:29:28.110 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 70662 root txt unknown /proc/70662/exe (readlink: Permission denied) 2024-09-10T23:29:28.110 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 70662 root NOFD /proc/70662/fd (opendir: Permission denied) 2024-09-10T23:29:28.110 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 70682 root cwd unknown /proc/70682/cwd (readlink: Permission denied) 2024-09-10T23:29:28.110 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 70682 root rtd unknown /proc/70682/root (readlink: Permission denied) 2024-09-10T23:29:28.110 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 70682 root txt unknown /proc/70682/exe (readlink: Permission denied) 2024-09-10T23:29:28.110 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 70682 root NOFD /proc/70682/fd (opendir: Permission denied) 2024-09-10T23:29:28.111 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/1 73419 root cwd unknown /proc/73419/cwd (readlink: Permission denied) 2024-09-10T23:29:28.111 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/1 73419 root rtd unknown /proc/73419/root (readlink: Permission denied) 2024-09-10T23:29:28.111 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/1 73419 root txt unknown /proc/73419/exe (readlink: Permission denied) 2024-09-10T23:29:28.111 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/1 73419 root NOFD /proc/73419/fd (opendir: Permission denied) 2024-09-10T23:29:28.111 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/5 73827 root cwd unknown /proc/73827/cwd (readlink: Permission denied) 2024-09-10T23:29:28.111 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/5 73827 root rtd unknown /proc/73827/root (readlink: Permission denied) 2024-09-10T23:29:28.111 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/5 73827 root txt unknown /proc/73827/exe (readlink: Permission denied) 2024-09-10T23:29:28.111 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/5 73827 root NOFD /proc/73827/fd (opendir: Permission denied) 2024-09-10T23:29:28.111 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 74041 root cwd unknown /proc/74041/cwd (readlink: Permission denied) 2024-09-10T23:29:28.111 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 74041 root rtd unknown /proc/74041/root (readlink: Permission denied) 2024-09-10T23:29:28.111 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 74041 root txt unknown /proc/74041/exe (readlink: Permission denied) 2024-09-10T23:29:28.111 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 74041 root NOFD /proc/74041/fd (opendir: Permission denied) 2024-09-10T23:29:28.111 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 74058 root cwd unknown /proc/74058/cwd (readlink: Permission denied) 2024-09-10T23:29:28.112 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 74058 root rtd unknown /proc/74058/root (readlink: Permission denied) 2024-09-10T23:29:28.112 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 74058 root txt unknown /proc/74058/exe (readlink: Permission denied) 2024-09-10T23:29:28.112 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 74058 root NOFD /proc/74058/fd (opendir: Permission denied) 2024-09-10T23:29:28.112 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 74059 root cwd unknown /proc/74059/cwd (readlink: Permission denied) 2024-09-10T23:29:28.112 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 74059 root rtd unknown /proc/74059/root (readlink: Permission denied) 2024-09-10T23:29:28.112 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 74059 root txt unknown /proc/74059/exe (readlink: Permission denied) 2024-09-10T23:29:28.112 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 74059 root NOFD /proc/74059/fd (opendir: Permission denied) 2024-09-10T23:29:28.112 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 74076 root cwd unknown /proc/74076/cwd (readlink: Permission denied) 2024-09-10T23:29:28.112 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 74076 root rtd unknown /proc/74076/root (readlink: Permission denied) 2024-09-10T23:29:28.112 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 74076 root txt unknown /proc/74076/exe (readlink: Permission denied) 2024-09-10T23:29:28.112 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 74076 root NOFD /proc/74076/fd (opendir: Permission denied) 2024-09-10T23:29:28.112 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 74077 root cwd unknown /proc/74077/cwd (readlink: Permission denied) 2024-09-10T23:29:28.112 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 74077 root rtd unknown /proc/74077/root (readlink: Permission denied) 2024-09-10T23:29:28.112 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 74077 root txt unknown /proc/74077/exe (readlink: Permission denied) 2024-09-10T23:29:28.113 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 74077 root NOFD /proc/74077/fd (opendir: Permission denied) 2024-09-10T23:29:28.113 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 74094 root cwd unknown /proc/74094/cwd (readlink: Permission denied) 2024-09-10T23:29:28.113 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 74094 root rtd unknown /proc/74094/root (readlink: Permission denied) 2024-09-10T23:29:28.113 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 74094 root txt unknown /proc/74094/exe (readlink: Permission denied) 2024-09-10T23:29:28.113 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 74094 root NOFD /proc/74094/fd (opendir: Permission denied) 2024-09-10T23:29:28.113 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 74095 root cwd unknown /proc/74095/cwd (readlink: Permission denied) 2024-09-10T23:29:28.113 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 74095 root rtd unknown /proc/74095/root (readlink: Permission denied) 2024-09-10T23:29:28.113 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 74095 root txt unknown /proc/74095/exe (readlink: Permission denied) 2024-09-10T23:29:28.113 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 74095 root NOFD /proc/74095/fd (opendir: Permission denied) 2024-09-10T23:29:28.113 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 74112 root cwd unknown /proc/74112/cwd (readlink: Permission denied) 2024-09-10T23:29:28.113 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 74112 root rtd unknown /proc/74112/root (readlink: Permission denied) 2024-09-10T23:29:28.113 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 74112 root txt unknown /proc/74112/exe (readlink: Permission denied) 2024-09-10T23:29:28.113 INFO:tasks.workunit.client.0.smithi003.stdout:journalct 74112 root NOFD /proc/74112/fd (opendir: Permission denied) 2024-09-10T23:29:28.113 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 74718 root cwd unknown /proc/74718/cwd (readlink: Permission denied) 2024-09-10T23:29:28.114 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 74718 root rtd unknown /proc/74718/root (readlink: Permission denied) 2024-09-10T23:29:28.114 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 74718 root txt unknown /proc/74718/exe (readlink: Permission denied) 2024-09-10T23:29:28.114 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 74718 root NOFD /proc/74718/fd (opendir: Permission denied) 2024-09-10T23:29:28.114 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 74720 root cwd unknown /proc/74720/cwd (readlink: Permission denied) 2024-09-10T23:29:28.114 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 74720 root rtd unknown /proc/74720/root (readlink: Permission denied) 2024-09-10T23:29:28.114 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 74720 root txt unknown /proc/74720/exe (readlink: Permission denied) 2024-09-10T23:29:28.114 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 74720 root NOFD /proc/74720/fd (opendir: Permission denied) 2024-09-10T23:29:28.114 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 ceph cwd unknown /proc/74722/cwd (readlink: Permission denied) 2024-09-10T23:29:28.114 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 ceph rtd unknown /proc/74722/root (readlink: Permission denied) 2024-09-10T23:29:28.114 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 ceph txt unknown /proc/74722/exe (readlink: Permission denied) 2024-09-10T23:29:28.114 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 ceph NOFD /proc/74722/fd (opendir: Permission denied) 2024-09-10T23:29:28.114 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74723 log ceph cwd unknown /proc/74722/task/74723/cwd (readlink: Permission denied) 2024-09-10T23:29:28.114 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74723 log ceph rtd unknown /proc/74722/task/74723/root (readlink: Permission denied) 2024-09-10T23:29:28.114 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74723 log ceph txt unknown /proc/74722/task/74723/exe (readlink: Permission denied) 2024-09-10T23:29:28.115 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74723 log ceph NOFD /proc/74722/task/74723/fd (opendir: Permission denied) 2024-09-10T23:29:28.115 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74725 msgr-work ceph cwd unknown /proc/74722/task/74725/cwd (readlink: Permission denied) 2024-09-10T23:29:28.115 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74725 msgr-work ceph rtd unknown /proc/74722/task/74725/root (readlink: Permission denied) 2024-09-10T23:29:28.115 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74725 msgr-work ceph txt unknown /proc/74722/task/74725/exe (readlink: Permission denied) 2024-09-10T23:29:28.115 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74725 msgr-work ceph NOFD /proc/74722/task/74725/fd (opendir: Permission denied) 2024-09-10T23:29:28.115 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74726 msgr-work ceph cwd unknown /proc/74722/task/74726/cwd (readlink: Permission denied) 2024-09-10T23:29:28.115 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74726 msgr-work ceph rtd unknown /proc/74722/task/74726/root (readlink: Permission denied) 2024-09-10T23:29:28.115 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74726 msgr-work ceph txt unknown /proc/74722/task/74726/exe (readlink: Permission denied) 2024-09-10T23:29:28.115 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74726 msgr-work ceph NOFD /proc/74722/task/74726/fd (opendir: Permission denied) 2024-09-10T23:29:28.115 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74727 msgr-work ceph cwd unknown /proc/74722/task/74727/cwd (readlink: Permission denied) 2024-09-10T23:29:28.115 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74727 msgr-work ceph rtd unknown /proc/74722/task/74727/root (readlink: Permission denied) 2024-09-10T23:29:28.115 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74727 msgr-work ceph txt unknown /proc/74722/task/74727/exe (readlink: Permission denied) 2024-09-10T23:29:28.115 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74727 msgr-work ceph NOFD /proc/74722/task/74727/fd (opendir: Permission denied) 2024-09-10T23:29:28.115 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74731 service ceph cwd unknown /proc/74722/task/74731/cwd (readlink: Permission denied) 2024-09-10T23:29:28.116 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74731 service ceph rtd unknown /proc/74722/task/74731/root (readlink: Permission denied) 2024-09-10T23:29:28.116 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74731 service ceph txt unknown /proc/74722/task/74731/exe (readlink: Permission denied) 2024-09-10T23:29:28.116 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74731 service ceph NOFD /proc/74722/task/74731/fd (opendir: Permission denied) 2024-09-10T23:29:28.116 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74732 admin_soc ceph cwd unknown /proc/74722/task/74732/cwd (readlink: Permission denied) 2024-09-10T23:29:28.116 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74732 admin_soc ceph rtd unknown /proc/74722/task/74732/root (readlink: Permission denied) 2024-09-10T23:29:28.116 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74732 admin_soc ceph txt unknown /proc/74722/task/74732/exe (readlink: Permission denied) 2024-09-10T23:29:28.116 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74732 admin_soc ceph NOFD /proc/74722/task/74732/fd (opendir: Permission denied) 2024-09-10T23:29:28.116 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74733 signal_ha ceph cwd unknown /proc/74722/task/74733/cwd (readlink: Permission denied) 2024-09-10T23:29:28.116 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74733 signal_ha ceph rtd unknown /proc/74722/task/74733/root (readlink: Permission denied) 2024-09-10T23:29:28.116 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74733 signal_ha ceph txt unknown /proc/74722/task/74733/exe (readlink: Permission denied) 2024-09-10T23:29:28.116 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74733 signal_ha ceph NOFD /proc/74722/task/74733/fd (opendir: Permission denied) 2024-09-10T23:29:28.116 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74734 io_contex ceph cwd unknown /proc/74722/task/74734/cwd (readlink: Permission denied) 2024-09-10T23:29:28.117 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74734 io_contex ceph rtd unknown /proc/74722/task/74734/root (readlink: Permission denied) 2024-09-10T23:29:28.117 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74734 io_contex ceph txt unknown /proc/74722/task/74734/exe (readlink: Permission denied) 2024-09-10T23:29:28.117 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74734 io_contex ceph NOFD /proc/74722/task/74734/fd (opendir: Permission denied) 2024-09-10T23:29:28.117 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74735 io_contex ceph cwd unknown /proc/74722/task/74735/cwd (readlink: Permission denied) 2024-09-10T23:29:28.117 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74735 io_contex ceph rtd unknown /proc/74722/task/74735/root (readlink: Permission denied) 2024-09-10T23:29:28.117 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74735 io_contex ceph txt unknown /proc/74722/task/74735/exe (readlink: Permission denied) 2024-09-10T23:29:28.117 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74735 io_contex ceph NOFD /proc/74722/task/74735/fd (opendir: Permission denied) 2024-09-10T23:29:28.117 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74736 ms_dispat ceph cwd unknown /proc/74722/task/74736/cwd (readlink: Permission denied) 2024-09-10T23:29:28.117 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74736 ms_dispat ceph rtd unknown /proc/74722/task/74736/root (readlink: Permission denied) 2024-09-10T23:29:28.117 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74736 ms_dispat ceph txt unknown /proc/74722/task/74736/exe (readlink: Permission denied) 2024-09-10T23:29:28.117 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74736 ms_dispat ceph NOFD /proc/74722/task/74736/fd (opendir: Permission denied) 2024-09-10T23:29:28.117 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74737 ms_local ceph cwd unknown /proc/74722/task/74737/cwd (readlink: Permission denied) 2024-09-10T23:29:28.117 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74737 ms_local ceph rtd unknown /proc/74722/task/74737/root (readlink: Permission denied) 2024-09-10T23:29:28.117 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74737 ms_local ceph txt unknown /proc/74722/task/74737/exe (readlink: Permission denied) 2024-09-10T23:29:28.118 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74737 ms_local ceph NOFD /proc/74722/task/74737/fd (opendir: Permission denied) 2024-09-10T23:29:28.118 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74738 safe_time ceph cwd unknown /proc/74722/task/74738/cwd (readlink: Permission denied) 2024-09-10T23:29:28.118 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74738 safe_time ceph rtd unknown /proc/74722/task/74738/root (readlink: Permission denied) 2024-09-10T23:29:28.118 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74738 safe_time ceph txt unknown /proc/74722/task/74738/exe (readlink: Permission denied) 2024-09-10T23:29:28.118 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74738 safe_time ceph NOFD /proc/74722/task/74738/fd (opendir: Permission denied) 2024-09-10T23:29:28.118 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74739 safe_time ceph cwd unknown /proc/74722/task/74739/cwd (readlink: Permission denied) 2024-09-10T23:29:28.118 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74739 safe_time ceph rtd unknown /proc/74722/task/74739/root (readlink: Permission denied) 2024-09-10T23:29:28.118 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74739 safe_time ceph txt unknown /proc/74722/task/74739/exe (readlink: Permission denied) 2024-09-10T23:29:28.118 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74739 safe_time ceph NOFD /proc/74722/task/74739/fd (opendir: Permission denied) 2024-09-10T23:29:28.118 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74740 ceph-mds ceph cwd unknown /proc/74722/task/74740/cwd (readlink: Permission denied) 2024-09-10T23:29:28.118 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74740 ceph-mds ceph rtd unknown /proc/74722/task/74740/root (readlink: Permission denied) 2024-09-10T23:29:28.118 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74740 ceph-mds ceph txt unknown /proc/74722/task/74740/exe (readlink: Permission denied) 2024-09-10T23:29:28.118 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74740 ceph-mds ceph NOFD /proc/74722/task/74740/fd (opendir: Permission denied) 2024-09-10T23:29:28.118 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74759 safe_time ceph cwd unknown /proc/74722/task/74759/cwd (readlink: Permission denied) 2024-09-10T23:29:28.119 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74759 safe_time ceph rtd unknown /proc/74722/task/74759/root (readlink: Permission denied) 2024-09-10T23:29:28.119 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74759 safe_time ceph txt unknown /proc/74722/task/74759/exe (readlink: Permission denied) 2024-09-10T23:29:28.119 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 74722 74759 safe_time ceph NOFD /proc/74722/task/74759/fd (opendir: Permission denied) 2024-09-10T23:29:28.119 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/0 75127 root cwd unknown /proc/75127/cwd (readlink: Permission denied) 2024-09-10T23:29:28.119 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/0 75127 root rtd unknown /proc/75127/root (readlink: Permission denied) 2024-09-10T23:29:28.119 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/0 75127 root txt unknown /proc/75127/exe (readlink: Permission denied) 2024-09-10T23:29:28.119 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/0 75127 root NOFD /proc/75127/fd (opendir: Permission denied) 2024-09-10T23:29:28.119 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 75129 root cwd unknown /proc/75129/cwd (readlink: Permission denied) 2024-09-10T23:29:28.119 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 75129 root rtd unknown /proc/75129/root (readlink: Permission denied) 2024-09-10T23:29:28.119 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 75129 root txt unknown /proc/75129/exe (readlink: Permission denied) 2024-09-10T23:29:28.119 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 75129 root NOFD /proc/75129/fd (opendir: Permission denied) 2024-09-10T23:29:28.119 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 75131 root cwd unknown /proc/75131/cwd (readlink: Permission denied) 2024-09-10T23:29:28.119 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 75131 root rtd unknown /proc/75131/root (readlink: Permission denied) 2024-09-10T23:29:28.119 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 75131 root txt unknown /proc/75131/exe (readlink: Permission denied) 2024-09-10T23:29:28.119 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 75131 root NOFD /proc/75131/fd (opendir: Permission denied) 2024-09-10T23:29:28.120 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 ceph cwd unknown /proc/75135/cwd (readlink: Permission denied) 2024-09-10T23:29:28.120 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 ceph rtd unknown /proc/75135/root (readlink: Permission denied) 2024-09-10T23:29:28.120 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 ceph txt unknown /proc/75135/exe (readlink: Permission denied) 2024-09-10T23:29:28.120 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 ceph NOFD /proc/75135/fd (opendir: Permission denied) 2024-09-10T23:29:28.120 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75136 log ceph cwd unknown /proc/75135/task/75136/cwd (readlink: Permission denied) 2024-09-10T23:29:28.120 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75136 log ceph rtd unknown /proc/75135/task/75136/root (readlink: Permission denied) 2024-09-10T23:29:28.120 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75136 log ceph txt unknown /proc/75135/task/75136/exe (readlink: Permission denied) 2024-09-10T23:29:28.120 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75136 log ceph NOFD /proc/75135/task/75136/fd (opendir: Permission denied) 2024-09-10T23:29:28.120 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75138 msgr-work ceph cwd unknown /proc/75135/task/75138/cwd (readlink: Permission denied) 2024-09-10T23:29:28.120 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75138 msgr-work ceph rtd unknown /proc/75135/task/75138/root (readlink: Permission denied) 2024-09-10T23:29:28.120 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75138 msgr-work ceph txt unknown /proc/75135/task/75138/exe (readlink: Permission denied) 2024-09-10T23:29:28.120 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75138 msgr-work ceph NOFD /proc/75135/task/75138/fd (opendir: Permission denied) 2024-09-10T23:29:28.120 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75139 msgr-work ceph cwd unknown /proc/75135/task/75139/cwd (readlink: Permission denied) 2024-09-10T23:29:28.120 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75139 msgr-work ceph rtd unknown /proc/75135/task/75139/root (readlink: Permission denied) 2024-09-10T23:29:28.121 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75139 msgr-work ceph txt unknown /proc/75135/task/75139/exe (readlink: Permission denied) 2024-09-10T23:29:28.121 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75139 msgr-work ceph NOFD /proc/75135/task/75139/fd (opendir: Permission denied) 2024-09-10T23:29:28.121 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75140 msgr-work ceph cwd unknown /proc/75135/task/75140/cwd (readlink: Permission denied) 2024-09-10T23:29:28.121 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75140 msgr-work ceph rtd unknown /proc/75135/task/75140/root (readlink: Permission denied) 2024-09-10T23:29:28.121 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75140 msgr-work ceph txt unknown /proc/75135/task/75140/exe (readlink: Permission denied) 2024-09-10T23:29:28.121 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75140 msgr-work ceph NOFD /proc/75135/task/75140/fd (opendir: Permission denied) 2024-09-10T23:29:28.121 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75144 service ceph cwd unknown /proc/75135/task/75144/cwd (readlink: Permission denied) 2024-09-10T23:29:28.121 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75144 service ceph rtd unknown /proc/75135/task/75144/root (readlink: Permission denied) 2024-09-10T23:29:28.121 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75144 service ceph txt unknown /proc/75135/task/75144/exe (readlink: Permission denied) 2024-09-10T23:29:28.121 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75144 service ceph NOFD /proc/75135/task/75144/fd (opendir: Permission denied) 2024-09-10T23:29:28.121 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75145 admin_soc ceph cwd unknown /proc/75135/task/75145/cwd (readlink: Permission denied) 2024-09-10T23:29:28.121 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75145 admin_soc ceph rtd unknown /proc/75135/task/75145/root (readlink: Permission denied) 2024-09-10T23:29:28.121 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75145 admin_soc ceph txt unknown /proc/75135/task/75145/exe (readlink: Permission denied) 2024-09-10T23:29:28.122 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75145 admin_soc ceph NOFD /proc/75135/task/75145/fd (opendir: Permission denied) 2024-09-10T23:29:28.122 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75146 signal_ha ceph cwd unknown /proc/75135/task/75146/cwd (readlink: Permission denied) 2024-09-10T23:29:28.122 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75146 signal_ha ceph rtd unknown /proc/75135/task/75146/root (readlink: Permission denied) 2024-09-10T23:29:28.122 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75146 signal_ha ceph txt unknown /proc/75135/task/75146/exe (readlink: Permission denied) 2024-09-10T23:29:28.122 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75146 signal_ha ceph NOFD /proc/75135/task/75146/fd (opendir: Permission denied) 2024-09-10T23:29:28.122 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75147 io_contex ceph cwd unknown /proc/75135/task/75147/cwd (readlink: Permission denied) 2024-09-10T23:29:28.122 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75147 io_contex ceph rtd unknown /proc/75135/task/75147/root (readlink: Permission denied) 2024-09-10T23:29:28.122 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75147 io_contex ceph txt unknown /proc/75135/task/75147/exe (readlink: Permission denied) 2024-09-10T23:29:28.122 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75147 io_contex ceph NOFD /proc/75135/task/75147/fd (opendir: Permission denied) 2024-09-10T23:29:28.122 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75148 io_contex ceph cwd unknown /proc/75135/task/75148/cwd (readlink: Permission denied) 2024-09-10T23:29:28.122 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75148 io_contex ceph rtd unknown /proc/75135/task/75148/root (readlink: Permission denied) 2024-09-10T23:29:28.122 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75148 io_contex ceph txt unknown /proc/75135/task/75148/exe (readlink: Permission denied) 2024-09-10T23:29:28.122 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75148 io_contex ceph NOFD /proc/75135/task/75148/fd (opendir: Permission denied) 2024-09-10T23:29:28.122 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75149 ms_dispat ceph cwd unknown /proc/75135/task/75149/cwd (readlink: Permission denied) 2024-09-10T23:29:28.123 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75149 ms_dispat ceph rtd unknown /proc/75135/task/75149/root (readlink: Permission denied) 2024-09-10T23:29:28.123 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75149 ms_dispat ceph txt unknown /proc/75135/task/75149/exe (readlink: Permission denied) 2024-09-10T23:29:28.123 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75149 ms_dispat ceph NOFD /proc/75135/task/75149/fd (opendir: Permission denied) 2024-09-10T23:29:28.123 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75150 ms_local ceph cwd unknown /proc/75135/task/75150/cwd (readlink: Permission denied) 2024-09-10T23:29:28.123 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75150 ms_local ceph rtd unknown /proc/75135/task/75150/root (readlink: Permission denied) 2024-09-10T23:29:28.123 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75150 ms_local ceph txt unknown /proc/75135/task/75150/exe (readlink: Permission denied) 2024-09-10T23:29:28.123 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75150 ms_local ceph NOFD /proc/75135/task/75150/fd (opendir: Permission denied) 2024-09-10T23:29:28.123 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75151 safe_time ceph cwd unknown /proc/75135/task/75151/cwd (readlink: Permission denied) 2024-09-10T23:29:28.123 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75151 safe_time ceph rtd unknown /proc/75135/task/75151/root (readlink: Permission denied) 2024-09-10T23:29:28.123 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75151 safe_time ceph txt unknown /proc/75135/task/75151/exe (readlink: Permission denied) 2024-09-10T23:29:28.123 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75151 safe_time ceph NOFD /proc/75135/task/75151/fd (opendir: Permission denied) 2024-09-10T23:29:28.123 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75152 safe_time ceph cwd unknown /proc/75135/task/75152/cwd (readlink: Permission denied) 2024-09-10T23:29:28.123 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75152 safe_time ceph rtd unknown /proc/75135/task/75152/root (readlink: Permission denied) 2024-09-10T23:29:28.124 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75152 safe_time ceph txt unknown /proc/75135/task/75152/exe (readlink: Permission denied) 2024-09-10T23:29:28.124 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75152 safe_time ceph NOFD /proc/75135/task/75152/fd (opendir: Permission denied) 2024-09-10T23:29:28.124 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75153 ceph-mds ceph cwd unknown /proc/75135/task/75153/cwd (readlink: Permission denied) 2024-09-10T23:29:28.124 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75153 ceph-mds ceph rtd unknown /proc/75135/task/75153/root (readlink: Permission denied) 2024-09-10T23:29:28.124 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75153 ceph-mds ceph txt unknown /proc/75135/task/75153/exe (readlink: Permission denied) 2024-09-10T23:29:28.124 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75153 ceph-mds ceph NOFD /proc/75135/task/75153/fd (opendir: Permission denied) 2024-09-10T23:29:28.124 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75154 safe_time ceph cwd unknown /proc/75135/task/75154/cwd (readlink: Permission denied) 2024-09-10T23:29:28.124 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75154 safe_time ceph rtd unknown /proc/75135/task/75154/root (readlink: Permission denied) 2024-09-10T23:29:28.124 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75154 safe_time ceph txt unknown /proc/75135/task/75154/exe (readlink: Permission denied) 2024-09-10T23:29:28.124 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 75135 75154 safe_time ceph NOFD /proc/75135/task/75154/fd (opendir: Permission denied) 2024-09-10T23:29:28.124 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 76004 root cwd unknown /proc/76004/cwd (readlink: Permission denied) 2024-09-10T23:29:28.124 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 76004 root rtd unknown /proc/76004/root (readlink: Permission denied) 2024-09-10T23:29:28.125 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 76004 root txt unknown /proc/76004/exe (readlink: Permission denied) 2024-09-10T23:29:28.125 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 76004 root NOFD /proc/76004/fd (opendir: Permission denied) 2024-09-10T23:29:28.125 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 76006 root cwd unknown /proc/76006/cwd (readlink: Permission denied) 2024-09-10T23:29:28.125 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 76006 root rtd unknown /proc/76006/root (readlink: Permission denied) 2024-09-10T23:29:28.125 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 76006 root txt unknown /proc/76006/exe (readlink: Permission denied) 2024-09-10T23:29:28.125 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 76006 root NOFD /proc/76006/fd (opendir: Permission denied) 2024-09-10T23:29:28.125 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 ceph cwd unknown /proc/76008/cwd (readlink: Permission denied) 2024-09-10T23:29:28.125 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 ceph rtd unknown /proc/76008/root (readlink: Permission denied) 2024-09-10T23:29:28.125 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 ceph txt unknown /proc/76008/exe (readlink: Permission denied) 2024-09-10T23:29:28.125 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 ceph NOFD /proc/76008/fd (opendir: Permission denied) 2024-09-10T23:29:28.125 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76009 log ceph cwd unknown /proc/76008/task/76009/cwd (readlink: Permission denied) 2024-09-10T23:29:28.125 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76009 log ceph rtd unknown /proc/76008/task/76009/root (readlink: Permission denied) 2024-09-10T23:29:28.125 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76009 log ceph txt unknown /proc/76008/task/76009/exe (readlink: Permission denied) 2024-09-10T23:29:28.126 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76009 log ceph NOFD /proc/76008/task/76009/fd (opendir: Permission denied) 2024-09-10T23:29:28.126 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76011 msgr-work ceph cwd unknown /proc/76008/task/76011/cwd (readlink: Permission denied) 2024-09-10T23:29:28.126 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76011 msgr-work ceph rtd unknown /proc/76008/task/76011/root (readlink: Permission denied) 2024-09-10T23:29:28.126 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76011 msgr-work ceph txt unknown /proc/76008/task/76011/exe (readlink: Permission denied) 2024-09-10T23:29:28.126 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76011 msgr-work ceph NOFD /proc/76008/task/76011/fd (opendir: Permission denied) 2024-09-10T23:29:28.126 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76012 msgr-work ceph cwd unknown /proc/76008/task/76012/cwd (readlink: Permission denied) 2024-09-10T23:29:28.126 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76012 msgr-work ceph rtd unknown /proc/76008/task/76012/root (readlink: Permission denied) 2024-09-10T23:29:28.126 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76012 msgr-work ceph txt unknown /proc/76008/task/76012/exe (readlink: Permission denied) 2024-09-10T23:29:28.126 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76012 msgr-work ceph NOFD /proc/76008/task/76012/fd (opendir: Permission denied) 2024-09-10T23:29:28.126 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76013 msgr-work ceph cwd unknown /proc/76008/task/76013/cwd (readlink: Permission denied) 2024-09-10T23:29:28.126 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76013 msgr-work ceph rtd unknown /proc/76008/task/76013/root (readlink: Permission denied) 2024-09-10T23:29:28.126 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76013 msgr-work ceph txt unknown /proc/76008/task/76013/exe (readlink: Permission denied) 2024-09-10T23:29:28.126 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76013 msgr-work ceph NOFD /proc/76008/task/76013/fd (opendir: Permission denied) 2024-09-10T23:29:28.127 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76017 service ceph cwd unknown /proc/76008/task/76017/cwd (readlink: Permission denied) 2024-09-10T23:29:28.127 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76017 service ceph rtd unknown /proc/76008/task/76017/root (readlink: Permission denied) 2024-09-10T23:29:28.127 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76017 service ceph txt unknown /proc/76008/task/76017/exe (readlink: Permission denied) 2024-09-10T23:29:28.127 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76017 service ceph NOFD /proc/76008/task/76017/fd (opendir: Permission denied) 2024-09-10T23:29:28.127 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76018 admin_soc ceph cwd unknown /proc/76008/task/76018/cwd (readlink: Permission denied) 2024-09-10T23:29:28.127 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76018 admin_soc ceph rtd unknown /proc/76008/task/76018/root (readlink: Permission denied) 2024-09-10T23:29:28.127 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76018 admin_soc ceph txt unknown /proc/76008/task/76018/exe (readlink: Permission denied) 2024-09-10T23:29:28.127 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76018 admin_soc ceph NOFD /proc/76008/task/76018/fd (opendir: Permission denied) 2024-09-10T23:29:28.127 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76019 signal_ha ceph cwd unknown /proc/76008/task/76019/cwd (readlink: Permission denied) 2024-09-10T23:29:28.127 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76019 signal_ha ceph rtd unknown /proc/76008/task/76019/root (readlink: Permission denied) 2024-09-10T23:29:28.127 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76019 signal_ha ceph txt unknown /proc/76008/task/76019/exe (readlink: Permission denied) 2024-09-10T23:29:28.127 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76019 signal_ha ceph NOFD /proc/76008/task/76019/fd (opendir: Permission denied) 2024-09-10T23:29:28.127 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76020 io_contex ceph cwd unknown /proc/76008/task/76020/cwd (readlink: Permission denied) 2024-09-10T23:29:28.127 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76020 io_contex ceph rtd unknown /proc/76008/task/76020/root (readlink: Permission denied) 2024-09-10T23:29:28.127 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76020 io_contex ceph txt unknown /proc/76008/task/76020/exe (readlink: Permission denied) 2024-09-10T23:29:28.128 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76020 io_contex ceph NOFD /proc/76008/task/76020/fd (opendir: Permission denied) 2024-09-10T23:29:28.128 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76021 io_contex ceph cwd unknown /proc/76008/task/76021/cwd (readlink: Permission denied) 2024-09-10T23:29:28.128 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76021 io_contex ceph rtd unknown /proc/76008/task/76021/root (readlink: Permission denied) 2024-09-10T23:29:28.128 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76021 io_contex ceph txt unknown /proc/76008/task/76021/exe (readlink: Permission denied) 2024-09-10T23:29:28.128 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76021 io_contex ceph NOFD /proc/76008/task/76021/fd (opendir: Permission denied) 2024-09-10T23:29:28.128 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76022 ms_dispat ceph cwd unknown /proc/76008/task/76022/cwd (readlink: Permission denied) 2024-09-10T23:29:28.128 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76022 ms_dispat ceph rtd unknown /proc/76008/task/76022/root (readlink: Permission denied) 2024-09-10T23:29:28.128 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76022 ms_dispat ceph txt unknown /proc/76008/task/76022/exe (readlink: Permission denied) 2024-09-10T23:29:28.128 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76022 ms_dispat ceph NOFD /proc/76008/task/76022/fd (opendir: Permission denied) 2024-09-10T23:29:28.128 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76023 ms_local ceph cwd unknown /proc/76008/task/76023/cwd (readlink: Permission denied) 2024-09-10T23:29:28.128 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76023 ms_local ceph rtd unknown /proc/76008/task/76023/root (readlink: Permission denied) 2024-09-10T23:29:28.128 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76023 ms_local ceph txt unknown /proc/76008/task/76023/exe (readlink: Permission denied) 2024-09-10T23:29:28.128 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76023 ms_local ceph NOFD /proc/76008/task/76023/fd (opendir: Permission denied) 2024-09-10T23:29:28.129 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76024 safe_time ceph cwd unknown /proc/76008/task/76024/cwd (readlink: Permission denied) 2024-09-10T23:29:28.129 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76024 safe_time ceph rtd unknown /proc/76008/task/76024/root (readlink: Permission denied) 2024-09-10T23:29:28.129 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76024 safe_time ceph txt unknown /proc/76008/task/76024/exe (readlink: Permission denied) 2024-09-10T23:29:28.129 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76024 safe_time ceph NOFD /proc/76008/task/76024/fd (opendir: Permission denied) 2024-09-10T23:29:28.129 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76025 safe_time ceph cwd unknown /proc/76008/task/76025/cwd (readlink: Permission denied) 2024-09-10T23:29:28.129 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76025 safe_time ceph rtd unknown /proc/76008/task/76025/root (readlink: Permission denied) 2024-09-10T23:29:28.129 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76025 safe_time ceph txt unknown /proc/76008/task/76025/exe (readlink: Permission denied) 2024-09-10T23:29:28.129 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76025 safe_time ceph NOFD /proc/76008/task/76025/fd (opendir: Permission denied) 2024-09-10T23:29:28.129 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76026 ceph-mds ceph cwd unknown /proc/76008/task/76026/cwd (readlink: Permission denied) 2024-09-10T23:29:28.129 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76026 ceph-mds ceph rtd unknown /proc/76008/task/76026/root (readlink: Permission denied) 2024-09-10T23:29:28.129 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76026 ceph-mds ceph txt unknown /proc/76008/task/76026/exe (readlink: Permission denied) 2024-09-10T23:29:28.129 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76026 ceph-mds ceph NOFD /proc/76008/task/76026/fd (opendir: Permission denied) 2024-09-10T23:29:28.129 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76027 safe_time ceph cwd unknown /proc/76008/task/76027/cwd (readlink: Permission denied) 2024-09-10T23:29:28.130 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76027 safe_time ceph rtd unknown /proc/76008/task/76027/root (readlink: Permission denied) 2024-09-10T23:29:28.130 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76027 safe_time ceph txt unknown /proc/76008/task/76027/exe (readlink: Permission denied) 2024-09-10T23:29:28.130 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76008 76027 safe_time ceph NOFD /proc/76008/task/76027/fd (opendir: Permission denied) 2024-09-10T23:29:28.130 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 76417 root cwd unknown /proc/76417/cwd (readlink: Permission denied) 2024-09-10T23:29:28.130 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 76417 root rtd unknown /proc/76417/root (readlink: Permission denied) 2024-09-10T23:29:28.130 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 76417 root txt unknown /proc/76417/exe (readlink: Permission denied) 2024-09-10T23:29:28.130 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 76417 root NOFD /proc/76417/fd (opendir: Permission denied) 2024-09-10T23:29:28.130 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 76419 root cwd unknown /proc/76419/cwd (readlink: Permission denied) 2024-09-10T23:29:28.130 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 76419 root rtd unknown /proc/76419/root (readlink: Permission denied) 2024-09-10T23:29:28.130 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 76419 root txt unknown /proc/76419/exe (readlink: Permission denied) 2024-09-10T23:29:28.130 INFO:tasks.workunit.client.0.smithi003.stdout:podman-in 76419 root NOFD /proc/76419/fd (opendir: Permission denied) 2024-09-10T23:29:28.130 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 ceph cwd unknown /proc/76421/cwd (readlink: Permission denied) 2024-09-10T23:29:28.130 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 ceph rtd unknown /proc/76421/root (readlink: Permission denied) 2024-09-10T23:29:28.130 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 ceph txt unknown /proc/76421/exe (readlink: Permission denied) 2024-09-10T23:29:28.131 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 ceph NOFD /proc/76421/fd (opendir: Permission denied) 2024-09-10T23:29:28.131 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76422 log ceph cwd unknown /proc/76421/task/76422/cwd (readlink: Permission denied) 2024-09-10T23:29:28.131 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76422 log ceph rtd unknown /proc/76421/task/76422/root (readlink: Permission denied) 2024-09-10T23:29:28.131 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76422 log ceph txt unknown /proc/76421/task/76422/exe (readlink: Permission denied) 2024-09-10T23:29:28.131 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76422 log ceph NOFD /proc/76421/task/76422/fd (opendir: Permission denied) 2024-09-10T23:29:28.131 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76424 msgr-work ceph cwd unknown /proc/76421/task/76424/cwd (readlink: Permission denied) 2024-09-10T23:29:28.131 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76424 msgr-work ceph rtd unknown /proc/76421/task/76424/root (readlink: Permission denied) 2024-09-10T23:29:28.131 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76424 msgr-work ceph txt unknown /proc/76421/task/76424/exe (readlink: Permission denied) 2024-09-10T23:29:28.131 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76424 msgr-work ceph NOFD /proc/76421/task/76424/fd (opendir: Permission denied) 2024-09-10T23:29:28.131 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76425 msgr-work ceph cwd unknown /proc/76421/task/76425/cwd (readlink: Permission denied) 2024-09-10T23:29:28.131 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76425 msgr-work ceph rtd unknown /proc/76421/task/76425/root (readlink: Permission denied) 2024-09-10T23:29:28.131 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76425 msgr-work ceph txt unknown /proc/76421/task/76425/exe (readlink: Permission denied) 2024-09-10T23:29:28.131 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76425 msgr-work ceph NOFD /proc/76421/task/76425/fd (opendir: Permission denied) 2024-09-10T23:29:28.132 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76426 msgr-work ceph cwd unknown /proc/76421/task/76426/cwd (readlink: Permission denied) 2024-09-10T23:29:28.132 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76426 msgr-work ceph rtd unknown /proc/76421/task/76426/root (readlink: Permission denied) 2024-09-10T23:29:28.132 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76426 msgr-work ceph txt unknown /proc/76421/task/76426/exe (readlink: Permission denied) 2024-09-10T23:29:28.132 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76426 msgr-work ceph NOFD /proc/76421/task/76426/fd (opendir: Permission denied) 2024-09-10T23:29:28.132 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76430 service ceph cwd unknown /proc/76421/task/76430/cwd (readlink: Permission denied) 2024-09-10T23:29:28.132 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76430 service ceph rtd unknown /proc/76421/task/76430/root (readlink: Permission denied) 2024-09-10T23:29:28.132 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76430 service ceph txt unknown /proc/76421/task/76430/exe (readlink: Permission denied) 2024-09-10T23:29:28.132 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76430 service ceph NOFD /proc/76421/task/76430/fd (opendir: Permission denied) 2024-09-10T23:29:28.132 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76431 admin_soc ceph cwd unknown /proc/76421/task/76431/cwd (readlink: Permission denied) 2024-09-10T23:29:28.132 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76431 admin_soc ceph rtd unknown /proc/76421/task/76431/root (readlink: Permission denied) 2024-09-10T23:29:28.132 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76431 admin_soc ceph txt unknown /proc/76421/task/76431/exe (readlink: Permission denied) 2024-09-10T23:29:28.132 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76431 admin_soc ceph NOFD /proc/76421/task/76431/fd (opendir: Permission denied) 2024-09-10T23:29:28.132 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76432 signal_ha ceph cwd unknown /proc/76421/task/76432/cwd (readlink: Permission denied) 2024-09-10T23:29:28.132 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76432 signal_ha ceph rtd unknown /proc/76421/task/76432/root (readlink: Permission denied) 2024-09-10T23:29:28.133 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76432 signal_ha ceph txt unknown /proc/76421/task/76432/exe (readlink: Permission denied) 2024-09-10T23:29:28.133 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76432 signal_ha ceph NOFD /proc/76421/task/76432/fd (opendir: Permission denied) 2024-09-10T23:29:28.133 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76433 io_contex ceph cwd unknown /proc/76421/task/76433/cwd (readlink: Permission denied) 2024-09-10T23:29:28.133 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76433 io_contex ceph rtd unknown /proc/76421/task/76433/root (readlink: Permission denied) 2024-09-10T23:29:28.133 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76433 io_contex ceph txt unknown /proc/76421/task/76433/exe (readlink: Permission denied) 2024-09-10T23:29:28.133 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76433 io_contex ceph NOFD /proc/76421/task/76433/fd (opendir: Permission denied) 2024-09-10T23:29:28.133 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76434 io_contex ceph cwd unknown /proc/76421/task/76434/cwd (readlink: Permission denied) 2024-09-10T23:29:28.133 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76434 io_contex ceph rtd unknown /proc/76421/task/76434/root (readlink: Permission denied) 2024-09-10T23:29:28.133 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76434 io_contex ceph txt unknown /proc/76421/task/76434/exe (readlink: Permission denied) 2024-09-10T23:29:28.133 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76434 io_contex ceph NOFD /proc/76421/task/76434/fd (opendir: Permission denied) 2024-09-10T23:29:28.133 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76435 ms_dispat ceph cwd unknown /proc/76421/task/76435/cwd (readlink: Permission denied) 2024-09-10T23:29:28.133 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76435 ms_dispat ceph rtd unknown /proc/76421/task/76435/root (readlink: Permission denied) 2024-09-10T23:29:28.133 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76435 ms_dispat ceph txt unknown /proc/76421/task/76435/exe (readlink: Permission denied) 2024-09-10T23:29:28.134 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76435 ms_dispat ceph NOFD /proc/76421/task/76435/fd (opendir: Permission denied) 2024-09-10T23:29:28.134 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76436 ms_local ceph cwd unknown /proc/76421/task/76436/cwd (readlink: Permission denied) 2024-09-10T23:29:28.134 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76436 ms_local ceph rtd unknown /proc/76421/task/76436/root (readlink: Permission denied) 2024-09-10T23:29:28.134 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76436 ms_local ceph txt unknown /proc/76421/task/76436/exe (readlink: Permission denied) 2024-09-10T23:29:28.134 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76436 ms_local ceph NOFD /proc/76421/task/76436/fd (opendir: Permission denied) 2024-09-10T23:29:28.134 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76437 safe_time ceph cwd unknown /proc/76421/task/76437/cwd (readlink: Permission denied) 2024-09-10T23:29:28.134 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76437 safe_time ceph rtd unknown /proc/76421/task/76437/root (readlink: Permission denied) 2024-09-10T23:29:28.134 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76437 safe_time ceph txt unknown /proc/76421/task/76437/exe (readlink: Permission denied) 2024-09-10T23:29:28.134 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76437 safe_time ceph NOFD /proc/76421/task/76437/fd (opendir: Permission denied) 2024-09-10T23:29:28.134 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76438 safe_time ceph cwd unknown /proc/76421/task/76438/cwd (readlink: Permission denied) 2024-09-10T23:29:28.134 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76438 safe_time ceph rtd unknown /proc/76421/task/76438/root (readlink: Permission denied) 2024-09-10T23:29:28.134 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76438 safe_time ceph txt unknown /proc/76421/task/76438/exe (readlink: Permission denied) 2024-09-10T23:29:28.134 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76438 safe_time ceph NOFD /proc/76421/task/76438/fd (opendir: Permission denied) 2024-09-10T23:29:28.134 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76439 ceph-mds ceph cwd unknown /proc/76421/task/76439/cwd (readlink: Permission denied) 2024-09-10T23:29:28.135 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76439 ceph-mds ceph rtd unknown /proc/76421/task/76439/root (readlink: Permission denied) 2024-09-10T23:29:28.135 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76439 ceph-mds ceph txt unknown /proc/76421/task/76439/exe (readlink: Permission denied) 2024-09-10T23:29:28.135 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76439 ceph-mds ceph NOFD /proc/76421/task/76439/fd (opendir: Permission denied) 2024-09-10T23:29:28.135 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76444 safe_time ceph cwd unknown /proc/76421/task/76444/cwd (readlink: Permission denied) 2024-09-10T23:29:28.135 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76444 safe_time ceph rtd unknown /proc/76421/task/76444/root (readlink: Permission denied) 2024-09-10T23:29:28.135 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76444 safe_time ceph txt unknown /proc/76421/task/76444/exe (readlink: Permission denied) 2024-09-10T23:29:28.135 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-mds 76421 76444 safe_time ceph NOFD /proc/76421/task/76444/fd (opendir: Permission denied) 2024-09-10T23:29:28.135 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 76755 root cwd unknown /proc/76755/cwd (readlink: Permission denied) 2024-09-10T23:29:28.135 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 76755 root rtd unknown /proc/76755/root (readlink: Permission denied) 2024-09-10T23:29:28.135 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 76755 root txt unknown /proc/76755/exe (readlink: Permission denied) 2024-09-10T23:29:28.135 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 76755 root NOFD /proc/76755/fd (opendir: Permission denied) 2024-09-10T23:29:28.135 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/0 80032 root cwd unknown /proc/80032/cwd (readlink: Permission denied) 2024-09-10T23:29:28.135 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/0 80032 root rtd unknown /proc/80032/root (readlink: Permission denied) 2024-09-10T23:29:28.136 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/0 80032 root txt unknown /proc/80032/exe (readlink: Permission denied) 2024-09-10T23:29:28.136 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/0 80032 root NOFD /proc/80032/fd (opendir: Permission denied) 2024-09-10T23:29:28.136 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/2 82064 root cwd unknown /proc/82064/cwd (readlink: Permission denied) 2024-09-10T23:29:28.136 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/2 82064 root rtd unknown /proc/82064/root (readlink: Permission denied) 2024-09-10T23:29:28.136 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/2 82064 root txt unknown /proc/82064/exe (readlink: Permission denied) 2024-09-10T23:29:28.136 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/2 82064 root NOFD /proc/82064/fd (opendir: Permission denied) 2024-09-10T23:29:28.136 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/3 85561 root cwd unknown /proc/85561/cwd (readlink: Permission denied) 2024-09-10T23:29:28.136 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/3 85561 root rtd unknown /proc/85561/root (readlink: Permission denied) 2024-09-10T23:29:28.136 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/3 85561 root txt unknown /proc/85561/exe (readlink: Permission denied) 2024-09-10T23:29:28.136 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/3 85561 root NOFD /proc/85561/fd (opendir: Permission denied) 2024-09-10T23:29:28.136 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/7 87010 root cwd unknown /proc/87010/cwd (readlink: Permission denied) 2024-09-10T23:29:28.136 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/7 87010 root rtd unknown /proc/87010/root (readlink: Permission denied) 2024-09-10T23:29:28.136 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/7 87010 root txt unknown /proc/87010/exe (readlink: Permission denied) 2024-09-10T23:29:28.137 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/7 87010 root NOFD /proc/87010/fd (opendir: Permission denied) 2024-09-10T23:29:28.137 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/7 87011 root cwd unknown /proc/87011/cwd (readlink: Permission denied) 2024-09-10T23:29:28.137 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/7 87011 root rtd unknown /proc/87011/root (readlink: Permission denied) 2024-09-10T23:29:28.137 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/7 87011 root txt unknown /proc/87011/exe (readlink: Permission denied) 2024-09-10T23:29:28.137 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/7 87011 root NOFD /proc/87011/fd (opendir: Permission denied) 2024-09-10T23:29:28.137 INFO:tasks.workunit.client.0.smithi003.stdout:bash 89274 ubuntu cwd DIR 8,1 4096 5553 /home/ubuntu 2024-09-10T23:29:28.137 INFO:tasks.workunit.client.0.smithi003.stdout:bash 89274 ubuntu rtd DIR 8,1 4096 2 / 2024-09-10T23:29:28.137 INFO:tasks.workunit.client.0.smithi003.stdout:bash 89274 ubuntu txt REG 8,1 1389072 11254 /usr/bin/bash 2024-09-10T23:29:28.137 INFO:tasks.workunit.client.0.smithi003.stdout:bash 89274 ubuntu mem REG 8,1 2586930 19889 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-09-10T23:29:28.137 INFO:tasks.workunit.client.0.smithi003.stdout:bash 89274 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-10T23:29:28.137 INFO:tasks.workunit.client.0.smithi003.stdout:bash 89274 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-10T23:29:28.137 INFO:tasks.workunit.client.0.smithi003.stdout:bash 89274 ubuntu mem REG 8,1 54 19892 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-09-10T23:29:28.137 INFO:tasks.workunit.client.0.smithi003.stdout:bash 89274 ubuntu mem REG 8,1 3284 32609 /usr/lib/locale/en_US.utf8/LC_TIME 2024-09-10T23:29:28.137 INFO:tasks.workunit.client.0.smithi003.stdout:bash 89274 ubuntu mem REG 8,1 286 32606 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-09-10T23:29:28.138 INFO:tasks.workunit.client.0.smithi003.stdout:bash 89274 ubuntu mem REG 8,1 57 30370 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-09-10T23:29:28.138 INFO:tasks.workunit.client.0.smithi003.stdout:bash 89274 ubuntu mem REG 8,1 34 32659 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-09-10T23:29:28.138 INFO:tasks.workunit.client.0.smithi003.stdout:bash 89274 ubuntu mem REG 8,1 77 19891 /usr/lib/locale/en_US.utf8/LC_NAME 2024-09-10T23:29:28.138 INFO:tasks.workunit.client.0.smithi003.stdout:bash 89274 ubuntu mem REG 8,1 167 32601 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-09-10T23:29:28.138 INFO:tasks.workunit.client.0.smithi003.stdout:bash 89274 ubuntu mem REG 8,1 59 32608 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-09-10T23:29:28.138 INFO:tasks.workunit.client.0.smithi003.stdout:bash 89274 ubuntu mem REG 8,1 23 32605 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-09-10T23:29:28.138 INFO:tasks.workunit.client.0.smithi003.stdout:bash 89274 ubuntu mem REG 8,1 195080 11252 /usr/lib64/libtinfo.so.6.2 2024-09-10T23:29:28.138 INFO:tasks.workunit.client.0.smithi003.stdout:bash 89274 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-10T23:29:28.138 INFO:tasks.workunit.client.0.smithi003.stdout:bash 89274 ubuntu mem REG 8,1 369 32604 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-09-10T23:29:28.138 INFO:tasks.workunit.client.0.smithi003.stdout:bash 89274 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-10T23:29:28.138 INFO:tasks.workunit.client.0.smithi003.stdout:bash 89274 ubuntu 0r FIFO 0,14 0t0 224460 pipe 2024-09-10T23:29:28.138 INFO:tasks.workunit.client.0.smithi003.stdout:bash 89274 ubuntu 1w FIFO 0,14 0t0 224461 pipe 2024-09-10T23:29:28.138 INFO:tasks.workunit.client.0.smithi003.stdout:bash 89274 ubuntu 2w FIFO 0,14 0t0 224462 pipe 2024-09-10T23:29:28.139 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 89306 root cwd unknown /proc/89306/cwd (readlink: Permission denied) 2024-09-10T23:29:28.139 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 89306 root rtd unknown /proc/89306/root (readlink: Permission denied) 2024-09-10T23:29:28.139 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 89306 root txt unknown /proc/89306/exe (readlink: Permission denied) 2024-09-10T23:29:28.139 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 89306 root NOFD /proc/89306/fd (opendir: Permission denied) 2024-09-10T23:29:28.139 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 89309 root cwd unknown /proc/89309/cwd (readlink: Permission denied) 2024-09-10T23:29:28.139 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 89309 root rtd unknown /proc/89309/root (readlink: Permission denied) 2024-09-10T23:29:28.139 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 89309 root txt unknown /proc/89309/exe (readlink: Permission denied) 2024-09-10T23:29:28.139 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 89309 root NOFD /proc/89309/fd (opendir: Permission denied) 2024-09-10T23:29:28.139 INFO:tasks.workunit.client.0.smithi003.stdout:daemon-he 89316 root cwd unknown /proc/89316/cwd (readlink: Permission denied) 2024-09-10T23:29:28.139 INFO:tasks.workunit.client.0.smithi003.stdout:daemon-he 89316 root rtd unknown /proc/89316/root (readlink: Permission denied) 2024-09-10T23:29:28.139 INFO:tasks.workunit.client.0.smithi003.stdout:daemon-he 89316 root txt unknown /proc/89316/exe (readlink: Permission denied) 2024-09-10T23:29:28.139 INFO:tasks.workunit.client.0.smithi003.stdout:daemon-he 89316 root NOFD /proc/89316/fd (opendir: Permission denied) 2024-09-10T23:29:28.139 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 root cwd unknown /proc/89332/cwd (readlink: Permission denied) 2024-09-10T23:29:28.140 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 root rtd unknown /proc/89332/root (readlink: Permission denied) 2024-09-10T23:29:28.140 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 root txt unknown /proc/89332/exe (readlink: Permission denied) 2024-09-10T23:29:28.140 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 root NOFD /proc/89332/fd (opendir: Permission denied) 2024-09-10T23:29:28.140 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89333 log root cwd unknown /proc/89332/task/89333/cwd (readlink: Permission denied) 2024-09-10T23:29:28.140 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89333 log root rtd unknown /proc/89332/task/89333/root (readlink: Permission denied) 2024-09-10T23:29:28.140 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89333 log root txt unknown /proc/89332/task/89333/exe (readlink: Permission denied) 2024-09-10T23:29:28.140 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89333 log root NOFD /proc/89332/task/89333/fd (opendir: Permission denied) 2024-09-10T23:29:28.140 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89335 msgr-work root cwd unknown /proc/89332/task/89335/cwd (readlink: Permission denied) 2024-09-10T23:29:28.140 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89335 msgr-work root rtd unknown /proc/89332/task/89335/root (readlink: Permission denied) 2024-09-10T23:29:28.140 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89335 msgr-work root txt unknown /proc/89332/task/89335/exe (readlink: Permission denied) 2024-09-10T23:29:28.140 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89335 msgr-work root NOFD /proc/89332/task/89335/fd (opendir: Permission denied) 2024-09-10T23:29:28.140 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89336 msgr-work root cwd unknown /proc/89332/task/89336/cwd (readlink: Permission denied) 2024-09-10T23:29:28.140 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89336 msgr-work root rtd unknown /proc/89332/task/89336/root (readlink: Permission denied) 2024-09-10T23:29:28.140 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89336 msgr-work root txt unknown /proc/89332/task/89336/exe (readlink: Permission denied) 2024-09-10T23:29:28.141 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89336 msgr-work root NOFD /proc/89332/task/89336/fd (opendir: Permission denied) 2024-09-10T23:29:28.141 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89337 msgr-work root cwd unknown /proc/89332/task/89337/cwd (readlink: Permission denied) 2024-09-10T23:29:28.141 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89337 msgr-work root rtd unknown /proc/89332/task/89337/root (readlink: Permission denied) 2024-09-10T23:29:28.141 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89337 msgr-work root txt unknown /proc/89332/task/89337/exe (readlink: Permission denied) 2024-09-10T23:29:28.141 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89337 msgr-work root NOFD /proc/89332/task/89337/fd (opendir: Permission denied) 2024-09-10T23:29:28.141 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89344 service root cwd unknown /proc/89332/task/89344/cwd (readlink: Permission denied) 2024-09-10T23:29:28.141 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89344 service root rtd unknown /proc/89332/task/89344/root (readlink: Permission denied) 2024-09-10T23:29:28.141 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89344 service root txt unknown /proc/89332/task/89344/exe (readlink: Permission denied) 2024-09-10T23:29:28.141 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89344 service root NOFD /proc/89332/task/89344/fd (opendir: Permission denied) 2024-09-10T23:29:28.141 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89345 admin_soc root cwd unknown /proc/89332/task/89345/cwd (readlink: Permission denied) 2024-09-10T23:29:28.141 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89345 admin_soc root rtd unknown /proc/89332/task/89345/root (readlink: Permission denied) 2024-09-10T23:29:28.141 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89345 admin_soc root txt unknown /proc/89332/task/89345/exe (readlink: Permission denied) 2024-09-10T23:29:28.141 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89345 admin_soc root NOFD /proc/89332/task/89345/fd (opendir: Permission denied) 2024-09-10T23:29:28.142 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89346 signal_ha root cwd unknown /proc/89332/task/89346/cwd (readlink: Permission denied) 2024-09-10T23:29:28.142 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89346 signal_ha root rtd unknown /proc/89332/task/89346/root (readlink: Permission denied) 2024-09-10T23:29:28.142 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89346 signal_ha root txt unknown /proc/89332/task/89346/exe (readlink: Permission denied) 2024-09-10T23:29:28.142 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89346 signal_ha root NOFD /proc/89332/task/89346/fd (opendir: Permission denied) 2024-09-10T23:29:28.142 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89347 io_contex root cwd unknown /proc/89332/task/89347/cwd (readlink: Permission denied) 2024-09-10T23:29:28.142 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89347 io_contex root rtd unknown /proc/89332/task/89347/root (readlink: Permission denied) 2024-09-10T23:29:28.142 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89347 io_contex root txt unknown /proc/89332/task/89347/exe (readlink: Permission denied) 2024-09-10T23:29:28.142 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89347 io_contex root NOFD /proc/89332/task/89347/fd (opendir: Permission denied) 2024-09-10T23:29:28.142 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89348 io_contex root cwd unknown /proc/89332/task/89348/cwd (readlink: Permission denied) 2024-09-10T23:29:28.142 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89348 io_contex root rtd unknown /proc/89332/task/89348/root (readlink: Permission denied) 2024-09-10T23:29:28.142 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89348 io_contex root txt unknown /proc/89332/task/89348/exe (readlink: Permission denied) 2024-09-10T23:29:28.142 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89348 io_contex root NOFD /proc/89332/task/89348/fd (opendir: Permission denied) 2024-09-10T23:29:28.142 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89349 ceph_time root cwd unknown /proc/89332/task/89349/cwd (readlink: Permission denied) 2024-09-10T23:29:28.142 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89349 ceph_time root rtd unknown /proc/89332/task/89349/root (readlink: Permission denied) 2024-09-10T23:29:28.143 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89349 ceph_time root txt unknown /proc/89332/task/89349/exe (readlink: Permission denied) 2024-09-10T23:29:28.143 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89349 ceph_time root NOFD /proc/89332/task/89349/fd (opendir: Permission denied) 2024-09-10T23:29:28.143 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89350 fn_anonym root cwd unknown /proc/89332/task/89350/cwd (readlink: Permission denied) 2024-09-10T23:29:28.143 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89350 fn_anonym root rtd unknown /proc/89332/task/89350/root (readlink: Permission denied) 2024-09-10T23:29:28.143 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89350 fn_anonym root txt unknown /proc/89332/task/89350/exe (readlink: Permission denied) 2024-09-10T23:29:28.143 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89350 fn_anonym root NOFD /proc/89332/task/89350/fd (opendir: Permission denied) 2024-09-10T23:29:28.143 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89351 fn_anonym root cwd unknown /proc/89332/task/89351/cwd (readlink: Permission denied) 2024-09-10T23:29:28.143 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89351 fn_anonym root rtd unknown /proc/89332/task/89351/root (readlink: Permission denied) 2024-09-10T23:29:28.143 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89351 fn_anonym root txt unknown /proc/89332/task/89351/exe (readlink: Permission denied) 2024-09-10T23:29:28.143 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89351 fn_anonym root NOFD /proc/89332/task/89351/fd (opendir: Permission denied) 2024-09-10T23:29:28.143 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89352 fn_anonym root cwd unknown /proc/89332/task/89352/cwd (readlink: Permission denied) 2024-09-10T23:29:28.143 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89352 fn_anonym root rtd unknown /proc/89332/task/89352/root (readlink: Permission denied) 2024-09-10T23:29:28.143 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89352 fn_anonym root txt unknown /proc/89332/task/89352/exe (readlink: Permission denied) 2024-09-10T23:29:28.144 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89352 fn_anonym root NOFD /proc/89332/task/89352/fd (opendir: Permission denied) 2024-09-10T23:29:28.144 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89353 fn_anonym root cwd unknown /proc/89332/task/89353/cwd (readlink: Permission denied) 2024-09-10T23:29:28.144 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89353 fn_anonym root rtd unknown /proc/89332/task/89353/root (readlink: Permission denied) 2024-09-10T23:29:28.144 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89353 fn_anonym root txt unknown /proc/89332/task/89353/exe (readlink: Permission denied) 2024-09-10T23:29:28.144 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89353 fn_anonym root NOFD /proc/89332/task/89353/fd (opendir: Permission denied) 2024-09-10T23:29:28.144 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89354 fn_anonym root cwd unknown /proc/89332/task/89354/cwd (readlink: Permission denied) 2024-09-10T23:29:28.144 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89354 fn_anonym root rtd unknown /proc/89332/task/89354/root (readlink: Permission denied) 2024-09-10T23:29:28.144 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89354 fn_anonym root txt unknown /proc/89332/task/89354/exe (readlink: Permission denied) 2024-09-10T23:29:28.144 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89354 fn_anonym root NOFD /proc/89332/task/89354/fd (opendir: Permission denied) 2024-09-10T23:29:28.144 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89355 safe_time root cwd unknown /proc/89332/task/89355/cwd (readlink: Permission denied) 2024-09-10T23:29:28.144 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89355 safe_time root rtd unknown /proc/89332/task/89355/root (readlink: Permission denied) 2024-09-10T23:29:28.144 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89355 safe_time root txt unknown /proc/89332/task/89355/exe (readlink: Permission denied) 2024-09-10T23:29:28.144 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89355 safe_time root NOFD /proc/89332/task/89355/fd (opendir: Permission denied) 2024-09-10T23:29:28.144 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89356 fn_anonym root cwd unknown /proc/89332/task/89356/cwd (readlink: Permission denied) 2024-09-10T23:29:28.144 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89356 fn_anonym root rtd unknown /proc/89332/task/89356/root (readlink: Permission denied) 2024-09-10T23:29:28.145 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89356 fn_anonym root txt unknown /proc/89332/task/89356/exe (readlink: Permission denied) 2024-09-10T23:29:28.145 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89356 fn_anonym root NOFD /proc/89332/task/89356/fd (opendir: Permission denied) 2024-09-10T23:29:28.145 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89358 flusher root cwd unknown /proc/89332/task/89358/cwd (readlink: Permission denied) 2024-09-10T23:29:28.145 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89358 flusher root rtd unknown /proc/89332/task/89358/root (readlink: Permission denied) 2024-09-10T23:29:28.145 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89358 flusher root txt unknown /proc/89332/task/89358/exe (readlink: Permission denied) 2024-09-10T23:29:28.145 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89358 flusher root NOFD /proc/89332/task/89358/fd (opendir: Permission denied) 2024-09-10T23:29:28.145 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89359 ms_dispat root cwd unknown /proc/89332/task/89359/cwd (readlink: Permission denied) 2024-09-10T23:29:28.145 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89359 ms_dispat root rtd unknown /proc/89332/task/89359/root (readlink: Permission denied) 2024-09-10T23:29:28.145 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89359 ms_dispat root txt unknown /proc/89332/task/89359/exe (readlink: Permission denied) 2024-09-10T23:29:28.145 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89359 ms_dispat root NOFD /proc/89332/task/89359/fd (opendir: Permission denied) 2024-09-10T23:29:28.145 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89360 ms_local root cwd unknown /proc/89332/task/89360/cwd (readlink: Permission denied) 2024-09-10T23:29:28.145 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89360 ms_local root rtd unknown /proc/89332/task/89360/root (readlink: Permission denied) 2024-09-10T23:29:28.145 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89360 ms_local root txt unknown /proc/89332/task/89360/exe (readlink: Permission denied) 2024-09-10T23:29:28.146 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89360 ms_local root NOFD /proc/89332/task/89360/fd (opendir: Permission denied) 2024-09-10T23:29:28.146 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89361 safe_time root cwd unknown /proc/89332/task/89361/cwd (readlink: Permission denied) 2024-09-10T23:29:28.146 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89361 safe_time root rtd unknown /proc/89332/task/89361/root (readlink: Permission denied) 2024-09-10T23:29:28.146 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89361 safe_time root txt unknown /proc/89332/task/89361/exe (readlink: Permission denied) 2024-09-10T23:29:28.146 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89361 safe_time root NOFD /proc/89332/task/89361/fd (opendir: Permission denied) 2024-09-10T23:29:28.146 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89362 ceph-fuse root cwd unknown /proc/89332/task/89362/cwd (readlink: Permission denied) 2024-09-10T23:29:28.146 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89362 ceph-fuse root rtd unknown /proc/89332/task/89362/root (readlink: Permission denied) 2024-09-10T23:29:28.146 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89362 ceph-fuse root txt unknown /proc/89332/task/89362/exe (readlink: Permission denied) 2024-09-10T23:29:28.146 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89362 ceph-fuse root NOFD /proc/89332/task/89362/fd (opendir: Permission denied) 2024-09-10T23:29:28.146 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89376 ceph-fuse root cwd unknown /proc/89332/task/89376/cwd (readlink: Permission denied) 2024-09-10T23:29:28.146 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89376 ceph-fuse root rtd unknown /proc/89332/task/89376/root (readlink: Permission denied) 2024-09-10T23:29:28.146 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89376 ceph-fuse root txt unknown /proc/89332/task/89376/exe (readlink: Permission denied) 2024-09-10T23:29:28.146 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89376 ceph-fuse root NOFD /proc/89332/task/89376/fd (opendir: Permission denied) 2024-09-10T23:29:28.146 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89378 ceph-fuse root cwd unknown /proc/89332/task/89378/cwd (readlink: Permission denied) 2024-09-10T23:29:28.147 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89378 ceph-fuse root rtd unknown /proc/89332/task/89378/root (readlink: Permission denied) 2024-09-10T23:29:28.147 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89378 ceph-fuse root txt unknown /proc/89332/task/89378/exe (readlink: Permission denied) 2024-09-10T23:29:28.147 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 89378 ceph-fuse root NOFD /proc/89332/task/89378/fd (opendir: Permission denied) 2024-09-10T23:29:28.147 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 91837 ceph-fuse root cwd unknown /proc/89332/task/91837/cwd (readlink: Permission denied) 2024-09-10T23:29:28.147 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 91837 ceph-fuse root rtd unknown /proc/89332/task/91837/root (readlink: Permission denied) 2024-09-10T23:29:28.147 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 91837 ceph-fuse root txt unknown /proc/89332/task/91837/exe (readlink: Permission denied) 2024-09-10T23:29:28.147 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 91837 ceph-fuse root NOFD /proc/89332/task/91837/fd (opendir: Permission denied) 2024-09-10T23:29:28.147 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 91976 ceph-fuse root cwd unknown /proc/89332/task/91976/cwd (readlink: Permission denied) 2024-09-10T23:29:28.147 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 91976 ceph-fuse root rtd unknown /proc/89332/task/91976/root (readlink: Permission denied) 2024-09-10T23:29:28.147 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 91976 ceph-fuse root txt unknown /proc/89332/task/91976/exe (readlink: Permission denied) 2024-09-10T23:29:28.147 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 91976 ceph-fuse root NOFD /proc/89332/task/91976/fd (opendir: Permission denied) 2024-09-10T23:29:28.147 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 91977 ceph-fuse root cwd unknown /proc/89332/task/91977/cwd (readlink: Permission denied) 2024-09-10T23:29:28.147 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 91977 ceph-fuse root rtd unknown /proc/89332/task/91977/root (readlink: Permission denied) 2024-09-10T23:29:28.147 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 91977 ceph-fuse root txt unknown /proc/89332/task/91977/exe (readlink: Permission denied) 2024-09-10T23:29:28.148 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 91977 ceph-fuse root NOFD /proc/89332/task/91977/fd (opendir: Permission denied) 2024-09-10T23:29:28.148 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 92005 ceph-fuse root cwd unknown /proc/89332/task/92005/cwd (readlink: Permission denied) 2024-09-10T23:29:28.148 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 92005 ceph-fuse root rtd unknown /proc/89332/task/92005/root (readlink: Permission denied) 2024-09-10T23:29:28.148 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 92005 ceph-fuse root txt unknown /proc/89332/task/92005/exe (readlink: Permission denied) 2024-09-10T23:29:28.148 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 92005 ceph-fuse root NOFD /proc/89332/task/92005/fd (opendir: Permission denied) 2024-09-10T23:29:28.148 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 92046 ceph-fuse root cwd unknown /proc/89332/task/92046/cwd (readlink: Permission denied) 2024-09-10T23:29:28.148 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 92046 ceph-fuse root rtd unknown /proc/89332/task/92046/root (readlink: Permission denied) 2024-09-10T23:29:28.148 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 92046 ceph-fuse root txt unknown /proc/89332/task/92046/exe (readlink: Permission denied) 2024-09-10T23:29:28.148 INFO:tasks.workunit.client.0.smithi003.stdout:ceph-fuse 89332 92046 ceph-fuse root NOFD /proc/89332/task/92046/fd (opendir: Permission denied) 2024-09-10T23:29:28.148 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/5 91475 root cwd unknown /proc/91475/cwd (readlink: Permission denied) 2024-09-10T23:29:28.148 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/5 91475 root rtd unknown /proc/91475/root (readlink: Permission denied) 2024-09-10T23:29:28.148 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/5 91475 root txt unknown /proc/91475/exe (readlink: Permission denied) 2024-09-10T23:29:28.148 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/5 91475 root NOFD /proc/91475/fd (opendir: Permission denied) 2024-09-10T23:29:28.148 INFO:tasks.workunit.client.0.smithi003.stdout:timeout 91820 ubuntu cwd DIR 0,120 269505656 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T23:29:28.149 INFO:tasks.workunit.client.0.smithi003.stdout:timeout 91820 ubuntu rtd DIR 8,1 4096 2 / 2024-09-10T23:29:28.149 INFO:tasks.workunit.client.0.smithi003.stdout:timeout 91820 ubuntu txt REG 8,1 41128 11685 /usr/bin/timeout 2024-09-10T23:29:28.149 INFO:tasks.workunit.client.0.smithi003.stdout:timeout 91820 ubuntu mem REG 8,1 2586930 19889 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-09-10T23:29:28.149 INFO:tasks.workunit.client.0.smithi003.stdout:timeout 91820 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-10T23:29:28.149 INFO:tasks.workunit.client.0.smithi003.stdout:timeout 91820 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-10T23:29:28.149 INFO:tasks.workunit.client.0.smithi003.stdout:timeout 91820 ubuntu mem REG 8,1 54 19892 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-09-10T23:29:28.149 INFO:tasks.workunit.client.0.smithi003.stdout:timeout 91820 ubuntu mem REG 8,1 3284 32609 /usr/lib/locale/en_US.utf8/LC_TIME 2024-09-10T23:29:28.149 INFO:tasks.workunit.client.0.smithi003.stdout:timeout 91820 ubuntu mem REG 8,1 286 32606 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-09-10T23:29:28.149 INFO:tasks.workunit.client.0.smithi003.stdout:timeout 91820 ubuntu mem REG 8,1 57 30370 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-09-10T23:29:28.149 INFO:tasks.workunit.client.0.smithi003.stdout:timeout 91820 ubuntu mem REG 8,1 34 32659 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-09-10T23:29:28.149 INFO:tasks.workunit.client.0.smithi003.stdout:timeout 91820 ubuntu mem REG 8,1 77 19891 /usr/lib/locale/en_US.utf8/LC_NAME 2024-09-10T23:29:28.149 INFO:tasks.workunit.client.0.smithi003.stdout:timeout 91820 ubuntu mem REG 8,1 167 32601 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-09-10T23:29:28.150 INFO:tasks.workunit.client.0.smithi003.stdout:timeout 91820 ubuntu mem REG 8,1 59 32608 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-09-10T23:29:28.150 INFO:tasks.workunit.client.0.smithi003.stdout:timeout 91820 ubuntu mem REG 8,1 23 32605 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-09-10T23:29:28.150 INFO:tasks.workunit.client.0.smithi003.stdout:timeout 91820 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-10T23:29:28.150 INFO:tasks.workunit.client.0.smithi003.stdout:timeout 91820 ubuntu mem REG 8,1 369 32604 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-09-10T23:29:28.150 INFO:tasks.workunit.client.0.smithi003.stdout:timeout 91820 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-10T23:29:28.150 INFO:tasks.workunit.client.0.smithi003.stdout:timeout 91820 ubuntu 0r FIFO 0,14 0t0 230574 pipe 2024-09-10T23:29:28.150 INFO:tasks.workunit.client.0.smithi003.stdout:timeout 91820 ubuntu 1w FIFO 0,14 0t0 230575 pipe 2024-09-10T23:29:28.150 INFO:tasks.workunit.client.0.smithi003.stdout:timeout 91820 ubuntu 2w FIFO 0,14 0t0 230576 pipe 2024-09-10T23:29:28.150 INFO:tasks.workunit.client.0.smithi003.stdout:fsync-tes 91839 ubuntu cwd DIR 0,120 269505656 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T23:29:28.150 INFO:tasks.workunit.client.0.smithi003.stdout:fsync-tes 91839 ubuntu rtd DIR 8,1 4096 2 / 2024-09-10T23:29:28.150 INFO:tasks.workunit.client.0.smithi003.stdout:fsync-tes 91839 ubuntu txt REG 8,1 1389072 11254 /usr/bin/bash 2024-09-10T23:29:28.150 INFO:tasks.workunit.client.0.smithi003.stdout:fsync-tes 91839 ubuntu mem REG 8,1 2586930 19889 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-09-10T23:29:28.150 INFO:tasks.workunit.client.0.smithi003.stdout:fsync-tes 91839 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-10T23:29:28.150 INFO:tasks.workunit.client.0.smithi003.stdout:fsync-tes 91839 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-10T23:29:28.151 INFO:tasks.workunit.client.0.smithi003.stdout:fsync-tes 91839 ubuntu mem REG 8,1 54 19892 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-09-10T23:29:28.151 INFO:tasks.workunit.client.0.smithi003.stdout:fsync-tes 91839 ubuntu mem REG 8,1 3284 32609 /usr/lib/locale/en_US.utf8/LC_TIME 2024-09-10T23:29:28.151 INFO:tasks.workunit.client.0.smithi003.stdout:fsync-tes 91839 ubuntu mem REG 8,1 286 32606 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-09-10T23:29:28.151 INFO:tasks.workunit.client.0.smithi003.stdout:fsync-tes 91839 ubuntu mem REG 8,1 57 30370 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-09-10T23:29:28.151 INFO:tasks.workunit.client.0.smithi003.stdout:fsync-tes 91839 ubuntu mem REG 8,1 34 32659 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-09-10T23:29:28.151 INFO:tasks.workunit.client.0.smithi003.stdout:fsync-tes 91839 ubuntu mem REG 8,1 77 19891 /usr/lib/locale/en_US.utf8/LC_NAME 2024-09-10T23:29:28.151 INFO:tasks.workunit.client.0.smithi003.stdout:fsync-tes 91839 ubuntu mem REG 8,1 167 32601 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-09-10T23:29:28.151 INFO:tasks.workunit.client.0.smithi003.stdout:fsync-tes 91839 ubuntu mem REG 8,1 59 32608 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-09-10T23:29:28.151 INFO:tasks.workunit.client.0.smithi003.stdout:fsync-tes 91839 ubuntu mem REG 8,1 23 32605 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-09-10T23:29:28.151 INFO:tasks.workunit.client.0.smithi003.stdout:fsync-tes 91839 ubuntu mem REG 8,1 195080 11252 /usr/lib64/libtinfo.so.6.2 2024-09-10T23:29:28.151 INFO:tasks.workunit.client.0.smithi003.stdout:fsync-tes 91839 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-10T23:29:28.151 INFO:tasks.workunit.client.0.smithi003.stdout:fsync-tes 91839 ubuntu mem REG 8,1 369 32604 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-09-10T23:29:28.151 INFO:tasks.workunit.client.0.smithi003.stdout:fsync-tes 91839 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-10T23:29:28.152 INFO:tasks.workunit.client.0.smithi003.stdout:fsync-tes 91839 ubuntu 0r FIFO 0,14 0t0 230574 pipe 2024-09-10T23:29:28.152 INFO:tasks.workunit.client.0.smithi003.stdout:fsync-tes 91839 ubuntu 1w FIFO 0,14 0t0 230575 pipe 2024-09-10T23:29:28.152 INFO:tasks.workunit.client.0.smithi003.stdout:fsync-tes 91839 ubuntu 2w FIFO 0,14 0t0 230576 pipe 2024-09-10T23:29:28.152 INFO:tasks.workunit.client.0.smithi003.stdout:fsync-tes 91839 ubuntu 255r REG 8,1 207 792793 /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2024-09-10T23:29:28.152 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 92045 root cwd unknown /proc/92045/cwd (readlink: Permission denied) 2024-09-10T23:29:28.152 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 92045 root rtd unknown /proc/92045/root (readlink: Permission denied) 2024-09-10T23:29:28.152 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 92045 root txt unknown /proc/92045/exe (readlink: Permission denied) 2024-09-10T23:29:28.152 INFO:tasks.workunit.client.0.smithi003.stdout:kworker/u 92045 root NOFD /proc/92045/fd (opendir: Permission denied) 2024-09-10T23:29:28.152 INFO:tasks.workunit.client.0.smithi003.stdout:setrouble 92959 setroubleshoot cwd unknown /proc/92959/cwd (readlink: Permission denied) 2024-09-10T23:29:28.152 INFO:tasks.workunit.client.0.smithi003.stdout:setrouble 92959 setroubleshoot rtd unknown /proc/92959/root (readlink: Permission denied) 2024-09-10T23:29:28.152 INFO:tasks.workunit.client.0.smithi003.stdout:setrouble 92959 setroubleshoot txt unknown /proc/92959/exe (readlink: Permission denied) 2024-09-10T23:29:28.152 INFO:tasks.workunit.client.0.smithi003.stdout:setrouble 92959 setroubleshoot NOFD /proc/92959/fd (opendir: Permission denied) 2024-09-10T23:29:28.152 INFO:tasks.workunit.client.0.smithi003.stdout:setrouble 92959 92961 setrouble setroubleshoot cwd unknown /proc/92959/task/92961/cwd (readlink: Permission denied) 2024-09-10T23:29:28.152 INFO:tasks.workunit.client.0.smithi003.stdout:setrouble 92959 92961 setrouble setroubleshoot rtd unknown /proc/92959/task/92961/root (readlink: Permission denied) 2024-09-10T23:29:28.153 INFO:tasks.workunit.client.0.smithi003.stdout:setrouble 92959 92961 setrouble setroubleshoot txt unknown /proc/92959/task/92961/exe (readlink: Permission denied) 2024-09-10T23:29:28.153 INFO:tasks.workunit.client.0.smithi003.stdout:setrouble 92959 92961 setrouble setroubleshoot NOFD /proc/92959/task/92961/fd (opendir: Permission denied) 2024-09-10T23:29:28.153 INFO:tasks.workunit.client.0.smithi003.stdout:setrouble 92959 92968 gmain setroubleshoot cwd unknown /proc/92959/task/92968/cwd (readlink: Permission denied) 2024-09-10T23:29:28.153 INFO:tasks.workunit.client.0.smithi003.stdout:setrouble 92959 92968 gmain setroubleshoot rtd unknown /proc/92959/task/92968/root (readlink: Permission denied) 2024-09-10T23:29:28.153 INFO:tasks.workunit.client.0.smithi003.stdout:setrouble 92959 92968 gmain setroubleshoot txt unknown /proc/92959/task/92968/exe (readlink: Permission denied) 2024-09-10T23:29:28.153 INFO:tasks.workunit.client.0.smithi003.stdout:setrouble 92959 92968 gmain setroubleshoot NOFD /proc/92959/task/92968/fd (opendir: Permission denied) 2024-09-10T23:29:28.153 INFO:tasks.workunit.client.0.smithi003.stdout:setrouble 92959 92969 gdbus setroubleshoot cwd unknown /proc/92959/task/92969/cwd (readlink: Permission denied) 2024-09-10T23:29:28.153 INFO:tasks.workunit.client.0.smithi003.stdout:setrouble 92959 92969 gdbus setroubleshoot rtd unknown /proc/92959/task/92969/root (readlink: Permission denied) 2024-09-10T23:29:28.153 INFO:tasks.workunit.client.0.smithi003.stdout:setrouble 92959 92969 gdbus setroubleshoot txt unknown /proc/92959/task/92969/exe (readlink: Permission denied) 2024-09-10T23:29:28.153 INFO:tasks.workunit.client.0.smithi003.stdout:setrouble 92959 92969 gdbus setroubleshoot NOFD /proc/92959/task/92969/fd (opendir: Permission denied) 2024-09-10T23:29:28.153 INFO:tasks.workunit.client.0.smithi003.stdout:Setrouble 92970 root cwd unknown /proc/92970/cwd (readlink: Permission denied) 2024-09-10T23:29:28.153 INFO:tasks.workunit.client.0.smithi003.stdout:Setrouble 92970 root rtd unknown /proc/92970/root (readlink: Permission denied) 2024-09-10T23:29:28.154 INFO:tasks.workunit.client.0.smithi003.stdout:Setrouble 92970 root txt unknown /proc/92970/exe (readlink: Permission denied) 2024-09-10T23:29:28.154 INFO:tasks.workunit.client.0.smithi003.stdout:Setrouble 92970 root NOFD /proc/92970/fd (opendir: Permission denied) 2024-09-10T23:29:28.154 INFO:tasks.workunit.client.0.smithi003.stdout:Setrouble 92970 92989 gmain root cwd unknown /proc/92970/task/92989/cwd (readlink: Permission denied) 2024-09-10T23:29:28.154 INFO:tasks.workunit.client.0.smithi003.stdout:Setrouble 92970 92989 gmain root rtd unknown /proc/92970/task/92989/root (readlink: Permission denied) 2024-09-10T23:29:28.154 INFO:tasks.workunit.client.0.smithi003.stdout:Setrouble 92970 92989 gmain root txt unknown /proc/92970/task/92989/exe (readlink: Permission denied) 2024-09-10T23:29:28.154 INFO:tasks.workunit.client.0.smithi003.stdout:Setrouble 92970 92989 gmain root NOFD /proc/92970/task/92989/fd (opendir: Permission denied) 2024-09-10T23:29:28.154 INFO:tasks.workunit.client.0.smithi003.stdout:Setrouble 92970 92990 gdbus root cwd unknown /proc/92970/task/92990/cwd (readlink: Permission denied) 2024-09-10T23:29:28.154 INFO:tasks.workunit.client.0.smithi003.stdout:Setrouble 92970 92990 gdbus root rtd unknown /proc/92970/task/92990/root (readlink: Permission denied) 2024-09-10T23:29:28.154 INFO:tasks.workunit.client.0.smithi003.stdout:Setrouble 92970 92990 gdbus root txt unknown /proc/92970/task/92990/exe (readlink: Permission denied) 2024-09-10T23:29:28.154 INFO:tasks.workunit.client.0.smithi003.stdout:Setrouble 92970 92990 gdbus root NOFD /proc/92970/task/92990/fd (opendir: Permission denied) 2024-09-10T23:29:28.154 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 92971 root cwd unknown /proc/92971/cwd (readlink: Permission denied) 2024-09-10T23:29:28.154 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 92971 root rtd unknown /proc/92971/root (readlink: Permission denied) 2024-09-10T23:29:28.154 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 92971 root txt unknown /proc/92971/exe (readlink: Permission denied) 2024-09-10T23:29:28.154 INFO:tasks.workunit.client.0.smithi003.stdout:sudo 92971 root NOFD /proc/92971/fd (opendir: Permission denied) 2024-09-10T23:29:28.155 INFO:tasks.workunit.client.0.smithi003.stdout:cephadm 92988 root cwd unknown /proc/92988/cwd (readlink: Permission denied) 2024-09-10T23:29:28.155 INFO:tasks.workunit.client.0.smithi003.stdout:cephadm 92988 root rtd unknown /proc/92988/root (readlink: Permission denied) 2024-09-10T23:29:28.155 INFO:tasks.workunit.client.0.smithi003.stdout:cephadm 92988 root txt unknown /proc/92988/exe (readlink: Permission denied) 2024-09-10T23:29:28.155 INFO:tasks.workunit.client.0.smithi003.stdout:cephadm 92988 root NOFD /proc/92988/fd (opendir: Permission denied) 2024-09-10T23:29:28.155 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 root cwd unknown /proc/93029/cwd (readlink: Permission denied) 2024-09-10T23:29:28.155 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 root rtd unknown /proc/93029/root (readlink: Permission denied) 2024-09-10T23:29:28.155 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 root txt unknown /proc/93029/exe (readlink: Permission denied) 2024-09-10T23:29:28.155 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 root NOFD /proc/93029/fd (opendir: Permission denied) 2024-09-10T23:29:28.155 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93030 podman root cwd unknown /proc/93029/task/93030/cwd (readlink: Permission denied) 2024-09-10T23:29:28.155 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93030 podman root rtd unknown /proc/93029/task/93030/root (readlink: Permission denied) 2024-09-10T23:29:28.155 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93030 podman root txt unknown /proc/93029/task/93030/exe (readlink: Permission denied) 2024-09-10T23:29:28.155 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93030 podman root NOFD /proc/93029/task/93030/fd (opendir: Permission denied) 2024-09-10T23:29:28.155 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93031 podman root cwd unknown /proc/93029/task/93031/cwd (readlink: Permission denied) 2024-09-10T23:29:28.155 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93031 podman root rtd unknown /proc/93029/task/93031/root (readlink: Permission denied) 2024-09-10T23:29:28.155 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93031 podman root txt unknown /proc/93029/task/93031/exe (readlink: Permission denied) 2024-09-10T23:29:28.156 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93031 podman root NOFD /proc/93029/task/93031/fd (opendir: Permission denied) 2024-09-10T23:29:28.156 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93032 podman root cwd unknown /proc/93029/task/93032/cwd (readlink: Permission denied) 2024-09-10T23:29:28.156 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93032 podman root rtd unknown /proc/93029/task/93032/root (readlink: Permission denied) 2024-09-10T23:29:28.156 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93032 podman root txt unknown /proc/93029/task/93032/exe (readlink: Permission denied) 2024-09-10T23:29:28.156 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93032 podman root NOFD /proc/93029/task/93032/fd (opendir: Permission denied) 2024-09-10T23:29:28.156 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93033 podman root cwd unknown /proc/93029/task/93033/cwd (readlink: Permission denied) 2024-09-10T23:29:28.156 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93033 podman root rtd unknown /proc/93029/task/93033/root (readlink: Permission denied) 2024-09-10T23:29:28.156 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93033 podman root txt unknown /proc/93029/task/93033/exe (readlink: Permission denied) 2024-09-10T23:29:28.156 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93033 podman root NOFD /proc/93029/task/93033/fd (opendir: Permission denied) 2024-09-10T23:29:28.156 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93034 podman root cwd unknown /proc/93029/task/93034/cwd (readlink: Permission denied) 2024-09-10T23:29:28.156 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93034 podman root rtd unknown /proc/93029/task/93034/root (readlink: Permission denied) 2024-09-10T23:29:28.156 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93034 podman root txt unknown /proc/93029/task/93034/exe (readlink: Permission denied) 2024-09-10T23:29:28.156 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93034 podman root NOFD /proc/93029/task/93034/fd (opendir: Permission denied) 2024-09-10T23:29:28.156 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93035 podman root cwd unknown /proc/93029/task/93035/cwd (readlink: Permission denied) 2024-09-10T23:29:28.157 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93035 podman root rtd unknown /proc/93029/task/93035/root (readlink: Permission denied) 2024-09-10T23:29:28.157 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93035 podman root txt unknown /proc/93029/task/93035/exe (readlink: Permission denied) 2024-09-10T23:29:28.157 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93035 podman root NOFD /proc/93029/task/93035/fd (opendir: Permission denied) 2024-09-10T23:29:28.157 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93036 podman root cwd unknown /proc/93029/task/93036/cwd (readlink: Permission denied) 2024-09-10T23:29:28.157 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93036 podman root rtd unknown /proc/93029/task/93036/root (readlink: Permission denied) 2024-09-10T23:29:28.157 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93036 podman root txt unknown /proc/93029/task/93036/exe (readlink: Permission denied) 2024-09-10T23:29:28.157 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93036 podman root NOFD /proc/93029/task/93036/fd (opendir: Permission denied) 2024-09-10T23:29:28.157 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93037 podman root cwd unknown /proc/93029/task/93037/cwd (readlink: Permission denied) 2024-09-10T23:29:28.157 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93037 podman root rtd unknown /proc/93029/task/93037/root (readlink: Permission denied) 2024-09-10T23:29:28.157 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93037 podman root txt unknown /proc/93029/task/93037/exe (readlink: Permission denied) 2024-09-10T23:29:28.157 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93037 podman root NOFD /proc/93029/task/93037/fd (opendir: Permission denied) 2024-09-10T23:29:28.157 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93038 podman root cwd unknown /proc/93029/task/93038/cwd (readlink: Permission denied) 2024-09-10T23:29:28.158 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93038 podman root rtd unknown /proc/93029/task/93038/root (readlink: Permission denied) 2024-09-10T23:29:28.158 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93038 podman root txt unknown /proc/93029/task/93038/exe (readlink: Permission denied) 2024-09-10T23:29:28.158 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93038 podman root NOFD /proc/93029/task/93038/fd (opendir: Permission denied) 2024-09-10T23:29:28.158 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93039 podman root cwd unknown /proc/93029/task/93039/cwd (readlink: Permission denied) 2024-09-10T23:29:28.158 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93039 podman root rtd unknown /proc/93029/task/93039/root (readlink: Permission denied) 2024-09-10T23:29:28.158 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93039 podman root txt unknown /proc/93029/task/93039/exe (readlink: Permission denied) 2024-09-10T23:29:28.158 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93039 podman root NOFD /proc/93029/task/93039/fd (opendir: Permission denied) 2024-09-10T23:29:28.158 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93040 podman root cwd unknown /proc/93029/task/93040/cwd (readlink: Permission denied) 2024-09-10T23:29:28.158 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93040 podman root rtd unknown /proc/93029/task/93040/root (readlink: Permission denied) 2024-09-10T23:29:28.158 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93040 podman root txt unknown /proc/93029/task/93040/exe (readlink: Permission denied) 2024-09-10T23:29:28.158 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93040 podman root NOFD /proc/93029/task/93040/fd (opendir: Permission denied) 2024-09-10T23:29:28.158 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93041 podman root cwd unknown /proc/93029/task/93041/cwd (readlink: Permission denied) 2024-09-10T23:29:28.158 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93041 podman root rtd unknown /proc/93029/task/93041/root (readlink: Permission denied) 2024-09-10T23:29:28.158 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93041 podman root txt unknown /proc/93029/task/93041/exe (readlink: Permission denied) 2024-09-10T23:29:28.159 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93041 podman root NOFD /proc/93029/task/93041/fd (opendir: Permission denied) 2024-09-10T23:29:28.159 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93042 podman root cwd unknown /proc/93029/task/93042/cwd (readlink: Permission denied) 2024-09-10T23:29:28.159 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93042 podman root rtd unknown /proc/93029/task/93042/root (readlink: Permission denied) 2024-09-10T23:29:28.159 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93042 podman root txt unknown /proc/93029/task/93042/exe (readlink: Permission denied) 2024-09-10T23:29:28.159 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93029 93042 podman root NOFD /proc/93029/task/93042/fd (opendir: Permission denied) 2024-09-10T23:29:28.159 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 93044 root cwd unknown /proc/93044/cwd (readlink: Permission denied) 2024-09-10T23:29:28.159 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 93044 root rtd unknown /proc/93044/root (readlink: Permission denied) 2024-09-10T23:29:28.159 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 93044 root txt unknown /proc/93044/exe (readlink: Permission denied) 2024-09-10T23:29:28.159 INFO:tasks.workunit.client.0.smithi003.stdout:conmon 93044 root NOFD /proc/93044/fd (opendir: Permission denied) 2024-09-10T23:29:28.159 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 root cwd unknown /proc/93097/cwd (readlink: Permission denied) 2024-09-10T23:29:28.159 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 root rtd unknown /proc/93097/root (readlink: Permission denied) 2024-09-10T23:29:28.159 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 root txt unknown /proc/93097/exe (readlink: Permission denied) 2024-09-10T23:29:28.159 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 root NOFD /proc/93097/fd (opendir: Permission denied) 2024-09-10T23:29:28.160 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93098 podman root cwd unknown /proc/93097/task/93098/cwd (readlink: Permission denied) 2024-09-10T23:29:28.160 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93098 podman root rtd unknown /proc/93097/task/93098/root (readlink: Permission denied) 2024-09-10T23:29:28.160 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93098 podman root txt unknown /proc/93097/task/93098/exe (readlink: Permission denied) 2024-09-10T23:29:28.160 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93098 podman root NOFD /proc/93097/task/93098/fd (opendir: Permission denied) 2024-09-10T23:29:28.160 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93099 podman root cwd unknown /proc/93097/task/93099/cwd (readlink: Permission denied) 2024-09-10T23:29:28.160 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93099 podman root rtd unknown /proc/93097/task/93099/root (readlink: Permission denied) 2024-09-10T23:29:28.160 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93099 podman root txt unknown /proc/93097/task/93099/exe (readlink: Permission denied) 2024-09-10T23:29:28.160 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93099 podman root NOFD /proc/93097/task/93099/fd (opendir: Permission denied) 2024-09-10T23:29:28.160 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93100 podman root cwd unknown /proc/93097/task/93100/cwd (readlink: Permission denied) 2024-09-10T23:29:28.160 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93100 podman root rtd unknown /proc/93097/task/93100/root (readlink: Permission denied) 2024-09-10T23:29:28.160 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93100 podman root txt unknown /proc/93097/task/93100/exe (readlink: Permission denied) 2024-09-10T23:29:28.160 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93100 podman root NOFD /proc/93097/task/93100/fd (opendir: Permission denied) 2024-09-10T23:29:28.160 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93101 podman root cwd unknown /proc/93097/task/93101/cwd (readlink: Permission denied) 2024-09-10T23:29:28.160 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93101 podman root rtd unknown /proc/93097/task/93101/root (readlink: Permission denied) 2024-09-10T23:29:28.160 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93101 podman root txt unknown /proc/93097/task/93101/exe (readlink: Permission denied) 2024-09-10T23:29:28.161 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93101 podman root NOFD /proc/93097/task/93101/fd (opendir: Permission denied) 2024-09-10T23:29:28.161 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93102 podman root cwd unknown /proc/93097/task/93102/cwd (readlink: Permission denied) 2024-09-10T23:29:28.161 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93102 podman root rtd unknown /proc/93097/task/93102/root (readlink: Permission denied) 2024-09-10T23:29:28.161 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93102 podman root txt unknown /proc/93097/task/93102/exe (readlink: Permission denied) 2024-09-10T23:29:28.161 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93102 podman root NOFD /proc/93097/task/93102/fd (opendir: Permission denied) 2024-09-10T23:29:28.161 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93103 podman root cwd unknown /proc/93097/task/93103/cwd (readlink: Permission denied) 2024-09-10T23:29:28.161 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93103 podman root rtd unknown /proc/93097/task/93103/root (readlink: Permission denied) 2024-09-10T23:29:28.161 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93103 podman root txt unknown /proc/93097/task/93103/exe (readlink: Permission denied) 2024-09-10T23:29:28.161 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93103 podman root NOFD /proc/93097/task/93103/fd (opendir: Permission denied) 2024-09-10T23:29:28.161 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93104 podman root cwd unknown /proc/93097/task/93104/cwd (readlink: Permission denied) 2024-09-10T23:29:28.161 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93104 podman root rtd unknown /proc/93097/task/93104/root (readlink: Permission denied) 2024-09-10T23:29:28.161 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93104 podman root txt unknown /proc/93097/task/93104/exe (readlink: Permission denied) 2024-09-10T23:29:28.162 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93104 podman root NOFD /proc/93097/task/93104/fd (opendir: Permission denied) 2024-09-10T23:29:28.162 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93105 podman root cwd unknown /proc/93097/task/93105/cwd (readlink: Permission denied) 2024-09-10T23:29:28.162 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93105 podman root rtd unknown /proc/93097/task/93105/root (readlink: Permission denied) 2024-09-10T23:29:28.162 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93105 podman root txt unknown /proc/93097/task/93105/exe (readlink: Permission denied) 2024-09-10T23:29:28.162 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93105 podman root NOFD /proc/93097/task/93105/fd (opendir: Permission denied) 2024-09-10T23:29:28.162 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93106 podman root cwd unknown /proc/93097/task/93106/cwd (readlink: Permission denied) 2024-09-10T23:29:28.162 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93106 podman root rtd unknown /proc/93097/task/93106/root (readlink: Permission denied) 2024-09-10T23:29:28.162 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93106 podman root txt unknown /proc/93097/task/93106/exe (readlink: Permission denied) 2024-09-10T23:29:28.162 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93106 podman root NOFD /proc/93097/task/93106/fd (opendir: Permission denied) 2024-09-10T23:29:28.162 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93107 podman root cwd unknown /proc/93097/task/93107/cwd (readlink: Permission denied) 2024-09-10T23:29:28.162 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93107 podman root rtd unknown /proc/93097/task/93107/root (readlink: Permission denied) 2024-09-10T23:29:28.162 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93107 podman root txt unknown /proc/93097/task/93107/exe (readlink: Permission denied) 2024-09-10T23:29:28.162 INFO:tasks.workunit.client.0.smithi003.stdout:podman 93097 93107 podman root NOFD /proc/93097/task/93107/fd (opendir: Permission denied) 2024-09-10T23:29:28.163 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93108 ubuntu cwd DIR 0,120 269505656 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T23:29:28.163 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93108 ubuntu rtd DIR 8,1 4096 2 / 2024-09-10T23:29:28.163 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93108 ubuntu txt REG 8,1 179232 13934 /usr/bin/lsof 2024-09-10T23:29:28.163 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93108 ubuntu mem REG 8,1 5436544 2392 /usr/lib64/libcrypto.so.3.2.2 2024-09-10T23:29:28.163 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93108 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-10T23:29:28.163 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93108 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-09-10T23:29:28.163 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93108 ubuntu mem REG 8,1 70880 11221 /usr/lib64/libresolv.so.2 2024-09-10T23:29:28.163 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93108 ubuntu mem REG 8,1 23992 11348 /usr/lib64/libkeyutils.so.1.10 2024-09-10T23:29:28.163 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93108 ubuntu mem REG 8,1 906368 12996 /usr/lib64/libkrb5.so.3.3 2024-09-10T23:29:28.163 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93108 ubuntu mem REG 8,1 358560 12986 /usr/lib64/libgssapi_krb5.so.2.2 2024-09-10T23:29:28.163 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93108 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-10T23:29:28.163 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93108 ubuntu mem REG 8,1 66320 12998 /usr/lib64/libkrb5support.so.0.1 2024-09-10T23:29:28.163 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93108 ubuntu mem REG 8,1 23872 11298 /usr/lib64/libcom_err.so.2.1 2024-09-10T23:29:28.164 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93108 ubuntu mem REG 8,1 99112 12990 /usr/lib64/libk5crypto.so.3.1 2024-09-10T23:29:28.164 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93108 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-09-10T23:29:28.164 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93108 ubuntu mem REG 8,1 196224 13024 /usr/lib64/libtirpc.so.3.0.0 2024-09-10T23:29:28.164 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93108 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-09-10T23:29:28.164 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93108 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-10T23:29:28.164 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93108 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-10T23:29:28.164 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93108 ubuntu 0r FIFO 0,14 0t0 230574 pipe 2024-09-10T23:29:28.164 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93108 ubuntu 1w FIFO 0,14 0t0 230575 pipe 2024-09-10T23:29:28.164 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93108 ubuntu 2w FIFO 0,14 0t0 230576 pipe 2024-09-10T23:29:28.164 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93108 ubuntu 3r DIR 0,21 0 1 /proc 2024-09-10T23:29:28.164 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93108 ubuntu 4r DIR 0,21 7 228323 /proc/93108/fd 2024-09-10T23:29:28.164 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93108 ubuntu 5w FIFO 0,14 0t0 228328 pipe 2024-09-10T23:29:28.164 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93108 ubuntu 6r FIFO 0,14 0t0 228329 pipe 2024-09-10T23:29:28.165 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93109 ubuntu cwd DIR 0,120 269505656 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T23:29:28.165 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93109 ubuntu rtd DIR 8,1 4096 2 / 2024-09-10T23:29:28.165 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93109 ubuntu txt REG 8,1 179232 13934 /usr/bin/lsof 2024-09-10T23:29:28.165 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93109 ubuntu mem REG 8,1 5436544 2392 /usr/lib64/libcrypto.so.3.2.2 2024-09-10T23:29:28.165 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93109 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-10T23:29:28.165 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93109 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-09-10T23:29:28.165 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93109 ubuntu mem REG 8,1 70880 11221 /usr/lib64/libresolv.so.2 2024-09-10T23:29:28.165 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93109 ubuntu mem REG 8,1 23992 11348 /usr/lib64/libkeyutils.so.1.10 2024-09-10T23:29:28.165 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93109 ubuntu mem REG 8,1 906368 12996 /usr/lib64/libkrb5.so.3.3 2024-09-10T23:29:28.165 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93109 ubuntu mem REG 8,1 358560 12986 /usr/lib64/libgssapi_krb5.so.2.2 2024-09-10T23:29:28.165 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93109 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-10T23:29:28.165 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93109 ubuntu mem REG 8,1 66320 12998 /usr/lib64/libkrb5support.so.0.1 2024-09-10T23:29:28.165 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93109 ubuntu mem REG 8,1 23872 11298 /usr/lib64/libcom_err.so.2.1 2024-09-10T23:29:28.166 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93109 ubuntu mem REG 8,1 99112 12990 /usr/lib64/libk5crypto.so.3.1 2024-09-10T23:29:28.166 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93109 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-09-10T23:29:28.166 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93109 ubuntu mem REG 8,1 196224 13024 /usr/lib64/libtirpc.so.3.0.0 2024-09-10T23:29:28.166 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93109 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-09-10T23:29:28.166 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93109 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-10T23:29:28.166 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93109 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-10T23:29:28.166 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93109 ubuntu 4r FIFO 0,14 0t0 228328 pipe 2024-09-10T23:29:28.166 INFO:tasks.workunit.client.0.smithi003.stdout:lsof 93109 ubuntu 7w FIFO 0,14 0t0 228329 pipe 2024-09-10T23:29:28.166 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T23:29:28.167 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T23:29:28.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:27 smithi194 ceph-mon[33904]: pgmap v471: 129 pgs: 129 active+clean; 307 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 671 KiB/s wr, 165 op/s 2024-09-10T23:29:28.202 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:27 smithi003 ceph-mon[30348]: pgmap v471: 129 pgs: 129 active+clean; 307 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 671 KiB/s wr, 165 op/s 2024-09-10T23:29:28.317 INFO:tasks.workunit:Stopping ['suites/fsync-tester.sh'] on client.0... 2024-09-10T23:29:28.317 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-10T23:29:28.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:27 smithi038 ceph-mon[34225]: pgmap v471: 129 pgs: 129 active+clean; 307 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 671 KiB/s wr, 165 op/s 2024-09-10T23:29:28.604 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '2e33a07a', total seconds elapsed: 26.1 2024-09-10T23:29:29.469 DEBUG:teuthology.parallel:result is None 2024-09-10T23:29:29.470 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T23:29:29.542 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T23:29:29.542 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-10T23:29:29.552 INFO:tasks.quiescer:joining Quiescers 2024-09-10T23:29:29.552 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-10T23:29:29.552 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:29:29.929 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:29:30.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:29 smithi194 ceph-mon[33904]: pgmap v472: 129 pgs: 129 active+clean; 307 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 670 KiB/s wr, 165 op/s 2024-09-10T23:29:30.201 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:29 smithi003 ceph-mon[30348]: pgmap v472: 129 pgs: 129 active+clean; 307 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 670 KiB/s wr, 165 op/s 2024-09-10T23:29:30.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:29 smithi038 ceph-mon[34225]: pgmap v472: 129 pgs: 129 active+clean; 307 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 670 KiB/s wr, 165 op/s 2024-09-10T23:29:30.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.627+0000 7f0e94400640 1 -- 172.21.15.3:0/980682043 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e8c10f3c0 msgr2=0x7f0e8c1117b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:30.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.627+0000 7f0e94400640 1 --2- 172.21.15.3:0/980682043 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e8c10f3c0 0x7f0e8c1117b0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f0e84009900 tx=0x7f0e8402a410 comp rx=0 tx=0).stop 2024-09-10T23:29:30.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.627+0000 7f0e94400640 1 -- 172.21.15.3:0/980682043 shutdown_connections 2024-09-10T23:29:30.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.627+0000 7f0e94400640 1 --2- 172.21.15.3:0/980682043 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e8c10f3c0 0x7f0e8c1117b0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.627+0000 7f0e94400640 1 --2- 172.21.15.3:0/980682043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e8c075f40 0x7f0e8c10edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.627+0000 7f0e94400640 1 --2- 172.21.15.3:0/980682043 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e8c075540 0x7f0e8c075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.627+0000 7f0e94400640 1 -- 172.21.15.3:0/980682043 >> 172.21.15.3:0/980682043 conn(0x7f0e8c0fe810 msgr2=0x7f0e8c100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:30.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.627+0000 7f0e94400640 1 -- 172.21.15.3:0/980682043 shutdown_connections 2024-09-10T23:29:30.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.627+0000 7f0e94400640 1 -- 172.21.15.3:0/980682043 wait complete. 2024-09-10T23:29:30.630 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.628+0000 7f0e94400640 1 Processor -- start 2024-09-10T23:29:30.630 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.628+0000 7f0e94400640 1 -- start start 2024-09-10T23:29:30.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.628+0000 7f0e94400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e8c075540 0x7f0e8c19b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.628+0000 7f0e94400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e8c075f40 0x7f0e8c19b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.628+0000 7f0e94400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e8c10f3c0 0x7f0e8c1a0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.628+0000 7f0e94400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0e8c114e60 con 0x7f0e8c10f3c0 2024-09-10T23:29:30.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.628+0000 7f0e94400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0e8c114ce0 con 0x7f0e8c075540 2024-09-10T23:29:30.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.628+0000 7f0e94400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0e8c114fe0 con 0x7f0e8c075f40 2024-09-10T23:29:30.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.629+0000 7f0e91000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e8c075f40 0x7f0e8c19b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.629+0000 7f0e91a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e8c075540 0x7f0e8c19b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.629+0000 7f0e91000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e8c075f40 0x7f0e8c19b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.3:39052/0 (socket says 172.21.15.3:39052) 2024-09-10T23:29:30.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.629+0000 7f0e91000640 1 -- 172.21.15.3:0/1059619803 learned_addr learned my addr 172.21.15.3:0/1059619803 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:29:30.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.629+0000 7f0e92400640 1 --2- 172.21.15.3:0/1059619803 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e8c10f3c0 0x7f0e8c1a0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.629+0000 7f0e91a00640 1 -- 172.21.15.3:0/1059619803 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e8c075f40 msgr2=0x7f0e8c19b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:30.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.629+0000 7f0e91a00640 1 --2- 172.21.15.3:0/1059619803 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e8c075f40 0x7f0e8c19b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.629+0000 7f0e91a00640 1 -- 172.21.15.3:0/1059619803 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e8c10f3c0 msgr2=0x7f0e8c1a0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:30.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.629+0000 7f0e91a00640 1 --2- 172.21.15.3:0/1059619803 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e8c10f3c0 0x7f0e8c1a0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.629+0000 7f0e91a00640 1 -- 172.21.15.3:0/1059619803 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e8c1a1480 con 0x7f0e8c075540 2024-09-10T23:29:30.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.629+0000 7f0e91000640 1 --2- 172.21.15.3:0/1059619803 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e8c075f40 0x7f0e8c19b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:29:30.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.630+0000 7f0e91a00640 1 --2- 172.21.15.3:0/1059619803 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e8c075540 0x7f0e8c19b3d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0e8000eb00 tx=0x7f0e8000c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:30.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.630+0000 7f0e8a000640 1 -- 172.21.15.3:0/1059619803 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e80010430 con 0x7f0e8c075540 2024-09-10T23:29:30.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.630+0000 7f0e94400640 1 -- 172.21.15.3:0/1059619803 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e8c1a1770 con 0x7f0e8c075540 2024-09-10T23:29:30.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.630+0000 7f0e8a000640 1 -- 172.21.15.3:0/1059619803 <== mon.2 v2:172.21.15.38:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0e80010a60 con 0x7f0e8c075540 2024-09-10T23:29:30.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.630+0000 7f0e8a000640 1 -- 172.21.15.3:0/1059619803 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e800179c0 con 0x7f0e8c075540 2024-09-10T23:29:30.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.630+0000 7f0e94400640 1 -- 172.21.15.3:0/1059619803 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e8c1a8000 con 0x7f0e8c075540 2024-09-10T23:29:30.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.631+0000 7f0e94400640 1 -- 172.21.15.3:0/1059619803 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e8c076a50 con 0x7f0e8c075540 2024-09-10T23:29:30.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.633+0000 7f0e8a000640 1 -- 172.21.15.3:0/1059619803 <== mon.2 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 26) ==== 153380+0+0 (secure 0 0 0) 0x7f0e80017b80 con 0x7f0e8c075540 2024-09-10T23:29:30.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.635+0000 7f0e8a000640 1 --2- 172.21.15.3:0/1059619803 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0e740b54d0 0x7f0e740b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.635+0000 7f0e8a000640 1 -- 172.21.15.3:0/1059619803 <== mon.2 v2:172.21.15.38:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7f0e800e6da0 con 0x7f0e8c075540 2024-09-10T23:29:30.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.635+0000 7f0e91000640 1 --2- 172.21.15.3:0/1059619803 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0e740b54d0 0x7f0e740b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.636+0000 7f0e91000640 1 --2- 172.21.15.3:0/1059619803 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0e740b54d0 0x7f0e740b7990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c111a10 tx=0x7f0e78005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:30.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.637+0000 7f0e8a000640 1 -- 172.21.15.3:0/1059619803 <== mon.2 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0e800ad5e0 con 0x7f0e8c075540 2024-09-10T23:29:30.875 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.874+0000 7f0e94400640 1 -- 172.21.15.3:0/1059619803 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0e8c075920 con 0x7f0e8c075540 2024-09-10T23:29:30.875 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.874+0000 7f0e8a000640 1 -- 172.21.15.3:0/1059619803 <== mon.2 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11891 (secure 0 0 0) 0x7f0e8c075920 con 0x7f0e8c075540 2024-09-10T23:29:30.876 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:29:30.876 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":26,"btime":"2024-09-10T23:26:42:260644+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/1495411512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":1495411512},{"type":"v1","addr":"172.21.15.3:6835","nonce":1495411512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/1857372777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1857372777},{"type":"v1","addr":"172.21.15.3:6837","nonce":1857372777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14862,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6839/493850676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":493850676},{"type":"v1","addr":"172.21.15.3:6839","nonce":493850676}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14874,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6841/1580524358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":1580524358},{"type":"v1","addr":"172.21.15.3:6841","nonce":1580524358}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/352514665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":352514665},{"type":"v1","addr":"172.21.15.194:6833","nonce":352514665}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2380508105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2380508105},{"type":"v1","addr":"172.21.15.194:6835","nonce":2380508105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:23:58.866253+0000","modified":"2024-09-10T23:26:41.694795+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34724,"mds_1":34682,"mds_2":34652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24649":{"gid":24649,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/739730313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":739730313},{"type":"v1","addr":"172.21.15.194:6837","nonce":739730313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/3198777710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3198777710},{"type":"v1","addr":"172.21.15.194:6839","nonce":3198777710}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34619":{"gid":34619,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6833/1194099617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1194099617},{"type":"v1","addr":"172.21.15.38:6833","nonce":1194099617}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34652":{"gid":34652,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.38:6835/218783320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":218783320},{"type":"v1","addr":"172.21.15.38:6835","nonce":218783320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34682":{"gid":34682,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":21,"addr":"172.21.15.38:6837/1821839397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":1821839397},{"type":"v1","addr":"172.21.15.38:6837","nonce":1821839397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34724":{"gid":34724,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.38:6839/458259815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":458259815},{"type":"v1","addr":"172.21.15.38:6839","nonce":458259815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34724,"qdb_cluster":[34724,34682,34652]},"id":1}]} 2024-09-10T23:29:30.876 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 26 2024-09-10T23:29:30.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.878+0000 7f0e94400640 1 -- 172.21.15.3:0/1059619803 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0e740b54d0 msgr2=0x7f0e740b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:30.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.878+0000 7f0e94400640 1 --2- 172.21.15.3:0/1059619803 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0e740b54d0 0x7f0e740b7990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c111a10 tx=0x7f0e78005f90 comp rx=0 tx=0).stop 2024-09-10T23:29:30.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.878+0000 7f0e94400640 1 -- 172.21.15.3:0/1059619803 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e8c075540 msgr2=0x7f0e8c19b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:30.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.878+0000 7f0e94400640 1 --2- 172.21.15.3:0/1059619803 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e8c075540 0x7f0e8c19b3d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0e8000eb00 tx=0x7f0e8000c2d0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.878+0000 7f0e94400640 1 -- 172.21.15.3:0/1059619803 shutdown_connections 2024-09-10T23:29:30.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.878+0000 7f0e94400640 1 --2- 172.21.15.3:0/1059619803 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0e740b54d0 0x7f0e740b7990 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.878+0000 7f0e94400640 1 --2- 172.21.15.3:0/1059619803 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e8c10f3c0 0x7f0e8c1a0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.878+0000 7f0e94400640 1 --2- 172.21.15.3:0/1059619803 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e8c075f40 0x7f0e8c19b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.878+0000 7f0e94400640 1 --2- 172.21.15.3:0/1059619803 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e8c075540 0x7f0e8c19b3d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.878+0000 7f0e94400640 1 -- 172.21.15.3:0/1059619803 >> 172.21.15.3:0/1059619803 conn(0x7f0e8c0fe810 msgr2=0x7f0e8c0ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:30.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.878+0000 7f0e94400640 1 -- 172.21.15.3:0/1059619803 shutdown_connections 2024-09-10T23:29:30.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:30.878+0000 7f0e94400640 1 -- 172.21.15.3:0/1059619803 wait complete. 2024-09-10T23:29:31.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:30 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1059619803' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:29:31.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:30 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/1059619803' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:29:31.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:30 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/1059619803' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:29:31.930 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34724 quiesce db --cancel --all' 2024-09-10T23:29:31.931 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34724 quiesce db --cancel --all 2024-09-10T23:29:32.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:31 smithi003 ceph-mon[30348]: pgmap v473: 129 pgs: 129 active+clean; 303 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 718 KiB/s wr, 155 op/s 2024-09-10T23:29:32.315 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:29:32.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:31 smithi038 ceph-mon[34225]: pgmap v473: 129 pgs: 129 active+clean; 303 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 718 KiB/s wr, 155 op/s 2024-09-10T23:29:32.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:31 smithi194 ceph-mon[33904]: pgmap v473: 129 pgs: 129 active+clean; 303 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 718 KiB/s wr, 155 op/s 2024-09-10T23:29:32.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.908+0000 7fe9fac00640 1 -- 172.21.15.3:0/803376339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9f410a800 msgr2=0x7fe9f410ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:32.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.908+0000 7fe9fac00640 1 --2- 172.21.15.3:0/803376339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9f410a800 0x7fe9f410ac40 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0009900 tx=0x7fe9e002a410 comp rx=0 tx=0).stop 2024-09-10T23:29:32.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.908+0000 7fe9fac00640 1 -- 172.21.15.3:0/803376339 shutdown_connections 2024-09-10T23:29:32.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.908+0000 7fe9fac00640 1 --2- 172.21.15.3:0/803376339 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9f410b180 0x7fe9f4111980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:32.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.908+0000 7fe9fac00640 1 --2- 172.21.15.3:0/803376339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9f410a800 0x7fe9f410ac40 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:32.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.908+0000 7fe9fac00640 1 --2- 172.21.15.3:0/803376339 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9f4104df0 0x7fe9f41051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:32.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.908+0000 7fe9fac00640 1 -- 172.21.15.3:0/803376339 >> 172.21.15.3:0/803376339 conn(0x7fe9f4100840 msgr2=0x7fe9f4102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:32.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.908+0000 7fe9fac00640 1 -- 172.21.15.3:0/803376339 shutdown_connections 2024-09-10T23:29:32.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.908+0000 7fe9fac00640 1 -- 172.21.15.3:0/803376339 wait complete. 2024-09-10T23:29:32.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.909+0000 7fe9fac00640 1 Processor -- start 2024-09-10T23:29:32.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.910+0000 7fe9fac00640 1 -- start start 2024-09-10T23:29:32.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.910+0000 7fe9fac00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9f4104df0 0x7fe9f419b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:32.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.910+0000 7fe9fac00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9f410a800 0x7fe9f419b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:32.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.910+0000 7fe9fac00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9f410b180 0x7fe9f41a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:32.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.910+0000 7fe9fac00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f4114d40 con 0x7fe9f4104df0 2024-09-10T23:29:32.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.910+0000 7fe9fac00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f4114bc0 con 0x7fe9f410a800 2024-09-10T23:29:32.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.910+0000 7fe9fac00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f4114ec0 con 0x7fe9f410b180 2024-09-10T23:29:32.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.910+0000 7fe9f9800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9f4104df0 0x7fe9f419b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:32.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.910+0000 7fe9f9800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9f4104df0 0x7fe9f419b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34570/0 (socket says 172.21.15.3:34570) 2024-09-10T23:29:32.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.910+0000 7fe9f9800640 1 -- 172.21.15.3:0/444841089 learned_addr learned my addr 172.21.15.3:0/444841089 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:29:32.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.910+0000 7fe9f8e00640 1 --2- 172.21.15.3:0/444841089 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9f410a800 0x7fe9f419b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:32.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.911+0000 7fe9fa200640 1 --2- 172.21.15.3:0/444841089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9f410b180 0x7fe9f41a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:32.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.911+0000 7fe9f8e00640 1 -- 172.21.15.3:0/444841089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9f410b180 msgr2=0x7fe9f41a0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:32.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.911+0000 7fe9f8e00640 1 --2- 172.21.15.3:0/444841089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9f410b180 0x7fe9f41a0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:32.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.911+0000 7fe9f8e00640 1 -- 172.21.15.3:0/444841089 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9f4104df0 msgr2=0x7fe9f419b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:32.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.911+0000 7fe9f8e00640 1 --2- 172.21.15.3:0/444841089 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9f4104df0 0x7fe9f419b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:32.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.911+0000 7fe9f8e00640 1 -- 172.21.15.3:0/444841089 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9f41a1160 con 0x7fe9f410a800 2024-09-10T23:29:32.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.911+0000 7fe9f8e00640 1 --2- 172.21.15.3:0/444841089 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9f410a800 0x7fe9f419b5f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe9e002a930 tx=0x7fe9e0003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:32.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.912+0000 7fe9f2000640 1 -- 172.21.15.3:0/444841089 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e003f070 con 0x7fe9f410a800 2024-09-10T23:29:32.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.912+0000 7fe9f2000640 1 -- 172.21.15.3:0/444841089 <== mon.2 v2:172.21.15.38:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe9e003baf0 con 0x7fe9f410a800 2024-09-10T23:29:32.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.912+0000 7fe9f2000640 1 -- 172.21.15.3:0/444841089 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e0035030 con 0x7fe9f410a800 2024-09-10T23:29:32.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.912+0000 7fe9fac00640 1 -- 172.21.15.3:0/444841089 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9f41a13f0 con 0x7fe9f410a800 2024-09-10T23:29:32.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.912+0000 7fe9fac00640 1 -- 172.21.15.3:0/444841089 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9f41a7b10 con 0x7fe9f410a800 2024-09-10T23:29:32.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.915+0000 7fe9fec1c740 1 Processor -- start 2024-09-10T23:29:32.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.915+0000 7fe9fec1c740 1 -- start start 2024-09-10T23:29:32.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.915+0000 7fe9fec1c740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5647e3888250 0x5647e3888630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:32.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.915+0000 7fe9fec1c740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5647e3888b70 0x5647e38945c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:32.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.916+0000 7fe9fec1c740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647e3894b00 0x5647e3896ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:32.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.916+0000 7fe9fec1c740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5647e37ffff0 con 0x5647e3894b00 2024-09-10T23:29:32.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.916+0000 7fe9fec1c740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5647e37ef420 con 0x5647e3888250 2024-09-10T23:29:32.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.916+0000 7fe9fec1c740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5647e37f3230 con 0x5647e3888b70 2024-09-10T23:29:32.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.916+0000 7fe9f2000640 1 -- 172.21.15.3:0/444841089 <== mon.2 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 26) ==== 153380+0+0 (secure 0 0 0) 0x7fe9e003b660 con 0x7fe9f410a800 2024-09-10T23:29:32.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.916+0000 7fe9fa200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5647e3888250 0x5647e3888630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:32.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.916+0000 7fe9f9800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5647e3888b70 0x5647e38945c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:32.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.916+0000 7fe9fa200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5647e3888250 0x5647e3888630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.3:36278/0 (socket says 172.21.15.3:36278) 2024-09-10T23:29:32.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.916+0000 7fe9fa200640 1 -- 172.21.15.3:0/3980677916 learned_addr learned my addr 172.21.15.3:0/3980677916 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:29:32.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.916+0000 7fe9f9800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5647e3888b70 0x5647e38945c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.3:39632/0 (socket says 172.21.15.3:39632) 2024-09-10T23:29:32.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.916+0000 7fe9f8e00640 1 --2- 172.21.15.3:0/3980677916 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647e3894b00 0x5647e3896ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:32.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.916+0000 7fe9f9800640 1 -- 172.21.15.3:0/3980677916 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5647e3888250 msgr2=0x5647e3888630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:32.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.917+0000 7fe9f9800640 1 --2- 172.21.15.3:0/3980677916 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5647e3888250 0x5647e3888630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:32.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.917+0000 7fe9f9800640 1 -- 172.21.15.3:0/3980677916 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647e3894b00 msgr2=0x5647e3896ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:32.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.917+0000 7fe9f9800640 1 --2- 172.21.15.3:0/3980677916 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647e3894b00 0x5647e3896ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:32.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.917+0000 7fe9f9800640 1 -- 172.21.15.3:0/3980677916 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647e354d8b0 con 0x5647e3888b70 2024-09-10T23:29:32.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.917+0000 7fe9fa200640 1 --2- 172.21.15.3:0/3980677916 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5647e3888250 0x5647e3888630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:29:32.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.917+0000 7fe9f9800640 1 --2- 172.21.15.3:0/3980677916 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5647e3888b70 0x5647e38945c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8009cb0 tx=0x7fe9e8011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be23c8f3c62fc2c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:32.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.917+0000 7fe9e6a00640 1 -- 172.21.15.3:0/3980677916 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8004230 con 0x5647e3888b70 2024-09-10T23:29:32.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.917+0000 7fe9e6a00640 1 -- 172.21.15.3:0/3980677916 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe9e80043d0 con 0x5647e3888b70 2024-09-10T23:29:32.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.917+0000 7fe9e6a00640 1 -- 172.21.15.3:0/3980677916 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8004be0 con 0x5647e3888b70 2024-09-10T23:29:32.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.918+0000 7fe9fec1c740 1 -- 172.21.15.3:0/3980677916 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5647e3888b70 msgr2=0x5647e38945c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:32.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.918+0000 7fe9fec1c740 1 --2- 172.21.15.3:0/3980677916 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5647e3888b70 0x5647e38945c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8009cb0 tx=0x7fe9e8011810 comp rx=0 tx=0).stop 2024-09-10T23:29:32.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.918+0000 7fe9fec1c740 1 -- 172.21.15.3:0/3980677916 shutdown_connections 2024-09-10T23:29:32.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.918+0000 7fe9fec1c740 1 --2- 172.21.15.3:0/3980677916 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647e3894b00 0x5647e3896ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:32.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.918+0000 7fe9fec1c740 1 --2- 172.21.15.3:0/3980677916 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5647e3888b70 0x5647e38945c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:32.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.918+0000 7fe9fec1c740 1 --2- 172.21.15.3:0/3980677916 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5647e3888250 0x5647e3888630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:32.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.918+0000 7fe9fec1c740 1 -- 172.21.15.3:0/3980677916 >> 172.21.15.3:0/3980677916 conn(0x5647e3886080 msgr2=0x5647e3887220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:32.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.918+0000 7fe9f2000640 1 --2- 172.21.15.3:0/444841089 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fe9dc0b5580 0x7fe9dc0b7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:32.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.918+0000 7fe9fec1c740 1 -- 172.21.15.3:0/3980677916 shutdown_connections 2024-09-10T23:29:32.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.919+0000 7fe9fec1c740 1 -- 172.21.15.3:0/3980677916 wait complete. 2024-09-10T23:29:32.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.919+0000 7fe9f2000640 1 -- 172.21.15.3:0/444841089 <== mon.2 v2:172.21.15.38:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7fe9e0106ba0 con 0x7fe9f410a800 2024-09-10T23:29:32.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.919+0000 7fe9f9800640 1 --2- 172.21.15.3:0/444841089 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fe9dc0b5580 0x7fe9dc0b7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:32.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.919+0000 7fe9fec1c740 1 -- start start 2024-09-10T23:29:32.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.919+0000 7fe9fec1c740 1 Processor -- start 2024-09-10T23:29:32.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.920+0000 7fe9f9800640 1 --2- 172.21.15.3:0/444841089 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fe9dc0b5580 0x7fe9dc0b7a40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe9e80047e0 tx=0x7fe9e80056a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:32.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.920+0000 7fe9fec1c740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5647e3888250 0x5647e3894350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:32.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.920+0000 7fe9fec1c740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647e3888b70 0x5647e38917a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:32.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.920+0000 7fe9fec1c740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5647e3894b00 0x5647e3891d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:32.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.920+0000 7fe9fec1c740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5647e3650810 con 0x5647e3888b70 2024-09-10T23:29:32.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.920+0000 7fe9fec1c740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5647e378a550 con 0x5647e3888250 2024-09-10T23:29:32.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.920+0000 7fe9fec1c740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5647e38977b0 con 0x5647e3894b00 2024-09-10T23:29:32.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.920+0000 7fe9fec1c740 10 client.0 _ll_register_callbacks cb 0x5647e379a040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:32.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.920+0000 7fe9f8e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647e3888b70 0x5647e38917a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:32.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.920+0000 7fe9f9800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5647e3888250 0x5647e3894350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:32.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.920+0000 7fe9f8e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647e3888b70 0x5647e38917a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34584/0 (socket says 172.21.15.3:34584) 2024-09-10T23:29:32.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.920+0000 7fe9f8e00640 1 -- 172.21.15.3:0/2066254801 learned_addr learned my addr 172.21.15.3:0/2066254801 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:29:32.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.921+0000 7fe9f9800640 1 -- 172.21.15.3:0/2066254801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5647e3894b00 msgr2=0x5647e3891d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:32.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.921+0000 7fe9f9800640 1 --2- 172.21.15.3:0/2066254801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5647e3894b00 0x5647e3891d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:32.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.921+0000 7fe9f9800640 1 -- 172.21.15.3:0/2066254801 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647e3888b70 msgr2=0x5647e38917a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:32.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.921+0000 7fe9f9800640 1 --2- 172.21.15.3:0/2066254801 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647e3888b70 0x5647e38917a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:32.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.921+0000 7fe9f9800640 1 -- 172.21.15.3:0/2066254801 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647e377c200 con 0x5647e3888250 2024-09-10T23:29:32.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.921+0000 7fe9f9800640 1 --2- 172.21.15.3:0/2066254801 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5647e3888250 0x5647e3894350 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8009f80 tx=0x7fe9e8011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8803ba5739abf60 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:32.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.921+0000 7fe9db400640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-10T23:29:32.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.922+0000 7fe9db400640 1 -- 172.21.15.3:0/2066254801 <== mon.2 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e801e070 con 0x5647e3888250 2024-09-10T23:29:32.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.922+0000 7fe9fec1c740 1 -- 172.21.15.3:0/2066254801 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9e80043d0 con 0x5647e3888250 2024-09-10T23:29:32.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.922+0000 7fe9db400640 1 -- 172.21.15.3:0/2066254801 <== mon.2 v2:172.21.15.38:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7fe9e8031410 con 0x5647e3888250 2024-09-10T23:29:32.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.922+0000 7fe9db400640 1 -- 172.21.15.3:0/2066254801 <== mon.2 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe9e8031610 con 0x5647e3888250 2024-09-10T23:29:32.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.922+0000 7fe9fec1c740 10 client.35582 fetch_fsmap learned FSMap version 26 2024-09-10T23:29:32.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.922+0000 7fe9fec1c740 1 -- 172.21.15.3:0/2066254801 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5647e38ab880 con 0x5647e3888250 2024-09-10T23:29:32.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.922+0000 7fe9db400640 1 -- 172.21.15.3:0/2066254801 <== mon.2 v2:172.21.15.38:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe9e80043d0 con 0x5647e3888250 2024-09-10T23:29:32.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.923+0000 7fe9db400640 1 -- 172.21.15.3:0/2066254801 <== mon.2 v2:172.21.15.38:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fe9e8018070 con 0x5647e3888250 2024-09-10T23:29:32.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.923+0000 7fe9fec1c740 10 client.35582 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:29:32.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.923+0000 7fe9fec1c740 10 client.35582 resolve_mds: validated gid 34724 aka daemon mds.b 2024-09-10T23:29:32.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.923+0000 7fe9fec1c740 20 client.35582 populate_metadata read hostname 'smithi003' 2024-09-10T23:29:32.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.923+0000 7fe9fec1c740 1 --2- 172.21.15.3:0/2066254801 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x5647e38acc70 0x5647e38af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:32.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.923+0000 7fe9fec1c740 4 client.35582 mds_command: new command op to 34724 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:29:32.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.923+0000 7fe9fec1c740 1 -- 172.21.15.3:0/2066254801 --> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5647e3801f40 con 0x5647e38acc70 2024-09-10T23:29:32.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.923+0000 7fe9f8e00640 1 --2- 172.21.15.3:0/2066254801 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x5647e38acc70 0x5647e38af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:32.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.924+0000 7fe9f8e00640 1 --2- 172.21.15.3:0/2066254801 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x5647e38acc70 0x5647e38af0c0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61a0919be2ee55d5 server_cookie=c78a680c014394a3 in_seq=0 out_seq=0 2024-09-10T23:29:32.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.924+0000 7fe9db400640 10 client.35582 ms_handle_connect on v2:172.21.15.38:6838/458259815 2024-09-10T23:29:32.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.925+0000 7fe9db400640 1 -- 172.21.15.3:0/2066254801 <== mds.0 v2:172.21.15.38:6838/458259815 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5647e3801f40 con 0x5647e38acc70 2024-09-10T23:29:32.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.925+0000 7fe9db400640 10 client.35582 handle_command_reply: tid=0 2024-09-10T23:29:32.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.925+0000 7fe9fec1c740 1 client.35582 shutdown 2024-09-10T23:29:32.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.925+0000 7fe9fec1c740 1 -- 172.21.15.3:0/2066254801 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5647e3888250 msgr2=0x5647e3894350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:32.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.925+0000 7fe9fec1c740 1 --2- 172.21.15.3:0/2066254801 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5647e3888250 0x5647e3894350 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8009f80 tx=0x7fe9e8011810 comp rx=0 tx=0).stop 2024-09-10T23:29:32.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.925+0000 7fe9fec1c740 1 -- 172.21.15.3:0/2066254801 shutdown_connections 2024-09-10T23:29:32.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.925+0000 7fe9fec1c740 1 --2- 172.21.15.3:0/2066254801 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x5647e38acc70 0x5647e38af0c0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:32.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.925+0000 7fe9fec1c740 1 --2- 172.21.15.3:0/2066254801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5647e3894b00 0x5647e3891d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:32.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.925+0000 7fe9fec1c740 1 --2- 172.21.15.3:0/2066254801 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647e3888b70 0x5647e38917a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:32.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.925+0000 7fe9fec1c740 1 --2- 172.21.15.3:0/2066254801 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5647e3888250 0x5647e3894350 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:32.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.925+0000 7fe9db400640 0 client.35582 ms_handle_reset on v2:172.21.15.38:6838/458259815 2024-09-10T23:29:32.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.925+0000 7fe9fec1c740 1 -- 172.21.15.3:0/2066254801 >> 172.21.15.3:0/2066254801 conn(0x5647e3886080 msgr2=0x5647e388bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:32.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.925+0000 7fe9fec1c740 1 -- 172.21.15.3:0/2066254801 shutdown_connections 2024-09-10T23:29:32.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.925+0000 7fe9fec1c740 1 -- 172.21.15.3:0/2066254801 wait complete. 2024-09-10T23:29:32.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.926+0000 7fe9fec1c740 20 client.35582 trim_cache size 0 max 16384 2024-09-10T23:29:32.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.944+0000 7fe9fec1c740 1 Processor -- start 2024-09-10T23:29:32.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.944+0000 7fe9fec1c740 1 -- start start 2024-09-10T23:29:32.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.944+0000 7fe9fec1c740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5647e3888250 0x5647e388ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:32.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.944+0000 7fe9fec1c740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647e3888b70 0x5647e388efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:32.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.944+0000 7fe9fec1c740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5647e3894b00 0x5647e3895ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:32.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.944+0000 7fe9fec1c740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f41b00e0 con 0x5647e3888b70 2024-09-10T23:29:32.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.944+0000 7fe9fec1c740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f41ad9b0 con 0x5647e3888250 2024-09-10T23:29:32.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.944+0000 7fe9fec1c740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f41ab840 con 0x5647e3894b00 2024-09-10T23:29:32.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.944+0000 7fe9f8e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647e3888b70 0x5647e388efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:32.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.944+0000 7fe9f9800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5647e3888250 0x5647e388ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:32.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.944+0000 7fe9f8e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647e3888b70 0x5647e388efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34594/0 (socket says 172.21.15.3:34594) 2024-09-10T23:29:32.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.944+0000 7fe9f8e00640 1 -- 172.21.15.3:0/2390165057 learned_addr learned my addr 172.21.15.3:0/2390165057 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:29:32.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.944+0000 7fe9fa200640 1 --2- 172.21.15.3:0/2390165057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5647e3894b00 0x5647e3895ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:32.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.945+0000 7fe9f8e00640 1 -- 172.21.15.3:0/2390165057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5647e3894b00 msgr2=0x5647e3895ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:32.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.945+0000 7fe9f8e00640 1 --2- 172.21.15.3:0/2390165057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5647e3894b00 0x5647e3895ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:32.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.945+0000 7fe9f8e00640 1 -- 172.21.15.3:0/2390165057 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5647e3888250 msgr2=0x5647e388ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:32.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.945+0000 7fe9f8e00640 1 --2- 172.21.15.3:0/2390165057 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5647e3888250 0x5647e388ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:32.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.945+0000 7fe9f8e00640 1 -- 172.21.15.3:0/2390165057 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647e38889a0 con 0x5647e3888b70 2024-09-10T23:29:32.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.945+0000 7fe9f9800640 1 --2- 172.21.15.3:0/2390165057 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5647e3888250 0x5647e388ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:29:32.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.945+0000 7fe9f8e00640 1 --2- 172.21.15.3:0/2390165057 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647e3888b70 0x5647e388efd0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0103e90 tx=0x7fe9e002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c886a9a8dfc1e408 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:32.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.945+0000 7fe9e6000640 1 -- 172.21.15.3:0/2390165057 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e0049040 con 0x5647e3888b70 2024-09-10T23:29:32.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.945+0000 7fe9e6000640 1 -- 172.21.15.3:0/2390165057 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe9e010b040 con 0x5647e3888b70 2024-09-10T23:29:32.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.945+0000 7fe9e6000640 1 -- 172.21.15.3:0/2390165057 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e00d61e0 con 0x5647e3888b70 2024-09-10T23:29:32.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.946+0000 7fe9fec1c740 1 -- 172.21.15.3:0/2390165057 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647e3888b70 msgr2=0x5647e388efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:32.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.946+0000 7fe9fec1c740 1 --2- 172.21.15.3:0/2390165057 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647e3888b70 0x5647e388efd0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0103e90 tx=0x7fe9e002a410 comp rx=0 tx=0).stop 2024-09-10T23:29:32.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.946+0000 7fe9fec1c740 1 -- 172.21.15.3:0/2390165057 shutdown_connections 2024-09-10T23:29:32.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.946+0000 7fe9fec1c740 1 --2- 172.21.15.3:0/2390165057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5647e3894b00 0x5647e3895ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:32.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.946+0000 7fe9fec1c740 1 --2- 172.21.15.3:0/2390165057 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647e3888b70 0x5647e388efd0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:32.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.946+0000 7fe9fec1c740 1 --2- 172.21.15.3:0/2390165057 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5647e3888250 0x5647e388ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:32.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.946+0000 7fe9fec1c740 1 -- 172.21.15.3:0/2390165057 >> 172.21.15.3:0/2390165057 conn(0x5647e3886080 msgr2=0x5647e38935f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:32.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.946+0000 7fe9fec1c740 1 -- 172.21.15.3:0/2390165057 shutdown_connections 2024-09-10T23:29:32.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.946+0000 7fe9fec1c740 1 -- 172.21.15.3:0/2390165057 wait complete. 2024-09-10T23:29:32.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.947+0000 7fe9fec1c740 1 -- start start 2024-09-10T23:29:32.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.947+0000 7fe9fec1c740 1 Processor -- start 2024-09-10T23:29:32.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.947+0000 7fe9fec1c740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5647e3888250 0x5647e38b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:32.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.947+0000 7fe9fec1c740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647e3888b70 0x5647e38a5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:32.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.947+0000 7fe9fec1c740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5647e3894b00 0x5647e38a5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:32.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.947+0000 7fe9fec1c740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f41abe90 con 0x5647e3888b70 2024-09-10T23:29:32.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.947+0000 7fe9fec1c740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f41ad2e0 con 0x5647e3888250 2024-09-10T23:29:32.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.947+0000 7fe9fec1c740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f41ac540 con 0x5647e3894b00 2024-09-10T23:29:32.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.947+0000 7fe9fec1c740 10 client.0 _ll_register_callbacks cb 0x7fe9e8009b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:32.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.948+0000 7fe9f8e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647e3888b70 0x5647e38a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:32.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.948+0000 7fe9f8e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647e3888b70 0x5647e38a5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34600/0 (socket says 172.21.15.3:34600) 2024-09-10T23:29:32.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.948+0000 7fe9f8e00640 1 -- 172.21.15.3:0/1416727458 learned_addr learned my addr 172.21.15.3:0/1416727458 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:29:32.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.948+0000 7fe9fa200640 1 --2- 172.21.15.3:0/1416727458 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5647e3894b00 0x5647e38a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:32.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.948+0000 7fe9f9800640 1 --2- 172.21.15.3:0/1416727458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5647e3888250 0x5647e38b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:32.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.948+0000 7fe9f8e00640 1 -- 172.21.15.3:0/1416727458 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5647e3894b00 msgr2=0x5647e38a5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:32.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.948+0000 7fe9f8e00640 1 --2- 172.21.15.3:0/1416727458 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5647e3894b00 0x5647e38a5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:32.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.948+0000 7fe9f8e00640 1 -- 172.21.15.3:0/1416727458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5647e3888250 msgr2=0x5647e38b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:32.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.948+0000 7fe9f8e00640 1 --2- 172.21.15.3:0/1416727458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5647e3888250 0x5647e38b4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:32.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.948+0000 7fe9f8e00640 1 -- 172.21.15.3:0/1416727458 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647e38a5e30 con 0x5647e3888b70 2024-09-10T23:29:32.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.948+0000 7fe9f8e00640 1 --2- 172.21.15.3:0/1416727458 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647e3888b70 0x5647e38a5300 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe9e00cca00 tx=0x7fe9e0103ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=765ac33528228f9d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:32.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.948+0000 7fe9db400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-10T23:29:32.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.949+0000 7fe9db400640 1 -- 172.21.15.3:0/1416727458 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e0049040 con 0x5647e3888b70 2024-09-10T23:29:32.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.949+0000 7fe9db400640 1 -- 172.21.15.3:0/1416727458 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9402+0+0 (secure 0 0 0) 0x7fe9e00c8f70 con 0x5647e3888b70 2024-09-10T23:29:32.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.949+0000 7fe9fec1c740 1 -- 172.21.15.3:0/1416727458 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9e010b040 con 0x5647e3888b70 2024-09-10T23:29:32.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.949+0000 7fe9db400640 1 -- 172.21.15.3:0/1416727458 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe9e00cc470 con 0x5647e3888b70 2024-09-10T23:29:32.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.949+0000 7fe9fec1c740 10 client.15792 fetch_fsmap learned FSMap version 26 2024-09-10T23:29:32.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.949+0000 7fe9fec1c740 1 -- 172.21.15.3:0/1416727458 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5647e391aba0 con 0x5647e3888b70 2024-09-10T23:29:32.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.949+0000 7fe9db400640 1 -- 172.21.15.3:0/1416727458 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe9e010b040 con 0x5647e3888b70 2024-09-10T23:29:32.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.949+0000 7fe9db400640 1 -- 172.21.15.3:0/1416727458 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fe9e01041a0 con 0x5647e3888b70 2024-09-10T23:29:32.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.949+0000 7fe9fec1c740 10 client.15792 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:29:32.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.949+0000 7fe9fec1c740 10 client.15792 resolve_mds: validated gid 34724 aka daemon mds.b 2024-09-10T23:29:32.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.949+0000 7fe9fec1c740 20 client.15792 populate_metadata read hostname 'smithi003' 2024-09-10T23:29:32.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.949+0000 7fe9fec1c740 1 --2- 172.21.15.3:0/1416727458 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x5647e391b190 0x5647e391d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:32.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.949+0000 7fe9fec1c740 4 client.15792 mds_command: new command op to 34724 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-10T23:29:32.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.949+0000 7fe9fec1c740 1 -- 172.21.15.3:0/1416727458 --> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x5647e37fd9f0 con 0x5647e391b190 2024-09-10T23:29:32.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.950+0000 7fe9f9800640 1 --2- 172.21.15.3:0/1416727458 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x5647e391b190 0x5647e391d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:32.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.950+0000 7fe9f9800640 1 --2- 172.21.15.3:0/1416727458 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x5647e391b190 0x5647e391d5b0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa8feaa472aebd32 server_cookie=bd2ac5c611948e1c in_seq=0 out_seq=0 2024-09-10T23:29:32.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.950+0000 7fe9db400640 10 client.15792 ms_handle_connect on v2:172.21.15.38:6838/458259815 2024-09-10T23:29:32.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.951+0000 7fe9db400640 1 -- 172.21.15.3:0/1416727458 <== mds.0 v2:172.21.15.38:6838/458259815 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x5647e37fd9f0 con 0x5647e391b190 2024-09-10T23:29:32.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.951+0000 7fe9db400640 10 client.15792 handle_command_reply: tid=0 2024-09-10T23:29:32.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.951+0000 7fe9fec1c740 1 client.15792 shutdown 2024-09-10T23:29:32.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.951+0000 7fe9fec1c740 1 -- 172.21.15.3:0/1416727458 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647e3888b70 msgr2=0x5647e38a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:32.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.951+0000 7fe9fec1c740 1 --2- 172.21.15.3:0/1416727458 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647e3888b70 0x5647e38a5300 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe9e00cca00 tx=0x7fe9e0103ec0 comp rx=0 tx=0).stop 2024-09-10T23:29:32.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.951+0000 7fe9fec1c740 1 -- 172.21.15.3:0/1416727458 shutdown_connections 2024-09-10T23:29:32.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.951+0000 7fe9fec1c740 1 --2- 172.21.15.3:0/1416727458 >> [v2:172.21.15.38:6838/458259815,v1:172.21.15.38:6839/458259815] conn(0x5647e391b190 0x5647e391d5b0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:32.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.951+0000 7fe9fec1c740 1 --2- 172.21.15.3:0/1416727458 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5647e3894b00 0x5647e38a5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:32.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.951+0000 7fe9fec1c740 1 --2- 172.21.15.3:0/1416727458 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647e3888b70 0x5647e38a5300 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:32.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.951+0000 7fe9fec1c740 1 --2- 172.21.15.3:0/1416727458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5647e3888250 0x5647e38b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:32.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.951+0000 7fe9db400640 0 client.15792 ms_handle_reset on v2:172.21.15.38:6838/458259815 2024-09-10T23:29:32.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.951+0000 7fe9fec1c740 1 -- 172.21.15.3:0/1416727458 >> 172.21.15.3:0/1416727458 conn(0x5647e3886080 msgr2=0x5647e3892dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:32.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.951+0000 7fe9fec1c740 1 -- 172.21.15.3:0/1416727458 shutdown_connections 2024-09-10T23:29:32.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.951+0000 7fe9fec1c740 1 -- 172.21.15.3:0/1416727458 wait complete. 2024-09-10T23:29:32.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.952+0000 7fe9fec1c740 20 client.15792 trim_cache size 0 max 16384 2024-09-10T23:29:32.956 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-10T23:29:32.956 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 26, 2024-09-10T23:29:32.956 INFO:teuthology.orchestra.run.smithi003.stdout: "leader": 34724, 2024-09-10T23:29:32.956 INFO:teuthology.orchestra.run.smithi003.stdout: "set_version": 12, 2024-09-10T23:29:32.957 INFO:teuthology.orchestra.run.smithi003.stdout: "sets": {} 2024-09-10T23:29:32.957 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-10T23:29:32.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.952+0000 7fe9fac00640 1 -- 172.21.15.3:0/444841089 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fe9dc0b5580 msgr2=0x7fe9dc0b7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:32.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.952+0000 7fe9fac00640 1 --2- 172.21.15.3:0/444841089 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fe9dc0b5580 0x7fe9dc0b7a40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe9e80047e0 tx=0x7fe9e80056a0 comp rx=0 tx=0).stop 2024-09-10T23:29:32.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.952+0000 7fe9fac00640 1 -- 172.21.15.3:0/444841089 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9f410a800 msgr2=0x7fe9f419b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:32.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.952+0000 7fe9fac00640 1 --2- 172.21.15.3:0/444841089 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9f410a800 0x7fe9f419b5f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe9e002a930 tx=0x7fe9e0003b90 comp rx=0 tx=0).stop 2024-09-10T23:29:32.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.953+0000 7fe9fac00640 1 -- 172.21.15.3:0/444841089 shutdown_connections 2024-09-10T23:29:32.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.953+0000 7fe9fac00640 1 --2- 172.21.15.3:0/444841089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9f410b180 0x7fe9f41a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:32.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.953+0000 7fe9fac00640 1 --2- 172.21.15.3:0/444841089 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9f410a800 0x7fe9f419b5f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:32.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.953+0000 7fe9fac00640 1 --2- 172.21.15.3:0/444841089 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fe9dc0b5580 0x7fe9dc0b7a40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:32.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.953+0000 7fe9fac00640 1 --2- 172.21.15.3:0/444841089 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9f4104df0 0x7fe9f419b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:32.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.953+0000 7fe9fac00640 1 -- 172.21.15.3:0/444841089 >> 172.21.15.3:0/444841089 conn(0x7fe9f4100840 msgr2=0x7fe9f4103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:32.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.953+0000 7fe9fac00640 1 -- 172.21.15.3:0/444841089 shutdown_connections 2024-09-10T23:29:32.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:29:32.953+0000 7fe9fac00640 1 -- 172.21.15.3:0/444841089 wait complete. 2024-09-10T23:29:33.930 INFO:tasks.quiescer:done joining Quiescers 2024-09-10T23:29:33.931 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-10T23:29:33.942 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-10T23:29:33.943 INFO:teuthology.task.exec:Executing custom commands... 2024-09-10T23:29:33.943 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi003.front.sepia.ceph.com 2024-09-10T23:29:33.943 DEBUG:teuthology.orchestra.run.smithi003:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-10T23:29:34.005 DEBUG:teuthology.orchestra.run.smithi003:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-10T23:29:34.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:33 smithi003 ceph-mon[30348]: pgmap v474: 129 pgs: 129 active+clean; 271 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 654 KiB/s wr, 147 op/s 2024-09-10T23:29:34.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:33 smithi038 ceph-mon[34225]: pgmap v474: 129 pgs: 129 active+clean; 271 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 654 KiB/s wr, 147 op/s 2024-09-10T23:29:34.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:33 smithi194 ceph-mon[33904]: pgmap v474: 129 pgs: 129 active+clean; 271 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 654 KiB/s wr, 147 op/s 2024-09-10T23:29:36.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:35 smithi003 ceph-mon[30348]: pgmap v475: 129 pgs: 129 active+clean; 262 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 252 KiB/s wr, 50 op/s 2024-09-10T23:29:36.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:35 smithi038 ceph-mon[34225]: pgmap v475: 129 pgs: 129 active+clean; 262 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 252 KiB/s wr, 50 op/s 2024-09-10T23:29:36.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:35 smithi194 ceph-mon[33904]: pgmap v475: 129 pgs: 129 active+clean; 262 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 252 KiB/s wr, 50 op/s 2024-09-10T23:29:38.221 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:37 smithi003 ceph-mon[30348]: pgmap v476: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 130 KiB/s wr, 22 op/s 2024-09-10T23:29:38.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:37 smithi038 ceph-mon[34225]: pgmap v476: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 130 KiB/s wr, 22 op/s 2024-09-10T23:29:38.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:37 smithi194 ceph-mon[33904]: pgmap v476: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 130 KiB/s wr, 22 op/s 2024-09-10T23:29:40.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:39 smithi003 ceph-mon[30348]: pgmap v477: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 98 KiB/s wr, 15 op/s 2024-09-10T23:29:40.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:39 smithi038 ceph-mon[34225]: pgmap v477: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 98 KiB/s wr, 15 op/s 2024-09-10T23:29:40.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:39 smithi194 ceph-mon[33904]: pgmap v477: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 98 KiB/s wr, 15 op/s 2024-09-10T23:29:42.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:41 smithi038 ceph-mon[34225]: pgmap v478: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 94 KiB/s wr, 12 op/s 2024-09-10T23:29:42.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:41 smithi194 ceph-mon[33904]: pgmap v478: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 94 KiB/s wr, 12 op/s 2024-09-10T23:29:42.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:41 smithi003 ceph-mon[30348]: pgmap v478: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 94 KiB/s wr, 12 op/s 2024-09-10T23:29:44.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:43 smithi038 ceph-mon[34225]: pgmap v479: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 14 op/s 2024-09-10T23:29:44.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:43 smithi194 ceph-mon[33904]: pgmap v479: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 14 op/s 2024-09-10T23:29:44.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:43 smithi003 ceph-mon[30348]: pgmap v479: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 14 op/s 2024-09-10T23:29:46.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:45 smithi038 ceph-mon[34225]: pgmap v480: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-10T23:29:46.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:45 smithi194 ceph-mon[33904]: pgmap v480: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-10T23:29:46.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:45 smithi003 ceph-mon[30348]: pgmap v480: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-10T23:29:48.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:47 smithi038 ceph-mon[34225]: pgmap v481: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-10T23:29:48.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:47 smithi194 ceph-mon[33904]: pgmap v481: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-10T23:29:48.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:47 smithi003 ceph-mon[30348]: pgmap v481: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-10T23:29:50.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:49 smithi038 ceph-mon[34225]: pgmap v482: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:29:50.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:49 smithi194 ceph-mon[33904]: pgmap v482: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:29:50.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:49 smithi003 ceph-mon[30348]: pgmap v482: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:29:52.250 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:51 smithi194 ceph-mon[33904]: pgmap v483: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:29:52.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:51 smithi038 ceph-mon[34225]: pgmap v483: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:29:52.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:51 smithi003 ceph-mon[30348]: pgmap v483: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:29:54.273 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:53 smithi003 ceph-mon[30348]: pgmap v484: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:29:54.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:53 smithi038 ceph-mon[34225]: pgmap v484: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:29:54.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:53 smithi194 ceph-mon[33904]: pgmap v484: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:29:56.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:56 smithi003 ceph-mon[30348]: pgmap v485: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:29:56.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:56 smithi038 ceph-mon[34225]: pgmap v485: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:29:56.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:56 smithi194 ceph-mon[33904]: pgmap v485: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:29:58.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:29:58 smithi038 ceph-mon[34225]: pgmap v486: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:29:58.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:29:58 smithi194 ceph-mon[33904]: pgmap v486: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:29:58.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:29:58 smithi003 ceph-mon[30348]: pgmap v486: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:30:00.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:00 smithi038 ceph-mon[34225]: pgmap v487: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:30:00.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:00 smithi038 ceph-mon[34225]: overall HEALTH_OK 2024-09-10T23:30:00.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:00 smithi194 ceph-mon[33904]: pgmap v487: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:30:00.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:00 smithi194 ceph-mon[33904]: overall HEALTH_OK 2024-09-10T23:30:00.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:00 smithi003 ceph-mon[30348]: pgmap v487: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:30:00.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:00 smithi003 ceph-mon[30348]: overall HEALTH_OK 2024-09-10T23:30:02.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:02 smithi038 ceph-mon[34225]: pgmap v488: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:30:02.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:02 smithi194 ceph-mon[33904]: pgmap v488: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:30:02.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:02 smithi003 ceph-mon[30348]: pgmap v488: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:30:04.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:04 smithi038 ceph-mon[34225]: pgmap v489: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:30:04.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:04 smithi194 ceph-mon[33904]: pgmap v489: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:30:04.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:04 smithi003 ceph-mon[30348]: pgmap v489: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:30:06.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:06 smithi003 ceph-mon[30348]: pgmap v490: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:30:06.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:06 smithi038 ceph-mon[34225]: pgmap v490: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:30:06.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:06 smithi194 ceph-mon[33904]: pgmap v490: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:30:07.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:07 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:30:07.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:07 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:30:07.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:07 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:30:08.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:08 smithi038 ceph-mon[34225]: pgmap v491: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:30:08.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:08 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:30:08.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:08 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:30:08.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:08 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:30:08.449 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:08 smithi194 ceph-mon[33904]: pgmap v491: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:30:08.449 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:08 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:30:08.449 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:08 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:30:08.449 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:08 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:30:08.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:08 smithi003 ceph-mon[30348]: pgmap v491: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:30:08.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:08 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:30:08.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:08 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:30:08.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:08 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:30:10.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:10 smithi038 ceph-mon[34225]: pgmap v492: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:30:10.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:10 smithi194 ceph-mon[33904]: pgmap v492: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:30:10.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:10 smithi003 ceph-mon[30348]: pgmap v492: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:30:12.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:12 smithi038 ceph-mon[34225]: pgmap v493: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:30:12.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:12 smithi194 ceph-mon[33904]: pgmap v493: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:30:12.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:12 smithi003 ceph-mon[30348]: pgmap v493: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:30:14.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:14 smithi003 ceph-mon[30348]: pgmap v494: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:30:14.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:14 smithi038 ceph-mon[34225]: pgmap v494: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:30:14.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:14 smithi194 ceph-mon[33904]: pgmap v494: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:30:16.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:16 smithi003 ceph-mon[30348]: pgmap v495: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:30:16.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:16 smithi038 ceph-mon[34225]: pgmap v495: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:30:16.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:16 smithi194 ceph-mon[33904]: pgmap v495: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:30:18.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:18 smithi038 ceph-mon[34225]: pgmap v496: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T23:30:18.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:18 smithi194 ceph-mon[33904]: pgmap v496: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T23:30:18.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:18 smithi003 ceph-mon[30348]: pgmap v496: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T23:30:20.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:20 smithi038 ceph-mon[34225]: pgmap v497: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:30:20.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:20 smithi194 ceph-mon[33904]: pgmap v497: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:30:20.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:20 smithi003 ceph-mon[30348]: pgmap v497: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:30:22.500 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:22 smithi194 ceph-mon[33904]: pgmap v498: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:30:22.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:22 smithi038 ceph-mon[34225]: pgmap v498: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:30:22.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:22 smithi003 ceph-mon[30348]: pgmap v498: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:30:24.523 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:24 smithi003 ceph-mon[30348]: pgmap v499: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:30:24.599 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:24 smithi038 ceph-mon[34225]: pgmap v499: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:30:24.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:24 smithi194 ceph-mon[33904]: pgmap v499: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:30:26.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:26 smithi003 ceph-mon[30348]: pgmap v500: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:30:26.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:26 smithi038 ceph-mon[34225]: pgmap v500: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:30:26.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:26 smithi194 ceph-mon[33904]: pgmap v500: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:30:28.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:28 smithi038 ceph-mon[34225]: pgmap v501: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:30:28.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:28 smithi194 ceph-mon[33904]: pgmap v501: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:30:28.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:28 smithi003 ceph-mon[30348]: pgmap v501: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:30:30.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:30 smithi038 ceph-mon[34225]: pgmap v502: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:30:30.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:30 smithi194 ceph-mon[33904]: pgmap v502: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:30:30.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:30 smithi003 ceph-mon[30348]: pgmap v502: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:30:32.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:32 smithi038 ceph-mon[34225]: pgmap v503: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:30:32.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:32 smithi194 ceph-mon[33904]: pgmap v503: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:30:32.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:32 smithi003 ceph-mon[30348]: pgmap v503: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:30:34.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:34 smithi038 ceph-mon[34225]: pgmap v504: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:30:34.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:34 smithi194 ceph-mon[33904]: pgmap v504: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:30:34.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:34 smithi003 ceph-mon[30348]: pgmap v504: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:30:36.532 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:36 smithi003 ceph-mon[30348]: pgmap v505: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:30:36.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:36 smithi038 ceph-mon[34225]: pgmap v505: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:30:36.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:36 smithi194 ceph-mon[33904]: pgmap v505: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:30:38.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:38 smithi038 ceph-mon[34225]: pgmap v506: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:30:38.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:38 smithi194 ceph-mon[33904]: pgmap v506: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:30:38.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:38 smithi003 ceph-mon[30348]: pgmap v506: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:30:40.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:40 smithi038 ceph-mon[34225]: pgmap v507: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:30:40.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:40 smithi194 ceph-mon[33904]: pgmap v507: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:30:40.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:40 smithi003 ceph-mon[30348]: pgmap v507: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:30:42.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:42 smithi038 ceph-mon[34225]: pgmap v508: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:30:42.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:42 smithi194 ceph-mon[33904]: pgmap v508: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:30:42.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:42 smithi003 ceph-mon[30348]: pgmap v508: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:30:44.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:44 smithi038 ceph-mon[34225]: pgmap v509: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:30:44.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:44 smithi194 ceph-mon[33904]: pgmap v509: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:30:44.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:44 smithi003 ceph-mon[30348]: pgmap v509: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:30:46.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:46 smithi038 ceph-mon[34225]: pgmap v510: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:30:46.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:46 smithi194 ceph-mon[33904]: pgmap v510: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:30:46.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:46 smithi003 ceph-mon[30348]: pgmap v510: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:30:48.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:48 smithi038 ceph-mon[34225]: pgmap v511: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:30:48.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:48 smithi194 ceph-mon[33904]: pgmap v511: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:30:48.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:48 smithi003 ceph-mon[30348]: pgmap v511: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:30:50.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:50 smithi038 ceph-mon[34225]: pgmap v512: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:30:50.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:50 smithi194 ceph-mon[33904]: pgmap v512: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:30:50.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:50 smithi003 ceph-mon[30348]: pgmap v512: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:30:52.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:52 smithi038 ceph-mon[34225]: pgmap v513: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:30:52.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:52 smithi194 ceph-mon[33904]: pgmap v513: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:30:52.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:52 smithi003 ceph-mon[30348]: pgmap v513: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:30:54.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:54 smithi194 ceph-mon[33904]: pgmap v514: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:30:54.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:54 smithi038 ceph-mon[34225]: pgmap v514: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:30:54.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:54 smithi003 ceph-mon[30348]: pgmap v514: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:30:56.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:56 smithi038 ceph-mon[34225]: pgmap v515: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:30:56.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:56 smithi194 ceph-mon[33904]: pgmap v515: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:30:56.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:56 smithi003 ceph-mon[30348]: pgmap v515: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:30:58.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:30:58 smithi038 ceph-mon[34225]: pgmap v516: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:30:58.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:30:58 smithi194 ceph-mon[33904]: pgmap v516: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:30:58.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:30:58 smithi003 ceph-mon[30348]: pgmap v516: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:31:00.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:00 smithi038 ceph-mon[34225]: pgmap v517: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:31:00.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:00 smithi194 ceph-mon[33904]: pgmap v517: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:31:00.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:00 smithi003 ceph-mon[30348]: pgmap v517: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:31:02.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:02 smithi038 ceph-mon[34225]: pgmap v518: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:31:02.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:02 smithi194 ceph-mon[33904]: pgmap v518: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:31:02.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:02 smithi003 ceph-mon[30348]: pgmap v518: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:31:04.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:04 smithi038 ceph-mon[34225]: pgmap v519: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:31:04.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:04 smithi194 ceph-mon[33904]: pgmap v519: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:31:04.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:04 smithi003 ceph-mon[30348]: pgmap v519: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:31:06.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:06 smithi038 ceph-mon[34225]: pgmap v520: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:31:06.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:06 smithi194 ceph-mon[33904]: pgmap v520: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:31:06.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:06 smithi003 ceph-mon[30348]: pgmap v520: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:31:08.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:08 smithi038 ceph-mon[34225]: pgmap v521: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:31:08.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:08 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:31:08.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:08 smithi194 ceph-mon[33904]: pgmap v521: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:31:08.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:08 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:31:08.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:08 smithi003 ceph-mon[30348]: pgmap v521: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:31:08.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:08 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:31:09.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:09 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:09.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:09 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:31:09.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:09 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:31:09.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:09 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:09.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:09 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:31:09.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:09 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:31:09.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:09 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:09.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:09 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:31:09.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:09 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:31:10.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:10 smithi194 ceph-mon[33904]: pgmap v522: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:31:10.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:10 smithi003 ceph-mon[30348]: pgmap v522: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:31:11.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:10 smithi038 ceph-mon[34225]: pgmap v522: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:31:12.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:12 smithi194 ceph-mon[33904]: pgmap v523: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:31:12.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:12 smithi003 ceph-mon[30348]: pgmap v523: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:31:13.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:12 smithi038 ceph-mon[34225]: pgmap v523: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:31:14.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:14 smithi194 ceph-mon[33904]: pgmap v524: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:31:14.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:14 smithi003 ceph-mon[30348]: pgmap v524: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:31:15.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:14 smithi038 ceph-mon[34225]: pgmap v524: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:31:16.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:16 smithi194 ceph-mon[33904]: pgmap v525: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T23:31:16.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:16 smithi003 ceph-mon[30348]: pgmap v525: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T23:31:17.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:16 smithi038 ceph-mon[34225]: pgmap v525: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T23:31:18.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:18 smithi194 ceph-mon[33904]: pgmap v526: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-10T23:31:18.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:18 smithi003 ceph-mon[30348]: pgmap v526: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-10T23:31:19.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:18 smithi038 ceph-mon[34225]: pgmap v526: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-10T23:31:20.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:20 smithi194 ceph-mon[33904]: pgmap v527: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T23:31:20.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:20 smithi003 ceph-mon[30348]: pgmap v527: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T23:31:21.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:20 smithi038 ceph-mon[34225]: pgmap v527: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T23:31:22.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:22 smithi194 ceph-mon[33904]: pgmap v528: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:31:22.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:22 smithi003 ceph-mon[30348]: pgmap v528: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:31:23.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:22 smithi038 ceph-mon[34225]: pgmap v528: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:31:24.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:24 smithi194 ceph-mon[33904]: pgmap v529: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-10T23:31:24.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:24 smithi003 ceph-mon[30348]: pgmap v529: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-10T23:31:25.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:24 smithi038 ceph-mon[34225]: pgmap v529: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-10T23:31:26.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:26 smithi194 ceph-mon[33904]: pgmap v530: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:31:26.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:26 smithi003 ceph-mon[30348]: pgmap v530: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:31:27.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:26 smithi038 ceph-mon[34225]: pgmap v530: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:31:28.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:28 smithi194 ceph-mon[33904]: pgmap v531: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:31:28.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:28 smithi003 ceph-mon[30348]: pgmap v531: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:31:29.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:28 smithi038 ceph-mon[34225]: pgmap v531: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:31:30.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:30 smithi194 ceph-mon[33904]: pgmap v532: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:31:30.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:30 smithi003 ceph-mon[30348]: pgmap v532: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:31:31.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:30 smithi038 ceph-mon[34225]: pgmap v532: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:31:32.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:32 smithi038 ceph-mon[34225]: pgmap v533: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:31:32.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:32 smithi194 ceph-mon[33904]: pgmap v533: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:31:32.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:32 smithi003 ceph-mon[30348]: pgmap v533: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:31:34.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:34 smithi194 ceph-mon[33904]: pgmap v534: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:31:34.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:34 smithi003 ceph-mon[30348]: pgmap v534: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:31:35.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:34 smithi038 ceph-mon[34225]: pgmap v534: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:31:36.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:36 smithi194 ceph-mon[33904]: pgmap v535: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:31:36.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:36 smithi003 ceph-mon[30348]: pgmap v535: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:31:37.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:36 smithi038 ceph-mon[34225]: pgmap v535: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:31:38.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:38 smithi194 ceph-mon[33904]: pgmap v536: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:31:38.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:38 smithi003 ceph-mon[30348]: pgmap v536: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:31:39.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:38 smithi038 ceph-mon[34225]: pgmap v536: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:31:40.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:40 smithi194 ceph-mon[33904]: pgmap v537: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:31:40.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:40 smithi003 ceph-mon[30348]: pgmap v537: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:31:41.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:40 smithi038 ceph-mon[34225]: pgmap v537: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:31:42.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:42 smithi194 ceph-mon[33904]: pgmap v538: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:31:42.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:42 smithi003 ceph-mon[30348]: pgmap v538: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:31:43.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:42 smithi038 ceph-mon[34225]: pgmap v538: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:31:44.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:44 smithi194 ceph-mon[33904]: pgmap v539: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-10T23:31:44.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:44 smithi003 ceph-mon[30348]: pgmap v539: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-10T23:31:45.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:44 smithi038 ceph-mon[34225]: pgmap v539: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-10T23:31:46.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:46 smithi194 ceph-mon[33904]: pgmap v540: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:31:46.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:46 smithi003 ceph-mon[30348]: pgmap v540: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:31:47.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:46 smithi038 ceph-mon[34225]: pgmap v540: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:31:48.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:48 smithi003 ceph-mon[30348]: pgmap v541: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:31:49.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:48 smithi038 ceph-mon[34225]: pgmap v541: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:31:49.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:48 smithi194 ceph-mon[33904]: pgmap v541: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:31:50.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:50 smithi003 ceph-mon[30348]: pgmap v542: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:31:51.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:50 smithi038 ceph-mon[34225]: pgmap v542: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:31:51.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:50 smithi194 ceph-mon[33904]: pgmap v542: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:31:52.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:52 smithi003 ceph-mon[30348]: pgmap v543: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:31:53.000 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:52 smithi194 ceph-mon[33904]: pgmap v543: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:31:53.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:52 smithi038 ceph-mon[34225]: pgmap v543: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:31:54.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:54 smithi003 ceph-mon[30348]: pgmap v544: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:31:55.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:54 smithi038 ceph-mon[34225]: pgmap v544: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:31:55.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:54 smithi194 ceph-mon[33904]: pgmap v544: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:31:56.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:56 smithi003 ceph-mon[30348]: pgmap v545: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:31:57.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:56 smithi038 ceph-mon[34225]: pgmap v545: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:31:57.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:56 smithi194 ceph-mon[33904]: pgmap v545: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:31:58.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:58 smithi003 ceph-mon[30348]: pgmap v546: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:31:59.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:58 smithi038 ceph-mon[34225]: pgmap v546: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:31:59.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:58 smithi194 ceph-mon[33904]: pgmap v546: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:32:00.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:31:59 smithi038 ceph-mon[34225]: pgmap v547: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:32:00.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:31:59 smithi194 ceph-mon[33904]: pgmap v547: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:32:00.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:31:59 smithi003 ceph-mon[30348]: pgmap v547: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:32:02.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:01 smithi003 ceph-mon[30348]: pgmap v548: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:32:02.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:01 smithi038 ceph-mon[34225]: pgmap v548: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:32:02.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:01 smithi194 ceph-mon[33904]: pgmap v548: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:32:04.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:03 smithi003 ceph-mon[30348]: pgmap v549: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:32:04.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:03 smithi038 ceph-mon[34225]: pgmap v549: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:32:04.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:03 smithi194 ceph-mon[33904]: pgmap v549: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:32:06.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:05 smithi003 ceph-mon[30348]: pgmap v550: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:32:06.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:05 smithi038 ceph-mon[34225]: pgmap v550: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:32:06.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:05 smithi194 ceph-mon[33904]: pgmap v550: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:32:08.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:07 smithi003 ceph-mon[30348]: pgmap v551: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:32:08.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:07 smithi038 ceph-mon[34225]: pgmap v551: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:32:08.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:07 smithi194 ceph-mon[33904]: pgmap v551: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:32:09.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:08 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:32:09.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:08 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:32:09.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:08 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:32:10.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:09 smithi038 ceph-mon[34225]: pgmap v552: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:32:10.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:09 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:32:10.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:09 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:32:10.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:09 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:32:10.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:09 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:32:10.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:09 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:32:10.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:09 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:32:10.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:09 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T23:32:10.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:09 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T23:32:10.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:09 smithi038 ceph-mon[34225]: Adjusting osd_memory_target on smithi003 to 177.5M 2024-09-10T23:32:10.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:09 smithi038 ceph-mon[34225]: Unable to set osd_memory_target on smithi003 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-10T23:32:10.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:09 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:32:10.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:09 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:32:10.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:09 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:32:10.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:09 smithi194 ceph-mon[33904]: pgmap v552: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:32:10.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:09 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:32:10.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:09 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:32:10.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:09 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:32:10.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:09 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:32:10.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:09 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:32:10.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:09 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:32:10.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:09 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T23:32:10.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:09 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T23:32:10.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:09 smithi194 ceph-mon[33904]: Adjusting osd_memory_target on smithi003 to 177.5M 2024-09-10T23:32:10.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:09 smithi194 ceph-mon[33904]: Unable to set osd_memory_target on smithi003 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-10T23:32:10.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:09 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:32:10.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:09 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:32:10.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:09 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:32:10.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:09 smithi003 ceph-mon[30348]: pgmap v552: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:32:10.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:09 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:32:10.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:09 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:32:10.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:09 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:32:10.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:09 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:32:10.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:09 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:32:10.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:09 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:32:10.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:09 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T23:32:10.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:09 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T23:32:10.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:09 smithi003 ceph-mon[30348]: Adjusting osd_memory_target on smithi003 to 177.5M 2024-09-10T23:32:10.472 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:09 smithi003 ceph-mon[30348]: Unable to set osd_memory_target on smithi003 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-10T23:32:10.472 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:09 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:32:10.472 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:09 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:32:10.472 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:09 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:32:12.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:11 smithi038 ceph-mon[34225]: pgmap v553: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:32:12.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:11 smithi194 ceph-mon[33904]: pgmap v553: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:32:12.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:11 smithi003 ceph-mon[30348]: pgmap v553: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:32:14.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:13 smithi038 ceph-mon[34225]: pgmap v554: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:32:14.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:13 smithi194 ceph-mon[33904]: pgmap v554: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:32:14.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:13 smithi003 ceph-mon[30348]: pgmap v554: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:32:16.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:15 smithi038 ceph-mon[34225]: pgmap v555: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T23:32:16.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:15 smithi194 ceph-mon[33904]: pgmap v555: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T23:32:16.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:15 smithi003 ceph-mon[30348]: pgmap v555: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T23:32:18.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:17 smithi038 ceph-mon[34225]: pgmap v556: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-10T23:32:18.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:17 smithi194 ceph-mon[33904]: pgmap v556: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-10T23:32:18.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:17 smithi003 ceph-mon[30348]: pgmap v556: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-10T23:32:20.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:20 smithi038 ceph-mon[34225]: pgmap v557: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T23:32:20.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:20 smithi194 ceph-mon[33904]: pgmap v557: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T23:32:20.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:20 smithi003 ceph-mon[30348]: pgmap v557: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T23:32:22.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:22 smithi038 ceph-mon[34225]: pgmap v558: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:32:22.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:22 smithi194 ceph-mon[33904]: pgmap v558: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:32:22.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:22 smithi003 ceph-mon[30348]: pgmap v558: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:32:24.273 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:24 smithi003 ceph-mon[30348]: pgmap v559: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-10T23:32:24.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:24 smithi038 ceph-mon[34225]: pgmap v559: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-10T23:32:24.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:24 smithi194 ceph-mon[33904]: pgmap v559: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-10T23:32:26.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:26 smithi038 ceph-mon[34225]: pgmap v560: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:32:26.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:26 smithi194 ceph-mon[33904]: pgmap v560: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:32:26.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:26 smithi003 ceph-mon[30348]: pgmap v560: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:32:28.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:28 smithi038 ceph-mon[34225]: pgmap v561: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:32:28.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:28 smithi194 ceph-mon[33904]: pgmap v561: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:32:28.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:28 smithi003 ceph-mon[30348]: pgmap v561: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:32:30.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:30 smithi038 ceph-mon[34225]: pgmap v562: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:32:30.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:30 smithi194 ceph-mon[33904]: pgmap v562: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:32:30.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:30 smithi003 ceph-mon[30348]: pgmap v562: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:32:32.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:32 smithi038 ceph-mon[34225]: pgmap v563: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:32:32.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:32 smithi194 ceph-mon[33904]: pgmap v563: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:32:32.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:32 smithi003 ceph-mon[30348]: pgmap v563: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:32:34.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:34 smithi038 ceph-mon[34225]: pgmap v564: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:32:34.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:34 smithi194 ceph-mon[33904]: pgmap v564: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:32:34.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:34 smithi003 ceph-mon[30348]: pgmap v564: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:32:36.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:36 smithi038 ceph-mon[34225]: pgmap v565: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:32:36.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:36 smithi194 ceph-mon[33904]: pgmap v565: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:32:36.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:36 smithi003 ceph-mon[30348]: pgmap v565: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:32:38.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:38 smithi038 ceph-mon[34225]: pgmap v566: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:32:38.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:38 smithi194 ceph-mon[33904]: pgmap v566: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:32:38.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:38 smithi003 ceph-mon[30348]: pgmap v566: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:32:40.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:40 smithi038 ceph-mon[34225]: pgmap v567: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:32:40.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:40 smithi194 ceph-mon[33904]: pgmap v567: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:32:40.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:40 smithi003 ceph-mon[30348]: pgmap v567: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:32:42.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:42 smithi038 ceph-mon[34225]: pgmap v568: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:32:42.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:42 smithi194 ceph-mon[33904]: pgmap v568: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:32:42.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:42 smithi003 ceph-mon[30348]: pgmap v568: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:32:44.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:44 smithi038 ceph-mon[34225]: pgmap v569: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:32:44.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:44 smithi194 ceph-mon[33904]: pgmap v569: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:32:44.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:44 smithi003 ceph-mon[30348]: pgmap v569: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:32:46.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:46 smithi038 ceph-mon[34225]: pgmap v570: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:32:46.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:46 smithi194 ceph-mon[33904]: pgmap v570: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:32:46.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:46 smithi003 ceph-mon[30348]: pgmap v570: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:32:48.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:48 smithi038 ceph-mon[34225]: pgmap v571: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:32:48.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:48 smithi194 ceph-mon[33904]: pgmap v571: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:32:48.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:48 smithi003 ceph-mon[30348]: pgmap v571: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:32:50.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:50 smithi038 ceph-mon[34225]: pgmap v572: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:32:50.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:50 smithi194 ceph-mon[33904]: pgmap v572: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:32:50.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:50 smithi003 ceph-mon[30348]: pgmap v572: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:32:52.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:52 smithi038 ceph-mon[34225]: pgmap v573: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:32:52.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:52 smithi194 ceph-mon[33904]: pgmap v573: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:32:52.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:52 smithi003 ceph-mon[30348]: pgmap v573: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:32:54.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:54 smithi038 ceph-mon[34225]: pgmap v574: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:32:54.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:54 smithi194 ceph-mon[33904]: pgmap v574: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:32:54.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:54 smithi003 ceph-mon[30348]: pgmap v574: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:32:56.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:56 smithi038 ceph-mon[34225]: pgmap v575: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:32:56.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:56 smithi194 ceph-mon[33904]: pgmap v575: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:32:56.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:56 smithi003 ceph-mon[30348]: pgmap v575: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:32:58.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:32:58 smithi038 ceph-mon[34225]: pgmap v576: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:32:58.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:32:58 smithi194 ceph-mon[33904]: pgmap v576: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:32:58.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:32:58 smithi003 ceph-mon[30348]: pgmap v576: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:33:00.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:00 smithi038 ceph-mon[34225]: pgmap v577: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:33:00.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:00 smithi194 ceph-mon[33904]: pgmap v577: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:33:00.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:00 smithi003 ceph-mon[30348]: pgmap v577: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:33:02.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:02 smithi038 ceph-mon[34225]: pgmap v578: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:33:02.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:02 smithi194 ceph-mon[33904]: pgmap v578: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:33:02.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:02 smithi003 ceph-mon[30348]: pgmap v578: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:33:04.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:04 smithi038 ceph-mon[34225]: pgmap v579: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-10T23:33:04.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:04 smithi194 ceph-mon[33904]: pgmap v579: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-10T23:33:04.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:04 smithi003 ceph-mon[30348]: pgmap v579: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-10T23:33:06.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:06 smithi038 ceph-mon[34225]: pgmap v580: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:33:06.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:06 smithi194 ceph-mon[33904]: pgmap v580: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:33:06.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:06 smithi003 ceph-mon[30348]: pgmap v580: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:33:08.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:08 smithi038 ceph-mon[34225]: pgmap v581: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:33:08.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:08 smithi194 ceph-mon[33904]: pgmap v581: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:33:08.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:08 smithi003 ceph-mon[30348]: pgmap v581: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:33:10.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:10 smithi038 ceph-mon[34225]: pgmap v582: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:33:10.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:10 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:33:10.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:10 smithi194 ceph-mon[33904]: pgmap v582: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:33:10.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:10 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:33:10.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:10 smithi003 ceph-mon[30348]: pgmap v582: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:33:10.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:10 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:33:11.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:11 smithi038 ceph-mon[34225]: osdmap e91: 12 total, 12 up, 12 in 2024-09-10T23:33:11.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:11 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:11 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:11 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:11 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:11 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:11 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:11 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:11 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:11 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:11 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.599 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:11 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.599 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:11 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.599 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:11 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.599 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:11 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.599 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:11 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.599 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:11 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.599 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:11 smithi038 ceph-mon[34225]: Adjusting osd_memory_target on smithi038 to 177.5M 2024-09-10T23:33:11.599 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:11 smithi038 ceph-mon[34225]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-09-10T23:33:11.599 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:11 smithi038 ceph-mon[34225]: Unable to set osd_memory_target on smithi038 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-10T23:33:11.599 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:11 smithi038 ceph-mon[34225]: Unable to set osd_memory_target on smithi194 to 185043353: error parsing value: Value '185043353' is below minimum 939524096 2024-09-10T23:33:11.599 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:11 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:33:11.599 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:11 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:33:11.600 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:11 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:33:11.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:11 smithi194 ceph-mon[33904]: osdmap e91: 12 total, 12 up, 12 in 2024-09-10T23:33:11.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:11 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:11 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:11 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:11 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:11 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:11 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:11 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:11 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:11 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:11 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:11 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:11 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:11 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:11 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:11 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:11 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:11 smithi194 ceph-mon[33904]: Adjusting osd_memory_target on smithi038 to 177.5M 2024-09-10T23:33:11.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:11 smithi194 ceph-mon[33904]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-09-10T23:33:11.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:11 smithi194 ceph-mon[33904]: Unable to set osd_memory_target on smithi038 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-10T23:33:11.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:11 smithi194 ceph-mon[33904]: Unable to set osd_memory_target on smithi194 to 185043353: error parsing value: Value '185043353' is below minimum 939524096 2024-09-10T23:33:11.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:11 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:33:11.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:11 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:33:11.699 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:11 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:33:11.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:11 smithi003 ceph-mon[30348]: osdmap e91: 12 total, 12 up, 12 in 2024-09-10T23:33:11.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:11 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:11 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:11 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:11 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:11 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:11 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:11 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:11 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:11 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:11 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:11 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:11 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:11 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:11 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:11 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:11 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:11.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:11 smithi003 ceph-mon[30348]: Adjusting osd_memory_target on smithi038 to 177.5M 2024-09-10T23:33:11.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:11 smithi003 ceph-mon[30348]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-09-10T23:33:11.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:11 smithi003 ceph-mon[30348]: Unable to set osd_memory_target on smithi038 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-10T23:33:11.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:11 smithi003 ceph-mon[30348]: Unable to set osd_memory_target on smithi194 to 185043353: error parsing value: Value '185043353' is below minimum 939524096 2024-09-10T23:33:11.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:11 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:33:11.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:11 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:33:11.722 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:11 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:33:12.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:12 smithi194 ceph-mon[33904]: pgmap v584: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-10T23:33:12.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:12 smithi003 ceph-mon[30348]: pgmap v584: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-10T23:33:13.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:12 smithi038 ceph-mon[34225]: pgmap v584: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-10T23:33:14.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:14 smithi194 ceph-mon[33904]: pgmap v585: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:33:14.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:14 smithi003 ceph-mon[30348]: pgmap v585: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:33:15.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:14 smithi038 ceph-mon[34225]: pgmap v585: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:33:16.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:16 smithi194 ceph-mon[33904]: pgmap v586: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:33:16.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:16 smithi003 ceph-mon[30348]: pgmap v586: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:33:17.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:16 smithi038 ceph-mon[34225]: pgmap v586: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:33:18.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:18 smithi194 ceph-mon[33904]: pgmap v587: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:33:18.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:18 smithi194 ceph-mon[33904]: osdmap e92: 12 total, 12 up, 12 in 2024-09-10T23:33:18.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:18 smithi003 ceph-mon[30348]: pgmap v587: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:33:18.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:18 smithi003 ceph-mon[30348]: osdmap e92: 12 total, 12 up, 12 in 2024-09-10T23:33:19.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:18 smithi038 ceph-mon[34225]: pgmap v587: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:33:19.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:18 smithi038 ceph-mon[34225]: osdmap e92: 12 total, 12 up, 12 in 2024-09-10T23:33:20.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:20 smithi194 ceph-mon[33904]: pgmap v589: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 237 B/s wr, 7 op/s 2024-09-10T23:33:20.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:20 smithi003 ceph-mon[30348]: pgmap v589: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 237 B/s wr, 7 op/s 2024-09-10T23:33:21.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:20 smithi038 ceph-mon[34225]: pgmap v589: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 237 B/s wr, 7 op/s 2024-09-10T23:33:22.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:22 smithi194 ceph-mon[33904]: pgmap v590: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:33:22.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:22 smithi003 ceph-mon[30348]: pgmap v590: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:33:23.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:22 smithi038 ceph-mon[34225]: pgmap v590: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:33:24.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:24 smithi194 ceph-mon[33904]: pgmap v591: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:33:24.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:24 smithi003 ceph-mon[30348]: pgmap v591: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:33:25.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:24 smithi038 ceph-mon[34225]: pgmap v591: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:33:26.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:26 smithi194 ceph-mon[33904]: pgmap v592: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:33:26.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:26 smithi003 ceph-mon[30348]: pgmap v592: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:33:27.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:26 smithi038 ceph-mon[34225]: pgmap v592: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:33:28.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:28 smithi194 ceph-mon[33904]: pgmap v593: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-10T23:33:28.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:28 smithi003 ceph-mon[30348]: pgmap v593: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-10T23:33:29.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:28 smithi038 ceph-mon[34225]: pgmap v593: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-10T23:33:30.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:30 smithi194 ceph-mon[33904]: pgmap v594: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-10T23:33:30.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:30 smithi003 ceph-mon[30348]: pgmap v594: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-10T23:33:31.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:30 smithi038 ceph-mon[34225]: pgmap v594: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-10T23:33:32.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:32 smithi194 ceph-mon[33904]: pgmap v595: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:33:32.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:32 smithi003 ceph-mon[30348]: pgmap v595: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:33:33.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:32 smithi038 ceph-mon[34225]: pgmap v595: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:33:34.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:34 smithi003 ceph-mon[30348]: pgmap v596: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:33:35.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:34 smithi038 ceph-mon[34225]: pgmap v596: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:33:35.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:34 smithi194 ceph-mon[33904]: pgmap v596: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:33:36.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:36 smithi003 ceph-mon[30348]: pgmap v597: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:33:37.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:36 smithi038 ceph-mon[34225]: pgmap v597: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:33:37.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:36 smithi194 ceph-mon[33904]: pgmap v597: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:33:38.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:38 smithi003 ceph-mon[30348]: pgmap v598: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:33:39.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:38 smithi038 ceph-mon[34225]: pgmap v598: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:33:39.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:38 smithi194 ceph-mon[33904]: pgmap v598: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:33:40.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:40 smithi003 ceph-mon[30348]: pgmap v599: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:33:41.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:40 smithi038 ceph-mon[34225]: pgmap v599: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:33:41.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:40 smithi194 ceph-mon[33904]: pgmap v599: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:33:42.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:42 smithi003 ceph-mon[30348]: pgmap v600: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:33:43.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:42 smithi038 ceph-mon[34225]: pgmap v600: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:33:43.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:42 smithi194 ceph-mon[33904]: pgmap v600: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:33:44.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:44 smithi003 ceph-mon[30348]: pgmap v601: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:33:45.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:44 smithi038 ceph-mon[34225]: pgmap v601: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:33:45.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:44 smithi194 ceph-mon[33904]: pgmap v601: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:33:47.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:46 smithi038 ceph-mon[34225]: pgmap v602: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:33:47.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:46 smithi194 ceph-mon[33904]: pgmap v602: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:33:47.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:46 smithi003 ceph-mon[30348]: pgmap v602: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:33:49.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:48 smithi038 ceph-mon[34225]: pgmap v603: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:33:49.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:48 smithi194 ceph-mon[33904]: pgmap v603: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:33:49.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:48 smithi003 ceph-mon[30348]: pgmap v603: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:33:51.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:50 smithi038 ceph-mon[34225]: pgmap v604: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:33:51.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:50 smithi194 ceph-mon[33904]: pgmap v604: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:33:51.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:50 smithi003 ceph-mon[30348]: pgmap v604: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:33:53.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:52 smithi038 ceph-mon[34225]: pgmap v605: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:33:53.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:52 smithi194 ceph-mon[33904]: pgmap v605: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:33:53.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:52 smithi003 ceph-mon[30348]: pgmap v605: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:33:55.000 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:54 smithi194 ceph-mon[33904]: pgmap v606: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:33:55.023 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:54 smithi003 ceph-mon[30348]: pgmap v606: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:33:55.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:54 smithi038 ceph-mon[34225]: pgmap v606: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:33:56.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:55 smithi038 ceph-mon[34225]: pgmap v607: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:33:56.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:55 smithi194 ceph-mon[33904]: pgmap v607: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:33:56.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:55 smithi003 ceph-mon[30348]: pgmap v607: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:33:58.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:33:58 smithi038 ceph-mon[34225]: pgmap v608: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:33:58.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:33:58 smithi194 ceph-mon[33904]: pgmap v608: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:33:58.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:33:57 smithi003 ceph-mon[30348]: pgmap v608: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:34:00.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:00 smithi038 ceph-mon[34225]: pgmap v609: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:34:00.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:00 smithi194 ceph-mon[33904]: pgmap v609: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:34:00.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:00 smithi003 ceph-mon[30348]: pgmap v609: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:34:02.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:02 smithi038 ceph-mon[34225]: pgmap v610: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:34:02.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:02 smithi194 ceph-mon[33904]: pgmap v610: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:34:02.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:02 smithi003 ceph-mon[30348]: pgmap v610: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:34:04.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:04 smithi038 ceph-mon[34225]: pgmap v611: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-10T23:34:04.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:04 smithi194 ceph-mon[33904]: pgmap v611: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-10T23:34:04.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:04 smithi003 ceph-mon[30348]: pgmap v611: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-10T23:34:06.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:06 smithi038 ceph-mon[34225]: pgmap v612: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:34:06.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:06 smithi194 ceph-mon[33904]: pgmap v612: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:34:06.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:06 smithi003 ceph-mon[30348]: pgmap v612: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:34:08.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:08 smithi038 ceph-mon[34225]: pgmap v613: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:34:08.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:08 smithi194 ceph-mon[33904]: pgmap v613: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:34:08.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:08 smithi003 ceph-mon[30348]: pgmap v613: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:34:10.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:10 smithi038 ceph-mon[34225]: pgmap v614: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:34:10.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:10 smithi194 ceph-mon[33904]: pgmap v614: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:34:10.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:10 smithi003 ceph-mon[30348]: pgmap v614: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:34:11.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:11 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:34:11.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:11 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:34:11.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:11 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:34:12.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:12 smithi038 ceph-mon[34225]: pgmap v615: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:34:12.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:12 smithi038 ceph-mon[34225]: osdmap e93: 12 total, 12 up, 12 in 2024-09-10T23:34:12.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:12 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:12.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:12 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:34:12.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:12 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:34:12.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:12 smithi194 ceph-mon[33904]: pgmap v615: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:34:12.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:12 smithi194 ceph-mon[33904]: osdmap e93: 12 total, 12 up, 12 in 2024-09-10T23:34:12.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:12 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:12.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:12 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:34:12.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:12 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:34:12.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:12 smithi003 ceph-mon[30348]: pgmap v615: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:34:12.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:12 smithi003 ceph-mon[30348]: osdmap e93: 12 total, 12 up, 12 in 2024-09-10T23:34:12.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:12 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:12.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:12 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:34:12.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:12 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:34:14.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:14 smithi038 ceph-mon[34225]: pgmap v617: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:34:14.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:14 smithi194 ceph-mon[33904]: pgmap v617: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:34:14.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:14 smithi003 ceph-mon[30348]: pgmap v617: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:34:16.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:16 smithi038 ceph-mon[34225]: pgmap v618: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:34:16.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:16 smithi194 ceph-mon[33904]: pgmap v618: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:34:16.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:16 smithi003 ceph-mon[30348]: pgmap v618: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:34:18.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:18 smithi038 ceph-mon[34225]: pgmap v619: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:34:18.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:18 smithi038 ceph-mon[34225]: osdmap e94: 12 total, 12 up, 12 in 2024-09-10T23:34:18.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:18 smithi194 ceph-mon[33904]: pgmap v619: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:34:18.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:18 smithi194 ceph-mon[33904]: osdmap e94: 12 total, 12 up, 12 in 2024-09-10T23:34:18.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:18 smithi003 ceph-mon[30348]: pgmap v619: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:34:18.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:18 smithi003 ceph-mon[30348]: osdmap e94: 12 total, 12 up, 12 in 2024-09-10T23:34:20.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:20 smithi038 ceph-mon[34225]: pgmap v621: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-10T23:34:20.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:20 smithi194 ceph-mon[33904]: pgmap v621: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-10T23:34:20.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:20 smithi003 ceph-mon[30348]: pgmap v621: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-10T23:34:22.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:22 smithi038 ceph-mon[34225]: pgmap v622: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 206 B/s wr, 6 op/s 2024-09-10T23:34:22.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:22 smithi194 ceph-mon[33904]: pgmap v622: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 206 B/s wr, 6 op/s 2024-09-10T23:34:22.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:22 smithi003 ceph-mon[30348]: pgmap v622: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 206 B/s wr, 6 op/s 2024-09-10T23:34:24.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:24 smithi038 ceph-mon[34225]: pgmap v623: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:34:24.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:24 smithi194 ceph-mon[33904]: pgmap v623: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:34:24.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:24 smithi003 ceph-mon[30348]: pgmap v623: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:34:26.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:26 smithi038 ceph-mon[34225]: pgmap v624: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:34:26.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:26 smithi194 ceph-mon[33904]: pgmap v624: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:34:26.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:26 smithi003 ceph-mon[30348]: pgmap v624: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:34:28.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:28 smithi038 ceph-mon[34225]: pgmap v625: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-10T23:34:28.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:28 smithi194 ceph-mon[33904]: pgmap v625: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-10T23:34:28.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:28 smithi003 ceph-mon[30348]: pgmap v625: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-10T23:34:30.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:30 smithi038 ceph-mon[34225]: pgmap v626: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-10T23:34:30.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:30 smithi194 ceph-mon[33904]: pgmap v626: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-10T23:34:30.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:30 smithi003 ceph-mon[30348]: pgmap v626: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-10T23:34:32.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:32 smithi038 ceph-mon[34225]: pgmap v627: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:34:32.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:32 smithi194 ceph-mon[33904]: pgmap v627: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:34:32.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:32 smithi003 ceph-mon[30348]: pgmap v627: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:34:34.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:34 smithi038 ceph-mon[34225]: pgmap v628: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:34:34.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:34 smithi194 ceph-mon[33904]: pgmap v628: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:34:34.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:34 smithi003 ceph-mon[30348]: pgmap v628: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:34:36.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:36 smithi038 ceph-mon[34225]: pgmap v629: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:34:36.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:36 smithi194 ceph-mon[33904]: pgmap v629: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:34:36.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:36 smithi003 ceph-mon[30348]: pgmap v629: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:34:38.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:38 smithi038 ceph-mon[34225]: pgmap v630: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:34:38.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:38 smithi194 ceph-mon[33904]: pgmap v630: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:34:38.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:38 smithi003 ceph-mon[30348]: pgmap v630: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:34:40.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:40 smithi038 ceph-mon[34225]: pgmap v631: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:34:40.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:40 smithi194 ceph-mon[33904]: pgmap v631: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:34:40.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:40 smithi003 ceph-mon[30348]: pgmap v631: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:34:42.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:42 smithi038 ceph-mon[34225]: pgmap v632: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:34:42.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:42 smithi194 ceph-mon[33904]: pgmap v632: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:34:42.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:42 smithi003 ceph-mon[30348]: pgmap v632: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:34:44.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:44 smithi194 ceph-mon[33904]: pgmap v633: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:34:44.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:44 smithi003 ceph-mon[30348]: pgmap v633: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:34:44.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:44 smithi038 ceph-mon[34225]: pgmap v633: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:34:46.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:46 smithi194 ceph-mon[33904]: pgmap v634: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:34:46.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:46 smithi003 ceph-mon[30348]: pgmap v634: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:34:46.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:46 smithi038 ceph-mon[34225]: pgmap v634: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:34:48.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:48 smithi194 ceph-mon[33904]: pgmap v635: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:34:48.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:48 smithi003 ceph-mon[30348]: pgmap v635: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:34:48.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:48 smithi038 ceph-mon[34225]: pgmap v635: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:34:50.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:50 smithi194 ceph-mon[33904]: pgmap v636: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:34:50.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:50 smithi003 ceph-mon[30348]: pgmap v636: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:34:50.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:50 smithi038 ceph-mon[34225]: pgmap v636: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:34:52.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:52 smithi194 ceph-mon[33904]: pgmap v637: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:34:52.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:52 smithi003 ceph-mon[30348]: pgmap v637: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:34:52.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:52 smithi038 ceph-mon[34225]: pgmap v637: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:34:54.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:54 smithi194 ceph-mon[33904]: pgmap v638: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:34:54.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:54 smithi003 ceph-mon[30348]: pgmap v638: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:34:54.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:54 smithi038 ceph-mon[34225]: pgmap v638: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:34:56.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:56 smithi194 ceph-mon[33904]: pgmap v639: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:34:56.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:56 smithi003 ceph-mon[30348]: pgmap v639: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:34:56.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:56 smithi038 ceph-mon[34225]: pgmap v639: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:34:58.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:34:58 smithi194 ceph-mon[33904]: pgmap v640: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:34:58.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:34:58 smithi003 ceph-mon[30348]: pgmap v640: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:34:58.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:34:58 smithi038 ceph-mon[34225]: pgmap v640: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:35:00.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:00 smithi194 ceph-mon[33904]: pgmap v641: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:35:00.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:00 smithi003 ceph-mon[30348]: pgmap v641: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:35:00.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:00 smithi038 ceph-mon[34225]: pgmap v641: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:35:02.649 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:02 smithi038 ceph-mon[34225]: pgmap v642: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:35:02.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:02 smithi194 ceph-mon[33904]: pgmap v642: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:35:02.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:02 smithi003 ceph-mon[30348]: pgmap v642: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:35:04.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:04 smithi194 ceph-mon[33904]: pgmap v643: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-10T23:35:04.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:04 smithi003 ceph-mon[30348]: pgmap v643: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-10T23:35:04.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:04 smithi038 ceph-mon[34225]: pgmap v643: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-10T23:35:06.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:06 smithi194 ceph-mon[33904]: pgmap v644: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:35:06.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:06 smithi003 ceph-mon[30348]: pgmap v644: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:35:06.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:06 smithi038 ceph-mon[34225]: pgmap v644: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:35:08.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:08 smithi194 ceph-mon[33904]: pgmap v645: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:35:08.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:08 smithi003 ceph-mon[30348]: pgmap v645: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:35:08.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:08 smithi038 ceph-mon[34225]: pgmap v645: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:35:10.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:10 smithi194 ceph-mon[33904]: pgmap v646: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:35:10.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:10 smithi003 ceph-mon[30348]: pgmap v646: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:35:10.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:10 smithi038 ceph-mon[34225]: pgmap v646: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:35:11.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:11 smithi194 ceph-mon[33904]: osdmap e95: 12 total, 12 up, 12 in 2024-09-10T23:35:11.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:11 smithi003 ceph-mon[30348]: osdmap e95: 12 total, 12 up, 12 in 2024-09-10T23:35:11.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:11 smithi038 ceph-mon[34225]: osdmap e95: 12 total, 12 up, 12 in 2024-09-10T23:35:12.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:12 smithi194 ceph-mon[33904]: pgmap v648: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-10T23:35:12.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:12 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:35:12.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:12 smithi003 ceph-mon[30348]: pgmap v648: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-10T23:35:12.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:12 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:35:12.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:12 smithi038 ceph-mon[34225]: pgmap v648: 129 pgs: 129 active+clean; 259 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-10T23:35:12.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:12 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:35:13.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:13 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:35:13.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:13 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:35:13.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:13 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:35:13.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:13 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:35:13.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:13 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:35:13.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:13 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:35:13.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:13 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:35:13.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:13 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:35:13.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:13 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:35:14.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:14 smithi003 ceph-mon[30348]: pgmap v649: 129 pgs: 129 active+clean; 87 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:35:15.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:14 smithi038 ceph-mon[34225]: pgmap v649: 129 pgs: 129 active+clean; 87 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:35:15.201 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:14 smithi194 ceph-mon[33904]: pgmap v649: 129 pgs: 129 active+clean; 87 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:35:16.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:16 smithi003 ceph-mon[30348]: pgmap v650: 129 pgs: 129 active+clean; 26 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:35:17.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:16 smithi038 ceph-mon[34225]: pgmap v650: 129 pgs: 129 active+clean; 26 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:35:17.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:16 smithi194 ceph-mon[33904]: pgmap v650: 129 pgs: 129 active+clean; 26 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:35:18.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:18 smithi003 ceph-mon[30348]: pgmap v651: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:35:18.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:18 smithi003 ceph-mon[30348]: osdmap e96: 12 total, 12 up, 12 in 2024-09-10T23:35:19.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:18 smithi038 ceph-mon[34225]: pgmap v651: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:35:19.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:18 smithi038 ceph-mon[34225]: osdmap e96: 12 total, 12 up, 12 in 2024-09-10T23:35:19.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:18 smithi194 ceph-mon[33904]: pgmap v651: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:35:19.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:18 smithi194 ceph-mon[33904]: osdmap e96: 12 total, 12 up, 12 in 2024-09-10T23:35:20.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:20 smithi003 ceph-mon[30348]: pgmap v653: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 239 B/s wr, 7 op/s 2024-09-10T23:35:21.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:20 smithi038 ceph-mon[34225]: pgmap v653: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 239 B/s wr, 7 op/s 2024-09-10T23:35:21.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:20 smithi194 ceph-mon[33904]: pgmap v653: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 239 B/s wr, 7 op/s 2024-09-10T23:35:23.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:22 smithi038 ceph-mon[34225]: pgmap v654: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:35:23.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:22 smithi194 ceph-mon[33904]: pgmap v654: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:35:23.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:22 smithi003 ceph-mon[30348]: pgmap v654: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:35:25.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:24 smithi038 ceph-mon[34225]: pgmap v655: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:35:25.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:24 smithi194 ceph-mon[33904]: pgmap v655: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:35:25.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:24 smithi003 ceph-mon[30348]: pgmap v655: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:35:27.000 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:26 smithi194 ceph-mon[33904]: pgmap v656: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:35:27.023 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:26 smithi003 ceph-mon[30348]: pgmap v656: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:35:27.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:26 smithi038 ceph-mon[34225]: pgmap v656: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:35:29.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:28 smithi038 ceph-mon[34225]: pgmap v657: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T23:35:29.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:28 smithi194 ceph-mon[33904]: pgmap v657: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T23:35:29.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:28 smithi003 ceph-mon[30348]: pgmap v657: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T23:35:31.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:30 smithi038 ceph-mon[34225]: pgmap v658: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:35:31.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:30 smithi194 ceph-mon[33904]: pgmap v658: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:35:31.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:30 smithi003 ceph-mon[30348]: pgmap v658: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:35:33.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:32 smithi038 ceph-mon[34225]: pgmap v659: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-10T23:35:33.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:32 smithi194 ceph-mon[33904]: pgmap v659: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-10T23:35:33.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:32 smithi003 ceph-mon[30348]: pgmap v659: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-10T23:35:35.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:34 smithi038 ceph-mon[34225]: pgmap v660: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-10T23:35:35.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:34 smithi194 ceph-mon[33904]: pgmap v660: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-10T23:35:35.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:34 smithi003 ceph-mon[30348]: pgmap v660: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-10T23:35:37.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:36 smithi038 ceph-mon[34225]: pgmap v661: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:35:37.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:36 smithi194 ceph-mon[33904]: pgmap v661: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:35:37.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:36 smithi003 ceph-mon[30348]: pgmap v661: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:35:39.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:38 smithi038 ceph-mon[34225]: pgmap v662: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:35:39.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:38 smithi194 ceph-mon[33904]: pgmap v662: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:35:39.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:38 smithi003 ceph-mon[30348]: pgmap v662: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:35:41.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:40 smithi038 ceph-mon[34225]: pgmap v663: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:35:41.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:40 smithi194 ceph-mon[33904]: pgmap v663: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:35:41.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:40 smithi003 ceph-mon[30348]: pgmap v663: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:35:42.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:41 smithi038 ceph-mon[34225]: pgmap v664: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:35:42.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:41 smithi194 ceph-mon[33904]: pgmap v664: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:35:42.220 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:41 smithi003 ceph-mon[30348]: pgmap v664: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:35:44.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:44 smithi038 ceph-mon[34225]: pgmap v665: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:35:44.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:44 smithi194 ceph-mon[33904]: pgmap v665: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:35:44.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:44 smithi003 ceph-mon[30348]: pgmap v665: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:35:46.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:46 smithi038 ceph-mon[34225]: pgmap v666: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:35:46.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:46 smithi194 ceph-mon[33904]: pgmap v666: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:35:46.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:46 smithi003 ceph-mon[30348]: pgmap v666: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:35:48.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:48 smithi038 ceph-mon[34225]: pgmap v667: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:35:48.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:48 smithi194 ceph-mon[33904]: pgmap v667: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:35:48.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:48 smithi003 ceph-mon[30348]: pgmap v667: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:35:50.348 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:50 smithi038 ceph-mon[34225]: pgmap v668: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:35:50.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:50 smithi194 ceph-mon[33904]: pgmap v668: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:35:50.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:50 smithi003 ceph-mon[30348]: pgmap v668: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:35:52.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:52 smithi038 ceph-mon[34225]: pgmap v669: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:35:52.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:52 smithi194 ceph-mon[33904]: pgmap v669: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:35:52.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:52 smithi003 ceph-mon[30348]: pgmap v669: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:35:54.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:54 smithi038 ceph-mon[34225]: pgmap v670: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:35:54.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:54 smithi194 ceph-mon[33904]: pgmap v670: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:35:54.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:54 smithi003 ceph-mon[30348]: pgmap v670: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:35:56.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:56 smithi038 ceph-mon[34225]: pgmap v671: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:35:56.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:56 smithi194 ceph-mon[33904]: pgmap v671: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:35:56.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:56 smithi003 ceph-mon[30348]: pgmap v671: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:35:58.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:35:58 smithi038 ceph-mon[34225]: pgmap v672: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:35:58.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:35:58 smithi194 ceph-mon[33904]: pgmap v672: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:35:58.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:35:58 smithi003 ceph-mon[30348]: pgmap v672: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:36:00.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:00 smithi038 ceph-mon[34225]: pgmap v673: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:36:00.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:00 smithi194 ceph-mon[33904]: pgmap v673: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:36:00.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:00 smithi003 ceph-mon[30348]: pgmap v673: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:36:02.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:02 smithi038 ceph-mon[34225]: pgmap v674: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:36:02.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:02 smithi194 ceph-mon[33904]: pgmap v674: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:36:02.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:02 smithi003 ceph-mon[30348]: pgmap v674: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:36:04.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:04 smithi038 ceph-mon[34225]: pgmap v675: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-10T23:36:04.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:04 smithi194 ceph-mon[33904]: pgmap v675: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-10T23:36:04.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:04 smithi003 ceph-mon[30348]: pgmap v675: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-10T23:36:06.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:06 smithi038 ceph-mon[34225]: pgmap v676: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:36:06.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:06 smithi194 ceph-mon[33904]: pgmap v676: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:36:06.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:06 smithi003 ceph-mon[30348]: pgmap v676: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:36:08.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:08 smithi038 ceph-mon[34225]: pgmap v677: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:36:08.448 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:08 smithi194 ceph-mon[33904]: pgmap v677: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:36:08.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:08 smithi003 ceph-mon[30348]: pgmap v677: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:36:10.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:10 smithi038 ceph-mon[34225]: pgmap v678: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:36:10.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:10 smithi194 ceph-mon[33904]: pgmap v678: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:36:10.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:10 smithi003 ceph-mon[30348]: pgmap v678: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:36:12.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:12 smithi194 ceph-mon[33904]: pgmap v679: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:36:12.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:12 smithi194 ceph-mon[33904]: osdmap e97: 12 total, 12 up, 12 in 2024-09-10T23:36:12.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:12 smithi003 ceph-mon[30348]: pgmap v679: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:36:12.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:12 smithi003 ceph-mon[30348]: osdmap e97: 12 total, 12 up, 12 in 2024-09-10T23:36:12.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:12 smithi038 ceph-mon[34225]: pgmap v679: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:36:12.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:12 smithi038 ceph-mon[34225]: osdmap e97: 12 total, 12 up, 12 in 2024-09-10T23:36:13.447 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:13 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:36:13.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:13 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:36:13.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:13 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:36:14.572 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:14 smithi003 ceph-mon[30348]: pgmap v681: 129 pgs: 7 active+clean+snaptrim_wait, 122 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:36:14.572 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:14 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:14.572 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:14 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:14.572 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:14 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:14.572 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:14 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:14.572 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:14 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:14.572 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:14 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:14.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:14 smithi038 ceph-mon[34225]: pgmap v681: 129 pgs: 7 active+clean+snaptrim_wait, 122 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:36:14.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:14 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:14.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:14 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:14.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:14 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:14.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:14 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:14.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:14 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:14.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:14 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:14.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:14 smithi194 ceph-mon[33904]: pgmap v681: 129 pgs: 7 active+clean+snaptrim_wait, 122 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:36:14.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:14 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:14.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:14 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:14.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:14 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:14.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:14 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:14.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:14 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:14.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:14 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:16.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:16 smithi038 ceph-mon[34225]: pgmap v682: 129 pgs: 7 active+clean+snaptrim_wait, 122 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:36:16.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:16 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:16.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:16 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:16.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:16 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:16.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:16 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:16.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:16 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:16.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:16 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:16.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:16 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:16.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:16 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:36:16.598 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:16 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:16.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:16 smithi194 ceph-mon[33904]: pgmap v682: 129 pgs: 7 active+clean+snaptrim_wait, 122 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:36:16.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:16 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:16.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:16 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:16.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:16 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:16.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:16 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:16.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:16 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:16.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:16 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:16.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:16 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:16.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:16 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:36:16.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:16 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:16.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:16 smithi003 ceph-mon[30348]: pgmap v682: 129 pgs: 7 active+clean+snaptrim_wait, 122 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:36:16.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:16 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:16.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:16 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:16.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:16 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:16.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:16 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:16.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:16 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:16.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:16 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:16.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:16 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:16.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:16 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:36:16.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:16 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:36:18.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:18 smithi038 ceph-mon[34225]: pgmap v683: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:36:18.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:18 smithi038 ceph-mon[34225]: osdmap e98: 12 total, 12 up, 12 in 2024-09-10T23:36:18.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:18 smithi194 ceph-mon[33904]: pgmap v683: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:36:18.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:18 smithi194 ceph-mon[33904]: osdmap e98: 12 total, 12 up, 12 in 2024-09-10T23:36:18.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:18 smithi003 ceph-mon[30348]: pgmap v683: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:36:18.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:18 smithi003 ceph-mon[30348]: osdmap e98: 12 total, 12 up, 12 in 2024-09-10T23:36:20.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:20 smithi038 ceph-mon[34225]: pgmap v685: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-10T23:36:20.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:20 smithi194 ceph-mon[33904]: pgmap v685: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-10T23:36:20.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:20 smithi003 ceph-mon[30348]: pgmap v685: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-10T23:36:22.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:22 smithi038 ceph-mon[34225]: pgmap v686: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 207 B/s wr, 6 op/s 2024-09-10T23:36:22.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:22 smithi194 ceph-mon[33904]: pgmap v686: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 207 B/s wr, 6 op/s 2024-09-10T23:36:22.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:22 smithi003 ceph-mon[30348]: pgmap v686: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 207 B/s wr, 6 op/s 2024-09-10T23:36:24.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:24 smithi038 ceph-mon[34225]: pgmap v687: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:36:24.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:24 smithi194 ceph-mon[33904]: pgmap v687: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:36:24.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:24 smithi003 ceph-mon[30348]: pgmap v687: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:36:26.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:26 smithi038 ceph-mon[34225]: pgmap v688: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:36:26.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:26 smithi194 ceph-mon[33904]: pgmap v688: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:36:26.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:26 smithi003 ceph-mon[30348]: pgmap v688: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:36:28.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:28 smithi194 ceph-mon[33904]: pgmap v689: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-10T23:36:28.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:28 smithi003 ceph-mon[30348]: pgmap v689: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-10T23:36:28.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:28 smithi038 ceph-mon[34225]: pgmap v689: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-10T23:36:30.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:30 smithi003 ceph-mon[30348]: pgmap v690: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-10T23:36:30.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:30 smithi194 ceph-mon[33904]: pgmap v690: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-10T23:36:30.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:30 smithi038 ceph-mon[34225]: pgmap v690: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-10T23:36:32.650 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:32 smithi038 ceph-mon[34225]: pgmap v691: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:36:32.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:32 smithi194 ceph-mon[33904]: pgmap v691: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:36:32.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:32 smithi003 ceph-mon[30348]: pgmap v691: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:36:34.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:34 smithi194 ceph-mon[33904]: pgmap v692: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:36:34.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:34 smithi003 ceph-mon[30348]: pgmap v692: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:36:34.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:34 smithi038 ceph-mon[34225]: pgmap v692: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:36:36.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:36 smithi194 ceph-mon[33904]: pgmap v693: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:36:36.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:36 smithi003 ceph-mon[30348]: pgmap v693: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:36:36.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:36 smithi038 ceph-mon[34225]: pgmap v693: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:36:38.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:38 smithi194 ceph-mon[33904]: pgmap v694: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:36:38.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:38 smithi003 ceph-mon[30348]: pgmap v694: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:36:38.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:38 smithi038 ceph-mon[34225]: pgmap v694: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:36:40.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:40 smithi194 ceph-mon[33904]: pgmap v695: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:36:40.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:40 smithi003 ceph-mon[30348]: pgmap v695: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:36:40.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:40 smithi038 ceph-mon[34225]: pgmap v695: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:36:42.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:42 smithi194 ceph-mon[33904]: pgmap v696: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:36:42.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:42 smithi003 ceph-mon[30348]: pgmap v696: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:36:42.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:42 smithi038 ceph-mon[34225]: pgmap v696: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:36:44.072 DEBUG:teuthology.orchestra.run.smithi003:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-10T23:36:44.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.240+0000 7f277e600640 1 -- 172.21.15.3:0/3360781401 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2778102d00 msgr2=0x7f27781030e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:44.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.240+0000 7f277e600640 1 --2- 172.21.15.3:0/3360781401 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2778102d00 0x7f27781030e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2768009900 tx=0x7f276802a3f0 comp rx=0 tx=0).stop 2024-09-10T23:36:44.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.241+0000 7f277e600640 1 -- 172.21.15.3:0/3360781401 shutdown_connections 2024-09-10T23:36:44.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.241+0000 7f277e600640 1 --2- 172.21.15.3:0/3360781401 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2778109080 0x7f277810f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:44.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.241+0000 7f277e600640 1 --2- 172.21.15.3:0/3360781401 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2778108700 0x7f2778108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:44.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.241+0000 7f277e600640 1 --2- 172.21.15.3:0/3360781401 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2778102d00 0x7f27781030e0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:44.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.241+0000 7f277e600640 1 -- 172.21.15.3:0/3360781401 >> 172.21.15.3:0/3360781401 conn(0x7f27780fe720 msgr2=0x7f2778100b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:44.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.241+0000 7f277e600640 1 -- 172.21.15.3:0/3360781401 shutdown_connections 2024-09-10T23:36:44.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.241+0000 7f277e600640 1 -- 172.21.15.3:0/3360781401 wait complete. 2024-09-10T23:36:44.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.242+0000 7f277e600640 1 Processor -- start 2024-09-10T23:36:44.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.242+0000 7f277e600640 1 -- start start 2024-09-10T23:36:44.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.242+0000 7f277e600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2778102d00 0x7f277819b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:44.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.242+0000 7f277e600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2778108700 0x7f277819b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:44.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.242+0000 7f277e600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2778109080 0x7f27781a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:44.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.242+0000 7f277e600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2778112bb0 con 0x7f2778109080 2024-09-10T23:36:44.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.242+0000 7f277e600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2778112a30 con 0x7f2778108700 2024-09-10T23:36:44.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.242+0000 7f277e600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2778112d30 con 0x7f2778102d00 2024-09-10T23:36:44.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.242+0000 7f2777e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2778109080 0x7f27781a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:44.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.243+0000 7f2777400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2778102d00 0x7f277819b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:44.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.243+0000 7f2777e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2778109080 0x7f27781a0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35486/0 (socket says 172.21.15.3:35486) 2024-09-10T23:36:44.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.243+0000 7f2777e00640 1 -- 172.21.15.3:0/4285519090 learned_addr learned my addr 172.21.15.3:0/4285519090 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:36:44.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.243+0000 7f276ea00640 1 --2- 172.21.15.3:0/4285519090 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2778108700 0x7f277819b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:44.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.243+0000 7f2777e00640 1 -- 172.21.15.3:0/4285519090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2778102d00 msgr2=0x7f277819b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:44.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.243+0000 7f2777e00640 1 --2- 172.21.15.3:0/4285519090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2778102d00 0x7f277819b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:44.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.243+0000 7f2777e00640 1 -- 172.21.15.3:0/4285519090 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2778108700 msgr2=0x7f277819b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:44.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.243+0000 7f2777e00640 1 --2- 172.21.15.3:0/4285519090 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2778108700 0x7f277819b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:44.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.243+0000 7f2777e00640 1 -- 172.21.15.3:0/4285519090 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27781a1350 con 0x7f2778109080 2024-09-10T23:36:44.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.243+0000 7f276ea00640 1 --2- 172.21.15.3:0/4285519090 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2778108700 0x7f277819b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:36:44.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.243+0000 7f2777e00640 1 --2- 172.21.15.3:0/4285519090 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2778109080 0x7f27781a0b80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f277000eaa0 tx=0x7f277000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:44.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.243+0000 7f2774c00640 1 -- 172.21.15.3:0/4285519090 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277000cdb0 con 0x7f2778109080 2024-09-10T23:36:44.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.244+0000 7f277e600640 1 -- 172.21.15.3:0/4285519090 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27781a1640 con 0x7f2778109080 2024-09-10T23:36:44.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.244+0000 7f2774c00640 1 -- 172.21.15.3:0/4285519090 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2770005020 con 0x7f2778109080 2024-09-10T23:36:44.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.244+0000 7f2774c00640 1 -- 172.21.15.3:0/4285519090 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27700116d0 con 0x7f2778109080 2024-09-10T23:36:44.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.244+0000 7f277e600640 1 -- 172.21.15.3:0/4285519090 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27781a7d00 con 0x7f2778109080 2024-09-10T23:36:44.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.245+0000 7f277e600640 1 -- 172.21.15.3:0/4285519090 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27781030e0 con 0x7f2778109080 2024-09-10T23:36:44.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.247+0000 7f2774c00640 1 -- 172.21.15.3:0/4285519090 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 26) ==== 153380+0+0 (secure 0 0 0) 0x7f277000f040 con 0x7f2778109080 2024-09-10T23:36:44.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.248+0000 7f2774c00640 1 --2- 172.21.15.3:0/4285519090 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f275c0b5450 0x7f275c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:44.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.248+0000 7f2774c00640 1 -- 172.21.15.3:0/4285519090 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9490+0+0 (secure 0 0 0) 0x7f27700e6300 con 0x7f2778109080 2024-09-10T23:36:44.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.249+0000 7f2777400640 1 --2- 172.21.15.3:0/4285519090 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f275c0b5450 0x7f275c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:44.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.249+0000 7f2777400640 1 --2- 172.21.15.3:0/4285519090 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f275c0b5450 0x7f275c0b7910 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f27680057c0 tx=0x7f27680058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:44.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.252+0000 7f2774c00640 1 -- 172.21.15.3:0/4285519090 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2770016030 con 0x7f2778109080 2024-09-10T23:36:44.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.468+0000 7f277e600640 1 -- 172.21.15.3:0/4285519090 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f2778063590 con 0x7f275c0b5450 2024-09-10T23:36:44.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.478+0000 7f2774c00640 1 -- 172.21.15.3:0/4285519090 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f2778063590 con 0x7f275c0b5450 2024-09-10T23:36:44.479 INFO:teuthology.orchestra.run.smithi003.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-10T00:00:00", "created": "2024-09-10T23:26:43", "first": "2024-09-10T23:27:00", "last": "2024-09-10T23:36:00", "last_pruned": "2024-09-10T23:36:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-09-10T23:36:44.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.480+0000 7f277e600640 1 -- 172.21.15.3:0/4285519090 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f275c0b5450 msgr2=0x7f275c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:44.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.480+0000 7f277e600640 1 --2- 172.21.15.3:0/4285519090 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f275c0b5450 0x7f275c0b7910 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f27680057c0 tx=0x7f27680058d0 comp rx=0 tx=0).stop 2024-09-10T23:36:44.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.480+0000 7f277e600640 1 -- 172.21.15.3:0/4285519090 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2778109080 msgr2=0x7f27781a0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:44.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.480+0000 7f277e600640 1 --2- 172.21.15.3:0/4285519090 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2778109080 0x7f27781a0b80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f277000eaa0 tx=0x7f277000ef60 comp rx=0 tx=0).stop 2024-09-10T23:36:44.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.481+0000 7f277e600640 1 -- 172.21.15.3:0/4285519090 shutdown_connections 2024-09-10T23:36:44.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.481+0000 7f277e600640 1 --2- 172.21.15.3:0/4285519090 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f275c0b5450 0x7f275c0b7910 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:44.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.481+0000 7f277e600640 1 --2- 172.21.15.3:0/4285519090 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2778109080 0x7f27781a0b80 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:44.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.481+0000 7f277e600640 1 --2- 172.21.15.3:0/4285519090 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2778108700 0x7f277819b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:44.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.481+0000 7f277e600640 1 --2- 172.21.15.3:0/4285519090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2778102d00 0x7f277819b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:44.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.481+0000 7f277e600640 1 -- 172.21.15.3:0/4285519090 >> 172.21.15.3:0/4285519090 conn(0x7f27780fe720 msgr2=0x7f2778104cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:44.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.481+0000 7f277e600640 1 -- 172.21.15.3:0/4285519090 shutdown_connections 2024-09-10T23:36:44.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.481+0000 7f277e600640 1 -- 172.21.15.3:0/4285519090 wait complete. 2024-09-10T23:36:44.498 DEBUG:teuthology.orchestra.run.smithi003:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-10T23:36:44.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.653+0000 7f4379a00640 1 -- 172.21.15.3:0/3032194356 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f43740754e0 msgr2=0x7f43740758c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:44.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.653+0000 7f4379a00640 1 --2- 172.21.15.3:0/3032194356 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f43740754e0 0x7f43740758c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4364009900 tx=0x7f436402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:36:44.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.654+0000 7f4379a00640 1 -- 172.21.15.3:0/3032194356 shutdown_connections 2024-09-10T23:36:44.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.654+0000 7f4379a00640 1 --2- 172.21.15.3:0/3032194356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f437410f2e0 0x7f43741116d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:44.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.654+0000 7f4379a00640 1 --2- 172.21.15.3:0/3032194356 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4374075e00 0x7f437410eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:44.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.654+0000 7f4379a00640 1 --2- 172.21.15.3:0/3032194356 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f43740754e0 0x7f43740758c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:44.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.654+0000 7f4379a00640 1 -- 172.21.15.3:0/3032194356 >> 172.21.15.3:0/3032194356 conn(0x7f43740fe720 msgr2=0x7f4374100b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:44.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.654+0000 7f4379a00640 1 -- 172.21.15.3:0/3032194356 shutdown_connections 2024-09-10T23:36:44.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.654+0000 7f4379a00640 1 -- 172.21.15.3:0/3032194356 wait complete. 2024-09-10T23:36:44.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.655+0000 7f4379a00640 1 Processor -- start 2024-09-10T23:36:44.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.655+0000 7f4379a00640 1 -- start start 2024-09-10T23:36:44.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.655+0000 7f4379a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43740754e0 0x7f437419b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:44.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.655+0000 7f4379a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4374075e00 0x7f437419b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:44.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.655+0000 7f4379a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f437410f2e0 0x7f43741a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:44.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.655+0000 7f4379a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f4374114dc0 con 0x7f437410f2e0 2024-09-10T23:36:44.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.655+0000 7f4379a00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4374114c40 con 0x7f43740754e0 2024-09-10T23:36:44.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.655+0000 7f4379a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4374114f40 con 0x7f4374075e00 2024-09-10T23:36:44.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.655+0000 7f4373400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f437410f2e0 0x7f43741a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:44.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.655+0000 7f4372a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43740754e0 0x7f437419b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:44.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.655+0000 7f4373400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f437410f2e0 0x7f43741a0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35502/0 (socket says 172.21.15.3:35502) 2024-09-10T23:36:44.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.655+0000 7f4373400640 1 -- 172.21.15.3:0/121387206 learned_addr learned my addr 172.21.15.3:0/121387206 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:36:44.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.656+0000 7f436a000640 1 --2- 172.21.15.3:0/121387206 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4374075e00 0x7f437419b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:44.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.656+0000 7f4373400640 1 -- 172.21.15.3:0/121387206 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4374075e00 msgr2=0x7f437419b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:44.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.656+0000 7f4373400640 1 --2- 172.21.15.3:0/121387206 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4374075e00 0x7f437419b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:44.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.656+0000 7f4373400640 1 -- 172.21.15.3:0/121387206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43740754e0 msgr2=0x7f437419b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:44.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.656+0000 7f4373400640 1 --2- 172.21.15.3:0/121387206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43740754e0 0x7f437419b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:44.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.656+0000 7f4373400640 1 -- 172.21.15.3:0/121387206 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43741a1360 con 0x7f437410f2e0 2024-09-10T23:36:44.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.656+0000 7f436a000640 1 --2- 172.21.15.3:0/121387206 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4374075e00 0x7f437419b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:36:44.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.656+0000 7f4373400640 1 --2- 172.21.15.3:0/121387206 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f437410f2e0 0x7f43741a0b90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f436c00cce0 tx=0x7f436c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:44.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.656+0000 7f436be00640 1 -- 172.21.15.3:0/121387206 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f436c00f450 con 0x7f437410f2e0 2024-09-10T23:36:44.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.656+0000 7f436be00640 1 -- 172.21.15.3:0/121387206 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f436c00fa80 con 0x7f437410f2e0 2024-09-10T23:36:44.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.656+0000 7f436be00640 1 -- 172.21.15.3:0/121387206 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f436c018ad0 con 0x7f437410f2e0 2024-09-10T23:36:44.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.656+0000 7f4379a00640 1 -- 172.21.15.3:0/121387206 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43741a1650 con 0x7f437410f2e0 2024-09-10T23:36:44.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.657+0000 7f4379a00640 1 -- 172.21.15.3:0/121387206 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43741a7d10 con 0x7f437410f2e0 2024-09-10T23:36:44.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.658+0000 7f4379a00640 1 -- 172.21.15.3:0/121387206 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43740758c0 con 0x7f437410f2e0 2024-09-10T23:36:44.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.660+0000 7f436be00640 1 -- 172.21.15.3:0/121387206 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 26) ==== 153380+0+0 (secure 0 0 0) 0x7f436c00f5f0 con 0x7f437410f2e0 2024-09-10T23:36:44.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.661+0000 7f436be00640 1 --2- 172.21.15.3:0/121387206 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f43580b54d0 0x7f43580b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:44.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.662+0000 7f436be00640 1 -- 172.21.15.3:0/121387206 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9490+0+0 (secure 0 0 0) 0x7f436c0e6c30 con 0x7f437410f2e0 2024-09-10T23:36:44.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.662+0000 7f4372a00640 1 --2- 172.21.15.3:0/121387206 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f43580b54d0 0x7f43580b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:44.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.662+0000 7f4372a00640 1 --2- 172.21.15.3:0/121387206 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f43580b54d0 0x7f43580b7990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4364006010 tx=0x7f4364005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:44.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.663+0000 7f436be00640 1 -- 172.21.15.3:0/121387206 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f436c014030 con 0x7f437410f2e0 2024-09-10T23:36:44.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:44 smithi194 ceph-mon[33904]: pgmap v697: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:36:44.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:44 smithi003 ceph-mon[30348]: pgmap v697: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:36:44.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:44 smithi038 ceph-mon[34225]: pgmap v697: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:36:44.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.885+0000 7f4379a00640 1 -- 172.21.15.3:0/121387206 --> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f4374100330 con 0x7f43580b54d0 2024-09-10T23:36:44.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.893+0000 7f436be00640 1 -- 172.21.15.3:0/121387206 <== mgr.14223 v2:172.21.15.3:6800/536493997 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f4374100330 con 0x7f43580b54d0 2024-09-10T23:36:44.894 INFO:teuthology.orchestra.run.smithi003.stdout:/ 1m 6m3h 2024-09-10T23:36:44.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.896+0000 7f4379a00640 1 -- 172.21.15.3:0/121387206 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f43580b54d0 msgr2=0x7f43580b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:44.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.896+0000 7f4379a00640 1 --2- 172.21.15.3:0/121387206 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f43580b54d0 0x7f43580b7990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4364006010 tx=0x7f4364005e80 comp rx=0 tx=0).stop 2024-09-10T23:36:44.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.896+0000 7f4379a00640 1 -- 172.21.15.3:0/121387206 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f437410f2e0 msgr2=0x7f43741a0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:44.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.896+0000 7f4379a00640 1 --2- 172.21.15.3:0/121387206 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f437410f2e0 0x7f43741a0b90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f436c00cce0 tx=0x7f436c00a620 comp rx=0 tx=0).stop 2024-09-10T23:36:44.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.896+0000 7f4379a00640 1 -- 172.21.15.3:0/121387206 shutdown_connections 2024-09-10T23:36:44.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.896+0000 7f4379a00640 1 --2- 172.21.15.3:0/121387206 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f43580b54d0 0x7f43580b7990 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:44.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.896+0000 7f4379a00640 1 --2- 172.21.15.3:0/121387206 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f437410f2e0 0x7f43741a0b90 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:44.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.896+0000 7f4379a00640 1 --2- 172.21.15.3:0/121387206 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4374075e00 0x7f437419b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:44.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.896+0000 7f4379a00640 1 --2- 172.21.15.3:0/121387206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43740754e0 0x7f437419b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:44.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.896+0000 7f4379a00640 1 -- 172.21.15.3:0/121387206 >> 172.21.15.3:0/121387206 conn(0x7f43740fe720 msgr2=0x7f43741114b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:44.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.896+0000 7f4379a00640 1 -- 172.21.15.3:0/121387206 shutdown_connections 2024-09-10T23:36:44.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:44.896+0000 7f4379a00640 1 -- 172.21.15.3:0/121387206 wait complete. 2024-09-10T23:36:44.913 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-10T23:36:44.927 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:36:45.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.084+0000 7f0105a00640 1 -- 172.21.15.3:0/1322835653 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0100102bc0 msgr2=0x7f0100102fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:45.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.084+0000 7f0105a00640 1 --2- 172.21.15.3:0/1322835653 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0100102bc0 0x7f0100102fa0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f00f0009900 tx=0x7f00f002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:36:45.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.084+0000 7f0105a00640 1 -- 172.21.15.3:0/1322835653 shutdown_connections 2024-09-10T23:36:45.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.084+0000 7f0105a00640 1 --2- 172.21.15.3:0/1322835653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0100108f40 0x7f010010f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:45.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.084+0000 7f0105a00640 1 --2- 172.21.15.3:0/1322835653 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01001085c0 0x7f0100108a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:45.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.084+0000 7f0105a00640 1 --2- 172.21.15.3:0/1322835653 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0100102bc0 0x7f0100102fa0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:45.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.084+0000 7f0105a00640 1 -- 172.21.15.3:0/1322835653 >> 172.21.15.3:0/1322835653 conn(0x7f01000fe600 msgr2=0x7f0100100a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:45.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.084+0000 7f0105a00640 1 -- 172.21.15.3:0/1322835653 shutdown_connections 2024-09-10T23:36:45.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.084+0000 7f0105a00640 1 -- 172.21.15.3:0/1322835653 wait complete. 2024-09-10T23:36:45.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.085+0000 7f0105a00640 1 Processor -- start 2024-09-10T23:36:45.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.085+0000 7f0105a00640 1 -- start start 2024-09-10T23:36:45.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.086+0000 7f0105a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0100102bc0 0x7f010019b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:45.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.086+0000 7f0105a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01001085c0 0x7f010019b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:45.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.086+0000 7f0105a00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0100108f40 0x7f01001a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:45.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.086+0000 7f0105a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0100112ab0 con 0x7f0100102bc0 2024-09-10T23:36:45.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.086+0000 7f0105a00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0100112930 con 0x7f0100108f40 2024-09-10T23:36:45.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.086+0000 7f0105a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0100112c30 con 0x7f01001085c0 2024-09-10T23:36:45.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.086+0000 7f00ffe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0100102bc0 0x7f010019b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:45.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.086+0000 7f00ffe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0100102bc0 0x7f010019b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35526/0 (socket says 172.21.15.3:35526) 2024-09-10T23:36:45.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.086+0000 7f00ffe00640 1 -- 172.21.15.3:0/2759369455 learned_addr learned my addr 172.21.15.3:0/2759369455 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:36:45.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.086+0000 7f00f7e00640 1 --2- 172.21.15.3:0/2759369455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01001085c0 0x7f010019b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:45.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.086+0000 7f0105000640 1 --2- 172.21.15.3:0/2759369455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0100108f40 0x7f01001a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:45.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.086+0000 7f00ffe00640 1 -- 172.21.15.3:0/2759369455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01001085c0 msgr2=0x7f010019b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:45.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.086+0000 7f00ffe00640 1 --2- 172.21.15.3:0/2759369455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01001085c0 0x7f010019b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:45.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.086+0000 7f00ffe00640 1 -- 172.21.15.3:0/2759369455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0100108f40 msgr2=0x7f01001a0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:45.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.086+0000 7f00ffe00640 1 --2- 172.21.15.3:0/2759369455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0100108f40 0x7f01001a0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:45.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.086+0000 7f00ffe00640 1 -- 172.21.15.3:0/2759369455 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01001a12d0 con 0x7f0100102bc0 2024-09-10T23:36:45.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.087+0000 7f00ffe00640 1 --2- 172.21.15.3:0/2759369455 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0100102bc0 0x7f010019b230 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f00f0009230 tx=0x7f00f0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:45.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.087+0000 7f00fd600640 1 -- 172.21.15.3:0/2759369455 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f003f030 con 0x7f0100102bc0 2024-09-10T23:36:45.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.087+0000 7f00fd600640 1 -- 172.21.15.3:0/2759369455 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00f0003a80 con 0x7f0100102bc0 2024-09-10T23:36:45.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.087+0000 7f00fd600640 1 -- 172.21.15.3:0/2759369455 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f0035070 con 0x7f0100102bc0 2024-09-10T23:36:45.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.087+0000 7f0105a00640 1 -- 172.21.15.3:0/2759369455 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01001a1560 con 0x7f0100102bc0 2024-09-10T23:36:45.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.087+0000 7f0105a00640 1 -- 172.21.15.3:0/2759369455 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01001a7c80 con 0x7f0100102bc0 2024-09-10T23:36:45.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.088+0000 7f0105a00640 1 -- 172.21.15.3:0/2759369455 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0100102fa0 con 0x7f0100102bc0 2024-09-10T23:36:45.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.090+0000 7f00fd600640 1 -- 172.21.15.3:0/2759369455 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 26) ==== 153380+0+0 (secure 0 0 0) 0x7f00f003bb90 con 0x7f0100102bc0 2024-09-10T23:36:45.093 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.092+0000 7f00fd600640 1 --2- 172.21.15.3:0/2759369455 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f00e40b54d0 0x7f00e40b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:45.093 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.092+0000 7f00fd600640 1 -- 172.21.15.3:0/2759369455 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9490+0+0 (secure 0 0 0) 0x7f00f0107120 con 0x7f0100102bc0 2024-09-10T23:36:45.093 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.092+0000 7f00f7e00640 1 --2- 172.21.15.3:0/2759369455 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f00e40b54d0 0x7f00e40b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:45.093 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.093+0000 7f00f7e00640 1 --2- 172.21.15.3:0/2759369455 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f00e40b54d0 0x7f00e40b7990 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0100101a80 tx=0x7f00e8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:45.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.093+0000 7f00fd600640 1 -- 172.21.15.3:0/2759369455 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f00f00cd8d0 con 0x7f0100102bc0 2024-09-10T23:36:45.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.289+0000 7f0105a00640 1 -- 172.21.15.3:0/2759369455 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01001a7f80 con 0x7f0100102bc0 2024-09-10T23:36:45.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.290+0000 7f00fd600640 1 -- 172.21.15.3:0/2759369455 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) ==== 74+0+25293 (secure 0 0 0) 0x7f00f00cd1d0 con 0x7f0100102bc0 2024-09-10T23:36:45.292 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:36:45.292 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":98,"fsid":"3f4e30d0-6fca-11ef-bcea-c7b262605968","created":"2024-09-10T23:14:12.377466+0000","modified":"2024-09-10T23:36:18.311016+0000","last_up_change":"2024-09-10T23:22:54.895554+0000","last_in_change":"2024-09-10T23:22:29.701108+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:18:27.131879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:23:53.689954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:23:55.864693+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":97,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:24:03.869094+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":97,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a38330ed-a85b-4e61-b373-dd8f1d5f7ba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6803","nonce":824467747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6805","nonce":824467747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6809","nonce":824467747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6807","nonce":824467747}]},"public_addr":"172.21.15.3:6803/824467747","cluster_addr":"172.21.15.3:6805/824467747","heartbeat_back_addr":"172.21.15.3:6809/824467747","heartbeat_front_addr":"172.21.15.3:6807/824467747","state":["exists","up"]},{"osd":1,"uuid":"49bb1212-a83e-4f85-ad71-d863880d8268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6801","nonce":1447444485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6803","nonce":1447444485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6807","nonce":1447444485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6805","nonce":1447444485}]},"public_addr":"172.21.15.38:6801/1447444485","cluster_addr":"172.21.15.38:6803/1447444485","heartbeat_back_addr":"172.21.15.38:6807/1447444485","heartbeat_front_addr":"172.21.15.38:6805/1447444485","state":["exists","up"]},{"osd":2,"uuid":"ea53eb27-e7fa-4783-9a53-8b44b4e293ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6801","nonce":3191263316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6803","nonce":3191263316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6807","nonce":3191263316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6805","nonce":3191263316}]},"public_addr":"172.21.15.194:6801/3191263316","cluster_addr":"172.21.15.194:6803/3191263316","heartbeat_back_addr":"172.21.15.194:6807/3191263316","heartbeat_front_addr":"172.21.15.194:6805/3191263316","state":["exists","up"]},{"osd":3,"uuid":"75067769-7be5-4a99-9e02-f7735b2e69c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6811","nonce":2061990952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6813","nonce":2061990952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6817","nonce":2061990952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6815","nonce":2061990952}]},"public_addr":"172.21.15.3:6811/2061990952","cluster_addr":"172.21.15.3:6813/2061990952","heartbeat_back_addr":"172.21.15.3:6817/2061990952","heartbeat_front_addr":"172.21.15.3:6815/2061990952","state":["exists","up"]},{"osd":4,"uuid":"872e90ca-b711-4206-b586-e7fa41122199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6809","nonce":413294160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6811","nonce":413294160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6815","nonce":413294160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6813","nonce":413294160}]},"public_addr":"172.21.15.38:6809/413294160","cluster_addr":"172.21.15.38:6811/413294160","heartbeat_back_addr":"172.21.15.38:6815/413294160","heartbeat_front_addr":"172.21.15.38:6813/413294160","state":["exists","up"]},{"osd":5,"uuid":"2cfa107c-6dae-4c26-9e29-8175b1237b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6809","nonce":4117812658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6811","nonce":4117812658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6815","nonce":4117812658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6813","nonce":4117812658}]},"public_addr":"172.21.15.194:6809/4117812658","cluster_addr":"172.21.15.194:6811/4117812658","heartbeat_back_addr":"172.21.15.194:6815/4117812658","heartbeat_front_addr":"172.21.15.194:6813/4117812658","state":["exists","up"]},{"osd":6,"uuid":"d2e4e309-c587-4725-a5b3-cbc7b1226750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6819","nonce":3470543721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6821","nonce":3470543721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6825","nonce":3470543721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6823","nonce":3470543721}]},"public_addr":"172.21.15.3:6819/3470543721","cluster_addr":"172.21.15.3:6821/3470543721","heartbeat_back_addr":"172.21.15.3:6825/3470543721","heartbeat_front_addr":"172.21.15.3:6823/3470543721","state":["exists","up"]},{"osd":7,"uuid":"46ecaec5-29da-4e1d-ac2f-42bbbd77e949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6817","nonce":2054203924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6819","nonce":2054203924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6823","nonce":2054203924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6821","nonce":2054203924}]},"public_addr":"172.21.15.38:6817/2054203924","cluster_addr":"172.21.15.38:6819/2054203924","heartbeat_back_addr":"172.21.15.38:6823/2054203924","heartbeat_front_addr":"172.21.15.38:6821/2054203924","state":["exists","up"]},{"osd":8,"uuid":"57fd8e43-9612-4f74-8eb2-8bdbbf7c0417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6817","nonce":170051722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6819","nonce":170051722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6823","nonce":170051722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6821","nonce":170051722}]},"public_addr":"172.21.15.194:6817/170051722","cluster_addr":"172.21.15.194:6819/170051722","heartbeat_back_addr":"172.21.15.194:6823/170051722","heartbeat_front_addr":"172.21.15.194:6821/170051722","state":["exists","up"]},{"osd":9,"uuid":"aeaaf23b-d2e2-4e30-9a49-de4aaba53900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6827","nonce":3967749600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6829","nonce":3967749600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6833","nonce":3967749600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6831","nonce":3967749600}]},"public_addr":"172.21.15.3:6827/3967749600","cluster_addr":"172.21.15.3:6829/3967749600","heartbeat_back_addr":"172.21.15.3:6833/3967749600","heartbeat_front_addr":"172.21.15.3:6831/3967749600","state":["exists","up"]},{"osd":10,"uuid":"b0ece81b-1c5b-40da-b579-fb99bacb005d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6825","nonce":1671957178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6827","nonce":1671957178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6831","nonce":1671957178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6829","nonce":1671957178}]},"public_addr":"172.21.15.38:6825/1671957178","cluster_addr":"172.21.15.38:6827/1671957178","heartbeat_back_addr":"172.21.15.38:6831/1671957178","heartbeat_front_addr":"172.21.15.38:6829/1671957178","state":["exists","up"]},{"osd":11,"uuid":"a0036526-54bf-4e8b-95cc-e7b75725961c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6825","nonce":1048859686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6827","nonce":1048859686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6831","nonce":1048859686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6829","nonce":1048859686}]},"public_addr":"172.21.15.194:6825/1048859686","cluster_addr":"172.21.15.194:6827/1048859686","heartbeat_back_addr":"172.21.15.194:6831/1048859686","heartbeat_front_addr":"172.21.15.194:6829/1048859686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:27.013354+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:56.609046+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:24.878988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:55.218204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:25.224770+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:54.614336+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:25.385483+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:55.317137+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:25.064825+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:54.655361+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:22:24.080027+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:22:52.886412+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":4,"to":6},{"from":5,"to":9}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.3:0/776988825":"2024-09-11T23:16:20.647314+0000","172.21.15.3:0/2965090335":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/2364823868":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/3186881356":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/911991463":"2024-09-11T23:16:20.647314+0000","172.21.15.3:6800/2582365069":"2024-09-11T23:14:37.169991+0000","172.21.15.3:6801/2582365069":"2024-09-11T23:14:37.169991+0000","172.21.15.3:6801/1528153492":"2024-09-11T23:15:05.835734+0000","172.21.15.3:6800/1924113958":"2024-09-11T23:16:20.647314+0000","172.21.15.3:0/554479543":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/4238683346":"2024-09-11T23:15:05.835734+0000","172.21.15.3:6800/1528153492":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/285471483":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/1249510760":"2024-09-11T23:16:20.647314+0000","172.21.15.3:6801/1924113958":"2024-09-11T23:16:20.647314+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]},{"pool":4,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:36:45.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.293+0000 7f0105a00640 1 -- 172.21.15.3:0/2759369455 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f00e40b54d0 msgr2=0x7f00e40b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:45.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.293+0000 7f0105a00640 1 --2- 172.21.15.3:0/2759369455 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f00e40b54d0 0x7f00e40b7990 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0100101a80 tx=0x7f00e8005f90 comp rx=0 tx=0).stop 2024-09-10T23:36:45.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.293+0000 7f0105a00640 1 -- 172.21.15.3:0/2759369455 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0100102bc0 msgr2=0x7f010019b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:45.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.293+0000 7f0105a00640 1 --2- 172.21.15.3:0/2759369455 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0100102bc0 0x7f010019b230 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f00f0009230 tx=0x7f00f0004270 comp rx=0 tx=0).stop 2024-09-10T23:36:45.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.293+0000 7f0105a00640 1 -- 172.21.15.3:0/2759369455 shutdown_connections 2024-09-10T23:36:45.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.293+0000 7f0105a00640 1 --2- 172.21.15.3:0/2759369455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0100108f40 0x7f01001a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:45.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.293+0000 7f0105a00640 1 --2- 172.21.15.3:0/2759369455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01001085c0 0x7f010019b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:45.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.293+0000 7f0105a00640 1 --2- 172.21.15.3:0/2759369455 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f00e40b54d0 0x7f00e40b7990 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:45.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.293+0000 7f0105a00640 1 --2- 172.21.15.3:0/2759369455 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0100102bc0 0x7f010019b230 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:45.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.293+0000 7f0105a00640 1 -- 172.21.15.3:0/2759369455 >> 172.21.15.3:0/2759369455 conn(0x7f01000fe600 msgr2=0x7f01000ffda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:45.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.293+0000 7f0105a00640 1 -- 172.21.15.3:0/2759369455 shutdown_connections 2024-09-10T23:36:45.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.293+0000 7f0105a00640 1 -- 172.21.15.3:0/2759369455 wait complete. 2024-09-10T23:36:45.311 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:18:27.131879+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-10T23:23:53.689954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-10T23:23:55.864693+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 97, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-10T23:24:03.869094+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 97, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-10T23:36:45.311 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T23:36:45.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.473+0000 7ffb1b600640 1 -- 172.21.15.3:0/2185331241 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb14109050 msgr2=0x7ffb1410f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:45.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.473+0000 7ffb1b600640 1 --2- 172.21.15.3:0/2185331241 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb14109050 0x7ffb1410f850 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c009ca0 tx=0x7ffb0c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:36:45.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.473+0000 7ffb1b600640 1 -- 172.21.15.3:0/2185331241 shutdown_connections 2024-09-10T23:36:45.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.473+0000 7ffb1b600640 1 --2- 172.21.15.3:0/2185331241 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb14109050 0x7ffb1410f850 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:45.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.473+0000 7ffb1b600640 1 --2- 172.21.15.3:0/2185331241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb141086d0 0x7ffb14108b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:45.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.473+0000 7ffb1b600640 1 --2- 172.21.15.3:0/2185331241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb14102cd0 0x7ffb141030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:45.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.473+0000 7ffb1b600640 1 -- 172.21.15.3:0/2185331241 >> 172.21.15.3:0/2185331241 conn(0x7ffb140fe730 msgr2=0x7ffb14100b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:45.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.473+0000 7ffb1b600640 1 -- 172.21.15.3:0/2185331241 shutdown_connections 2024-09-10T23:36:45.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.473+0000 7ffb1b600640 1 -- 172.21.15.3:0/2185331241 wait complete. 2024-09-10T23:36:45.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.474+0000 7ffb1b600640 1 Processor -- start 2024-09-10T23:36:45.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.474+0000 7ffb1b600640 1 -- start start 2024-09-10T23:36:45.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.474+0000 7ffb1b600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb14102cd0 0x7ffb1419b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:45.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.474+0000 7ffb1b600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb141086d0 0x7ffb1419b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:45.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.474+0000 7ffb1b600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb14109050 0x7ffb141a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:45.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.474+0000 7ffb1b600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ffb14112bd0 con 0x7ffb141086d0 2024-09-10T23:36:45.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.474+0000 7ffb1b600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ffb14112a50 con 0x7ffb14109050 2024-09-10T23:36:45.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.474+0000 7ffb1b600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ffb14112d50 con 0x7ffb14102cd0 2024-09-10T23:36:45.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.474+0000 7ffb0be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb141086d0 0x7ffb1419b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:45.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.474+0000 7ffb0be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb141086d0 0x7ffb1419b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35532/0 (socket says 172.21.15.3:35532) 2024-09-10T23:36:45.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.474+0000 7ffb0be00640 1 -- 172.21.15.3:0/1938369397 learned_addr learned my addr 172.21.15.3:0/1938369397 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:36:45.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.475+0000 7ffb18c00640 1 --2- 172.21.15.3:0/1938369397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb14102cd0 0x7ffb1419b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:45.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.475+0000 7ffb19600640 1 --2- 172.21.15.3:0/1938369397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb14109050 0x7ffb141a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:45.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.475+0000 7ffb0be00640 1 -- 172.21.15.3:0/1938369397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb14102cd0 msgr2=0x7ffb1419b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:45.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.475+0000 7ffb0be00640 1 --2- 172.21.15.3:0/1938369397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb14102cd0 0x7ffb1419b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:45.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.475+0000 7ffb0be00640 1 -- 172.21.15.3:0/1938369397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb14109050 msgr2=0x7ffb141a0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:45.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.475+0000 7ffb0be00640 1 --2- 172.21.15.3:0/1938369397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb14109050 0x7ffb141a0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:45.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.475+0000 7ffb0be00640 1 -- 172.21.15.3:0/1938369397 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb141a1360 con 0x7ffb141086d0 2024-09-10T23:36:45.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.475+0000 7ffb19600640 1 --2- 172.21.15.3:0/1938369397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb14109050 0x7ffb141a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:36:45.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.475+0000 7ffb0be00640 1 --2- 172.21.15.3:0/1938369397 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb141086d0 0x7ffb1419b800 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ffafc00d950 tx=0x7ffafc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:45.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.475+0000 7ffb12000640 1 -- 172.21.15.3:0/1938369397 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffafc017070 con 0x7ffb141086d0 2024-09-10T23:36:45.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.475+0000 7ffb12000640 1 -- 172.21.15.3:0/1938369397 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffafc009c30 con 0x7ffb141086d0 2024-09-10T23:36:45.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.475+0000 7ffb12000640 1 -- 172.21.15.3:0/1938369397 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffafc00f620 con 0x7ffb141086d0 2024-09-10T23:36:45.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.475+0000 7ffb1b600640 1 -- 172.21.15.3:0/1938369397 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb141a1650 con 0x7ffb141086d0 2024-09-10T23:36:45.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.476+0000 7ffb1b600640 1 -- 172.21.15.3:0/1938369397 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb141a7d10 con 0x7ffb141086d0 2024-09-10T23:36:45.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.477+0000 7ffb1b600640 1 -- 172.21.15.3:0/1938369397 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb141030b0 con 0x7ffb141086d0 2024-09-10T23:36:45.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.479+0000 7ffb12000640 1 -- 172.21.15.3:0/1938369397 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 26) ==== 153380+0+0 (secure 0 0 0) 0x7ffafc010460 con 0x7ffb141086d0 2024-09-10T23:36:45.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.480+0000 7ffb12000640 1 --2- 172.21.15.3:0/1938369397 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ffaf80b54d0 0x7ffaf80b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:45.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.480+0000 7ffb12000640 1 -- 172.21.15.3:0/1938369397 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9490+0+0 (secure 0 0 0) 0x7ffafc0e5fd0 con 0x7ffb141086d0 2024-09-10T23:36:45.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.480+0000 7ffb18c00640 1 --2- 172.21.15.3:0/1938369397 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ffaf80b54d0 0x7ffaf80b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:45.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.481+0000 7ffb18c00640 1 --2- 172.21.15.3:0/1938369397 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ffaf80b54d0 0x7ffaf80b7990 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ffb04009bd0 tx=0x7ffb04005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:45.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.483+0000 7ffb12000640 1 -- 172.21.15.3:0/1938369397 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ffafc0ac720 con 0x7ffb141086d0 2024-09-10T23:36:45.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:45 smithi194 ceph-mon[33904]: from='client.15798 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:36:45.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:45 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2759369455' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:36:45.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.710+0000 7ffb1b600640 1 -- 172.21.15.3:0/1938369397 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ffb141a8160 con 0x7ffb141086d0 2024-09-10T23:36:45.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.710+0000 7ffb12000640 1 -- 172.21.15.3:0/1938369397 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) ==== 93+0+10 (secure 0 0 0) 0x7ffafc009de0 con 0x7ffb141086d0 2024-09-10T23:36:45.711 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2024-09-10T23:36:45.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.713+0000 7ffb1b600640 1 -- 172.21.15.3:0/1938369397 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ffaf80b54d0 msgr2=0x7ffaf80b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:45.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.713+0000 7ffb1b600640 1 --2- 172.21.15.3:0/1938369397 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ffaf80b54d0 0x7ffaf80b7990 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ffb04009bd0 tx=0x7ffb04005f90 comp rx=0 tx=0).stop 2024-09-10T23:36:45.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.713+0000 7ffb1b600640 1 -- 172.21.15.3:0/1938369397 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb141086d0 msgr2=0x7ffb1419b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:45.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.713+0000 7ffb1b600640 1 --2- 172.21.15.3:0/1938369397 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb141086d0 0x7ffb1419b800 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ffafc00d950 tx=0x7ffafc00de10 comp rx=0 tx=0).stop 2024-09-10T23:36:45.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.713+0000 7ffb1b600640 1 -- 172.21.15.3:0/1938369397 shutdown_connections 2024-09-10T23:36:45.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.713+0000 7ffb1b600640 1 --2- 172.21.15.3:0/1938369397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb14109050 0x7ffb141a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:45.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.713+0000 7ffb1b600640 1 --2- 172.21.15.3:0/1938369397 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7ffaf80b54d0 0x7ffaf80b7990 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:45.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.713+0000 7ffb1b600640 1 --2- 172.21.15.3:0/1938369397 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb141086d0 0x7ffb1419b800 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:45.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.713+0000 7ffb1b600640 1 --2- 172.21.15.3:0/1938369397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb14102cd0 0x7ffb1419b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:45.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.713+0000 7ffb1b600640 1 -- 172.21.15.3:0/1938369397 >> 172.21.15.3:0/1938369397 conn(0x7ffb140fe730 msgr2=0x7ffb140753b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:45.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.713+0000 7ffb1b600640 1 -- 172.21.15.3:0/1938369397 shutdown_connections 2024-09-10T23:36:45.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.713+0000 7ffb1b600640 1 -- 172.21.15.3:0/1938369397 wait complete. 2024-09-10T23:36:45.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:45 smithi003 ceph-mon[30348]: from='client.15798 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:36:45.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:45 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2759369455' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:36:45.729 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-10T23:36:45.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:45 smithi038 ceph-mon[34225]: from='client.15798 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:36:45.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:45 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2759369455' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:36:45.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.893+0000 7f4887200640 1 -- 172.21.15.3:0/1175943215 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4880104f10 msgr2=0x7f48801052f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:45.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.893+0000 7f4887200640 1 --2- 172.21.15.3:0/1175943215 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4880104f10 0x7f48801052f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4870009900 tx=0x7f487002a410 comp rx=0 tx=0).stop 2024-09-10T23:36:45.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.893+0000 7f4887200640 1 -- 172.21.15.3:0/1175943215 shutdown_connections 2024-09-10T23:36:45.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.893+0000 7f4887200640 1 --2- 172.21.15.3:0/1175943215 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f488010b290 0x7f4880111a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:45.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.893+0000 7f4887200640 1 --2- 172.21.15.3:0/1175943215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f488010a910 0x7f488010ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:45.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.893+0000 7f4887200640 1 --2- 172.21.15.3:0/1175943215 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4880104f10 0x7f48801052f0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:45.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.893+0000 7f4887200640 1 -- 172.21.15.3:0/1175943215 >> 172.21.15.3:0/1175943215 conn(0x7f4880100910 msgr2=0x7f4880102d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:45.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.893+0000 7f4887200640 1 -- 172.21.15.3:0/1175943215 shutdown_connections 2024-09-10T23:36:45.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.893+0000 7f4887200640 1 -- 172.21.15.3:0/1175943215 wait complete. 2024-09-10T23:36:45.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.894+0000 7f4887200640 1 Processor -- start 2024-09-10T23:36:45.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.894+0000 7f4887200640 1 -- start start 2024-09-10T23:36:45.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.895+0000 7f4887200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4880104f10 0x7f488019b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:45.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.895+0000 7f4887200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f488010a910 0x7f488019b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:45.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.895+0000 7f4887200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f488010b290 0x7f48801a0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:45.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.895+0000 7f4887200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f4880114dd0 con 0x7f488010a910 2024-09-10T23:36:45.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.895+0000 7f4887200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4880114c50 con 0x7f488010b290 2024-09-10T23:36:45.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.895+0000 7f4887200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4880114f50 con 0x7f4880104f10 2024-09-10T23:36:45.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.895+0000 7f487f400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f488010a910 0x7f488019b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:45.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.895+0000 7f487f400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f488010a910 0x7f488019b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35546/0 (socket says 172.21.15.3:35546) 2024-09-10T23:36:45.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.895+0000 7f487f400640 1 -- 172.21.15.3:0/637985198 learned_addr learned my addr 172.21.15.3:0/637985198 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:36:45.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.895+0000 7f487fe00640 1 --2- 172.21.15.3:0/637985198 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4880104f10 0x7f488019b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:45.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.895+0000 7f4885200640 1 --2- 172.21.15.3:0/637985198 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f488010b290 0x7f48801a0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:45.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.896+0000 7f487f400640 1 -- 172.21.15.3:0/637985198 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4880104f10 msgr2=0x7f488019b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:45.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.896+0000 7f487f400640 1 --2- 172.21.15.3:0/637985198 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4880104f10 0x7f488019b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:45.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.896+0000 7f487f400640 1 -- 172.21.15.3:0/637985198 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f488010b290 msgr2=0x7f48801a0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:45.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.896+0000 7f487f400640 1 --2- 172.21.15.3:0/637985198 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f488010b290 0x7f48801a0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:45.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.896+0000 7f487f400640 1 -- 172.21.15.3:0/637985198 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48801a13f0 con 0x7f488010a910 2024-09-10T23:36:45.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.896+0000 7f487f400640 1 --2- 172.21.15.3:0/637985198 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f488010a910 0x7f488019b890 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f486c00e9f0 tx=0x7f486c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:45.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.897+0000 7f487cc00640 1 -- 172.21.15.3:0/637985198 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486c00cd80 con 0x7f488010a910 2024-09-10T23:36:45.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.897+0000 7f487cc00640 1 -- 172.21.15.3:0/637985198 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f486c0054b0 con 0x7f488010a910 2024-09-10T23:36:45.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.897+0000 7f487cc00640 1 -- 172.21.15.3:0/637985198 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486c010430 con 0x7f488010a910 2024-09-10T23:36:45.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.897+0000 7f4887200640 1 -- 172.21.15.3:0/637985198 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48801a16e0 con 0x7f488010a910 2024-09-10T23:36:45.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.897+0000 7f4887200640 1 -- 172.21.15.3:0/637985198 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48801a7da0 con 0x7f488010a910 2024-09-10T23:36:45.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.898+0000 7f4887200640 1 -- 172.21.15.3:0/637985198 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48801052f0 con 0x7f488010a910 2024-09-10T23:36:45.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.900+0000 7f487cc00640 1 -- 172.21.15.3:0/637985198 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 26) ==== 153380+0+0 (secure 0 0 0) 0x7f486c005020 con 0x7f488010a910 2024-09-10T23:36:45.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.901+0000 7f487cc00640 1 --2- 172.21.15.3:0/637985198 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f48640b54d0 0x7f48640b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:45.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.902+0000 7f487cc00640 1 -- 172.21.15.3:0/637985198 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9490+0+0 (secure 0 0 0) 0x7f486c0e67b0 con 0x7f488010a910 2024-09-10T23:36:45.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.902+0000 7f487fe00640 1 --2- 172.21.15.3:0/637985198 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f48640b54d0 0x7f48640b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:45.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.902+0000 7f487fe00640 1 --2- 172.21.15.3:0/637985198 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f48640b54d0 0x7f48640b7990 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4870006010 tx=0x7f4870005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:45.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:45.905+0000 7f487cc00640 1 -- 172.21.15.3:0/637985198 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f486c0acf00 con 0x7f488010a910 2024-09-10T23:36:46.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.104+0000 7f4887200640 1 -- 172.21.15.3:0/637985198 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f488002e5c0 con 0x7f488010a910 2024-09-10T23:36:46.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.105+0000 7f487cc00640 1 -- 172.21.15.3:0/637985198 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v98) ==== 104+0+11 (secure 0 0 0) 0x7f486c0ac800 con 0x7f488010a910 2024-09-10T23:36:46.106 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2024-09-10T23:36:46.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.107+0000 7f4887200640 1 -- 172.21.15.3:0/637985198 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f48640b54d0 msgr2=0x7f48640b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:46.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.107+0000 7f4887200640 1 --2- 172.21.15.3:0/637985198 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f48640b54d0 0x7f48640b7990 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4870006010 tx=0x7f4870005e80 comp rx=0 tx=0).stop 2024-09-10T23:36:46.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.108+0000 7f4887200640 1 -- 172.21.15.3:0/637985198 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f488010a910 msgr2=0x7f488019b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:46.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.108+0000 7f4887200640 1 --2- 172.21.15.3:0/637985198 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f488010a910 0x7f488019b890 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f486c00e9f0 tx=0x7f486c00edf0 comp rx=0 tx=0).stop 2024-09-10T23:36:46.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.108+0000 7f4887200640 1 -- 172.21.15.3:0/637985198 shutdown_connections 2024-09-10T23:36:46.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.108+0000 7f4887200640 1 --2- 172.21.15.3:0/637985198 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f488010b290 0x7f48801a0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:46.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.108+0000 7f4887200640 1 --2- 172.21.15.3:0/637985198 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f48640b54d0 0x7f48640b7990 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:46.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.108+0000 7f4887200640 1 --2- 172.21.15.3:0/637985198 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f488010a910 0x7f488019b890 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:46.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.108+0000 7f4887200640 1 --2- 172.21.15.3:0/637985198 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4880104f10 0x7f488019b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:46.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.108+0000 7f4887200640 1 -- 172.21.15.3:0/637985198 >> 172.21.15.3:0/637985198 conn(0x7f4880100910 msgr2=0x7f4880102d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:46.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.108+0000 7f4887200640 1 -- 172.21.15.3:0/637985198 shutdown_connections 2024-09-10T23:36:46.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.108+0000 7f4887200640 1 -- 172.21.15.3:0/637985198 wait complete. 2024-09-10T23:36:46.126 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-10T23:36:46.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.286+0000 7f5c54200640 1 -- 172.21.15.3:0/2388779053 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c4c104ee0 msgr2=0x7f5c4c1052c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:46.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.286+0000 7f5c54200640 1 --2- 172.21.15.3:0/2388779053 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c4c104ee0 0x7f5c4c1052c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5c40009900 tx=0x7f5c4002a400 comp rx=0 tx=0).stop 2024-09-10T23:36:46.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.286+0000 7f5c54200640 1 -- 172.21.15.3:0/2388779053 shutdown_connections 2024-09-10T23:36:46.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.286+0000 7f5c54200640 1 --2- 172.21.15.3:0/2388779053 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c4c10b260 0x7f5c4c111a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:46.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.286+0000 7f5c54200640 1 --2- 172.21.15.3:0/2388779053 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c4c10a8e0 0x7f5c4c10ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:46.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.286+0000 7f5c54200640 1 --2- 172.21.15.3:0/2388779053 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c4c104ee0 0x7f5c4c1052c0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:46.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.286+0000 7f5c54200640 1 -- 172.21.15.3:0/2388779053 >> 172.21.15.3:0/2388779053 conn(0x7f5c4c100920 msgr2=0x7f5c4c102d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:46.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.286+0000 7f5c54200640 1 -- 172.21.15.3:0/2388779053 shutdown_connections 2024-09-10T23:36:46.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.286+0000 7f5c54200640 1 -- 172.21.15.3:0/2388779053 wait complete. 2024-09-10T23:36:46.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.287+0000 7f5c54200640 1 Processor -- start 2024-09-10T23:36:46.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.287+0000 7f5c54200640 1 -- start start 2024-09-10T23:36:46.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.288+0000 7f5c54200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c4c104ee0 0x7f5c4c19b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:46.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.288+0000 7f5c54200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c4c10a8e0 0x7f5c4c19b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:46.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.288+0000 7f5c54200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c4c10b260 0x7f5c4c1a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:46.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.288+0000 7f5c54200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c114d80 con 0x7f5c4c10b260 2024-09-10T23:36:46.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.288+0000 7f5c54200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c114c00 con 0x7f5c4c10a8e0 2024-09-10T23:36:46.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.288+0000 7f5c54200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c114f00 con 0x7f5c4c104ee0 2024-09-10T23:36:46.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.288+0000 7f5c52200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c4c10b260 0x7f5c4c1a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:46.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.288+0000 7f5c52200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c4c10b260 0x7f5c4c1a0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35570/0 (socket says 172.21.15.3:35570) 2024-09-10T23:36:46.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.288+0000 7f5c52200640 1 -- 172.21.15.3:0/1467059493 learned_addr learned my addr 172.21.15.3:0/1467059493 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:36:46.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.288+0000 7f5c51800640 1 --2- 172.21.15.3:0/1467059493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c4c104ee0 0x7f5c4c19b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:46.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.288+0000 7f5c50e00640 1 --2- 172.21.15.3:0/1467059493 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c4c10a8e0 0x7f5c4c19b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:46.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.288+0000 7f5c52200640 1 -- 172.21.15.3:0/1467059493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c4c104ee0 msgr2=0x7f5c4c19b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:46.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.288+0000 7f5c52200640 1 --2- 172.21.15.3:0/1467059493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c4c104ee0 0x7f5c4c19b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:46.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.288+0000 7f5c52200640 1 -- 172.21.15.3:0/1467059493 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c4c10a8e0 msgr2=0x7f5c4c19b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:46.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.288+0000 7f5c52200640 1 --2- 172.21.15.3:0/1467059493 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c4c10a8e0 0x7f5c4c19b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:46.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.288+0000 7f5c52200640 1 -- 172.21.15.3:0/1467059493 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c4c1a1320 con 0x7f5c4c10b260 2024-09-10T23:36:46.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.288+0000 7f5c50e00640 1 --2- 172.21.15.3:0/1467059493 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c4c10a8e0 0x7f5c4c19b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:36:46.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.289+0000 7f5c52200640 1 --2- 172.21.15.3:0/1467059493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c4c10b260 0x7f5c4c1a0b50 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5c4400cce0 tx=0x7f5c4400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:46.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.289+0000 7f5c4a000640 1 -- 172.21.15.3:0/1467059493 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c4400f450 con 0x7f5c4c10b260 2024-09-10T23:36:46.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.289+0000 7f5c4a000640 1 -- 172.21.15.3:0/1467059493 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5c4400fa80 con 0x7f5c4c10b260 2024-09-10T23:36:46.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.289+0000 7f5c4a000640 1 -- 172.21.15.3:0/1467059493 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c44018ad0 con 0x7f5c4c10b260 2024-09-10T23:36:46.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.289+0000 7f5c54200640 1 -- 172.21.15.3:0/1467059493 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c4c1a1610 con 0x7f5c4c10b260 2024-09-10T23:36:46.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.289+0000 7f5c54200640 1 -- 172.21.15.3:0/1467059493 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c4c1a7cd0 con 0x7f5c4c10b260 2024-09-10T23:36:46.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.290+0000 7f5c54200640 1 -- 172.21.15.3:0/1467059493 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c4c1052c0 con 0x7f5c4c10b260 2024-09-10T23:36:46.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.294+0000 7f5c4a000640 1 -- 172.21.15.3:0/1467059493 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 26) ==== 153380+0+0 (secure 0 0 0) 0x7f5c4400f5f0 con 0x7f5c4c10b260 2024-09-10T23:36:46.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.295+0000 7f5c4a000640 1 --2- 172.21.15.3:0/1467059493 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5c340b54d0 0x7f5c340b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:46.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.296+0000 7f5c4a000640 1 -- 172.21.15.3:0/1467059493 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9490+0+0 (secure 0 0 0) 0x7f5c440e6c30 con 0x7f5c4c10b260 2024-09-10T23:36:46.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.296+0000 7f5c51800640 1 --2- 172.21.15.3:0/1467059493 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5c340b54d0 0x7f5c340b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:46.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.296+0000 7f5c51800640 1 --2- 172.21.15.3:0/1467059493 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5c340b54d0 0x7f5c340b7990 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5c40006010 tx=0x7f5c40005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:46.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.297+0000 7f5c4a000640 1 -- 172.21.15.3:0/1467059493 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5c44014030 con 0x7f5c4c10b260 2024-09-10T23:36:46.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.497+0000 7f5c54200640 1 -- 172.21.15.3:0/1467059493 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5c4c02e5c0 con 0x7f5c4c10b260 2024-09-10T23:36:46.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.497+0000 7f5c4a000640 1 -- 172.21.15.3:0/1467059493 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v98) ==== 100+0+11 (secure 0 0 0) 0x7f5c440ad490 con 0x7f5c4c10b260 2024-09-10T23:36:46.499 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2024-09-10T23:36:46.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.500+0000 7f5c54200640 1 -- 172.21.15.3:0/1467059493 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5c340b54d0 msgr2=0x7f5c340b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:46.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.500+0000 7f5c54200640 1 --2- 172.21.15.3:0/1467059493 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5c340b54d0 0x7f5c340b7990 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5c40006010 tx=0x7f5c40005e80 comp rx=0 tx=0).stop 2024-09-10T23:36:46.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.500+0000 7f5c54200640 1 -- 172.21.15.3:0/1467059493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c4c10b260 msgr2=0x7f5c4c1a0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:46.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.500+0000 7f5c54200640 1 --2- 172.21.15.3:0/1467059493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c4c10b260 0x7f5c4c1a0b50 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5c4400cce0 tx=0x7f5c4400a620 comp rx=0 tx=0).stop 2024-09-10T23:36:46.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.500+0000 7f5c54200640 1 -- 172.21.15.3:0/1467059493 shutdown_connections 2024-09-10T23:36:46.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.500+0000 7f5c54200640 1 --2- 172.21.15.3:0/1467059493 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5c340b54d0 0x7f5c340b7990 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:46.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.500+0000 7f5c54200640 1 --2- 172.21.15.3:0/1467059493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c4c10b260 0x7f5c4c1a0b50 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:46.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.500+0000 7f5c54200640 1 --2- 172.21.15.3:0/1467059493 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c4c10a8e0 0x7f5c4c19b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:46.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.500+0000 7f5c54200640 1 --2- 172.21.15.3:0/1467059493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c4c104ee0 0x7f5c4c19b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:46.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.500+0000 7f5c54200640 1 -- 172.21.15.3:0/1467059493 >> 172.21.15.3:0/1467059493 conn(0x7f5c4c100920 msgr2=0x7f5c4c101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:46.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.500+0000 7f5c54200640 1 -- 172.21.15.3:0/1467059493 shutdown_connections 2024-09-10T23:36:46.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.500+0000 7f5c54200640 1 -- 172.21.15.3:0/1467059493 wait complete. 2024-09-10T23:36:46.517 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-10T23:36:46.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.677+0000 7f5c7c200640 1 -- 172.21.15.3:0/3744648488 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c74075e00 msgr2=0x7f5c7410edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:46.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.677+0000 7f5c7c200640 1 --2- 172.21.15.3:0/3744648488 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c74075e00 0x7f5c7410edb0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f5c60009900 tx=0x7f5c6002a410 comp rx=0 tx=0).stop 2024-09-10T23:36:46.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.677+0000 7f5c7c200640 1 -- 172.21.15.3:0/3744648488 shutdown_connections 2024-09-10T23:36:46.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.677+0000 7f5c7c200640 1 --2- 172.21.15.3:0/3744648488 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c7410f2f0 0x7f5c741116e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:46.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.677+0000 7f5c7c200640 1 --2- 172.21.15.3:0/3744648488 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c74075e00 0x7f5c7410edb0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:46.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.677+0000 7f5c7c200640 1 --2- 172.21.15.3:0/3744648488 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c740754e0 0x7f5c740758c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:46.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.677+0000 7f5c7c200640 1 -- 172.21.15.3:0/3744648488 >> 172.21.15.3:0/3744648488 conn(0x7f5c740fe730 msgr2=0x7f5c74100b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:46.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.677+0000 7f5c7c200640 1 -- 172.21.15.3:0/3744648488 shutdown_connections 2024-09-10T23:36:46.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.677+0000 7f5c7c200640 1 -- 172.21.15.3:0/3744648488 wait complete. 2024-09-10T23:36:46.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.678+0000 7f5c7c200640 1 Processor -- start 2024-09-10T23:36:46.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.678+0000 7f5c7c200640 1 -- start start 2024-09-10T23:36:46.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.678+0000 7f5c7c200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c740754e0 0x7f5c7419b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:46.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.678+0000 7f5c7c200640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c74075e00 0x7f5c7419b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:46.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.678+0000 7f5c7c200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c7410f2f0 0x7f5c741a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:46.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.678+0000 7f5c7c200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f5c74114dd0 con 0x7f5c740754e0 2024-09-10T23:36:46.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.678+0000 7f5c7c200640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5c74114c50 con 0x7f5c74075e00 2024-09-10T23:36:46.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.678+0000 7f5c7c200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5c74114f50 con 0x7f5c7410f2f0 2024-09-10T23:36:46.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.679+0000 7f5c79800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c740754e0 0x7f5c7419b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:46.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.679+0000 7f5c79800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c740754e0 0x7f5c7419b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35590/0 (socket says 172.21.15.3:35590) 2024-09-10T23:36:46.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.679+0000 7f5c79800640 1 -- 172.21.15.3:0/2561301308 learned_addr learned my addr 172.21.15.3:0/2561301308 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:36:46.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.679+0000 7f5c7a200640 1 --2- 172.21.15.3:0/2561301308 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c7410f2f0 0x7f5c741a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:46.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.679+0000 7f5c78e00640 1 --2- 172.21.15.3:0/2561301308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c74075e00 0x7f5c7419b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:46.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.679+0000 7f5c79800640 1 -- 172.21.15.3:0/2561301308 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c7410f2f0 msgr2=0x7f5c741a0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:46.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.679+0000 7f5c79800640 1 --2- 172.21.15.3:0/2561301308 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c7410f2f0 0x7f5c741a0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:46.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.679+0000 7f5c79800640 1 -- 172.21.15.3:0/2561301308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c74075e00 msgr2=0x7f5c7419b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:46.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.679+0000 7f5c79800640 1 --2- 172.21.15.3:0/2561301308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c74075e00 0x7f5c7419b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:46.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.679+0000 7f5c79800640 1 -- 172.21.15.3:0/2561301308 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c741a1410 con 0x7f5c740754e0 2024-09-10T23:36:46.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.679+0000 7f5c79800640 1 --2- 172.21.15.3:0/2561301308 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c740754e0 0x7f5c7419b370 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f5c6800e9f0 tx=0x7f5c6800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:46.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.680+0000 7f5c72000640 1 -- 172.21.15.3:0/2561301308 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6800cd80 con 0x7f5c740754e0 2024-09-10T23:36:46.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.680+0000 7f5c72000640 1 -- 172.21.15.3:0/2561301308 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5c680108c0 con 0x7f5c740754e0 2024-09-10T23:36:46.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.680+0000 7f5c7c200640 1 -- 172.21.15.3:0/2561301308 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c741a1700 con 0x7f5c740754e0 2024-09-10T23:36:46.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.680+0000 7f5c72000640 1 -- 172.21.15.3:0/2561301308 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c680187c0 con 0x7f5c740754e0 2024-09-10T23:36:46.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.680+0000 7f5c7c200640 1 -- 172.21.15.3:0/2561301308 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c741a7fa0 con 0x7f5c740754e0 2024-09-10T23:36:46.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.681+0000 7f5c7c200640 1 -- 172.21.15.3:0/2561301308 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c740769f0 con 0x7f5c740754e0 2024-09-10T23:36:46.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.683+0000 7f5c72000640 1 -- 172.21.15.3:0/2561301308 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 26) ==== 153380+0+0 (secure 0 0 0) 0x7f5c68010430 con 0x7f5c740754e0 2024-09-10T23:36:46.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.685+0000 7f5c72000640 1 --2- 172.21.15.3:0/2561301308 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5c5c0b54d0 0x7f5c5c0b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:46.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.685+0000 7f5c72000640 1 -- 172.21.15.3:0/2561301308 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9490+0+0 (secure 0 0 0) 0x7f5c680e6cc0 con 0x7f5c740754e0 2024-09-10T23:36:46.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.685+0000 7f5c78e00640 1 --2- 172.21.15.3:0/2561301308 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5c5c0b54d0 0x7f5c5c0b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:46.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.686+0000 7f5c78e00640 1 --2- 172.21.15.3:0/2561301308 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5c5c0b54d0 0x7f5c5c0b7990 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5c60006010 tx=0x7f5c60005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:46.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.686+0000 7f5c72000640 1 -- 172.21.15.3:0/2561301308 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5c680ad470 con 0x7f5c740754e0 2024-09-10T23:36:46.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:46 smithi194 ceph-mon[33904]: from='client.15804 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:36:46.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:46 smithi194 ceph-mon[33904]: pgmap v698: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:36:46.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:46 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/1938369397' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T23:36:46.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:46 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/637985198' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T23:36:46.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:46 smithi003 ceph-mon[30348]: from='client.15804 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:36:46.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:46 smithi003 ceph-mon[30348]: pgmap v698: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:36:46.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:46 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1938369397' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T23:36:46.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:46 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/637985198' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T23:36:46.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:46 smithi038 ceph-mon[34225]: from='client.15804 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:36:46.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:46 smithi038 ceph-mon[34225]: pgmap v698: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:36:46.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:46 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/1938369397' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T23:36:46.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:46 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/637985198' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T23:36:46.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.882+0000 7f5c7c200640 1 -- 172.21.15.3:0/2561301308 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f5c741a8210 con 0x7f5c740754e0 2024-09-10T23:36:46.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.883+0000 7f5c72000640 1 -- 172.21.15.3:0/2561301308 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v98) ==== 103+0+11 (secure 0 0 0) 0x7f5c680acd70 con 0x7f5c740754e0 2024-09-10T23:36:46.884 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2024-09-10T23:36:46.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.885+0000 7f5c7c200640 1 -- 172.21.15.3:0/2561301308 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5c5c0b54d0 msgr2=0x7f5c5c0b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:46.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.885+0000 7f5c7c200640 1 --2- 172.21.15.3:0/2561301308 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5c5c0b54d0 0x7f5c5c0b7990 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5c60006010 tx=0x7f5c60005a20 comp rx=0 tx=0).stop 2024-09-10T23:36:46.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.885+0000 7f5c7c200640 1 -- 172.21.15.3:0/2561301308 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c740754e0 msgr2=0x7f5c7419b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:46.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.885+0000 7f5c7c200640 1 --2- 172.21.15.3:0/2561301308 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c740754e0 0x7f5c7419b370 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f5c6800e9f0 tx=0x7f5c6800eeb0 comp rx=0 tx=0).stop 2024-09-10T23:36:46.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.885+0000 7f5c7c200640 1 -- 172.21.15.3:0/2561301308 shutdown_connections 2024-09-10T23:36:46.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.885+0000 7f5c7c200640 1 --2- 172.21.15.3:0/2561301308 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c7410f2f0 0x7f5c741a0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:46.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.885+0000 7f5c7c200640 1 --2- 172.21.15.3:0/2561301308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c74075e00 0x7f5c7419b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:46.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.885+0000 7f5c7c200640 1 --2- 172.21.15.3:0/2561301308 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f5c5c0b54d0 0x7f5c5c0b7990 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:46.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.885+0000 7f5c7c200640 1 --2- 172.21.15.3:0/2561301308 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5c740754e0 0x7f5c7419b370 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:46.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.885+0000 7f5c7c200640 1 -- 172.21.15.3:0/2561301308 >> 172.21.15.3:0/2561301308 conn(0x7f5c740fe730 msgr2=0x7f5c740ff330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:46.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.885+0000 7f5c7c200640 1 -- 172.21.15.3:0/2561301308 shutdown_connections 2024-09-10T23:36:46.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:46.885+0000 7f5c7c200640 1 -- 172.21.15.3:0/2561301308 wait complete. 2024-09-10T23:36:46.905 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-10T23:36:47.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.063+0000 7f9c15400640 1 -- 172.21.15.3:0/1295086615 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c1010b2b0 msgr2=0x7f9c10111ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:47.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.063+0000 7f9c15400640 1 --2- 172.21.15.3:0/1295086615 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c1010b2b0 0x7f9c10111ab0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9c08009ca0 tx=0x7f9c0802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:36:47.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.063+0000 7f9c15400640 1 -- 172.21.15.3:0/1295086615 shutdown_connections 2024-09-10T23:36:47.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.063+0000 7f9c15400640 1 --2- 172.21.15.3:0/1295086615 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c1010b2b0 0x7f9c10111ab0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:47.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.063+0000 7f9c15400640 1 --2- 172.21.15.3:0/1295086615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9c1010a930 0x7f9c1010ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:47.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.063+0000 7f9c15400640 1 --2- 172.21.15.3:0/1295086615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c10104f30 0x7f9c10105310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:47.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.063+0000 7f9c15400640 1 -- 172.21.15.3:0/1295086615 >> 172.21.15.3:0/1295086615 conn(0x7f9c10100910 msgr2=0x7f9c10102d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:47.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.063+0000 7f9c15400640 1 -- 172.21.15.3:0/1295086615 shutdown_connections 2024-09-10T23:36:47.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.063+0000 7f9c15400640 1 -- 172.21.15.3:0/1295086615 wait complete. 2024-09-10T23:36:47.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.064+0000 7f9c15400640 1 Processor -- start 2024-09-10T23:36:47.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.064+0000 7f9c15400640 1 -- start start 2024-09-10T23:36:47.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.064+0000 7f9c15400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9c10104f30 0x7f9c1019b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:47.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.065+0000 7f9c15400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c1010a930 0x7f9c1019b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:47.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.065+0000 7f9c15400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c1010b2b0 0x7f9c101a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:47.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.065+0000 7f9c15400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9c10114de0 con 0x7f9c1010b2b0 2024-09-10T23:36:47.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.065+0000 7f9c15400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9c10114c60 con 0x7f9c10104f30 2024-09-10T23:36:47.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.065+0000 7f9c15400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9c10114f60 con 0x7f9c1010a930 2024-09-10T23:36:47.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.065+0000 7f9c0f200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c1010b2b0 0x7f9c101a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:47.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.065+0000 7f9c0f200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c1010b2b0 0x7f9c101a0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35620/0 (socket says 172.21.15.3:35620) 2024-09-10T23:36:47.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.065+0000 7f9c0f200640 1 -- 172.21.15.3:0/3047441306 learned_addr learned my addr 172.21.15.3:0/3047441306 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:36:47.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.065+0000 7f9c07e00640 1 --2- 172.21.15.3:0/3047441306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c1010a930 0x7f9c1019b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:47.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.065+0000 7f9c0e800640 1 --2- 172.21.15.3:0/3047441306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9c10104f30 0x7f9c1019b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:47.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.065+0000 7f9c0f200640 1 -- 172.21.15.3:0/3047441306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c1010a930 msgr2=0x7f9c1019b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:47.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.065+0000 7f9c0f200640 1 --2- 172.21.15.3:0/3047441306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c1010a930 0x7f9c1019b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:47.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.065+0000 7f9c0f200640 1 -- 172.21.15.3:0/3047441306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9c10104f30 msgr2=0x7f9c1019b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:47.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.065+0000 7f9c0f200640 1 --2- 172.21.15.3:0/3047441306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9c10104f30 0x7f9c1019b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:47.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.065+0000 7f9c0f200640 1 -- 172.21.15.3:0/3047441306 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c101a12c0 con 0x7f9c1010b2b0 2024-09-10T23:36:47.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.066+0000 7f9c0f200640 1 --2- 172.21.15.3:0/3047441306 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c1010b2b0 0x7f9c101a0af0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9c08031040 tx=0x7f9c08003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:47.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.066+0000 7f9c07400640 1 -- 172.21.15.3:0/3047441306 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c08032c90 con 0x7f9c1010b2b0 2024-09-10T23:36:47.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.066+0000 7f9c07400640 1 -- 172.21.15.3:0/3047441306 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c08032e30 con 0x7f9c1010b2b0 2024-09-10T23:36:47.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.066+0000 7f9c07400640 1 -- 172.21.15.3:0/3047441306 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c08030af0 con 0x7f9c1010b2b0 2024-09-10T23:36:47.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.066+0000 7f9c15400640 1 -- 172.21.15.3:0/3047441306 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c101a1550 con 0x7f9c1010b2b0 2024-09-10T23:36:47.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.066+0000 7f9c15400640 1 -- 172.21.15.3:0/3047441306 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c101a7c70 con 0x7f9c1010b2b0 2024-09-10T23:36:47.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.067+0000 7f9c15400640 1 -- 172.21.15.3:0/3047441306 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c10105310 con 0x7f9c1010b2b0 2024-09-10T23:36:47.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.069+0000 7f9c07400640 1 -- 172.21.15.3:0/3047441306 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 26) ==== 153380+0+0 (secure 0 0 0) 0x7f9c08030c90 con 0x7f9c1010b2b0 2024-09-10T23:36:47.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.071+0000 7f9c07400640 1 --2- 172.21.15.3:0/3047441306 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f9bf40b54d0 0x7f9bf40b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:47.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.071+0000 7f9c07400640 1 -- 172.21.15.3:0/3047441306 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9490+0+0 (secure 0 0 0) 0x7f9c081076e0 con 0x7f9c1010b2b0 2024-09-10T23:36:47.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.071+0000 7f9c0e800640 1 --2- 172.21.15.3:0/3047441306 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f9bf40b54d0 0x7f9bf40b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:47.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.072+0000 7f9c0e800640 1 --2- 172.21.15.3:0/3047441306 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f9bf40b54d0 0x7f9bf40b7990 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9c00005e10 tx=0x7f9c00005da0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:47.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.073+0000 7f9c07400640 1 -- 172.21.15.3:0/3047441306 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9c080cde30 con 0x7f9c1010b2b0 2024-09-10T23:36:47.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.316+0000 7f9c15400640 1 -- 172.21.15.3:0/3047441306 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f9c101a7fe0 con 0x7f9c1010b2b0 2024-09-10T23:36:47.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.326+0000 7f9c07400640 1 -- 172.21.15.3:0/3047441306 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v26) ==== 81+0+828461 (secure 0 0 0) 0x7f9c080cd730 con 0x7f9c1010b2b0 2024-09-10T23:36:47.339 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:36:47.339 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-10T23:36:47.339 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 26, 2024-09-10T23:36:47.339 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.339 INFO:teuthology.orchestra.run.smithi003.stdout: "active_gid": 14223, 2024-09-10T23:36:47.339 INFO:teuthology.orchestra.run.smithi003.stdout: "active_name": "x", 2024-09-10T23:36:47.339 INFO:teuthology.orchestra.run.smithi003.stdout: "active_addrs": { 2024-09-10T23:36:47.339 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2024-09-10T23:36:47.339 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.339 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v2", 2024-09-10T23:36:47.340 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6800", 2024-09-10T23:36:47.340 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 536493997 2024-09-10T23:36:47.340 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.340 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.340 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2024-09-10T23:36:47.340 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6801", 2024-09-10T23:36:47.340 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 536493997 2024-09-10T23:36:47.340 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.340 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-10T23:36:47.340 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.340 INFO:teuthology.orchestra.run.smithi003.stdout: "active_addr": "172.21.15.3:6801/536493997", 2024-09-10T23:36:47.340 INFO:teuthology.orchestra.run.smithi003.stdout: "active_change": "2024-09-10T23:16:20.647465+0000", 2024-09-10T23:36:47.340 INFO:teuthology.orchestra.run.smithi003.stdout: "active_mgr_features": 4540719139924082687, 2024-09-10T23:36:47.341 INFO:teuthology.orchestra.run.smithi003.stdout: "available": true, 2024-09-10T23:36:47.341 INFO:teuthology.orchestra.run.smithi003.stdout: "standbys": [ 2024-09-10T23:36:47.341 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.341 INFO:teuthology.orchestra.run.smithi003.stdout: "gid": 14307, 2024-09-10T23:36:47.341 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "z", 2024-09-10T23:36:47.341 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_features": 4540719139924082687, 2024-09-10T23:36:47.341 INFO:teuthology.orchestra.run.smithi003.stdout: "available_modules": [ 2024-09-10T23:36:47.341 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.341 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "alerts", 2024-09-10T23:36:47.341 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.341 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.341 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.341 INFO:teuthology.orchestra.run.smithi003.stdout: "interval": { 2024-09-10T23:36:47.341 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "interval", 2024-09-10T23:36:47.342 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:47.342 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.342 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.342 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "60", 2024-09-10T23:36:47.342 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.342 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.342 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.342 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T23:36:47.342 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.342 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.342 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.342 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.342 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.343 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.343 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.343 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.343 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.343 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.343 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.343 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.343 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.343 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.343 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.343 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.343 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.343 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.344 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.344 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.344 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.344 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.344 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.344 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.344 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.344 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.344 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.345 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.345 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.345 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.345 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.345 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.345 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.345 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.345 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.345 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.345 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.345 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.345 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.345 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.345 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.346 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.346 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.346 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.346 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.346 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.346 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.346 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.346 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.346 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.346 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.346 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.346 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.346 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.347 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.347 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.347 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.347 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.347 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.347 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.347 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.347 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.347 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.347 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.347 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.347 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.347 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.348 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.348 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.348 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.348 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.348 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.348 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.348 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.348 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_destination": { 2024-09-10T23:36:47.348 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_destination", 2024-09-10T23:36:47.348 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.348 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.348 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.348 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.348 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.349 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.349 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.349 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-10T23:36:47.349 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.349 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.349 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.349 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.349 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_from_name": { 2024-09-10T23:36:47.349 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_from_name", 2024-09-10T23:36:47.349 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.349 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.349 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.349 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "Ceph", 2024-09-10T23:36:47.349 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.350 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.350 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.350 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Email From: name", 2024-09-10T23:36:47.350 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.350 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.350 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.350 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.350 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_host": { 2024-09-10T23:36:47.350 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_host", 2024-09-10T23:36:47.350 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.350 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.350 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.350 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.350 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.351 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.351 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.351 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "SMTP server", 2024-09-10T23:36:47.351 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.351 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.351 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.351 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.351 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_password": { 2024-09-10T23:36:47.351 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_password", 2024-09-10T23:36:47.351 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.351 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.351 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.351 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.351 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.351 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.352 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.352 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Password to authenticate with", 2024-09-10T23:36:47.352 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.352 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.352 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.352 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.352 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_port": { 2024-09-10T23:36:47.352 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_port", 2024-09-10T23:36:47.352 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.352 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.352 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.352 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "465", 2024-09-10T23:36:47.352 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.353 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.353 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.353 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "SMTP port", 2024-09-10T23:36:47.353 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.353 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.353 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.353 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.353 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_sender": { 2024-09-10T23:36:47.353 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_sender", 2024-09-10T23:36:47.353 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.354 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.354 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.354 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.354 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.354 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.354 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.354 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "SMTP envelope sender", 2024-09-10T23:36:47.354 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.354 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.354 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.354 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.355 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_ssl": { 2024-09-10T23:36:47.355 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_ssl", 2024-09-10T23:36:47.355 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.355 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.355 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.355 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.355 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.355 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.355 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.355 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T23:36:47.355 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.355 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.355 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.356 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.356 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_user": { 2024-09-10T23:36:47.356 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_user", 2024-09-10T23:36:47.356 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.356 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.356 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.356 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.356 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.356 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.356 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.356 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "User to authenticate as", 2024-09-10T23:36:47.356 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.356 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.356 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.357 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.357 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.357 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.357 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.357 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.357 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.357 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.357 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.357 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.357 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.357 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.357 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.358 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.358 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.358 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.358 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.358 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.358 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.358 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "balancer", 2024-09-10T23:36:47.358 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.358 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.358 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.358 INFO:teuthology.orchestra.run.smithi003.stdout: "active": { 2024-09-10T23:36:47.358 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "active", 2024-09-10T23:36:47.358 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.358 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.359 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.359 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.359 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.359 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.359 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.359 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T23:36:47.359 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.359 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.359 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.359 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.359 INFO:teuthology.orchestra.run.smithi003.stdout: "begin_time": { 2024-09-10T23:36:47.359 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "begin_time", 2024-09-10T23:36:47.359 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.360 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.360 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.360 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0000", 2024-09-10T23:36:47.360 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.360 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.360 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.360 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T23:36:47.360 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T23:36:47.360 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.360 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.360 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.360 INFO:teuthology.orchestra.run.smithi003.stdout: "begin_weekday": { 2024-09-10T23:36:47.360 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "begin_weekday", 2024-09-10T23:36:47.361 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "uint", 2024-09-10T23:36:47.361 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.361 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.361 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.361 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "0", 2024-09-10T23:36:47.361 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "6", 2024-09-10T23:36:47.361 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.361 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T23:36:47.361 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T23:36:47.361 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.361 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.361 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.361 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_compat_max_iterations": { 2024-09-10T23:36:47.362 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crush_compat_max_iterations", 2024-09-10T23:36:47.362 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "uint", 2024-09-10T23:36:47.362 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.362 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.362 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "25", 2024-09-10T23:36:47.362 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "1", 2024-09-10T23:36:47.362 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "250", 2024-09-10T23:36:47.362 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.362 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T23:36:47.362 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.362 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.362 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.362 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.363 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_compat_metrics": { 2024-09-10T23:36:47.363 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crush_compat_metrics", 2024-09-10T23:36:47.363 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.363 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.363 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.363 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T23:36:47.363 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.363 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.363 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.363 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T23:36:47.363 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T23:36:47.363 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.363 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.363 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.364 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_compat_step": { 2024-09-10T23:36:47.364 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crush_compat_step", 2024-09-10T23:36:47.364 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-10T23:36:47.364 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.364 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.364 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0.5", 2024-09-10T23:36:47.364 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "0.001", 2024-09-10T23:36:47.364 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "0.999", 2024-09-10T23:36:47.364 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.364 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "aggressiveness of optimization", 2024-09-10T23:36:47.364 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T23:36:47.364 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.365 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.365 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.365 INFO:teuthology.orchestra.run.smithi003.stdout: "end_time": { 2024-09-10T23:36:47.365 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "end_time", 2024-09-10T23:36:47.365 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.365 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.365 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.365 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "2359", 2024-09-10T23:36:47.365 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.365 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.365 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.365 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T23:36:47.365 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T23:36:47.365 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.366 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.366 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.366 INFO:teuthology.orchestra.run.smithi003.stdout: "end_weekday": { 2024-09-10T23:36:47.366 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "end_weekday", 2024-09-10T23:36:47.366 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "uint", 2024-09-10T23:36:47.366 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.366 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.366 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.366 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "0", 2024-09-10T23:36:47.366 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "6", 2024-09-10T23:36:47.366 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.366 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T23:36:47.366 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T23:36:47.366 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.367 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.367 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.367 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.367 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.367 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.367 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.367 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.367 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.367 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.367 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.367 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.367 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.367 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.367 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.368 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.368 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.368 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.368 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.368 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.368 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.368 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.368 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.368 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.368 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.368 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.368 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.369 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.369 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.369 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.369 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.369 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.369 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.369 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.369 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.369 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.369 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.369 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.369 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.369 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.370 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.370 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.370 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.370 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.370 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.370 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.370 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.370 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.370 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.370 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.370 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.370 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.370 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.370 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.371 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.371 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.371 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.371 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.371 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.371 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.371 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.371 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.371 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.371 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.371 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.371 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.371 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.371 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.372 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.372 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.372 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.372 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.372 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.372 INFO:teuthology.orchestra.run.smithi003.stdout: "min_score": { 2024-09-10T23:36:47.372 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "min_score", 2024-09-10T23:36:47.372 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-10T23:36:47.372 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.372 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.372 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.372 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.372 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.372 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.373 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T23:36:47.373 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.373 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.373 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.373 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.373 INFO:teuthology.orchestra.run.smithi003.stdout: "mode": { 2024-09-10T23:36:47.373 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mode", 2024-09-10T23:36:47.373 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.373 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.373 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.373 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "upmap", 2024-09-10T23:36:47.373 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.373 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.373 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.374 INFO:teuthology.orchestra.run.smithi003.stdout: "crush-compat", 2024-09-10T23:36:47.374 INFO:teuthology.orchestra.run.smithi003.stdout: "none", 2024-09-10T23:36:47.374 INFO:teuthology.orchestra.run.smithi003.stdout: "read", 2024-09-10T23:36:47.374 INFO:teuthology.orchestra.run.smithi003.stdout: "upmap", 2024-09-10T23:36:47.374 INFO:teuthology.orchestra.run.smithi003.stdout: "upmap-read" 2024-09-10T23:36:47.374 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.374 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Balancer mode", 2024-09-10T23:36:47.374 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.374 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.374 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.374 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.374 INFO:teuthology.orchestra.run.smithi003.stdout: "pool_ids": { 2024-09-10T23:36:47.374 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "pool_ids", 2024-09-10T23:36:47.374 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.375 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.375 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.375 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.375 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.375 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.375 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.375 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T23:36:47.375 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.375 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.375 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.375 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.375 INFO:teuthology.orchestra.run.smithi003.stdout: "sleep_interval": { 2024-09-10T23:36:47.375 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sleep_interval", 2024-09-10T23:36:47.375 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:47.376 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.376 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.376 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "60", 2024-09-10T23:36:47.376 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.376 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.376 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.376 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T23:36:47.376 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.377 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.377 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.377 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.377 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.377 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.377 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.377 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.377 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.377 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.377 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.377 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.377 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.377 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.377 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.378 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.378 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.378 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.378 INFO:teuthology.orchestra.run.smithi003.stdout: "upmap_max_deviation": { 2024-09-10T23:36:47.378 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "upmap_max_deviation", 2024-09-10T23:36:47.378 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.378 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.378 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.378 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5", 2024-09-10T23:36:47.378 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "1", 2024-09-10T23:36:47.378 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.378 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.378 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T23:36:47.378 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T23:36:47.379 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.379 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.379 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.379 INFO:teuthology.orchestra.run.smithi003.stdout: "upmap_max_optimizations": { 2024-09-10T23:36:47.379 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "upmap_max_optimizations", 2024-09-10T23:36:47.379 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "uint", 2024-09-10T23:36:47.379 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.379 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.379 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-10T23:36:47.379 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.379 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.379 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.379 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T23:36:47.380 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.380 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.380 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.380 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.380 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.380 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.380 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.380 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "cephadm", 2024-09-10T23:36:47.380 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.380 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.380 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.380 INFO:teuthology.orchestra.run.smithi003.stdout: "agent_down_multiplier": { 2024-09-10T23:36:47.380 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "agent_down_multiplier", 2024-09-10T23:36:47.380 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-10T23:36:47.381 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.381 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.381 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "3.0", 2024-09-10T23:36:47.381 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.381 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.381 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.381 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T23:36:47.381 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.381 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.381 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.381 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.381 INFO:teuthology.orchestra.run.smithi003.stdout: "agent_refresh_rate": { 2024-09-10T23:36:47.382 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "agent_refresh_rate", 2024-09-10T23:36:47.382 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:47.382 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.382 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.382 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "20", 2024-09-10T23:36:47.382 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.382 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.382 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.382 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T23:36:47.382 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.382 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.382 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.382 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.383 INFO:teuthology.orchestra.run.smithi003.stdout: "agent_starting_port": { 2024-09-10T23:36:47.383 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "agent_starting_port", 2024-09-10T23:36:47.383 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.383 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.383 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.383 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "4721", 2024-09-10T23:36:47.383 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.383 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.383 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.383 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T23:36:47.383 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.383 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.383 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.384 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.384 INFO:teuthology.orchestra.run.smithi003.stdout: "allow_ptrace": { 2024-09-10T23:36:47.384 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "allow_ptrace", 2024-09-10T23:36:47.384 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.384 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.384 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.384 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.384 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.384 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.384 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.384 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T23:36:47.384 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T23:36:47.384 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.385 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.385 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.385 INFO:teuthology.orchestra.run.smithi003.stdout: "autotune_interval": { 2024-09-10T23:36:47.385 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "autotune_interval", 2024-09-10T23:36:47.385 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:47.385 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.385 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.385 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "600", 2024-09-10T23:36:47.385 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.385 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.385 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.385 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T23:36:47.385 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.386 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.386 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.386 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.386 INFO:teuthology.orchestra.run.smithi003.stdout: "autotune_memory_target_ratio": { 2024-09-10T23:36:47.386 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T23:36:47.386 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-10T23:36:47.386 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.386 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.386 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0.7", 2024-09-10T23:36:47.386 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.386 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.386 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.386 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T23:36:47.387 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.387 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.387 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.387 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.387 INFO:teuthology.orchestra.run.smithi003.stdout: "cephadm_log_destination": { 2024-09-10T23:36:47.387 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "cephadm_log_destination", 2024-09-10T23:36:47.387 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.387 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.387 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.387 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.387 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.387 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.387 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.388 INFO:teuthology.orchestra.run.smithi003.stdout: "file", 2024-09-10T23:36:47.388 INFO:teuthology.orchestra.run.smithi003.stdout: "file,syslog", 2024-09-10T23:36:47.388 INFO:teuthology.orchestra.run.smithi003.stdout: "syslog" 2024-09-10T23:36:47.388 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.388 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T23:36:47.388 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.388 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.388 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.388 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.388 INFO:teuthology.orchestra.run.smithi003.stdout: "cgroups_split": { 2024-09-10T23:36:47.388 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "cgroups_split", 2024-09-10T23:36:47.388 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.389 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.389 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.389 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.389 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.389 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.389 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.389 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T23:36:47.389 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.389 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.389 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.389 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.390 INFO:teuthology.orchestra.run.smithi003.stdout: "config_checks_enabled": { 2024-09-10T23:36:47.390 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "config_checks_enabled", 2024-09-10T23:36:47.390 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.390 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.390 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.390 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.390 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.390 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.390 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.390 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T23:36:47.390 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.390 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.390 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.391 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.391 INFO:teuthology.orchestra.run.smithi003.stdout: "config_dashboard": { 2024-09-10T23:36:47.391 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "config_dashboard", 2024-09-10T23:36:47.391 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.391 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.391 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.391 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.391 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.391 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.391 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.391 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T23:36:47.391 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.391 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.391 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.392 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.392 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_alertmanager": { 2024-09-10T23:36:47.392 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_alertmanager", 2024-09-10T23:36:47.392 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.392 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.392 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.392 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-10T23:36:47.392 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.392 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.392 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.392 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Prometheus container image", 2024-09-10T23:36:47.392 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.392 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.392 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.393 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.393 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_base": { 2024-09-10T23:36:47.393 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_base", 2024-09-10T23:36:47.393 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.393 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.393 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.393 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T23:36:47.393 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.393 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.393 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.393 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Container image name, without the tag", 2024-09-10T23:36:47.393 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.393 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.393 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.393 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.394 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_elasticsearch": { 2024-09-10T23:36:47.394 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_elasticsearch", 2024-09-10T23:36:47.394 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.394 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.394 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.394 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T23:36:47.394 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.394 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.394 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.394 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "elasticsearch container image", 2024-09-10T23:36:47.394 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.394 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.395 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.395 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.395 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_grafana": { 2024-09-10T23:36:47.395 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_grafana", 2024-09-10T23:36:47.395 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.395 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.395 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.395 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-10T23:36:47.395 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.395 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.395 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.395 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Prometheus container image", 2024-09-10T23:36:47.395 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.396 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.396 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.396 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.396 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_haproxy": { 2024-09-10T23:36:47.396 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_haproxy", 2024-09-10T23:36:47.396 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.396 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.396 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.396 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T23:36:47.396 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.396 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.396 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.397 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "HAproxy container image", 2024-09-10T23:36:47.397 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.397 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.397 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.397 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.397 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_jaeger_agent": { 2024-09-10T23:36:47.397 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_jaeger_agent", 2024-09-10T23:36:47.397 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.397 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.397 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.397 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T23:36:47.397 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.397 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.398 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.398 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Jaeger agent container image", 2024-09-10T23:36:47.398 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.398 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.398 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.398 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.398 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_jaeger_collector": { 2024-09-10T23:36:47.398 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_jaeger_collector", 2024-09-10T23:36:47.398 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.398 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.398 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.398 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T23:36:47.398 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.399 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.399 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.399 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Jaeger collector container image", 2024-09-10T23:36:47.399 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.399 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.399 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.399 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.399 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_jaeger_query": { 2024-09-10T23:36:47.399 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_jaeger_query", 2024-09-10T23:36:47.399 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.399 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.399 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.399 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T23:36:47.399 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.399 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.400 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.400 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Jaeger query container image", 2024-09-10T23:36:47.400 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.400 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.400 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.400 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.400 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_keepalived": { 2024-09-10T23:36:47.400 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_keepalived", 2024-09-10T23:36:47.400 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.400 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.400 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.400 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T23:36:47.400 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.401 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.401 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.401 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Keepalived container image", 2024-09-10T23:36:47.401 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.401 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.401 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.401 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.401 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_loki": { 2024-09-10T23:36:47.401 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_loki", 2024-09-10T23:36:47.401 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.401 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.401 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.401 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T23:36:47.401 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.401 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.402 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.402 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Loki container image", 2024-09-10T23:36:47.402 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.402 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.402 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.402 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.402 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_nginx": { 2024-09-10T23:36:47.402 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_nginx", 2024-09-10T23:36:47.402 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.402 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.402 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.402 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-10T23:36:47.402 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.402 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.402 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.403 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Nginx container image", 2024-09-10T23:36:47.403 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.403 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.403 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.403 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.403 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_node_exporter": { 2024-09-10T23:36:47.403 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_node_exporter", 2024-09-10T23:36:47.403 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.403 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.403 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.403 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-10T23:36:47.403 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.403 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.403 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.404 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Prometheus container image", 2024-09-10T23:36:47.404 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.404 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.404 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.404 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.404 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_nvmeof": { 2024-09-10T23:36:47.404 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_nvmeof", 2024-09-10T23:36:47.404 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.404 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.404 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.404 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-10T23:36:47.404 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.404 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.404 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.404 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Nvme-of container image", 2024-09-10T23:36:47.405 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.405 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.405 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.405 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.405 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_oauth2_proxy": { 2024-09-10T23:36:47.405 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_oauth2_proxy", 2024-09-10T23:36:47.405 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.405 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.405 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.405 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-10T23:36:47.405 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.405 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.405 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.406 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "oauth2-proxy container image", 2024-09-10T23:36:47.406 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.406 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.406 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.406 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.406 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_prometheus": { 2024-09-10T23:36:47.406 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_prometheus", 2024-09-10T23:36:47.406 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.406 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.406 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.406 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-10T23:36:47.406 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.407 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.407 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.407 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Prometheus container image", 2024-09-10T23:36:47.407 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.407 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.407 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.407 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.407 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_promtail": { 2024-09-10T23:36:47.407 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_promtail", 2024-09-10T23:36:47.407 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.407 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.407 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.407 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T23:36:47.408 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.408 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.408 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.408 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Promtail container image", 2024-09-10T23:36:47.408 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.408 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.408 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.408 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.408 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_samba": { 2024-09-10T23:36:47.408 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_samba", 2024-09-10T23:36:47.408 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.408 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.408 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.409 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T23:36:47.409 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.409 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.409 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.409 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Samba/SMB container image", 2024-09-10T23:36:47.409 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.409 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.409 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.409 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.409 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_samba_metrics": { 2024-09-10T23:36:47.409 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_samba_metrics", 2024-09-10T23:36:47.409 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.410 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.410 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.410 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-10T23:36:47.410 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.410 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.410 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.410 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-10T23:36:47.410 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.410 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.410 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.410 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.410 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_snmp_gateway": { 2024-09-10T23:36:47.410 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_snmp_gateway", 2024-09-10T23:36:47.411 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.411 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.411 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.411 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T23:36:47.411 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.411 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.411 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.411 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "SNMP Gateway container image", 2024-09-10T23:36:47.411 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.411 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.411 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.411 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.411 INFO:teuthology.orchestra.run.smithi003.stdout: "container_init": { 2024-09-10T23:36:47.411 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_init", 2024-09-10T23:36:47.412 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.412 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.412 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.412 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.412 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.412 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.412 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.412 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T23:36:47.412 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.412 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.412 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.412 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.412 INFO:teuthology.orchestra.run.smithi003.stdout: "daemon_cache_timeout": { 2024-09-10T23:36:47.413 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "daemon_cache_timeout", 2024-09-10T23:36:47.413 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:47.413 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.413 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.413 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "600", 2024-09-10T23:36:47.413 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.413 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.413 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.413 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T23:36:47.413 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.413 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.413 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.413 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.413 INFO:teuthology.orchestra.run.smithi003.stdout: "default_cephadm_command_timeout": { 2024-09-10T23:36:47.413 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T23:36:47.414 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.414 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.414 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.414 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "900", 2024-09-10T23:36:47.414 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.414 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.414 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.414 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T23:36:47.414 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.414 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.414 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.414 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.414 INFO:teuthology.orchestra.run.smithi003.stdout: "default_registry": { 2024-09-10T23:36:47.414 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "default_registry", 2024-09-10T23:36:47.415 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.415 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.415 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.415 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "docker.io", 2024-09-10T23:36:47.415 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.415 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.415 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.415 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T23:36:47.415 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.415 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.415 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.415 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.416 INFO:teuthology.orchestra.run.smithi003.stdout: "device_cache_timeout": { 2024-09-10T23:36:47.416 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "device_cache_timeout", 2024-09-10T23:36:47.416 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:47.416 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.416 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.416 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "1800", 2024-09-10T23:36:47.416 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.416 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.416 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.416 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "seconds to cache device inventory", 2024-09-10T23:36:47.416 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.416 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.416 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.417 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.417 INFO:teuthology.orchestra.run.smithi003.stdout: "device_enhanced_scan": { 2024-09-10T23:36:47.417 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "device_enhanced_scan", 2024-09-10T23:36:47.417 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.417 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.417 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.417 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.417 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.417 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.417 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.417 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T23:36:47.417 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.417 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.418 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.418 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.418 INFO:teuthology.orchestra.run.smithi003.stdout: "facts_cache_timeout": { 2024-09-10T23:36:47.418 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "facts_cache_timeout", 2024-09-10T23:36:47.418 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:47.418 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.418 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.418 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "60", 2024-09-10T23:36:47.418 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.418 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.418 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.418 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "seconds to cache host facts data", 2024-09-10T23:36:47.418 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.419 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.419 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.419 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.419 INFO:teuthology.orchestra.run.smithi003.stdout: "grafana_dashboards_path": { 2024-09-10T23:36:47.419 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "grafana_dashboards_path", 2024-09-10T23:36:47.419 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.419 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.419 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.419 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T23:36:47.419 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.419 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.419 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.420 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T23:36:47.420 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.420 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.420 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.420 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.420 INFO:teuthology.orchestra.run.smithi003.stdout: "host_check_interval": { 2024-09-10T23:36:47.420 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "host_check_interval", 2024-09-10T23:36:47.420 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:47.420 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.420 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.420 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "600", 2024-09-10T23:36:47.420 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.421 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.421 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.421 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how frequently to perform a host check", 2024-09-10T23:36:47.421 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.421 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.421 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.421 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.421 INFO:teuthology.orchestra.run.smithi003.stdout: "hw_monitoring": { 2024-09-10T23:36:47.421 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "hw_monitoring", 2024-09-10T23:36:47.421 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.421 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.422 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.422 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.422 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.422 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.422 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.422 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T23:36:47.422 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.422 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.422 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.422 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.422 INFO:teuthology.orchestra.run.smithi003.stdout: "inventory_list_all": { 2024-09-10T23:36:47.422 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "inventory_list_all", 2024-09-10T23:36:47.422 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.422 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.423 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.423 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.423 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.423 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.423 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.423 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T23:36:47.423 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.423 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.423 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.423 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.423 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.423 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.423 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.423 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.424 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.424 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.424 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.424 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.424 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.424 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.424 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.424 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.424 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.424 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.424 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.424 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.424 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.424 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.424 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.425 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.425 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.425 INFO:teuthology.orchestra.run.smithi003.stdout: "log_refresh_metadata": { 2024-09-10T23:36:47.425 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_refresh_metadata", 2024-09-10T23:36:47.425 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.425 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.425 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.425 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.425 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.425 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.425 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.425 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T23:36:47.426 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.426 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.426 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.426 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.426 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.426 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.426 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.426 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.426 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.426 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.426 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.426 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.426 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.426 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T23:36:47.426 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.427 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.427 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.427 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.427 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.427 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.427 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.427 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.427 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.427 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.427 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.427 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.427 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.427 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.427 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.428 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.428 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.428 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.428 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.428 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.428 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.428 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.428 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.428 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.428 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.428 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.428 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.428 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.428 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.429 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.429 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.429 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.429 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.429 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.429 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.429 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.429 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.429 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.429 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.429 INFO:teuthology.orchestra.run.smithi003.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T23:36:47.429 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T23:36:47.429 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.429 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.430 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.430 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.430 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.430 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.430 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.430 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T23:36:47.430 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.430 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.430 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.430 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.430 INFO:teuthology.orchestra.run.smithi003.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T23:36:47.430 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T23:36:47.430 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.431 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.431 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.431 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "*", 2024-09-10T23:36:47.431 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.431 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.431 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.431 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T23:36:47.431 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.431 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.431 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.431 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.431 INFO:teuthology.orchestra.run.smithi003.stdout: "max_count_per_host": { 2024-09-10T23:36:47.431 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "max_count_per_host", 2024-09-10T23:36:47.431 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.431 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.431 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.432 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-10T23:36:47.432 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.432 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.432 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.432 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "max number of daemons per service per host", 2024-09-10T23:36:47.432 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.432 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.432 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.432 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.432 INFO:teuthology.orchestra.run.smithi003.stdout: "max_osd_draining_count": { 2024-09-10T23:36:47.432 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "max_osd_draining_count", 2024-09-10T23:36:47.432 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.432 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.432 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.433 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-10T23:36:47.433 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.433 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.433 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.433 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T23:36:47.433 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.433 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.433 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.433 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.433 INFO:teuthology.orchestra.run.smithi003.stdout: "migration_current": { 2024-09-10T23:36:47.433 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "migration_current", 2024-09-10T23:36:47.433 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.433 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.433 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.433 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.434 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.434 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.434 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.434 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "internal - do not modify", 2024-09-10T23:36:47.434 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.434 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.434 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.434 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.434 INFO:teuthology.orchestra.run.smithi003.stdout: "mode": { 2024-09-10T23:36:47.434 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mode", 2024-09-10T23:36:47.434 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.434 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.434 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.434 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "root", 2024-09-10T23:36:47.434 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.435 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.435 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.435 INFO:teuthology.orchestra.run.smithi003.stdout: "cephadm-package", 2024-09-10T23:36:47.435 INFO:teuthology.orchestra.run.smithi003.stdout: "root" 2024-09-10T23:36:47.435 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.435 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T23:36:47.435 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.435 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.435 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.435 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.435 INFO:teuthology.orchestra.run.smithi003.stdout: "oob_default_addr": { 2024-09-10T23:36:47.435 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "oob_default_addr", 2024-09-10T23:36:47.435 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.435 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.436 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.436 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "169.254.1.1", 2024-09-10T23:36:47.436 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.436 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.436 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.436 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T23:36:47.436 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.436 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.436 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.436 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.436 INFO:teuthology.orchestra.run.smithi003.stdout: "prometheus_alerts_path": { 2024-09-10T23:36:47.436 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "prometheus_alerts_path", 2024-09-10T23:36:47.436 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.436 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.437 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.437 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T23:36:47.437 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.437 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.437 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.437 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T23:36:47.437 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.437 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.437 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.437 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.437 INFO:teuthology.orchestra.run.smithi003.stdout: "registry_insecure": { 2024-09-10T23:36:47.437 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "registry_insecure", 2024-09-10T23:36:47.437 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.437 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.438 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.438 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.438 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.438 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.438 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.438 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T23:36:47.438 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.438 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.438 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.438 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.438 INFO:teuthology.orchestra.run.smithi003.stdout: "registry_password": { 2024-09-10T23:36:47.438 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "registry_password", 2024-09-10T23:36:47.438 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.438 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.438 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.439 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.439 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.439 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.439 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.439 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T23:36:47.439 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.439 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.439 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.439 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.439 INFO:teuthology.orchestra.run.smithi003.stdout: "registry_url": { 2024-09-10T23:36:47.439 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "registry_url", 2024-09-10T23:36:47.439 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.439 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.439 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.439 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.439 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.440 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.440 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.440 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T23:36:47.440 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.440 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.440 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.440 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.440 INFO:teuthology.orchestra.run.smithi003.stdout: "registry_username": { 2024-09-10T23:36:47.440 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "registry_username", 2024-09-10T23:36:47.440 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.440 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.440 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.440 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.440 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.440 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.441 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.441 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T23:36:47.441 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.441 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.441 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.441 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.441 INFO:teuthology.orchestra.run.smithi003.stdout: "secure_monitoring_stack": { 2024-09-10T23:36:47.441 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "secure_monitoring_stack", 2024-09-10T23:36:47.441 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.441 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.441 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.441 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.441 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.441 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.441 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.442 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T23:36:47.442 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.442 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.442 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.442 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.442 INFO:teuthology.orchestra.run.smithi003.stdout: "service_discovery_port": { 2024-09-10T23:36:47.442 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "service_discovery_port", 2024-09-10T23:36:47.442 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.442 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.442 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.442 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "8765", 2024-09-10T23:36:47.442 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.442 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.442 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.442 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "cephadm service discovery port", 2024-09-10T23:36:47.443 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.443 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.443 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.443 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.443 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.443 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.443 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.443 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.443 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.443 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.443 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.443 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.443 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.444 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.444 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.444 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.444 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.444 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.444 INFO:teuthology.orchestra.run.smithi003.stdout: "ssh_config_file": { 2024-09-10T23:36:47.444 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ssh_config_file", 2024-09-10T23:36:47.444 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.444 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.444 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.444 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.445 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.445 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.445 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.445 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T23:36:47.445 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.445 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.445 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.445 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.445 INFO:teuthology.orchestra.run.smithi003.stdout: "use_agent": { 2024-09-10T23:36:47.445 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "use_agent", 2024-09-10T23:36:47.445 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.445 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.445 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.446 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.446 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.446 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.446 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.446 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T23:36:47.446 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.446 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.446 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.446 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.446 INFO:teuthology.orchestra.run.smithi003.stdout: "use_repo_digest": { 2024-09-10T23:36:47.446 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "use_repo_digest", 2024-09-10T23:36:47.446 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.446 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.447 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.447 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.447 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.447 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.447 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.447 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T23:36:47.447 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.447 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.447 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.447 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.447 INFO:teuthology.orchestra.run.smithi003.stdout: "warn_on_failed_host_check": { 2024-09-10T23:36:47.447 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "warn_on_failed_host_check", 2024-09-10T23:36:47.447 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.447 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.447 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.448 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.448 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.448 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.448 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.448 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T23:36:47.448 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.448 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.448 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.448 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.448 INFO:teuthology.orchestra.run.smithi003.stdout: "warn_on_stray_daemons": { 2024-09-10T23:36:47.448 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "warn_on_stray_daemons", 2024-09-10T23:36:47.448 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.449 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.449 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.449 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.449 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.449 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.449 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.449 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T23:36:47.449 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.449 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.449 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.449 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.449 INFO:teuthology.orchestra.run.smithi003.stdout: "warn_on_stray_hosts": { 2024-09-10T23:36:47.449 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "warn_on_stray_hosts", 2024-09-10T23:36:47.449 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.450 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.450 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.450 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.450 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.450 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.450 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.450 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T23:36:47.450 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.450 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.450 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.450 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.450 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.450 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.451 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.451 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crash", 2024-09-10T23:36:47.451 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.451 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.451 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.451 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.451 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.451 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.451 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.451 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.451 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.451 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.451 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.451 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.452 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.452 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.452 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.452 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.452 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.452 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.452 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.452 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.452 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.452 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.452 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.452 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.453 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.453 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.453 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.453 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.453 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.453 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.453 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.453 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.453 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.453 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.453 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.453 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.453 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.453 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.454 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.454 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.454 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.454 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.454 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.454 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.454 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.454 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.454 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.454 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.454 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.454 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.454 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.454 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.455 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.455 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.455 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.455 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.455 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.455 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.455 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.455 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.455 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.455 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.455 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.455 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.455 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.456 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.456 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.456 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.456 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.456 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.456 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.456 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.456 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.456 INFO:teuthology.orchestra.run.smithi003.stdout: "retain_interval": { 2024-09-10T23:36:47.456 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "retain_interval", 2024-09-10T23:36:47.456 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:47.456 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.456 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.456 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "31536000", 2024-09-10T23:36:47.457 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.457 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.457 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.457 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T23:36:47.457 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.457 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.457 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.457 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.457 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.457 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.457 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.457 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.457 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.458 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.458 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.458 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.458 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.458 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.458 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.458 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.458 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.458 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.458 INFO:teuthology.orchestra.run.smithi003.stdout: "warn_recent_interval": { 2024-09-10T23:36:47.458 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "warn_recent_interval", 2024-09-10T23:36:47.458 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:47.459 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.459 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.459 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "1209600", 2024-09-10T23:36:47.459 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.459 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.459 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.459 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T23:36:47.459 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.459 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.459 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.459 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.459 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.459 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.460 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.460 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "dashboard", 2024-09-10T23:36:47.460 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.460 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.460 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.460 INFO:teuthology.orchestra.run.smithi003.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T23:36:47.460 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T23:36:47.460 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.460 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.460 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.460 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-10T23:36:47.460 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.460 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.461 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.461 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.461 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.461 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.461 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.461 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.461 INFO:teuthology.orchestra.run.smithi003.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T23:36:47.461 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T23:36:47.461 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.461 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.461 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.461 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.461 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.461 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.462 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.462 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.462 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.462 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.462 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.462 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.462 INFO:teuthology.orchestra.run.smithi003.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T23:36:47.462 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T23:36:47.462 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.462 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.462 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.462 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.462 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.462 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.463 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.463 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.463 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.463 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.463 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.463 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.463 INFO:teuthology.orchestra.run.smithi003.stdout: "AUDIT_API_ENABLED": { 2024-09-10T23:36:47.463 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T23:36:47.463 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.463 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.463 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.463 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.463 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.463 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.464 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.464 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.464 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.464 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.464 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.464 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.464 INFO:teuthology.orchestra.run.smithi003.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T23:36:47.464 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T23:36:47.464 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.464 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.464 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.464 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.464 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.465 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.465 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.465 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.465 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.465 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.465 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.465 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.465 INFO:teuthology.orchestra.run.smithi003.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T23:36:47.465 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T23:36:47.465 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.465 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.465 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.465 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.466 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.466 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.466 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.466 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.466 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.466 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.466 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.466 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.466 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T23:36:47.466 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T23:36:47.466 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.466 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.466 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.467 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.467 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.467 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.467 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.467 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.467 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.467 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.467 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.467 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.467 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T23:36:47.467 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T23:36:47.467 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.467 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.467 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.468 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.468 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.468 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.468 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.468 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.468 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.468 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.468 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.468 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.468 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T23:36:47.468 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T23:36:47.468 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.468 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.468 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.468 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.469 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.469 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.469 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.469 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.469 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.469 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.469 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.469 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.469 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T23:36:47.469 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T23:36:47.469 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.469 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.469 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.469 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.469 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.470 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.470 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.470 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.470 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.470 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.470 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.470 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.470 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T23:36:47.470 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T23:36:47.470 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.470 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.470 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.470 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.470 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.470 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.471 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.471 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.471 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.471 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.471 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.471 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.471 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T23:36:47.471 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T23:36:47.471 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.471 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.471 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.471 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.471 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.471 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.471 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.472 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.472 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.472 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.472 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.472 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.472 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T23:36:47.472 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T23:36:47.472 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.472 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.472 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.472 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.472 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.473 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.473 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.473 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.473 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.473 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.473 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.473 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.473 INFO:teuthology.orchestra.run.smithi003.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T23:36:47.473 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T23:36:47.473 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.473 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.473 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.473 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.473 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.474 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.474 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.474 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.474 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.474 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.474 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.474 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.474 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T23:36:47.474 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T23:36:47.474 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.474 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.474 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.474 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "admin", 2024-09-10T23:36:47.474 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.475 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.475 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.475 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.475 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.475 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.475 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.475 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.475 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T23:36:47.475 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T23:36:47.475 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.475 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.475 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.476 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.476 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.476 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.476 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.476 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.476 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.476 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.476 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.476 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.476 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_API_URL": { 2024-09-10T23:36:47.476 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_API_URL", 2024-09-10T23:36:47.476 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.477 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.477 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.477 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.477 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.477 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.477 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.477 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.477 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.477 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.477 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.477 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.478 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T23:36:47.478 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T23:36:47.478 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.478 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.478 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.478 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "admin", 2024-09-10T23:36:47.478 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.478 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.478 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.478 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.478 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.478 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.478 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.478 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.479 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T23:36:47.479 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T23:36:47.479 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.479 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.479 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.479 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.479 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.479 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.479 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.479 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.479 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.479 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.479 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.479 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.480 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T23:36:47.480 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T23:36:47.480 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.480 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.480 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.480 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.480 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.480 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.480 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.480 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.480 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.480 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.480 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.481 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.481 INFO:teuthology.orchestra.run.smithi003.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T23:36:47.481 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T23:36:47.481 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.481 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.481 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.481 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.481 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.481 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.481 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.481 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.481 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.481 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.481 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.482 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.482 INFO:teuthology.orchestra.run.smithi003.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T23:36:47.482 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T23:36:47.482 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.482 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.482 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.482 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.482 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.482 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.482 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.482 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.482 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.482 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.482 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.482 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.483 INFO:teuthology.orchestra.run.smithi003.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-10T23:36:47.483 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-10T23:36:47.483 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.483 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.483 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.483 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "[]", 2024-09-10T23:36:47.483 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.483 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.483 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.483 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.483 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.483 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.483 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.483 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.484 INFO:teuthology.orchestra.run.smithi003.stdout: "MULTICLUSTER_CONFIG": { 2024-09-10T23:36:47.484 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-10T23:36:47.484 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.484 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.484 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.484 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "{}", 2024-09-10T23:36:47.484 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.484 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.484 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.484 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.484 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.484 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.484 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.484 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.485 INFO:teuthology.orchestra.run.smithi003.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T23:36:47.485 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T23:36:47.485 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.485 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.485 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.485 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.485 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.485 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.485 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.485 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.485 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.485 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.485 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.485 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.486 INFO:teuthology.orchestra.run.smithi003.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T23:36:47.486 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T23:36:47.486 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.486 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.486 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.486 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.486 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.486 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.486 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.486 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.486 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.486 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.487 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.487 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.487 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T23:36:47.487 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T23:36:47.487 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.487 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.487 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.487 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.487 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.487 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.487 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.487 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.487 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.488 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.488 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.488 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.488 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T23:36:47.488 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T23:36:47.488 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.488 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.488 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.488 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.488 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.488 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.488 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.488 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.488 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.489 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.489 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.489 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.489 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T23:36:47.489 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T23:36:47.489 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.489 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.489 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.489 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.490 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.490 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.490 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.490 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.490 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.490 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.490 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.490 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.490 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T23:36:47.490 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T23:36:47.490 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.490 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.490 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.490 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.491 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.491 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.491 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.491 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.491 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.491 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.491 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.491 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.491 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T23:36:47.491 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T23:36:47.491 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.491 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.491 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.491 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.492 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.492 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.492 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.492 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.492 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.492 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.492 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.492 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.492 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T23:36:47.492 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T23:36:47.492 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.492 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.492 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.492 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.493 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.493 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.493 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.493 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.493 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.493 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.493 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.493 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.493 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T23:36:47.493 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T23:36:47.493 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.493 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.493 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.494 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.494 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.494 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.494 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.494 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.494 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.494 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.494 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.494 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.494 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T23:36:47.494 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T23:36:47.494 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.494 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.494 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.495 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.495 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.495 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.495 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.495 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.495 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.495 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.495 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.495 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.495 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T23:36:47.495 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T23:36:47.495 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.496 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.496 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.496 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T23:36:47.496 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.496 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.496 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.496 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.496 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.496 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.496 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.496 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.496 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T23:36:47.496 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T23:36:47.497 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.497 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.497 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.497 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-10T23:36:47.497 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.497 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.497 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.497 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.497 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.497 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.497 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.497 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.497 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T23:36:47.497 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T23:36:47.498 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.498 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.498 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.498 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "8", 2024-09-10T23:36:47.498 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.498 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.498 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.498 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.498 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.498 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.498 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.498 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.498 INFO:teuthology.orchestra.run.smithi003.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T23:36:47.498 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T23:36:47.498 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.499 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.499 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.499 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "45", 2024-09-10T23:36:47.499 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.499 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.499 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.499 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.499 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.499 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.499 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.499 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.499 INFO:teuthology.orchestra.run.smithi003.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T23:36:47.500 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T23:36:47.500 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.500 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.500 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.500 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.500 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.500 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.500 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.500 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.500 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.500 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.500 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.500 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.500 INFO:teuthology.orchestra.run.smithi003.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T23:36:47.501 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T23:36:47.501 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.501 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.501 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.501 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "admin", 2024-09-10T23:36:47.501 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.501 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.501 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.501 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.501 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.501 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.501 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.501 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.501 INFO:teuthology.orchestra.run.smithi003.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T23:36:47.502 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T23:36:47.502 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.502 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.502 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.502 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.502 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.502 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.502 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.502 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.502 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.502 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.502 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.502 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.502 INFO:teuthology.orchestra.run.smithi003.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T23:36:47.503 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T23:36:47.503 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.503 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.503 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.503 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.503 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.503 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.503 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.503 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.503 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.503 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.503 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.503 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.503 INFO:teuthology.orchestra.run.smithi003.stdout: "UNSAFE_TLS_v1_2": { 2024-09-10T23:36:47.504 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-10T23:36:47.504 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.504 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.504 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.504 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.504 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.504 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.504 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.504 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.504 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.504 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.504 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.504 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.504 INFO:teuthology.orchestra.run.smithi003.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T23:36:47.505 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T23:36:47.505 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.505 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.505 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.505 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.505 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.505 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.505 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.505 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.505 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.505 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.505 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.505 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.505 INFO:teuthology.orchestra.run.smithi003.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T23:36:47.506 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T23:36:47.506 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.506 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.506 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.506 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-10T23:36:47.506 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.506 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.506 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.506 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.506 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.506 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.506 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.506 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.507 INFO:teuthology.orchestra.run.smithi003.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T23:36:47.507 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T23:36:47.507 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.507 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.507 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.507 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5", 2024-09-10T23:36:47.507 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.507 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.507 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.507 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.507 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.507 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.507 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.507 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.508 INFO:teuthology.orchestra.run.smithi003.stdout: "cross_origin_url": { 2024-09-10T23:36:47.508 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "cross_origin_url", 2024-09-10T23:36:47.508 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.508 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.508 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.508 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.508 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.508 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.508 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.508 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.508 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.508 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.508 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.508 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.508 INFO:teuthology.orchestra.run.smithi003.stdout: "crt_file": { 2024-09-10T23:36:47.509 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crt_file", 2024-09-10T23:36:47.509 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.509 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.509 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.509 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.509 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.509 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.509 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.509 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.509 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.509 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.509 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.509 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.509 INFO:teuthology.orchestra.run.smithi003.stdout: "debug": { 2024-09-10T23:36:47.510 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "debug", 2024-09-10T23:36:47.510 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.510 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.510 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.510 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.510 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.510 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.510 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.510 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Enable/disable debug options", 2024-09-10T23:36:47.510 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.510 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.510 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.510 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.510 INFO:teuthology.orchestra.run.smithi003.stdout: "jwt_token_ttl": { 2024-09-10T23:36:47.511 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "jwt_token_ttl", 2024-09-10T23:36:47.511 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.511 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.511 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.511 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "28800", 2024-09-10T23:36:47.511 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.511 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.511 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.511 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.511 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.511 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.511 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.511 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.511 INFO:teuthology.orchestra.run.smithi003.stdout: "key_file": { 2024-09-10T23:36:47.512 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "key_file", 2024-09-10T23:36:47.512 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.512 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.512 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.512 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.512 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.512 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.512 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.512 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.512 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.512 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.512 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.512 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.512 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.512 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.513 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.513 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.513 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.513 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.513 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.513 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.513 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.513 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.513 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.513 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.513 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.513 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.514 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.514 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.514 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.514 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.514 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.514 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.514 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.514 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.514 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.514 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.514 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.514 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.514 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.515 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.515 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.515 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.515 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.515 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.515 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.515 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.515 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.515 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.515 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.515 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.515 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.515 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.516 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.516 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.516 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.516 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.516 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.516 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.516 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.516 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.516 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.516 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.516 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.516 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.516 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.517 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.517 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.517 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.517 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.517 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.517 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.517 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.517 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.517 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.517 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.517 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.517 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.517 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.517 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.518 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.518 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.518 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.518 INFO:teuthology.orchestra.run.smithi003.stdout: "motd": { 2024-09-10T23:36:47.518 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "motd", 2024-09-10T23:36:47.518 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.518 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.518 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.518 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.518 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.518 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.518 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.518 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "The message of the day", 2024-09-10T23:36:47.519 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.519 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.519 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.519 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.519 INFO:teuthology.orchestra.run.smithi003.stdout: "redirect_resolve_ip_addr": { 2024-09-10T23:36:47.519 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T23:36:47.519 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.519 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.519 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.519 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.519 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.519 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.519 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.519 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.520 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.520 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.520 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.520 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.520 INFO:teuthology.orchestra.run.smithi003.stdout: "server_addr": { 2024-09-10T23:36:47.520 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_addr", 2024-09-10T23:36:47.520 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.520 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.520 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.520 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "::", 2024-09-10T23:36:47.520 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.520 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.520 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.520 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.521 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.521 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.521 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.521 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.521 INFO:teuthology.orchestra.run.smithi003.stdout: "server_port": { 2024-09-10T23:36:47.521 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_port", 2024-09-10T23:36:47.521 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.521 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.521 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.521 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "8080", 2024-09-10T23:36:47.524 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.524 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.524 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.524 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.524 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.524 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.524 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.524 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.524 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.524 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.524 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.524 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.525 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.525 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.525 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.525 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.525 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.525 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.525 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.525 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.525 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.525 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.525 INFO:teuthology.orchestra.run.smithi003.stdout: "ssl": { 2024-09-10T23:36:47.525 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ssl", 2024-09-10T23:36:47.525 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.526 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.526 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.526 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.526 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.526 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.526 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.526 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.526 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.526 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.526 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.526 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.526 INFO:teuthology.orchestra.run.smithi003.stdout: "ssl_server_port": { 2024-09-10T23:36:47.526 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ssl_server_port", 2024-09-10T23:36:47.526 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.527 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.527 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.527 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "8443", 2024-09-10T23:36:47.527 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.527 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.527 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.527 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.527 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.527 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.527 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.527 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.527 INFO:teuthology.orchestra.run.smithi003.stdout: "standby_behaviour": { 2024-09-10T23:36:47.527 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "standby_behaviour", 2024-09-10T23:36:47.527 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.527 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.528 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.528 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "redirect", 2024-09-10T23:36:47.528 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.528 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.528 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.528 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.528 INFO:teuthology.orchestra.run.smithi003.stdout: "redirect" 2024-09-10T23:36:47.528 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.528 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.528 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.528 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.528 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.528 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.528 INFO:teuthology.orchestra.run.smithi003.stdout: "standby_error_status_code": { 2024-09-10T23:36:47.529 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "standby_error_status_code", 2024-09-10T23:36:47.529 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.529 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.529 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.529 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "500", 2024-09-10T23:36:47.529 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "400", 2024-09-10T23:36:47.529 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "599", 2024-09-10T23:36:47.529 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.529 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.529 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.529 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.530 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.530 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.530 INFO:teuthology.orchestra.run.smithi003.stdout: "url_prefix": { 2024-09-10T23:36:47.530 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "url_prefix", 2024-09-10T23:36:47.530 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.530 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.530 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.530 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.530 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.530 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.530 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.530 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.530 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.530 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.531 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.531 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.531 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.531 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.531 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.531 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "devicehealth", 2024-09-10T23:36:47.531 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.531 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.531 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.531 INFO:teuthology.orchestra.run.smithi003.stdout: "enable_monitoring": { 2024-09-10T23:36:47.531 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "enable_monitoring", 2024-09-10T23:36:47.531 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.531 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.531 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.532 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.532 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.532 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.532 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.532 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "monitor device health metrics", 2024-09-10T23:36:47.532 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.532 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.532 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.532 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.532 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.532 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.532 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.532 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.532 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.533 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.533 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.533 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.533 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.533 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.533 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.533 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.533 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.533 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.533 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.533 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.533 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.533 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.533 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.534 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.534 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.534 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.534 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.534 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.534 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.534 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.534 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.534 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.534 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.534 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.534 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.534 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.535 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.535 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.535 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.535 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.535 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.535 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.535 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.535 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.535 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.535 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.536 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.536 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.536 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.536 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.536 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.536 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.536 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.536 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.536 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.536 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.536 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.536 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.536 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.537 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.537 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.537 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.537 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.537 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.537 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.537 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.537 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.537 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.537 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.537 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.537 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.537 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.538 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.538 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.538 INFO:teuthology.orchestra.run.smithi003.stdout: "mark_out_threshold": { 2024-09-10T23:36:47.538 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mark_out_threshold", 2024-09-10T23:36:47.538 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:47.538 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.538 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.538 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "2419200", 2024-09-10T23:36:47.538 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.538 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.538 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.538 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T23:36:47.538 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.539 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.539 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.539 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.539 INFO:teuthology.orchestra.run.smithi003.stdout: "pool_name": { 2024-09-10T23:36:47.539 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "pool_name", 2024-09-10T23:36:47.539 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.539 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.539 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.539 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "device_health_metrics", 2024-09-10T23:36:47.539 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.539 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.539 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.539 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T23:36:47.540 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.540 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.540 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.540 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.540 INFO:teuthology.orchestra.run.smithi003.stdout: "retention_period": { 2024-09-10T23:36:47.540 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "retention_period", 2024-09-10T23:36:47.540 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:47.540 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.540 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.540 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "15552000", 2024-09-10T23:36:47.540 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.540 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.540 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.541 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how long to retain device health metrics", 2024-09-10T23:36:47.541 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.541 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.541 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.541 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.541 INFO:teuthology.orchestra.run.smithi003.stdout: "scrape_frequency": { 2024-09-10T23:36:47.541 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "scrape_frequency", 2024-09-10T23:36:47.541 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:47.541 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.541 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.541 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "86400", 2024-09-10T23:36:47.541 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.541 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.541 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.542 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T23:36:47.542 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.542 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.542 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.542 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.542 INFO:teuthology.orchestra.run.smithi003.stdout: "self_heal": { 2024-09-10T23:36:47.542 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "self_heal", 2024-09-10T23:36:47.542 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.542 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.542 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.542 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.542 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.542 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.542 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.543 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T23:36:47.543 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.543 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.543 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.543 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.543 INFO:teuthology.orchestra.run.smithi003.stdout: "sleep_interval": { 2024-09-10T23:36:47.543 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sleep_interval", 2024-09-10T23:36:47.543 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:47.543 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.543 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.543 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "600", 2024-09-10T23:36:47.543 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.543 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.544 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.544 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T23:36:47.544 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.544 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.544 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.544 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.544 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.544 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.544 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.544 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.544 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.544 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.544 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.544 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.545 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.545 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.545 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.545 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.545 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.545 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.545 INFO:teuthology.orchestra.run.smithi003.stdout: "warn_threshold": { 2024-09-10T23:36:47.545 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "warn_threshold", 2024-09-10T23:36:47.545 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:47.545 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.545 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.545 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "7257600", 2024-09-10T23:36:47.545 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.545 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.546 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.546 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T23:36:47.546 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.546 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.546 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.546 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.546 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.546 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.546 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.546 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "diskprediction_local", 2024-09-10T23:36:47.546 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.546 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.546 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.547 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.547 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.547 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.547 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.547 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.547 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.547 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.547 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.547 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.547 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.547 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.547 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.547 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.547 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.548 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.548 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.548 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.548 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.548 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.548 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.548 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.548 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.548 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.548 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.548 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.548 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.548 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.549 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.549 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.549 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.549 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.549 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.549 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.549 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.549 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.549 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.549 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.549 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.549 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.549 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.549 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.550 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.550 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.550 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.550 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.550 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.550 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.550 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.550 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.550 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.550 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.550 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.550 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.550 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.550 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.551 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.551 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.551 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.551 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.551 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.551 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.551 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.551 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.551 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.551 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.551 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.551 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.551 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.551 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.552 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.552 INFO:teuthology.orchestra.run.smithi003.stdout: "predict_interval": { 2024-09-10T23:36:47.552 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "predict_interval", 2024-09-10T23:36:47.552 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.552 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.552 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.552 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "86400", 2024-09-10T23:36:47.552 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.552 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.552 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.552 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.552 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.552 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.552 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.552 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.553 INFO:teuthology.orchestra.run.smithi003.stdout: "predictor_model": { 2024-09-10T23:36:47.553 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "predictor_model", 2024-09-10T23:36:47.553 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.553 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.553 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.553 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "prophetstor", 2024-09-10T23:36:47.553 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.553 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.553 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.553 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.553 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.553 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.553 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.553 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.554 INFO:teuthology.orchestra.run.smithi003.stdout: "sleep_interval": { 2024-09-10T23:36:47.554 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sleep_interval", 2024-09-10T23:36:47.554 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.554 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.554 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.554 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "600", 2024-09-10T23:36:47.554 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.554 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.554 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.554 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.554 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.554 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.554 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.554 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.554 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.555 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.555 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.555 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.555 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.555 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.555 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.555 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.555 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.555 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.555 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.555 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.555 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.555 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.555 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.556 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.556 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.556 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "influx", 2024-09-10T23:36:47.556 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": false, 2024-09-10T23:36:47.556 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "influxdb python module not found", 2024-09-10T23:36:47.556 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.556 INFO:teuthology.orchestra.run.smithi003.stdout: "batch_size": { 2024-09-10T23:36:47.556 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "batch_size", 2024-09-10T23:36:47.556 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.556 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.556 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.556 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5000", 2024-09-10T23:36:47.556 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.557 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.557 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.557 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T23:36:47.557 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.557 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.557 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.557 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.557 INFO:teuthology.orchestra.run.smithi003.stdout: "database": { 2024-09-10T23:36:47.557 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "database", 2024-09-10T23:36:47.557 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.557 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.557 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.557 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "ceph", 2024-09-10T23:36:47.558 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.558 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.558 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.558 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T23:36:47.558 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.558 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.558 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.558 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.558 INFO:teuthology.orchestra.run.smithi003.stdout: "hostname": { 2024-09-10T23:36:47.558 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "hostname", 2024-09-10T23:36:47.558 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.558 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.558 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.558 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.559 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.559 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.559 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.559 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "InfluxDB server hostname", 2024-09-10T23:36:47.559 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.559 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.559 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.559 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.559 INFO:teuthology.orchestra.run.smithi003.stdout: "interval": { 2024-09-10T23:36:47.559 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "interval", 2024-09-10T23:36:47.559 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:47.559 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.559 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.559 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "30", 2024-09-10T23:36:47.560 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "5", 2024-09-10T23:36:47.560 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.560 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.560 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T23:36:47.560 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.560 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.560 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.560 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.560 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.560 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.560 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.560 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.560 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.561 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.561 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.561 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.561 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.561 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.561 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.561 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.561 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.561 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.561 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.561 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.561 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.561 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.561 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.562 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.562 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.562 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.562 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.562 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.562 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.562 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.562 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.562 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.562 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.562 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.562 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.562 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.563 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.563 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.563 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.563 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.563 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.563 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.563 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.563 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.563 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.563 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.563 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.563 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.563 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.564 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.564 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.564 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.564 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.564 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.564 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.564 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.564 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.564 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.564 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.564 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.564 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.564 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.565 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.565 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.565 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.565 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.565 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.565 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.565 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.565 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.565 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.565 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.565 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.565 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.565 INFO:teuthology.orchestra.run.smithi003.stdout: "password": { 2024-09-10T23:36:47.566 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "password", 2024-09-10T23:36:47.566 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.566 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.566 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.566 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.566 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.566 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.566 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.566 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "password of InfluxDB server user", 2024-09-10T23:36:47.566 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.566 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.566 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.566 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.566 INFO:teuthology.orchestra.run.smithi003.stdout: "port": { 2024-09-10T23:36:47.567 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "port", 2024-09-10T23:36:47.567 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.567 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.567 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.567 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "8086", 2024-09-10T23:36:47.567 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.567 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.567 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.567 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "InfluxDB server port", 2024-09-10T23:36:47.567 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.567 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.567 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.567 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.568 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.568 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.568 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.568 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.568 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.568 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.568 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.568 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.568 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.568 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.568 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.568 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.568 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.569 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.569 INFO:teuthology.orchestra.run.smithi003.stdout: "ssl": { 2024-09-10T23:36:47.569 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ssl", 2024-09-10T23:36:47.569 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.569 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.569 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.569 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "false", 2024-09-10T23:36:47.569 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.569 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.569 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.569 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T23:36:47.569 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.569 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.569 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.570 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.570 INFO:teuthology.orchestra.run.smithi003.stdout: "threads": { 2024-09-10T23:36:47.570 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "threads", 2024-09-10T23:36:47.570 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.570 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.570 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.570 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5", 2024-09-10T23:36:47.570 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "1", 2024-09-10T23:36:47.570 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "32", 2024-09-10T23:36:47.570 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.570 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T23:36:47.570 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.570 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.570 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.570 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.571 INFO:teuthology.orchestra.run.smithi003.stdout: "username": { 2024-09-10T23:36:47.571 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "username", 2024-09-10T23:36:47.571 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.571 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.571 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.571 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.571 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.571 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.571 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.571 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "username of InfluxDB server user", 2024-09-10T23:36:47.571 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.571 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.572 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.572 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.572 INFO:teuthology.orchestra.run.smithi003.stdout: "verify_ssl": { 2024-09-10T23:36:47.572 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "verify_ssl", 2024-09-10T23:36:47.572 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.572 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.572 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.572 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "true", 2024-09-10T23:36:47.572 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.572 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.572 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.572 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T23:36:47.572 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.573 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.573 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.573 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.573 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.573 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.573 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.573 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "insights", 2024-09-10T23:36:47.573 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.573 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.573 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.573 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.573 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.573 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.573 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.574 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.574 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.574 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.574 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.574 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.574 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.574 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.574 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.574 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.574 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.574 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.574 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.574 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.574 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.575 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.575 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.575 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.575 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.575 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.575 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.575 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.575 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.575 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.575 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.575 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.575 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.575 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.576 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.576 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.576 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.576 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.576 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.576 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.576 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.576 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.576 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.576 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.576 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.576 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.576 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.577 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.577 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.577 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.577 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.577 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.577 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.577 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.577 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.578 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.578 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.578 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.578 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.578 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.578 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.578 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.578 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.578 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.578 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.578 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.578 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.579 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.579 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.579 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.579 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.579 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.579 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.579 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.579 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.579 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.579 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.579 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.579 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.579 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.579 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.579 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.580 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.580 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.580 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.580 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.580 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.580 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.580 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.580 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.580 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "iostat", 2024-09-10T23:36:47.580 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.580 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.580 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.580 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.580 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.580 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.581 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.581 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.581 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.581 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.581 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.581 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.581 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.581 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.581 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.581 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.581 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.581 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.581 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.581 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.581 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.582 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.582 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.582 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.582 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.582 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.582 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.582 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.582 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.582 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.582 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.582 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.582 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.582 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.582 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.583 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.583 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.583 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.583 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.583 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.583 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.583 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.583 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.583 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.583 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.583 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.583 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.583 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.583 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.583 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.584 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.584 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.584 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.584 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.584 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.584 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.584 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.584 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.584 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.584 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.584 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.584 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.584 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.584 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.585 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.585 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.585 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.585 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.585 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.585 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.585 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.585 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.585 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.585 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.585 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.585 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.586 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.586 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.586 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.586 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.586 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.586 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.586 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.586 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.586 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.586 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.586 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.586 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.586 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.586 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.586 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "k8sevents", 2024-09-10T23:36:47.587 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.587 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.587 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.587 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_event_retention_days": { 2024-09-10T23:36:47.587 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ceph_event_retention_days", 2024-09-10T23:36:47.587 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.587 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.587 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.587 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "7", 2024-09-10T23:36:47.587 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.587 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.587 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.587 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T23:36:47.588 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.588 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.588 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.588 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.588 INFO:teuthology.orchestra.run.smithi003.stdout: "config_check_secs": { 2024-09-10T23:36:47.588 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "config_check_secs", 2024-09-10T23:36:47.588 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.588 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.588 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.588 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-10T23:36:47.588 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "10", 2024-09-10T23:36:47.588 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.588 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.589 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T23:36:47.589 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.589 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.589 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.589 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.589 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.589 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.589 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.589 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.590 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.590 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.590 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.590 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.590 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.590 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.590 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.590 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.590 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.590 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.590 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.590 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.590 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.590 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.591 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.591 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.591 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.591 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.591 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.591 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.591 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.591 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.591 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.591 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.591 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.591 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.591 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.592 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.592 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.592 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.592 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.592 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.592 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.592 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.592 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.592 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.592 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.592 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.592 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.592 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.592 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.593 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.593 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.593 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.593 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.593 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.593 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.593 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.593 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.593 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.593 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.593 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.593 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.593 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.594 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.594 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.594 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.594 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.594 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.594 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.594 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.594 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.594 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.594 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.594 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.594 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.594 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.595 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.595 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.595 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.595 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.595 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.595 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.595 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.595 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.595 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.595 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.595 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.595 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.595 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.596 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.596 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.596 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.596 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "localpool", 2024-09-10T23:36:47.596 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.596 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.596 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.596 INFO:teuthology.orchestra.run.smithi003.stdout: "failure_domain": { 2024-09-10T23:36:47.596 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "failure_domain", 2024-09-10T23:36:47.596 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.596 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.596 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.596 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "host", 2024-09-10T23:36:47.596 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.597 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.597 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.597 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "failure domain for any created local pool", 2024-09-10T23:36:47.597 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T23:36:47.597 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.597 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.597 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.597 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.597 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.597 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.597 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.597 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.597 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.597 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.597 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.598 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.598 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.598 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.598 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.598 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.598 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.598 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.598 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.598 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.598 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.598 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.598 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.598 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.599 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.599 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.599 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.599 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.599 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.599 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.599 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.599 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.599 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.599 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.599 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.599 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.599 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.599 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.599 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.599 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.600 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.600 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.600 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.600 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.600 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.600 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.600 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.600 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.600 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.600 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.600 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.600 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.601 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.601 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.601 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.601 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.601 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.601 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.601 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.601 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.601 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.601 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.601 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.601 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.601 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.601 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.602 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.602 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.602 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.602 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.602 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.602 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.602 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.602 INFO:teuthology.orchestra.run.smithi003.stdout: "min_size": { 2024-09-10T23:36:47.602 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "min_size", 2024-09-10T23:36:47.602 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.602 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.602 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.602 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.603 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.603 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.603 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.603 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "default min_size for any created local pool", 2024-09-10T23:36:47.603 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T23:36:47.603 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.603 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.603 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.603 INFO:teuthology.orchestra.run.smithi003.stdout: "num_rep": { 2024-09-10T23:36:47.603 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "num_rep", 2024-09-10T23:36:47.603 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.603 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.603 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.604 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "3", 2024-09-10T23:36:47.604 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.604 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.604 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.604 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "default replica count for any created local pool", 2024-09-10T23:36:47.604 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.604 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.604 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.604 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.604 INFO:teuthology.orchestra.run.smithi003.stdout: "pg_num": { 2024-09-10T23:36:47.604 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "pg_num", 2024-09-10T23:36:47.604 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.604 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.605 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.605 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "128", 2024-09-10T23:36:47.605 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.605 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.605 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.605 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T23:36:47.605 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.605 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.605 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.605 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.605 INFO:teuthology.orchestra.run.smithi003.stdout: "prefix": { 2024-09-10T23:36:47.605 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "prefix", 2024-09-10T23:36:47.605 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.605 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.606 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.606 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.606 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.606 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.606 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.606 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "name prefix for any created local pool", 2024-09-10T23:36:47.606 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.606 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.606 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.606 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.606 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.606 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.606 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.606 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.607 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.607 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.607 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.607 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.607 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.607 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.607 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.607 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.607 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.607 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.607 INFO:teuthology.orchestra.run.smithi003.stdout: "subtree": { 2024-09-10T23:36:47.607 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "subtree", 2024-09-10T23:36:47.607 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.607 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.608 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.608 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "rack", 2024-09-10T23:36:47.608 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.608 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.608 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.608 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T23:36:47.608 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T23:36:47.608 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.608 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.608 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.608 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.608 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.608 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.609 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mds_autoscaler", 2024-09-10T23:36:47.609 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.609 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.609 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.609 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.609 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.609 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.609 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.609 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.609 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.609 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.609 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.609 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.609 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.610 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.610 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.610 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.610 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.610 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.610 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.610 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.610 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.610 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.610 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.610 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.610 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.610 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.610 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.610 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.611 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.611 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.611 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.611 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.611 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.611 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.611 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.611 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.611 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.611 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.611 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.611 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.611 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.611 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.612 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.612 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.612 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.612 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.612 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.612 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.612 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.612 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.612 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.612 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.612 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.612 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.612 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.613 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.613 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.613 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.613 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.613 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.613 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.613 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.613 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.613 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.613 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.613 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.613 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.613 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.613 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.614 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.614 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.614 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.614 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.614 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.614 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.614 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.614 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.614 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.614 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.614 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.614 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.614 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.614 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.615 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.615 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.615 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.615 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.615 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.615 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.615 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.615 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mirroring", 2024-09-10T23:36:47.615 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.615 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.615 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.615 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.615 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.615 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.616 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.616 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.616 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.616 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.616 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.616 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.616 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.616 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.616 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.616 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.616 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.616 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.616 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.617 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.617 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.617 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.617 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.617 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.617 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.617 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.617 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.617 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.617 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.617 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.617 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.617 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.618 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.618 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.618 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.618 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.618 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.618 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.618 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.618 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.618 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.618 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.618 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.618 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.618 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.619 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.619 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.619 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.619 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.619 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.619 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.619 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.619 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.619 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.619 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.619 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.619 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.619 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.619 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.620 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.620 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.620 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.620 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.620 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.620 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.620 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.620 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.620 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.620 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.620 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.620 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.620 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.621 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.621 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.621 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.621 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.621 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.621 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.621 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.621 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.621 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.621 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.621 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.621 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.622 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.622 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.622 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.622 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.622 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.622 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.622 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "nfs", 2024-09-10T23:36:47.622 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.622 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.622 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.622 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.622 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.622 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.623 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.623 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.623 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.623 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.623 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.623 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.623 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.623 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.623 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.623 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.623 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.623 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.623 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.624 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.624 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.624 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.624 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.624 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.624 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.624 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.624 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.624 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.624 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.624 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.624 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.624 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.624 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.625 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.625 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.625 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.625 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.625 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.625 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.625 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.625 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.625 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.625 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.625 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.625 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.625 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.625 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.625 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.626 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.626 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.626 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.626 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.626 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.626 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.626 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.626 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.626 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.626 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.626 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.626 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.626 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.627 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.627 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.627 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.627 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.627 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.627 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.627 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.627 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.627 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.627 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.627 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.627 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.627 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.628 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.628 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.628 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.628 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.628 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.628 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.628 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.628 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.628 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.628 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.628 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.628 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.629 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.629 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.629 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.629 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.629 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "orchestrator", 2024-09-10T23:36:47.629 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.629 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.629 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.629 INFO:teuthology.orchestra.run.smithi003.stdout: "fail_fs": { 2024-09-10T23:36:47.629 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "fail_fs", 2024-09-10T23:36:47.629 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.629 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.629 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.630 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.630 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.630 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.630 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.630 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T23:36:47.630 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.630 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.630 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.630 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.630 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.630 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.630 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.630 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.631 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.631 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.631 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.631 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.631 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.631 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.631 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.631 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.631 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.631 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.631 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.631 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.631 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.632 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.632 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.632 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.632 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.632 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.632 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.632 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.632 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.632 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.632 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.632 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.632 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.632 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.632 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.633 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.633 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.633 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.633 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.633 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.633 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.633 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.633 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.633 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.633 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.633 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.633 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.633 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.634 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.634 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.634 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.634 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.634 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.634 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.634 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.634 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.634 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.634 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.634 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.634 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.635 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.635 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.635 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.635 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.635 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.635 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.635 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.635 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.635 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.635 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.635 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.635 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.636 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.636 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.636 INFO:teuthology.orchestra.run.smithi003.stdout: "orchestrator": { 2024-09-10T23:36:47.636 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "orchestrator", 2024-09-10T23:36:47.636 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.636 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.636 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.636 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.636 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.636 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.636 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.636 INFO:teuthology.orchestra.run.smithi003.stdout: "cephadm", 2024-09-10T23:36:47.636 INFO:teuthology.orchestra.run.smithi003.stdout: "rook", 2024-09-10T23:36:47.636 INFO:teuthology.orchestra.run.smithi003.stdout: "test_orchestrator" 2024-09-10T23:36:47.637 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.637 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Orchestrator backend", 2024-09-10T23:36:47.637 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.637 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.637 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.637 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.637 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.637 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.637 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.637 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.637 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.637 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.637 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.638 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.638 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.638 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.638 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.638 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.638 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.638 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.638 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.638 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.638 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.638 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "osd_perf_query", 2024-09-10T23:36:47.638 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.638 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.639 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.639 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.639 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.639 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.639 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.639 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.639 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.639 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.639 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.639 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.639 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.639 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.639 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.639 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.639 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.640 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.640 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.640 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.640 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.640 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.640 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.640 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.640 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.640 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.640 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.640 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.640 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.640 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.641 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.641 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.641 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.641 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.641 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.641 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.641 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.641 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.641 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.641 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.641 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.641 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.642 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.642 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.642 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.642 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.642 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.642 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.642 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.642 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.642 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.642 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.642 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.642 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.642 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.642 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.642 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.643 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.643 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.643 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.643 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.643 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.643 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.643 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.643 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.643 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.643 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.643 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.643 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.643 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.644 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.644 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.644 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.644 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.644 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.644 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.644 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.644 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.644 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.644 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.644 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.644 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.645 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.645 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.645 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.645 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.645 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.645 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.645 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.645 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.645 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "osd_support", 2024-09-10T23:36:47.645 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.645 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.645 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.645 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.645 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.646 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.646 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.646 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.646 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.646 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.646 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.646 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.646 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.646 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.646 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.646 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.646 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.646 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.646 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.647 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.647 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.647 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.647 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.647 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.647 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.647 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.647 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.647 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.647 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.647 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.647 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.647 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.648 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.648 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.648 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.648 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.648 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.648 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.648 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.648 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.648 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.648 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.648 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.648 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.649 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.649 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.649 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.649 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.649 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.649 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.649 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.649 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.649 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.650 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.650 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.650 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.650 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.650 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.650 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.650 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.650 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.650 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.650 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.650 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.651 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.651 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.651 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.651 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.651 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.651 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.651 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.651 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.651 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.651 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.651 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.651 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.652 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.652 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.652 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.652 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.652 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.652 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.652 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.652 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.652 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.652 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.652 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.652 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.652 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.652 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.653 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "pg_autoscaler", 2024-09-10T23:36:47.653 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.653 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.653 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.653 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.653 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.653 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.653 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.653 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.653 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.653 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.653 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.653 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.653 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.654 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.654 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.654 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.654 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.654 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.654 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.654 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.654 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.654 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.654 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.654 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.654 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.654 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.654 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.655 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.655 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.655 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.655 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.655 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.655 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.655 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.655 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.655 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.655 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.655 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.655 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.655 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.656 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.656 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.656 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.656 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.656 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.656 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.656 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.656 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.656 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.656 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.656 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.656 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.656 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.657 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.657 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.657 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.657 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.657 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.657 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.657 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.657 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.657 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.657 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.657 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.657 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.657 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.657 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.657 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.658 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.658 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.658 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.658 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.658 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.658 INFO:teuthology.orchestra.run.smithi003.stdout: "sleep_interval": { 2024-09-10T23:36:47.658 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sleep_interval", 2024-09-10T23:36:47.658 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:47.658 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.658 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.658 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "60", 2024-09-10T23:36:47.658 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.659 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.659 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.660 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.661 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.661 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.661 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.661 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.661 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.661 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.661 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.661 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.661 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.661 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.661 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.661 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.661 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.662 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.662 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.662 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.662 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.662 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.662 INFO:teuthology.orchestra.run.smithi003.stdout: "threshold": { 2024-09-10T23:36:47.662 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "threshold", 2024-09-10T23:36:47.662 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-10T23:36:47.662 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.662 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.662 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "3.0", 2024-09-10T23:36:47.662 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "1.0", 2024-09-10T23:36:47.662 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.662 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.663 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "scaling threshold", 2024-09-10T23:36:47.663 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T23:36:47.663 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.663 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.663 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.663 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.663 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.663 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.663 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "progress", 2024-09-10T23:36:47.663 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.663 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.663 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.663 INFO:teuthology.orchestra.run.smithi003.stdout: "allow_pg_recovery_event": { 2024-09-10T23:36:47.663 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "allow_pg_recovery_event", 2024-09-10T23:36:47.664 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.664 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.664 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.664 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.664 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.664 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.664 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.664 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T23:36:47.664 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.664 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.664 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.664 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.664 INFO:teuthology.orchestra.run.smithi003.stdout: "enabled": { 2024-09-10T23:36:47.664 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "enabled", 2024-09-10T23:36:47.665 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.665 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.665 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.665 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.665 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.665 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.665 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.665 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.665 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.665 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.665 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.665 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.666 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.666 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.666 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.666 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.666 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.666 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.666 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.666 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.666 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.666 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.666 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.666 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.666 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.666 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.667 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.667 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.667 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.667 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.667 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.667 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.667 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.667 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.667 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.667 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.667 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.667 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.667 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.667 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.668 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.668 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.668 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.668 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.668 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.668 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.668 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.668 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.668 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.668 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.668 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.668 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.668 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.669 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.669 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.669 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.669 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.669 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.669 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.669 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.669 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.669 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.669 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.669 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.669 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.669 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.669 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.670 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.670 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.670 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.670 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.670 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.670 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.670 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.670 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.670 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.670 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.670 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.670 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.670 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.670 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.671 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.671 INFO:teuthology.orchestra.run.smithi003.stdout: "max_completed_events": { 2024-09-10T23:36:47.671 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "max_completed_events", 2024-09-10T23:36:47.671 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.671 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.671 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.671 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "50", 2024-09-10T23:36:47.671 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.671 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.671 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.671 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "number of past completed events to remember", 2024-09-10T23:36:47.671 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.671 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.671 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.671 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.672 INFO:teuthology.orchestra.run.smithi003.stdout: "sleep_interval": { 2024-09-10T23:36:47.672 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sleep_interval", 2024-09-10T23:36:47.672 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:47.672 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.672 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.672 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5", 2024-09-10T23:36:47.672 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.672 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.672 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.672 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how long the module is going to sleep", 2024-09-10T23:36:47.672 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.672 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.672 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.672 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.673 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.673 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.673 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.673 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.673 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.673 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.673 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.673 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.673 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.673 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.673 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.673 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.673 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.673 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.674 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.674 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.674 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.674 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "prometheus", 2024-09-10T23:36:47.674 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.674 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.674 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.674 INFO:teuthology.orchestra.run.smithi003.stdout: "cache": { 2024-09-10T23:36:47.674 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "cache", 2024-09-10T23:36:47.674 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.675 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.675 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.675 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.675 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.675 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.675 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.675 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.675 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.675 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.675 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.675 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.675 INFO:teuthology.orchestra.run.smithi003.stdout: "exclude_perf_counters": { 2024-09-10T23:36:47.675 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "exclude_perf_counters", 2024-09-10T23:36:47.675 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.676 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.676 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.676 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.676 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.676 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.676 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.676 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T23:36:47.676 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T23:36:47.676 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.676 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.676 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.676 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.676 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.676 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.677 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.677 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.677 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.677 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.677 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.677 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.677 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.677 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.677 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.678 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.678 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.678 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.678 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.678 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.678 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.678 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.678 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.678 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.678 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.678 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.678 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.678 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.678 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.679 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.679 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.679 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.679 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.679 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.679 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.679 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.679 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.679 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.679 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.679 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.679 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.679 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.679 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.679 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.680 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.680 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.680 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.680 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.680 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.680 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.680 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.680 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.680 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.680 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.680 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.680 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.680 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.681 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.681 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.681 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.681 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.681 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.681 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.681 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.681 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.681 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.681 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.681 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.681 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.681 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.681 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.682 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.682 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.682 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_stats_pools": { 2024-09-10T23:36:47.682 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rbd_stats_pools", 2024-09-10T23:36:47.682 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.682 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.682 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.682 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.682 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.682 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.682 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.682 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.682 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.682 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.683 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.683 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.683 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T23:36:47.683 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T23:36:47.683 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.683 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.683 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.683 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "300", 2024-09-10T23:36:47.683 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.683 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.683 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.683 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.683 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.683 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.684 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.684 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.684 INFO:teuthology.orchestra.run.smithi003.stdout: "scrape_interval": { 2024-09-10T23:36:47.684 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "scrape_interval", 2024-09-10T23:36:47.684 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-10T23:36:47.684 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.684 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.684 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "15.0", 2024-09-10T23:36:47.684 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.684 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.684 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.684 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.684 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.684 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.685 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.685 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.685 INFO:teuthology.orchestra.run.smithi003.stdout: "server_addr": { 2024-09-10T23:36:47.685 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_addr", 2024-09-10T23:36:47.685 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.685 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.685 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.685 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "::", 2024-09-10T23:36:47.685 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.685 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.685 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.685 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T23:36:47.685 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.685 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.686 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.686 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.686 INFO:teuthology.orchestra.run.smithi003.stdout: "server_port": { 2024-09-10T23:36:47.686 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_port", 2024-09-10T23:36:47.686 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.686 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.686 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.686 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "9283", 2024-09-10T23:36:47.686 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.686 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.686 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.686 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T23:36:47.686 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.686 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.687 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.687 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.687 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.687 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.687 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.687 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.687 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.687 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.687 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.687 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.687 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.687 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.687 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.687 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.688 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.688 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.688 INFO:teuthology.orchestra.run.smithi003.stdout: "stale_cache_strategy": { 2024-09-10T23:36:47.688 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "stale_cache_strategy", 2024-09-10T23:36:47.688 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.688 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.688 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.688 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "log", 2024-09-10T23:36:47.688 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.688 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.688 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.688 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.689 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.689 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.689 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.689 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.689 INFO:teuthology.orchestra.run.smithi003.stdout: "standby_behaviour": { 2024-09-10T23:36:47.689 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "standby_behaviour", 2024-09-10T23:36:47.689 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.689 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.689 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.689 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "default", 2024-09-10T23:36:47.689 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.689 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.690 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.690 INFO:teuthology.orchestra.run.smithi003.stdout: "default", 2024-09-10T23:36:47.690 INFO:teuthology.orchestra.run.smithi003.stdout: "error" 2024-09-10T23:36:47.690 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.690 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.690 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.690 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.690 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.690 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.690 INFO:teuthology.orchestra.run.smithi003.stdout: "standby_error_status_code": { 2024-09-10T23:36:47.691 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "standby_error_status_code", 2024-09-10T23:36:47.691 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.691 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.691 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.691 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "500", 2024-09-10T23:36:47.691 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "400", 2024-09-10T23:36:47.691 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "599", 2024-09-10T23:36:47.691 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.691 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.691 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.691 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.691 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.691 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.691 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.692 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.692 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.692 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rbd_support", 2024-09-10T23:36:47.692 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.692 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.692 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.692 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.692 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.692 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.692 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.692 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.692 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.692 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.693 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.693 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.693 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.693 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.693 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.693 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.693 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.693 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.693 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.693 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.693 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.693 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.693 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.693 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.693 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.694 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.694 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.694 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.694 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.694 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.694 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.694 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.694 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.694 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.694 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.694 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.694 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.694 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.694 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.695 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.695 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.695 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.695 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.695 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.695 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.695 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.695 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.695 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.695 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.695 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.695 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.695 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.695 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.696 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.696 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.696 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.696 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.696 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.696 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.696 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.696 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.696 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.696 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.696 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.696 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.696 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.696 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.697 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.697 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.697 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.697 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.697 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.697 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.697 INFO:teuthology.orchestra.run.smithi003.stdout: "max_concurrent_snap_create": { 2024-09-10T23:36:47.697 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "max_concurrent_snap_create", 2024-09-10T23:36:47.697 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.697 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.697 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.697 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-10T23:36:47.697 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.698 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.698 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.698 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.698 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.698 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.698 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.698 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.698 INFO:teuthology.orchestra.run.smithi003.stdout: "mirror_snapshot_schedule": { 2024-09-10T23:36:47.698 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T23:36:47.698 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.698 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.698 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.698 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.698 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.699 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.699 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.699 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.699 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.699 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.699 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.699 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.699 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.699 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.699 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.699 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.699 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.699 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.699 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.699 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.700 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.700 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.700 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.700 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.700 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.700 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.700 INFO:teuthology.orchestra.run.smithi003.stdout: "trash_purge_schedule": { 2024-09-10T23:36:47.700 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "trash_purge_schedule", 2024-09-10T23:36:47.700 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.700 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.700 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.700 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.701 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.701 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.701 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.701 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.701 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.701 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.701 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.701 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.701 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.701 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.701 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.701 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "restful", 2024-09-10T23:36:47.701 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.701 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.701 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.702 INFO:teuthology.orchestra.run.smithi003.stdout: "enable_auth": { 2024-09-10T23:36:47.702 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "enable_auth", 2024-09-10T23:36:47.702 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.702 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.702 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.702 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.702 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.702 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.702 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.702 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.702 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.702 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.702 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.702 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.703 INFO:teuthology.orchestra.run.smithi003.stdout: "key_file": { 2024-09-10T23:36:47.703 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "key_file", 2024-09-10T23:36:47.703 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.703 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.703 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.703 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.703 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.703 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.703 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.703 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.703 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.703 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.703 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.703 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.703 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.704 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.704 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.704 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.704 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.704 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.704 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.704 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.704 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.704 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.704 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.704 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.704 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.704 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.704 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.705 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.705 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.705 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.705 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.705 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.705 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.705 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.705 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.705 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.705 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.705 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.705 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.705 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.706 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.706 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.706 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.706 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.706 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.706 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.706 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.706 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.706 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.706 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.706 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.706 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.706 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.706 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.707 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.707 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.707 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.707 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.707 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.707 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.707 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.707 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.707 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.707 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.707 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.707 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.707 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.708 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.708 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.708 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.708 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.708 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.708 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.708 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.708 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.708 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.708 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.708 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.708 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.708 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.709 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.709 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.709 INFO:teuthology.orchestra.run.smithi003.stdout: "max_requests": { 2024-09-10T23:36:47.709 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "max_requests", 2024-09-10T23:36:47.709 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.709 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.709 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.709 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "500", 2024-09-10T23:36:47.709 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.709 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.709 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.709 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-10T23:36:47.709 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.709 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.710 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.710 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.710 INFO:teuthology.orchestra.run.smithi003.stdout: "server_addr": { 2024-09-10T23:36:47.710 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_addr", 2024-09-10T23:36:47.710 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.710 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.710 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.710 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.710 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.710 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.713 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.713 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.713 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.713 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.713 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.713 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.713 INFO:teuthology.orchestra.run.smithi003.stdout: "server_port": { 2024-09-10T23:36:47.713 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_port", 2024-09-10T23:36:47.713 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.713 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.714 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.714 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.714 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.714 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.714 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.714 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.714 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.714 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.714 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.714 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.714 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.714 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.714 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.714 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.715 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.715 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.715 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.715 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.715 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.715 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.715 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.715 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.715 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.715 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.715 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.715 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.715 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.715 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rgw", 2024-09-10T23:36:47.716 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.716 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.716 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.716 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.716 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.716 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.716 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.716 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.716 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.716 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.716 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.716 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.716 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.716 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.717 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.717 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.717 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.717 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.717 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.717 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.717 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.717 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.717 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.717 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.717 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.717 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.717 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.717 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.718 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.718 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.718 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.718 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.718 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.718 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.718 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.718 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.718 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.718 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.718 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.718 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.718 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.719 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.719 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.719 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.719 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.719 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.719 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.719 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.719 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.719 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.719 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.719 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.719 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.719 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.720 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.720 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.720 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.720 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.720 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.720 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.720 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.720 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.720 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.720 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.720 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.720 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.720 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.721 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.721 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.721 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.721 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.721 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.721 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.721 INFO:teuthology.orchestra.run.smithi003.stdout: "secondary_zone_period_retry_limit": { 2024-09-10T23:36:47.721 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-10T23:36:47.721 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.721 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.721 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.721 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5", 2024-09-10T23:36:47.721 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.721 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.722 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.722 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-10T23:36:47.722 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.722 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.722 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.722 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.722 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.722 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.722 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.722 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.722 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.722 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.722 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.722 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.723 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.723 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.723 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.723 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.723 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.723 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.723 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.723 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.723 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.723 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rook", 2024-09-10T23:36:47.723 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.723 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.723 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.724 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.724 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.724 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.724 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.724 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.724 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.724 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.724 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.724 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.724 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.724 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.724 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.724 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.724 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.725 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.725 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.725 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.725 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.725 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.725 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.725 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.725 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.725 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.725 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.725 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.725 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.725 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.725 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.726 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.726 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.726 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.726 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.726 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.726 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.726 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.726 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.726 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.726 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.726 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.726 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.726 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.727 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.727 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.727 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.727 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.727 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.727 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.727 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.727 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.727 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.727 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.727 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.727 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.727 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.727 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.728 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.728 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.728 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.728 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.728 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.728 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.728 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.728 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.728 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.728 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.728 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.728 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.728 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.729 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.729 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.729 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.729 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.729 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.729 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.729 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.729 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.729 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.729 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.729 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.729 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.729 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.729 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.730 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.730 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.730 INFO:teuthology.orchestra.run.smithi003.stdout: "storage_class": { 2024-09-10T23:36:47.730 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "storage_class", 2024-09-10T23:36:47.730 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.730 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.730 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.730 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "local", 2024-09-10T23:36:47.730 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.730 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.730 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.730 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T23:36:47.730 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.730 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.730 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.731 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.731 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.731 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.731 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.731 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "selftest", 2024-09-10T23:36:47.731 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.731 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.731 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.731 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.731 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.731 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.731 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.731 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.731 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.732 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.732 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.732 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.732 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.732 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.732 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.732 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.732 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.732 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.732 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.732 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.732 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.732 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.733 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.733 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.733 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.733 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.733 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.733 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.733 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.733 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.733 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.733 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.733 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.733 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.733 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.734 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.734 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.734 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.734 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.734 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.734 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.734 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.734 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.734 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.734 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.734 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.734 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.734 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.734 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.735 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.735 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.735 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.735 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.735 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.735 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.735 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.735 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.735 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.735 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.735 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.735 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.736 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.736 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.736 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.736 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.736 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.736 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.736 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.736 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.736 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.736 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.736 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.736 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.736 INFO:teuthology.orchestra.run.smithi003.stdout: "roption1": { 2024-09-10T23:36:47.737 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "roption1", 2024-09-10T23:36:47.737 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.737 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.737 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.737 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.737 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.737 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.737 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.737 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.737 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.737 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.737 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.737 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.737 INFO:teuthology.orchestra.run.smithi003.stdout: "roption2": { 2024-09-10T23:36:47.738 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "roption2", 2024-09-10T23:36:47.738 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.738 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.738 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.738 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "xyz", 2024-09-10T23:36:47.738 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.738 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.738 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.738 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.738 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.738 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.738 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.738 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.739 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption1": { 2024-09-10T23:36:47.739 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption1", 2024-09-10T23:36:47.739 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.739 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.739 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.739 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.739 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.739 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.739 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.739 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.739 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.739 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.739 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.739 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.740 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption2": { 2024-09-10T23:36:47.740 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption2", 2024-09-10T23:36:47.740 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.740 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.740 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.740 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.740 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.740 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.740 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.740 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.740 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.740 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.740 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.740 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.741 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption3": { 2024-09-10T23:36:47.741 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption3", 2024-09-10T23:36:47.741 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-10T23:36:47.741 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.741 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.741 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.741 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.741 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.741 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.741 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.741 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.741 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.741 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.741 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.742 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption4": { 2024-09-10T23:36:47.742 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption4", 2024-09-10T23:36:47.742 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.742 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.742 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.742 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.742 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.742 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.742 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.742 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.742 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.742 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.742 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.742 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.743 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption5": { 2024-09-10T23:36:47.743 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption5", 2024-09-10T23:36:47.743 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.743 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.743 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.743 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.743 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.743 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.743 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.743 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.743 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.743 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.743 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.743 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.744 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption6": { 2024-09-10T23:36:47.744 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption6", 2024-09-10T23:36:47.744 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.744 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.744 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.744 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.744 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.744 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.744 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.744 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.744 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.744 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.744 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.745 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.745 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption7": { 2024-09-10T23:36:47.745 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption7", 2024-09-10T23:36:47.745 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.745 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.745 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.745 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.745 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "1", 2024-09-10T23:36:47.745 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "42", 2024-09-10T23:36:47.745 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.745 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.745 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.745 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.745 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.746 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.746 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.746 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.746 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.746 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.746 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.746 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.746 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.746 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.746 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.746 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.746 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.746 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.746 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.747 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.747 INFO:teuthology.orchestra.run.smithi003.stdout: "testkey": { 2024-09-10T23:36:47.747 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "testkey", 2024-09-10T23:36:47.747 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.747 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.747 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.747 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.747 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.747 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.747 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.747 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.747 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.747 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.747 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.748 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.748 INFO:teuthology.orchestra.run.smithi003.stdout: "testlkey": { 2024-09-10T23:36:47.748 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "testlkey", 2024-09-10T23:36:47.748 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.748 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.748 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.748 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.748 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.748 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.748 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.748 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.748 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.748 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.748 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.748 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.749 INFO:teuthology.orchestra.run.smithi003.stdout: "testnewline": { 2024-09-10T23:36:47.749 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "testnewline", 2024-09-10T23:36:47.749 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.749 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.749 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.749 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.749 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.749 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.749 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.749 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.749 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.749 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.749 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.749 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.750 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.750 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.750 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.750 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smb", 2024-09-10T23:36:47.750 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.750 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.750 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.750 INFO:teuthology.orchestra.run.smithi003.stdout: "internal_store_backend": { 2024-09-10T23:36:47.750 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "internal_store_backend", 2024-09-10T23:36:47.750 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.750 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.750 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.750 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.750 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.750 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.751 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.751 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-10T23:36:47.751 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.751 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.751 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.751 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.751 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.751 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.751 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.751 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.751 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.751 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.751 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.751 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.751 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.752 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.752 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.752 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.752 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.752 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.752 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.752 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.752 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.752 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.752 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.752 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.752 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.752 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.752 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.753 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.753 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.753 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.753 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.753 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.753 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.753 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.753 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.753 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.753 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.753 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.753 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.753 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.753 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.753 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.754 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.754 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.754 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.754 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.754 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.754 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.754 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.754 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.754 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.754 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.754 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.754 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.754 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.754 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.755 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.755 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.755 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.755 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.755 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.755 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.755 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.755 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.755 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.755 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.755 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.755 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.755 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.756 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.756 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.756 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.756 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.756 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.756 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.756 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.756 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.756 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.756 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.756 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.756 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.756 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.756 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.756 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.757 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.757 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.757 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.757 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.757 INFO:teuthology.orchestra.run.smithi003.stdout: "update_orchestration": { 2024-09-10T23:36:47.757 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "update_orchestration", 2024-09-10T23:36:47.757 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.757 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.757 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.757 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.757 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.757 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.757 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.757 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-10T23:36:47.758 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.758 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.758 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.758 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.758 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.758 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.758 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.758 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "snap_schedule", 2024-09-10T23:36:47.758 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.758 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.758 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.758 INFO:teuthology.orchestra.run.smithi003.stdout: "allow_m_granularity": { 2024-09-10T23:36:47.758 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "allow_m_granularity", 2024-09-10T23:36:47.759 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.759 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.759 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.759 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.759 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.759 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.759 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.759 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T23:36:47.759 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.759 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.759 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.759 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.759 INFO:teuthology.orchestra.run.smithi003.stdout: "dump_on_update": { 2024-09-10T23:36:47.759 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "dump_on_update", 2024-09-10T23:36:47.760 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.760 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.760 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.760 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.760 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.760 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.760 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.760 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "dump database to debug log on update", 2024-09-10T23:36:47.760 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.760 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.760 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.761 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.761 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.761 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.761 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.761 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.761 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.761 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.761 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.761 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.761 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.761 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.761 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.762 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.762 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.762 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.762 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.762 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.762 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.762 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.762 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.762 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.762 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.762 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.762 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.762 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.763 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.763 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.763 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.763 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.763 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.763 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.763 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.763 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.763 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.763 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.763 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.763 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.763 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.763 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.763 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.764 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.764 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.764 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.764 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.764 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.764 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.764 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.764 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.764 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.764 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.764 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.764 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.764 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.765 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.765 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.765 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.765 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.765 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.765 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.765 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.765 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.765 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.765 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.765 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.765 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.765 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.766 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.766 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.766 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.766 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.766 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.766 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.766 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.766 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.766 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.766 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.766 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.766 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.766 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.766 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.766 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.767 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.767 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.767 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.767 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.767 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.767 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.767 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.767 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "stats", 2024-09-10T23:36:47.767 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.767 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.767 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.767 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.767 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.767 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.767 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.768 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.768 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.768 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.768 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.768 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.768 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.768 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.768 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.768 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.768 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.768 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.768 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.768 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.768 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.768 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.769 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.769 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.769 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.769 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.769 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.769 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.769 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.769 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.769 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.769 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.769 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.769 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.769 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.770 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.770 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.770 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.770 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.770 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.770 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.770 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.770 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.770 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.770 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.770 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.770 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.770 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.770 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.770 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.771 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.771 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.771 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.771 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.771 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.771 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.771 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.771 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.771 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.771 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.771 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.771 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.771 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.771 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.771 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.772 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.772 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.772 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.772 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.772 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.772 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.772 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.772 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.772 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.772 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.772 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.772 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.772 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.773 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.773 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.773 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.773 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.773 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.773 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.773 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.773 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.773 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.773 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.773 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.773 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.773 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "status", 2024-09-10T23:36:47.774 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.774 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.774 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.774 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.774 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.774 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.774 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.774 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.774 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.774 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.774 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.774 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.774 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.774 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.775 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.775 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.775 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.775 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.775 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.775 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.775 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.775 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.775 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.775 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.775 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.775 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.776 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.776 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.776 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.776 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.776 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.776 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.776 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.776 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.776 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.776 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.776 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.776 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.777 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.777 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.777 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.777 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.777 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.777 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.777 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.777 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.777 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.777 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.777 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.777 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.777 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.778 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.778 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.778 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.778 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.778 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.778 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.778 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.778 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.778 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.778 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.778 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.778 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.778 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.778 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.779 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.779 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.779 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.779 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.779 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.779 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.779 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.779 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.779 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.779 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.779 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.779 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.779 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.780 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.780 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.780 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.780 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.780 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.780 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.780 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.780 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.780 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.780 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.780 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.780 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.780 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "telegraf", 2024-09-10T23:36:47.780 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.781 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.781 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.781 INFO:teuthology.orchestra.run.smithi003.stdout: "address": { 2024-09-10T23:36:47.781 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "address", 2024-09-10T23:36:47.781 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.781 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.781 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.781 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T23:36:47.781 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.781 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.781 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.781 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.781 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.781 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.782 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.782 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.782 INFO:teuthology.orchestra.run.smithi003.stdout: "interval": { 2024-09-10T23:36:47.782 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "interval", 2024-09-10T23:36:47.782 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:47.782 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.782 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.782 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "15", 2024-09-10T23:36:47.782 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.782 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.782 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.782 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.782 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.782 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.783 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.783 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.783 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.783 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.783 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.783 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.783 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.783 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.783 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.783 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.783 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.783 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.783 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.784 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.784 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.784 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.784 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.784 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.784 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.784 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.784 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.784 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.784 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.784 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.784 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.785 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.785 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.785 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.785 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.785 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.785 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.785 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.785 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.785 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.785 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.785 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.785 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.785 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.785 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.786 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.786 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.786 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.786 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.786 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.786 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.786 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.786 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.786 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.786 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.786 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.786 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.786 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.786 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.787 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.787 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.787 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.787 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.787 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.787 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.787 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.787 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.787 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.787 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.787 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.787 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.787 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.787 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.787 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.788 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.788 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.788 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.788 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.788 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.788 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.788 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.788 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.788 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.788 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.788 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.788 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.789 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.789 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.789 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.789 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.789 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.789 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.789 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.789 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.789 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.789 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "telemetry", 2024-09-10T23:36:47.789 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.789 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.789 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.789 INFO:teuthology.orchestra.run.smithi003.stdout: "channel_basic": { 2024-09-10T23:36:47.790 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "channel_basic", 2024-09-10T23:36:47.790 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.790 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.790 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.790 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.790 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.790 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.790 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.790 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T23:36:47.791 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.791 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.791 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.791 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.791 INFO:teuthology.orchestra.run.smithi003.stdout: "channel_crash": { 2024-09-10T23:36:47.791 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "channel_crash", 2024-09-10T23:36:47.791 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.791 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.791 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.791 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.791 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.791 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.791 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.791 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T23:36:47.792 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.792 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.792 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.792 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.792 INFO:teuthology.orchestra.run.smithi003.stdout: "channel_device": { 2024-09-10T23:36:47.792 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "channel_device", 2024-09-10T23:36:47.792 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.792 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.792 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.792 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.792 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.792 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.792 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.793 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T23:36:47.793 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.793 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.793 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.793 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.793 INFO:teuthology.orchestra.run.smithi003.stdout: "channel_ident": { 2024-09-10T23:36:47.793 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "channel_ident", 2024-09-10T23:36:47.793 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.793 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.793 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.793 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.793 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.793 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.793 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.794 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T23:36:47.794 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.794 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.794 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.794 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.794 INFO:teuthology.orchestra.run.smithi003.stdout: "channel_perf": { 2024-09-10T23:36:47.794 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "channel_perf", 2024-09-10T23:36:47.794 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.794 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.794 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.794 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.794 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.794 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.794 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.795 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T23:36:47.795 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.795 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.795 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.795 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.795 INFO:teuthology.orchestra.run.smithi003.stdout: "contact": { 2024-09-10T23:36:47.795 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "contact", 2024-09-10T23:36:47.795 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.795 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.795 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.795 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.795 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.795 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.795 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.796 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.796 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.796 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.796 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.796 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.796 INFO:teuthology.orchestra.run.smithi003.stdout: "description": { 2024-09-10T23:36:47.796 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "description", 2024-09-10T23:36:47.796 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.796 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.796 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.796 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.796 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.796 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.796 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.797 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.797 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.797 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.797 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.797 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.797 INFO:teuthology.orchestra.run.smithi003.stdout: "device_url": { 2024-09-10T23:36:47.797 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "device_url", 2024-09-10T23:36:47.797 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.797 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.797 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.797 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T23:36:47.797 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.797 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.797 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.798 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.798 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.798 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.798 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.798 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.798 INFO:teuthology.orchestra.run.smithi003.stdout: "enabled": { 2024-09-10T23:36:47.798 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "enabled", 2024-09-10T23:36:47.798 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.798 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.798 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.798 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.798 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.798 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.798 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.798 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.799 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.799 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.799 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.799 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.799 INFO:teuthology.orchestra.run.smithi003.stdout: "interval": { 2024-09-10T23:36:47.799 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "interval", 2024-09-10T23:36:47.799 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.799 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.799 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.799 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "24", 2024-09-10T23:36:47.799 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "8", 2024-09-10T23:36:47.799 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.799 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.800 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.800 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.800 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.800 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.800 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.800 INFO:teuthology.orchestra.run.smithi003.stdout: "last_opt_revision": { 2024-09-10T23:36:47.800 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "last_opt_revision", 2024-09-10T23:36:47.800 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.800 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.800 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.800 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "1", 2024-09-10T23:36:47.800 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.800 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.800 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.800 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.801 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.801 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.801 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.801 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.801 INFO:teuthology.orchestra.run.smithi003.stdout: "leaderboard": { 2024-09-10T23:36:47.801 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "leaderboard", 2024-09-10T23:36:47.801 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.801 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.801 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.801 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.801 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.801 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.801 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.801 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.801 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.802 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.802 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.802 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.802 INFO:teuthology.orchestra.run.smithi003.stdout: "leaderboard_description": { 2024-09-10T23:36:47.802 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "leaderboard_description", 2024-09-10T23:36:47.802 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.802 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.802 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.802 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.802 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.802 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.802 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.802 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.803 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.803 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.803 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.803 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.803 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.803 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.803 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.803 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.803 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.803 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.803 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.803 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.803 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.804 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.804 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.804 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.804 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.804 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.804 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.804 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.804 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.804 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.804 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.804 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.804 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.804 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.805 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.805 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.805 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.805 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.805 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.805 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.805 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.805 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.805 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.805 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.805 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.805 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.806 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.806 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.806 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.806 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.806 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.806 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.806 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.806 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.806 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.806 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.806 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.806 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.806 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.807 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.807 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.807 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.807 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.807 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.807 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.807 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.807 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.807 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.807 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.807 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.807 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.807 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.807 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.808 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.808 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.808 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.808 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.808 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.808 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.808 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.808 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.808 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.808 INFO:teuthology.orchestra.run.smithi003.stdout: "organization": { 2024-09-10T23:36:47.808 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "organization", 2024-09-10T23:36:47.808 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.808 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.809 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.809 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.809 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.809 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.809 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.809 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.809 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.809 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.809 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.809 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.809 INFO:teuthology.orchestra.run.smithi003.stdout: "proxy": { 2024-09-10T23:36:47.809 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "proxy", 2024-09-10T23:36:47.809 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.809 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.810 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.810 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.810 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.810 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.810 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.810 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.810 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.810 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.810 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.810 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.810 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.810 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.810 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.810 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.811 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.811 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.811 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.811 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.811 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.811 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.811 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.811 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.811 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.811 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.811 INFO:teuthology.orchestra.run.smithi003.stdout: "url": { 2024-09-10T23:36:47.811 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "url", 2024-09-10T23:36:47.811 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.811 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.811 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.812 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T23:36:47.812 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.812 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.812 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.812 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.812 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.812 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.812 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.812 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.812 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.812 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.812 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.812 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "test_orchestrator", 2024-09-10T23:36:47.812 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.813 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.813 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.813 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.813 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.813 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.813 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.813 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.813 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.813 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.813 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.813 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.813 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.813 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.814 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.814 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.814 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.814 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.814 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.814 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.814 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.814 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.814 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.814 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.814 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.814 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.814 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.814 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.815 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.815 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.815 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.815 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.815 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.815 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.815 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.815 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.815 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.815 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.815 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.815 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.815 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.815 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.815 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.816 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.816 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.816 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.816 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.816 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.816 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.816 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.816 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.816 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.816 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.816 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.816 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.816 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.816 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.817 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.817 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.817 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.817 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.817 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.817 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.817 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.817 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.817 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.817 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.817 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.817 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.817 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.818 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.818 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.818 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.818 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.818 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.818 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.818 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.818 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.818 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.818 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.818 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.818 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.818 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.818 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.819 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.819 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.819 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.819 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.819 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.819 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.819 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "volumes", 2024-09-10T23:36:47.819 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.819 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.819 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.819 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.819 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.819 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.819 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.819 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.820 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.820 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.820 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.820 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.820 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.820 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.820 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.820 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.820 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.820 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.820 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.820 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.820 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.821 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.821 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.821 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.821 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.821 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.821 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.821 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.821 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.821 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.821 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.821 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.821 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.821 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.822 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.822 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.822 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.822 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.822 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.822 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.822 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.822 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.822 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.822 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.822 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.822 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.822 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.822 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.823 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.823 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.823 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.823 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.823 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.823 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.823 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.823 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.823 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.823 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.823 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.823 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.823 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.823 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.823 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.824 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.824 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.824 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.824 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.824 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.824 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.824 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.824 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.824 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.824 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.824 INFO:teuthology.orchestra.run.smithi003.stdout: "max_concurrent_clones": { 2024-09-10T23:36:47.824 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "max_concurrent_clones", 2024-09-10T23:36:47.824 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.824 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.825 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.825 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "4", 2024-09-10T23:36:47.825 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.825 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.825 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.825 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T23:36:47.825 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.825 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.825 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.825 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.825 INFO:teuthology.orchestra.run.smithi003.stdout: "periodic_async_work": { 2024-09-10T23:36:47.825 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "periodic_async_work", 2024-09-10T23:36:47.825 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.825 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.825 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.826 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.826 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.826 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.826 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.826 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Periodically check for async work", 2024-09-10T23:36:47.826 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.826 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.826 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.826 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.826 INFO:teuthology.orchestra.run.smithi003.stdout: "snapshot_clone_delay": { 2024-09-10T23:36:47.826 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "snapshot_clone_delay", 2024-09-10T23:36:47.826 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.826 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.826 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.827 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.827 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.827 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.827 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.827 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T23:36:47.827 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.827 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.827 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.827 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.827 INFO:teuthology.orchestra.run.smithi003.stdout: "snapshot_clone_no_wait": { 2024-09-10T23:36:47.827 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T23:36:47.827 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.827 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.827 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.827 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.828 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.828 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.828 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.828 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T23:36:47.828 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.828 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.828 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.828 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.828 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.828 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.828 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.828 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.828 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.828 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.829 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.829 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.829 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.829 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.829 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.829 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.829 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.829 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.829 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.829 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.829 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.829 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "zabbix", 2024-09-10T23:36:47.829 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.829 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.830 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.830 INFO:teuthology.orchestra.run.smithi003.stdout: "discovery_interval": { 2024-09-10T23:36:47.830 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "discovery_interval", 2024-09-10T23:36:47.830 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "uint", 2024-09-10T23:36:47.830 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.830 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.830 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "100", 2024-09-10T23:36:47.830 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.830 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.830 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.830 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.830 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.830 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.830 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.830 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.831 INFO:teuthology.orchestra.run.smithi003.stdout: "identifier": { 2024-09-10T23:36:47.831 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "identifier", 2024-09-10T23:36:47.831 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.831 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.831 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.831 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.831 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.831 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.831 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.831 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.831 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.831 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.831 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.832 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.832 INFO:teuthology.orchestra.run.smithi003.stdout: "interval": { 2024-09-10T23:36:47.832 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "interval", 2024-09-10T23:36:47.832 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:47.832 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.832 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.832 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "60", 2024-09-10T23:36:47.832 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.832 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.832 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.832 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.832 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.832 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.832 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.833 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.833 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.833 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.833 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.833 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.833 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.833 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.833 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.833 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.833 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.833 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.833 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.833 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.834 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.834 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.834 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.834 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.834 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.834 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.834 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.834 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.834 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.834 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.834 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.834 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.834 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.835 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.835 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.835 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.835 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.835 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.835 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.835 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.835 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.835 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.835 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.835 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.835 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.835 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.835 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.836 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.836 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.836 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.836 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.836 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.836 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.836 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.836 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.836 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.836 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.836 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.836 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.836 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.837 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.837 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.837 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.837 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.837 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.837 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.837 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.837 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.837 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.837 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.837 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.837 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.838 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.838 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.838 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.838 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.838 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.838 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.838 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.838 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.838 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.838 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.838 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.838 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.838 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.838 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.838 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.839 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.839 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.839 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.839 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.839 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.839 INFO:teuthology.orchestra.run.smithi003.stdout: "zabbix_host": { 2024-09-10T23:36:47.839 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "zabbix_host", 2024-09-10T23:36:47.839 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.839 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.839 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.839 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.839 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.839 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.839 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.840 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.840 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.840 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.840 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.840 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.840 INFO:teuthology.orchestra.run.smithi003.stdout: "zabbix_port": { 2024-09-10T23:36:47.840 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "zabbix_port", 2024-09-10T23:36:47.840 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.840 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.840 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.840 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10051", 2024-09-10T23:36:47.840 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.840 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.840 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.841 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.841 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.841 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.841 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.841 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.841 INFO:teuthology.orchestra.run.smithi003.stdout: "zabbix_sender": { 2024-09-10T23:36:47.841 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "zabbix_sender", 2024-09-10T23:36:47.841 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.841 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.841 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.841 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T23:36:47.841 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.841 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.842 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.842 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.842 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.842 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.842 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.842 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.842 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.842 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.842 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-10T23:36:47.842 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.842 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.842 INFO:teuthology.orchestra.run.smithi003.stdout: "gid": 34202, 2024-09-10T23:36:47.842 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "y", 2024-09-10T23:36:47.842 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_features": 4540719139924082687, 2024-09-10T23:36:47.842 INFO:teuthology.orchestra.run.smithi003.stdout: "available_modules": [ 2024-09-10T23:36:47.843 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.843 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "alerts", 2024-09-10T23:36:47.843 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.843 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.843 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.843 INFO:teuthology.orchestra.run.smithi003.stdout: "interval": { 2024-09-10T23:36:47.843 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "interval", 2024-09-10T23:36:47.843 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:47.843 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.843 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.843 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "60", 2024-09-10T23:36:47.843 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.843 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.843 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.844 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T23:36:47.844 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.844 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.844 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.844 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.844 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.844 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.844 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.844 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.844 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.844 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.844 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.844 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.845 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.845 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.845 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.845 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.845 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.845 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.845 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.845 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.845 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.845 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.845 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.845 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.846 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.846 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.846 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.846 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.846 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.846 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.846 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.846 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.846 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.846 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.846 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.846 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.846 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.846 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.847 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.847 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.847 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.847 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.847 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.847 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.847 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.847 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.847 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.847 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.847 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.847 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.847 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.848 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.848 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.848 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.848 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.848 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.848 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.848 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.848 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.848 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.848 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.848 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.848 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.848 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.848 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.849 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.849 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.849 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.849 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.849 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.849 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.849 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.849 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.849 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.849 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_destination": { 2024-09-10T23:36:47.849 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_destination", 2024-09-10T23:36:47.849 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.849 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.850 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.850 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.850 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.850 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.850 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.850 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-10T23:36:47.850 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.850 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.850 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.850 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.850 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_from_name": { 2024-09-10T23:36:47.850 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_from_name", 2024-09-10T23:36:47.850 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.851 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.851 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.851 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "Ceph", 2024-09-10T23:36:47.851 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.851 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.851 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.851 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Email From: name", 2024-09-10T23:36:47.851 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.851 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.851 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.851 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.851 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_host": { 2024-09-10T23:36:47.851 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_host", 2024-09-10T23:36:47.852 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.852 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.852 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.852 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.852 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.852 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.852 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.852 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "SMTP server", 2024-09-10T23:36:47.852 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.852 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.852 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.852 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.852 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_password": { 2024-09-10T23:36:47.853 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_password", 2024-09-10T23:36:47.853 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.853 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.853 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.853 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.853 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.853 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.853 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.853 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Password to authenticate with", 2024-09-10T23:36:47.853 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.853 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.853 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.853 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.853 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_port": { 2024-09-10T23:36:47.854 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_port", 2024-09-10T23:36:47.854 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.854 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.854 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.854 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "465", 2024-09-10T23:36:47.854 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.854 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.854 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.854 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "SMTP port", 2024-09-10T23:36:47.854 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.854 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.854 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.854 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.855 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_sender": { 2024-09-10T23:36:47.855 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_sender", 2024-09-10T23:36:47.855 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.855 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.855 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.855 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.855 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.855 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.855 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.855 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "SMTP envelope sender", 2024-09-10T23:36:47.855 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.855 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.855 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.855 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.856 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_ssl": { 2024-09-10T23:36:47.856 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_ssl", 2024-09-10T23:36:47.856 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.856 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.856 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.856 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.856 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.856 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.856 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.856 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T23:36:47.856 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.856 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.856 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.856 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.857 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_user": { 2024-09-10T23:36:47.857 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_user", 2024-09-10T23:36:47.857 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.857 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.857 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.857 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.857 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.857 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.857 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.857 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "User to authenticate as", 2024-09-10T23:36:47.857 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.857 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.857 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.857 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.857 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.858 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.858 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.858 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.858 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.858 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.858 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.858 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.858 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.858 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.858 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.858 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.858 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.858 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.858 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.858 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.859 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.859 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "balancer", 2024-09-10T23:36:47.859 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.859 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.859 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.859 INFO:teuthology.orchestra.run.smithi003.stdout: "active": { 2024-09-10T23:36:47.859 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "active", 2024-09-10T23:36:47.859 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.859 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.859 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.859 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.859 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.859 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.860 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.860 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T23:36:47.860 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.860 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.860 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.860 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.860 INFO:teuthology.orchestra.run.smithi003.stdout: "begin_time": { 2024-09-10T23:36:47.860 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "begin_time", 2024-09-10T23:36:47.860 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.860 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.860 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.860 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0000", 2024-09-10T23:36:47.860 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.860 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.861 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.861 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T23:36:47.861 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T23:36:47.861 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.861 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.861 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.861 INFO:teuthology.orchestra.run.smithi003.stdout: "begin_weekday": { 2024-09-10T23:36:47.861 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "begin_weekday", 2024-09-10T23:36:47.861 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "uint", 2024-09-10T23:36:47.861 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.861 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.861 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.861 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "0", 2024-09-10T23:36:47.861 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "6", 2024-09-10T23:36:47.862 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.862 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T23:36:47.862 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T23:36:47.862 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.862 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.862 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.862 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_compat_max_iterations": { 2024-09-10T23:36:47.862 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crush_compat_max_iterations", 2024-09-10T23:36:47.862 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "uint", 2024-09-10T23:36:47.862 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.862 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.862 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "25", 2024-09-10T23:36:47.862 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "1", 2024-09-10T23:36:47.862 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "250", 2024-09-10T23:36:47.863 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.863 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T23:36:47.863 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.863 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.863 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.863 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.863 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_compat_metrics": { 2024-09-10T23:36:47.863 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crush_compat_metrics", 2024-09-10T23:36:47.863 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.863 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.863 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.863 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T23:36:47.863 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.863 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.864 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.864 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T23:36:47.864 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T23:36:47.864 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.864 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.864 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.864 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_compat_step": { 2024-09-10T23:36:47.864 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crush_compat_step", 2024-09-10T23:36:47.864 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-10T23:36:47.864 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.864 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.864 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0.5", 2024-09-10T23:36:47.864 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "0.001", 2024-09-10T23:36:47.865 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "0.999", 2024-09-10T23:36:47.865 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.865 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "aggressiveness of optimization", 2024-09-10T23:36:47.865 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T23:36:47.865 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.865 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.865 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.865 INFO:teuthology.orchestra.run.smithi003.stdout: "end_time": { 2024-09-10T23:36:47.865 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "end_time", 2024-09-10T23:36:47.865 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.865 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.865 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.865 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "2359", 2024-09-10T23:36:47.865 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.866 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.866 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.866 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T23:36:47.866 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T23:36:47.866 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.866 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.866 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.866 INFO:teuthology.orchestra.run.smithi003.stdout: "end_weekday": { 2024-09-10T23:36:47.866 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "end_weekday", 2024-09-10T23:36:47.866 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "uint", 2024-09-10T23:36:47.866 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.866 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.866 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.866 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "0", 2024-09-10T23:36:47.867 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "6", 2024-09-10T23:36:47.867 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.867 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T23:36:47.867 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T23:36:47.867 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.867 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.867 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.867 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.867 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.867 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.867 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.867 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.867 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.867 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.868 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.868 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.868 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.868 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.868 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.868 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.868 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.868 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.868 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.868 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.868 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.868 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.868 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.868 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.869 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.869 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.869 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.869 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.869 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.869 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.869 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.869 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.869 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.869 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.869 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.869 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.869 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.869 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.870 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.870 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.870 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.870 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.870 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.870 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.870 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.870 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.870 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.870 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.870 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.870 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.870 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.870 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.871 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.871 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.871 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.871 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.871 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.871 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.871 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.871 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.871 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.871 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.871 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.871 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.871 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.871 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.871 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.872 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.872 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.872 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.872 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.872 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.872 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.872 INFO:teuthology.orchestra.run.smithi003.stdout: "min_score": { 2024-09-10T23:36:47.872 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "min_score", 2024-09-10T23:36:47.872 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-10T23:36:47.872 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.872 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.872 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.873 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.873 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.873 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.873 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T23:36:47.873 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.873 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.873 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.873 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.873 INFO:teuthology.orchestra.run.smithi003.stdout: "mode": { 2024-09-10T23:36:47.873 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mode", 2024-09-10T23:36:47.873 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.873 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.873 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.874 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "upmap", 2024-09-10T23:36:47.874 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.874 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.874 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.874 INFO:teuthology.orchestra.run.smithi003.stdout: "crush-compat", 2024-09-10T23:36:47.874 INFO:teuthology.orchestra.run.smithi003.stdout: "none", 2024-09-10T23:36:47.874 INFO:teuthology.orchestra.run.smithi003.stdout: "read", 2024-09-10T23:36:47.874 INFO:teuthology.orchestra.run.smithi003.stdout: "upmap", 2024-09-10T23:36:47.874 INFO:teuthology.orchestra.run.smithi003.stdout: "upmap-read" 2024-09-10T23:36:47.874 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.874 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Balancer mode", 2024-09-10T23:36:47.874 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.874 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.875 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.875 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.875 INFO:teuthology.orchestra.run.smithi003.stdout: "pool_ids": { 2024-09-10T23:36:47.875 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "pool_ids", 2024-09-10T23:36:47.875 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.875 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.875 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.875 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.875 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.875 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.875 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.875 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T23:36:47.875 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.875 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.876 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.876 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.876 INFO:teuthology.orchestra.run.smithi003.stdout: "sleep_interval": { 2024-09-10T23:36:47.876 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sleep_interval", 2024-09-10T23:36:47.876 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:47.876 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.876 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.876 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "60", 2024-09-10T23:36:47.876 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.876 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.876 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.876 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T23:36:47.876 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.877 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.877 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.877 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.877 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.877 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.877 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.877 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.877 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.877 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.877 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.877 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.877 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.877 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.877 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.878 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.878 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.878 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.878 INFO:teuthology.orchestra.run.smithi003.stdout: "upmap_max_deviation": { 2024-09-10T23:36:47.878 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "upmap_max_deviation", 2024-09-10T23:36:47.878 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.878 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.878 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.878 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5", 2024-09-10T23:36:47.878 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "1", 2024-09-10T23:36:47.878 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.878 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.878 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T23:36:47.878 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T23:36:47.879 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.879 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.879 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.879 INFO:teuthology.orchestra.run.smithi003.stdout: "upmap_max_optimizations": { 2024-09-10T23:36:47.879 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "upmap_max_optimizations", 2024-09-10T23:36:47.879 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "uint", 2024-09-10T23:36:47.879 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.879 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.879 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-10T23:36:47.879 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.879 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.879 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.879 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T23:36:47.879 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.880 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.880 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.880 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.880 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.880 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.880 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.880 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "cephadm", 2024-09-10T23:36:47.880 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.880 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.880 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.880 INFO:teuthology.orchestra.run.smithi003.stdout: "agent_down_multiplier": { 2024-09-10T23:36:47.880 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "agent_down_multiplier", 2024-09-10T23:36:47.880 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-10T23:36:47.881 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.881 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.881 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "3.0", 2024-09-10T23:36:47.881 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.881 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.881 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.881 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T23:36:47.881 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.881 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.881 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.881 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.881 INFO:teuthology.orchestra.run.smithi003.stdout: "agent_refresh_rate": { 2024-09-10T23:36:47.881 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "agent_refresh_rate", 2024-09-10T23:36:47.882 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:47.882 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.882 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.882 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "20", 2024-09-10T23:36:47.882 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.882 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.882 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.882 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T23:36:47.882 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.882 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.882 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.882 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.882 INFO:teuthology.orchestra.run.smithi003.stdout: "agent_starting_port": { 2024-09-10T23:36:47.882 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "agent_starting_port", 2024-09-10T23:36:47.883 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.883 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.883 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.883 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "4721", 2024-09-10T23:36:47.883 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.883 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.883 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.883 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T23:36:47.883 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.883 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.883 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.883 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.883 INFO:teuthology.orchestra.run.smithi003.stdout: "allow_ptrace": { 2024-09-10T23:36:47.883 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "allow_ptrace", 2024-09-10T23:36:47.884 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.884 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.884 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.884 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.884 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.884 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.884 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.884 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T23:36:47.884 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T23:36:47.884 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.884 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.884 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.884 INFO:teuthology.orchestra.run.smithi003.stdout: "autotune_interval": { 2024-09-10T23:36:47.885 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "autotune_interval", 2024-09-10T23:36:47.885 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:47.885 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.885 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.885 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "600", 2024-09-10T23:36:47.885 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.885 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.885 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.885 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T23:36:47.885 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.885 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.885 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.885 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.886 INFO:teuthology.orchestra.run.smithi003.stdout: "autotune_memory_target_ratio": { 2024-09-10T23:36:47.886 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T23:36:47.886 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-10T23:36:47.886 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.886 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.886 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0.7", 2024-09-10T23:36:47.886 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.886 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.886 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.886 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T23:36:47.886 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.886 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.887 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.887 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.887 INFO:teuthology.orchestra.run.smithi003.stdout: "cephadm_log_destination": { 2024-09-10T23:36:47.887 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "cephadm_log_destination", 2024-09-10T23:36:47.887 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.887 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.887 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.887 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.887 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.887 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.887 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.887 INFO:teuthology.orchestra.run.smithi003.stdout: "file", 2024-09-10T23:36:47.887 INFO:teuthology.orchestra.run.smithi003.stdout: "file,syslog", 2024-09-10T23:36:47.888 INFO:teuthology.orchestra.run.smithi003.stdout: "syslog" 2024-09-10T23:36:47.888 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.888 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T23:36:47.888 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.888 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.888 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.888 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.888 INFO:teuthology.orchestra.run.smithi003.stdout: "cgroups_split": { 2024-09-10T23:36:47.888 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "cgroups_split", 2024-09-10T23:36:47.888 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.888 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.888 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.889 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.889 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.889 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.889 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.889 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T23:36:47.889 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.889 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.889 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.889 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.889 INFO:teuthology.orchestra.run.smithi003.stdout: "config_checks_enabled": { 2024-09-10T23:36:47.889 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "config_checks_enabled", 2024-09-10T23:36:47.889 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.889 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.890 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.890 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.890 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.890 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.890 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.890 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T23:36:47.890 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.890 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.890 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.890 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.891 INFO:teuthology.orchestra.run.smithi003.stdout: "config_dashboard": { 2024-09-10T23:36:47.891 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "config_dashboard", 2024-09-10T23:36:47.891 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.891 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.891 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.891 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.891 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.891 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.891 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.891 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T23:36:47.891 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.891 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.892 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.892 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.892 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_alertmanager": { 2024-09-10T23:36:47.892 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_alertmanager", 2024-09-10T23:36:47.892 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.892 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.892 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.892 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-10T23:36:47.892 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.892 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.892 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.893 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Prometheus container image", 2024-09-10T23:36:47.893 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.893 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.893 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.893 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.893 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_base": { 2024-09-10T23:36:47.893 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_base", 2024-09-10T23:36:47.893 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.893 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.893 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.893 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T23:36:47.893 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.893 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.894 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.894 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Container image name, without the tag", 2024-09-10T23:36:47.894 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.894 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.894 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.894 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.894 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_elasticsearch": { 2024-09-10T23:36:47.894 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_elasticsearch", 2024-09-10T23:36:47.894 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.894 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.894 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.894 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T23:36:47.894 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.895 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.895 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.895 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "elasticsearch container image", 2024-09-10T23:36:47.895 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.895 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.895 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.895 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.895 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_grafana": { 2024-09-10T23:36:47.895 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_grafana", 2024-09-10T23:36:47.895 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.895 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.895 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.895 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-10T23:36:47.896 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.896 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.896 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.896 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Prometheus container image", 2024-09-10T23:36:47.896 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.896 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.896 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.896 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.896 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_haproxy": { 2024-09-10T23:36:47.896 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_haproxy", 2024-09-10T23:36:47.896 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.896 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.896 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.896 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T23:36:47.897 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.897 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.897 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.897 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "HAproxy container image", 2024-09-10T23:36:47.897 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.897 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.897 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.897 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.897 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_jaeger_agent": { 2024-09-10T23:36:47.897 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_jaeger_agent", 2024-09-10T23:36:47.897 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.897 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.897 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.897 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T23:36:47.898 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.898 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.898 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.898 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Jaeger agent container image", 2024-09-10T23:36:47.898 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.898 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.898 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.898 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.898 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_jaeger_collector": { 2024-09-10T23:36:47.898 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_jaeger_collector", 2024-09-10T23:36:47.898 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.898 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.898 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.898 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T23:36:47.899 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.899 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.899 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.899 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Jaeger collector container image", 2024-09-10T23:36:47.899 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.899 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.899 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.899 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.899 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_jaeger_query": { 2024-09-10T23:36:47.899 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_jaeger_query", 2024-09-10T23:36:47.899 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.899 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.899 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.900 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T23:36:47.900 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.900 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.900 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.900 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Jaeger query container image", 2024-09-10T23:36:47.900 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.900 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.900 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.900 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.900 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_keepalived": { 2024-09-10T23:36:47.900 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_keepalived", 2024-09-10T23:36:47.900 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.900 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.900 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.901 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T23:36:47.901 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.901 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.901 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.901 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Keepalived container image", 2024-09-10T23:36:47.901 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.901 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.901 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.901 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.901 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_loki": { 2024-09-10T23:36:47.901 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_loki", 2024-09-10T23:36:47.901 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.901 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.901 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.902 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T23:36:47.902 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.902 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.902 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.902 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Loki container image", 2024-09-10T23:36:47.902 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.902 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.902 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.902 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.902 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_nginx": { 2024-09-10T23:36:47.902 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_nginx", 2024-09-10T23:36:47.902 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.902 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.902 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.902 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-10T23:36:47.903 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.903 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.903 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.903 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Nginx container image", 2024-09-10T23:36:47.903 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.903 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.903 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.903 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.903 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_node_exporter": { 2024-09-10T23:36:47.903 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_node_exporter", 2024-09-10T23:36:47.903 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.903 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.903 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.903 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-10T23:36:47.904 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.904 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.904 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.904 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Prometheus container image", 2024-09-10T23:36:47.904 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.904 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.904 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.904 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.904 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_nvmeof": { 2024-09-10T23:36:47.904 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_nvmeof", 2024-09-10T23:36:47.904 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.904 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.904 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.904 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-10T23:36:47.905 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.905 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.905 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.905 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Nvme-of container image", 2024-09-10T23:36:47.905 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.905 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.905 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.905 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.905 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_oauth2_proxy": { 2024-09-10T23:36:47.905 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_oauth2_proxy", 2024-09-10T23:36:47.905 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.905 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.905 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.906 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-10T23:36:47.906 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.906 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.906 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.906 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "oauth2-proxy container image", 2024-09-10T23:36:47.906 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.906 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.906 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.906 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.906 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_prometheus": { 2024-09-10T23:36:47.906 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_prometheus", 2024-09-10T23:36:47.906 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.906 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.906 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.906 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-10T23:36:47.907 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.907 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.907 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.907 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Prometheus container image", 2024-09-10T23:36:47.907 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.907 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.907 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.907 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.907 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_promtail": { 2024-09-10T23:36:47.907 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_promtail", 2024-09-10T23:36:47.907 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.907 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.907 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.907 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T23:36:47.907 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.908 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.908 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.908 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Promtail container image", 2024-09-10T23:36:47.908 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.908 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.908 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.908 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.908 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_samba": { 2024-09-10T23:36:47.908 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_samba", 2024-09-10T23:36:47.908 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.908 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.908 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.908 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T23:36:47.908 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.909 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.909 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.909 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Samba/SMB container image", 2024-09-10T23:36:47.909 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.909 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.909 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.909 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.909 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_samba_metrics": { 2024-09-10T23:36:47.909 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_samba_metrics", 2024-09-10T23:36:47.909 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.909 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.909 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.909 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-10T23:36:47.909 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.910 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.910 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.910 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-10T23:36:47.910 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.910 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.910 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.910 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.910 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_snmp_gateway": { 2024-09-10T23:36:47.910 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_snmp_gateway", 2024-09-10T23:36:47.910 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.910 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.910 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.910 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T23:36:47.911 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.911 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.911 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.911 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "SNMP Gateway container image", 2024-09-10T23:36:47.911 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.911 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.911 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.911 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.911 INFO:teuthology.orchestra.run.smithi003.stdout: "container_init": { 2024-09-10T23:36:47.911 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_init", 2024-09-10T23:36:47.911 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.911 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.911 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.912 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.912 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.912 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.912 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.912 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T23:36:47.912 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.912 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.912 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.912 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.912 INFO:teuthology.orchestra.run.smithi003.stdout: "daemon_cache_timeout": { 2024-09-10T23:36:47.912 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "daemon_cache_timeout", 2024-09-10T23:36:47.912 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:47.912 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.912 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.913 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "600", 2024-09-10T23:36:47.913 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.913 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.913 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.913 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T23:36:47.913 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.913 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.913 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.913 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.913 INFO:teuthology.orchestra.run.smithi003.stdout: "default_cephadm_command_timeout": { 2024-09-10T23:36:47.913 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T23:36:47.913 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.914 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.914 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.914 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "900", 2024-09-10T23:36:47.914 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.914 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.914 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.914 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T23:36:47.914 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.914 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.914 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.914 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.914 INFO:teuthology.orchestra.run.smithi003.stdout: "default_registry": { 2024-09-10T23:36:47.914 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "default_registry", 2024-09-10T23:36:47.914 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.914 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.915 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.915 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "docker.io", 2024-09-10T23:36:47.915 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.915 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.915 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.915 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T23:36:47.915 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.915 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.915 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.915 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.915 INFO:teuthology.orchestra.run.smithi003.stdout: "device_cache_timeout": { 2024-09-10T23:36:47.915 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "device_cache_timeout", 2024-09-10T23:36:47.915 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:47.916 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.916 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.916 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "1800", 2024-09-10T23:36:47.916 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.916 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.916 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.916 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "seconds to cache device inventory", 2024-09-10T23:36:47.916 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.916 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.916 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.916 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.916 INFO:teuthology.orchestra.run.smithi003.stdout: "device_enhanced_scan": { 2024-09-10T23:36:47.916 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "device_enhanced_scan", 2024-09-10T23:36:47.917 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.917 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.917 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.917 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.917 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.917 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.917 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.917 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T23:36:47.917 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.917 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.917 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.917 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.917 INFO:teuthology.orchestra.run.smithi003.stdout: "facts_cache_timeout": { 2024-09-10T23:36:47.917 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "facts_cache_timeout", 2024-09-10T23:36:47.918 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:47.918 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.918 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.918 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "60", 2024-09-10T23:36:47.918 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.918 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.918 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.918 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "seconds to cache host facts data", 2024-09-10T23:36:47.918 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.918 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.918 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.918 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.918 INFO:teuthology.orchestra.run.smithi003.stdout: "grafana_dashboards_path": { 2024-09-10T23:36:47.918 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "grafana_dashboards_path", 2024-09-10T23:36:47.918 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.918 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.919 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.919 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T23:36:47.919 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.919 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.919 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.919 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T23:36:47.919 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.919 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.919 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.919 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.919 INFO:teuthology.orchestra.run.smithi003.stdout: "host_check_interval": { 2024-09-10T23:36:47.919 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "host_check_interval", 2024-09-10T23:36:47.919 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:47.919 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.920 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.920 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "600", 2024-09-10T23:36:47.920 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.920 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.920 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.920 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how frequently to perform a host check", 2024-09-10T23:36:47.920 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.920 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.920 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.920 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.920 INFO:teuthology.orchestra.run.smithi003.stdout: "hw_monitoring": { 2024-09-10T23:36:47.920 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "hw_monitoring", 2024-09-10T23:36:47.920 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.920 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.921 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.921 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.921 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.921 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.921 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.921 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T23:36:47.921 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.921 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.921 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.921 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.921 INFO:teuthology.orchestra.run.smithi003.stdout: "inventory_list_all": { 2024-09-10T23:36:47.921 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "inventory_list_all", 2024-09-10T23:36:47.921 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.921 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.921 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.922 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.922 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.922 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.922 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.922 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T23:36:47.922 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.922 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.922 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.922 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.922 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.922 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.922 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.922 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.922 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.923 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.923 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.923 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.923 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.923 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.923 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.923 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.923 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.923 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.923 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.923 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.923 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.923 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.923 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.923 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.924 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.924 INFO:teuthology.orchestra.run.smithi003.stdout: "log_refresh_metadata": { 2024-09-10T23:36:47.924 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_refresh_metadata", 2024-09-10T23:36:47.924 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.924 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.924 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.924 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.924 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.924 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.924 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.924 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T23:36:47.924 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.924 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.924 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.925 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.925 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.925 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.925 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.925 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.925 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.925 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.925 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.925 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.925 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.925 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T23:36:47.925 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.925 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.925 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.926 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.926 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.926 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.926 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.926 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.926 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.926 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.926 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.926 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.926 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.926 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.926 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.927 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.927 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.927 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.927 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.927 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.927 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.927 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.927 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.927 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.927 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.927 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.927 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.927 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.927 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.927 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.928 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.928 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.928 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.928 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.928 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.928 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.928 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.928 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.928 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.928 INFO:teuthology.orchestra.run.smithi003.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T23:36:47.928 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T23:36:47.928 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.928 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.929 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.929 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.929 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.929 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.929 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.929 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T23:36:47.929 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.929 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.929 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.929 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.929 INFO:teuthology.orchestra.run.smithi003.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T23:36:47.929 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T23:36:47.929 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.929 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.929 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.930 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "*", 2024-09-10T23:36:47.930 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.932 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.932 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.932 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T23:36:47.932 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.932 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.932 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.932 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.932 INFO:teuthology.orchestra.run.smithi003.stdout: "max_count_per_host": { 2024-09-10T23:36:47.932 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "max_count_per_host", 2024-09-10T23:36:47.932 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.932 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.932 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.933 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-10T23:36:47.933 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.933 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.933 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.933 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "max number of daemons per service per host", 2024-09-10T23:36:47.933 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.933 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.933 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.933 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.933 INFO:teuthology.orchestra.run.smithi003.stdout: "max_osd_draining_count": { 2024-09-10T23:36:47.933 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "max_osd_draining_count", 2024-09-10T23:36:47.933 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.933 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.934 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.934 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-10T23:36:47.934 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.934 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.934 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.934 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T23:36:47.934 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.934 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.934 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.934 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.934 INFO:teuthology.orchestra.run.smithi003.stdout: "migration_current": { 2024-09-10T23:36:47.934 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "migration_current", 2024-09-10T23:36:47.934 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.935 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.935 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.935 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.935 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.935 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.935 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.935 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "internal - do not modify", 2024-09-10T23:36:47.935 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.935 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.935 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.935 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.935 INFO:teuthology.orchestra.run.smithi003.stdout: "mode": { 2024-09-10T23:36:47.935 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mode", 2024-09-10T23:36:47.935 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.936 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.936 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.936 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "root", 2024-09-10T23:36:47.936 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.936 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.936 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.936 INFO:teuthology.orchestra.run.smithi003.stdout: "cephadm-package", 2024-09-10T23:36:47.936 INFO:teuthology.orchestra.run.smithi003.stdout: "root" 2024-09-10T23:36:47.936 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.936 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T23:36:47.936 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.936 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.936 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.937 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.937 INFO:teuthology.orchestra.run.smithi003.stdout: "oob_default_addr": { 2024-09-10T23:36:47.937 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "oob_default_addr", 2024-09-10T23:36:47.937 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.937 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.937 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.937 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "169.254.1.1", 2024-09-10T23:36:47.937 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.937 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.937 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.937 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T23:36:47.937 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.937 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.938 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.938 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.938 INFO:teuthology.orchestra.run.smithi003.stdout: "prometheus_alerts_path": { 2024-09-10T23:36:47.938 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "prometheus_alerts_path", 2024-09-10T23:36:47.938 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.938 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.938 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.938 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T23:36:47.938 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.938 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.938 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.938 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T23:36:47.938 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.939 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.939 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.939 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.939 INFO:teuthology.orchestra.run.smithi003.stdout: "registry_insecure": { 2024-09-10T23:36:47.939 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "registry_insecure", 2024-09-10T23:36:47.939 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.939 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.939 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.939 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.939 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.939 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.939 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.939 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T23:36:47.939 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.940 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.940 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.940 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.940 INFO:teuthology.orchestra.run.smithi003.stdout: "registry_password": { 2024-09-10T23:36:47.940 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "registry_password", 2024-09-10T23:36:47.940 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.940 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.940 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.940 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.940 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.940 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.940 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.940 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T23:36:47.940 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.940 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.941 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.941 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.941 INFO:teuthology.orchestra.run.smithi003.stdout: "registry_url": { 2024-09-10T23:36:47.941 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "registry_url", 2024-09-10T23:36:47.941 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.941 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.941 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.941 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.941 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.941 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.941 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.941 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T23:36:47.941 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.941 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.942 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.942 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.942 INFO:teuthology.orchestra.run.smithi003.stdout: "registry_username": { 2024-09-10T23:36:47.942 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "registry_username", 2024-09-10T23:36:47.942 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.942 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.942 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.942 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.942 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.942 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.942 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.942 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T23:36:47.942 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.942 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.942 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.943 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.943 INFO:teuthology.orchestra.run.smithi003.stdout: "secure_monitoring_stack": { 2024-09-10T23:36:47.943 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "secure_monitoring_stack", 2024-09-10T23:36:47.943 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.943 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.943 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.943 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.943 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.943 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.943 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.943 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T23:36:47.943 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.943 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.943 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.943 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.944 INFO:teuthology.orchestra.run.smithi003.stdout: "service_discovery_port": { 2024-09-10T23:36:47.944 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "service_discovery_port", 2024-09-10T23:36:47.944 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.944 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.944 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.944 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "8765", 2024-09-10T23:36:47.944 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.944 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.944 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.944 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "cephadm service discovery port", 2024-09-10T23:36:47.944 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.944 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.944 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.944 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.944 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.944 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.945 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.945 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.945 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.945 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.945 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.945 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.945 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.945 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.945 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.945 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.945 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.945 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.946 INFO:teuthology.orchestra.run.smithi003.stdout: "ssh_config_file": { 2024-09-10T23:36:47.946 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ssh_config_file", 2024-09-10T23:36:47.946 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.946 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.946 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.946 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.946 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.946 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.946 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.946 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T23:36:47.946 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.946 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.946 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.947 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.947 INFO:teuthology.orchestra.run.smithi003.stdout: "use_agent": { 2024-09-10T23:36:47.947 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "use_agent", 2024-09-10T23:36:47.947 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.947 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.947 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.947 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.947 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.947 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.947 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.947 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T23:36:47.947 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.947 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.947 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.947 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.947 INFO:teuthology.orchestra.run.smithi003.stdout: "use_repo_digest": { 2024-09-10T23:36:47.948 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "use_repo_digest", 2024-09-10T23:36:47.948 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.948 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.948 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.948 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.948 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.948 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.948 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.948 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T23:36:47.948 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.948 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.948 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.948 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.948 INFO:teuthology.orchestra.run.smithi003.stdout: "warn_on_failed_host_check": { 2024-09-10T23:36:47.949 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "warn_on_failed_host_check", 2024-09-10T23:36:47.949 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.949 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.949 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.949 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.949 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.949 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.949 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.949 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T23:36:47.949 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.949 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.949 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.949 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.950 INFO:teuthology.orchestra.run.smithi003.stdout: "warn_on_stray_daemons": { 2024-09-10T23:36:47.950 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "warn_on_stray_daemons", 2024-09-10T23:36:47.950 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.950 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.950 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.950 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.950 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.950 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.950 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.950 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T23:36:47.950 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.950 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.950 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.950 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.951 INFO:teuthology.orchestra.run.smithi003.stdout: "warn_on_stray_hosts": { 2024-09-10T23:36:47.951 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "warn_on_stray_hosts", 2024-09-10T23:36:47.951 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.951 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.951 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.951 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.951 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.951 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.951 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.951 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T23:36:47.951 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.951 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.951 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.951 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.951 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.952 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.952 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.952 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crash", 2024-09-10T23:36:47.952 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.952 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.952 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.952 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:47.952 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:47.952 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.952 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.952 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.952 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.952 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.952 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.953 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.953 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.953 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.953 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.953 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.953 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.953 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.953 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.953 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.953 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.953 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.953 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.953 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.953 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:47.954 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:47.954 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.954 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.954 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.954 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.954 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.954 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.954 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.954 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.954 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.954 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.954 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.954 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.954 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:47.955 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:47.955 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.955 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.955 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.955 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:47.955 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.955 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.955 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:47.955 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:47.955 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:47.955 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:47.955 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:47.955 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:47.955 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:47.956 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:47.956 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.956 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.956 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.956 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.956 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.956 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:47.956 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:47.956 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.956 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.956 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.956 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.956 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.956 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.956 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.957 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.957 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.957 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.957 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.957 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.957 INFO:teuthology.orchestra.run.smithi003.stdout: "retain_interval": { 2024-09-10T23:36:47.957 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "retain_interval", 2024-09-10T23:36:47.957 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:47.957 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.957 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.957 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "31536000", 2024-09-10T23:36:47.957 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.957 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.957 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.958 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T23:36:47.958 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.958 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.958 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.958 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.958 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:47.958 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:47.958 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.958 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:47.958 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.958 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:47.958 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.958 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.958 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.958 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.959 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.959 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.959 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.959 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.959 INFO:teuthology.orchestra.run.smithi003.stdout: "warn_recent_interval": { 2024-09-10T23:36:47.959 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "warn_recent_interval", 2024-09-10T23:36:47.959 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:47.959 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.959 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:47.959 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "1209600", 2024-09-10T23:36:47.959 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.959 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.959 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.959 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T23:36:47.959 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.960 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.960 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.960 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.960 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:47.960 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.960 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:47.960 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "dashboard", 2024-09-10T23:36:47.960 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:47.960 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:47.960 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:47.960 INFO:teuthology.orchestra.run.smithi003.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T23:36:47.960 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T23:36:47.960 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.960 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.961 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.961 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-10T23:36:47.961 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.961 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.961 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.961 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.961 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.961 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.961 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.961 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.961 INFO:teuthology.orchestra.run.smithi003.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T23:36:47.961 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T23:36:47.961 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.962 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.962 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.962 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.962 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.962 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.962 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.962 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.962 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.962 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.962 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.962 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.962 INFO:teuthology.orchestra.run.smithi003.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T23:36:47.962 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T23:36:47.963 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.963 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.963 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.963 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.963 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.963 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.963 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.963 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.963 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.963 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.963 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.963 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.963 INFO:teuthology.orchestra.run.smithi003.stdout: "AUDIT_API_ENABLED": { 2024-09-10T23:36:47.963 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T23:36:47.964 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.964 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.964 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.964 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.964 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.964 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.964 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.964 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.964 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.964 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.964 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.964 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.964 INFO:teuthology.orchestra.run.smithi003.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T23:36:47.965 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T23:36:47.965 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.965 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.965 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.965 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.965 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.965 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.965 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.965 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.965 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.965 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.965 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.966 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.966 INFO:teuthology.orchestra.run.smithi003.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T23:36:47.966 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T23:36:47.966 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.966 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.966 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.966 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.966 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.966 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.966 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.966 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.966 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.966 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.966 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.967 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.967 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T23:36:47.967 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T23:36:47.967 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.967 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.967 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.967 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.967 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.967 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.967 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.967 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.967 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.967 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.968 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.968 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.968 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T23:36:47.968 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T23:36:47.968 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.968 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.968 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.968 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.968 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.968 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.968 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.968 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.969 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.969 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.969 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.969 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.969 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T23:36:47.969 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T23:36:47.969 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.969 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.969 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.969 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.969 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.969 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.969 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.969 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.969 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.970 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.970 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.970 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.970 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T23:36:47.970 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T23:36:47.970 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.970 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.970 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.970 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.970 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.970 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.970 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.970 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.971 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.971 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.971 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.971 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.971 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T23:36:47.971 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T23:36:47.971 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.971 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.971 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.971 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.971 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.971 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.971 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.971 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.972 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.972 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.972 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.972 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.972 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T23:36:47.972 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T23:36:47.972 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.972 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.972 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.972 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.972 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.972 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.972 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.973 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.973 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.973 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.973 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.973 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.973 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T23:36:47.973 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T23:36:47.973 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.973 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.973 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.973 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.973 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.973 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.973 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.974 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.974 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.974 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.974 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.974 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.974 INFO:teuthology.orchestra.run.smithi003.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T23:36:47.974 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T23:36:47.974 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.974 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.974 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.974 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.974 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.974 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.974 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.975 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.975 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.975 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.975 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.975 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.975 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T23:36:47.975 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T23:36:47.975 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.975 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.975 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.975 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "admin", 2024-09-10T23:36:47.975 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.975 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.976 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.976 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.976 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.976 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.976 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.976 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.976 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T23:36:47.976 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T23:36:47.976 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.976 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.976 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.976 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.977 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.977 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.977 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.977 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.977 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.977 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.977 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.977 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.977 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_API_URL": { 2024-09-10T23:36:47.977 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_API_URL", 2024-09-10T23:36:47.977 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.977 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.977 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.977 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.978 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.978 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.978 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.978 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.978 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.978 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.978 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.978 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.978 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T23:36:47.978 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T23:36:47.978 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.978 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.978 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.979 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "admin", 2024-09-10T23:36:47.979 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.979 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.979 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.979 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.979 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.979 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.979 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.979 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.979 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T23:36:47.979 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T23:36:47.979 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.979 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.980 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.980 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.980 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.980 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.980 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.980 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.980 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.980 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.980 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.980 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.980 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T23:36:47.980 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T23:36:47.980 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.981 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.981 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.981 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.981 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.981 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.981 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.981 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.981 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.981 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.981 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.981 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.981 INFO:teuthology.orchestra.run.smithi003.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T23:36:47.981 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T23:36:47.981 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.982 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.982 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.982 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.982 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.982 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.982 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.982 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.982 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.982 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.982 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.982 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.982 INFO:teuthology.orchestra.run.smithi003.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T23:36:47.982 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T23:36:47.983 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.983 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.983 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.983 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.983 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.983 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.983 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.983 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.983 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.983 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.983 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.983 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.983 INFO:teuthology.orchestra.run.smithi003.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-10T23:36:47.984 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-10T23:36:47.984 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.984 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.984 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.984 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "[]", 2024-09-10T23:36:47.984 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.984 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.984 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.984 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.984 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.984 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.984 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.984 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.984 INFO:teuthology.orchestra.run.smithi003.stdout: "MULTICLUSTER_CONFIG": { 2024-09-10T23:36:47.985 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-10T23:36:47.985 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.985 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.985 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.985 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "{}", 2024-09-10T23:36:47.985 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.985 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.985 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.985 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.985 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.985 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.985 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.985 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.985 INFO:teuthology.orchestra.run.smithi003.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T23:36:47.986 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T23:36:47.986 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.986 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.986 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.986 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:47.986 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.986 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.986 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.986 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.986 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.986 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.986 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.986 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.987 INFO:teuthology.orchestra.run.smithi003.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T23:36:47.987 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T23:36:47.987 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.987 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.987 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.987 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.987 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.987 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.987 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.987 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.987 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.987 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.987 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.988 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.988 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T23:36:47.988 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T23:36:47.988 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.988 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.988 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.988 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.988 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.988 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.988 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.988 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.988 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.988 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.988 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.989 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.989 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T23:36:47.989 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T23:36:47.989 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.989 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.989 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.989 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.989 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.989 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.989 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.989 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.989 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.989 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.990 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.990 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.990 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T23:36:47.990 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T23:36:47.990 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.990 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.990 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.990 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.990 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.990 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.990 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.990 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.991 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.991 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.991 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.991 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.991 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T23:36:47.991 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T23:36:47.991 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.991 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.991 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.991 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.992 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.992 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.992 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.992 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.992 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.992 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.992 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.992 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.992 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T23:36:47.992 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T23:36:47.992 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.992 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.992 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.993 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.993 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.993 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.993 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.993 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.993 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.993 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.993 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.993 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.993 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T23:36:47.993 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T23:36:47.993 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.994 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.994 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.994 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.994 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.994 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.994 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.994 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.994 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.994 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.994 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.994 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.994 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T23:36:47.994 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T23:36:47.995 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.995 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.995 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.995 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:47.995 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.995 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.995 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.995 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.995 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.995 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.995 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.995 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.995 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T23:36:47.996 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T23:36:47.996 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:47.996 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.996 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.996 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:47.996 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.996 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.996 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.996 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.996 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.996 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.996 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.997 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.997 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T23:36:47.997 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T23:36:47.997 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:47.997 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.997 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.997 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T23:36:47.997 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.997 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.997 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.997 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.997 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.997 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.997 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.998 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.998 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T23:36:47.998 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T23:36:47.998 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.998 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.998 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.998 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-10T23:36:47.998 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.998 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.998 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.998 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.998 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:47.998 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:47.999 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:47.999 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:47.999 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T23:36:47.999 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T23:36:47.999 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:47.999 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:47.999 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:47.999 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "8", 2024-09-10T23:36:47.999 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:47.999 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:47.999 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:47.999 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:47.999 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.000 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.000 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.000 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.000 INFO:teuthology.orchestra.run.smithi003.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T23:36:48.000 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T23:36:48.000 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.000 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.000 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.000 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "45", 2024-09-10T23:36:48.000 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.000 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.000 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.000 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.000 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.001 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.001 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.001 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.001 INFO:teuthology.orchestra.run.smithi003.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T23:36:48.001 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T23:36:48.001 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.001 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.001 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.001 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.001 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.001 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.001 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.001 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.002 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.002 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.002 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.002 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.002 INFO:teuthology.orchestra.run.smithi003.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T23:36:48.002 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T23:36:48.002 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.002 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.002 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.002 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "admin", 2024-09-10T23:36:48.002 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.002 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.002 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.002 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.003 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.003 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.003 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.003 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.003 INFO:teuthology.orchestra.run.smithi003.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T23:36:48.003 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T23:36:48.003 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.003 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.003 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.003 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.003 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.003 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.003 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.003 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.003 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.003 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.004 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.004 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.004 INFO:teuthology.orchestra.run.smithi003.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T23:36:48.004 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T23:36:48.004 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.004 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.004 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.004 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.004 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.004 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.004 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.004 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.004 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.005 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.005 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.005 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.005 INFO:teuthology.orchestra.run.smithi003.stdout: "UNSAFE_TLS_v1_2": { 2024-09-10T23:36:48.005 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-10T23:36:48.005 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.005 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.005 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.005 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.005 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.005 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.005 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.005 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.005 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.006 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.006 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.006 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.006 INFO:teuthology.orchestra.run.smithi003.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T23:36:48.006 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T23:36:48.006 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.006 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.006 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.006 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.006 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.006 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.006 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.006 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.006 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.007 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.007 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.007 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.007 INFO:teuthology.orchestra.run.smithi003.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T23:36:48.007 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T23:36:48.007 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.007 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.007 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.007 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-10T23:36:48.007 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.007 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.007 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.007 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.007 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.008 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.008 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.008 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.008 INFO:teuthology.orchestra.run.smithi003.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T23:36:48.008 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T23:36:48.008 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.008 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.008 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.008 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5", 2024-09-10T23:36:48.008 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.008 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.008 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.008 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.009 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.009 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.009 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.009 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.009 INFO:teuthology.orchestra.run.smithi003.stdout: "cross_origin_url": { 2024-09-10T23:36:48.009 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "cross_origin_url", 2024-09-10T23:36:48.009 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.009 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.009 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.009 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.009 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.009 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.009 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.010 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.010 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.010 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.010 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.010 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.010 INFO:teuthology.orchestra.run.smithi003.stdout: "crt_file": { 2024-09-10T23:36:48.010 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crt_file", 2024-09-10T23:36:48.010 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.010 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.010 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.010 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.010 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.010 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.011 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.011 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.011 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.011 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.011 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.011 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.011 INFO:teuthology.orchestra.run.smithi003.stdout: "debug": { 2024-09-10T23:36:48.011 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "debug", 2024-09-10T23:36:48.011 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.011 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.011 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.011 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.011 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.012 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.012 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.012 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Enable/disable debug options", 2024-09-10T23:36:48.012 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.012 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.012 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.012 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.012 INFO:teuthology.orchestra.run.smithi003.stdout: "jwt_token_ttl": { 2024-09-10T23:36:48.012 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "jwt_token_ttl", 2024-09-10T23:36:48.012 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.012 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.012 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.012 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "28800", 2024-09-10T23:36:48.012 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.013 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.013 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.013 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.013 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.013 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.013 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.013 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.013 INFO:teuthology.orchestra.run.smithi003.stdout: "key_file": { 2024-09-10T23:36:48.013 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "key_file", 2024-09-10T23:36:48.013 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.013 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.013 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.013 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.014 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.014 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.014 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.014 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.014 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.014 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.014 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.014 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.014 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.014 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.014 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.014 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.014 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.014 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.015 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.015 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.015 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.015 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.015 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.015 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.015 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.015 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.015 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.015 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.015 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.015 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.015 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.015 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.016 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.016 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.016 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.016 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.016 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.016 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.016 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.016 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.016 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.016 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.016 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.016 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.016 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.017 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.017 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.017 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.017 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.017 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.017 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.017 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.017 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.017 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.017 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.017 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.017 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.017 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.017 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.018 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.018 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.018 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.018 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.018 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.018 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.018 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.018 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.018 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.018 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.018 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.018 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.018 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.019 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.019 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.019 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.019 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.019 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.019 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.019 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.019 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.019 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.019 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.019 INFO:teuthology.orchestra.run.smithi003.stdout: "motd": { 2024-09-10T23:36:48.019 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "motd", 2024-09-10T23:36:48.019 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.019 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.020 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.020 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.020 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.020 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.020 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.020 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "The message of the day", 2024-09-10T23:36:48.020 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.020 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.020 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.020 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.020 INFO:teuthology.orchestra.run.smithi003.stdout: "redirect_resolve_ip_addr": { 2024-09-10T23:36:48.020 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T23:36:48.020 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.021 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.021 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.021 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.021 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.021 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.021 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.021 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.021 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.021 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.021 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.021 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.021 INFO:teuthology.orchestra.run.smithi003.stdout: "server_addr": { 2024-09-10T23:36:48.021 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_addr", 2024-09-10T23:36:48.022 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.022 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.022 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.022 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "::", 2024-09-10T23:36:48.022 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.022 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.022 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.022 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.022 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.022 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.022 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.022 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.022 INFO:teuthology.orchestra.run.smithi003.stdout: "server_port": { 2024-09-10T23:36:48.022 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_port", 2024-09-10T23:36:48.023 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.023 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.023 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.023 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "8080", 2024-09-10T23:36:48.023 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.023 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.023 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.023 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.023 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.023 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.023 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.023 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.023 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.023 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.024 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.024 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.024 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.024 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.024 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.024 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.024 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.024 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.024 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.024 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.024 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.024 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.025 INFO:teuthology.orchestra.run.smithi003.stdout: "ssl": { 2024-09-10T23:36:48.025 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ssl", 2024-09-10T23:36:48.025 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.025 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.025 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.025 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.025 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.025 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.025 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.025 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.025 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.025 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.025 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.026 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.026 INFO:teuthology.orchestra.run.smithi003.stdout: "ssl_server_port": { 2024-09-10T23:36:48.026 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ssl_server_port", 2024-09-10T23:36:48.026 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.026 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.026 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.026 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "8443", 2024-09-10T23:36:48.026 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.026 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.026 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.026 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.026 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.026 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.026 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.026 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.027 INFO:teuthology.orchestra.run.smithi003.stdout: "standby_behaviour": { 2024-09-10T23:36:48.027 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "standby_behaviour", 2024-09-10T23:36:48.027 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.027 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.027 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.027 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "redirect", 2024-09-10T23:36:48.027 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.027 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.027 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.027 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.027 INFO:teuthology.orchestra.run.smithi003.stdout: "redirect" 2024-09-10T23:36:48.027 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.027 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.027 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.028 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.028 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.028 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.028 INFO:teuthology.orchestra.run.smithi003.stdout: "standby_error_status_code": { 2024-09-10T23:36:48.028 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "standby_error_status_code", 2024-09-10T23:36:48.028 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.028 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.028 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.028 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "500", 2024-09-10T23:36:48.028 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "400", 2024-09-10T23:36:48.028 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "599", 2024-09-10T23:36:48.028 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.028 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.028 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.029 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.029 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.029 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.029 INFO:teuthology.orchestra.run.smithi003.stdout: "url_prefix": { 2024-09-10T23:36:48.029 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "url_prefix", 2024-09-10T23:36:48.029 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.029 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.029 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.029 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.029 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.029 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.029 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.029 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.030 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.030 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.030 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.030 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.030 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.030 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.030 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.030 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "devicehealth", 2024-09-10T23:36:48.030 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.030 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.030 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.030 INFO:teuthology.orchestra.run.smithi003.stdout: "enable_monitoring": { 2024-09-10T23:36:48.030 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "enable_monitoring", 2024-09-10T23:36:48.030 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.031 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.031 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.031 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.031 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.031 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.031 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.031 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "monitor device health metrics", 2024-09-10T23:36:48.031 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.031 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.031 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.031 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.031 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.031 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.031 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.032 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.032 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.032 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.032 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.032 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.032 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.032 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.032 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.032 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.032 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.032 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.033 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.033 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.033 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.033 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.033 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.033 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.033 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.033 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.033 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.033 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.033 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.033 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.033 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.034 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.034 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.034 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.034 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.034 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.034 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.034 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.034 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.034 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.034 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.034 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.034 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.034 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.034 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.035 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.035 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.035 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.035 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.035 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.035 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.035 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.035 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.035 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.035 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.035 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.035 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.036 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.036 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.036 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.036 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.036 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.036 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.036 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.036 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.036 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.036 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.036 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.036 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.036 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.037 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.037 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.037 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.037 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.037 INFO:teuthology.orchestra.run.smithi003.stdout: "mark_out_threshold": { 2024-09-10T23:36:48.037 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mark_out_threshold", 2024-09-10T23:36:48.037 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:48.037 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.037 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.037 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "2419200", 2024-09-10T23:36:48.037 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.037 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.037 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.037 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T23:36:48.038 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.038 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.038 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.038 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.038 INFO:teuthology.orchestra.run.smithi003.stdout: "pool_name": { 2024-09-10T23:36:48.038 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "pool_name", 2024-09-10T23:36:48.038 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.038 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.038 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.038 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "device_health_metrics", 2024-09-10T23:36:48.038 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.038 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.038 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.039 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T23:36:48.039 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.039 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.039 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.039 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.039 INFO:teuthology.orchestra.run.smithi003.stdout: "retention_period": { 2024-09-10T23:36:48.039 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "retention_period", 2024-09-10T23:36:48.039 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:48.039 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.039 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.039 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "15552000", 2024-09-10T23:36:48.039 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.039 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.040 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.040 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how long to retain device health metrics", 2024-09-10T23:36:48.040 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.040 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.040 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.040 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.040 INFO:teuthology.orchestra.run.smithi003.stdout: "scrape_frequency": { 2024-09-10T23:36:48.040 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "scrape_frequency", 2024-09-10T23:36:48.040 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:48.040 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.040 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.040 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "86400", 2024-09-10T23:36:48.040 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.041 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.041 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.041 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T23:36:48.041 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.041 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.041 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.041 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.041 INFO:teuthology.orchestra.run.smithi003.stdout: "self_heal": { 2024-09-10T23:36:48.041 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "self_heal", 2024-09-10T23:36:48.041 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.041 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.041 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.041 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.041 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.042 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.042 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.042 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T23:36:48.042 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.042 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.042 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.042 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.042 INFO:teuthology.orchestra.run.smithi003.stdout: "sleep_interval": { 2024-09-10T23:36:48.042 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sleep_interval", 2024-09-10T23:36:48.042 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:48.042 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.042 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.042 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "600", 2024-09-10T23:36:48.042 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.042 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.043 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.043 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T23:36:48.043 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.043 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.043 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.043 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.043 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.043 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.043 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.043 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.043 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.043 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.043 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.043 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.044 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.044 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.044 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.044 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.044 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.044 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.044 INFO:teuthology.orchestra.run.smithi003.stdout: "warn_threshold": { 2024-09-10T23:36:48.044 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "warn_threshold", 2024-09-10T23:36:48.044 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:48.044 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.044 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.044 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "7257600", 2024-09-10T23:36:48.044 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.045 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.045 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.045 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T23:36:48.045 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.045 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.045 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.045 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.045 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.045 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.045 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.045 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "diskprediction_local", 2024-09-10T23:36:48.045 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.045 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.045 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.046 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.046 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.046 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.046 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.046 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.046 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.046 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.046 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.046 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.046 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.046 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.046 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.046 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.046 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.047 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.047 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.047 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.047 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.047 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.047 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.047 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.047 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.047 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.047 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.047 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.047 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.047 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.048 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.048 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.048 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.048 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.048 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.048 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.048 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.048 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.048 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.048 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.048 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.048 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.048 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.048 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.049 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.049 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.049 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.049 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.049 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.049 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.049 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.049 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.049 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.049 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.049 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.049 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.049 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.049 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.050 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.050 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.050 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.050 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.050 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.050 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.050 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.050 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.050 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.050 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.050 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.050 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.050 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.050 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.051 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.051 INFO:teuthology.orchestra.run.smithi003.stdout: "predict_interval": { 2024-09-10T23:36:48.051 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "predict_interval", 2024-09-10T23:36:48.051 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.051 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.051 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.051 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "86400", 2024-09-10T23:36:48.051 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.051 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.051 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.051 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.051 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.051 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.051 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.052 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.052 INFO:teuthology.orchestra.run.smithi003.stdout: "predictor_model": { 2024-09-10T23:36:48.052 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "predictor_model", 2024-09-10T23:36:48.052 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.052 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.052 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.052 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "prophetstor", 2024-09-10T23:36:48.052 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.052 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.052 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.052 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.052 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.052 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.052 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.053 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.053 INFO:teuthology.orchestra.run.smithi003.stdout: "sleep_interval": { 2024-09-10T23:36:48.053 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sleep_interval", 2024-09-10T23:36:48.053 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.053 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.053 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.053 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "600", 2024-09-10T23:36:48.053 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.053 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.053 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.053 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.053 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.053 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.054 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.054 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.054 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.054 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.054 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.054 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.054 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.054 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.054 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.054 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.054 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.054 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.054 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.054 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.055 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.055 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.055 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.055 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.055 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.055 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "influx", 2024-09-10T23:36:48.055 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": false, 2024-09-10T23:36:48.055 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "influxdb python module not found", 2024-09-10T23:36:48.055 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.055 INFO:teuthology.orchestra.run.smithi003.stdout: "batch_size": { 2024-09-10T23:36:48.055 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "batch_size", 2024-09-10T23:36:48.055 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.055 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.055 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.056 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5000", 2024-09-10T23:36:48.056 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.056 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.056 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.056 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T23:36:48.056 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.056 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.056 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.056 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.056 INFO:teuthology.orchestra.run.smithi003.stdout: "database": { 2024-09-10T23:36:48.056 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "database", 2024-09-10T23:36:48.056 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.056 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.057 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.057 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "ceph", 2024-09-10T23:36:48.057 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.057 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.057 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.057 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T23:36:48.057 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.057 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.057 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.057 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.057 INFO:teuthology.orchestra.run.smithi003.stdout: "hostname": { 2024-09-10T23:36:48.057 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "hostname", 2024-09-10T23:36:48.057 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.057 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.058 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.058 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.058 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.058 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.058 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.058 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "InfluxDB server hostname", 2024-09-10T23:36:48.058 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.058 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.058 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.058 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.058 INFO:teuthology.orchestra.run.smithi003.stdout: "interval": { 2024-09-10T23:36:48.058 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "interval", 2024-09-10T23:36:48.058 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:48.058 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.058 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.059 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "30", 2024-09-10T23:36:48.059 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "5", 2024-09-10T23:36:48.059 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.059 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.059 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T23:36:48.059 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.059 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.059 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.059 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.059 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.059 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.059 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.059 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.059 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.060 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.060 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.060 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.060 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.060 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.060 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.060 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.060 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.060 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.060 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.060 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.060 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.060 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.061 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.061 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.061 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.061 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.061 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.061 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.061 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.061 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.061 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.061 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.061 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.061 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.061 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.061 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.062 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.062 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.062 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.062 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.062 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.062 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.062 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.062 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.062 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.062 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.062 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.062 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.062 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.062 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.063 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.063 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.063 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.063 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.063 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.063 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.063 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.063 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.063 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.063 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.063 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.063 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.063 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.063 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.064 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.064 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.064 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.064 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.064 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.064 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.064 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.064 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.064 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.064 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.064 INFO:teuthology.orchestra.run.smithi003.stdout: "password": { 2024-09-10T23:36:48.064 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "password", 2024-09-10T23:36:48.064 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.065 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.065 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.065 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.065 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.065 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.065 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.065 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "password of InfluxDB server user", 2024-09-10T23:36:48.065 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.065 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.065 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.065 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.065 INFO:teuthology.orchestra.run.smithi003.stdout: "port": { 2024-09-10T23:36:48.065 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "port", 2024-09-10T23:36:48.065 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.065 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.066 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.066 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "8086", 2024-09-10T23:36:48.066 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.066 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.066 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.066 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "InfluxDB server port", 2024-09-10T23:36:48.066 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.066 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.066 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.066 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.066 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.066 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.066 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.066 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.067 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.067 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.067 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.067 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.067 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.067 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.067 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.067 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.067 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.067 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.067 INFO:teuthology.orchestra.run.smithi003.stdout: "ssl": { 2024-09-10T23:36:48.067 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ssl", 2024-09-10T23:36:48.067 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.067 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.068 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.068 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "false", 2024-09-10T23:36:48.068 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.068 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.068 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.068 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T23:36:48.068 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.068 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.068 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.068 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.068 INFO:teuthology.orchestra.run.smithi003.stdout: "threads": { 2024-09-10T23:36:48.068 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "threads", 2024-09-10T23:36:48.068 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.068 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.069 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.069 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5", 2024-09-10T23:36:48.069 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "1", 2024-09-10T23:36:48.069 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "32", 2024-09-10T23:36:48.069 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.069 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T23:36:48.069 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.069 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.069 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.069 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.069 INFO:teuthology.orchestra.run.smithi003.stdout: "username": { 2024-09-10T23:36:48.069 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "username", 2024-09-10T23:36:48.069 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.069 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.070 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.070 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.070 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.070 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.070 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.070 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "username of InfluxDB server user", 2024-09-10T23:36:48.070 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.070 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.070 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.070 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.070 INFO:teuthology.orchestra.run.smithi003.stdout: "verify_ssl": { 2024-09-10T23:36:48.070 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "verify_ssl", 2024-09-10T23:36:48.070 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.070 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.071 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.071 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "true", 2024-09-10T23:36:48.071 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.071 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.071 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.071 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T23:36:48.071 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.071 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.071 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.071 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.071 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.071 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.071 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.071 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "insights", 2024-09-10T23:36:48.072 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.072 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.072 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.072 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.072 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.072 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.072 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.072 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.072 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.072 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.072 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.072 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.072 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.072 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.073 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.073 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.073 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.073 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.073 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.073 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.073 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.073 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.073 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.073 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.073 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.073 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.073 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.074 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.074 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.074 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.074 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.074 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.074 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.074 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.074 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.074 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.074 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.074 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.074 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.074 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.074 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.075 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.075 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.075 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.075 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.075 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.075 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.075 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.075 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.075 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.075 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.075 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.075 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.075 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.075 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.076 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.076 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.076 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.076 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.076 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.076 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.076 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.076 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.076 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.076 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.076 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.076 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.076 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.076 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.077 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.077 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.077 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.077 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.077 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.077 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.077 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.077 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.077 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.077 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.077 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.077 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.077 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.077 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.078 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.078 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.078 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.078 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.078 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.078 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.078 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.078 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "iostat", 2024-09-10T23:36:48.078 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.078 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.078 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.078 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.078 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.078 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.079 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.079 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.079 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.079 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.079 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.079 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.079 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.079 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.079 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.079 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.079 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.079 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.079 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.079 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.080 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.080 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.080 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.080 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.080 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.080 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.080 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.080 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.080 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.080 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.080 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.080 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.081 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.081 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.081 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.081 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.081 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.081 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.081 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.081 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.081 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.081 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.081 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.081 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.081 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.082 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.082 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.082 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.082 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.082 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.082 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.082 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.082 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.082 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.082 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.082 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.083 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.083 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.083 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.083 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.083 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.083 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.083 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.083 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.083 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.083 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.083 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.083 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.084 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.084 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.084 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.084 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.084 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.084 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.084 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.084 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.084 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.084 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.084 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.085 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.085 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.085 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.085 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.085 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.085 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.085 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.085 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.085 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.085 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.085 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.085 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "k8sevents", 2024-09-10T23:36:48.085 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.086 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.086 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.086 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_event_retention_days": { 2024-09-10T23:36:48.086 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ceph_event_retention_days", 2024-09-10T23:36:48.086 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.086 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.086 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.086 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "7", 2024-09-10T23:36:48.086 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.086 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.086 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.086 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T23:36:48.087 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.087 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.087 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.087 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.087 INFO:teuthology.orchestra.run.smithi003.stdout: "config_check_secs": { 2024-09-10T23:36:48.087 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "config_check_secs", 2024-09-10T23:36:48.087 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.087 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.087 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.087 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-10T23:36:48.087 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "10", 2024-09-10T23:36:48.087 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.087 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.087 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T23:36:48.088 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.088 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.088 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.088 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.088 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.088 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.088 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.088 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.088 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.088 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.088 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.089 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.089 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.089 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.089 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.089 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.089 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.089 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.089 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.089 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.089 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.089 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.089 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.089 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.090 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.090 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.090 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.090 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.090 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.090 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.090 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.090 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.090 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.090 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.090 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.090 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.090 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.091 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.091 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.091 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.091 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.091 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.091 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.091 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.091 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.092 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.092 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.092 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.092 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.092 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.092 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.092 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.092 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.092 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.092 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.092 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.092 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.092 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.093 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.093 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.093 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.093 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.093 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.093 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.093 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.093 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.093 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.093 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.093 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.093 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.094 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.094 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.094 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.094 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.094 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.094 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.094 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.094 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.094 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.094 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.094 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.094 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.095 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.095 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.095 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.095 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.095 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.095 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.095 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.095 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.095 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.095 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "localpool", 2024-09-10T23:36:48.095 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.095 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.095 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.096 INFO:teuthology.orchestra.run.smithi003.stdout: "failure_domain": { 2024-09-10T23:36:48.096 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "failure_domain", 2024-09-10T23:36:48.096 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.096 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.096 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.096 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "host", 2024-09-10T23:36:48.096 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.096 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.096 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.096 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "failure domain for any created local pool", 2024-09-10T23:36:48.096 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T23:36:48.096 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.096 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.097 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.097 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.097 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.097 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.097 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.097 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.097 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.097 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.097 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.097 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.097 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.097 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.097 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.098 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.098 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.098 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.098 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.098 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.098 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.098 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.098 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.098 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.098 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.098 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.098 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.098 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.098 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.099 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.099 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.099 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.099 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.099 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.099 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.099 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.099 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.099 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.099 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.099 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.099 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.099 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.100 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.100 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.100 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.100 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.100 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.100 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.100 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.100 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.100 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.100 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.100 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.100 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.100 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.100 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.101 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.101 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.101 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.101 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.101 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.101 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.101 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.101 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.101 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.101 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.101 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.101 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.101 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.101 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.102 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.102 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.102 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.102 INFO:teuthology.orchestra.run.smithi003.stdout: "min_size": { 2024-09-10T23:36:48.102 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "min_size", 2024-09-10T23:36:48.102 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.102 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.102 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.102 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.102 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.102 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.102 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.102 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "default min_size for any created local pool", 2024-09-10T23:36:48.102 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T23:36:48.103 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.103 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.103 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.103 INFO:teuthology.orchestra.run.smithi003.stdout: "num_rep": { 2024-09-10T23:36:48.103 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "num_rep", 2024-09-10T23:36:48.103 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.103 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.103 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.103 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "3", 2024-09-10T23:36:48.103 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.103 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.103 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.103 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "default replica count for any created local pool", 2024-09-10T23:36:48.104 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.104 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.104 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.104 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.104 INFO:teuthology.orchestra.run.smithi003.stdout: "pg_num": { 2024-09-10T23:36:48.104 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "pg_num", 2024-09-10T23:36:48.104 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.104 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.104 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.104 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "128", 2024-09-10T23:36:48.104 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.104 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.104 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.105 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T23:36:48.105 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.105 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.105 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.105 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.105 INFO:teuthology.orchestra.run.smithi003.stdout: "prefix": { 2024-09-10T23:36:48.105 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "prefix", 2024-09-10T23:36:48.105 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.105 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.105 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.105 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.105 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.105 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.106 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.106 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "name prefix for any created local pool", 2024-09-10T23:36:48.106 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.106 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.106 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.106 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.106 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.106 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.106 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.106 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.106 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.106 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.106 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.106 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.107 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.107 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.107 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.107 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.107 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.107 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.107 INFO:teuthology.orchestra.run.smithi003.stdout: "subtree": { 2024-09-10T23:36:48.107 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "subtree", 2024-09-10T23:36:48.107 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.107 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.107 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.107 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "rack", 2024-09-10T23:36:48.107 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.108 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.108 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.108 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T23:36:48.108 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T23:36:48.108 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.108 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.108 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.108 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.108 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.108 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.108 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mds_autoscaler", 2024-09-10T23:36:48.108 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.108 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.109 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.109 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.109 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.109 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.109 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.109 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.109 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.109 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.109 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.109 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.109 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.109 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.109 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.109 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.110 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.110 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.110 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.110 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.110 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.110 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.110 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.110 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.110 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.110 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.110 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.110 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.110 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.111 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.111 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.111 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.111 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.111 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.111 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.111 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.111 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.111 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.111 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.111 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.111 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.111 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.111 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.111 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.112 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.112 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.112 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.112 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.112 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.112 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.112 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.112 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.112 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.112 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.112 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.112 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.112 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.112 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.113 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.113 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.113 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.113 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.113 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.113 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.113 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.113 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.113 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.113 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.113 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.113 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.113 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.113 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.113 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.114 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.114 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.114 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.114 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.114 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.114 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.114 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.114 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.114 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.114 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.114 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.114 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.114 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.114 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.115 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.115 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.115 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.115 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mirroring", 2024-09-10T23:36:48.115 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.115 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.115 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.115 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.115 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.115 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.115 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.115 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.115 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.116 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.116 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.116 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.116 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.116 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.116 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.116 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.116 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.116 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.116 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.116 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.116 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.116 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.116 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.117 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.117 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.117 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.117 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.117 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.117 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.117 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.117 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.117 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.117 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.117 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.117 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.118 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.118 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.118 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.118 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.118 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.118 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.118 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.118 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.118 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.118 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.118 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.118 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.118 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.118 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.119 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.119 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.119 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.119 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.119 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.119 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.119 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.119 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.119 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.119 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.119 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.119 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.119 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.119 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.120 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.120 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.120 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.120 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.120 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.120 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.120 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.120 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.120 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.120 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.120 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.120 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.120 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.120 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.121 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.121 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.121 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.121 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.121 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.121 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.121 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.121 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.121 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.121 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.121 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.121 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.121 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.121 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "nfs", 2024-09-10T23:36:48.122 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.122 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.122 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.122 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.122 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.122 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.122 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.122 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.122 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.122 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.122 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.122 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.122 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.122 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.122 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.123 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.123 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.123 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.123 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.123 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.123 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.123 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.123 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.123 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.123 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.123 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.123 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.123 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.123 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.123 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.124 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.124 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.124 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.124 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.124 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.124 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.124 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.124 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.124 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.124 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.124 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.124 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.124 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.124 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.124 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.125 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.125 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.125 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.125 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.125 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.125 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.125 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.125 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.125 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.125 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.125 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.125 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.125 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.126 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.126 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.126 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.126 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.126 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.126 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.126 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.126 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.126 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.126 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.126 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.126 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.126 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.126 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.127 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.127 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.127 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.127 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.127 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.127 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.127 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.127 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.127 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.127 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.127 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.127 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.127 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.127 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.128 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.128 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.128 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.128 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.128 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "orchestrator", 2024-09-10T23:36:48.128 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.128 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.128 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.128 INFO:teuthology.orchestra.run.smithi003.stdout: "fail_fs": { 2024-09-10T23:36:48.128 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "fail_fs", 2024-09-10T23:36:48.128 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.128 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.128 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.128 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.129 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.129 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.129 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.129 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T23:36:48.129 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.129 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.129 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.129 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.129 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.129 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.129 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.129 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.129 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.129 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.130 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.130 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.130 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.130 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.130 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.130 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.130 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.130 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.130 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.130 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.130 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.130 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.130 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.130 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.130 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.131 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.131 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.131 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.131 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.131 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.131 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.131 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.131 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.131 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.131 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.131 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.131 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.131 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.132 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.132 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.132 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.132 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.132 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.132 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.132 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.132 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.132 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.132 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.132 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.132 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.132 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.132 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.132 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.133 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.133 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.133 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.133 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.133 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.133 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.133 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.133 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.133 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.133 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.133 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.133 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.133 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.134 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.134 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.134 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.134 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.134 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.134 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.134 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.134 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.134 INFO:teuthology.orchestra.run.smithi003.stdout: "orchestrator": { 2024-09-10T23:36:48.134 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "orchestrator", 2024-09-10T23:36:48.134 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.134 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.134 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.134 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.135 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.135 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.135 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.135 INFO:teuthology.orchestra.run.smithi003.stdout: "cephadm", 2024-09-10T23:36:48.135 INFO:teuthology.orchestra.run.smithi003.stdout: "rook", 2024-09-10T23:36:48.135 INFO:teuthology.orchestra.run.smithi003.stdout: "test_orchestrator" 2024-09-10T23:36:48.135 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.135 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Orchestrator backend", 2024-09-10T23:36:48.135 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.135 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.135 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.135 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.135 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.136 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.136 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.136 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.136 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.136 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.136 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.136 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.136 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.136 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.136 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.136 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.136 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.136 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.137 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.137 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.137 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.137 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "osd_perf_query", 2024-09-10T23:36:48.137 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.137 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.137 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.137 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.137 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.137 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.137 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.137 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.137 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.137 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.138 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.138 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.138 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.138 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.138 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.138 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.138 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.138 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.138 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.138 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.138 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.138 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.138 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.138 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.139 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.139 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.139 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.139 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.139 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.139 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.139 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.139 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.139 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.139 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.139 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.139 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.139 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.139 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.139 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.140 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.140 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.140 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.140 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.140 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.140 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.140 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.140 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.140 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.140 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.140 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.140 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.140 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.141 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.141 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.141 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.141 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.141 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.141 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.141 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.141 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.141 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.141 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.141 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.141 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.141 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.141 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.142 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.142 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.142 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.142 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.142 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.142 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.142 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.142 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.142 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.142 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.142 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.142 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.142 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.142 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.143 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.143 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.143 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.143 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.143 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.143 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.143 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.143 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.143 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.143 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.143 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "osd_support", 2024-09-10T23:36:48.143 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.143 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.143 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.143 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.144 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.144 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.144 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.144 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.144 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.144 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.144 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.144 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.144 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.144 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.144 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.144 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.144 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.144 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.145 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.145 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.145 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.145 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.145 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.145 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.145 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.145 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.145 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.145 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.145 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.145 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.145 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.146 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.146 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.146 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.146 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.146 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.146 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.146 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.146 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.146 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.146 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.146 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.146 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.146 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.146 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.146 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.147 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.147 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.147 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.147 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.147 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.147 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.147 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.147 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.147 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.147 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.147 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.147 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.147 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.147 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.148 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.148 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.148 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.148 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.148 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.148 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.148 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.148 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.148 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.148 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.148 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.148 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.148 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.148 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.149 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.149 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.149 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.149 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.149 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.149 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.149 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.149 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.149 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.149 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.149 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.149 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.149 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.150 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.150 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.150 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.150 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "pg_autoscaler", 2024-09-10T23:36:48.150 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.150 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.150 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.150 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.150 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.150 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.150 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.150 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.150 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.150 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.151 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.151 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.151 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.151 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.151 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.151 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.151 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.151 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.151 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.151 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.151 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.151 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.151 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.151 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.152 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.152 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.152 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.152 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.152 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.152 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.152 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.152 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.152 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.152 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.152 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.152 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.152 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.152 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.152 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.153 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.153 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.153 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.153 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.153 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.153 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.153 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.153 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.153 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.153 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.153 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.153 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.153 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.153 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.154 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.154 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.154 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.154 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.154 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.154 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.154 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.154 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.154 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.154 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.154 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.154 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.154 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.154 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.155 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.155 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.155 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.155 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.155 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.155 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.155 INFO:teuthology.orchestra.run.smithi003.stdout: "sleep_interval": { 2024-09-10T23:36:48.155 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sleep_interval", 2024-09-10T23:36:48.155 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:48.155 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.155 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.155 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "60", 2024-09-10T23:36:48.155 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.155 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.156 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.156 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.156 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.156 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.156 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.156 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.156 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.156 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.156 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.156 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.156 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.156 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.156 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.156 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.157 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.157 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.157 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.157 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.157 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.157 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.157 INFO:teuthology.orchestra.run.smithi003.stdout: "threshold": { 2024-09-10T23:36:48.157 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "threshold", 2024-09-10T23:36:48.157 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-10T23:36:48.157 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.157 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.157 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "3.0", 2024-09-10T23:36:48.157 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "1.0", 2024-09-10T23:36:48.157 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.157 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.158 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "scaling threshold", 2024-09-10T23:36:48.158 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T23:36:48.158 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.158 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.158 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.158 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.158 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.158 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.158 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "progress", 2024-09-10T23:36:48.158 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.158 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.158 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.158 INFO:teuthology.orchestra.run.smithi003.stdout: "allow_pg_recovery_event": { 2024-09-10T23:36:48.158 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "allow_pg_recovery_event", 2024-09-10T23:36:48.159 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.159 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.159 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.159 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.159 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.159 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.159 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.159 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T23:36:48.159 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.159 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.159 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.159 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.159 INFO:teuthology.orchestra.run.smithi003.stdout: "enabled": { 2024-09-10T23:36:48.159 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "enabled", 2024-09-10T23:36:48.160 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.160 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.160 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.160 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.160 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.160 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.160 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.160 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.160 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.160 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.160 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.160 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.160 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.160 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.161 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.161 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.161 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.161 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.161 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.161 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.161 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.161 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.161 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.161 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.161 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.161 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.161 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.161 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.162 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.162 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.162 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.162 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.162 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.162 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.162 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.162 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.162 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.162 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.162 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.162 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.162 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.163 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.163 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.163 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.163 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.163 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.163 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.163 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.163 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.163 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.163 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.163 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.163 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.163 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.163 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.164 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.164 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.164 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.164 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.164 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.164 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.164 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.164 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.164 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.164 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.164 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.164 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.164 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.164 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.165 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.165 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.165 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.165 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.165 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.165 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.165 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.165 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.165 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.165 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.165 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.165 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.165 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.166 INFO:teuthology.orchestra.run.smithi003.stdout: "max_completed_events": { 2024-09-10T23:36:48.166 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "max_completed_events", 2024-09-10T23:36:48.166 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.166 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.166 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.166 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "50", 2024-09-10T23:36:48.166 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.166 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.166 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.166 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "number of past completed events to remember", 2024-09-10T23:36:48.166 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.166 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.166 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.166 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.167 INFO:teuthology.orchestra.run.smithi003.stdout: "sleep_interval": { 2024-09-10T23:36:48.167 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sleep_interval", 2024-09-10T23:36:48.167 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:48.167 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.167 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.167 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5", 2024-09-10T23:36:48.167 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.167 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.167 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.167 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how long the module is going to sleep", 2024-09-10T23:36:48.167 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.167 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.167 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.167 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.168 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.168 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.168 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.168 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.168 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.168 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.168 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.168 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.168 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.168 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.168 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.168 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.168 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.168 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.169 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.169 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.169 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.169 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "prometheus", 2024-09-10T23:36:48.169 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.169 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.169 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.169 INFO:teuthology.orchestra.run.smithi003.stdout: "cache": { 2024-09-10T23:36:48.169 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "cache", 2024-09-10T23:36:48.169 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.169 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.169 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.169 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.169 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.169 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.170 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.170 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.170 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.170 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.170 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.170 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.170 INFO:teuthology.orchestra.run.smithi003.stdout: "exclude_perf_counters": { 2024-09-10T23:36:48.170 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "exclude_perf_counters", 2024-09-10T23:36:48.170 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.170 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.170 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.170 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.170 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.170 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.171 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.171 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T23:36:48.171 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T23:36:48.171 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.171 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.171 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.171 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.171 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.171 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.171 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.171 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.171 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.171 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.171 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.172 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.172 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.172 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.172 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.172 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.172 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.172 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.172 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.172 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.172 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.172 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.172 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.172 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.173 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.173 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.173 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.173 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.173 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.173 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.173 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.173 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.173 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.173 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.173 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.173 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.173 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.174 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.174 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.174 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.174 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.174 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.174 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.174 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.174 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.174 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.174 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.174 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.174 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.174 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.174 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.175 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.175 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.175 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.175 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.175 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.175 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.175 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.175 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.175 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.175 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.175 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.175 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.175 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.175 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.176 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.176 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.176 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.176 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.176 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.176 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.176 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.176 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.176 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_stats_pools": { 2024-09-10T23:36:48.176 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rbd_stats_pools", 2024-09-10T23:36:48.176 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.176 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.176 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.177 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.177 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.177 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.177 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.177 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.177 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.177 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.177 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.177 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.177 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T23:36:48.177 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T23:36:48.177 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.177 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.177 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.178 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "300", 2024-09-10T23:36:48.178 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.178 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.178 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.178 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.178 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.178 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.178 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.178 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.178 INFO:teuthology.orchestra.run.smithi003.stdout: "scrape_interval": { 2024-09-10T23:36:48.178 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "scrape_interval", 2024-09-10T23:36:48.178 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-10T23:36:48.179 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.179 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.179 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "15.0", 2024-09-10T23:36:48.179 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.179 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.179 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.179 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.179 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.179 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.179 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.179 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.179 INFO:teuthology.orchestra.run.smithi003.stdout: "server_addr": { 2024-09-10T23:36:48.179 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_addr", 2024-09-10T23:36:48.179 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.179 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.180 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.180 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "::", 2024-09-10T23:36:48.180 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.180 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.180 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.180 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T23:36:48.180 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.180 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.180 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.180 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.180 INFO:teuthology.orchestra.run.smithi003.stdout: "server_port": { 2024-09-10T23:36:48.180 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_port", 2024-09-10T23:36:48.180 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.180 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.181 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.181 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "9283", 2024-09-10T23:36:48.181 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.181 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.181 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.181 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T23:36:48.181 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.181 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.181 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.181 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.181 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.181 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.181 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.181 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.182 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.182 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.182 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.182 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.182 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.182 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.182 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.182 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.182 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.182 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.182 INFO:teuthology.orchestra.run.smithi003.stdout: "stale_cache_strategy": { 2024-09-10T23:36:48.182 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "stale_cache_strategy", 2024-09-10T23:36:48.182 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.183 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.183 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.183 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "log", 2024-09-10T23:36:48.183 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.183 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.183 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.183 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.183 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.183 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.183 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.183 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.183 INFO:teuthology.orchestra.run.smithi003.stdout: "standby_behaviour": { 2024-09-10T23:36:48.183 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "standby_behaviour", 2024-09-10T23:36:48.183 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.183 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.184 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.184 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "default", 2024-09-10T23:36:48.184 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.184 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.184 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.184 INFO:teuthology.orchestra.run.smithi003.stdout: "default", 2024-09-10T23:36:48.184 INFO:teuthology.orchestra.run.smithi003.stdout: "error" 2024-09-10T23:36:48.184 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.184 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.184 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.184 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.184 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.184 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.184 INFO:teuthology.orchestra.run.smithi003.stdout: "standby_error_status_code": { 2024-09-10T23:36:48.184 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "standby_error_status_code", 2024-09-10T23:36:48.185 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.185 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.185 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.185 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "500", 2024-09-10T23:36:48.185 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "400", 2024-09-10T23:36:48.185 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "599", 2024-09-10T23:36:48.185 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.185 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.185 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.185 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.185 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.185 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.185 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.186 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.186 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.186 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rbd_support", 2024-09-10T23:36:48.186 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.186 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.186 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.186 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.186 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.186 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.186 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.186 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.186 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.186 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.186 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.187 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.187 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.187 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.187 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.187 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.187 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.187 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.187 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.187 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.187 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.187 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.187 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.187 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.188 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.188 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.188 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.188 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.188 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.188 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.188 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.188 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.188 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.188 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.188 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.188 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.188 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.189 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.189 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.189 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.189 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.189 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.189 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.189 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.189 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.189 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.189 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.189 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.189 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.189 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.189 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.190 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.190 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.190 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.190 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.190 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.190 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.190 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.190 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.190 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.190 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.190 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.190 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.191 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.191 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.191 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.191 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.191 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.191 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.191 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.191 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.191 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.191 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.192 INFO:teuthology.orchestra.run.smithi003.stdout: "max_concurrent_snap_create": { 2024-09-10T23:36:48.192 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "max_concurrent_snap_create", 2024-09-10T23:36:48.192 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.192 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.192 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.192 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-10T23:36:48.192 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.192 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.192 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.192 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.192 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.192 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.192 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.193 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.193 INFO:teuthology.orchestra.run.smithi003.stdout: "mirror_snapshot_schedule": { 2024-09-10T23:36:48.193 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T23:36:48.193 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.193 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.193 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.193 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.193 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.193 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.193 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.193 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.193 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.194 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.194 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.194 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.194 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.194 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.194 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.194 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.194 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.194 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.194 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.194 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.194 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.194 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.194 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.195 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.195 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.195 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.195 INFO:teuthology.orchestra.run.smithi003.stdout: "trash_purge_schedule": { 2024-09-10T23:36:48.195 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "trash_purge_schedule", 2024-09-10T23:36:48.195 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.195 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.195 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.195 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.195 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.195 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.195 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.195 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.195 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.196 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.196 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.196 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.196 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.196 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.196 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.196 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "restful", 2024-09-10T23:36:48.196 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.196 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.196 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.196 INFO:teuthology.orchestra.run.smithi003.stdout: "enable_auth": { 2024-09-10T23:36:48.196 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "enable_auth", 2024-09-10T23:36:48.196 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.196 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.197 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.197 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.197 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.197 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.197 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.197 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.197 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.197 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.197 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.197 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.197 INFO:teuthology.orchestra.run.smithi003.stdout: "key_file": { 2024-09-10T23:36:48.197 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "key_file", 2024-09-10T23:36:48.197 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.198 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.198 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.198 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.198 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.198 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.198 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.198 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.198 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.198 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.198 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.198 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.198 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.198 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.198 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.198 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.199 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.199 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.199 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.199 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.199 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.199 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.199 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.199 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.199 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.199 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.199 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.199 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.199 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.200 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.200 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.200 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.200 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.200 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.200 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.200 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.200 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.200 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.200 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.200 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.200 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.200 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.200 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.201 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.201 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.201 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.201 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.201 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.201 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.201 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.201 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.201 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.201 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.201 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.201 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.201 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.202 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.202 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.202 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.202 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.202 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.202 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.202 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.202 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.202 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.202 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.202 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.202 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.202 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.202 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.202 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.203 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.203 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.203 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.203 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.203 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.203 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.203 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.203 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.203 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.203 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.203 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.203 INFO:teuthology.orchestra.run.smithi003.stdout: "max_requests": { 2024-09-10T23:36:48.203 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "max_requests", 2024-09-10T23:36:48.203 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.203 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.204 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.204 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "500", 2024-09-10T23:36:48.204 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.204 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.204 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.204 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-10T23:36:48.204 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.204 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.204 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.204 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.204 INFO:teuthology.orchestra.run.smithi003.stdout: "server_addr": { 2024-09-10T23:36:48.204 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_addr", 2024-09-10T23:36:48.204 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.204 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.205 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.205 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.205 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.205 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.205 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.205 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.205 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.205 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.205 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.205 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.205 INFO:teuthology.orchestra.run.smithi003.stdout: "server_port": { 2024-09-10T23:36:48.205 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_port", 2024-09-10T23:36:48.205 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.206 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.206 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.206 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.206 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.206 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.206 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.206 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.206 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.206 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.206 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.206 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.206 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.206 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.206 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.206 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.207 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.207 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.207 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.207 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.207 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.207 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.207 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.207 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.207 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.207 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.207 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.207 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.207 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.207 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rgw", 2024-09-10T23:36:48.208 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.208 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.208 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.208 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.208 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.208 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.208 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.208 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.208 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.208 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.208 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.208 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.208 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.208 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.209 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.209 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.209 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.209 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.209 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.209 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.209 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.209 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.209 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.209 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.209 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.209 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.209 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.209 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.210 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.210 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.210 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.210 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.210 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.210 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.210 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.210 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.210 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.210 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.210 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.210 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.210 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.210 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.210 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.211 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.211 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.211 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.211 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.211 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.211 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.211 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.211 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.211 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.211 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.211 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.211 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.211 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.211 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.211 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: "secondary_zone_period_retry_limit": { 2024-09-10T23:36:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-10T23:36:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5", 2024-09-10T23:36:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-10T23:36:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.214 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.214 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.214 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.214 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.214 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.214 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.214 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.214 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.214 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.214 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.214 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.214 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.214 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.214 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.215 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.215 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.215 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.215 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.215 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.215 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rook", 2024-09-10T23:36:48.215 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.215 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.215 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.215 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.215 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.215 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.215 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.216 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.216 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.216 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.216 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.216 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.216 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.216 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.216 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.216 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.216 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.216 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.216 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.216 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.216 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.216 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.217 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.217 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.217 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.217 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.217 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.217 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.217 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.217 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.217 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.217 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.217 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.217 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.217 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.217 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.218 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.218 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.218 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.218 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.218 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.218 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.218 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.218 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.218 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.218 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.218 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.218 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.218 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.218 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.218 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.219 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.219 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.219 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.219 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.219 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.219 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.219 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.219 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.219 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.219 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.219 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.219 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.219 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.219 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.219 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.219 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.220 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.220 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.220 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.220 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.220 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.220 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.220 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.220 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.220 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.220 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.220 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.220 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.220 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.220 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.220 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.221 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.221 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.221 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.221 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.221 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.221 INFO:teuthology.orchestra.run.smithi003.stdout: "storage_class": { 2024-09-10T23:36:48.221 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "storage_class", 2024-09-10T23:36:48.221 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.221 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.221 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.221 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "local", 2024-09-10T23:36:48.221 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.221 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.221 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.221 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T23:36:48.222 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.222 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.222 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.222 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.222 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.222 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.222 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.222 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "selftest", 2024-09-10T23:36:48.222 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.222 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.222 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.222 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.222 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.222 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.222 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.222 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.223 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.223 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.223 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.223 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.223 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.223 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.223 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.223 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.223 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.223 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.223 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.223 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.223 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.223 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.223 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.223 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.224 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.224 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.224 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.224 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.224 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.224 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.224 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.224 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.224 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.224 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.224 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.224 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.225 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.225 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.225 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.225 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.225 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.225 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.225 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.225 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.225 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.225 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.225 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.225 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.225 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.225 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.225 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.226 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.226 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.226 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.226 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.226 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.226 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.226 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.226 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.226 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.226 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.226 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.226 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.226 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.226 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.226 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.227 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.227 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.227 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.227 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.227 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.227 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.227 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.227 INFO:teuthology.orchestra.run.smithi003.stdout: "roption1": { 2024-09-10T23:36:48.227 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "roption1", 2024-09-10T23:36:48.227 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.227 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.227 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.227 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.227 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.227 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.228 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.228 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.228 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.228 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.228 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.228 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.228 INFO:teuthology.orchestra.run.smithi003.stdout: "roption2": { 2024-09-10T23:36:48.228 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "roption2", 2024-09-10T23:36:48.228 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.228 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.228 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.228 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "xyz", 2024-09-10T23:36:48.228 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.228 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.228 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.229 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.229 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.229 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.229 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.229 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.229 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption1": { 2024-09-10T23:36:48.229 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption1", 2024-09-10T23:36:48.229 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.229 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.229 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.229 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.229 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.229 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.230 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.230 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.230 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.230 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.230 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.230 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.230 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption2": { 2024-09-10T23:36:48.230 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption2", 2024-09-10T23:36:48.230 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.230 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.230 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.230 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.230 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.231 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.231 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.231 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.231 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.231 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.231 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.231 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.231 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption3": { 2024-09-10T23:36:48.231 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption3", 2024-09-10T23:36:48.231 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-10T23:36:48.231 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.232 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.232 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.232 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.232 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.232 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.232 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.232 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.232 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.232 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.232 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.232 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption4": { 2024-09-10T23:36:48.232 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption4", 2024-09-10T23:36:48.232 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.233 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.233 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.233 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.233 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.233 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.233 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.233 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.233 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.233 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.233 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.233 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.233 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption5": { 2024-09-10T23:36:48.233 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption5", 2024-09-10T23:36:48.234 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.234 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.234 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.234 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.234 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.234 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.234 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.234 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.234 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.234 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.234 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.234 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.234 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption6": { 2024-09-10T23:36:48.235 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption6", 2024-09-10T23:36:48.235 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.235 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.235 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.235 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.235 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.235 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.235 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.235 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.235 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.235 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.235 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.235 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.236 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption7": { 2024-09-10T23:36:48.236 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption7", 2024-09-10T23:36:48.236 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.236 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.236 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.236 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.236 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "1", 2024-09-10T23:36:48.236 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "42", 2024-09-10T23:36:48.236 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.236 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.236 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.236 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.236 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.236 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.237 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.237 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.237 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.237 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.237 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.237 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.237 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.237 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.237 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.237 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.237 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.237 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.237 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.237 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.237 INFO:teuthology.orchestra.run.smithi003.stdout: "testkey": { 2024-09-10T23:36:48.238 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "testkey", 2024-09-10T23:36:48.238 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.238 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.238 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.238 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.238 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.238 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.238 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.238 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.238 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.238 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.238 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.238 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.238 INFO:teuthology.orchestra.run.smithi003.stdout: "testlkey": { 2024-09-10T23:36:48.238 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "testlkey", 2024-09-10T23:36:48.239 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.239 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.239 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.239 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.239 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.239 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.239 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.239 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.239 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.239 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.239 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.239 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.239 INFO:teuthology.orchestra.run.smithi003.stdout: "testnewline": { 2024-09-10T23:36:48.239 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "testnewline", 2024-09-10T23:36:48.239 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.239 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.239 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.240 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.240 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.240 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.240 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.240 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.240 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.240 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.240 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.240 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.240 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.240 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.240 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.240 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smb", 2024-09-10T23:36:48.240 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.240 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.241 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.241 INFO:teuthology.orchestra.run.smithi003.stdout: "internal_store_backend": { 2024-09-10T23:36:48.241 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "internal_store_backend", 2024-09-10T23:36:48.241 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.241 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.241 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.241 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.241 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.241 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.241 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.241 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-10T23:36:48.241 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.241 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.241 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.242 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.242 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.242 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.242 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.242 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.242 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.242 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.242 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.242 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.242 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.242 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.242 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.242 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.242 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.242 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.242 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.243 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.243 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.243 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.243 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.243 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.243 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.243 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.243 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.243 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.243 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.243 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.243 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.243 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.243 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.243 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.244 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.244 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.244 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.244 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.244 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.244 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.244 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.244 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.244 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.244 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.244 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.244 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.245 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.245 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.245 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.245 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.245 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.245 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.245 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.245 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.245 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.245 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.245 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.245 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.245 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.245 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.246 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.246 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.246 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.246 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.246 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.246 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.246 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.246 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.246 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.246 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.246 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.246 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.246 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.246 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.246 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.247 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.247 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.247 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.247 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.247 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.247 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.247 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.247 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.247 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.247 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.247 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.247 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.247 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.247 INFO:teuthology.orchestra.run.smithi003.stdout: "update_orchestration": { 2024-09-10T23:36:48.248 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "update_orchestration", 2024-09-10T23:36:48.248 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.248 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.248 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.248 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.248 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.248 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.248 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.248 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-10T23:36:48.248 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.248 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.248 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.248 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.249 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.249 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.249 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.249 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "snap_schedule", 2024-09-10T23:36:48.249 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.249 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.249 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.249 INFO:teuthology.orchestra.run.smithi003.stdout: "allow_m_granularity": { 2024-09-10T23:36:48.249 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "allow_m_granularity", 2024-09-10T23:36:48.249 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.249 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.249 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.250 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.250 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.250 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.250 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.250 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T23:36:48.250 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.250 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.250 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.250 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.250 INFO:teuthology.orchestra.run.smithi003.stdout: "dump_on_update": { 2024-09-10T23:36:48.250 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "dump_on_update", 2024-09-10T23:36:48.250 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.250 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.250 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.250 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.251 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.251 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.251 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.251 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "dump database to debug log on update", 2024-09-10T23:36:48.251 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.251 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.251 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.251 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.251 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.251 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.251 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.251 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.251 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.251 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.252 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.252 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.252 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.252 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.252 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.252 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.252 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.252 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.252 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.252 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.252 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.252 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.252 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.252 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.252 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.252 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.253 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.253 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.253 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.253 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.253 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.253 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.253 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.253 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.253 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.253 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.253 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.253 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.253 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.254 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.254 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.254 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.254 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.254 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.254 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.254 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.254 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.254 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.254 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.254 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.254 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.254 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.254 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.255 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.255 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.255 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.255 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.255 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.255 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.255 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.255 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.255 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.255 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.255 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.255 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.255 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.256 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.256 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.256 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.256 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.256 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.256 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.256 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.256 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.256 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.256 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.256 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.256 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.256 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.256 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.257 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.257 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.257 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.257 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.257 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.257 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.257 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.257 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.257 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.257 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.257 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.257 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "stats", 2024-09-10T23:36:48.258 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.258 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.258 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.258 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.258 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.258 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.258 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.258 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.258 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.258 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.258 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.258 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.258 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.258 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.258 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.259 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.259 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.259 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.259 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.259 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.259 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.259 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.259 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.259 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.259 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.259 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.259 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.259 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.259 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.260 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.260 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.260 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.260 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.260 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.260 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.260 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.260 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.260 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.260 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.260 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.260 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.260 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.260 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.261 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.261 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.261 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.261 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.261 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.261 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.261 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.261 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.261 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.261 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.261 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.261 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.261 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.261 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.262 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.262 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.262 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.262 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.262 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.262 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.262 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.262 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.262 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.262 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.262 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.262 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.262 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.262 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.262 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.263 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.263 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.263 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.263 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.263 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.263 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.263 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.263 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.263 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.263 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.263 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.263 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.263 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.263 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.263 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.264 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.264 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.264 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.264 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "status", 2024-09-10T23:36:48.264 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.264 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.264 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.264 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.264 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.264 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.264 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.264 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.264 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.264 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.265 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.265 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.265 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.265 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.265 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.265 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.265 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.265 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.265 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.265 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.265 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.265 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.265 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.265 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.265 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.266 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.266 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.266 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.266 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.266 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.266 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.266 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.266 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.266 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.266 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.266 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.266 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.266 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.266 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.267 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.267 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.267 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.267 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.267 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.267 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.267 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.267 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.267 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.267 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.267 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.267 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.267 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.267 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.268 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.268 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.268 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.268 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.268 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.268 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.268 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.268 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.268 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.268 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.268 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.268 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.268 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.268 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.269 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.269 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.269 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.269 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.269 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.269 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.269 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.269 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.269 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.269 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.269 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.269 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.269 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.270 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.270 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.270 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.270 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.270 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.270 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.270 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.270 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.270 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.270 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.270 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "telegraf", 2024-09-10T23:36:48.270 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.270 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.270 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.270 INFO:teuthology.orchestra.run.smithi003.stdout: "address": { 2024-09-10T23:36:48.271 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "address", 2024-09-10T23:36:48.271 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.271 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.271 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.271 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T23:36:48.271 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.271 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.271 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.271 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.271 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.271 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.271 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.271 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.271 INFO:teuthology.orchestra.run.smithi003.stdout: "interval": { 2024-09-10T23:36:48.272 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "interval", 2024-09-10T23:36:48.272 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:48.272 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.272 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.272 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "15", 2024-09-10T23:36:48.272 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.272 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.272 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.272 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.272 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.272 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.272 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.273 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.273 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.273 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.273 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.273 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.273 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.273 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.273 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.273 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.273 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.273 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.273 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.274 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.274 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.274 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.274 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.274 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.274 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.274 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.274 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.274 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.274 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.274 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.274 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.274 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.275 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.275 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.275 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.275 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.275 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.275 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.275 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.275 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.275 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.275 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.275 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.275 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.275 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.276 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.276 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.276 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.276 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.276 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.276 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.276 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.276 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.276 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.276 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.276 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.276 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.277 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.277 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.277 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.277 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.277 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.277 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.277 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.277 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.277 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.277 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.277 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.277 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.277 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.278 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.278 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.278 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.278 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.278 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.278 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.278 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.278 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.278 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.278 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.278 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.278 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.278 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.278 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.278 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.279 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.279 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.279 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.279 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.279 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.279 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.279 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.279 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.279 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.279 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.279 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "telemetry", 2024-09-10T23:36:48.279 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.279 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.279 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.280 INFO:teuthology.orchestra.run.smithi003.stdout: "channel_basic": { 2024-09-10T23:36:48.280 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "channel_basic", 2024-09-10T23:36:48.280 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.280 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.280 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.280 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.280 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.280 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.280 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.280 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T23:36:48.280 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.280 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.280 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.280 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.281 INFO:teuthology.orchestra.run.smithi003.stdout: "channel_crash": { 2024-09-10T23:36:48.281 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "channel_crash", 2024-09-10T23:36:48.281 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.281 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.281 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.281 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.281 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.281 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.281 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.281 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T23:36:48.281 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.281 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.281 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.281 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.282 INFO:teuthology.orchestra.run.smithi003.stdout: "channel_device": { 2024-09-10T23:36:48.282 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "channel_device", 2024-09-10T23:36:48.282 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.282 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.282 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.282 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.282 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.282 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.282 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.282 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T23:36:48.282 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.282 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.282 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.282 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.283 INFO:teuthology.orchestra.run.smithi003.stdout: "channel_ident": { 2024-09-10T23:36:48.283 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "channel_ident", 2024-09-10T23:36:48.283 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.283 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.283 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.283 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.283 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.283 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.283 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.283 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T23:36:48.283 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.283 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.283 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.284 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.284 INFO:teuthology.orchestra.run.smithi003.stdout: "channel_perf": { 2024-09-10T23:36:48.284 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "channel_perf", 2024-09-10T23:36:48.284 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.284 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.284 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.284 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.284 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.284 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.284 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.284 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T23:36:48.284 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.284 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.284 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.285 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.285 INFO:teuthology.orchestra.run.smithi003.stdout: "contact": { 2024-09-10T23:36:48.285 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "contact", 2024-09-10T23:36:48.285 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.285 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.285 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.285 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.285 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.285 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.285 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.285 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.285 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.285 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.286 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.286 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.286 INFO:teuthology.orchestra.run.smithi003.stdout: "description": { 2024-09-10T23:36:48.286 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "description", 2024-09-10T23:36:48.286 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.286 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.286 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.286 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.286 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.286 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.286 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.286 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.286 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.286 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.287 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.287 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.287 INFO:teuthology.orchestra.run.smithi003.stdout: "device_url": { 2024-09-10T23:36:48.287 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "device_url", 2024-09-10T23:36:48.287 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.287 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.287 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.287 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T23:36:48.287 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.287 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.287 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.287 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.288 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.288 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.288 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.288 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.288 INFO:teuthology.orchestra.run.smithi003.stdout: "enabled": { 2024-09-10T23:36:48.288 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "enabled", 2024-09-10T23:36:48.288 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.288 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.288 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.288 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.288 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.288 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.289 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.289 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.289 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.289 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.289 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.289 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.289 INFO:teuthology.orchestra.run.smithi003.stdout: "interval": { 2024-09-10T23:36:48.289 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "interval", 2024-09-10T23:36:48.289 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.289 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.289 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.289 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "24", 2024-09-10T23:36:48.290 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "8", 2024-09-10T23:36:48.290 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.290 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.290 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.290 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.290 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.290 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.290 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.290 INFO:teuthology.orchestra.run.smithi003.stdout: "last_opt_revision": { 2024-09-10T23:36:48.290 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "last_opt_revision", 2024-09-10T23:36:48.290 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.290 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.290 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.291 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "1", 2024-09-10T23:36:48.291 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.291 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.291 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.291 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.291 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.291 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.291 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.291 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.291 INFO:teuthology.orchestra.run.smithi003.stdout: "leaderboard": { 2024-09-10T23:36:48.291 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "leaderboard", 2024-09-10T23:36:48.291 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.291 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.292 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.292 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.292 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.292 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.292 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.292 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.292 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.292 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.292 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.293 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.293 INFO:teuthology.orchestra.run.smithi003.stdout: "leaderboard_description": { 2024-09-10T23:36:48.293 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "leaderboard_description", 2024-09-10T23:36:48.293 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.293 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.293 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.293 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.293 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.293 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.293 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.293 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.293 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.293 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.294 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.294 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.294 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.294 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.294 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.294 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.294 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.294 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.294 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.294 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.294 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.294 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.295 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.295 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.295 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.295 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.295 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.295 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.295 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.295 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.295 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.295 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.295 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.295 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.295 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.296 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.296 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.296 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.296 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.296 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.296 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.296 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.296 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.296 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.296 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.296 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.296 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.297 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.297 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.297 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.297 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.297 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.297 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.297 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.297 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.297 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.297 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.297 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.298 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.298 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.298 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.298 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.298 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.298 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.298 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.298 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.298 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.298 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.298 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.298 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.298 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.299 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.299 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.299 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.299 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.299 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.299 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.299 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.299 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.299 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.299 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.299 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.299 INFO:teuthology.orchestra.run.smithi003.stdout: "organization": { 2024-09-10T23:36:48.299 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "organization", 2024-09-10T23:36:48.300 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.300 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.300 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.300 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.300 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.300 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.300 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.300 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.300 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.300 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.300 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.300 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.300 INFO:teuthology.orchestra.run.smithi003.stdout: "proxy": { 2024-09-10T23:36:48.300 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "proxy", 2024-09-10T23:36:48.301 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.301 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.301 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.301 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.301 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.301 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.301 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.301 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.301 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.301 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.301 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.301 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.301 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.301 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.302 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.302 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.302 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.302 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.302 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.302 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.302 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.302 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.302 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.302 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.302 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.302 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.302 INFO:teuthology.orchestra.run.smithi003.stdout: "url": { 2024-09-10T23:36:48.302 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "url", 2024-09-10T23:36:48.302 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.303 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.303 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.303 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T23:36:48.303 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.303 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.303 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.303 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.303 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.303 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.303 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.303 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.303 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.303 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.303 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.303 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "test_orchestrator", 2024-09-10T23:36:48.304 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.304 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.304 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.304 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.304 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.304 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.304 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.304 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.304 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.304 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.304 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.304 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.304 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.304 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.304 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.305 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.305 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.305 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.305 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.305 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.305 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.305 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.305 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.305 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.305 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.305 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.305 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.305 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.305 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.305 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.306 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.306 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.306 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.306 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.306 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.306 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.306 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.306 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.306 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.306 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.306 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.306 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.306 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.306 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.307 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.307 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.307 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.307 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.307 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.307 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.307 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.307 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.307 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.307 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.307 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.307 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.307 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.307 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.308 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.308 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.308 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.308 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.308 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.308 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.308 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.308 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.308 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.308 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.308 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.308 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.308 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.308 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.308 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.309 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.309 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.309 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.309 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.309 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.309 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.309 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.309 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.309 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.309 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.309 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.309 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.309 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.309 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.310 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.310 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.310 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.310 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "volumes", 2024-09-10T23:36:48.310 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.310 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.310 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.310 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.310 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.310 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.310 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.310 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.310 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.310 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.311 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.311 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.311 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.311 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.311 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.311 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.311 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.311 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.311 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.311 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.311 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.311 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.311 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.311 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.312 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.312 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.312 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.312 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.312 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.312 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.312 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.312 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.312 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.312 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.312 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.312 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.312 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.312 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.313 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.313 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.313 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.313 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.313 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.313 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.313 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.313 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.313 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.313 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.313 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.313 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.313 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.313 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.314 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.314 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.314 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.314 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.314 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.314 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.314 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.314 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.314 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.314 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.314 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.314 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.314 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.314 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.314 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.315 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.315 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.315 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.315 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.315 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.315 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.315 INFO:teuthology.orchestra.run.smithi003.stdout: "max_concurrent_clones": { 2024-09-10T23:36:48.315 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "max_concurrent_clones", 2024-09-10T23:36:48.315 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.315 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.315 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.315 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "4", 2024-09-10T23:36:48.315 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.316 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.316 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.316 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T23:36:48.316 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.316 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.316 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.316 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.316 INFO:teuthology.orchestra.run.smithi003.stdout: "periodic_async_work": { 2024-09-10T23:36:48.316 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "periodic_async_work", 2024-09-10T23:36:48.316 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.316 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.316 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.316 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.317 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.317 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.317 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.317 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Periodically check for async work", 2024-09-10T23:36:48.317 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.317 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.317 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.317 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.317 INFO:teuthology.orchestra.run.smithi003.stdout: "snapshot_clone_delay": { 2024-09-10T23:36:48.317 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "snapshot_clone_delay", 2024-09-10T23:36:48.317 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.317 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.317 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.317 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.318 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.318 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.318 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.318 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T23:36:48.318 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.318 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.318 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.318 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.318 INFO:teuthology.orchestra.run.smithi003.stdout: "snapshot_clone_no_wait": { 2024-09-10T23:36:48.318 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T23:36:48.318 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.318 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.318 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.319 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.319 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.319 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.319 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.319 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T23:36:48.319 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.319 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.319 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.319 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.319 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.319 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.319 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.319 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.319 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.320 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.320 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.320 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.320 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.320 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.320 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.320 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.320 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.320 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.320 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.320 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.320 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.320 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "zabbix", 2024-09-10T23:36:48.320 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.321 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.321 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.321 INFO:teuthology.orchestra.run.smithi003.stdout: "discovery_interval": { 2024-09-10T23:36:48.321 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "discovery_interval", 2024-09-10T23:36:48.321 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "uint", 2024-09-10T23:36:48.321 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.321 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.321 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "100", 2024-09-10T23:36:48.321 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.321 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.321 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.321 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.321 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.321 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.321 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.322 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.322 INFO:teuthology.orchestra.run.smithi003.stdout: "identifier": { 2024-09-10T23:36:48.322 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "identifier", 2024-09-10T23:36:48.322 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.322 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.322 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.322 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.322 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.322 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.322 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.322 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.322 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.322 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.322 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.323 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.323 INFO:teuthology.orchestra.run.smithi003.stdout: "interval": { 2024-09-10T23:36:48.323 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "interval", 2024-09-10T23:36:48.323 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:48.323 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.323 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.323 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "60", 2024-09-10T23:36:48.323 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.323 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.323 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.323 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.323 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.323 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.323 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.323 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.323 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.324 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.324 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.324 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.324 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.324 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.324 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.324 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.324 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.324 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.324 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.324 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.324 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.324 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.324 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.324 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.325 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.325 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.325 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.325 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.325 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.325 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.325 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.325 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.325 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.325 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.325 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.325 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.325 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.326 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.326 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.326 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.326 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.326 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.326 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.326 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.326 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.326 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.326 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.326 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.326 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.326 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.326 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.326 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.327 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.327 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.327 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.327 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.327 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.327 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.327 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.327 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.327 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.327 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.327 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.327 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.327 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.327 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.327 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.328 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.328 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.328 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.328 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.328 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.328 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.328 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.328 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.328 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.328 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.328 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.328 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.328 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.328 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.328 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.329 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.329 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.329 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.329 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.329 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.329 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.329 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.329 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.329 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.329 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.329 INFO:teuthology.orchestra.run.smithi003.stdout: "zabbix_host": { 2024-09-10T23:36:48.329 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "zabbix_host", 2024-09-10T23:36:48.329 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.329 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.329 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.330 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.330 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.330 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.330 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.330 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.330 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.330 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.330 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.330 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.330 INFO:teuthology.orchestra.run.smithi003.stdout: "zabbix_port": { 2024-09-10T23:36:48.330 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "zabbix_port", 2024-09-10T23:36:48.330 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.330 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.330 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.330 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10051", 2024-09-10T23:36:48.331 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.331 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.331 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.331 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.331 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.331 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.331 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.331 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.331 INFO:teuthology.orchestra.run.smithi003.stdout: "zabbix_sender": { 2024-09-10T23:36:48.331 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "zabbix_sender", 2024-09-10T23:36:48.331 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.331 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.331 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.331 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T23:36:48.331 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.332 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.332 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.332 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.332 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.332 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.332 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.332 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.332 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.332 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.332 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-10T23:36:48.332 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.332 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.332 INFO:teuthology.orchestra.run.smithi003.stdout: "modules": [ 2024-09-10T23:36:48.333 INFO:teuthology.orchestra.run.smithi003.stdout: "cephadm", 2024-09-10T23:36:48.333 INFO:teuthology.orchestra.run.smithi003.stdout: "dashboard", 2024-09-10T23:36:48.333 INFO:teuthology.orchestra.run.smithi003.stdout: "iostat", 2024-09-10T23:36:48.333 INFO:teuthology.orchestra.run.smithi003.stdout: "nfs", 2024-09-10T23:36:48.333 INFO:teuthology.orchestra.run.smithi003.stdout: "restful", 2024-09-10T23:36:48.333 INFO:teuthology.orchestra.run.smithi003.stdout: "snap_schedule" 2024-09-10T23:36:48.333 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.333 INFO:teuthology.orchestra.run.smithi003.stdout: "available_modules": [ 2024-09-10T23:36:48.333 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.333 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "alerts", 2024-09-10T23:36:48.333 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.333 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.333 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.333 INFO:teuthology.orchestra.run.smithi003.stdout: "interval": { 2024-09-10T23:36:48.334 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "interval", 2024-09-10T23:36:48.334 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:48.334 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.334 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.334 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "60", 2024-09-10T23:36:48.334 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.334 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.334 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.334 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T23:36:48.334 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.334 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.334 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.334 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.334 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.334 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.335 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.335 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.335 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.335 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.335 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.335 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.335 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.335 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.335 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.335 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.335 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.335 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.335 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.335 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.336 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.336 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.336 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.336 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.336 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.336 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.336 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.336 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.336 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.336 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.336 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.336 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.336 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.336 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.336 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.337 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.337 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.340 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.340 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.340 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.340 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.340 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.340 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.340 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.340 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.340 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.340 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.340 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.340 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.341 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.341 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.341 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.341 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.341 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.341 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.341 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.341 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.341 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.341 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.341 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.341 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.341 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.341 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.342 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.342 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.342 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.342 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.342 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.342 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.342 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.342 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.342 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.342 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.342 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.342 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_destination": { 2024-09-10T23:36:48.342 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_destination", 2024-09-10T23:36:48.343 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.343 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.343 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.343 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.343 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.343 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.343 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.343 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-10T23:36:48.343 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.343 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.343 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.343 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.343 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_from_name": { 2024-09-10T23:36:48.344 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_from_name", 2024-09-10T23:36:48.344 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.344 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.344 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.344 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "Ceph", 2024-09-10T23:36:48.344 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.344 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.344 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.344 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Email From: name", 2024-09-10T23:36:48.344 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.344 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.344 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.344 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.344 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_host": { 2024-09-10T23:36:48.345 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_host", 2024-09-10T23:36:48.345 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.345 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.345 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.345 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.345 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.345 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.345 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.345 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "SMTP server", 2024-09-10T23:36:48.345 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.345 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.345 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.346 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.346 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_password": { 2024-09-10T23:36:48.346 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_password", 2024-09-10T23:36:48.346 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.346 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.346 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.346 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.346 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.346 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.346 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.346 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Password to authenticate with", 2024-09-10T23:36:48.346 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.346 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.346 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.347 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.347 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_port": { 2024-09-10T23:36:48.347 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_port", 2024-09-10T23:36:48.347 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.347 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.347 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.347 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "465", 2024-09-10T23:36:48.347 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.347 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.347 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.347 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "SMTP port", 2024-09-10T23:36:48.347 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.347 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.348 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.348 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.348 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_sender": { 2024-09-10T23:36:48.348 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_sender", 2024-09-10T23:36:48.348 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.348 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.348 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.348 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.348 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.348 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.348 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.348 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "SMTP envelope sender", 2024-09-10T23:36:48.348 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.349 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.349 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.349 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.349 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_ssl": { 2024-09-10T23:36:48.349 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_ssl", 2024-09-10T23:36:48.349 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.349 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.349 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.349 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.349 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.349 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.349 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.350 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T23:36:48.350 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.350 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.350 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.350 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.350 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_user": { 2024-09-10T23:36:48.350 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_user", 2024-09-10T23:36:48.350 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.350 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.350 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.350 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.350 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.350 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.351 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.351 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "User to authenticate as", 2024-09-10T23:36:48.351 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.351 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.351 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.351 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.351 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.351 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.351 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.351 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.351 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.351 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.352 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.352 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.352 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.352 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.352 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.352 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.352 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.352 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.352 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.352 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.352 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.352 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "balancer", 2024-09-10T23:36:48.352 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.353 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.353 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.353 INFO:teuthology.orchestra.run.smithi003.stdout: "active": { 2024-09-10T23:36:48.353 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "active", 2024-09-10T23:36:48.353 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.353 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.353 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.353 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.353 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.353 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.353 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.353 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T23:36:48.353 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.353 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.354 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.354 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.354 INFO:teuthology.orchestra.run.smithi003.stdout: "begin_time": { 2024-09-10T23:36:48.354 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "begin_time", 2024-09-10T23:36:48.354 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.354 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.354 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.354 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0000", 2024-09-10T23:36:48.354 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.354 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.354 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.354 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T23:36:48.354 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T23:36:48.355 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.355 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.355 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.355 INFO:teuthology.orchestra.run.smithi003.stdout: "begin_weekday": { 2024-09-10T23:36:48.355 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "begin_weekday", 2024-09-10T23:36:48.355 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "uint", 2024-09-10T23:36:48.355 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.355 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.355 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.355 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "0", 2024-09-10T23:36:48.355 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "6", 2024-09-10T23:36:48.355 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.355 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T23:36:48.355 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T23:36:48.356 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.356 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.356 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.356 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_compat_max_iterations": { 2024-09-10T23:36:48.356 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crush_compat_max_iterations", 2024-09-10T23:36:48.356 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "uint", 2024-09-10T23:36:48.356 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.356 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.356 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "25", 2024-09-10T23:36:48.356 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "1", 2024-09-10T23:36:48.356 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "250", 2024-09-10T23:36:48.356 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.356 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T23:36:48.356 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.357 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.357 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.357 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.357 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_compat_metrics": { 2024-09-10T23:36:48.357 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crush_compat_metrics", 2024-09-10T23:36:48.357 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.357 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.357 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.357 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T23:36:48.357 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.357 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.357 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.357 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T23:36:48.357 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T23:36:48.358 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.358 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.358 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.358 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_compat_step": { 2024-09-10T23:36:48.358 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crush_compat_step", 2024-09-10T23:36:48.358 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-10T23:36:48.358 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.358 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.358 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0.5", 2024-09-10T23:36:48.358 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "0.001", 2024-09-10T23:36:48.358 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "0.999", 2024-09-10T23:36:48.358 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.358 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "aggressiveness of optimization", 2024-09-10T23:36:48.358 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T23:36:48.358 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.359 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.359 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.359 INFO:teuthology.orchestra.run.smithi003.stdout: "end_time": { 2024-09-10T23:36:48.359 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "end_time", 2024-09-10T23:36:48.359 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.359 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.359 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.359 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "2359", 2024-09-10T23:36:48.359 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.359 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.359 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.359 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T23:36:48.359 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T23:36:48.359 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.359 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.360 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.360 INFO:teuthology.orchestra.run.smithi003.stdout: "end_weekday": { 2024-09-10T23:36:48.360 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "end_weekday", 2024-09-10T23:36:48.360 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "uint", 2024-09-10T23:36:48.360 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.360 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.360 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.360 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "0", 2024-09-10T23:36:48.360 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "6", 2024-09-10T23:36:48.360 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.360 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T23:36:48.360 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T23:36:48.360 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.361 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.361 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.361 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.361 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.361 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.361 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.361 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.361 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.361 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.361 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.361 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.361 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.361 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.361 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.361 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.362 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.362 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.362 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.362 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.362 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.362 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.362 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.362 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.362 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.362 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.362 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.362 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.362 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.362 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.362 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.363 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.363 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.363 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.363 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.363 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.363 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.363 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.363 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.363 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.363 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.363 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.363 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.363 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.363 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.363 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.363 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.364 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.364 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.364 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.364 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.364 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.364 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.364 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.364 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.364 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.364 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.364 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.364 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.364 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.364 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.365 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.365 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.365 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.365 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.365 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.365 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.365 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.365 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.365 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.365 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.365 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.365 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.365 INFO:teuthology.orchestra.run.smithi003.stdout: "min_score": { 2024-09-10T23:36:48.366 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "min_score", 2024-09-10T23:36:48.366 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-10T23:36:48.366 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.366 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.366 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.366 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.366 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.366 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.366 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T23:36:48.366 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.366 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.366 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.366 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.366 INFO:teuthology.orchestra.run.smithi003.stdout: "mode": { 2024-09-10T23:36:48.367 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mode", 2024-09-10T23:36:48.367 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.367 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.367 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.367 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "upmap", 2024-09-10T23:36:48.367 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.367 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.367 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.367 INFO:teuthology.orchestra.run.smithi003.stdout: "crush-compat", 2024-09-10T23:36:48.367 INFO:teuthology.orchestra.run.smithi003.stdout: "none", 2024-09-10T23:36:48.367 INFO:teuthology.orchestra.run.smithi003.stdout: "read", 2024-09-10T23:36:48.367 INFO:teuthology.orchestra.run.smithi003.stdout: "upmap", 2024-09-10T23:36:48.367 INFO:teuthology.orchestra.run.smithi003.stdout: "upmap-read" 2024-09-10T23:36:48.367 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.368 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Balancer mode", 2024-09-10T23:36:48.368 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.368 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.368 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.368 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.368 INFO:teuthology.orchestra.run.smithi003.stdout: "pool_ids": { 2024-09-10T23:36:48.368 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "pool_ids", 2024-09-10T23:36:48.368 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.368 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.368 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.368 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.368 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.368 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.368 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.368 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T23:36:48.369 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.369 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.369 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.369 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.369 INFO:teuthology.orchestra.run.smithi003.stdout: "sleep_interval": { 2024-09-10T23:36:48.369 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sleep_interval", 2024-09-10T23:36:48.369 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:48.369 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.369 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.369 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "60", 2024-09-10T23:36:48.369 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.369 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.369 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.369 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T23:36:48.370 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.370 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.370 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.370 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.370 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.370 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.370 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.370 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.370 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.370 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.370 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.370 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.370 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.370 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.370 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.371 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.371 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.371 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.371 INFO:teuthology.orchestra.run.smithi003.stdout: "upmap_max_deviation": { 2024-09-10T23:36:48.371 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "upmap_max_deviation", 2024-09-10T23:36:48.371 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.371 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.371 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.371 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5", 2024-09-10T23:36:48.371 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "1", 2024-09-10T23:36:48.371 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.371 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.371 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T23:36:48.371 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T23:36:48.372 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.372 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.372 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.372 INFO:teuthology.orchestra.run.smithi003.stdout: "upmap_max_optimizations": { 2024-09-10T23:36:48.372 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "upmap_max_optimizations", 2024-09-10T23:36:48.372 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "uint", 2024-09-10T23:36:48.372 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.372 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.372 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-10T23:36:48.372 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.372 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.372 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.372 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T23:36:48.372 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.373 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.373 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.373 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.373 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.373 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.373 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.373 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "cephadm", 2024-09-10T23:36:48.373 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.373 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.373 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.373 INFO:teuthology.orchestra.run.smithi003.stdout: "agent_down_multiplier": { 2024-09-10T23:36:48.373 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "agent_down_multiplier", 2024-09-10T23:36:48.373 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-10T23:36:48.373 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.374 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.374 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "3.0", 2024-09-10T23:36:48.374 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.374 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.374 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.374 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T23:36:48.374 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.374 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.374 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.374 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.374 INFO:teuthology.orchestra.run.smithi003.stdout: "agent_refresh_rate": { 2024-09-10T23:36:48.374 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "agent_refresh_rate", 2024-09-10T23:36:48.374 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:48.374 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.375 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.375 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "20", 2024-09-10T23:36:48.375 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.375 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.375 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.375 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T23:36:48.375 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.375 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.375 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.375 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.375 INFO:teuthology.orchestra.run.smithi003.stdout: "agent_starting_port": { 2024-09-10T23:36:48.375 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "agent_starting_port", 2024-09-10T23:36:48.375 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.375 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.376 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.376 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "4721", 2024-09-10T23:36:48.376 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.376 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.376 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.376 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T23:36:48.376 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.376 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.376 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.376 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.376 INFO:teuthology.orchestra.run.smithi003.stdout: "allow_ptrace": { 2024-09-10T23:36:48.376 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "allow_ptrace", 2024-09-10T23:36:48.376 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.377 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.377 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.377 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.377 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.377 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.377 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.377 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T23:36:48.377 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T23:36:48.377 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.377 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.377 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.377 INFO:teuthology.orchestra.run.smithi003.stdout: "autotune_interval": { 2024-09-10T23:36:48.377 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "autotune_interval", 2024-09-10T23:36:48.378 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:48.378 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.378 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.378 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "600", 2024-09-10T23:36:48.378 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.378 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.378 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.378 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T23:36:48.378 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.378 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.378 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.378 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.378 INFO:teuthology.orchestra.run.smithi003.stdout: "autotune_memory_target_ratio": { 2024-09-10T23:36:48.378 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T23:36:48.379 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-10T23:36:48.379 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.379 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.379 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0.7", 2024-09-10T23:36:48.379 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.379 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.379 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.379 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T23:36:48.379 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.379 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.379 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.379 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.379 INFO:teuthology.orchestra.run.smithi003.stdout: "cephadm_log_destination": { 2024-09-10T23:36:48.379 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "cephadm_log_destination", 2024-09-10T23:36:48.380 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.380 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.380 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.380 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.380 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.380 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.380 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.380 INFO:teuthology.orchestra.run.smithi003.stdout: "file", 2024-09-10T23:36:48.380 INFO:teuthology.orchestra.run.smithi003.stdout: "file,syslog", 2024-09-10T23:36:48.380 INFO:teuthology.orchestra.run.smithi003.stdout: "syslog" 2024-09-10T23:36:48.380 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.380 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T23:36:48.380 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.381 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.381 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.381 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.381 INFO:teuthology.orchestra.run.smithi003.stdout: "cgroups_split": { 2024-09-10T23:36:48.381 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "cgroups_split", 2024-09-10T23:36:48.381 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.381 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.381 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.381 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.381 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.381 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.381 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.381 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T23:36:48.381 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.382 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.382 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.382 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.382 INFO:teuthology.orchestra.run.smithi003.stdout: "config_checks_enabled": { 2024-09-10T23:36:48.382 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "config_checks_enabled", 2024-09-10T23:36:48.382 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.382 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.382 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.382 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.382 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.382 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.382 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.382 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T23:36:48.382 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.383 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.383 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.383 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.383 INFO:teuthology.orchestra.run.smithi003.stdout: "config_dashboard": { 2024-09-10T23:36:48.383 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "config_dashboard", 2024-09-10T23:36:48.383 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.383 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.383 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.383 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.383 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.383 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.383 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.383 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T23:36:48.383 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.384 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.384 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.384 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.384 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_alertmanager": { 2024-09-10T23:36:48.384 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_alertmanager", 2024-09-10T23:36:48.384 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.384 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.384 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.384 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-10T23:36:48.384 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.384 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.384 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.384 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Prometheus container image", 2024-09-10T23:36:48.384 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.384 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.385 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.385 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.385 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_base": { 2024-09-10T23:36:48.385 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_base", 2024-09-10T23:36:48.385 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.385 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.385 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.385 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T23:36:48.385 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.385 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.385 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.385 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Container image name, without the tag", 2024-09-10T23:36:48.385 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.386 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.386 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.386 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.386 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_elasticsearch": { 2024-09-10T23:36:48.386 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_elasticsearch", 2024-09-10T23:36:48.386 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.386 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.386 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.386 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T23:36:48.386 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.386 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.386 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.386 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "elasticsearch container image", 2024-09-10T23:36:48.386 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.387 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.387 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.387 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.387 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_grafana": { 2024-09-10T23:36:48.387 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_grafana", 2024-09-10T23:36:48.387 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.387 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.387 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.387 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-10T23:36:48.387 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.387 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.387 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.387 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Prometheus container image", 2024-09-10T23:36:48.387 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.387 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.388 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.388 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.388 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_haproxy": { 2024-09-10T23:36:48.388 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_haproxy", 2024-09-10T23:36:48.388 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.388 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.388 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.388 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T23:36:48.388 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.388 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.388 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.388 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "HAproxy container image", 2024-09-10T23:36:48.389 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.389 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.389 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.389 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.389 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_jaeger_agent": { 2024-09-10T23:36:48.389 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_jaeger_agent", 2024-09-10T23:36:48.389 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.389 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.389 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.389 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T23:36:48.389 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.389 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.389 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.389 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Jaeger agent container image", 2024-09-10T23:36:48.390 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.390 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.390 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.390 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.390 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_jaeger_collector": { 2024-09-10T23:36:48.390 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_jaeger_collector", 2024-09-10T23:36:48.390 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.390 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.390 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.390 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T23:36:48.390 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.390 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.390 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.390 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Jaeger collector container image", 2024-09-10T23:36:48.391 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.391 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.391 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.391 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.391 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_jaeger_query": { 2024-09-10T23:36:48.391 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_jaeger_query", 2024-09-10T23:36:48.391 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.391 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.391 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.391 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T23:36:48.391 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.391 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.391 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.392 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Jaeger query container image", 2024-09-10T23:36:48.392 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.392 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.392 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.392 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.392 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_keepalived": { 2024-09-10T23:36:48.392 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_keepalived", 2024-09-10T23:36:48.392 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.393 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.393 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.393 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T23:36:48.393 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.393 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.393 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.393 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Keepalived container image", 2024-09-10T23:36:48.393 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.393 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.393 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.393 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.393 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_loki": { 2024-09-10T23:36:48.393 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_loki", 2024-09-10T23:36:48.394 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.394 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.394 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.394 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T23:36:48.394 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.394 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.394 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.394 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Loki container image", 2024-09-10T23:36:48.394 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.394 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.394 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.394 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.394 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_nginx": { 2024-09-10T23:36:48.395 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_nginx", 2024-09-10T23:36:48.395 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.395 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.395 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.395 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-10T23:36:48.395 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.395 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.395 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.395 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Nginx container image", 2024-09-10T23:36:48.395 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.395 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.395 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.395 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.396 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_node_exporter": { 2024-09-10T23:36:48.396 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_node_exporter", 2024-09-10T23:36:48.396 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.396 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.396 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.396 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-10T23:36:48.396 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.396 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.396 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.396 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Prometheus container image", 2024-09-10T23:36:48.396 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.396 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.396 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.397 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.397 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_nvmeof": { 2024-09-10T23:36:48.397 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_nvmeof", 2024-09-10T23:36:48.397 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.397 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.397 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.397 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-10T23:36:48.397 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.397 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.397 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.397 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Nvme-of container image", 2024-09-10T23:36:48.397 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.397 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.397 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.398 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.398 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_oauth2_proxy": { 2024-09-10T23:36:48.398 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_oauth2_proxy", 2024-09-10T23:36:48.398 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.398 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.398 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.398 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-10T23:36:48.398 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.398 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.398 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.398 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "oauth2-proxy container image", 2024-09-10T23:36:48.398 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.398 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.398 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.399 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.399 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_prometheus": { 2024-09-10T23:36:48.399 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_prometheus", 2024-09-10T23:36:48.399 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.399 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.399 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.399 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-10T23:36:48.399 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.399 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.399 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.399 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Prometheus container image", 2024-09-10T23:36:48.399 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.399 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.399 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.400 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.400 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_promtail": { 2024-09-10T23:36:48.400 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_promtail", 2024-09-10T23:36:48.400 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.400 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.400 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.400 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T23:36:48.400 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.400 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.400 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.400 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Promtail container image", 2024-09-10T23:36:48.400 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.400 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.401 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.401 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.401 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_samba": { 2024-09-10T23:36:48.401 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_samba", 2024-09-10T23:36:48.401 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.401 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.401 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.401 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T23:36:48.401 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.401 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.401 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.401 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Samba/SMB container image", 2024-09-10T23:36:48.401 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.401 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.402 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.402 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.402 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_samba_metrics": { 2024-09-10T23:36:48.402 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_samba_metrics", 2024-09-10T23:36:48.402 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.402 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.402 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.402 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-10T23:36:48.402 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.402 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.402 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.402 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-10T23:36:48.402 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.402 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.402 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.403 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.403 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_snmp_gateway": { 2024-09-10T23:36:48.403 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_snmp_gateway", 2024-09-10T23:36:48.403 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.403 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.403 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.403 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T23:36:48.403 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.403 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.403 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.403 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "SNMP Gateway container image", 2024-09-10T23:36:48.403 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.403 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.403 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.403 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.404 INFO:teuthology.orchestra.run.smithi003.stdout: "container_init": { 2024-09-10T23:36:48.404 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_init", 2024-09-10T23:36:48.404 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.404 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.404 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.404 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.404 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.404 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.404 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.404 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T23:36:48.404 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.404 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.404 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.404 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.405 INFO:teuthology.orchestra.run.smithi003.stdout: "daemon_cache_timeout": { 2024-09-10T23:36:48.405 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "daemon_cache_timeout", 2024-09-10T23:36:48.405 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:48.405 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.405 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.405 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "600", 2024-09-10T23:36:48.405 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.405 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.405 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.406 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T23:36:48.406 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.406 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.406 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.406 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.406 INFO:teuthology.orchestra.run.smithi003.stdout: "default_cephadm_command_timeout": { 2024-09-10T23:36:48.406 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T23:36:48.406 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.406 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.406 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.406 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "900", 2024-09-10T23:36:48.406 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.406 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.406 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.407 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T23:36:48.407 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.407 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.407 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.407 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.407 INFO:teuthology.orchestra.run.smithi003.stdout: "default_registry": { 2024-09-10T23:36:48.407 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "default_registry", 2024-09-10T23:36:48.407 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.407 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.407 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.407 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "docker.io", 2024-09-10T23:36:48.407 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.407 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.407 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.408 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T23:36:48.408 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.408 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.408 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.408 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.408 INFO:teuthology.orchestra.run.smithi003.stdout: "device_cache_timeout": { 2024-09-10T23:36:48.408 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "device_cache_timeout", 2024-09-10T23:36:48.408 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:48.408 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.408 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.408 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "1800", 2024-09-10T23:36:48.408 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.408 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.408 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.409 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "seconds to cache device inventory", 2024-09-10T23:36:48.409 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.409 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.409 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.409 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.409 INFO:teuthology.orchestra.run.smithi003.stdout: "device_enhanced_scan": { 2024-09-10T23:36:48.409 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "device_enhanced_scan", 2024-09-10T23:36:48.409 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.409 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.409 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.409 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.409 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.410 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.410 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.410 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T23:36:48.410 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.410 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.410 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.410 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.410 INFO:teuthology.orchestra.run.smithi003.stdout: "facts_cache_timeout": { 2024-09-10T23:36:48.410 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "facts_cache_timeout", 2024-09-10T23:36:48.410 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:48.410 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.410 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.410 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "60", 2024-09-10T23:36:48.410 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.411 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.411 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.411 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "seconds to cache host facts data", 2024-09-10T23:36:48.411 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.411 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.411 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.411 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.411 INFO:teuthology.orchestra.run.smithi003.stdout: "grafana_dashboards_path": { 2024-09-10T23:36:48.411 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "grafana_dashboards_path", 2024-09-10T23:36:48.411 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.411 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.411 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.411 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T23:36:48.412 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.412 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.412 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.412 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T23:36:48.412 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.412 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.412 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.412 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.412 INFO:teuthology.orchestra.run.smithi003.stdout: "host_check_interval": { 2024-09-10T23:36:48.412 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "host_check_interval", 2024-09-10T23:36:48.412 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:48.412 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.412 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.412 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "600", 2024-09-10T23:36:48.413 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.413 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.413 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.413 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how frequently to perform a host check", 2024-09-10T23:36:48.413 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.413 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.413 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.413 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.413 INFO:teuthology.orchestra.run.smithi003.stdout: "hw_monitoring": { 2024-09-10T23:36:48.413 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "hw_monitoring", 2024-09-10T23:36:48.413 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.413 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.413 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.414 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.414 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.414 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.414 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.414 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T23:36:48.414 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.414 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.414 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.414 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.414 INFO:teuthology.orchestra.run.smithi003.stdout: "inventory_list_all": { 2024-09-10T23:36:48.414 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "inventory_list_all", 2024-09-10T23:36:48.414 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.414 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.415 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.415 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.415 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.415 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.415 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.415 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T23:36:48.415 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.415 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.415 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.415 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.415 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.415 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.415 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.415 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.416 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.416 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.416 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.416 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.416 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.416 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.416 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.416 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.416 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.416 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.416 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.416 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.416 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.417 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.417 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.417 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.417 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.417 INFO:teuthology.orchestra.run.smithi003.stdout: "log_refresh_metadata": { 2024-09-10T23:36:48.417 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_refresh_metadata", 2024-09-10T23:36:48.417 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.417 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.417 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.417 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.417 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.417 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.417 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.417 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T23:36:48.418 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.418 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.418 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.418 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.418 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.418 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.418 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.418 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.418 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.418 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.418 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.418 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.418 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.419 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T23:36:48.419 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.419 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.419 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.419 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.419 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.419 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.419 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.419 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.419 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.419 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.419 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.419 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.419 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.419 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.420 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.420 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.420 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.420 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.420 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.420 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.420 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.420 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.420 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.420 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.420 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.420 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.420 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.420 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.420 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.421 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.421 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.421 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.421 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.421 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.421 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.421 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.421 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.421 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.421 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.421 INFO:teuthology.orchestra.run.smithi003.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T23:36:48.421 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T23:36:48.421 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.421 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.422 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.422 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.422 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.422 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.422 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.422 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T23:36:48.422 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.422 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.422 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.422 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.422 INFO:teuthology.orchestra.run.smithi003.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T23:36:48.422 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T23:36:48.422 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.422 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.422 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.423 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "*", 2024-09-10T23:36:48.423 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.423 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.423 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.423 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T23:36:48.423 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.423 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.423 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.423 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.423 INFO:teuthology.orchestra.run.smithi003.stdout: "max_count_per_host": { 2024-09-10T23:36:48.423 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "max_count_per_host", 2024-09-10T23:36:48.423 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.423 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.423 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.423 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-10T23:36:48.424 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.424 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.424 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.424 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "max number of daemons per service per host", 2024-09-10T23:36:48.424 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.424 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.424 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.424 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.424 INFO:teuthology.orchestra.run.smithi003.stdout: "max_osd_draining_count": { 2024-09-10T23:36:48.424 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "max_osd_draining_count", 2024-09-10T23:36:48.424 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.424 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.424 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.424 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-10T23:36:48.425 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.425 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.425 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.425 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T23:36:48.425 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.425 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.425 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.425 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.425 INFO:teuthology.orchestra.run.smithi003.stdout: "migration_current": { 2024-09-10T23:36:48.425 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "migration_current", 2024-09-10T23:36:48.425 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.425 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.425 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.425 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.426 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.426 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.426 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.426 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "internal - do not modify", 2024-09-10T23:36:48.426 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.426 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.426 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.426 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.426 INFO:teuthology.orchestra.run.smithi003.stdout: "mode": { 2024-09-10T23:36:48.426 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mode", 2024-09-10T23:36:48.426 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.426 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.426 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.426 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "root", 2024-09-10T23:36:48.427 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.427 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.427 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.427 INFO:teuthology.orchestra.run.smithi003.stdout: "cephadm-package", 2024-09-10T23:36:48.427 INFO:teuthology.orchestra.run.smithi003.stdout: "root" 2024-09-10T23:36:48.427 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.427 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T23:36:48.427 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.427 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.427 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.427 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.427 INFO:teuthology.orchestra.run.smithi003.stdout: "oob_default_addr": { 2024-09-10T23:36:48.427 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "oob_default_addr", 2024-09-10T23:36:48.427 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.428 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.428 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.428 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "169.254.1.1", 2024-09-10T23:36:48.428 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.428 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.428 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.428 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T23:36:48.428 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.428 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.428 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.428 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.428 INFO:teuthology.orchestra.run.smithi003.stdout: "prometheus_alerts_path": { 2024-09-10T23:36:48.428 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "prometheus_alerts_path", 2024-09-10T23:36:48.428 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.428 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.429 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.429 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T23:36:48.429 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.429 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.429 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.429 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T23:36:48.429 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.429 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.429 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.429 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.429 INFO:teuthology.orchestra.run.smithi003.stdout: "registry_insecure": { 2024-09-10T23:36:48.429 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "registry_insecure", 2024-09-10T23:36:48.429 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.429 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.429 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.430 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.430 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.430 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.430 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.430 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T23:36:48.430 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.430 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.430 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.430 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.430 INFO:teuthology.orchestra.run.smithi003.stdout: "registry_password": { 2024-09-10T23:36:48.430 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "registry_password", 2024-09-10T23:36:48.430 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.430 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.430 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.430 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.430 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.431 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.431 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.431 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T23:36:48.431 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.431 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.431 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.431 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.431 INFO:teuthology.orchestra.run.smithi003.stdout: "registry_url": { 2024-09-10T23:36:48.431 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "registry_url", 2024-09-10T23:36:48.431 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.431 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.431 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.431 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.431 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.431 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.432 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.432 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T23:36:48.432 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.432 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.432 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.432 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.432 INFO:teuthology.orchestra.run.smithi003.stdout: "registry_username": { 2024-09-10T23:36:48.432 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "registry_username", 2024-09-10T23:36:48.432 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.432 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.432 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.432 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.432 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.432 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.432 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.433 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T23:36:48.433 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.433 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.433 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.433 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.433 INFO:teuthology.orchestra.run.smithi003.stdout: "secure_monitoring_stack": { 2024-09-10T23:36:48.433 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "secure_monitoring_stack", 2024-09-10T23:36:48.433 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.433 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.433 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.433 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.433 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.433 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.433 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.433 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T23:36:48.434 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.434 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.434 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.434 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.434 INFO:teuthology.orchestra.run.smithi003.stdout: "service_discovery_port": { 2024-09-10T23:36:48.434 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "service_discovery_port", 2024-09-10T23:36:48.434 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.434 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.434 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.434 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "8765", 2024-09-10T23:36:48.434 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.434 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.434 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.434 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "cephadm service discovery port", 2024-09-10T23:36:48.435 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.435 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.435 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.435 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.435 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.435 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.435 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.435 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.435 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.435 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.435 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.435 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.435 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.435 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.435 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.436 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.436 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.436 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.436 INFO:teuthology.orchestra.run.smithi003.stdout: "ssh_config_file": { 2024-09-10T23:36:48.436 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ssh_config_file", 2024-09-10T23:36:48.436 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.436 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.436 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.436 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.436 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.436 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.436 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.436 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T23:36:48.436 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.437 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.437 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.437 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.437 INFO:teuthology.orchestra.run.smithi003.stdout: "use_agent": { 2024-09-10T23:36:48.437 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "use_agent", 2024-09-10T23:36:48.437 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.437 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.437 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.437 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.437 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.437 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.437 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.437 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T23:36:48.437 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.438 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.438 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.438 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.438 INFO:teuthology.orchestra.run.smithi003.stdout: "use_repo_digest": { 2024-09-10T23:36:48.438 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "use_repo_digest", 2024-09-10T23:36:48.438 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.438 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.438 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.438 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.438 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.438 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.438 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.438 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T23:36:48.438 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.438 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.439 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.439 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.439 INFO:teuthology.orchestra.run.smithi003.stdout: "warn_on_failed_host_check": { 2024-09-10T23:36:48.439 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "warn_on_failed_host_check", 2024-09-10T23:36:48.439 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.439 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.439 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.439 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.439 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.439 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.439 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.439 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T23:36:48.439 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.439 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.439 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.439 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.440 INFO:teuthology.orchestra.run.smithi003.stdout: "warn_on_stray_daemons": { 2024-09-10T23:36:48.440 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "warn_on_stray_daemons", 2024-09-10T23:36:48.440 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.440 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.440 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.440 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.440 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.440 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.440 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.440 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T23:36:48.440 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.440 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.440 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.440 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.441 INFO:teuthology.orchestra.run.smithi003.stdout: "warn_on_stray_hosts": { 2024-09-10T23:36:48.441 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "warn_on_stray_hosts", 2024-09-10T23:36:48.441 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.441 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.441 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.441 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.441 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.441 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.441 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.441 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T23:36:48.441 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.441 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.441 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.441 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.441 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.442 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.442 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.442 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crash", 2024-09-10T23:36:48.442 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.442 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.442 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.442 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.442 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.442 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.442 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.442 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.442 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.442 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.442 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.442 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.443 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.443 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.443 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.443 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.443 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.443 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.443 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.443 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.443 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.443 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.443 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.443 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.443 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.443 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.444 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.444 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.444 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.444 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.444 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.444 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.444 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.444 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.444 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.444 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.444 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.444 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.444 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.444 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.444 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.445 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.445 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.445 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.445 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.445 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.445 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.445 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.445 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.445 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.445 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.445 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.445 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.445 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.445 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.446 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.446 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.446 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.446 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.446 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.446 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.446 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.446 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.446 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.446 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.446 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.446 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.446 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.446 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.446 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.447 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.447 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.447 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.447 INFO:teuthology.orchestra.run.smithi003.stdout: "retain_interval": { 2024-09-10T23:36:48.447 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "retain_interval", 2024-09-10T23:36:48.447 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:48.447 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.447 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.447 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "31536000", 2024-09-10T23:36:48.447 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.447 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.447 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.447 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T23:36:48.447 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.447 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.447 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.448 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.448 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.448 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.448 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.448 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.448 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.448 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.448 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.448 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.448 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.448 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.448 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.448 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.448 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.448 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.448 INFO:teuthology.orchestra.run.smithi003.stdout: "warn_recent_interval": { 2024-09-10T23:36:48.449 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "warn_recent_interval", 2024-09-10T23:36:48.449 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:48.449 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.449 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.449 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "1209600", 2024-09-10T23:36:48.449 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.449 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.449 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.449 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T23:36:48.449 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.449 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.449 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.449 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.450 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.450 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.450 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.450 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "dashboard", 2024-09-10T23:36:48.450 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.450 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.450 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.450 INFO:teuthology.orchestra.run.smithi003.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T23:36:48.450 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T23:36:48.450 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.450 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.450 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.450 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-10T23:36:48.450 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.451 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.451 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.451 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.451 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.451 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.451 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.451 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.451 INFO:teuthology.orchestra.run.smithi003.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T23:36:48.451 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T23:36:48.451 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.451 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.451 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.451 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.451 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.451 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.451 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.452 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.452 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.452 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.452 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.452 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.452 INFO:teuthology.orchestra.run.smithi003.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T23:36:48.452 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T23:36:48.452 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.452 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.452 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.452 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.452 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.452 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.452 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.453 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.453 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.453 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.453 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.453 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.453 INFO:teuthology.orchestra.run.smithi003.stdout: "AUDIT_API_ENABLED": { 2024-09-10T23:36:48.453 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T23:36:48.453 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.453 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.453 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.453 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.453 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.453 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.453 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.453 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.454 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.454 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.454 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.454 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.454 INFO:teuthology.orchestra.run.smithi003.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T23:36:48.454 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T23:36:48.454 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.454 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.454 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.454 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.454 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.454 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.454 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.454 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.454 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.454 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.455 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.455 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.455 INFO:teuthology.orchestra.run.smithi003.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T23:36:48.455 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T23:36:48.455 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.455 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.455 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.455 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.455 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.455 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.455 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.455 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.455 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.455 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.455 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.455 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.456 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T23:36:48.456 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T23:36:48.456 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.456 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.456 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.456 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.456 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.456 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.456 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.456 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.456 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.456 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.456 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.456 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.457 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T23:36:48.457 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T23:36:48.457 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.457 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.457 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.457 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.457 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.457 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.457 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.457 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.457 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.457 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.457 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.457 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.457 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T23:36:48.458 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T23:36:48.458 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.458 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.458 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.458 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.458 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.458 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.458 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.458 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.458 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.458 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.458 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.458 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.458 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T23:36:48.458 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T23:36:48.458 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.459 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.459 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.459 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.459 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.459 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.459 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.459 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.459 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.459 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.459 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.459 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.459 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T23:36:48.459 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T23:36:48.459 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.459 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.460 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.460 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.460 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.460 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.460 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.460 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.460 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.460 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.460 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.460 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.460 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T23:36:48.460 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T23:36:48.460 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.460 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.460 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.461 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.461 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.461 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.461 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.461 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.461 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.461 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.461 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.461 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.461 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T23:36:48.461 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T23:36:48.461 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.461 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.461 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.461 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.461 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.462 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.462 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.462 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.462 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.462 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.462 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.462 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.462 INFO:teuthology.orchestra.run.smithi003.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T23:36:48.462 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T23:36:48.462 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.462 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.462 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.462 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.462 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.462 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.462 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.463 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.463 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.463 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.463 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.463 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.463 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T23:36:48.463 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T23:36:48.463 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.463 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.463 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.463 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "admin", 2024-09-10T23:36:48.463 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.463 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.463 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.463 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.464 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.464 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.464 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.464 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.464 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T23:36:48.464 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T23:36:48.464 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.464 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.464 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.464 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.464 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.464 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.464 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.464 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.465 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.465 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.465 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.465 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.465 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_API_URL": { 2024-09-10T23:36:48.465 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_API_URL", 2024-09-10T23:36:48.465 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.465 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.465 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.465 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.465 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.465 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.465 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.466 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.466 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.466 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.466 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.466 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.466 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T23:36:48.466 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T23:36:48.466 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.466 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.466 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.466 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "admin", 2024-09-10T23:36:48.466 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.466 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.466 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.466 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.467 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.467 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.467 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.467 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.467 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T23:36:48.467 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T23:36:48.467 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.467 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.467 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.467 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.467 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.467 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.467 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.467 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.468 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.468 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.468 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.468 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.468 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T23:36:48.468 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T23:36:48.468 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.468 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.468 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.468 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.468 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.468 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.468 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.468 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.469 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.469 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.469 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.469 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.469 INFO:teuthology.orchestra.run.smithi003.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T23:36:48.469 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T23:36:48.469 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.469 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.469 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.469 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.469 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.469 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.469 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.470 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.470 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.470 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.470 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.470 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.470 INFO:teuthology.orchestra.run.smithi003.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T23:36:48.470 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T23:36:48.470 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.470 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.470 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.470 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.470 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.470 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.471 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.471 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.471 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.471 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.471 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.471 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.471 INFO:teuthology.orchestra.run.smithi003.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-10T23:36:48.471 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-10T23:36:48.471 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.471 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.471 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.471 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "[]", 2024-09-10T23:36:48.471 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.471 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.471 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.471 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.472 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.472 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.472 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.472 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.472 INFO:teuthology.orchestra.run.smithi003.stdout: "MULTICLUSTER_CONFIG": { 2024-09-10T23:36:48.472 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-10T23:36:48.472 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.472 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.472 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.472 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "{}", 2024-09-10T23:36:48.472 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.472 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.472 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.472 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.473 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.473 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.473 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.473 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.473 INFO:teuthology.orchestra.run.smithi003.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T23:36:48.473 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T23:36:48.473 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.473 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.473 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.473 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.473 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.473 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.473 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.473 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.473 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.473 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.474 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.474 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.474 INFO:teuthology.orchestra.run.smithi003.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T23:36:48.474 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T23:36:48.474 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.474 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.474 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.474 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.474 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.474 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.474 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.474 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.474 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.474 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.475 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.475 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.475 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T23:36:48.475 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T23:36:48.475 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.475 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.475 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.475 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.475 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.475 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.475 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.475 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.476 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.476 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.476 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.476 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.476 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T23:36:48.476 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T23:36:48.476 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.476 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.476 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.476 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.476 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.476 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.476 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.476 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.477 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.477 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.477 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.477 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.477 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T23:36:48.477 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T23:36:48.477 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.477 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.477 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.477 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.477 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.477 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.477 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.477 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.477 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.478 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.478 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.478 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.478 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T23:36:48.478 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T23:36:48.478 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.478 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.478 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.478 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.478 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.478 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.478 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.478 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.478 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.478 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.478 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.479 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.479 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T23:36:48.479 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T23:36:48.479 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.479 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.479 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.479 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.479 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.479 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.479 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.479 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.479 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.479 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.479 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.479 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.480 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T23:36:48.480 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T23:36:48.480 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.480 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.480 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.480 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.480 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.480 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.480 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.480 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.480 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.480 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.480 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.480 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.481 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T23:36:48.481 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T23:36:48.481 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.481 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.481 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.481 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.481 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.481 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.481 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.481 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.481 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.481 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.481 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.481 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.482 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T23:36:48.482 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T23:36:48.482 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.482 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.482 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.482 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.482 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.482 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.482 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.482 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.482 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.482 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.482 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.482 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.483 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T23:36:48.483 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T23:36:48.483 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.483 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.483 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.483 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T23:36:48.483 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.483 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.483 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.483 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.483 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.483 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.483 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.483 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.484 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T23:36:48.484 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T23:36:48.484 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.484 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.484 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.484 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-10T23:36:48.484 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.484 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.484 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.484 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.484 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.484 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.484 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.485 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.485 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T23:36:48.485 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T23:36:48.485 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.485 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.485 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.485 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "8", 2024-09-10T23:36:48.485 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.485 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.485 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.485 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.485 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.485 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.486 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.486 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.486 INFO:teuthology.orchestra.run.smithi003.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T23:36:48.486 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T23:36:48.486 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.486 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.486 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.486 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "45", 2024-09-10T23:36:48.486 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.486 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.486 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.486 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.486 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.487 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.487 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.487 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.487 INFO:teuthology.orchestra.run.smithi003.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T23:36:48.487 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T23:36:48.487 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.487 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.487 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.487 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.487 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.487 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.487 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.487 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.487 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.487 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.487 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.488 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.488 INFO:teuthology.orchestra.run.smithi003.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T23:36:48.488 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T23:36:48.488 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.488 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.488 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.488 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "admin", 2024-09-10T23:36:48.488 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.488 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.488 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.488 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.488 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.488 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.488 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.488 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.489 INFO:teuthology.orchestra.run.smithi003.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T23:36:48.489 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T23:36:48.489 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.489 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.489 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.489 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.489 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.489 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.489 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.489 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.489 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.489 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.489 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.489 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.490 INFO:teuthology.orchestra.run.smithi003.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T23:36:48.490 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T23:36:48.490 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.490 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.490 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.490 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.490 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.490 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.490 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.490 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.490 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.490 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.490 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.490 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.491 INFO:teuthology.orchestra.run.smithi003.stdout: "UNSAFE_TLS_v1_2": { 2024-09-10T23:36:48.491 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-10T23:36:48.491 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.491 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.491 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.491 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.491 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.491 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.491 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.491 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.491 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.491 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.491 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.491 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.492 INFO:teuthology.orchestra.run.smithi003.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T23:36:48.492 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T23:36:48.492 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.492 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.492 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.492 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.492 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.492 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.492 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.493 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.493 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.493 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.493 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.493 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.493 INFO:teuthology.orchestra.run.smithi003.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T23:36:48.493 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T23:36:48.493 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.493 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.493 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.493 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-10T23:36:48.493 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.493 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.494 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.494 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.494 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.494 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.494 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.494 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.494 INFO:teuthology.orchestra.run.smithi003.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T23:36:48.494 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T23:36:48.494 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.494 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.494 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.494 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5", 2024-09-10T23:36:48.494 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.495 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.495 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.495 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.495 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.495 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.495 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.495 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.495 INFO:teuthology.orchestra.run.smithi003.stdout: "cross_origin_url": { 2024-09-10T23:36:48.495 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "cross_origin_url", 2024-09-10T23:36:48.495 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.495 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.495 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.496 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.496 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.496 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.496 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.496 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.496 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.496 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.496 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.496 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.496 INFO:teuthology.orchestra.run.smithi003.stdout: "crt_file": { 2024-09-10T23:36:48.496 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crt_file", 2024-09-10T23:36:48.496 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.497 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.497 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.497 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.497 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.497 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.497 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.497 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.497 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.497 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.497 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.497 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.497 INFO:teuthology.orchestra.run.smithi003.stdout: "debug": { 2024-09-10T23:36:48.498 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "debug", 2024-09-10T23:36:48.498 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.498 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.498 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.498 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.498 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.498 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.498 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.498 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Enable/disable debug options", 2024-09-10T23:36:48.498 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.498 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.499 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.499 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.499 INFO:teuthology.orchestra.run.smithi003.stdout: "jwt_token_ttl": { 2024-09-10T23:36:48.499 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "jwt_token_ttl", 2024-09-10T23:36:48.499 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.499 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.499 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.499 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "28800", 2024-09-10T23:36:48.499 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.499 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.499 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.499 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.500 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.500 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.500 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.500 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.500 INFO:teuthology.orchestra.run.smithi003.stdout: "key_file": { 2024-09-10T23:36:48.500 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "key_file", 2024-09-10T23:36:48.500 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.500 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.500 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.500 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.500 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.500 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.500 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.500 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.501 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.501 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.501 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.501 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.501 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.501 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.501 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.501 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.501 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.501 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.501 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.501 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.501 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.502 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.502 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.502 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.502 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.502 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.502 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.502 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.502 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.502 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.502 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.502 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.502 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.502 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.502 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.503 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.503 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.503 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.503 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.503 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.503 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.503 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.503 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.503 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.503 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.503 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.503 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.503 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.503 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.503 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.503 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.504 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.504 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.504 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.504 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.504 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.504 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.504 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.504 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.504 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.504 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.504 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.504 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.504 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.504 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.504 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.505 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.505 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.505 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.505 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.505 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.505 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.505 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.505 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.505 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.505 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.505 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.505 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.505 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.505 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.506 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.506 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.506 INFO:teuthology.orchestra.run.smithi003.stdout: "motd": { 2024-09-10T23:36:48.506 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "motd", 2024-09-10T23:36:48.506 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.506 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.506 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.506 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.506 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.506 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.506 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.506 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "The message of the day", 2024-09-10T23:36:48.506 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.506 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.507 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.507 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.507 INFO:teuthology.orchestra.run.smithi003.stdout: "redirect_resolve_ip_addr": { 2024-09-10T23:36:48.507 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T23:36:48.507 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.507 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.507 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.507 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.507 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.507 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.507 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.507 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.507 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.507 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.507 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.508 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.508 INFO:teuthology.orchestra.run.smithi003.stdout: "server_addr": { 2024-09-10T23:36:48.508 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_addr", 2024-09-10T23:36:48.508 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.508 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.508 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.508 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "::", 2024-09-10T23:36:48.508 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.508 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.508 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.508 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.508 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.508 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.508 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.509 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.509 INFO:teuthology.orchestra.run.smithi003.stdout: "server_port": { 2024-09-10T23:36:48.509 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_port", 2024-09-10T23:36:48.509 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.509 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.509 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.509 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "8080", 2024-09-10T23:36:48.509 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.509 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.509 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.509 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.509 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.509 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.509 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.510 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.510 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.510 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.510 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.510 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.510 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.510 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.510 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.510 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.510 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.510 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.510 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.510 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.510 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.511 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.511 INFO:teuthology.orchestra.run.smithi003.stdout: "ssl": { 2024-09-10T23:36:48.511 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ssl", 2024-09-10T23:36:48.511 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.511 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.511 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.511 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.511 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.511 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.511 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.511 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.511 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.511 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.511 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.511 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.512 INFO:teuthology.orchestra.run.smithi003.stdout: "ssl_server_port": { 2024-09-10T23:36:48.512 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ssl_server_port", 2024-09-10T23:36:48.512 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.512 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.512 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.512 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "8443", 2024-09-10T23:36:48.512 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.512 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.512 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.512 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.512 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.512 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.512 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.513 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.513 INFO:teuthology.orchestra.run.smithi003.stdout: "standby_behaviour": { 2024-09-10T23:36:48.513 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "standby_behaviour", 2024-09-10T23:36:48.513 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.513 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.513 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.513 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "redirect", 2024-09-10T23:36:48.513 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.513 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.513 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.513 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.513 INFO:teuthology.orchestra.run.smithi003.stdout: "redirect" 2024-09-10T23:36:48.513 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.513 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.514 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.514 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.514 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.514 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.514 INFO:teuthology.orchestra.run.smithi003.stdout: "standby_error_status_code": { 2024-09-10T23:36:48.514 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "standby_error_status_code", 2024-09-10T23:36:48.514 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.514 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.514 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.514 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "500", 2024-09-10T23:36:48.514 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "400", 2024-09-10T23:36:48.514 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "599", 2024-09-10T23:36:48.514 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.514 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.515 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.515 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.515 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.515 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.515 INFO:teuthology.orchestra.run.smithi003.stdout: "url_prefix": { 2024-09-10T23:36:48.515 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "url_prefix", 2024-09-10T23:36:48.515 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.515 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.515 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.515 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.515 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.515 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.515 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.516 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.516 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.516 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.516 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.516 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.516 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.516 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.516 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.516 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "devicehealth", 2024-09-10T23:36:48.516 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.516 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.516 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.516 INFO:teuthology.orchestra.run.smithi003.stdout: "enable_monitoring": { 2024-09-10T23:36:48.517 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "enable_monitoring", 2024-09-10T23:36:48.517 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.517 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.517 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.517 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.517 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.517 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.517 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.517 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "monitor device health metrics", 2024-09-10T23:36:48.517 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.517 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.517 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.517 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.517 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.518 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.518 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.518 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.518 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.518 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.518 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.518 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.518 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.518 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.518 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.518 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.518 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.518 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.519 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.519 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.519 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.519 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.519 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.519 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.519 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.519 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.519 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.519 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.519 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.519 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.519 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.519 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.520 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.520 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.520 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.520 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.520 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.520 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.520 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.520 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.520 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.520 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.520 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.520 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.520 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.520 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.521 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.521 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.521 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.521 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.521 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.521 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.521 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.521 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.521 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.521 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.521 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.521 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.521 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.522 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.522 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.522 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.522 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.522 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.522 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.522 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.522 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.522 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.522 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.522 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.522 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.522 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.522 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.523 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.523 INFO:teuthology.orchestra.run.smithi003.stdout: "mark_out_threshold": { 2024-09-10T23:36:48.523 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mark_out_threshold", 2024-09-10T23:36:48.523 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:48.523 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.523 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.523 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "2419200", 2024-09-10T23:36:48.523 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.523 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.523 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.523 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T23:36:48.523 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.523 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.523 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.523 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.524 INFO:teuthology.orchestra.run.smithi003.stdout: "pool_name": { 2024-09-10T23:36:48.524 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "pool_name", 2024-09-10T23:36:48.524 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.524 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.524 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.524 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "device_health_metrics", 2024-09-10T23:36:48.524 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.524 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.524 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.524 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T23:36:48.524 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.524 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.524 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.525 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.525 INFO:teuthology.orchestra.run.smithi003.stdout: "retention_period": { 2024-09-10T23:36:48.525 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "retention_period", 2024-09-10T23:36:48.525 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:48.525 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.525 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.525 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "15552000", 2024-09-10T23:36:48.525 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.525 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.525 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.525 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how long to retain device health metrics", 2024-09-10T23:36:48.525 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.525 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.525 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.526 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.526 INFO:teuthology.orchestra.run.smithi003.stdout: "scrape_frequency": { 2024-09-10T23:36:48.526 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "scrape_frequency", 2024-09-10T23:36:48.526 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:48.526 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.526 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.526 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "86400", 2024-09-10T23:36:48.526 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.526 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.526 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.526 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T23:36:48.526 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.526 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.526 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.526 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.526 INFO:teuthology.orchestra.run.smithi003.stdout: "self_heal": { 2024-09-10T23:36:48.527 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "self_heal", 2024-09-10T23:36:48.527 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.527 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.527 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.527 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.527 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.527 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.527 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.527 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T23:36:48.527 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.527 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.527 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.527 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.527 INFO:teuthology.orchestra.run.smithi003.stdout: "sleep_interval": { 2024-09-10T23:36:48.527 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sleep_interval", 2024-09-10T23:36:48.527 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:48.528 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.528 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.528 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "600", 2024-09-10T23:36:48.528 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.528 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.528 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.528 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T23:36:48.528 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.528 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.528 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.528 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.528 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.528 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.528 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.528 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.529 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.529 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.529 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.529 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.529 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.529 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.529 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.529 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.529 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.529 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.529 INFO:teuthology.orchestra.run.smithi003.stdout: "warn_threshold": { 2024-09-10T23:36:48.529 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "warn_threshold", 2024-09-10T23:36:48.529 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:48.529 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.530 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.530 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "7257600", 2024-09-10T23:36:48.530 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.530 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.530 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.530 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T23:36:48.530 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.530 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.530 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.530 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.530 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.530 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.530 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.530 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "diskprediction_local", 2024-09-10T23:36:48.531 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.531 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.531 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.531 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.531 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.531 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.531 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.531 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.531 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.531 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.531 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.531 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.531 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.531 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.531 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.532 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.532 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.532 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.532 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.532 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.532 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.532 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.532 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.532 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.532 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.532 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.532 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.532 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.532 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.533 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.533 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.533 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.533 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.533 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.533 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.533 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.533 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.533 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.533 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.533 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.533 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.533 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.533 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.533 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.534 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.534 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.534 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.534 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.534 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.534 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.534 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.534 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.534 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.534 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.534 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.534 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.534 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.534 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.535 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.535 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.535 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.535 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.535 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.535 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.535 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.535 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.535 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.535 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.535 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.535 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.535 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.535 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.535 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.536 INFO:teuthology.orchestra.run.smithi003.stdout: "predict_interval": { 2024-09-10T23:36:48.536 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "predict_interval", 2024-09-10T23:36:48.536 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.536 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.536 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.536 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "86400", 2024-09-10T23:36:48.536 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.536 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.536 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.536 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.536 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.536 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.536 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.536 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.537 INFO:teuthology.orchestra.run.smithi003.stdout: "predictor_model": { 2024-09-10T23:36:48.537 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "predictor_model", 2024-09-10T23:36:48.537 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.537 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.537 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.537 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "prophetstor", 2024-09-10T23:36:48.537 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.537 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.537 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.537 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.537 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.537 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.537 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.537 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.538 INFO:teuthology.orchestra.run.smithi003.stdout: "sleep_interval": { 2024-09-10T23:36:48.538 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sleep_interval", 2024-09-10T23:36:48.538 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.538 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.538 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.538 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "600", 2024-09-10T23:36:48.538 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.538 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.538 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.538 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.538 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.538 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.538 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.538 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.538 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.539 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.539 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.539 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.539 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.539 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.539 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.539 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.539 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.539 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.539 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.539 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.539 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.539 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.539 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.539 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.539 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.540 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "influx", 2024-09-10T23:36:48.540 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": false, 2024-09-10T23:36:48.540 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "influxdb python module not found", 2024-09-10T23:36:48.540 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.540 INFO:teuthology.orchestra.run.smithi003.stdout: "batch_size": { 2024-09-10T23:36:48.540 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "batch_size", 2024-09-10T23:36:48.540 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.540 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.540 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.540 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5000", 2024-09-10T23:36:48.540 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.540 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.540 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.540 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T23:36:48.541 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.541 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.541 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.541 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.541 INFO:teuthology.orchestra.run.smithi003.stdout: "database": { 2024-09-10T23:36:48.541 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "database", 2024-09-10T23:36:48.541 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.541 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.541 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.541 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "ceph", 2024-09-10T23:36:48.541 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.541 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.541 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.541 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T23:36:48.542 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.542 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.542 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.542 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.542 INFO:teuthology.orchestra.run.smithi003.stdout: "hostname": { 2024-09-10T23:36:48.542 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "hostname", 2024-09-10T23:36:48.542 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.542 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.542 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.542 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.542 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.542 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.542 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.542 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "InfluxDB server hostname", 2024-09-10T23:36:48.542 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.543 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.543 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.543 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.543 INFO:teuthology.orchestra.run.smithi003.stdout: "interval": { 2024-09-10T23:36:48.543 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "interval", 2024-09-10T23:36:48.543 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:48.543 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.543 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.543 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "30", 2024-09-10T23:36:48.543 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "5", 2024-09-10T23:36:48.543 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.543 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.543 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T23:36:48.543 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.543 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.544 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.544 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.544 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.544 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.544 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.544 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.544 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.544 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.544 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.544 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.544 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.544 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.544 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.545 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.545 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.545 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.545 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.545 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.545 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.545 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.545 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.545 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.545 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.545 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.545 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.545 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.546 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.546 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.546 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.546 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.546 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.546 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.546 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.546 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.546 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.546 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.546 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.546 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.546 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.547 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.547 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.547 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.547 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.547 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.547 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.547 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.547 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.547 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.547 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.547 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.547 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.547 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.548 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.548 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.548 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.548 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.548 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.548 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.548 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.548 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.548 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.548 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.548 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.548 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.548 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.549 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.549 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.549 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.549 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.549 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.549 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.549 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.549 INFO:teuthology.orchestra.run.smithi003.stdout: "password": { 2024-09-10T23:36:48.549 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "password", 2024-09-10T23:36:48.549 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.549 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.549 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.549 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.550 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.550 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.550 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.550 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "password of InfluxDB server user", 2024-09-10T23:36:48.550 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.550 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.550 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.550 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.550 INFO:teuthology.orchestra.run.smithi003.stdout: "port": { 2024-09-10T23:36:48.550 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "port", 2024-09-10T23:36:48.550 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.550 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.550 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.550 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "8086", 2024-09-10T23:36:48.551 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.551 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.551 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.551 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "InfluxDB server port", 2024-09-10T23:36:48.551 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.551 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.551 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.551 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.551 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.551 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.551 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.551 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.551 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.552 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.552 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.552 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.552 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.552 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.552 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.552 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.552 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.552 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.552 INFO:teuthology.orchestra.run.smithi003.stdout: "ssl": { 2024-09-10T23:36:48.552 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ssl", 2024-09-10T23:36:48.552 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.552 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.552 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.553 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "false", 2024-09-10T23:36:48.553 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.553 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.553 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.553 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T23:36:48.553 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.553 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.553 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.553 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.553 INFO:teuthology.orchestra.run.smithi003.stdout: "threads": { 2024-09-10T23:36:48.553 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "threads", 2024-09-10T23:36:48.553 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.554 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.554 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.554 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5", 2024-09-10T23:36:48.554 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "1", 2024-09-10T23:36:48.554 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "32", 2024-09-10T23:36:48.554 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.554 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T23:36:48.554 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.554 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.554 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.554 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.554 INFO:teuthology.orchestra.run.smithi003.stdout: "username": { 2024-09-10T23:36:48.555 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "username", 2024-09-10T23:36:48.555 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.555 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.555 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.555 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.555 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.555 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.555 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.555 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "username of InfluxDB server user", 2024-09-10T23:36:48.555 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.555 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.555 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.555 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.555 INFO:teuthology.orchestra.run.smithi003.stdout: "verify_ssl": { 2024-09-10T23:36:48.556 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "verify_ssl", 2024-09-10T23:36:48.556 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.556 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.556 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.556 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "true", 2024-09-10T23:36:48.556 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.556 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.556 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.556 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T23:36:48.556 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.556 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.556 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.556 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.557 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.557 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.557 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.557 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "insights", 2024-09-10T23:36:48.557 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.557 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.557 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.557 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.557 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.557 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.557 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.557 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.557 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.557 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.558 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.558 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.558 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.558 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.558 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.558 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.558 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.558 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.558 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.558 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.558 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.558 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.558 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.558 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.558 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.559 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.559 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.559 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.559 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.559 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.559 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.559 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.559 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.559 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.559 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.559 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.559 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.559 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.560 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.560 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.560 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.560 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.560 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.560 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.560 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.560 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.560 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.560 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.560 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.560 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.560 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.560 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.561 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.561 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.561 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.561 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.561 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.561 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.561 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.561 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.561 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.561 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.561 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.561 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.561 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.561 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.562 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.562 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.562 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.562 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.562 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.562 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.562 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.562 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.562 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.562 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.562 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.562 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.562 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.562 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.563 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.563 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.563 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.563 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.563 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.563 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.563 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.563 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.563 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.563 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.563 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "iostat", 2024-09-10T23:36:48.563 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.563 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.563 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.564 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.564 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.564 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.564 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.564 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.564 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.564 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.564 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.564 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.564 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.564 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.564 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.565 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.565 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.565 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.565 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.565 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.565 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.565 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.565 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.565 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.565 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.565 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.565 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.565 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.566 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.566 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.566 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.566 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.566 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.566 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.566 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.566 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.566 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.566 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.566 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.566 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.566 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.567 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.567 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.567 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.567 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.567 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.567 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.567 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.567 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.567 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.567 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.567 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.567 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.567 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.567 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.568 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.568 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.568 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.568 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.568 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.568 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.568 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.568 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.568 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.568 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.568 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.568 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.568 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.568 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.568 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.569 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.569 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.569 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.569 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.569 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.569 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.569 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.569 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.569 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.569 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.569 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.569 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.569 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.569 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.569 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.570 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.570 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.570 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.570 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.570 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.570 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "k8sevents", 2024-09-10T23:36:48.570 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.570 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.570 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.570 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_event_retention_days": { 2024-09-10T23:36:48.570 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ceph_event_retention_days", 2024-09-10T23:36:48.570 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.570 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.570 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.571 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "7", 2024-09-10T23:36:48.571 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.571 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.571 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.571 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T23:36:48.571 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.571 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.571 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.571 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.571 INFO:teuthology.orchestra.run.smithi003.stdout: "config_check_secs": { 2024-09-10T23:36:48.571 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "config_check_secs", 2024-09-10T23:36:48.571 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.571 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.571 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.571 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-10T23:36:48.571 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "10", 2024-09-10T23:36:48.572 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.572 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.572 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T23:36:48.572 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.572 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.572 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.572 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.572 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.572 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.572 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.572 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.572 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.572 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.573 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.573 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.573 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.573 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.573 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.573 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.573 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.573 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.573 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.573 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.573 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.573 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.573 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.573 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.573 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.574 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.574 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.574 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.574 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.574 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.574 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.574 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.574 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.574 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.574 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.574 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.574 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.574 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.574 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.574 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.574 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.575 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.575 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.575 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.575 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.575 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.575 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.575 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.575 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.575 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.575 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.575 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.575 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.575 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.575 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.576 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.576 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.576 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.576 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.576 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.576 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.576 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.576 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.576 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.576 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.576 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.576 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.576 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.576 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.577 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.577 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.577 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.577 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.577 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.577 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.577 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.577 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.577 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.577 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.577 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.577 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.577 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.577 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.577 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.577 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.578 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.578 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.578 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.578 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.578 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.578 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.578 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "localpool", 2024-09-10T23:36:48.578 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.578 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.578 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.578 INFO:teuthology.orchestra.run.smithi003.stdout: "failure_domain": { 2024-09-10T23:36:48.578 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "failure_domain", 2024-09-10T23:36:48.578 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.578 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.579 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.579 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "host", 2024-09-10T23:36:48.579 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.579 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.579 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.579 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "failure domain for any created local pool", 2024-09-10T23:36:48.579 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T23:36:48.579 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.579 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.579 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.579 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.579 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.579 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.579 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.579 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.579 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.580 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.580 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.580 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.580 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.580 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.580 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.580 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.580 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.580 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.580 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.580 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.580 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.580 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.581 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.581 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.581 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.581 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.581 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.581 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.581 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.581 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.581 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.581 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.581 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.581 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.581 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.581 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.582 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.582 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.582 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.582 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.582 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.582 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.582 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.582 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.582 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.582 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.582 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.582 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.582 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.582 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.583 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.583 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.583 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.583 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.583 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.583 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.583 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.583 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.583 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.583 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.583 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.583 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.583 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.583 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.583 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.583 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.584 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.584 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.584 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.584 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.584 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.584 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.584 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.584 INFO:teuthology.orchestra.run.smithi003.stdout: "min_size": { 2024-09-10T23:36:48.584 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "min_size", 2024-09-10T23:36:48.584 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.584 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.584 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.584 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.584 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.584 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.585 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.585 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "default min_size for any created local pool", 2024-09-10T23:36:48.585 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T23:36:48.585 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.585 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.585 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.585 INFO:teuthology.orchestra.run.smithi003.stdout: "num_rep": { 2024-09-10T23:36:48.585 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "num_rep", 2024-09-10T23:36:48.585 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.585 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.585 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.585 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "3", 2024-09-10T23:36:48.585 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.585 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.586 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.586 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "default replica count for any created local pool", 2024-09-10T23:36:48.586 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.586 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.586 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.586 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.586 INFO:teuthology.orchestra.run.smithi003.stdout: "pg_num": { 2024-09-10T23:36:48.586 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "pg_num", 2024-09-10T23:36:48.586 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.586 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.586 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.586 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "128", 2024-09-10T23:36:48.586 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.586 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.587 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.587 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T23:36:48.587 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.587 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.587 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.587 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.587 INFO:teuthology.orchestra.run.smithi003.stdout: "prefix": { 2024-09-10T23:36:48.587 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "prefix", 2024-09-10T23:36:48.587 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.587 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.587 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.587 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.587 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.587 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.587 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.587 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "name prefix for any created local pool", 2024-09-10T23:36:48.588 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.588 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.588 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.588 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.588 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.588 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.588 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.588 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.588 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.588 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.588 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.588 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.588 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.588 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.589 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.589 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.589 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.589 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.589 INFO:teuthology.orchestra.run.smithi003.stdout: "subtree": { 2024-09-10T23:36:48.589 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "subtree", 2024-09-10T23:36:48.589 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.589 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.589 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.589 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "rack", 2024-09-10T23:36:48.589 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.589 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.589 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.589 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T23:36:48.590 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T23:36:48.590 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.590 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.590 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.590 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.590 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.590 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.590 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mds_autoscaler", 2024-09-10T23:36:48.590 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.590 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.590 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.590 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.590 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.590 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.590 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.591 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.591 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.591 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.591 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.591 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.591 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.591 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.591 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.591 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.591 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.591 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.591 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.591 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.591 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.592 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.592 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.592 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.592 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.592 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.592 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.592 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.592 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.592 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.592 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.592 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.592 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.592 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.592 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.593 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.593 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.593 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.593 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.593 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.593 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.593 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.593 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.593 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.593 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.593 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.593 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.593 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.593 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.594 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.594 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.594 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.594 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.594 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.594 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.594 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.594 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.594 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.594 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.594 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.594 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.594 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.594 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.594 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.595 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.595 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.595 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.595 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.595 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.595 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.595 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.595 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.595 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.595 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.595 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.595 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.595 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.596 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.596 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.596 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.596 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.596 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.596 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.596 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.596 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.596 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.596 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.596 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.596 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.596 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.596 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mirroring", 2024-09-10T23:36:48.597 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.597 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.597 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.597 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.597 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.597 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.597 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.597 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.597 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.597 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.597 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.597 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.597 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.598 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.598 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.598 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.598 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.598 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.598 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.598 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.598 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.598 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.598 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.598 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.598 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.598 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.599 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.599 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.599 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.599 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.599 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.599 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.599 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.599 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.599 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.599 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.599 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.599 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.599 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.600 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.600 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.600 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.600 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.600 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.600 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.600 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.600 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.600 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.600 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.600 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.600 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.600 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.600 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.601 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.601 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.601 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.601 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.601 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.601 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.601 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.601 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.601 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.601 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.601 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.601 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.601 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.601 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.602 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.602 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.602 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.602 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.602 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.602 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.602 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.602 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.602 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.602 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.602 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.602 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.602 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.603 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.603 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.603 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.603 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.603 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.603 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.603 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.603 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.603 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.603 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.603 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "nfs", 2024-09-10T23:36:48.603 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.603 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.603 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.604 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.604 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.604 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.604 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.604 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.604 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.604 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.604 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.604 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.604 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.604 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.604 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.604 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.605 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.605 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.605 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.605 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.605 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.605 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.605 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.605 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.605 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.605 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.605 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.605 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.605 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.605 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.605 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.606 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.606 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.606 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.606 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.606 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.606 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.606 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.606 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.606 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.606 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.606 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.606 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.606 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.607 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.607 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.607 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.607 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.607 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.607 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.607 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.607 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.607 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.607 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.607 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.607 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.607 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.607 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.607 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.607 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.608 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.608 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.608 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.608 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.608 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.608 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.608 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.608 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.608 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.608 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.608 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.608 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.608 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.608 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.608 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.609 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.609 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.609 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.609 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.609 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.609 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.609 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.609 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.609 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.609 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.609 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.609 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.609 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.609 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.609 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.610 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "orchestrator", 2024-09-10T23:36:48.610 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.610 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.610 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.610 INFO:teuthology.orchestra.run.smithi003.stdout: "fail_fs": { 2024-09-10T23:36:48.610 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "fail_fs", 2024-09-10T23:36:48.610 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.610 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.610 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.610 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.610 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.610 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.610 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.610 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T23:36:48.611 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.611 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.611 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.611 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.611 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.611 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.611 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.611 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.611 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.611 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.611 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.611 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.611 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.611 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.611 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.612 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.612 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.612 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.612 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.612 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.612 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.612 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.612 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.612 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.612 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.612 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.612 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.612 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.612 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.613 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.613 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.613 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.613 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.613 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.613 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.613 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.613 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.613 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.613 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.613 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.613 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.613 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.613 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.613 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.614 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.614 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.614 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.614 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.614 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.614 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.614 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.614 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.614 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.614 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.614 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.614 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.614 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.614 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.615 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.615 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.615 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.615 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.615 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.615 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.615 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.615 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.615 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.615 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.615 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.615 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.615 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.615 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.616 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.616 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.616 INFO:teuthology.orchestra.run.smithi003.stdout: "orchestrator": { 2024-09-10T23:36:48.616 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "orchestrator", 2024-09-10T23:36:48.616 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.616 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.616 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.616 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.616 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.616 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.616 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.616 INFO:teuthology.orchestra.run.smithi003.stdout: "cephadm", 2024-09-10T23:36:48.616 INFO:teuthology.orchestra.run.smithi003.stdout: "rook", 2024-09-10T23:36:48.617 INFO:teuthology.orchestra.run.smithi003.stdout: "test_orchestrator" 2024-09-10T23:36:48.617 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.617 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Orchestrator backend", 2024-09-10T23:36:48.617 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.617 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.617 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.617 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.617 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.617 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.617 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.617 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.617 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.617 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.617 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.618 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.618 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.618 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.618 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.618 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.618 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.618 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.618 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.618 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.618 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.618 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "osd_perf_query", 2024-09-10T23:36:48.618 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.618 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.619 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.619 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.619 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.619 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.619 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.619 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.619 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.619 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.619 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.619 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.619 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.619 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.619 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.619 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.620 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.620 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.620 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.620 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.620 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.620 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.620 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.620 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.620 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.620 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.620 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.620 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.620 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.621 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.621 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.621 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.621 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.621 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.621 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.621 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.621 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.621 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.621 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.621 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.621 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.621 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.622 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.622 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.622 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.622 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.622 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.622 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.622 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.622 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.622 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.622 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.622 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.622 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.622 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.623 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.623 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.623 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.623 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.623 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.623 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.623 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.623 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.623 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.623 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.623 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.623 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.623 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.623 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.623 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.624 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.624 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.624 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.624 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.624 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.624 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.624 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.624 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.624 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.624 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.624 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.624 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.624 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.625 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.625 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.625 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.625 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.625 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.625 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.625 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.625 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "osd_support", 2024-09-10T23:36:48.625 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.625 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.625 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.625 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.625 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.626 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.626 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.626 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.626 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.626 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.626 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.626 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.626 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.626 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.626 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.626 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.626 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.626 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.626 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.627 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.627 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.627 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.627 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.627 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.627 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.627 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.627 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.627 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.627 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.627 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.627 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.627 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.627 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.627 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.627 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.628 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.628 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.628 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.628 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.628 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.628 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.628 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.628 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.628 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.628 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.628 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.628 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.628 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.628 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.628 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.629 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.629 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.629 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.629 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.629 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.629 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.629 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.629 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.629 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.629 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.629 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.629 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.629 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.629 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.629 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.630 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.630 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.630 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.630 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.630 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.630 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.630 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.630 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.630 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.630 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.630 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.630 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.630 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.630 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.630 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.630 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.631 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.631 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.631 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.631 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.631 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.631 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.631 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.631 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.631 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.631 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "pg_autoscaler", 2024-09-10T23:36:48.631 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.631 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.631 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.631 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.632 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.632 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.632 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.632 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.632 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.632 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.632 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.632 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.632 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.632 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.632 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.632 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.632 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.632 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.632 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.633 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.633 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.633 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.633 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.633 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.633 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.633 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.633 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.633 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.633 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.633 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.633 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.633 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.634 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.634 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.634 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.634 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.634 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.634 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.634 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.634 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.634 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.634 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.634 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.634 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.634 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.634 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.634 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.634 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.635 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.635 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.635 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.635 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.635 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.635 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.635 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.635 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.635 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.635 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.635 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.635 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.635 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.635 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.635 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.636 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.636 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.636 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.636 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.636 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.636 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.636 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.636 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.636 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.636 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.636 INFO:teuthology.orchestra.run.smithi003.stdout: "sleep_interval": { 2024-09-10T23:36:48.636 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sleep_interval", 2024-09-10T23:36:48.636 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:48.636 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.637 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.637 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "60", 2024-09-10T23:36:48.637 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.637 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.637 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.637 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.637 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.637 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.637 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.637 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.637 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.637 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.637 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.637 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.638 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.638 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.638 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.638 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.638 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.638 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.638 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.638 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.638 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.638 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.638 INFO:teuthology.orchestra.run.smithi003.stdout: "threshold": { 2024-09-10T23:36:48.638 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "threshold", 2024-09-10T23:36:48.638 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-10T23:36:48.638 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.638 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.638 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "3.0", 2024-09-10T23:36:48.639 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "1.0", 2024-09-10T23:36:48.639 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.639 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.639 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "scaling threshold", 2024-09-10T23:36:48.639 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T23:36:48.639 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.639 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.639 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.639 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.639 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.639 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.639 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "progress", 2024-09-10T23:36:48.639 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.639 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.639 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.639 INFO:teuthology.orchestra.run.smithi003.stdout: "allow_pg_recovery_event": { 2024-09-10T23:36:48.640 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "allow_pg_recovery_event", 2024-09-10T23:36:48.640 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.640 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.640 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.640 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.640 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.640 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.640 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.640 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T23:36:48.640 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.640 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.640 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.640 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.640 INFO:teuthology.orchestra.run.smithi003.stdout: "enabled": { 2024-09-10T23:36:48.640 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "enabled", 2024-09-10T23:36:48.641 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.641 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.641 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.641 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.641 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.641 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.641 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.641 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.641 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.641 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.641 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.641 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.641 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.641 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.642 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.642 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.642 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.642 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.642 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.642 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.642 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.642 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.642 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.642 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.642 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.642 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.642 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.642 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.642 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.643 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.643 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.643 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.643 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.643 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.643 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.643 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.643 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.643 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.643 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.643 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.643 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.643 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.643 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.643 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.643 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.644 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.644 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.644 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.644 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.644 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.644 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.644 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.644 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.644 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.644 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.644 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.644 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.644 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.644 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.645 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.645 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.645 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.645 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.645 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.645 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.645 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.645 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.645 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.645 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.645 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.645 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.645 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.645 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.645 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.646 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.646 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.646 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.646 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.646 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.646 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.646 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.646 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.646 INFO:teuthology.orchestra.run.smithi003.stdout: "max_completed_events": { 2024-09-10T23:36:48.646 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "max_completed_events", 2024-09-10T23:36:48.646 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.646 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.646 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.646 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "50", 2024-09-10T23:36:48.646 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.647 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.647 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.647 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "number of past completed events to remember", 2024-09-10T23:36:48.647 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.647 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.647 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.647 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.647 INFO:teuthology.orchestra.run.smithi003.stdout: "sleep_interval": { 2024-09-10T23:36:48.647 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sleep_interval", 2024-09-10T23:36:48.647 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:48.647 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.647 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.647 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5", 2024-09-10T23:36:48.647 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.647 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.647 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.648 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how long the module is going to sleep", 2024-09-10T23:36:48.648 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.648 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.648 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.648 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.648 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.648 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.648 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.648 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.648 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.648 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.648 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.648 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.648 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.648 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.649 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.649 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.649 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.649 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.649 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.649 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.649 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.649 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "prometheus", 2024-09-10T23:36:48.649 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.649 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.649 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.649 INFO:teuthology.orchestra.run.smithi003.stdout: "cache": { 2024-09-10T23:36:48.649 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "cache", 2024-09-10T23:36:48.649 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.650 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.650 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.650 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.650 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.650 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.650 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.650 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.650 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.650 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.650 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.650 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.650 INFO:teuthology.orchestra.run.smithi003.stdout: "exclude_perf_counters": { 2024-09-10T23:36:48.650 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "exclude_perf_counters", 2024-09-10T23:36:48.650 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.650 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.651 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.651 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.651 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.651 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.651 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.651 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T23:36:48.651 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T23:36:48.651 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.651 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.651 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.651 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.651 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.651 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.651 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.652 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.652 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.652 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.652 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.652 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.652 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.652 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.652 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.652 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.652 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.652 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.652 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.652 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.652 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.652 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.652 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.653 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.653 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.653 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.653 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.653 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.653 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.653 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.653 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.653 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.653 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.653 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.653 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.653 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.653 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.653 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.654 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.654 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.654 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.654 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.654 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.654 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.654 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.654 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.654 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.654 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.654 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.654 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.654 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.654 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.654 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.654 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.655 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.655 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.655 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.655 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.655 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.655 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.655 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.655 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.655 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.655 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.655 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.655 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.655 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.655 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.656 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.656 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.656 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.656 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.656 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.656 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_stats_pools": { 2024-09-10T23:36:48.656 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rbd_stats_pools", 2024-09-10T23:36:48.656 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.656 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.656 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.656 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.656 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.656 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.656 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.656 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.657 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.657 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.657 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.657 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.657 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T23:36:48.657 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T23:36:48.657 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.657 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.657 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.657 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "300", 2024-09-10T23:36:48.657 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.657 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.657 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.657 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.657 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.657 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.658 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.658 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.658 INFO:teuthology.orchestra.run.smithi003.stdout: "scrape_interval": { 2024-09-10T23:36:48.658 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "scrape_interval", 2024-09-10T23:36:48.658 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-10T23:36:48.658 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.658 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.658 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "15.0", 2024-09-10T23:36:48.658 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.658 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.658 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.658 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.658 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.658 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.659 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.659 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.659 INFO:teuthology.orchestra.run.smithi003.stdout: "server_addr": { 2024-09-10T23:36:48.659 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_addr", 2024-09-10T23:36:48.659 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.659 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.659 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.659 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "::", 2024-09-10T23:36:48.659 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.659 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.659 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.659 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T23:36:48.659 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.659 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.659 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.659 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.660 INFO:teuthology.orchestra.run.smithi003.stdout: "server_port": { 2024-09-10T23:36:48.660 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_port", 2024-09-10T23:36:48.660 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.660 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.660 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.660 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "9283", 2024-09-10T23:36:48.660 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.660 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.660 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.660 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T23:36:48.660 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.660 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.660 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.660 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.660 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.660 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.661 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.661 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.661 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.661 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.661 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.661 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.661 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.661 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.661 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.661 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.661 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.661 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.661 INFO:teuthology.orchestra.run.smithi003.stdout: "stale_cache_strategy": { 2024-09-10T23:36:48.661 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "stale_cache_strategy", 2024-09-10T23:36:48.661 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.661 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.662 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.662 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "log", 2024-09-10T23:36:48.662 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.662 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.662 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.662 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.662 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.662 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.662 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.662 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.662 INFO:teuthology.orchestra.run.smithi003.stdout: "standby_behaviour": { 2024-09-10T23:36:48.662 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "standby_behaviour", 2024-09-10T23:36:48.662 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.662 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.663 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.663 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "default", 2024-09-10T23:36:48.663 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.663 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.663 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.663 INFO:teuthology.orchestra.run.smithi003.stdout: "default", 2024-09-10T23:36:48.663 INFO:teuthology.orchestra.run.smithi003.stdout: "error" 2024-09-10T23:36:48.663 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.663 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.663 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.663 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.663 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.663 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.663 INFO:teuthology.orchestra.run.smithi003.stdout: "standby_error_status_code": { 2024-09-10T23:36:48.663 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "standby_error_status_code", 2024-09-10T23:36:48.664 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.664 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.664 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.664 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "500", 2024-09-10T23:36:48.664 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "400", 2024-09-10T23:36:48.664 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "599", 2024-09-10T23:36:48.664 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.664 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.664 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.664 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.664 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.664 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.664 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.664 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.664 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.665 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rbd_support", 2024-09-10T23:36:48.665 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.665 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.665 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.665 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.665 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.665 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.665 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.665 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.665 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.665 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.666 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.666 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.666 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.666 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.666 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.666 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.666 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.666 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.666 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.666 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.666 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.666 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.666 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.666 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.667 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.667 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.667 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.667 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.667 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.667 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.667 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.667 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.667 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.667 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.667 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.667 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.667 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.667 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.668 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.668 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.668 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.668 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.668 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.668 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.668 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.668 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.668 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.668 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.668 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.668 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.668 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.668 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.668 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.669 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.669 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.669 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.669 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.669 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.669 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.669 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.669 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.669 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.669 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.669 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.669 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.669 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.669 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.669 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.670 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.670 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.670 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.670 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.670 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.670 INFO:teuthology.orchestra.run.smithi003.stdout: "max_concurrent_snap_create": { 2024-09-10T23:36:48.670 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "max_concurrent_snap_create", 2024-09-10T23:36:48.670 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.670 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.670 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.670 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-10T23:36:48.670 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.670 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.670 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.671 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.671 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.671 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.671 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.671 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.671 INFO:teuthology.orchestra.run.smithi003.stdout: "mirror_snapshot_schedule": { 2024-09-10T23:36:48.671 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T23:36:48.671 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.671 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.671 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.671 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.671 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.671 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.671 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.671 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.672 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.672 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.672 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.672 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.672 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.672 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.672 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.672 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.672 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.672 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.672 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.672 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.672 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.672 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.673 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.673 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.673 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.673 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.673 INFO:teuthology.orchestra.run.smithi003.stdout: "trash_purge_schedule": { 2024-09-10T23:36:48.673 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "trash_purge_schedule", 2024-09-10T23:36:48.673 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.673 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.673 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.673 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.673 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.673 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.673 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.673 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.674 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.674 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.674 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.674 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.674 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.674 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.674 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.674 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "restful", 2024-09-10T23:36:48.674 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.674 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.674 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.674 INFO:teuthology.orchestra.run.smithi003.stdout: "enable_auth": { 2024-09-10T23:36:48.674 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "enable_auth", 2024-09-10T23:36:48.674 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.675 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.675 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.675 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.675 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.675 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.675 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.675 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.675 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.675 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.675 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.675 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.675 INFO:teuthology.orchestra.run.smithi003.stdout: "key_file": { 2024-09-10T23:36:48.675 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "key_file", 2024-09-10T23:36:48.675 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.676 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.676 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.676 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.676 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.676 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.676 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.676 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.676 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.676 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.676 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.676 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.676 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.676 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.677 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.677 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.677 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.677 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.677 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.677 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.677 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.677 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.677 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.677 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.677 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.677 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.677 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.678 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.678 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.678 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.678 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.678 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.678 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.678 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.678 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.678 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.678 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.678 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.678 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.678 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.678 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.679 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.679 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.679 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.679 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.679 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.679 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.679 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.679 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.679 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.679 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.679 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.680 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.680 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.680 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.680 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.680 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.680 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.680 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.680 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.680 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.680 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.680 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.680 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.680 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.680 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.680 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.681 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.681 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.681 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.681 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.681 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.681 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.681 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.681 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.681 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.681 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.681 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.681 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.681 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.682 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.682 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.682 INFO:teuthology.orchestra.run.smithi003.stdout: "max_requests": { 2024-09-10T23:36:48.682 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "max_requests", 2024-09-10T23:36:48.682 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.682 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.682 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.682 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "500", 2024-09-10T23:36:48.682 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.682 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.682 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.682 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-10T23:36:48.682 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.683 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.683 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.683 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.683 INFO:teuthology.orchestra.run.smithi003.stdout: "server_addr": { 2024-09-10T23:36:48.683 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_addr", 2024-09-10T23:36:48.683 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.683 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.683 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.683 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.683 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.683 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.683 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.683 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.683 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.684 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.684 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.684 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.684 INFO:teuthology.orchestra.run.smithi003.stdout: "server_port": { 2024-09-10T23:36:48.684 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_port", 2024-09-10T23:36:48.684 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.684 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.684 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.684 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.684 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.684 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.684 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.684 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.684 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.685 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.685 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.685 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.685 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.685 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.685 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.685 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.685 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.685 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.685 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.685 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.685 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.685 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.685 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.686 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.686 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.686 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.686 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.686 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.686 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.686 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rgw", 2024-09-10T23:36:48.686 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.686 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.686 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.686 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.686 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.686 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.687 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.687 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.687 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.687 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.687 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.687 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.687 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.687 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.687 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.687 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.687 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.687 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.687 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.687 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.688 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.688 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.688 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.688 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.688 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.688 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.688 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.688 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.688 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.688 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.688 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.688 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.688 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.689 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.689 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.689 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.689 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.689 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.689 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.689 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.689 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.689 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.689 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.689 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.689 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.689 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.690 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.690 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.690 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.690 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.690 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.690 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.690 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.690 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.690 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.690 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.690 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.690 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.690 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.690 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.691 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.691 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.691 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.691 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.691 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.691 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.691 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.691 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.691 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.691 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.691 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.691 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.691 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.691 INFO:teuthology.orchestra.run.smithi003.stdout: "secondary_zone_period_retry_limit": { 2024-09-10T23:36:48.692 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-10T23:36:48.692 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.692 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.692 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.692 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5", 2024-09-10T23:36:48.692 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.692 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.692 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.692 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-10T23:36:48.692 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.692 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.692 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.692 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.692 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.692 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.693 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.693 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.693 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.693 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.693 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.693 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.693 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.693 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.693 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.693 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.693 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.693 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.693 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.694 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.694 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.694 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rook", 2024-09-10T23:36:48.694 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.694 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.694 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.694 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.694 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.694 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.694 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.694 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.694 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.694 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.694 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.695 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.695 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.695 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.695 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.695 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.695 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.695 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.695 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.695 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.695 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.695 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.695 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.695 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.695 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.696 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.696 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.696 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.696 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.696 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.696 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.696 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.696 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.696 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.696 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.696 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.696 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.697 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.697 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.697 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.697 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.697 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.697 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.697 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.697 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.697 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.697 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.697 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.697 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.697 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.698 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.698 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.698 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.698 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.698 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.698 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.698 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.698 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.698 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.698 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.698 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.698 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.698 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.698 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.699 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.699 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.699 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.699 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.699 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.699 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.699 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.699 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.699 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.699 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.699 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.699 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.700 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.700 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.700 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.700 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.700 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.700 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.700 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.700 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.700 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.700 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.700 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.700 INFO:teuthology.orchestra.run.smithi003.stdout: "storage_class": { 2024-09-10T23:36:48.701 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "storage_class", 2024-09-10T23:36:48.701 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.701 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.701 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.701 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "local", 2024-09-10T23:36:48.701 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.701 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.701 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.701 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T23:36:48.701 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.701 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.701 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.701 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.702 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.702 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.702 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.702 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "selftest", 2024-09-10T23:36:48.702 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.702 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.702 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.702 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.702 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.702 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.702 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.702 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.702 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.702 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.702 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.702 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.703 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.703 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.703 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.703 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.703 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.703 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.703 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.703 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.703 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.703 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.703 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.703 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.703 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.703 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.703 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.704 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.704 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.704 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.704 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.704 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.704 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.704 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.704 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.704 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.704 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.704 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.704 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.704 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.705 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.705 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.705 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.705 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.705 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.705 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.705 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.705 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.705 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.705 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.705 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.705 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.705 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.705 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.705 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.706 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.706 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.706 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.706 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.706 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.706 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.706 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.706 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.706 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.706 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.706 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.706 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.706 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.706 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.706 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.707 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.707 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.707 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.707 INFO:teuthology.orchestra.run.smithi003.stdout: "roption1": { 2024-09-10T23:36:48.707 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "roption1", 2024-09-10T23:36:48.707 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.707 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.707 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.707 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.707 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.707 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.707 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.707 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.707 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.707 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.708 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.708 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.708 INFO:teuthology.orchestra.run.smithi003.stdout: "roption2": { 2024-09-10T23:36:48.708 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "roption2", 2024-09-10T23:36:48.708 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.708 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.708 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.708 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "xyz", 2024-09-10T23:36:48.708 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.708 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.708 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.708 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.708 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.708 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.709 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.709 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.709 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption1": { 2024-09-10T23:36:48.709 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption1", 2024-09-10T23:36:48.709 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.709 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.709 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.709 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.709 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.709 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.709 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.709 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.709 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.710 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.710 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.710 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.710 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption2": { 2024-09-10T23:36:48.710 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption2", 2024-09-10T23:36:48.710 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.710 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.710 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.710 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.710 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.710 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.710 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.710 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.711 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.711 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.711 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.711 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.711 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption3": { 2024-09-10T23:36:48.711 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption3", 2024-09-10T23:36:48.711 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-10T23:36:48.711 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.711 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.711 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.711 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.711 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.711 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.711 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.711 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.712 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.712 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.712 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.712 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption4": { 2024-09-10T23:36:48.712 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption4", 2024-09-10T23:36:48.712 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.712 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.712 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.712 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.712 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.712 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.712 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.713 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.713 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.713 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.713 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.713 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.713 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption5": { 2024-09-10T23:36:48.713 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption5", 2024-09-10T23:36:48.713 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.713 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.713 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.713 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.713 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.713 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.713 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.713 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.714 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.714 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.714 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.714 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.714 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption6": { 2024-09-10T23:36:48.714 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption6", 2024-09-10T23:36:48.714 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.714 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.714 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.714 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.714 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.714 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.714 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.714 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.714 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.715 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.715 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.715 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.715 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption7": { 2024-09-10T23:36:48.715 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption7", 2024-09-10T23:36:48.715 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.715 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.715 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.715 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.715 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "1", 2024-09-10T23:36:48.715 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "42", 2024-09-10T23:36:48.715 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.715 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.715 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.715 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.715 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.716 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.716 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.716 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.716 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.716 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.716 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.716 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.716 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.716 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.716 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.716 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.716 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.716 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.717 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.717 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.717 INFO:teuthology.orchestra.run.smithi003.stdout: "testkey": { 2024-09-10T23:36:48.717 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "testkey", 2024-09-10T23:36:48.717 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.717 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.717 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.717 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.717 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.717 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.717 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.717 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.717 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.718 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.718 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.718 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.718 INFO:teuthology.orchestra.run.smithi003.stdout: "testlkey": { 2024-09-10T23:36:48.718 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "testlkey", 2024-09-10T23:36:48.718 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.718 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.718 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.718 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.718 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.718 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.718 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.718 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.718 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.718 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.718 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.719 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.719 INFO:teuthology.orchestra.run.smithi003.stdout: "testnewline": { 2024-09-10T23:36:48.719 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "testnewline", 2024-09-10T23:36:48.719 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.719 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.719 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.719 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.719 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.719 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.719 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.719 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.719 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.719 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.719 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.720 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.720 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.720 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.720 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.720 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smb", 2024-09-10T23:36:48.720 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.720 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.720 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.720 INFO:teuthology.orchestra.run.smithi003.stdout: "internal_store_backend": { 2024-09-10T23:36:48.720 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "internal_store_backend", 2024-09-10T23:36:48.720 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.720 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.721 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.721 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.721 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.721 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.721 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.721 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-10T23:36:48.721 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.721 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.721 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.721 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.721 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.721 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.721 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.721 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.722 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.722 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.722 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.722 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.722 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.722 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.722 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.722 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.722 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.722 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.722 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.722 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.722 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.722 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.723 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.723 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.723 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.723 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.723 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.723 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.723 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.723 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.723 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.723 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.723 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.723 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.723 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.723 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.724 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.724 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.724 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.724 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.724 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.724 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.724 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.724 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.724 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.724 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.724 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.724 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.724 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.724 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.725 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.725 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.725 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.725 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.725 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.725 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.725 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.725 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.725 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.725 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.725 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.725 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.725 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.726 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.726 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.726 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.726 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.726 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.726 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.726 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.726 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.726 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.726 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.726 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.726 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.726 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.726 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.727 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.727 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.727 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.727 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.727 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.727 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.727 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.727 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.727 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.727 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.727 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.727 INFO:teuthology.orchestra.run.smithi003.stdout: "update_orchestration": { 2024-09-10T23:36:48.727 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "update_orchestration", 2024-09-10T23:36:48.728 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.728 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.728 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.728 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.728 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.728 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.728 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.728 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-10T23:36:48.728 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.728 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.728 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.728 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.728 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.729 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.729 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.729 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "snap_schedule", 2024-09-10T23:36:48.729 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.729 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.729 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.729 INFO:teuthology.orchestra.run.smithi003.stdout: "allow_m_granularity": { 2024-09-10T23:36:48.729 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "allow_m_granularity", 2024-09-10T23:36:48.729 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.729 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.729 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.729 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.729 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.729 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.730 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.730 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T23:36:48.730 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.730 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.730 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.730 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.730 INFO:teuthology.orchestra.run.smithi003.stdout: "dump_on_update": { 2024-09-10T23:36:48.730 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "dump_on_update", 2024-09-10T23:36:48.730 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.730 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.730 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.730 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.730 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.730 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.731 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.731 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "dump database to debug log on update", 2024-09-10T23:36:48.731 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.731 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.731 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.731 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.731 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.731 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.731 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.731 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.731 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.731 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.731 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.732 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.732 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.732 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.732 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.732 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.732 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.732 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.732 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.732 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.732 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.732 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.732 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.732 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.732 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.733 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.733 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.733 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.733 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.733 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.733 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.733 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.733 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.733 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.733 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.733 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.733 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.733 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.733 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.734 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.734 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.734 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.734 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.734 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.734 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.734 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.734 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.734 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.734 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.734 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.734 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.734 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.734 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.734 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.735 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.735 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.735 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.735 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.735 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.735 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.735 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.735 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.735 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.735 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.735 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.735 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.735 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.736 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.736 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.736 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.736 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.736 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.736 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.736 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.736 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.736 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.736 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.736 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.736 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.736 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.737 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.737 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.737 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.737 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.737 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.737 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.737 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.737 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.737 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.737 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.737 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.737 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "stats", 2024-09-10T23:36:48.737 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.738 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.738 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.738 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.738 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.738 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.738 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.738 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.738 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.738 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.738 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.738 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.738 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.738 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.738 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.739 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.739 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.739 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.739 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.739 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.739 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.739 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.739 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.739 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.739 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.739 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.739 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.739 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.739 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.739 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.740 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.740 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.740 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.740 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.740 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.740 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.740 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.740 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.740 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.740 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.740 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.740 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.740 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.740 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.740 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.741 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.741 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.741 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.741 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.741 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.741 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.741 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.741 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.741 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.741 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.741 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.741 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.741 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.741 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.742 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.742 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.742 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.742 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.742 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.742 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.742 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.742 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.742 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.742 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.742 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.742 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.742 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.743 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.743 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.743 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.743 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.743 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.743 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.743 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.743 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.743 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.743 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.743 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.743 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.743 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.743 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.744 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.744 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.744 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.744 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.744 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "status", 2024-09-10T23:36:48.744 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.744 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.744 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.744 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.744 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.744 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.744 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.744 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.744 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.744 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.745 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.745 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.745 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.745 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.745 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.745 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.745 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.745 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.745 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.745 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.745 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.745 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.745 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.745 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.746 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.746 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.746 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.746 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.746 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.746 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.746 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.746 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.746 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.746 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.746 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.746 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.746 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.747 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.747 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.747 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.747 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.747 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.747 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.747 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.747 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.747 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.747 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.747 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.747 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.747 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.747 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.747 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.747 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.748 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.748 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.748 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.748 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.748 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.748 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.748 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.748 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.748 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.748 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.748 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.748 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.748 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.748 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.748 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.749 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.749 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.749 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.749 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.749 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.749 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.749 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.749 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.749 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.749 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.749 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.749 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.749 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.749 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.750 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.750 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.750 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.750 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.750 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.750 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.750 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.750 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.750 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "telegraf", 2024-09-10T23:36:48.750 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.750 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.750 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.750 INFO:teuthology.orchestra.run.smithi003.stdout: "address": { 2024-09-10T23:36:48.750 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "address", 2024-09-10T23:36:48.750 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.751 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.751 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.751 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T23:36:48.751 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.751 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.751 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.751 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.751 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.751 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.751 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.751 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.751 INFO:teuthology.orchestra.run.smithi003.stdout: "interval": { 2024-09-10T23:36:48.751 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "interval", 2024-09-10T23:36:48.752 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:48.752 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.752 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.752 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "15", 2024-09-10T23:36:48.752 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.752 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.752 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.752 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.752 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.752 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.752 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.752 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.752 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.752 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.753 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.753 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.753 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.753 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.753 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.753 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.753 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.753 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.753 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.753 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.753 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.753 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.753 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.753 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.754 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.754 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.754 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.754 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.754 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.754 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.754 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.754 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.754 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.754 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.754 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.754 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.755 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.755 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.755 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.755 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.755 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.755 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.755 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.755 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.755 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.755 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.755 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.755 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.755 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.756 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.756 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.756 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.756 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.756 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.756 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.756 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.756 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.756 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.756 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.756 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.756 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.756 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.756 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.757 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.757 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.757 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.757 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.757 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.757 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.757 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.757 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.757 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.757 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.757 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.757 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.757 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.758 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.758 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.758 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.758 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.758 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.758 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.758 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.758 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.758 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.758 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.758 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.758 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.758 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.758 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.759 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.759 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.759 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.759 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.759 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.759 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "telemetry", 2024-09-10T23:36:48.759 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.759 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.759 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.759 INFO:teuthology.orchestra.run.smithi003.stdout: "channel_basic": { 2024-09-10T23:36:48.759 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "channel_basic", 2024-09-10T23:36:48.759 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.759 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.759 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.760 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.760 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.760 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.760 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.760 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T23:36:48.760 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.760 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.760 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.760 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.760 INFO:teuthology.orchestra.run.smithi003.stdout: "channel_crash": { 2024-09-10T23:36:48.760 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "channel_crash", 2024-09-10T23:36:48.760 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.760 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.760 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.761 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.761 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.761 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.761 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.761 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T23:36:48.761 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.761 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.761 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.761 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.761 INFO:teuthology.orchestra.run.smithi003.stdout: "channel_device": { 2024-09-10T23:36:48.761 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "channel_device", 2024-09-10T23:36:48.761 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.761 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.761 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.762 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.762 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.762 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.762 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.762 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T23:36:48.762 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.762 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.762 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.762 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.762 INFO:teuthology.orchestra.run.smithi003.stdout: "channel_ident": { 2024-09-10T23:36:48.762 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "channel_ident", 2024-09-10T23:36:48.762 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.762 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.762 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.763 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.763 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.763 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.763 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.763 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T23:36:48.763 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.763 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.763 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.763 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.763 INFO:teuthology.orchestra.run.smithi003.stdout: "channel_perf": { 2024-09-10T23:36:48.763 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "channel_perf", 2024-09-10T23:36:48.763 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.763 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.763 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.763 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.764 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.764 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.764 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.764 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T23:36:48.764 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.764 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.764 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.764 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.764 INFO:teuthology.orchestra.run.smithi003.stdout: "contact": { 2024-09-10T23:36:48.764 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "contact", 2024-09-10T23:36:48.764 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.764 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.764 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.764 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.765 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.765 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.765 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.765 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.765 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.765 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.765 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.765 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.765 INFO:teuthology.orchestra.run.smithi003.stdout: "description": { 2024-09-10T23:36:48.765 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "description", 2024-09-10T23:36:48.765 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.765 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.765 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.766 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.766 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.766 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.766 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.766 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.766 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.766 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.766 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.766 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.766 INFO:teuthology.orchestra.run.smithi003.stdout: "device_url": { 2024-09-10T23:36:48.766 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "device_url", 2024-09-10T23:36:48.766 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.766 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.766 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.767 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T23:36:48.767 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.767 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.767 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.767 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.767 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.767 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.767 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.767 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.767 INFO:teuthology.orchestra.run.smithi003.stdout: "enabled": { 2024-09-10T23:36:48.767 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "enabled", 2024-09-10T23:36:48.767 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.767 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.767 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.768 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.768 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.768 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.768 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.768 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.768 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.768 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.768 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.768 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.768 INFO:teuthology.orchestra.run.smithi003.stdout: "interval": { 2024-09-10T23:36:48.768 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "interval", 2024-09-10T23:36:48.768 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.768 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.769 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.769 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "24", 2024-09-10T23:36:48.769 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "8", 2024-09-10T23:36:48.769 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.769 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.769 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.769 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.769 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.769 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.769 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.769 INFO:teuthology.orchestra.run.smithi003.stdout: "last_opt_revision": { 2024-09-10T23:36:48.769 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "last_opt_revision", 2024-09-10T23:36:48.769 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.769 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.770 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.770 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "1", 2024-09-10T23:36:48.770 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.770 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.770 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.770 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.770 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.770 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.770 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.770 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.770 INFO:teuthology.orchestra.run.smithi003.stdout: "leaderboard": { 2024-09-10T23:36:48.770 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "leaderboard", 2024-09-10T23:36:48.771 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.771 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.771 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.771 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.771 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.771 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.771 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.771 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.771 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.771 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.771 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.771 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.771 INFO:teuthology.orchestra.run.smithi003.stdout: "leaderboard_description": { 2024-09-10T23:36:48.771 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "leaderboard_description", 2024-09-10T23:36:48.772 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.772 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.772 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.772 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.772 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.772 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.772 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.772 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.772 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.772 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.772 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.772 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.772 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.772 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.773 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.773 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.773 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.773 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.773 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.773 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.773 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.773 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.773 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.773 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.773 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.773 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.773 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.773 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.774 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.774 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.774 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.774 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.774 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.774 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.774 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.774 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.774 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.774 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.774 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.774 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.774 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.774 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.774 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.775 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.775 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.775 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.775 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.775 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.775 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.775 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.775 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.775 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.775 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.775 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.775 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.775 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.776 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.776 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.776 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.776 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.776 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.776 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.776 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.776 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.776 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.776 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.776 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.776 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.777 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.777 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.777 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.777 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.777 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.777 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.777 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.777 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.777 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.777 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.777 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.777 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.777 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.777 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.778 INFO:teuthology.orchestra.run.smithi003.stdout: "organization": { 2024-09-10T23:36:48.778 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "organization", 2024-09-10T23:36:48.778 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.778 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.778 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.778 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.778 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.778 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.778 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.778 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.778 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.778 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.778 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.779 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.779 INFO:teuthology.orchestra.run.smithi003.stdout: "proxy": { 2024-09-10T23:36:48.779 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "proxy", 2024-09-10T23:36:48.779 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.779 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.779 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.779 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.779 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.779 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.779 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.779 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.779 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.779 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.779 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.780 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.780 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.780 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.780 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.780 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.780 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.780 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.780 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.780 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.780 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.780 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.780 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.780 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.780 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.781 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.781 INFO:teuthology.orchestra.run.smithi003.stdout: "url": { 2024-09-10T23:36:48.781 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "url", 2024-09-10T23:36:48.781 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.781 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.781 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.781 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T23:36:48.781 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.781 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.781 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.781 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.781 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.781 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.782 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.782 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.782 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.782 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.782 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.782 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "test_orchestrator", 2024-09-10T23:36:48.782 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.782 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.782 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.782 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.782 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.782 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.782 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.782 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.782 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.783 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.783 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.783 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.783 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.783 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.783 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.783 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.783 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.783 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.783 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.783 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.783 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.783 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.783 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.783 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.784 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.784 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.784 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.784 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.784 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.784 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.784 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.784 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.784 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.784 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.784 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.784 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.784 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.784 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.784 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.785 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.785 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.785 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.785 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.785 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.785 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.785 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.785 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.785 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.785 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.785 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.785 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.785 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.786 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.786 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.786 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.786 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.786 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.786 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.786 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.786 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.786 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.786 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.786 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.786 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.786 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.786 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.786 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.787 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.787 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.787 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.787 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.787 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.787 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.787 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.787 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.787 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.787 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.787 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.787 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.787 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.787 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.788 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.788 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.788 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.788 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.788 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.788 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.788 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.788 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.788 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.788 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "volumes", 2024-09-10T23:36:48.788 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.788 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.788 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.788 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.789 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.789 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.789 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.789 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.789 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.789 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.789 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.789 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.789 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.789 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.789 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.789 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.789 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.790 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.790 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.790 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.790 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.790 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.790 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.790 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.790 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.790 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.790 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.790 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.790 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.790 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.790 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.791 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.791 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.791 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.791 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.791 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.791 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.791 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.791 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.791 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.791 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.791 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.791 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.791 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.791 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.792 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.792 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.792 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.792 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.792 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.792 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.792 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.792 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.792 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.792 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.792 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.792 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.792 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.792 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.793 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.793 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.793 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.793 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.793 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.793 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.793 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.793 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.793 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.793 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.793 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.793 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.793 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.793 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.794 INFO:teuthology.orchestra.run.smithi003.stdout: "max_concurrent_clones": { 2024-09-10T23:36:48.794 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "max_concurrent_clones", 2024-09-10T23:36:48.794 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.794 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.794 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.794 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "4", 2024-09-10T23:36:48.794 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.794 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.794 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.794 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T23:36:48.794 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.794 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.794 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.794 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.795 INFO:teuthology.orchestra.run.smithi003.stdout: "periodic_async_work": { 2024-09-10T23:36:48.795 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "periodic_async_work", 2024-09-10T23:36:48.795 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.795 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.795 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.795 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.795 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.795 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.795 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.795 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Periodically check for async work", 2024-09-10T23:36:48.795 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.795 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.795 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.795 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.796 INFO:teuthology.orchestra.run.smithi003.stdout: "snapshot_clone_delay": { 2024-09-10T23:36:48.796 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "snapshot_clone_delay", 2024-09-10T23:36:48.796 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.796 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.796 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.796 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.796 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.796 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.796 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.796 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T23:36:48.796 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.796 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.796 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.796 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.797 INFO:teuthology.orchestra.run.smithi003.stdout: "snapshot_clone_no_wait": { 2024-09-10T23:36:48.797 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T23:36:48.797 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.797 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.797 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.797 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-10T23:36:48.797 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.797 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.797 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.797 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T23:36:48.797 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.797 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.797 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.797 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.797 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.798 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.798 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.798 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.798 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.798 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.798 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.798 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.798 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.798 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.798 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.798 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.798 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.798 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.798 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.799 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.799 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.799 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "zabbix", 2024-09-10T23:36:48.799 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-10T23:36:48.799 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-10T23:36:48.799 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-10T23:36:48.799 INFO:teuthology.orchestra.run.smithi003.stdout: "discovery_interval": { 2024-09-10T23:36:48.799 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "discovery_interval", 2024-09-10T23:36:48.799 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "uint", 2024-09-10T23:36:48.799 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.799 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.799 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "100", 2024-09-10T23:36:48.799 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.799 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.799 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.800 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.800 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.800 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.800 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.800 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.800 INFO:teuthology.orchestra.run.smithi003.stdout: "identifier": { 2024-09-10T23:36:48.800 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "identifier", 2024-09-10T23:36:48.800 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.800 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.800 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.800 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.800 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.800 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.800 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.801 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.801 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.801 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.801 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.801 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.801 INFO:teuthology.orchestra.run.smithi003.stdout: "interval": { 2024-09-10T23:36:48.801 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "interval", 2024-09-10T23:36:48.801 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-10T23:36:48.801 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.801 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.801 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "60", 2024-09-10T23:36:48.801 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.801 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.801 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.802 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.802 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.802 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.802 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.802 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.802 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-10T23:36:48.802 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-10T23:36:48.802 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.802 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.802 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.802 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.802 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.802 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.802 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.803 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.803 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.803 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.803 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.803 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.803 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.803 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.803 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.803 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.803 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.803 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.803 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.803 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-10T23:36:48.803 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-10T23:36:48.804 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.804 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.804 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.804 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.804 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.804 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.804 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.804 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.804 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.804 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.804 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.804 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.804 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-10T23:36:48.805 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-10T23:36:48.805 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.805 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.805 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.805 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-10T23:36:48.805 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.805 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.805 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-10T23:36:48.805 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-10T23:36:48.805 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-10T23:36:48.805 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-10T23:36:48.805 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-10T23:36:48.805 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-10T23:36:48.806 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-10T23:36:48.806 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.806 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.806 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.806 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.806 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.806 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.806 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-10T23:36:48.806 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-10T23:36:48.806 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-10T23:36:48.806 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.806 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.806 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-10T23:36:48.806 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.807 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.807 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.807 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.807 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.807 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.807 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.807 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.807 INFO:teuthology.orchestra.run.smithi003.stdout: "sqlite3_killpoint": { 2024-09-10T23:36:48.807 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:36:48.807 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.807 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "dev", 2024-09-10T23:36:48.807 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-10T23:36:48.807 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-10T23:36:48.807 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.808 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.808 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.808 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.808 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.808 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.808 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.808 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.808 INFO:teuthology.orchestra.run.smithi003.stdout: "zabbix_host": { 2024-09-10T23:36:48.808 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "zabbix_host", 2024-09-10T23:36:48.808 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.808 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.808 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.808 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-10T23:36:48.809 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.809 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.809 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.809 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.809 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.809 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.809 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.809 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.809 INFO:teuthology.orchestra.run.smithi003.stdout: "zabbix_port": { 2024-09-10T23:36:48.809 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "zabbix_port", 2024-09-10T23:36:48.809 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-10T23:36:48.809 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.809 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.809 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10051", 2024-09-10T23:36:48.810 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.810 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.810 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.810 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.810 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.810 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.810 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.810 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.810 INFO:teuthology.orchestra.run.smithi003.stdout: "zabbix_sender": { 2024-09-10T23:36:48.810 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "zabbix_sender", 2024-09-10T23:36:48.810 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-10T23:36:48.810 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-10T23:36:48.810 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-10T23:36:48.811 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T23:36:48.811 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-10T23:36:48.811 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-10T23:36:48.811 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-10T23:36:48.811 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-10T23:36:48.811 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-10T23:36:48.811 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-10T23:36:48.811 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-10T23:36:48.811 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.811 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.811 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.811 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.811 INFO:teuthology.orchestra.run.smithi003.stdout: "services": { 2024-09-10T23:36:48.812 INFO:teuthology.orchestra.run.smithi003.stdout: "dashboard": "https://172.21.15.3:8443/" 2024-09-10T23:36:48.812 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.812 INFO:teuthology.orchestra.run.smithi003.stdout: "always_on_modules": { 2024-09-10T23:36:48.812 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus": [ 2024-09-10T23:36:48.812 INFO:teuthology.orchestra.run.smithi003.stdout: "balancer", 2024-09-10T23:36:48.812 INFO:teuthology.orchestra.run.smithi003.stdout: "crash", 2024-09-10T23:36:48.812 INFO:teuthology.orchestra.run.smithi003.stdout: "devicehealth", 2024-09-10T23:36:48.812 INFO:teuthology.orchestra.run.smithi003.stdout: "orchestrator", 2024-09-10T23:36:48.812 INFO:teuthology.orchestra.run.smithi003.stdout: "pg_autoscaler", 2024-09-10T23:36:48.812 INFO:teuthology.orchestra.run.smithi003.stdout: "progress", 2024-09-10T23:36:48.812 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_support", 2024-09-10T23:36:48.812 INFO:teuthology.orchestra.run.smithi003.stdout: "status", 2024-09-10T23:36:48.812 INFO:teuthology.orchestra.run.smithi003.stdout: "telemetry", 2024-09-10T23:36:48.812 INFO:teuthology.orchestra.run.smithi003.stdout: "volumes" 2024-09-10T23:36:48.812 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.813 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific": [ 2024-09-10T23:36:48.813 INFO:teuthology.orchestra.run.smithi003.stdout: "balancer", 2024-09-10T23:36:48.813 INFO:teuthology.orchestra.run.smithi003.stdout: "crash", 2024-09-10T23:36:48.813 INFO:teuthology.orchestra.run.smithi003.stdout: "devicehealth", 2024-09-10T23:36:48.813 INFO:teuthology.orchestra.run.smithi003.stdout: "orchestrator", 2024-09-10T23:36:48.813 INFO:teuthology.orchestra.run.smithi003.stdout: "pg_autoscaler", 2024-09-10T23:36:48.813 INFO:teuthology.orchestra.run.smithi003.stdout: "progress", 2024-09-10T23:36:48.813 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_support", 2024-09-10T23:36:48.813 INFO:teuthology.orchestra.run.smithi003.stdout: "status", 2024-09-10T23:36:48.813 INFO:teuthology.orchestra.run.smithi003.stdout: "telemetry", 2024-09-10T23:36:48.813 INFO:teuthology.orchestra.run.smithi003.stdout: "volumes" 2024-09-10T23:36:48.813 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.813 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy": [ 2024-09-10T23:36:48.813 INFO:teuthology.orchestra.run.smithi003.stdout: "balancer", 2024-09-10T23:36:48.814 INFO:teuthology.orchestra.run.smithi003.stdout: "crash", 2024-09-10T23:36:48.814 INFO:teuthology.orchestra.run.smithi003.stdout: "devicehealth", 2024-09-10T23:36:48.814 INFO:teuthology.orchestra.run.smithi003.stdout: "orchestrator", 2024-09-10T23:36:48.814 INFO:teuthology.orchestra.run.smithi003.stdout: "pg_autoscaler", 2024-09-10T23:36:48.814 INFO:teuthology.orchestra.run.smithi003.stdout: "progress", 2024-09-10T23:36:48.814 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_support", 2024-09-10T23:36:48.814 INFO:teuthology.orchestra.run.smithi003.stdout: "status", 2024-09-10T23:36:48.814 INFO:teuthology.orchestra.run.smithi003.stdout: "telemetry", 2024-09-10T23:36:48.814 INFO:teuthology.orchestra.run.smithi003.stdout: "volumes" 2024-09-10T23:36:48.814 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.814 INFO:teuthology.orchestra.run.smithi003.stdout: "reef": [ 2024-09-10T23:36:48.814 INFO:teuthology.orchestra.run.smithi003.stdout: "balancer", 2024-09-10T23:36:48.814 INFO:teuthology.orchestra.run.smithi003.stdout: "crash", 2024-09-10T23:36:48.814 INFO:teuthology.orchestra.run.smithi003.stdout: "devicehealth", 2024-09-10T23:36:48.815 INFO:teuthology.orchestra.run.smithi003.stdout: "orchestrator", 2024-09-10T23:36:48.815 INFO:teuthology.orchestra.run.smithi003.stdout: "pg_autoscaler", 2024-09-10T23:36:48.815 INFO:teuthology.orchestra.run.smithi003.stdout: "progress", 2024-09-10T23:36:48.815 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_support", 2024-09-10T23:36:48.815 INFO:teuthology.orchestra.run.smithi003.stdout: "status", 2024-09-10T23:36:48.815 INFO:teuthology.orchestra.run.smithi003.stdout: "telemetry", 2024-09-10T23:36:48.815 INFO:teuthology.orchestra.run.smithi003.stdout: "volumes" 2024-09-10T23:36:48.815 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-10T23:36:48.815 INFO:teuthology.orchestra.run.smithi003.stdout: "squid": [ 2024-09-10T23:36:48.815 INFO:teuthology.orchestra.run.smithi003.stdout: "balancer", 2024-09-10T23:36:48.815 INFO:teuthology.orchestra.run.smithi003.stdout: "crash", 2024-09-10T23:36:48.815 INFO:teuthology.orchestra.run.smithi003.stdout: "devicehealth", 2024-09-10T23:36:48.815 INFO:teuthology.orchestra.run.smithi003.stdout: "orchestrator", 2024-09-10T23:36:48.815 INFO:teuthology.orchestra.run.smithi003.stdout: "pg_autoscaler", 2024-09-10T23:36:48.816 INFO:teuthology.orchestra.run.smithi003.stdout: "progress", 2024-09-10T23:36:48.816 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_support", 2024-09-10T23:36:48.816 INFO:teuthology.orchestra.run.smithi003.stdout: "status", 2024-09-10T23:36:48.816 INFO:teuthology.orchestra.run.smithi003.stdout: "telemetry", 2024-09-10T23:36:48.816 INFO:teuthology.orchestra.run.smithi003.stdout: "volumes" 2024-09-10T23:36:48.816 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-10T23:36:48.816 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.816 INFO:teuthology.orchestra.run.smithi003.stdout: "force_disabled_modules": {}, 2024-09-10T23:36:48.816 INFO:teuthology.orchestra.run.smithi003.stdout: "last_failure_osd_epoch": 5, 2024-09-10T23:36:48.816 INFO:teuthology.orchestra.run.smithi003.stdout: "active_clients": [ 2024-09-10T23:36:48.816 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.816 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "devicehealth", 2024-09-10T23:36:48.816 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2024-09-10T23:36:48.816 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.817 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v2", 2024-09-10T23:36:48.817 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:0", 2024-09-10T23:36:48.817 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 1305006808 2024-09-10T23:36:48.817 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.817 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-10T23:36:48.817 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.817 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.817 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "libcephsqlite", 2024-09-10T23:36:48.817 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2024-09-10T23:36:48.817 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.817 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v2", 2024-09-10T23:36:48.817 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:0", 2024-09-10T23:36:48.817 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 3264842241 2024-09-10T23:36:48.818 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.818 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-10T23:36:48.818 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.818 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.818 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rbd_support", 2024-09-10T23:36:48.818 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2024-09-10T23:36:48.818 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.818 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v2", 2024-09-10T23:36:48.818 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:0", 2024-09-10T23:36:48.818 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 1980111985 2024-09-10T23:36:48.818 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.818 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-10T23:36:48.818 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.818 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.819 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "snap_schedule", 2024-09-10T23:36:48.819 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2024-09-10T23:36:48.819 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.819 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v2", 2024-09-10T23:36:48.819 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:0", 2024-09-10T23:36:48.819 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 3417340163 2024-09-10T23:36:48.819 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.819 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-10T23:36:48.819 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.819 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.819 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "snap_schedule", 2024-09-10T23:36:48.819 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2024-09-10T23:36:48.819 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.819 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v2", 2024-09-10T23:36:48.820 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:0", 2024-09-10T23:36:48.820 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 811154778 2024-09-10T23:36:48.820 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.820 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-10T23:36:48.820 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:48.820 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.820 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "volumes", 2024-09-10T23:36:48.820 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2024-09-10T23:36:48.820 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-10T23:36:48.820 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v2", 2024-09-10T23:36:48.820 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:0", 2024-09-10T23:36:48.820 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 1517971559 2024-09-10T23:36:48.820 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.821 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-10T23:36:48.821 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:48.821 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-10T23:36:48.821 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-10T23:36:48.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.334+0000 7f9c15400640 1 -- 172.21.15.3:0/3047441306 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f9bf40b54d0 msgr2=0x7f9bf40b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:48.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.334+0000 7f9c15400640 1 --2- 172.21.15.3:0/3047441306 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f9bf40b54d0 0x7f9bf40b7990 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9c00005e10 tx=0x7f9c00005da0 comp rx=0 tx=0).stop 2024-09-10T23:36:48.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.334+0000 7f9c15400640 1 -- 172.21.15.3:0/3047441306 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c1010b2b0 msgr2=0x7f9c101a0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:48.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.334+0000 7f9c15400640 1 --2- 172.21.15.3:0/3047441306 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c1010b2b0 0x7f9c101a0af0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9c08031040 tx=0x7f9c08003f80 comp rx=0 tx=0).stop 2024-09-10T23:36:48.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.334+0000 7f9c15400640 1 -- 172.21.15.3:0/3047441306 shutdown_connections 2024-09-10T23:36:48.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.334+0000 7f9c15400640 1 --2- 172.21.15.3:0/3047441306 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f9bf40b54d0 0x7f9bf40b7990 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:48.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.334+0000 7f9c15400640 1 --2- 172.21.15.3:0/3047441306 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c1010b2b0 0x7f9c101a0af0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:48.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.334+0000 7f9c15400640 1 --2- 172.21.15.3:0/3047441306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c1010a930 0x7f9c1019b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:48.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.334+0000 7f9c15400640 1 --2- 172.21.15.3:0/3047441306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9c10104f30 0x7f9c1019b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:48.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.334+0000 7f9c15400640 1 -- 172.21.15.3:0/3047441306 >> 172.21.15.3:0/3047441306 conn(0x7f9c10100910 msgr2=0x7f9c101010c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:48.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.335+0000 7f9c15400640 1 -- 172.21.15.3:0/3047441306 shutdown_connections 2024-09-10T23:36:48.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:36:47.335+0000 7f9c15400640 1 -- 172.21.15.3:0/3047441306 wait complete. 2024-09-10T23:36:48.831 DEBUG:tasks.check_counter:Getting stats from a 2024-09-10T23:36:48.831 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-10T23:36:48.832 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:47 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1467059493' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T23:36:48.832 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:47 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2561301308' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-10T23:36:48.832 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:47 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3047441306' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-10T23:36:48.832 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:48 smithi003 ceph-mon[30348]: pgmap v699: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:36:48.833 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:47 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/1467059493' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T23:36:48.833 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:47 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2561301308' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-10T23:36:48.833 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:47 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3047441306' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-10T23:36:48.833 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:47 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/1467059493' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T23:36:48.833 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:47 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2561301308' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-10T23:36:48.833 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:47 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3047441306' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-10T23:36:48.834 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:48 smithi194 ceph-mon[33904]: pgmap v699: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:36:48.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:48 smithi038 ceph-mon[34225]: pgmap v699: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:36:49.225 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:36:49.823 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-10T23:36:49.823 INFO:teuthology.orchestra.run.smithi003.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:36:49.824 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_messages": 0, 2024-09-10T23:36:49.824 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages": 2, 2024-09-10T23:36:49.824 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_bytes": 0, 2024-09-10T23:36:49.824 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_bytes": 0, 2024-09-10T23:36:49.824 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_created_connections": 4, 2024-09-10T23:36:49.824 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_active_connections": 0, 2024-09-10T23:36:49.824 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_total_time": 0.003491457, 2024-09-10T23:36:49.824 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T23:36:49.824 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_recv_time": 0.000314352, 2024-09-10T23:36:49.824 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:36:49.824 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:49.824 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-10T23:36:49.824 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-10T23:36:49.825 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-10T23:36:49.825 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:49.825 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:49.825 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-10T23:36:49.825 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-10T23:36:49.825 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-10T23:36:49.825 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:49.825 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T23:36:49.825 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T23:36:49.825 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:49.825 INFO:teuthology.orchestra.run.smithi003.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:36:49.825 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_messages": 2, 2024-09-10T23:36:49.825 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages": 163, 2024-09-10T23:36:49.826 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_bytes": 320, 2024-09-10T23:36:49.826 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_bytes": 189344, 2024-09-10T23:36:49.826 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_created_connections": 4, 2024-09-10T23:36:49.826 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_active_connections": 2, 2024-09-10T23:36:49.826 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_total_time": 0.024350832, 2024-09-10T23:36:49.826 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_send_time": 0.019352308, 2024-09-10T23:36:49.826 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_recv_time": 0.002306775, 2024-09-10T23:36:49.826 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:36:49.826 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:49.826 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 160, 2024-09-10T23:36:49.826 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.015980308, 2024-09-10T23:36:49.826 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000099876 2024-09-10T23:36:49.826 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:49.826 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:49.827 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-10T23:36:49.827 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-10T23:36:49.827 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-10T23:36:49.827 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:49.827 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-10T23:36:49.827 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_encrypted_bytes": 189344 2024-09-10T23:36:49.827 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:49.827 INFO:teuthology.orchestra.run.smithi003.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:36:49.827 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_messages": 222, 2024-09-10T23:36:49.827 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages": 213, 2024-09-10T23:36:49.827 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_bytes": 1140176, 2024-09-10T23:36:49.827 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_bytes": 130272, 2024-09-10T23:36:49.827 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_created_connections": 2, 2024-09-10T23:36:49.827 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_active_connections": 1, 2024-09-10T23:36:49.828 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_total_time": 0.055766143, 2024-09-10T23:36:49.828 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_send_time": 0.025119927, 2024-09-10T23:36:49.828 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_recv_time": 0.042898460, 2024-09-10T23:36:49.828 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:36:49.828 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:49.828 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 213, 2024-09-10T23:36:49.828 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.024492344, 2024-09-10T23:36:49.828 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000114987 2024-09-10T23:36:49.828 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:49.828 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:49.828 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-10T23:36:49.828 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-10T23:36:49.828 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-10T23:36:49.828 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:49.829 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_encrypted_bytes": 1140176, 2024-09-10T23:36:49.829 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_encrypted_bytes": 130272 2024-09-10T23:36:49.829 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:49.829 INFO:teuthology.orchestra.run.smithi003.stdout: "cct": { 2024-09-10T23:36:49.829 INFO:teuthology.orchestra.run.smithi003.stdout: "total_workers": 0, 2024-09-10T23:36:49.829 INFO:teuthology.orchestra.run.smithi003.stdout: "unhealthy_workers": 0 2024-09-10T23:36:49.829 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:49.829 INFO:teuthology.orchestra.run.smithi003.stdout: "mempool": { 2024-09-10T23:36:49.829 INFO:teuthology.orchestra.run.smithi003.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:36:49.829 INFO:teuthology.orchestra.run.smithi003.stdout: "bloom_filter_items": 0, 2024-09-10T23:36:49.829 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:36:49.829 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:36:49.829 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:36:49.829 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:36:49.830 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:36:49.830 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:36:49.830 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:36:49.830 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:36:49.830 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:36:49.830 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:36:49.830 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:36:49.830 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:36:49.830 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:36:49.830 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_extent_items": 0, 2024-09-10T23:36:49.830 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:36:49.830 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_blob_items": 0, 2024-09-10T23:36:49.830 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:36:49.830 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:36:49.831 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:36:49.831 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:36:49.831 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:36:49.831 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:36:49.831 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:36:49.831 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_txc_items": 0, 2024-09-10T23:36:49.831 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:36:49.831 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:36:49.831 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:36:49.831 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_writing_items": 0, 2024-09-10T23:36:49.831 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_bytes": 0, 2024-09-10T23:36:49.831 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_items": 0, 2024-09-10T23:36:49.831 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:36:49.831 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:36:49.832 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:36:49.832 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:36:49.832 INFO:teuthology.orchestra.run.smithi003.stdout: "buffer_anon_bytes": 148967, 2024-09-10T23:36:49.832 INFO:teuthology.orchestra.run.smithi003.stdout: "buffer_anon_items": 29, 2024-09-10T23:36:49.832 INFO:teuthology.orchestra.run.smithi003.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:36:49.832 INFO:teuthology.orchestra.run.smithi003.stdout: "buffer_meta_items": 0, 2024-09-10T23:36:49.832 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_bytes": 0, 2024-09-10T23:36:49.832 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_items": 0, 2024-09-10T23:36:49.832 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:36:49.832 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mapbl_items": 0, 2024-09-10T23:36:49.832 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:36:49.832 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pglog_items": 0, 2024-09-10T23:36:49.832 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_bytes": 0, 2024-09-10T23:36:49.832 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_items": 0, 2024-09-10T23:36:49.833 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:36:49.833 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:36:49.833 INFO:teuthology.orchestra.run.smithi003.stdout: "pgmap_bytes": 0, 2024-09-10T23:36:49.833 INFO:teuthology.orchestra.run.smithi003.stdout: "pgmap_items": 0, 2024-09-10T23:36:49.833 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_co_bytes": 968, 2024-09-10T23:36:49.833 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_co_items": 2, 2024-09-10T23:36:49.833 INFO:teuthology.orchestra.run.smithi003.stdout: "unittest_1_bytes": 0, 2024-09-10T23:36:49.833 INFO:teuthology.orchestra.run.smithi003.stdout: "unittest_1_items": 0, 2024-09-10T23:36:49.833 INFO:teuthology.orchestra.run.smithi003.stdout: "unittest_2_bytes": 0, 2024-09-10T23:36:49.833 INFO:teuthology.orchestra.run.smithi003.stdout: "unittest_2_items": 0 2024-09-10T23:36:49.833 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:49.833 INFO:teuthology.orchestra.run.smithi003.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:36:49.833 INFO:teuthology.orchestra.run.smithi003.stdout: "val": 0, 2024-09-10T23:36:49.833 INFO:teuthology.orchestra.run.smithi003.stdout: "max": 104857600, 2024-09-10T23:36:49.833 INFO:teuthology.orchestra.run.smithi003.stdout: "get_started": 0, 2024-09-10T23:36:49.834 INFO:teuthology.orchestra.run.smithi003.stdout: "get": 220, 2024-09-10T23:36:49.834 INFO:teuthology.orchestra.run.smithi003.stdout: "get_sum": 1106415, 2024-09-10T23:36:49.834 INFO:teuthology.orchestra.run.smithi003.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:49.834 INFO:teuthology.orchestra.run.smithi003.stdout: "get_or_fail_success": 220, 2024-09-10T23:36:49.834 INFO:teuthology.orchestra.run.smithi003.stdout: "take": 0, 2024-09-10T23:36:49.834 INFO:teuthology.orchestra.run.smithi003.stdout: "take_sum": 0, 2024-09-10T23:36:49.834 INFO:teuthology.orchestra.run.smithi003.stdout: "put": 220, 2024-09-10T23:36:49.834 INFO:teuthology.orchestra.run.smithi003.stdout: "put_sum": 1106415, 2024-09-10T23:36:49.834 INFO:teuthology.orchestra.run.smithi003.stdout: "wait": { 2024-09-10T23:36:49.834 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-10T23:36:49.834 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-10T23:36:49.834 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-10T23:36:49.834 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:49.834 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:49.835 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-10T23:36:50.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:50 smithi194 ceph-mon[33904]: pgmap v700: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-10T23:36:50.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:50 smithi003 ceph-mon[30348]: pgmap v700: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-10T23:36:50.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:50 smithi038 ceph-mon[34225]: pgmap v700: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-10T23:36:50.849 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-10T23:36:50.849 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-10T23:36:50.849 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-09-10T23:36:50.849 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-09-10T23:36:50.849 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-09-10T23:36:50.849 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-09-10T23:36:50.849 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-09-10T23:36:50.849 DEBUG:tasks.check_counter:Getting stats from d 2024-09-10T23:36:50.849 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-10T23:36:51.230 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:36:51.809 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-10T23:36:51.809 INFO:teuthology.orchestra.run.smithi003.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:36:51.809 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_messages": 225, 2024-09-10T23:36:51.809 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages": 218, 2024-09-10T23:36:51.809 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_bytes": 1139088, 2024-09-10T23:36:51.810 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_bytes": 134304, 2024-09-10T23:36:51.810 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_created_connections": 4, 2024-09-10T23:36:51.810 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_active_connections": 0, 2024-09-10T23:36:51.810 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_total_time": 0.059223829, 2024-09-10T23:36:51.810 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_send_time": 0.027506594, 2024-09-10T23:36:51.810 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_recv_time": 0.041655789, 2024-09-10T23:36:51.810 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:36:51.810 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:51.810 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 217, 2024-09-10T23:36:51.810 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.017961211, 2024-09-10T23:36:51.810 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000082770 2024-09-10T23:36:51.810 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:51.810 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:51.810 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-10T23:36:51.811 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-10T23:36:51.811 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-10T23:36:51.811 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:51.811 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_encrypted_bytes": 1139088, 2024-09-10T23:36:51.811 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_encrypted_bytes": 134304 2024-09-10T23:36:51.811 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:51.811 INFO:teuthology.orchestra.run.smithi003.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:36:51.811 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_messages": 1, 2024-09-10T23:36:51.811 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages": 167, 2024-09-10T23:36:51.811 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_bytes": 160, 2024-09-10T23:36:51.811 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_bytes": 109632, 2024-09-10T23:36:51.811 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_created_connections": 3, 2024-09-10T23:36:51.812 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_active_connections": 2, 2024-09-10T23:36:51.812 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_total_time": 0.023469760, 2024-09-10T23:36:51.812 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_send_time": 0.019432648, 2024-09-10T23:36:51.812 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_recv_time": 0.001427205, 2024-09-10T23:36:51.812 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:36:51.812 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:51.812 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 165, 2024-09-10T23:36:51.812 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.012269198, 2024-09-10T23:36:51.812 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000074358 2024-09-10T23:36:51.812 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:51.812 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:51.812 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-10T23:36:51.812 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-10T23:36:51.813 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-10T23:36:51.813 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:51.813 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T23:36:51.813 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_encrypted_bytes": 109632 2024-09-10T23:36:51.813 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:51.813 INFO:teuthology.orchestra.run.smithi003.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:36:51.813 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_messages": 4, 2024-09-10T23:36:51.813 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages": 4, 2024-09-10T23:36:51.813 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_bytes": 2992, 2024-09-10T23:36:51.813 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_bytes": 448, 2024-09-10T23:36:51.813 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_created_connections": 2, 2024-09-10T23:36:51.813 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_active_connections": 1, 2024-09-10T23:36:51.813 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_total_time": 0.003360323, 2024-09-10T23:36:51.813 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_send_time": 0.000074949, 2024-09-10T23:36:51.814 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_recv_time": 0.003231532, 2024-09-10T23:36:51.814 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:36:51.814 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:51.814 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 3, 2024-09-10T23:36:51.814 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.005951624, 2024-09-10T23:36:51.814 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.001983874 2024-09-10T23:36:51.814 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:51.815 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:51.815 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-10T23:36:51.815 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-10T23:36:51.815 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-10T23:36:51.815 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:51.815 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-10T23:36:51.815 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T23:36:51.815 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:51.816 INFO:teuthology.orchestra.run.smithi003.stdout: "cct": { 2024-09-10T23:36:51.816 INFO:teuthology.orchestra.run.smithi003.stdout: "total_workers": 0, 2024-09-10T23:36:51.816 INFO:teuthology.orchestra.run.smithi003.stdout: "unhealthy_workers": 0 2024-09-10T23:36:51.816 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:51.816 INFO:teuthology.orchestra.run.smithi003.stdout: "mempool": { 2024-09-10T23:36:51.816 INFO:teuthology.orchestra.run.smithi003.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:36:51.816 INFO:teuthology.orchestra.run.smithi003.stdout: "bloom_filter_items": 0, 2024-09-10T23:36:51.816 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:36:51.816 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:36:51.816 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:36:51.817 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:36:51.817 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:36:51.817 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:36:51.817 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:36:51.817 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:36:51.817 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:36:51.817 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:36:51.817 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:36:51.817 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:36:51.817 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:36:51.817 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_extent_items": 0, 2024-09-10T23:36:51.817 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:36:51.817 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_blob_items": 0, 2024-09-10T23:36:51.817 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:36:51.818 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:36:51.818 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:36:51.818 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:36:51.818 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:36:51.818 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:36:51.818 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:36:51.818 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_txc_items": 0, 2024-09-10T23:36:51.818 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:36:51.818 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:36:51.818 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:36:51.818 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_writing_items": 0, 2024-09-10T23:36:51.818 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_bytes": 0, 2024-09-10T23:36:51.818 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_items": 0, 2024-09-10T23:36:51.818 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:36:51.819 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:36:51.819 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:36:51.819 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:36:51.819 INFO:teuthology.orchestra.run.smithi003.stdout: "buffer_anon_bytes": 149024, 2024-09-10T23:36:51.819 INFO:teuthology.orchestra.run.smithi003.stdout: "buffer_anon_items": 31, 2024-09-10T23:36:51.819 INFO:teuthology.orchestra.run.smithi003.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:36:51.819 INFO:teuthology.orchestra.run.smithi003.stdout: "buffer_meta_items": 0, 2024-09-10T23:36:51.819 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_bytes": 0, 2024-09-10T23:36:51.819 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_items": 0, 2024-09-10T23:36:51.819 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:36:51.819 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mapbl_items": 0, 2024-09-10T23:36:51.819 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:36:51.819 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pglog_items": 0, 2024-09-10T23:36:51.819 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_bytes": 0, 2024-09-10T23:36:51.820 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_items": 0, 2024-09-10T23:36:51.820 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:36:51.820 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:36:51.820 INFO:teuthology.orchestra.run.smithi003.stdout: "pgmap_bytes": 0, 2024-09-10T23:36:51.820 INFO:teuthology.orchestra.run.smithi003.stdout: "pgmap_items": 0, 2024-09-10T23:36:51.820 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_co_bytes": 968, 2024-09-10T23:36:51.820 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_co_items": 2, 2024-09-10T23:36:51.820 INFO:teuthology.orchestra.run.smithi003.stdout: "unittest_1_bytes": 0, 2024-09-10T23:36:51.820 INFO:teuthology.orchestra.run.smithi003.stdout: "unittest_1_items": 0, 2024-09-10T23:36:51.820 INFO:teuthology.orchestra.run.smithi003.stdout: "unittest_2_bytes": 0, 2024-09-10T23:36:51.820 INFO:teuthology.orchestra.run.smithi003.stdout: "unittest_2_items": 0 2024-09-10T23:36:51.821 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:51.821 INFO:teuthology.orchestra.run.smithi003.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:36:51.821 INFO:teuthology.orchestra.run.smithi003.stdout: "val": 0, 2024-09-10T23:36:51.821 INFO:teuthology.orchestra.run.smithi003.stdout: "max": 104857600, 2024-09-10T23:36:51.821 INFO:teuthology.orchestra.run.smithi003.stdout: "get_started": 0, 2024-09-10T23:36:51.821 INFO:teuthology.orchestra.run.smithi003.stdout: "get": 226, 2024-09-10T23:36:51.821 INFO:teuthology.orchestra.run.smithi003.stdout: "get_sum": 1107298, 2024-09-10T23:36:51.821 INFO:teuthology.orchestra.run.smithi003.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:51.821 INFO:teuthology.orchestra.run.smithi003.stdout: "get_or_fail_success": 226, 2024-09-10T23:36:51.821 INFO:teuthology.orchestra.run.smithi003.stdout: "take": 0, 2024-09-10T23:36:51.821 INFO:teuthology.orchestra.run.smithi003.stdout: "take_sum": 0, 2024-09-10T23:36:51.821 INFO:teuthology.orchestra.run.smithi003.stdout: "put": 226, 2024-09-10T23:36:51.821 INFO:teuthology.orchestra.run.smithi003.stdout: "put_sum": 1107298, 2024-09-10T23:36:51.821 INFO:teuthology.orchestra.run.smithi003.stdout: "wait": { 2024-09-10T23:36:51.822 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-10T23:36:51.822 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-10T23:36:51.822 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-10T23:36:51.822 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:51.822 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:51.822 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-10T23:36:52.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:52 smithi003 ceph-mon[30348]: pgmap v701: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-10T23:36:52.613 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-10T23:36:52.613 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-10T23:36:52.614 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-10T23:36:52.614 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-10T23:36:52.614 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-10T23:36:52.614 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-10T23:36:52.614 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-10T23:36:52.614 DEBUG:tasks.check_counter:Getting stats from g 2024-09-10T23:36:52.614 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-10T23:36:52.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:52 smithi194 ceph-mon[33904]: pgmap v701: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-10T23:36:52.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:52 smithi038 ceph-mon[34225]: pgmap v701: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-10T23:36:53.003 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:36:53.777 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-10T23:36:53.777 INFO:teuthology.orchestra.run.smithi003.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:36:53.777 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_messages": 0, 2024-09-10T23:36:53.777 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages": 2, 2024-09-10T23:36:53.777 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_bytes": 0, 2024-09-10T23:36:53.777 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_bytes": 0, 2024-09-10T23:36:53.777 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_created_connections": 4, 2024-09-10T23:36:53.777 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_active_connections": 0, 2024-09-10T23:36:53.777 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_total_time": 0.003259917, 2024-09-10T23:36:53.777 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T23:36:53.778 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_recv_time": 0.000423089, 2024-09-10T23:36:53.778 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:36:53.778 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:53.778 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-10T23:36:53.778 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-10T23:36:53.778 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-10T23:36:53.778 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:53.778 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:53.778 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-10T23:36:53.778 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-10T23:36:53.778 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-10T23:36:53.778 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:53.778 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T23:36:53.778 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T23:36:53.779 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:53.779 INFO:teuthology.orchestra.run.smithi003.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:36:53.779 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_messages": 1, 2024-09-10T23:36:53.779 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages": 163, 2024-09-10T23:36:53.779 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_bytes": 160, 2024-09-10T23:36:53.779 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_bytes": 108928, 2024-09-10T23:36:53.779 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_created_connections": 3, 2024-09-10T23:36:53.779 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_active_connections": 2, 2024-09-10T23:36:53.779 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_total_time": 0.022939381, 2024-09-10T23:36:53.779 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_send_time": 0.018604597, 2024-09-10T23:36:53.779 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_recv_time": 0.001608890, 2024-09-10T23:36:53.779 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:36:53.779 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:53.780 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 161, 2024-09-10T23:36:53.780 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.012923890, 2024-09-10T23:36:53.780 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000080272 2024-09-10T23:36:53.780 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:53.780 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:53.780 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-10T23:36:53.780 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-10T23:36:53.780 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-10T23:36:53.780 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:53.780 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T23:36:53.780 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_encrypted_bytes": 108928 2024-09-10T23:36:53.780 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:53.781 INFO:teuthology.orchestra.run.smithi003.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:36:53.781 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_messages": 225, 2024-09-10T23:36:53.781 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages": 216, 2024-09-10T23:36:53.781 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_bytes": 1140992, 2024-09-10T23:36:53.781 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_bytes": 132192, 2024-09-10T23:36:53.781 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_created_connections": 2, 2024-09-10T23:36:53.781 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_active_connections": 1, 2024-09-10T23:36:53.781 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_total_time": 0.056715101, 2024-09-10T23:36:53.781 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_send_time": 0.027847449, 2024-09-10T23:36:53.781 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_recv_time": 0.038451170, 2024-09-10T23:36:53.781 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:36:53.781 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:53.781 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 216, 2024-09-10T23:36:53.782 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.023283979, 2024-09-10T23:36:53.782 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000107796 2024-09-10T23:36:53.782 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:53.782 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:53.782 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-10T23:36:53.782 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-10T23:36:53.782 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-10T23:36:53.782 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:53.782 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_encrypted_bytes": 1140992, 2024-09-10T23:36:53.782 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_encrypted_bytes": 132192 2024-09-10T23:36:53.782 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:53.782 INFO:teuthology.orchestra.run.smithi003.stdout: "cct": { 2024-09-10T23:36:53.782 INFO:teuthology.orchestra.run.smithi003.stdout: "total_workers": 0, 2024-09-10T23:36:53.782 INFO:teuthology.orchestra.run.smithi003.stdout: "unhealthy_workers": 0 2024-09-10T23:36:53.783 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:53.783 INFO:teuthology.orchestra.run.smithi003.stdout: "mempool": { 2024-09-10T23:36:53.783 INFO:teuthology.orchestra.run.smithi003.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:36:53.783 INFO:teuthology.orchestra.run.smithi003.stdout: "bloom_filter_items": 0, 2024-09-10T23:36:53.783 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:36:53.783 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:36:53.783 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:36:53.783 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:36:53.783 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:36:53.783 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:36:53.783 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:36:53.783 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:36:53.783 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:36:53.783 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:36:53.784 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:36:53.784 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:36:53.784 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:36:53.784 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_extent_items": 0, 2024-09-10T23:36:53.784 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:36:53.784 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_blob_items": 0, 2024-09-10T23:36:53.784 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:36:53.784 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:36:53.784 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:36:53.784 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:36:53.784 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:36:53.784 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:36:53.784 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:36:53.784 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_txc_items": 0, 2024-09-10T23:36:53.785 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:36:53.785 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:36:53.785 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:36:53.785 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_writing_items": 0, 2024-09-10T23:36:53.785 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_bytes": 0, 2024-09-10T23:36:53.785 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_items": 0, 2024-09-10T23:36:53.785 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:36:53.785 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:36:53.785 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:36:53.785 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:36:53.785 INFO:teuthology.orchestra.run.smithi003.stdout: "buffer_anon_bytes": 148967, 2024-09-10T23:36:53.785 INFO:teuthology.orchestra.run.smithi003.stdout: "buffer_anon_items": 29, 2024-09-10T23:36:53.785 INFO:teuthology.orchestra.run.smithi003.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:36:53.786 INFO:teuthology.orchestra.run.smithi003.stdout: "buffer_meta_items": 0, 2024-09-10T23:36:53.786 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_bytes": 0, 2024-09-10T23:36:53.786 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_items": 0, 2024-09-10T23:36:53.786 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:36:53.786 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mapbl_items": 0, 2024-09-10T23:36:53.786 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:36:53.786 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pglog_items": 0, 2024-09-10T23:36:53.786 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_bytes": 0, 2024-09-10T23:36:53.786 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_items": 0, 2024-09-10T23:36:53.786 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:36:53.786 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:36:53.786 INFO:teuthology.orchestra.run.smithi003.stdout: "pgmap_bytes": 0, 2024-09-10T23:36:53.786 INFO:teuthology.orchestra.run.smithi003.stdout: "pgmap_items": 0, 2024-09-10T23:36:53.786 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_co_bytes": 968, 2024-09-10T23:36:53.787 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_co_items": 2, 2024-09-10T23:36:53.787 INFO:teuthology.orchestra.run.smithi003.stdout: "unittest_1_bytes": 0, 2024-09-10T23:36:53.787 INFO:teuthology.orchestra.run.smithi003.stdout: "unittest_1_items": 0, 2024-09-10T23:36:53.787 INFO:teuthology.orchestra.run.smithi003.stdout: "unittest_2_bytes": 0, 2024-09-10T23:36:53.787 INFO:teuthology.orchestra.run.smithi003.stdout: "unittest_2_items": 0 2024-09-10T23:36:53.787 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:53.787 INFO:teuthology.orchestra.run.smithi003.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:36:53.787 INFO:teuthology.orchestra.run.smithi003.stdout: "val": 0, 2024-09-10T23:36:53.787 INFO:teuthology.orchestra.run.smithi003.stdout: "max": 104857600, 2024-09-10T23:36:53.787 INFO:teuthology.orchestra.run.smithi003.stdout: "get_started": 0, 2024-09-10T23:36:53.787 INFO:teuthology.orchestra.run.smithi003.stdout: "get": 222, 2024-09-10T23:36:53.787 INFO:teuthology.orchestra.run.smithi003.stdout: "get_sum": 1106778, 2024-09-10T23:36:53.787 INFO:teuthology.orchestra.run.smithi003.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:53.787 INFO:teuthology.orchestra.run.smithi003.stdout: "get_or_fail_success": 222, 2024-09-10T23:36:53.788 INFO:teuthology.orchestra.run.smithi003.stdout: "take": 0, 2024-09-10T23:36:53.788 INFO:teuthology.orchestra.run.smithi003.stdout: "take_sum": 0, 2024-09-10T23:36:53.788 INFO:teuthology.orchestra.run.smithi003.stdout: "put": 222, 2024-09-10T23:36:53.788 INFO:teuthology.orchestra.run.smithi003.stdout: "put_sum": 1106778, 2024-09-10T23:36:53.788 INFO:teuthology.orchestra.run.smithi003.stdout: "wait": { 2024-09-10T23:36:53.788 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-10T23:36:53.788 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-10T23:36:53.788 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-10T23:36:53.788 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:53.788 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:53.788 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-10T23:36:54.514 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-10T23:36:54.514 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-10T23:36:54.514 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-09-10T23:36:54.514 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-09-10T23:36:54.515 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-10T23:36:54.515 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-10T23:36:54.515 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-10T23:36:54.515 DEBUG:tasks.check_counter:Getting stats from j 2024-09-10T23:36:54.515 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-10T23:36:54.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:54 smithi194 ceph-mon[33904]: pgmap v702: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-10T23:36:54.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:54 smithi003 ceph-mon[30348]: pgmap v702: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-10T23:36:54.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:54 smithi038 ceph-mon[34225]: pgmap v702: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-10T23:36:54.897 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:36:55.501 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-10T23:36:55.501 INFO:teuthology.orchestra.run.smithi003.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:36:55.501 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_messages": 0, 2024-09-10T23:36:55.501 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages": 2, 2024-09-10T23:36:55.501 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_bytes": 0, 2024-09-10T23:36:55.501 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_bytes": 0, 2024-09-10T23:36:55.501 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_created_connections": 4, 2024-09-10T23:36:55.501 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_active_connections": 0, 2024-09-10T23:36:55.501 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_total_time": 0.003690235, 2024-09-10T23:36:55.501 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T23:36:55.502 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_recv_time": 0.000514935, 2024-09-10T23:36:55.502 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:36:55.502 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:55.502 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-10T23:36:55.502 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-10T23:36:55.502 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-10T23:36:55.502 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:55.502 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:55.502 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-10T23:36:55.502 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-10T23:36:55.502 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-10T23:36:55.502 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:55.502 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T23:36:55.502 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T23:36:55.503 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:55.503 INFO:teuthology.orchestra.run.smithi003.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:36:55.503 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_messages": 227, 2024-09-10T23:36:55.503 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages": 220, 2024-09-10T23:36:55.503 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_bytes": 1139632, 2024-09-10T23:36:55.503 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_bytes": 135584, 2024-09-10T23:36:55.503 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_created_connections": 2, 2024-09-10T23:36:55.503 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_active_connections": 1, 2024-09-10T23:36:55.503 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_total_time": 0.055524696, 2024-09-10T23:36:55.503 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_send_time": 0.027758860, 2024-09-10T23:36:55.503 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_recv_time": 0.038396595, 2024-09-10T23:36:55.503 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:36:55.504 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:55.504 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 219, 2024-09-10T23:36:55.504 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.017695164, 2024-09-10T23:36:55.504 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000080799 2024-09-10T23:36:55.504 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:55.504 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:55.504 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-10T23:36:55.504 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-10T23:36:55.504 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-10T23:36:55.504 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:55.504 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_encrypted_bytes": 1139632, 2024-09-10T23:36:55.505 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_encrypted_bytes": 135584 2024-09-10T23:36:55.505 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:55.505 INFO:teuthology.orchestra.run.smithi003.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:36:55.505 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_messages": 5, 2024-09-10T23:36:55.505 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages": 170, 2024-09-10T23:36:55.505 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_bytes": 3152, 2024-09-10T23:36:55.505 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_bytes": 110256, 2024-09-10T23:36:55.505 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_created_connections": 3, 2024-09-10T23:36:55.505 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_active_connections": 2, 2024-09-10T23:36:55.505 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_total_time": 0.025221781, 2024-09-10T23:36:55.505 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_send_time": 0.018396380, 2024-09-10T23:36:55.505 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_recv_time": 0.004420809, 2024-09-10T23:36:55.506 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:36:55.506 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:55.506 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 169, 2024-09-10T23:36:55.506 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.017828359, 2024-09-10T23:36:55.506 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000105493 2024-09-10T23:36:55.506 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:55.508 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:55.508 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-10T23:36:55.508 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-10T23:36:55.508 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-10T23:36:55.508 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:55.508 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-10T23:36:55.508 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_encrypted_bytes": 110256 2024-09-10T23:36:55.508 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:55.508 INFO:teuthology.orchestra.run.smithi003.stdout: "cct": { 2024-09-10T23:36:55.508 INFO:teuthology.orchestra.run.smithi003.stdout: "total_workers": 0, 2024-09-10T23:36:55.508 INFO:teuthology.orchestra.run.smithi003.stdout: "unhealthy_workers": 0 2024-09-10T23:36:55.508 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:55.509 INFO:teuthology.orchestra.run.smithi003.stdout: "mempool": { 2024-09-10T23:36:55.509 INFO:teuthology.orchestra.run.smithi003.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:36:55.509 INFO:teuthology.orchestra.run.smithi003.stdout: "bloom_filter_items": 0, 2024-09-10T23:36:55.509 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:36:55.509 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:36:55.509 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:36:55.509 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:36:55.509 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:36:55.509 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:36:55.509 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:36:55.509 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:36:55.509 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:36:55.509 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:36:55.509 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:36:55.510 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:36:55.510 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:36:55.510 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_extent_items": 0, 2024-09-10T23:36:55.510 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:36:55.510 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_blob_items": 0, 2024-09-10T23:36:55.510 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:36:55.510 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:36:55.510 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:36:55.510 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:36:55.510 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:36:55.510 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:36:55.510 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:36:55.510 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_txc_items": 0, 2024-09-10T23:36:55.510 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:36:55.511 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:36:55.511 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:36:55.511 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_writing_items": 0, 2024-09-10T23:36:55.511 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_bytes": 0, 2024-09-10T23:36:55.511 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_items": 0, 2024-09-10T23:36:55.511 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:36:55.511 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:36:55.511 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:36:55.511 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:36:55.511 INFO:teuthology.orchestra.run.smithi003.stdout: "buffer_anon_bytes": 148984, 2024-09-10T23:36:55.511 INFO:teuthology.orchestra.run.smithi003.stdout: "buffer_anon_items": 30, 2024-09-10T23:36:55.511 INFO:teuthology.orchestra.run.smithi003.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:36:55.511 INFO:teuthology.orchestra.run.smithi003.stdout: "buffer_meta_items": 0, 2024-09-10T23:36:55.511 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_bytes": 0, 2024-09-10T23:36:55.511 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_items": 0, 2024-09-10T23:36:55.512 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:36:55.512 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mapbl_items": 0, 2024-09-10T23:36:55.512 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:36:55.512 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pglog_items": 0, 2024-09-10T23:36:55.512 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_bytes": 0, 2024-09-10T23:36:55.512 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_items": 0, 2024-09-10T23:36:55.512 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:36:55.512 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:36:55.512 INFO:teuthology.orchestra.run.smithi003.stdout: "pgmap_bytes": 0, 2024-09-10T23:36:55.512 INFO:teuthology.orchestra.run.smithi003.stdout: "pgmap_items": 0, 2024-09-10T23:36:55.512 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_co_bytes": 968, 2024-09-10T23:36:55.512 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_co_items": 2, 2024-09-10T23:36:55.512 INFO:teuthology.orchestra.run.smithi003.stdout: "unittest_1_bytes": 0, 2024-09-10T23:36:55.512 INFO:teuthology.orchestra.run.smithi003.stdout: "unittest_1_items": 0, 2024-09-10T23:36:55.513 INFO:teuthology.orchestra.run.smithi003.stdout: "unittest_2_bytes": 0, 2024-09-10T23:36:55.513 INFO:teuthology.orchestra.run.smithi003.stdout: "unittest_2_items": 0 2024-09-10T23:36:55.513 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-10T23:36:55.513 INFO:teuthology.orchestra.run.smithi003.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:36:55.513 INFO:teuthology.orchestra.run.smithi003.stdout: "val": 0, 2024-09-10T23:36:55.513 INFO:teuthology.orchestra.run.smithi003.stdout: "max": 104857600, 2024-09-10T23:36:55.513 INFO:teuthology.orchestra.run.smithi003.stdout: "get_started": 0, 2024-09-10T23:36:55.513 INFO:teuthology.orchestra.run.smithi003.stdout: "get": 228, 2024-09-10T23:36:55.513 INFO:teuthology.orchestra.run.smithi003.stdout: "get_sum": 1107558, 2024-09-10T23:36:55.513 INFO:teuthology.orchestra.run.smithi003.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:55.513 INFO:teuthology.orchestra.run.smithi003.stdout: "get_or_fail_success": 228, 2024-09-10T23:36:55.513 INFO:teuthology.orchestra.run.smithi003.stdout: "take": 0, 2024-09-10T23:36:55.513 INFO:teuthology.orchestra.run.smithi003.stdout: "take_sum": 0, 2024-09-10T23:36:55.513 INFO:teuthology.orchestra.run.smithi003.stdout: "put": 228, 2024-09-10T23:36:55.514 INFO:teuthology.orchestra.run.smithi003.stdout: "put_sum": 1107558, 2024-09-10T23:36:55.514 INFO:teuthology.orchestra.run.smithi003.stdout: "wait": { 2024-09-10T23:36:55.514 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-10T23:36:55.514 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-10T23:36:55.514 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-10T23:36:55.514 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:55.514 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-10T23:36:55.514 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-10T23:36:56.289 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-10T23:36:56.289 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-10T23:36:56.289 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-10T23:36:56.289 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-10T23:36:56.289 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-10T23:36:56.289 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-10T23:36:56.289 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-10T23:36:56.289 DEBUG:tasks.check_counter:Getting stats from b 2024-09-10T23:36:56.289 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-10T23:36:56.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:56 smithi038 ceph-mon[34225]: pgmap v703: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-10T23:36:56.681 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:36:56.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:56 smithi194 ceph-mon[33904]: pgmap v703: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-10T23:36:56.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:56 smithi003 ceph-mon[30348]: pgmap v703: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-10T23:36:57.311 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-10T23:36:57.311 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:36:57.312 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 980, 2024-09-10T23:36:57.312 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 815, 2024-09-10T23:36:57.312 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 409335, 2024-09-10T23:36:57.312 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 1283090, 2024-09-10T23:36:57.312 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 20, 2024-09-10T23:36:57.312 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 7, 2024-09-10T23:36:57.312 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.173805515, 2024-09-10T23:36:57.312 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.080492087, 2024-09-10T23:36:57.312 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.072756146, 2024-09-10T23:36:57.312 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.018920674, 2024-09-10T23:36:57.312 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:57.313 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 817, 2024-09-10T23:36:57.313 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.346912344, 2024-09-10T23:36:57.313 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000424617 2024-09-10T23:36:57.313 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.313 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:57.313 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 968, 2024-09-10T23:36:57.313 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000288038, 2024-09-10T23:36:57.313 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000297 2024-09-10T23:36:57.313 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.313 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 36208, 2024-09-10T23:36:57.313 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 2784 2024-09-10T23:36:57.313 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.313 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:36:57.313 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 1710, 2024-09-10T23:36:57.314 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 1034, 2024-09-10T23:36:57.314 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 1769759, 2024-09-10T23:36:57.314 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 422789, 2024-09-10T23:36:57.314 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 8, 2024-09-10T23:36:57.314 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 6, 2024-09-10T23:36:57.314 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.281997064, 2024-09-10T23:36:57.314 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.126813661, 2024-09-10T23:36:57.314 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.133844471, 2024-09-10T23:36:57.314 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.041108546, 2024-09-10T23:36:57.314 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:57.314 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 1036, 2024-09-10T23:36:57.314 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.483604393, 2024-09-10T23:36:57.315 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000466799 2024-09-10T23:36:57.315 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.315 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:57.315 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 1708, 2024-09-10T23:36:57.315 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000500820, 2024-09-10T23:36:57.315 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000293 2024-09-10T23:36:57.315 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.315 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 1510688, 2024-09-10T23:36:57.315 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 229184 2024-09-10T23:36:57.315 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.315 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:36:57.315 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 1121, 2024-09-10T23:36:57.316 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 665, 2024-09-10T23:36:57.316 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 417136, 2024-09-10T23:36:57.316 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 679340, 2024-09-10T23:36:57.316 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 24, 2024-09-10T23:36:57.316 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 8, 2024-09-10T23:36:57.316 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.191054315, 2024-09-10T23:36:57.316 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.060830826, 2024-09-10T23:36:57.316 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.072812687, 2024-09-10T23:36:57.316 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.053259418, 2024-09-10T23:36:57.316 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:57.316 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 657, 2024-09-10T23:36:57.316 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.348405173, 2024-09-10T23:36:57.316 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000530297 2024-09-10T23:36:57.317 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.317 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:57.317 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 1153, 2024-09-10T23:36:57.317 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000262370, 2024-09-10T23:36:57.317 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000227 2024-09-10T23:36:57.317 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.317 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 56928, 2024-09-10T23:36:57.317 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 373312 2024-09-10T23:36:57.317 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.317 INFO:teuthology.orchestra.run.smithi038.stdout: "cct": { 2024-09-10T23:36:57.317 INFO:teuthology.orchestra.run.smithi038.stdout: "total_workers": 1, 2024-09-10T23:36:57.317 INFO:teuthology.orchestra.run.smithi038.stdout: "unhealthy_workers": 0 2024-09-10T23:36:57.318 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.318 INFO:teuthology.orchestra.run.smithi038.stdout: "finisher-MDSRank": { 2024-09-10T23:36:57.318 INFO:teuthology.orchestra.run.smithi038.stdout: "queue_len": 0, 2024-09-10T23:36:57.318 INFO:teuthology.orchestra.run.smithi038.stdout: "complete_latency": { 2024-09-10T23:36:57.318 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 382, 2024-09-10T23:36:57.318 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.114577548, 2024-09-10T23:36:57.318 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000299941 2024-09-10T23:36:57.318 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:36:57.318 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.318 INFO:teuthology.orchestra.run.smithi038.stdout: "finisher-PurgeQueue": { 2024-09-10T23:36:57.318 INFO:teuthology.orchestra.run.smithi038.stdout: "queue_len": 0, 2024-09-10T23:36:57.318 INFO:teuthology.orchestra.run.smithi038.stdout: "complete_latency": { 2024-09-10T23:36:57.318 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 80, 2024-09-10T23:36:57.318 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.004686839, 2024-09-10T23:36:57.319 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000058585 2024-09-10T23:36:57.319 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:36:57.319 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.319 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2024-09-10T23:36:57.319 INFO:teuthology.orchestra.run.smithi038.stdout: "request": 176, 2024-09-10T23:36:57.319 INFO:teuthology.orchestra.run.smithi038.stdout: "reply": 176, 2024-09-10T23:36:57.319 INFO:teuthology.orchestra.run.smithi038.stdout: "reply_latency": { 2024-09-10T23:36:57.319 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 176, 2024-09-10T23:36:57.319 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.192121479, 2024-09-10T23:36:57.319 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.001091599 2024-09-10T23:36:57.319 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.319 INFO:teuthology.orchestra.run.smithi038.stdout: "slow_reply": 0, 2024-09-10T23:36:57.319 INFO:teuthology.orchestra.run.smithi038.stdout: "forward": 0, 2024-09-10T23:36:57.319 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_fetch_complete": 0, 2024-09-10T23:36:57.320 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_fetch_keys": 0, 2024-09-10T23:36:57.320 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_commit": 12, 2024-09-10T23:36:57.320 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_split": 0, 2024-09-10T23:36:57.320 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_merge": 0, 2024-09-10T23:36:57.320 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes": 36, 2024-09-10T23:36:57.320 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_top": 0, 2024-09-10T23:36:57.320 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_bottom": 36, 2024-09-10T23:36:57.320 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_pin_tail": 0, 2024-09-10T23:36:57.320 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_pinned": 36, 2024-09-10T23:36:57.320 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_expired": 0, 2024-09-10T23:36:57.320 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_with_caps": 3, 2024-09-10T23:36:57.320 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": 3, 2024-09-10T23:36:57.321 INFO:teuthology.orchestra.run.smithi038.stdout: "subtrees": 2, 2024-09-10T23:36:57.321 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse": 237, 2024-09-10T23:36:57.321 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_hit": 226, 2024-09-10T23:36:57.321 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_forward": 0, 2024-09-10T23:36:57.321 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_discover": 0, 2024-09-10T23:36:57.321 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_dir_fetch": 0, 2024-09-10T23:36:57.321 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_remote_ino": 0, 2024-09-10T23:36:57.321 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_lock": 0, 2024-09-10T23:36:57.321 INFO:teuthology.orchestra.run.smithi038.stdout: "load_cent": 0, 2024-09-10T23:36:57.321 INFO:teuthology.orchestra.run.smithi038.stdout: "q": 0, 2024-09-10T23:36:57.321 INFO:teuthology.orchestra.run.smithi038.stdout: "exported": 0, 2024-09-10T23:36:57.321 INFO:teuthology.orchestra.run.smithi038.stdout: "exported_inodes": 0, 2024-09-10T23:36:57.321 INFO:teuthology.orchestra.run.smithi038.stdout: "imported": 0, 2024-09-10T23:36:57.321 INFO:teuthology.orchestra.run.smithi038.stdout: "imported_inodes": 0, 2024-09-10T23:36:57.322 INFO:teuthology.orchestra.run.smithi038.stdout: "openino_dir_fetch": 0, 2024-09-10T23:36:57.322 INFO:teuthology.orchestra.run.smithi038.stdout: "openino_backtrace_fetch": 0, 2024-09-10T23:36:57.322 INFO:teuthology.orchestra.run.smithi038.stdout: "openino_peer_discover": 0, 2024-09-10T23:36:57.322 INFO:teuthology.orchestra.run.smithi038.stdout: "root_rfiles": 4, 2024-09-10T23:36:57.322 INFO:teuthology.orchestra.run.smithi038.stdout: "root_rbytes": 234, 2024-09-10T23:36:57.322 INFO:teuthology.orchestra.run.smithi038.stdout: "root_rsnaps": 6, 2024-09-10T23:36:57.322 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T23:36:57.322 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_set_tag": 0, 2024-09-10T23:36:57.322 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T23:36:57.322 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_inotable_repaired": 0, 2024-09-10T23:36:57.322 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_dir_inodes": 0, 2024-09-10T23:36:57.322 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T23:36:57.322 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T23:36:57.322 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_file_inodes": 0, 2024-09-10T23:36:57.323 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_inode_file_caps": 0, 2024-09-10T23:36:57.323 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_revoke": 40, 2024-09-10T23:36:57.323 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_grant": 39, 2024-09-10T23:36:57.323 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T23:36:57.323 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T23:36:57.323 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T23:36:57.323 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_caps": 98, 2024-09-10T23:36:57.323 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_caps_dirty": 56, 2024-09-10T23:36:57.323 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_cap_release": 3, 2024-09-10T23:36:57.323 INFO:teuthology.orchestra.run.smithi038.stdout: "process_request_cap_release": 35 2024-09-10T23:36:57.323 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.323 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_cache": { 2024-09-10T23:36:57.323 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_update": 11, 2024-09-10T23:36:57.323 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_update_receipt": 0, 2024-09-10T23:36:57.324 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_try_discover": 0, 2024-09-10T23:36:57.324 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_send_discover": 0, 2024-09-10T23:36:57.324 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_handle_discover": 24, 2024-09-10T23:36:57.324 INFO:teuthology.orchestra.run.smithi038.stdout: "num_strays": 2, 2024-09-10T23:36:57.324 INFO:teuthology.orchestra.run.smithi038.stdout: "num_strays_delayed": 0, 2024-09-10T23:36:57.324 INFO:teuthology.orchestra.run.smithi038.stdout: "num_strays_enqueuing": 0, 2024-09-10T23:36:57.324 INFO:teuthology.orchestra.run.smithi038.stdout: "strays_created": 6, 2024-09-10T23:36:57.324 INFO:teuthology.orchestra.run.smithi038.stdout: "strays_enqueued": 4, 2024-09-10T23:36:57.324 INFO:teuthology.orchestra.run.smithi038.stdout: "strays_reintegrated": 0, 2024-09-10T23:36:57.324 INFO:teuthology.orchestra.run.smithi038.stdout: "strays_migrated": 0, 2024-09-10T23:36:57.324 INFO:teuthology.orchestra.run.smithi038.stdout: "num_recovering_processing": 0, 2024-09-10T23:36:57.324 INFO:teuthology.orchestra.run.smithi038.stdout: "num_recovering_enqueued": 0, 2024-09-10T23:36:57.324 INFO:teuthology.orchestra.run.smithi038.stdout: "num_recovering_prioritized": 0, 2024-09-10T23:36:57.324 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_started": 0, 2024-09-10T23:36:57.325 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_completed": 0, 2024-09-10T23:36:57.325 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_quiesce_path": 3, 2024-09-10T23:36:57.325 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_quiesce_inode": 46, 2024-09-10T23:36:57.325 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T23:36:57.325 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_exportdir": 0, 2024-09-10T23:36:57.325 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_flush": 0, 2024-09-10T23:36:57.325 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_fragmentdir": 0, 2024-09-10T23:36:57.325 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_fragstats": 0, 2024-09-10T23:36:57.325 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_inodestats": 0, 2024-09-10T23:36:57.325 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-10T23:36:57.325 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_succeeded": 0, 2024-09-10T23:36:57.325 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_write_failed": 0 2024-09-10T23:36:57.325 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.326 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_log": { 2024-09-10T23:36:57.326 INFO:teuthology.orchestra.run.smithi038.stdout: "evlrg": 0, 2024-09-10T23:36:57.326 INFO:teuthology.orchestra.run.smithi038.stdout: "evadd": 192, 2024-09-10T23:36:57.326 INFO:teuthology.orchestra.run.smithi038.stdout: "evex": 0, 2024-09-10T23:36:57.326 INFO:teuthology.orchestra.run.smithi038.stdout: "evtrm": 0, 2024-09-10T23:36:57.326 INFO:teuthology.orchestra.run.smithi038.stdout: "ev": 192, 2024-09-10T23:36:57.326 INFO:teuthology.orchestra.run.smithi038.stdout: "evexg": 0, 2024-09-10T23:36:57.326 INFO:teuthology.orchestra.run.smithi038.stdout: "evexd": 0, 2024-09-10T23:36:57.326 INFO:teuthology.orchestra.run.smithi038.stdout: "segadd": 2, 2024-09-10T23:36:57.326 INFO:teuthology.orchestra.run.smithi038.stdout: "segex": 0, 2024-09-10T23:36:57.326 INFO:teuthology.orchestra.run.smithi038.stdout: "segtrm": 0, 2024-09-10T23:36:57.326 INFO:teuthology.orchestra.run.smithi038.stdout: "seg": 2, 2024-09-10T23:36:57.326 INFO:teuthology.orchestra.run.smithi038.stdout: "segmjr": 2, 2024-09-10T23:36:57.326 INFO:teuthology.orchestra.run.smithi038.stdout: "segexg": 0, 2024-09-10T23:36:57.327 INFO:teuthology.orchestra.run.smithi038.stdout: "segexd": 0, 2024-09-10T23:36:57.327 INFO:teuthology.orchestra.run.smithi038.stdout: "expos": 4194304, 2024-09-10T23:36:57.327 INFO:teuthology.orchestra.run.smithi038.stdout: "wrpos": 5092655, 2024-09-10T23:36:57.327 INFO:teuthology.orchestra.run.smithi038.stdout: "rdpos": 0, 2024-09-10T23:36:57.327 INFO:teuthology.orchestra.run.smithi038.stdout: "jlat": { 2024-09-10T23:36:57.327 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 151, 2024-09-10T23:36:57.327 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.457707575, 2024-09-10T23:36:57.327 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.003031175 2024-09-10T23:36:57.327 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.327 INFO:teuthology.orchestra.run.smithi038.stdout: "replayed": 0 2024-09-10T23:36:57.327 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.327 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_mem": { 2024-09-10T23:36:57.327 INFO:teuthology.orchestra.run.smithi038.stdout: "ino": 29, 2024-09-10T23:36:57.328 INFO:teuthology.orchestra.run.smithi038.stdout: "ino+": 33, 2024-09-10T23:36:57.328 INFO:teuthology.orchestra.run.smithi038.stdout: "ino-": 4, 2024-09-10T23:36:57.328 INFO:teuthology.orchestra.run.smithi038.stdout: "dir": 20, 2024-09-10T23:36:57.328 INFO:teuthology.orchestra.run.smithi038.stdout: "dir+": 20, 2024-09-10T23:36:57.328 INFO:teuthology.orchestra.run.smithi038.stdout: "dir-": 0, 2024-09-10T23:36:57.328 INFO:teuthology.orchestra.run.smithi038.stdout: "dn": 36, 2024-09-10T23:36:57.328 INFO:teuthology.orchestra.run.smithi038.stdout: "dn+": 40, 2024-09-10T23:36:57.328 INFO:teuthology.orchestra.run.smithi038.stdout: "dn-": 4, 2024-09-10T23:36:57.328 INFO:teuthology.orchestra.run.smithi038.stdout: "cap": 3, 2024-09-10T23:36:57.328 INFO:teuthology.orchestra.run.smithi038.stdout: "cap+": 22, 2024-09-10T23:36:57.328 INFO:teuthology.orchestra.run.smithi038.stdout: "cap-": 19, 2024-09-10T23:36:57.328 INFO:teuthology.orchestra.run.smithi038.stdout: "rss": 54228, 2024-09-10T23:36:57.329 INFO:teuthology.orchestra.run.smithi038.stdout: "heap": 271306752 2024-09-10T23:36:57.329 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.329 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_server": { 2024-09-10T23:36:57.329 INFO:teuthology.orchestra.run.smithi038.stdout: "dispatch_client_request": 233, 2024-09-10T23:36:57.329 INFO:teuthology.orchestra.run.smithi038.stdout: "dispatch_server_request": 1, 2024-09-10T23:36:57.329 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_request": 176, 2024-09-10T23:36:57.329 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_session": 32, 2024-09-10T23:36:57.329 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_peer_request": 2, 2024-09-10T23:36:57.329 INFO:teuthology.orchestra.run.smithi038.stdout: "req_create_latency": { 2024-09-10T23:36:57.329 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 8, 2024-09-10T23:36:57.329 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.006916559, 2024-09-10T23:36:57.329 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000864569 2024-09-10T23:36:57.329 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.330 INFO:teuthology.orchestra.run.smithi038.stdout: "req_getattr_latency": { 2024-09-10T23:36:57.330 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 112, 2024-09-10T23:36:57.330 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.024199993, 2024-09-10T23:36:57.330 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000216071 2024-09-10T23:36:57.330 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.330 INFO:teuthology.orchestra.run.smithi038.stdout: "req_getfilelock_latency": { 2024-09-10T23:36:57.330 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:57.330 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:57.330 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:57.330 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.330 INFO:teuthology.orchestra.run.smithi038.stdout: "req_link_latency": { 2024-09-10T23:36:57.330 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:57.330 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:57.331 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:57.331 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.331 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookup_latency": { 2024-09-10T23:36:57.331 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 4, 2024-09-10T23:36:57.331 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.005432608, 2024-09-10T23:36:57.331 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.001358152 2024-09-10T23:36:57.331 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.331 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookuphash_latency": { 2024-09-10T23:36:57.331 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:57.331 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:57.331 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:57.331 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.331 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookupino_latency": { 2024-09-10T23:36:57.331 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:57.332 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:57.332 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:57.332 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.332 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookupname_latency": { 2024-09-10T23:36:57.332 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:57.332 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:57.332 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:57.332 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.332 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookupparent_latency": { 2024-09-10T23:36:57.332 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:57.332 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:57.332 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:57.332 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.333 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookupsnap_latency": { 2024-09-10T23:36:57.333 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:57.333 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:57.333 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:57.333 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.333 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lssnap_latency": { 2024-09-10T23:36:57.334 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 10, 2024-09-10T23:36:57.334 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.001842299, 2024-09-10T23:36:57.334 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000184229 2024-09-10T23:36:57.334 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.334 INFO:teuthology.orchestra.run.smithi038.stdout: "req_mkdir_latency": { 2024-09-10T23:36:57.334 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 8, 2024-09-10T23:36:57.334 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.014172695, 2024-09-10T23:36:57.334 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.001771586 2024-09-10T23:36:57.334 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.334 INFO:teuthology.orchestra.run.smithi038.stdout: "req_mknod_latency": { 2024-09-10T23:36:57.335 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:57.335 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:57.335 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:57.335 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.335 INFO:teuthology.orchestra.run.smithi038.stdout: "req_mksnap_latency": { 2024-09-10T23:36:57.335 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 10, 2024-09-10T23:36:57.335 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.060238933, 2024-09-10T23:36:57.335 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.006023893 2024-09-10T23:36:57.335 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.335 INFO:teuthology.orchestra.run.smithi038.stdout: "req_open_latency": { 2024-09-10T23:36:57.335 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:57.335 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:57.336 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:57.336 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.336 INFO:teuthology.orchestra.run.smithi038.stdout: "req_readdir_latency": { 2024-09-10T23:36:57.336 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 1, 2024-09-10T23:36:57.336 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000943604, 2024-09-10T23:36:57.336 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000943604 2024-09-10T23:36:57.336 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.336 INFO:teuthology.orchestra.run.smithi038.stdout: "req_rename_latency": { 2024-09-10T23:36:57.336 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 2, 2024-09-10T23:36:57.336 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.002046863, 2024-09-10T23:36:57.336 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.001023431 2024-09-10T23:36:57.336 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.337 INFO:teuthology.orchestra.run.smithi038.stdout: "req_renamesnap_latency": { 2024-09-10T23:36:57.337 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:57.337 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:57.337 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:57.337 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.337 INFO:teuthology.orchestra.run.smithi038.stdout: "req_snapdiff_latency": { 2024-09-10T23:36:57.337 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:57.337 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:57.337 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:57.337 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.337 INFO:teuthology.orchestra.run.smithi038.stdout: "req_rmdir_latency": { 2024-09-10T23:36:57.337 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 2, 2024-09-10T23:36:57.337 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.022655780, 2024-09-10T23:36:57.338 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.011327890 2024-09-10T23:36:57.338 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.338 INFO:teuthology.orchestra.run.smithi038.stdout: "req_rmsnap_latency": { 2024-09-10T23:36:57.338 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 4, 2024-09-10T23:36:57.338 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.021888326, 2024-09-10T23:36:57.338 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.005472081 2024-09-10T23:36:57.338 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.338 INFO:teuthology.orchestra.run.smithi038.stdout: "req_rmxattr_latency": { 2024-09-10T23:36:57.338 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:57.338 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:57.338 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:57.338 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.339 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setattr_latency": { 2024-09-10T23:36:57.339 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 2, 2024-09-10T23:36:57.339 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.001312365, 2024-09-10T23:36:57.339 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000656182 2024-09-10T23:36:57.339 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.339 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setdirlayout_latency": { 2024-09-10T23:36:57.339 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:57.339 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:57.339 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:57.339 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.339 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setfilelock_latency": { 2024-09-10T23:36:57.339 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:57.339 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:57.340 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:57.340 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.340 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setlayout_latency": { 2024-09-10T23:36:57.340 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:57.340 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:57.340 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:57.340 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.340 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setxattr_latency": { 2024-09-10T23:36:57.340 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 9, 2024-09-10T23:36:57.340 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.024792854, 2024-09-10T23:36:57.340 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.002754761 2024-09-10T23:36:57.340 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.340 INFO:teuthology.orchestra.run.smithi038.stdout: "req_symlink_latency": { 2024-09-10T23:36:57.341 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:57.341 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:57.341 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:57.341 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.341 INFO:teuthology.orchestra.run.smithi038.stdout: "req_unlink_latency": { 2024-09-10T23:36:57.341 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 4, 2024-09-10T23:36:57.341 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.005678600, 2024-09-10T23:36:57.341 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.001419650 2024-09-10T23:36:57.341 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.341 INFO:teuthology.orchestra.run.smithi038.stdout: "cap_revoke_eviction": 0, 2024-09-10T23:36:57.341 INFO:teuthology.orchestra.run.smithi038.stdout: "cap_acquisition_throttle": 0, 2024-09-10T23:36:57.341 INFO:teuthology.orchestra.run.smithi038.stdout: "req_getvxattr_latency": { 2024-09-10T23:36:57.341 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:57.341 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:57.342 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:57.342 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:36:57.342 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.342 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_sessions": { 2024-09-10T23:36:57.342 INFO:teuthology.orchestra.run.smithi038.stdout: "session_count": 2, 2024-09-10T23:36:57.342 INFO:teuthology.orchestra.run.smithi038.stdout: "session_add": 5, 2024-09-10T23:36:57.342 INFO:teuthology.orchestra.run.smithi038.stdout: "session_remove": 3, 2024-09-10T23:36:57.342 INFO:teuthology.orchestra.run.smithi038.stdout: "sessions_open": 2, 2024-09-10T23:36:57.342 INFO:teuthology.orchestra.run.smithi038.stdout: "sessions_stale": 0, 2024-09-10T23:36:57.342 INFO:teuthology.orchestra.run.smithi038.stdout: "total_load": 27, 2024-09-10T23:36:57.342 INFO:teuthology.orchestra.run.smithi038.stdout: "average_load": 13, 2024-09-10T23:36:57.342 INFO:teuthology.orchestra.run.smithi038.stdout: "avg_session_uptime": 604, 2024-09-10T23:36:57.342 INFO:teuthology.orchestra.run.smithi038.stdout: "mdthresh_evicted": 0 2024-09-10T23:36:57.342 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.343 INFO:teuthology.orchestra.run.smithi038.stdout: "mempool": { 2024-09-10T23:36:57.343 INFO:teuthology.orchestra.run.smithi038.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:36:57.343 INFO:teuthology.orchestra.run.smithi038.stdout: "bloom_filter_items": 0, 2024-09-10T23:36:57.343 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:36:57.343 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:36:57.343 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:36:57.343 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:36:57.343 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:36:57.343 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:36:57.343 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:36:57.343 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:36:57.343 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:36:57.344 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:36:57.344 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:36:57.344 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:36:57.344 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:36:57.344 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_extent_items": 0, 2024-09-10T23:36:57.344 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:36:57.344 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_blob_items": 0, 2024-09-10T23:36:57.344 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:36:57.344 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:36:57.344 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:36:57.344 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:36:57.344 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:36:57.344 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:36:57.344 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:36:57.345 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_txc_items": 0, 2024-09-10T23:36:57.345 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:36:57.345 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:36:57.345 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:36:57.345 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_items": 0, 2024-09-10T23:36:57.345 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_bytes": 0, 2024-09-10T23:36:57.345 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_items": 0, 2024-09-10T23:36:57.345 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:36:57.345 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:36:57.345 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:36:57.345 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:36:57.345 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_anon_bytes": 319047, 2024-09-10T23:36:57.345 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_anon_items": 110, 2024-09-10T23:36:57.346 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:36:57.346 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_meta_items": 0, 2024-09-10T23:36:57.346 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_bytes": 0, 2024-09-10T23:36:57.346 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_items": 0, 2024-09-10T23:36:57.346 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:36:57.346 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mapbl_items": 0, 2024-09-10T23:36:57.346 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:36:57.346 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pglog_items": 0, 2024-09-10T23:36:57.346 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_bytes": 9648, 2024-09-10T23:36:57.346 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_items": 196, 2024-09-10T23:36:57.346 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:36:57.346 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:36:57.346 INFO:teuthology.orchestra.run.smithi038.stdout: "pgmap_bytes": 0, 2024-09-10T23:36:57.346 INFO:teuthology.orchestra.run.smithi038.stdout: "pgmap_items": 0, 2024-09-10T23:36:57.346 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_co_bytes": 135836, 2024-09-10T23:36:57.347 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_co_items": 1048, 2024-09-10T23:36:57.347 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_1_bytes": 0, 2024-09-10T23:36:57.347 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_1_items": 0, 2024-09-10T23:36:57.347 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_2_bytes": 0, 2024-09-10T23:36:57.347 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_2_items": 0 2024-09-10T23:36:57.347 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.347 INFO:teuthology.orchestra.run.smithi038.stdout: "objecter": { 2024-09-10T23:36:57.347 INFO:teuthology.orchestra.run.smithi038.stdout: "op_active": 0, 2024-09-10T23:36:57.347 INFO:teuthology.orchestra.run.smithi038.stdout: "op_laggy": 0, 2024-09-10T23:36:57.347 INFO:teuthology.orchestra.run.smithi038.stdout: "op_send": 811, 2024-09-10T23:36:57.347 INFO:teuthology.orchestra.run.smithi038.stdout: "op_send_bytes": 915380, 2024-09-10T23:36:57.347 INFO:teuthology.orchestra.run.smithi038.stdout: "op_resend": 37, 2024-09-10T23:36:57.347 INFO:teuthology.orchestra.run.smithi038.stdout: "op_reply": 811, 2024-09-10T23:36:57.347 INFO:teuthology.orchestra.run.smithi038.stdout: "op_latency": { 2024-09-10T23:36:57.347 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 811, 2024-09-10T23:36:57.348 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 22.885552846, 2024-09-10T23:36:57.348 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.028218930 2024-09-10T23:36:57.348 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.348 INFO:teuthology.orchestra.run.smithi038.stdout: "op_inflight": 0, 2024-09-10T23:36:57.348 INFO:teuthology.orchestra.run.smithi038.stdout: "oplen_avg": { 2024-09-10T23:36:57.348 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 811, 2024-09-10T23:36:57.348 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 858 2024-09-10T23:36:57.348 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.348 INFO:teuthology.orchestra.run.smithi038.stdout: "op": 811, 2024-09-10T23:36:57.348 INFO:teuthology.orchestra.run.smithi038.stdout: "op_r": 1, 2024-09-10T23:36:57.348 INFO:teuthology.orchestra.run.smithi038.stdout: "op_w": 810, 2024-09-10T23:36:57.348 INFO:teuthology.orchestra.run.smithi038.stdout: "op_rmw": 0, 2024-09-10T23:36:57.348 INFO:teuthology.orchestra.run.smithi038.stdout: "op_pg": 0, 2024-09-10T23:36:57.348 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_stat": 0, 2024-09-10T23:36:57.348 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_create": 11, 2024-09-10T23:36:57.349 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_read": 1, 2024-09-10T23:36:57.349 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_write": 152, 2024-09-10T23:36:57.349 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_writefull": 29, 2024-09-10T23:36:57.349 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_writesame": 0, 2024-09-10T23:36:57.349 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_append": 0, 2024-09-10T23:36:57.349 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_zero": 0, 2024-09-10T23:36:57.349 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_truncate": 0, 2024-09-10T23:36:57.349 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_delete": 583, 2024-09-10T23:36:57.349 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_mapext": 0, 2024-09-10T23:36:57.349 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_sparse_read": 0, 2024-09-10T23:36:57.349 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_clonerange": 0, 2024-09-10T23:36:57.349 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_getxattr": 0, 2024-09-10T23:36:57.349 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_setxattr": 22, 2024-09-10T23:36:57.349 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_cmpxattr": 0, 2024-09-10T23:36:57.350 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_rmxattr": 0, 2024-09-10T23:36:57.350 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_resetxattrs": 0, 2024-09-10T23:36:57.350 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_call": 0, 2024-09-10T23:36:57.350 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_watch": 0, 2024-09-10T23:36:57.350 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_notify": 0, 2024-09-10T23:36:57.350 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T23:36:57.350 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_pgls": 0, 2024-09-10T23:36:57.350 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_pgls_filter": 0, 2024-09-10T23:36:57.350 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_other": 0, 2024-09-10T23:36:57.350 INFO:teuthology.orchestra.run.smithi038.stdout: "linger_active": 0, 2024-09-10T23:36:57.350 INFO:teuthology.orchestra.run.smithi038.stdout: "linger_send": 0, 2024-09-10T23:36:57.350 INFO:teuthology.orchestra.run.smithi038.stdout: "linger_resend": 0, 2024-09-10T23:36:57.350 INFO:teuthology.orchestra.run.smithi038.stdout: "linger_ping": 0, 2024-09-10T23:36:57.350 INFO:teuthology.orchestra.run.smithi038.stdout: "poolop_active": 0, 2024-09-10T23:36:57.350 INFO:teuthology.orchestra.run.smithi038.stdout: "poolop_send": 0, 2024-09-10T23:36:57.351 INFO:teuthology.orchestra.run.smithi038.stdout: "poolop_resend": 0, 2024-09-10T23:36:57.351 INFO:teuthology.orchestra.run.smithi038.stdout: "poolstat_active": 0, 2024-09-10T23:36:57.351 INFO:teuthology.orchestra.run.smithi038.stdout: "poolstat_send": 0, 2024-09-10T23:36:57.351 INFO:teuthology.orchestra.run.smithi038.stdout: "poolstat_resend": 0, 2024-09-10T23:36:57.351 INFO:teuthology.orchestra.run.smithi038.stdout: "statfs_active": 0, 2024-09-10T23:36:57.351 INFO:teuthology.orchestra.run.smithi038.stdout: "statfs_send": 0, 2024-09-10T23:36:57.351 INFO:teuthology.orchestra.run.smithi038.stdout: "statfs_resend": 0, 2024-09-10T23:36:57.351 INFO:teuthology.orchestra.run.smithi038.stdout: "command_active": 0, 2024-09-10T23:36:57.351 INFO:teuthology.orchestra.run.smithi038.stdout: "command_send": 0, 2024-09-10T23:36:57.351 INFO:teuthology.orchestra.run.smithi038.stdout: "command_resend": 0, 2024-09-10T23:36:57.351 INFO:teuthology.orchestra.run.smithi038.stdout: "map_epoch": 98, 2024-09-10T23:36:57.351 INFO:teuthology.orchestra.run.smithi038.stdout: "map_full": 0, 2024-09-10T23:36:57.351 INFO:teuthology.orchestra.run.smithi038.stdout: "map_inc": 19, 2024-09-10T23:36:57.351 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_sessions": 12, 2024-09-10T23:36:57.351 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_session_open": 12, 2024-09-10T23:36:57.351 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_session_close": 0, 2024-09-10T23:36:57.352 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_laggy": 0, 2024-09-10T23:36:57.352 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_wr": 50, 2024-09-10T23:36:57.352 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_rd": 0, 2024-09-10T23:36:57.352 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_del": 10 2024-09-10T23:36:57.352 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.352 INFO:teuthology.orchestra.run.smithi038.stdout: "oft": { 2024-09-10T23:36:57.352 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_total_objs": 1, 2024-09-10T23:36:57.352 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_total_kv_pairs": 0, 2024-09-10T23:36:57.352 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_total_updates": 0, 2024-09-10T23:36:57.352 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_total_removes": 0 2024-09-10T23:36:57.352 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.352 INFO:teuthology.orchestra.run.smithi038.stdout: "purge_queue": { 2024-09-10T23:36:57.352 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executing_ops": 0, 2024-09-10T23:36:57.352 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executing_ops_high_water": 69, 2024-09-10T23:36:57.352 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executing": 0, 2024-09-10T23:36:57.353 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executing_high_water": 3, 2024-09-10T23:36:57.353 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executed_ops": 71, 2024-09-10T23:36:57.353 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executed": 4, 2024-09-10T23:36:57.353 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_item_in_journal": 0 2024-09-10T23:36:57.353 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.353 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:36:57.353 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-10T23:36:57.353 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 104857600, 2024-09-10T23:36:57.353 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-10T23:36:57.353 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 3807, 2024-09-10T23:36:57.353 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 2193525, 2024-09-10T23:36:57.353 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:57.353 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 3807, 2024-09-10T23:36:57.353 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 0, 2024-09-10T23:36:57.354 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 0, 2024-09-10T23:36:57.354 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 3807, 2024-09-10T23:36:57.354 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 2193525, 2024-09-10T23:36:57.354 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-10T23:36:57.354 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:57.354 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:57.354 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:57.354 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:36:57.354 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.354 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-objecter_bytes": { 2024-09-10T23:36:57.354 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-10T23:36:57.354 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 104857600, 2024-09-10T23:36:57.354 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-10T23:36:57.354 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 0, 2024-09-10T23:36:57.355 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 0, 2024-09-10T23:36:57.355 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:57.355 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:57.355 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 811, 2024-09-10T23:36:57.355 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 915848, 2024-09-10T23:36:57.355 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 811, 2024-09-10T23:36:57.355 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 915848, 2024-09-10T23:36:57.355 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-10T23:36:57.355 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:57.355 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:57.355 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:57.355 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:36:57.355 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.355 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-objecter_ops": { 2024-09-10T23:36:57.356 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-10T23:36:57.356 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 1024, 2024-09-10T23:36:57.356 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-10T23:36:57.356 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 0, 2024-09-10T23:36:57.356 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 0, 2024-09-10T23:36:57.356 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:57.356 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:57.356 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 811, 2024-09-10T23:36:57.356 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 811, 2024-09-10T23:36:57.356 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 811, 2024-09-10T23:36:57.356 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 811, 2024-09-10T23:36:57.356 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-10T23:36:57.356 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:57.356 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:57.357 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:57.357 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:36:57.357 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.357 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-write_buf_throttle": { 2024-09-10T23:36:57.357 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-10T23:36:57.357 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 3758096384, 2024-09-10T23:36:57.357 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-10T23:36:57.357 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 4, 2024-09-10T23:36:57.357 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 468, 2024-09-10T23:36:57.357 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:57.357 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 4, 2024-09-10T23:36:57.357 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 0, 2024-09-10T23:36:57.357 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 0, 2024-09-10T23:36:57.357 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 1, 2024-09-10T23:36:57.357 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 468, 2024-09-10T23:36:57.358 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-10T23:36:57.358 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:57.358 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:57.358 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:57.358 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:36:57.358 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.358 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-write_buf_throttle-0x562954ed6960": { 2024-09-10T23:36:57.358 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-10T23:36:57.358 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 3758096384, 2024-09-10T23:36:57.358 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-10T23:36:57.358 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 192, 2024-09-10T23:36:57.358 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 898351, 2024-09-10T23:36:57.358 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:57.358 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 192, 2024-09-10T23:36:57.358 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 0, 2024-09-10T23:36:57.359 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 0, 2024-09-10T23:36:57.359 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 151, 2024-09-10T23:36:57.359 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 898351, 2024-09-10T23:36:57.359 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-10T23:36:57.359 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:57.359 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:57.359 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:57.359 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:36:57.359 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:57.359 INFO:teuthology.orchestra.run.smithi038.stdout: "trackedop": { 2024-09-10T23:36:57.359 INFO:teuthology.orchestra.run.smithi038.stdout: "slow_ops_count": 49 2024-09-10T23:36:57.359 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:36:57.359 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-10T23:36:58.251 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-09-10T23:36:58.252 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-09-10T23:36:58.252 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=11 2024-09-10T23:36:58.252 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2024-09-10T23:36:58.252 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-10T23:36:58.252 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=10 2024-09-10T23:36:58.252 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=4 2024-09-10T23:36:58.252 DEBUG:tasks.check_counter:Getting stats from e 2024-09-10T23:36:58.252 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-10T23:36:58.597 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:36:58 smithi038 ceph-mon[34225]: pgmap v704: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-10T23:36:58.633 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:36:58.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:36:58 smithi194 ceph-mon[33904]: pgmap v704: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-10T23:36:58.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:36:58 smithi003 ceph-mon[30348]: pgmap v704: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-10T23:36:59.213 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-10T23:36:59.213 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:36:59.213 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 426, 2024-09-10T23:36:59.213 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 519, 2024-09-10T23:36:59.214 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 127116, 2024-09-10T23:36:59.214 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 239264, 2024-09-10T23:36:59.214 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 10, 2024-09-10T23:36:59.214 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 3, 2024-09-10T23:36:59.214 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.103414579, 2024-09-10T23:36:59.214 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.059108081, 2024-09-10T23:36:59.214 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.036731132, 2024-09-10T23:36:59.214 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.003420684, 2024-09-10T23:36:59.214 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:59.214 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 517, 2024-09-10T23:36:59.214 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.069389625, 2024-09-10T23:36:59.214 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000134215 2024-09-10T23:36:59.215 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.215 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:59.215 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 890, 2024-09-10T23:36:59.215 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000245278, 2024-09-10T23:36:59.215 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000275 2024-09-10T23:36:59.215 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.215 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T23:36:59.215 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T23:36:59.215 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.215 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:36:59.215 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 39, 2024-09-10T23:36:59.215 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 219, 2024-09-10T23:36:59.215 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 8996, 2024-09-10T23:36:59.216 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 371959, 2024-09-10T23:36:59.216 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 11, 2024-09-10T23:36:59.216 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 5, 2024-09-10T23:36:59.216 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.024917412, 2024-09-10T23:36:59.216 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.013996945, 2024-09-10T23:36:59.216 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.007616475, 2024-09-10T23:36:59.216 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.000646058, 2024-09-10T23:36:59.216 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:59.216 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 217, 2024-09-10T23:36:59.216 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.036649175, 2024-09-10T23:36:59.216 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000168890 2024-09-10T23:36:59.216 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.216 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:59.217 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 45, 2024-09-10T23:36:59.217 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000013588, 2024-09-10T23:36:59.217 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000301 2024-09-10T23:36:59.217 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.217 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 1744, 2024-09-10T23:36:59.217 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 326896 2024-09-10T23:36:59.217 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.217 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:36:59.217 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 300, 2024-09-10T23:36:59.217 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 289, 2024-09-10T23:36:59.217 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 1189446, 2024-09-10T23:36:59.218 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 177121, 2024-09-10T23:36:59.218 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 8, 2024-09-10T23:36:59.218 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 5, 2024-09-10T23:36:59.218 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.070652742, 2024-09-10T23:36:59.218 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.031049686, 2024-09-10T23:36:59.218 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.052745008, 2024-09-10T23:36:59.218 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.000176206, 2024-09-10T23:36:59.218 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:36:59.218 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 289, 2024-09-10T23:36:59.218 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.042398683, 2024-09-10T23:36:59.218 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000146708 2024-09-10T23:36:59.219 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.219 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:36:59.219 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 25, 2024-09-10T23:36:59.219 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000005053, 2024-09-10T23:36:59.219 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000202 2024-09-10T23:36:59.219 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.219 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 1187264, 2024-09-10T23:36:59.219 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 148432 2024-09-10T23:36:59.219 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.219 INFO:teuthology.orchestra.run.smithi038.stdout: "cct": { 2024-09-10T23:36:59.219 INFO:teuthology.orchestra.run.smithi038.stdout: "total_workers": 1, 2024-09-10T23:36:59.219 INFO:teuthology.orchestra.run.smithi038.stdout: "unhealthy_workers": 0 2024-09-10T23:36:59.219 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.220 INFO:teuthology.orchestra.run.smithi038.stdout: "finisher-MDSRank": { 2024-09-10T23:36:59.220 INFO:teuthology.orchestra.run.smithi038.stdout: "queue_len": 0, 2024-09-10T23:36:59.220 INFO:teuthology.orchestra.run.smithi038.stdout: "complete_latency": { 2024-09-10T23:36:59.220 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 59, 2024-09-10T23:36:59.220 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.001837633, 2024-09-10T23:36:59.220 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000031146 2024-09-10T23:36:59.220 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:36:59.220 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.220 INFO:teuthology.orchestra.run.smithi038.stdout: "finisher-PurgeQueue": { 2024-09-10T23:36:59.220 INFO:teuthology.orchestra.run.smithi038.stdout: "queue_len": 0, 2024-09-10T23:36:59.220 INFO:teuthology.orchestra.run.smithi038.stdout: "complete_latency": { 2024-09-10T23:36:59.220 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 2, 2024-09-10T23:36:59.221 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000038879, 2024-09-10T23:36:59.221 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000019439 2024-09-10T23:36:59.221 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:36:59.221 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.221 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2024-09-10T23:36:59.221 INFO:teuthology.orchestra.run.smithi038.stdout: "request": 6, 2024-09-10T23:36:59.221 INFO:teuthology.orchestra.run.smithi038.stdout: "reply": 4, 2024-09-10T23:36:59.221 INFO:teuthology.orchestra.run.smithi038.stdout: "reply_latency": { 2024-09-10T23:36:59.221 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 4, 2024-09-10T23:36:59.221 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.001314612, 2024-09-10T23:36:59.221 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000328653 2024-09-10T23:36:59.221 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.221 INFO:teuthology.orchestra.run.smithi038.stdout: "slow_reply": 0, 2024-09-10T23:36:59.222 INFO:teuthology.orchestra.run.smithi038.stdout: "forward": 2, 2024-09-10T23:36:59.222 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_fetch_complete": 0, 2024-09-10T23:36:59.222 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_fetch_keys": 0, 2024-09-10T23:36:59.222 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_commit": 11, 2024-09-10T23:36:59.222 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_split": 0, 2024-09-10T23:36:59.222 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_merge": 0, 2024-09-10T23:36:59.222 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes": 16, 2024-09-10T23:36:59.222 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_top": 0, 2024-09-10T23:36:59.222 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_bottom": 16, 2024-09-10T23:36:59.222 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_pin_tail": 0, 2024-09-10T23:36:59.222 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_pinned": 13, 2024-09-10T23:36:59.222 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_expired": 4, 2024-09-10T23:36:59.222 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_with_caps": 0, 2024-09-10T23:36:59.223 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": 0, 2024-09-10T23:36:59.223 INFO:teuthology.orchestra.run.smithi038.stdout: "subtrees": 3, 2024-09-10T23:36:59.223 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse": 26, 2024-09-10T23:36:59.223 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_hit": 19, 2024-09-10T23:36:59.223 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_forward": 0, 2024-09-10T23:36:59.223 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_discover": 6, 2024-09-10T23:36:59.223 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_dir_fetch": 0, 2024-09-10T23:36:59.223 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_remote_ino": 0, 2024-09-10T23:36:59.223 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_lock": 0, 2024-09-10T23:36:59.223 INFO:teuthology.orchestra.run.smithi038.stdout: "load_cent": 0, 2024-09-10T23:36:59.223 INFO:teuthology.orchestra.run.smithi038.stdout: "q": 0, 2024-09-10T23:36:59.223 INFO:teuthology.orchestra.run.smithi038.stdout: "exported": 0, 2024-09-10T23:36:59.223 INFO:teuthology.orchestra.run.smithi038.stdout: "exported_inodes": 0, 2024-09-10T23:36:59.224 INFO:teuthology.orchestra.run.smithi038.stdout: "imported": 0, 2024-09-10T23:36:59.224 INFO:teuthology.orchestra.run.smithi038.stdout: "imported_inodes": 0, 2024-09-10T23:36:59.224 INFO:teuthology.orchestra.run.smithi038.stdout: "openino_dir_fetch": 0, 2024-09-10T23:36:59.224 INFO:teuthology.orchestra.run.smithi038.stdout: "openino_backtrace_fetch": 0, 2024-09-10T23:36:59.224 INFO:teuthology.orchestra.run.smithi038.stdout: "openino_peer_discover": 0, 2024-09-10T23:36:59.224 INFO:teuthology.orchestra.run.smithi038.stdout: "root_rfiles": 8, 2024-09-10T23:36:59.224 INFO:teuthology.orchestra.run.smithi038.stdout: "root_rbytes": 195290466, 2024-09-10T23:36:59.224 INFO:teuthology.orchestra.run.smithi038.stdout: "root_rsnaps": 2, 2024-09-10T23:36:59.224 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T23:36:59.224 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_set_tag": 0, 2024-09-10T23:36:59.224 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T23:36:59.224 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_inotable_repaired": 0, 2024-09-10T23:36:59.225 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_dir_inodes": 0, 2024-09-10T23:36:59.225 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T23:36:59.225 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T23:36:59.225 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_file_inodes": 0, 2024-09-10T23:36:59.225 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_inode_file_caps": 0, 2024-09-10T23:36:59.225 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_revoke": 3, 2024-09-10T23:36:59.225 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_grant": 0, 2024-09-10T23:36:59.225 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T23:36:59.225 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T23:36:59.225 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T23:36:59.225 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_caps": 3, 2024-09-10T23:36:59.225 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_caps_dirty": 0, 2024-09-10T23:36:59.225 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_cap_release": 0, 2024-09-10T23:36:59.226 INFO:teuthology.orchestra.run.smithi038.stdout: "process_request_cap_release": 1 2024-09-10T23:36:59.226 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.226 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_cache": { 2024-09-10T23:36:59.226 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_update": 0, 2024-09-10T23:36:59.226 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_update_receipt": 15, 2024-09-10T23:36:59.226 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_try_discover": 10, 2024-09-10T23:36:59.226 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_send_discover": 12, 2024-09-10T23:36:59.226 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_handle_discover": 0, 2024-09-10T23:36:59.226 INFO:teuthology.orchestra.run.smithi038.stdout: "num_strays": 0, 2024-09-10T23:36:59.226 INFO:teuthology.orchestra.run.smithi038.stdout: "num_strays_delayed": 0, 2024-09-10T23:36:59.226 INFO:teuthology.orchestra.run.smithi038.stdout: "num_strays_enqueuing": 0, 2024-09-10T23:36:59.226 INFO:teuthology.orchestra.run.smithi038.stdout: "strays_created": 0, 2024-09-10T23:36:59.226 INFO:teuthology.orchestra.run.smithi038.stdout: "strays_enqueued": 0, 2024-09-10T23:36:59.226 INFO:teuthology.orchestra.run.smithi038.stdout: "strays_reintegrated": 0, 2024-09-10T23:36:59.226 INFO:teuthology.orchestra.run.smithi038.stdout: "strays_migrated": 0, 2024-09-10T23:36:59.227 INFO:teuthology.orchestra.run.smithi038.stdout: "num_recovering_processing": 0, 2024-09-10T23:36:59.227 INFO:teuthology.orchestra.run.smithi038.stdout: "num_recovering_enqueued": 0, 2024-09-10T23:36:59.227 INFO:teuthology.orchestra.run.smithi038.stdout: "num_recovering_prioritized": 0, 2024-09-10T23:36:59.227 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_started": 0, 2024-09-10T23:36:59.227 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_completed": 0, 2024-09-10T23:36:59.227 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_quiesce_path": 3, 2024-09-10T23:36:59.227 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_quiesce_inode": 17, 2024-09-10T23:36:59.227 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T23:36:59.227 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_exportdir": 0, 2024-09-10T23:36:59.227 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_flush": 0, 2024-09-10T23:36:59.227 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_fragmentdir": 0, 2024-09-10T23:36:59.227 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_fragstats": 0, 2024-09-10T23:36:59.227 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_inodestats": 0, 2024-09-10T23:36:59.228 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-10T23:36:59.228 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_succeeded": 0, 2024-09-10T23:36:59.228 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_write_failed": 0 2024-09-10T23:36:59.228 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.228 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_log": { 2024-09-10T23:36:59.228 INFO:teuthology.orchestra.run.smithi038.stdout: "evlrg": 0, 2024-09-10T23:36:59.228 INFO:teuthology.orchestra.run.smithi038.stdout: "evadd": 7, 2024-09-10T23:36:59.228 INFO:teuthology.orchestra.run.smithi038.stdout: "evex": 0, 2024-09-10T23:36:59.228 INFO:teuthology.orchestra.run.smithi038.stdout: "evtrm": 0, 2024-09-10T23:36:59.228 INFO:teuthology.orchestra.run.smithi038.stdout: "ev": 7, 2024-09-10T23:36:59.228 INFO:teuthology.orchestra.run.smithi038.stdout: "evexg": 0, 2024-09-10T23:36:59.228 INFO:teuthology.orchestra.run.smithi038.stdout: "evexd": 0, 2024-09-10T23:36:59.228 INFO:teuthology.orchestra.run.smithi038.stdout: "segadd": 2, 2024-09-10T23:36:59.228 INFO:teuthology.orchestra.run.smithi038.stdout: "segex": 0, 2024-09-10T23:36:59.229 INFO:teuthology.orchestra.run.smithi038.stdout: "segtrm": 0, 2024-09-10T23:36:59.229 INFO:teuthology.orchestra.run.smithi038.stdout: "seg": 2, 2024-09-10T23:36:59.229 INFO:teuthology.orchestra.run.smithi038.stdout: "segmjr": 2, 2024-09-10T23:36:59.229 INFO:teuthology.orchestra.run.smithi038.stdout: "segexg": 0, 2024-09-10T23:36:59.229 INFO:teuthology.orchestra.run.smithi038.stdout: "segexd": 0, 2024-09-10T23:36:59.229 INFO:teuthology.orchestra.run.smithi038.stdout: "expos": 4194304, 2024-09-10T23:36:59.229 INFO:teuthology.orchestra.run.smithi038.stdout: "wrpos": 4196449, 2024-09-10T23:36:59.229 INFO:teuthology.orchestra.run.smithi038.stdout: "rdpos": 0, 2024-09-10T23:36:59.229 INFO:teuthology.orchestra.run.smithi038.stdout: "jlat": { 2024-09-10T23:36:59.229 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 6, 2024-09-10T23:36:59.229 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.014024579, 2024-09-10T23:36:59.229 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.002337429 2024-09-10T23:36:59.229 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.229 INFO:teuthology.orchestra.run.smithi038.stdout: "replayed": 0 2024-09-10T23:36:59.230 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.230 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_mem": { 2024-09-10T23:36:59.230 INFO:teuthology.orchestra.run.smithi038.stdout: "ino": 20, 2024-09-10T23:36:59.230 INFO:teuthology.orchestra.run.smithi038.stdout: "ino+": 22, 2024-09-10T23:36:59.230 INFO:teuthology.orchestra.run.smithi038.stdout: "ino-": 2, 2024-09-10T23:36:59.230 INFO:teuthology.orchestra.run.smithi038.stdout: "dir": 19, 2024-09-10T23:36:59.230 INFO:teuthology.orchestra.run.smithi038.stdout: "dir+": 22, 2024-09-10T23:36:59.230 INFO:teuthology.orchestra.run.smithi038.stdout: "dir-": 3, 2024-09-10T23:36:59.230 INFO:teuthology.orchestra.run.smithi038.stdout: "dn": 16, 2024-09-10T23:36:59.230 INFO:teuthology.orchestra.run.smithi038.stdout: "dn+": 20, 2024-09-10T23:36:59.230 INFO:teuthology.orchestra.run.smithi038.stdout: "dn-": 4, 2024-09-10T23:36:59.230 INFO:teuthology.orchestra.run.smithi038.stdout: "cap": 0, 2024-09-10T23:36:59.230 INFO:teuthology.orchestra.run.smithi038.stdout: "cap+": 4, 2024-09-10T23:36:59.231 INFO:teuthology.orchestra.run.smithi038.stdout: "cap-": 4, 2024-09-10T23:36:59.231 INFO:teuthology.orchestra.run.smithi038.stdout: "rss": 49304, 2024-09-10T23:36:59.231 INFO:teuthology.orchestra.run.smithi038.stdout: "heap": 258727936 2024-09-10T23:36:59.231 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.231 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_server": { 2024-09-10T23:36:59.231 INFO:teuthology.orchestra.run.smithi038.stdout: "dispatch_client_request": 7, 2024-09-10T23:36:59.231 INFO:teuthology.orchestra.run.smithi038.stdout: "dispatch_server_request": 0, 2024-09-10T23:36:59.231 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_request": 6, 2024-09-10T23:36:59.231 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_session": 17, 2024-09-10T23:36:59.231 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_peer_request": 0, 2024-09-10T23:36:59.231 INFO:teuthology.orchestra.run.smithi038.stdout: "req_create_latency": { 2024-09-10T23:36:59.231 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:59.231 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:59.231 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:59.231 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.232 INFO:teuthology.orchestra.run.smithi038.stdout: "req_getattr_latency": { 2024-09-10T23:36:59.232 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 2, 2024-09-10T23:36:59.232 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000491425, 2024-09-10T23:36:59.232 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000245712 2024-09-10T23:36:59.232 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.232 INFO:teuthology.orchestra.run.smithi038.stdout: "req_getfilelock_latency": { 2024-09-10T23:36:59.232 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:59.232 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:59.232 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:59.232 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.232 INFO:teuthology.orchestra.run.smithi038.stdout: "req_link_latency": { 2024-09-10T23:36:59.232 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:59.232 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:59.233 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:59.233 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.233 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookup_latency": { 2024-09-10T23:36:59.233 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 2, 2024-09-10T23:36:59.233 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000823187, 2024-09-10T23:36:59.233 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000411593 2024-09-10T23:36:59.233 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.233 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookuphash_latency": { 2024-09-10T23:36:59.233 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:59.233 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:59.233 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:59.233 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.233 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookupino_latency": { 2024-09-10T23:36:59.234 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:59.234 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:59.234 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:59.234 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.234 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookupname_latency": { 2024-09-10T23:36:59.234 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:59.234 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:59.234 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:59.234 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.234 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookupparent_latency": { 2024-09-10T23:36:59.234 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:59.234 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:59.234 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:59.234 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.235 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookupsnap_latency": { 2024-09-10T23:36:59.235 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:59.235 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:59.235 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:59.235 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.235 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lssnap_latency": { 2024-09-10T23:36:59.235 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:59.235 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:59.236 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:59.236 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.236 INFO:teuthology.orchestra.run.smithi038.stdout: "req_mkdir_latency": { 2024-09-10T23:36:59.236 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:59.236 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:59.236 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:59.236 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.236 INFO:teuthology.orchestra.run.smithi038.stdout: "req_mknod_latency": { 2024-09-10T23:36:59.236 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:59.236 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:59.237 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:59.237 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.237 INFO:teuthology.orchestra.run.smithi038.stdout: "req_mksnap_latency": { 2024-09-10T23:36:59.237 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:59.237 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:59.237 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:59.237 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.237 INFO:teuthology.orchestra.run.smithi038.stdout: "req_open_latency": { 2024-09-10T23:36:59.237 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:59.237 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:59.237 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:59.237 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.237 INFO:teuthology.orchestra.run.smithi038.stdout: "req_readdir_latency": { 2024-09-10T23:36:59.238 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:59.238 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:59.238 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:59.238 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.238 INFO:teuthology.orchestra.run.smithi038.stdout: "req_rename_latency": { 2024-09-10T23:36:59.238 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:59.238 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:59.238 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:59.238 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.238 INFO:teuthology.orchestra.run.smithi038.stdout: "req_renamesnap_latency": { 2024-09-10T23:36:59.238 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:59.238 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:59.238 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:59.238 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.239 INFO:teuthology.orchestra.run.smithi038.stdout: "req_snapdiff_latency": { 2024-09-10T23:36:59.239 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:59.239 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:59.239 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:59.239 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.239 INFO:teuthology.orchestra.run.smithi038.stdout: "req_rmdir_latency": { 2024-09-10T23:36:59.239 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:59.239 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:59.239 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:59.239 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.239 INFO:teuthology.orchestra.run.smithi038.stdout: "req_rmsnap_latency": { 2024-09-10T23:36:59.239 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:59.239 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:59.240 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:59.240 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.240 INFO:teuthology.orchestra.run.smithi038.stdout: "req_rmxattr_latency": { 2024-09-10T23:36:59.240 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:59.240 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:59.240 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:59.240 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.240 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setattr_latency": { 2024-09-10T23:36:59.240 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:59.240 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:59.240 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:59.240 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.240 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setdirlayout_latency": { 2024-09-10T23:36:59.241 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:59.241 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:59.241 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:59.241 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.241 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setfilelock_latency": { 2024-09-10T23:36:59.241 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:59.241 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:59.241 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:59.241 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.241 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setlayout_latency": { 2024-09-10T23:36:59.241 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:59.241 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:59.241 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:59.242 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.242 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setxattr_latency": { 2024-09-10T23:36:59.242 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:59.242 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:59.242 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:59.242 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.242 INFO:teuthology.orchestra.run.smithi038.stdout: "req_symlink_latency": { 2024-09-10T23:36:59.242 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:59.242 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:59.242 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:59.242 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.242 INFO:teuthology.orchestra.run.smithi038.stdout: "req_unlink_latency": { 2024-09-10T23:36:59.242 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:59.243 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:59.243 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:59.243 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.243 INFO:teuthology.orchestra.run.smithi038.stdout: "cap_revoke_eviction": 0, 2024-09-10T23:36:59.243 INFO:teuthology.orchestra.run.smithi038.stdout: "cap_acquisition_throttle": 0, 2024-09-10T23:36:59.243 INFO:teuthology.orchestra.run.smithi038.stdout: "req_getvxattr_latency": { 2024-09-10T23:36:59.243 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:59.243 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:59.243 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:59.243 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:36:59.243 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.243 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_sessions": { 2024-09-10T23:36:59.244 INFO:teuthology.orchestra.run.smithi038.stdout: "session_count": 1, 2024-09-10T23:36:59.244 INFO:teuthology.orchestra.run.smithi038.stdout: "session_add": 3, 2024-09-10T23:36:59.244 INFO:teuthology.orchestra.run.smithi038.stdout: "session_remove": 2, 2024-09-10T23:36:59.244 INFO:teuthology.orchestra.run.smithi038.stdout: "sessions_open": 1, 2024-09-10T23:36:59.244 INFO:teuthology.orchestra.run.smithi038.stdout: "sessions_stale": 0, 2024-09-10T23:36:59.244 INFO:teuthology.orchestra.run.smithi038.stdout: "total_load": 3, 2024-09-10T23:36:59.244 INFO:teuthology.orchestra.run.smithi038.stdout: "average_load": 1, 2024-09-10T23:36:59.244 INFO:teuthology.orchestra.run.smithi038.stdout: "avg_session_uptime": 614, 2024-09-10T23:36:59.244 INFO:teuthology.orchestra.run.smithi038.stdout: "mdthresh_evicted": 0 2024-09-10T23:36:59.244 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.244 INFO:teuthology.orchestra.run.smithi038.stdout: "mempool": { 2024-09-10T23:36:59.244 INFO:teuthology.orchestra.run.smithi038.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:36:59.244 INFO:teuthology.orchestra.run.smithi038.stdout: "bloom_filter_items": 0, 2024-09-10T23:36:59.244 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:36:59.245 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:36:59.245 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:36:59.245 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:36:59.245 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:36:59.245 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:36:59.245 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:36:59.245 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:36:59.245 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:36:59.245 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:36:59.245 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:36:59.245 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:36:59.245 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:36:59.245 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_extent_items": 0, 2024-09-10T23:36:59.246 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:36:59.246 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_blob_items": 0, 2024-09-10T23:36:59.246 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:36:59.246 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:36:59.246 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:36:59.246 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:36:59.246 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:36:59.246 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:36:59.246 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:36:59.246 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_txc_items": 0, 2024-09-10T23:36:59.246 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:36:59.246 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:36:59.246 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:36:59.247 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_items": 0, 2024-09-10T23:36:59.247 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_bytes": 0, 2024-09-10T23:36:59.247 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_items": 0, 2024-09-10T23:36:59.247 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:36:59.247 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:36:59.247 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:36:59.247 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:36:59.247 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_anon_bytes": 254151, 2024-09-10T23:36:59.247 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_anon_items": 80, 2024-09-10T23:36:59.247 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:36:59.247 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_meta_items": 0, 2024-09-10T23:36:59.247 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_bytes": 0, 2024-09-10T23:36:59.247 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_items": 0, 2024-09-10T23:36:59.247 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:36:59.248 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mapbl_items": 0, 2024-09-10T23:36:59.248 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:36:59.248 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pglog_items": 0, 2024-09-10T23:36:59.248 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_bytes": 9648, 2024-09-10T23:36:59.248 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_items": 196, 2024-09-10T23:36:59.248 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:36:59.248 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:36:59.248 INFO:teuthology.orchestra.run.smithi038.stdout: "pgmap_bytes": 0, 2024-09-10T23:36:59.248 INFO:teuthology.orchestra.run.smithi038.stdout: "pgmap_items": 0, 2024-09-10T23:36:59.248 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_co_bytes": 83261, 2024-09-10T23:36:59.248 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_co_items": 341, 2024-09-10T23:36:59.248 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_1_bytes": 0, 2024-09-10T23:36:59.248 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_1_items": 0, 2024-09-10T23:36:59.249 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_2_bytes": 0, 2024-09-10T23:36:59.249 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_2_items": 0 2024-09-10T23:36:59.249 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.249 INFO:teuthology.orchestra.run.smithi038.stdout: "objecter": { 2024-09-10T23:36:59.249 INFO:teuthology.orchestra.run.smithi038.stdout: "op_active": 0, 2024-09-10T23:36:59.249 INFO:teuthology.orchestra.run.smithi038.stdout: "op_laggy": 0, 2024-09-10T23:36:59.249 INFO:teuthology.orchestra.run.smithi038.stdout: "op_send": 45, 2024-09-10T23:36:59.249 INFO:teuthology.orchestra.run.smithi038.stdout: "op_send_bytes": 12762, 2024-09-10T23:36:59.249 INFO:teuthology.orchestra.run.smithi038.stdout: "op_resend": 33, 2024-09-10T23:36:59.249 INFO:teuthology.orchestra.run.smithi038.stdout: "op_reply": 45, 2024-09-10T23:36:59.249 INFO:teuthology.orchestra.run.smithi038.stdout: "op_latency": { 2024-09-10T23:36:59.249 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 45, 2024-09-10T23:36:59.250 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.301994077, 2024-09-10T23:36:59.250 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.006710979 2024-09-10T23:36:59.250 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.250 INFO:teuthology.orchestra.run.smithi038.stdout: "op_inflight": 0, 2024-09-10T23:36:59.250 INFO:teuthology.orchestra.run.smithi038.stdout: "oplen_avg": { 2024-09-10T23:36:59.250 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 45, 2024-09-10T23:36:59.250 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 69 2024-09-10T23:36:59.250 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.250 INFO:teuthology.orchestra.run.smithi038.stdout: "op": 45, 2024-09-10T23:36:59.250 INFO:teuthology.orchestra.run.smithi038.stdout: "op_r": 0, 2024-09-10T23:36:59.250 INFO:teuthology.orchestra.run.smithi038.stdout: "op_w": 45, 2024-09-10T23:36:59.250 INFO:teuthology.orchestra.run.smithi038.stdout: "op_rmw": 0, 2024-09-10T23:36:59.250 INFO:teuthology.orchestra.run.smithi038.stdout: "op_pg": 0, 2024-09-10T23:36:59.250 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_stat": 0, 2024-09-10T23:36:59.251 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_create": 10, 2024-09-10T23:36:59.251 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_read": 0, 2024-09-10T23:36:59.251 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_write": 6, 2024-09-10T23:36:59.251 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_writefull": 8, 2024-09-10T23:36:59.251 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_writesame": 0, 2024-09-10T23:36:59.251 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_append": 0, 2024-09-10T23:36:59.251 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_zero": 0, 2024-09-10T23:36:59.251 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_truncate": 0, 2024-09-10T23:36:59.251 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_delete": 6, 2024-09-10T23:36:59.251 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_mapext": 0, 2024-09-10T23:36:59.251 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_sparse_read": 0, 2024-09-10T23:36:59.251 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_clonerange": 0, 2024-09-10T23:36:59.251 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_getxattr": 0, 2024-09-10T23:36:59.251 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_setxattr": 20, 2024-09-10T23:36:59.252 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_cmpxattr": 0, 2024-09-10T23:36:59.252 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_rmxattr": 0, 2024-09-10T23:36:59.252 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_resetxattrs": 0, 2024-09-10T23:36:59.252 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_call": 0, 2024-09-10T23:36:59.252 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_watch": 0, 2024-09-10T23:36:59.252 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_notify": 0, 2024-09-10T23:36:59.252 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T23:36:59.252 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_pgls": 0, 2024-09-10T23:36:59.252 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_pgls_filter": 0, 2024-09-10T23:36:59.252 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_other": 0, 2024-09-10T23:36:59.252 INFO:teuthology.orchestra.run.smithi038.stdout: "linger_active": 0, 2024-09-10T23:36:59.252 INFO:teuthology.orchestra.run.smithi038.stdout: "linger_send": 0, 2024-09-10T23:36:59.252 INFO:teuthology.orchestra.run.smithi038.stdout: "linger_resend": 0, 2024-09-10T23:36:59.252 INFO:teuthology.orchestra.run.smithi038.stdout: "linger_ping": 0, 2024-09-10T23:36:59.253 INFO:teuthology.orchestra.run.smithi038.stdout: "poolop_active": 0, 2024-09-10T23:36:59.253 INFO:teuthology.orchestra.run.smithi038.stdout: "poolop_send": 0, 2024-09-10T23:36:59.253 INFO:teuthology.orchestra.run.smithi038.stdout: "poolop_resend": 0, 2024-09-10T23:36:59.253 INFO:teuthology.orchestra.run.smithi038.stdout: "poolstat_active": 0, 2024-09-10T23:36:59.253 INFO:teuthology.orchestra.run.smithi038.stdout: "poolstat_send": 0, 2024-09-10T23:36:59.253 INFO:teuthology.orchestra.run.smithi038.stdout: "poolstat_resend": 0, 2024-09-10T23:36:59.253 INFO:teuthology.orchestra.run.smithi038.stdout: "statfs_active": 0, 2024-09-10T23:36:59.253 INFO:teuthology.orchestra.run.smithi038.stdout: "statfs_send": 0, 2024-09-10T23:36:59.253 INFO:teuthology.orchestra.run.smithi038.stdout: "statfs_resend": 0, 2024-09-10T23:36:59.253 INFO:teuthology.orchestra.run.smithi038.stdout: "command_active": 0, 2024-09-10T23:36:59.253 INFO:teuthology.orchestra.run.smithi038.stdout: "command_send": 0, 2024-09-10T23:36:59.253 INFO:teuthology.orchestra.run.smithi038.stdout: "command_resend": 0, 2024-09-10T23:36:59.253 INFO:teuthology.orchestra.run.smithi038.stdout: "map_epoch": 98, 2024-09-10T23:36:59.254 INFO:teuthology.orchestra.run.smithi038.stdout: "map_full": 0, 2024-09-10T23:36:59.254 INFO:teuthology.orchestra.run.smithi038.stdout: "map_inc": 10, 2024-09-10T23:36:59.254 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_sessions": 9, 2024-09-10T23:36:59.254 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_session_open": 9, 2024-09-10T23:36:59.254 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_session_close": 0, 2024-09-10T23:36:59.254 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_laggy": 0, 2024-09-10T23:36:59.254 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_wr": 17, 2024-09-10T23:36:59.254 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_rd": 0, 2024-09-10T23:36:59.254 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_del": 2 2024-09-10T23:36:59.254 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.254 INFO:teuthology.orchestra.run.smithi038.stdout: "oft": { 2024-09-10T23:36:59.254 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_total_objs": 1, 2024-09-10T23:36:59.254 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_total_kv_pairs": 0, 2024-09-10T23:36:59.254 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_total_updates": 0, 2024-09-10T23:36:59.254 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_total_removes": 0 2024-09-10T23:36:59.255 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.255 INFO:teuthology.orchestra.run.smithi038.stdout: "purge_queue": { 2024-09-10T23:36:59.255 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executing_ops": 0, 2024-09-10T23:36:59.255 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T23:36:59.255 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executing": 0, 2024-09-10T23:36:59.255 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executing_high_water": 0, 2024-09-10T23:36:59.255 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executed_ops": 0, 2024-09-10T23:36:59.255 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executed": 0, 2024-09-10T23:36:59.255 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_item_in_journal": 0 2024-09-10T23:36:59.255 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.255 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:36:59.255 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-10T23:36:59.255 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 104857600, 2024-09-10T23:36:59.255 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-10T23:36:59.256 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 761, 2024-09-10T23:36:59.256 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 1239325, 2024-09-10T23:36:59.256 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:59.256 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 761, 2024-09-10T23:36:59.256 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 0, 2024-09-10T23:36:59.256 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 0, 2024-09-10T23:36:59.256 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 761, 2024-09-10T23:36:59.256 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 1239325, 2024-09-10T23:36:59.256 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-10T23:36:59.256 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:59.256 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:59.256 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:59.256 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:36:59.257 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.257 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-objecter_bytes": { 2024-09-10T23:36:59.257 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-10T23:36:59.257 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 104857600, 2024-09-10T23:36:59.257 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-10T23:36:59.257 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 0, 2024-09-10T23:36:59.257 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 0, 2024-09-10T23:36:59.257 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:59.257 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:59.257 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 45, 2024-09-10T23:36:59.257 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 12762, 2024-09-10T23:36:59.257 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 45, 2024-09-10T23:36:59.257 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 12762, 2024-09-10T23:36:59.258 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-10T23:36:59.258 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:59.258 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:59.258 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:59.258 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:36:59.258 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.258 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-objecter_ops": { 2024-09-10T23:36:59.258 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-10T23:36:59.258 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 1024, 2024-09-10T23:36:59.258 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-10T23:36:59.258 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 0, 2024-09-10T23:36:59.258 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 0, 2024-09-10T23:36:59.258 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:59.258 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:59.259 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 45, 2024-09-10T23:36:59.259 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 45, 2024-09-10T23:36:59.259 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 45, 2024-09-10T23:36:59.259 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 45, 2024-09-10T23:36:59.259 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-10T23:36:59.259 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:59.259 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:59.259 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:59.259 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:36:59.259 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.259 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-write_buf_throttle": { 2024-09-10T23:36:59.259 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-10T23:36:59.259 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 3758096384, 2024-09-10T23:36:59.259 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-10T23:36:59.260 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 0, 2024-09-10T23:36:59.260 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 0, 2024-09-10T23:36:59.260 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:59.260 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 0, 2024-09-10T23:36:59.260 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 0, 2024-09-10T23:36:59.260 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 0, 2024-09-10T23:36:59.260 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 0, 2024-09-10T23:36:59.260 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 0, 2024-09-10T23:36:59.260 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-10T23:36:59.260 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:59.260 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:59.260 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:59.260 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:36:59.261 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.261 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-write_buf_throttle-0x555649de6960": { 2024-09-10T23:36:59.261 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-10T23:36:59.261 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 3758096384, 2024-09-10T23:36:59.261 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-10T23:36:59.261 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 7, 2024-09-10T23:36:59.261 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 2145, 2024-09-10T23:36:59.261 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-10T23:36:59.261 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 7, 2024-09-10T23:36:59.261 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 0, 2024-09-10T23:36:59.261 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 0, 2024-09-10T23:36:59.261 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 6, 2024-09-10T23:36:59.261 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 2145, 2024-09-10T23:36:59.262 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-10T23:36:59.262 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:36:59.262 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:36:59.262 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:36:59.262 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:36:59.262 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:36:59.262 INFO:teuthology.orchestra.run.smithi038.stdout: "trackedop": { 2024-09-10T23:36:59.262 INFO:teuthology.orchestra.run.smithi038.stdout: "slow_ops_count": 20 2024-09-10T23:36:59.262 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:36:59.262 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-10T23:37:00.056 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-10T23:37:00.056 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-10T23:37:00.056 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-10T23:37:00.056 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=15 2024-09-10T23:37:00.057 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=2 2024-09-10T23:37:00.057 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-09-10T23:37:00.057 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-09-10T23:37:00.057 DEBUG:tasks.check_counter:Getting stats from h 2024-09-10T23:37:00.057 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-10T23:37:00.445 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:37:00.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:00 smithi194 ceph-mon[33904]: pgmap v705: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-10T23:37:00.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:00 smithi003 ceph-mon[30348]: pgmap v705: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-10T23:37:00.768 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:00 smithi038 ceph-mon[34225]: pgmap v705: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-10T23:37:01.100 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-10T23:37:01.100 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:37:01.100 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 449, 2024-09-10T23:37:01.100 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 577, 2024-09-10T23:37:01.100 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 135270, 2024-09-10T23:37:01.100 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 299081, 2024-09-10T23:37:01.100 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 9, 2024-09-10T23:37:01.100 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 4, 2024-09-10T23:37:01.100 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.111363283, 2024-09-10T23:37:01.101 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.062292465, 2024-09-10T23:37:01.101 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.040612128, 2024-09-10T23:37:01.101 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.004474084, 2024-09-10T23:37:01.101 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:37:01.101 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 575, 2024-09-10T23:37:01.101 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.107790501, 2024-09-10T23:37:01.101 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000187461 2024-09-10T23:37:01.101 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.101 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:37:01.101 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 965, 2024-09-10T23:37:01.101 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000263027, 2024-09-10T23:37:01.101 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000272 2024-09-10T23:37:01.102 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.102 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 3536, 2024-09-10T23:37:01.102 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 12432 2024-09-10T23:37:01.102 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.102 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:37:01.102 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 294, 2024-09-10T23:37:01.102 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 279, 2024-09-10T23:37:01.102 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 1190994, 2024-09-10T23:37:01.102 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 173049, 2024-09-10T23:37:01.102 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 9, 2024-09-10T23:37:01.102 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 7, 2024-09-10T23:37:01.102 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.070312107, 2024-09-10T23:37:01.102 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.030309897, 2024-09-10T23:37:01.102 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.051913675, 2024-09-10T23:37:01.103 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.000677167, 2024-09-10T23:37:01.103 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:37:01.103 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 279, 2024-09-10T23:37:01.103 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.054269109, 2024-09-10T23:37:01.103 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000194512 2024-09-10T23:37:01.103 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.103 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:37:01.103 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 2, 2024-09-10T23:37:01.103 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000094, 2024-09-10T23:37:01.103 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000047 2024-09-10T23:37:01.103 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.103 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 1187328, 2024-09-10T23:37:01.103 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 142144 2024-09-10T23:37:01.104 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.104 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:37:01.104 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 28, 2024-09-10T23:37:01.104 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 225, 2024-09-10T23:37:01.104 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 6266, 2024-09-10T23:37:01.104 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 396647, 2024-09-10T23:37:01.104 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 11, 2024-09-10T23:37:01.104 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 7, 2024-09-10T23:37:01.104 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.025329250, 2024-09-10T23:37:01.104 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.014763063, 2024-09-10T23:37:01.104 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.007453975, 2024-09-10T23:37:01.104 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.000273314, 2024-09-10T23:37:01.104 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:37:01.105 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 223, 2024-09-10T23:37:01.105 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.025208505, 2024-09-10T23:37:01.105 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000113042 2024-09-10T23:37:01.105 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.105 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:37:01.105 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 59, 2024-09-10T23:37:01.105 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000017906, 2024-09-10T23:37:01.105 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000303 2024-09-10T23:37:01.105 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.106 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T23:37:01.106 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 326928 2024-09-10T23:37:01.106 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.106 INFO:teuthology.orchestra.run.smithi038.stdout: "cct": { 2024-09-10T23:37:01.106 INFO:teuthology.orchestra.run.smithi038.stdout: "total_workers": 1, 2024-09-10T23:37:01.106 INFO:teuthology.orchestra.run.smithi038.stdout: "unhealthy_workers": 0 2024-09-10T23:37:01.106 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.106 INFO:teuthology.orchestra.run.smithi038.stdout: "finisher-MDSRank": { 2024-09-10T23:37:01.106 INFO:teuthology.orchestra.run.smithi038.stdout: "queue_len": 0, 2024-09-10T23:37:01.106 INFO:teuthology.orchestra.run.smithi038.stdout: "complete_latency": { 2024-09-10T23:37:01.106 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 46, 2024-09-10T23:37:01.106 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.001800425, 2024-09-10T23:37:01.107 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000039139 2024-09-10T23:37:01.107 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:37:01.107 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.107 INFO:teuthology.orchestra.run.smithi038.stdout: "finisher-PurgeQueue": { 2024-09-10T23:37:01.107 INFO:teuthology.orchestra.run.smithi038.stdout: "queue_len": 0, 2024-09-10T23:37:01.107 INFO:teuthology.orchestra.run.smithi038.stdout: "complete_latency": { 2024-09-10T23:37:01.107 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 2, 2024-09-10T23:37:01.107 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000022130, 2024-09-10T23:37:01.107 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000011065 2024-09-10T23:37:01.107 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:37:01.107 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.107 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2024-09-10T23:37:01.107 INFO:teuthology.orchestra.run.smithi038.stdout: "request": 9, 2024-09-10T23:37:01.107 INFO:teuthology.orchestra.run.smithi038.stdout: "reply": 6, 2024-09-10T23:37:01.108 INFO:teuthology.orchestra.run.smithi038.stdout: "reply_latency": { 2024-09-10T23:37:01.108 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 6, 2024-09-10T23:37:01.108 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.002959919, 2024-09-10T23:37:01.108 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000493319 2024-09-10T23:37:01.108 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.108 INFO:teuthology.orchestra.run.smithi038.stdout: "slow_reply": 0, 2024-09-10T23:37:01.108 INFO:teuthology.orchestra.run.smithi038.stdout: "forward": 3, 2024-09-10T23:37:01.108 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_fetch_complete": 0, 2024-09-10T23:37:01.108 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_fetch_keys": 0, 2024-09-10T23:37:01.108 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_commit": 11, 2024-09-10T23:37:01.108 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_split": 0, 2024-09-10T23:37:01.108 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_merge": 0, 2024-09-10T23:37:01.109 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes": 16, 2024-09-10T23:37:01.109 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_top": 0, 2024-09-10T23:37:01.109 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_bottom": 16, 2024-09-10T23:37:01.109 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_pin_tail": 0, 2024-09-10T23:37:01.109 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_pinned": 13, 2024-09-10T23:37:01.109 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_expired": 4, 2024-09-10T23:37:01.109 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_with_caps": 3, 2024-09-10T23:37:01.109 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": 4, 2024-09-10T23:37:01.109 INFO:teuthology.orchestra.run.smithi038.stdout: "subtrees": 3, 2024-09-10T23:37:01.109 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse": 29, 2024-09-10T23:37:01.109 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_hit": 22, 2024-09-10T23:37:01.109 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_forward": 1, 2024-09-10T23:37:01.109 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_discover": 5, 2024-09-10T23:37:01.110 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_dir_fetch": 0, 2024-09-10T23:37:01.110 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_remote_ino": 0, 2024-09-10T23:37:01.110 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_lock": 0, 2024-09-10T23:37:01.110 INFO:teuthology.orchestra.run.smithi038.stdout: "load_cent": 0, 2024-09-10T23:37:01.110 INFO:teuthology.orchestra.run.smithi038.stdout: "q": 0, 2024-09-10T23:37:01.110 INFO:teuthology.orchestra.run.smithi038.stdout: "exported": 0, 2024-09-10T23:37:01.110 INFO:teuthology.orchestra.run.smithi038.stdout: "exported_inodes": 0, 2024-09-10T23:37:01.110 INFO:teuthology.orchestra.run.smithi038.stdout: "imported": 0, 2024-09-10T23:37:01.110 INFO:teuthology.orchestra.run.smithi038.stdout: "imported_inodes": 0, 2024-09-10T23:37:01.110 INFO:teuthology.orchestra.run.smithi038.stdout: "openino_dir_fetch": 0, 2024-09-10T23:37:01.110 INFO:teuthology.orchestra.run.smithi038.stdout: "openino_backtrace_fetch": 0, 2024-09-10T23:37:01.110 INFO:teuthology.orchestra.run.smithi038.stdout: "openino_peer_discover": 0, 2024-09-10T23:37:01.110 INFO:teuthology.orchestra.run.smithi038.stdout: "root_rfiles": 8, 2024-09-10T23:37:01.110 INFO:teuthology.orchestra.run.smithi038.stdout: "root_rbytes": 195290466, 2024-09-10T23:37:01.111 INFO:teuthology.orchestra.run.smithi038.stdout: "root_rsnaps": 2, 2024-09-10T23:37:01.111 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T23:37:01.111 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_set_tag": 0, 2024-09-10T23:37:01.111 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T23:37:01.111 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_inotable_repaired": 0, 2024-09-10T23:37:01.111 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_dir_inodes": 0, 2024-09-10T23:37:01.111 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T23:37:01.111 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T23:37:01.111 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_file_inodes": 0, 2024-09-10T23:37:01.111 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_inode_file_caps": 0, 2024-09-10T23:37:01.111 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_revoke": 4, 2024-09-10T23:37:01.112 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_grant": 0, 2024-09-10T23:37:01.112 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T23:37:01.112 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T23:37:01.112 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T23:37:01.112 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_caps": 4, 2024-09-10T23:37:01.112 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_caps_dirty": 0, 2024-09-10T23:37:01.112 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_cap_release": 0, 2024-09-10T23:37:01.112 INFO:teuthology.orchestra.run.smithi038.stdout: "process_request_cap_release": 0 2024-09-10T23:37:01.112 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.112 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_cache": { 2024-09-10T23:37:01.113 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_update": 0, 2024-09-10T23:37:01.113 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_update_receipt": 17, 2024-09-10T23:37:01.113 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_try_discover": 11, 2024-09-10T23:37:01.113 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_send_discover": 12, 2024-09-10T23:37:01.113 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_handle_discover": 0, 2024-09-10T23:37:01.113 INFO:teuthology.orchestra.run.smithi038.stdout: "num_strays": 0, 2024-09-10T23:37:01.113 INFO:teuthology.orchestra.run.smithi038.stdout: "num_strays_delayed": 0, 2024-09-10T23:37:01.113 INFO:teuthology.orchestra.run.smithi038.stdout: "num_strays_enqueuing": 0, 2024-09-10T23:37:01.113 INFO:teuthology.orchestra.run.smithi038.stdout: "strays_created": 0, 2024-09-10T23:37:01.113 INFO:teuthology.orchestra.run.smithi038.stdout: "strays_enqueued": 0, 2024-09-10T23:37:01.113 INFO:teuthology.orchestra.run.smithi038.stdout: "strays_reintegrated": 0, 2024-09-10T23:37:01.114 INFO:teuthology.orchestra.run.smithi038.stdout: "strays_migrated": 0, 2024-09-10T23:37:01.114 INFO:teuthology.orchestra.run.smithi038.stdout: "num_recovering_processing": 0, 2024-09-10T23:37:01.114 INFO:teuthology.orchestra.run.smithi038.stdout: "num_recovering_enqueued": 0, 2024-09-10T23:37:01.114 INFO:teuthology.orchestra.run.smithi038.stdout: "num_recovering_prioritized": 0, 2024-09-10T23:37:01.114 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_started": 0, 2024-09-10T23:37:01.114 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_completed": 0, 2024-09-10T23:37:01.114 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_quiesce_path": 3, 2024-09-10T23:37:01.114 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_quiesce_inode": 17, 2024-09-10T23:37:01.114 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T23:37:01.114 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_exportdir": 0, 2024-09-10T23:37:01.115 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_flush": 0, 2024-09-10T23:37:01.115 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_fragmentdir": 0, 2024-09-10T23:37:01.115 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_fragstats": 0, 2024-09-10T23:37:01.115 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_inodestats": 0, 2024-09-10T23:37:01.115 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-10T23:37:01.115 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_succeeded": 0, 2024-09-10T23:37:01.115 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_write_failed": 0 2024-09-10T23:37:01.115 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.115 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_log": { 2024-09-10T23:37:01.115 INFO:teuthology.orchestra.run.smithi038.stdout: "evlrg": 0, 2024-09-10T23:37:01.115 INFO:teuthology.orchestra.run.smithi038.stdout: "evadd": 4, 2024-09-10T23:37:01.115 INFO:teuthology.orchestra.run.smithi038.stdout: "evex": 0, 2024-09-10T23:37:01.115 INFO:teuthology.orchestra.run.smithi038.stdout: "evtrm": 0, 2024-09-10T23:37:01.115 INFO:teuthology.orchestra.run.smithi038.stdout: "ev": 4, 2024-09-10T23:37:01.116 INFO:teuthology.orchestra.run.smithi038.stdout: "evexg": 0, 2024-09-10T23:37:01.116 INFO:teuthology.orchestra.run.smithi038.stdout: "evexd": 0, 2024-09-10T23:37:01.116 INFO:teuthology.orchestra.run.smithi038.stdout: "segadd": 2, 2024-09-10T23:37:01.116 INFO:teuthology.orchestra.run.smithi038.stdout: "segex": 0, 2024-09-10T23:37:01.116 INFO:teuthology.orchestra.run.smithi038.stdout: "segtrm": 0, 2024-09-10T23:37:01.116 INFO:teuthology.orchestra.run.smithi038.stdout: "seg": 2, 2024-09-10T23:37:01.116 INFO:teuthology.orchestra.run.smithi038.stdout: "segmjr": 2, 2024-09-10T23:37:01.116 INFO:teuthology.orchestra.run.smithi038.stdout: "segexg": 0, 2024-09-10T23:37:01.116 INFO:teuthology.orchestra.run.smithi038.stdout: "segexd": 0, 2024-09-10T23:37:01.116 INFO:teuthology.orchestra.run.smithi038.stdout: "expos": 4194304, 2024-09-10T23:37:01.116 INFO:teuthology.orchestra.run.smithi038.stdout: "wrpos": 4195776, 2024-09-10T23:37:01.116 INFO:teuthology.orchestra.run.smithi038.stdout: "rdpos": 0, 2024-09-10T23:37:01.116 INFO:teuthology.orchestra.run.smithi038.stdout: "jlat": { 2024-09-10T23:37:01.117 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 3, 2024-09-10T23:37:01.117 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.006597180, 2024-09-10T23:37:01.117 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.002199060 2024-09-10T23:37:01.117 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.117 INFO:teuthology.orchestra.run.smithi038.stdout: "replayed": 0 2024-09-10T23:37:01.117 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.117 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_mem": { 2024-09-10T23:37:01.117 INFO:teuthology.orchestra.run.smithi038.stdout: "ino": 20, 2024-09-10T23:37:01.117 INFO:teuthology.orchestra.run.smithi038.stdout: "ino+": 22, 2024-09-10T23:37:01.117 INFO:teuthology.orchestra.run.smithi038.stdout: "ino-": 2, 2024-09-10T23:37:01.117 INFO:teuthology.orchestra.run.smithi038.stdout: "dir": 19, 2024-09-10T23:37:01.117 INFO:teuthology.orchestra.run.smithi038.stdout: "dir+": 23, 2024-09-10T23:37:01.117 INFO:teuthology.orchestra.run.smithi038.stdout: "dir-": 4, 2024-09-10T23:37:01.117 INFO:teuthology.orchestra.run.smithi038.stdout: "dn": 16, 2024-09-10T23:37:01.118 INFO:teuthology.orchestra.run.smithi038.stdout: "dn+": 20, 2024-09-10T23:37:01.118 INFO:teuthology.orchestra.run.smithi038.stdout: "dn-": 4, 2024-09-10T23:37:01.118 INFO:teuthology.orchestra.run.smithi038.stdout: "cap": 4, 2024-09-10T23:37:01.118 INFO:teuthology.orchestra.run.smithi038.stdout: "cap+": 4, 2024-09-10T23:37:01.118 INFO:teuthology.orchestra.run.smithi038.stdout: "cap-": 0, 2024-09-10T23:37:01.118 INFO:teuthology.orchestra.run.smithi038.stdout: "rss": 49072, 2024-09-10T23:37:01.118 INFO:teuthology.orchestra.run.smithi038.stdout: "heap": 258732032 2024-09-10T23:37:01.118 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.118 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_server": { 2024-09-10T23:37:01.118 INFO:teuthology.orchestra.run.smithi038.stdout: "dispatch_client_request": 12, 2024-09-10T23:37:01.118 INFO:teuthology.orchestra.run.smithi038.stdout: "dispatch_server_request": 0, 2024-09-10T23:37:01.118 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_request": 9, 2024-09-10T23:37:01.118 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_session": 17, 2024-09-10T23:37:01.119 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_peer_request": 1, 2024-09-10T23:37:01.119 INFO:teuthology.orchestra.run.smithi038.stdout: "req_create_latency": { 2024-09-10T23:37:01.119 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:01.119 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:01.119 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:01.119 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.119 INFO:teuthology.orchestra.run.smithi038.stdout: "req_getattr_latency": { 2024-09-10T23:37:01.119 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 6, 2024-09-10T23:37:01.119 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.002959919, 2024-09-10T23:37:01.119 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000493319 2024-09-10T23:37:01.119 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.119 INFO:teuthology.orchestra.run.smithi038.stdout: "req_getfilelock_latency": { 2024-09-10T23:37:01.119 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:01.119 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:01.120 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:01.120 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.120 INFO:teuthology.orchestra.run.smithi038.stdout: "req_link_latency": { 2024-09-10T23:37:01.120 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:01.120 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:01.120 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:01.120 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.120 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookup_latency": { 2024-09-10T23:37:01.120 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:01.120 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:01.120 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:01.120 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.120 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookuphash_latency": { 2024-09-10T23:37:01.121 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:01.121 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:01.121 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:01.121 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.121 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookupino_latency": { 2024-09-10T23:37:01.121 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:01.121 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:01.121 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:01.121 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.121 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookupname_latency": { 2024-09-10T23:37:01.121 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:01.121 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:01.121 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:01.121 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.122 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookupparent_latency": { 2024-09-10T23:37:01.122 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:01.122 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:01.122 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:01.122 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.122 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookupsnap_latency": { 2024-09-10T23:37:01.122 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:01.122 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:01.122 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:01.122 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.122 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lssnap_latency": { 2024-09-10T23:37:01.122 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:01.123 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:01.123 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:01.123 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.123 INFO:teuthology.orchestra.run.smithi038.stdout: "req_mkdir_latency": { 2024-09-10T23:37:01.123 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:01.124 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:01.124 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:01.124 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.124 INFO:teuthology.orchestra.run.smithi038.stdout: "req_mknod_latency": { 2024-09-10T23:37:01.124 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:01.124 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:01.124 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:01.124 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.124 INFO:teuthology.orchestra.run.smithi038.stdout: "req_mksnap_latency": { 2024-09-10T23:37:01.124 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:01.124 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:01.124 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:01.124 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.125 INFO:teuthology.orchestra.run.smithi038.stdout: "req_open_latency": { 2024-09-10T23:37:01.125 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:01.125 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:01.125 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:01.125 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.125 INFO:teuthology.orchestra.run.smithi038.stdout: "req_readdir_latency": { 2024-09-10T23:37:01.125 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:01.125 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:01.125 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:01.125 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.125 INFO:teuthology.orchestra.run.smithi038.stdout: "req_rename_latency": { 2024-09-10T23:37:01.125 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:01.125 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:01.126 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:01.126 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.126 INFO:teuthology.orchestra.run.smithi038.stdout: "req_renamesnap_latency": { 2024-09-10T23:37:01.126 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:01.126 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:01.126 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:01.126 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.126 INFO:teuthology.orchestra.run.smithi038.stdout: "req_snapdiff_latency": { 2024-09-10T23:37:01.126 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:01.126 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:01.126 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:01.126 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.126 INFO:teuthology.orchestra.run.smithi038.stdout: "req_rmdir_latency": { 2024-09-10T23:37:01.126 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:01.127 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:01.127 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:01.127 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.127 INFO:teuthology.orchestra.run.smithi038.stdout: "req_rmsnap_latency": { 2024-09-10T23:37:01.127 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:01.127 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:01.127 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:01.127 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.127 INFO:teuthology.orchestra.run.smithi038.stdout: "req_rmxattr_latency": { 2024-09-10T23:37:01.127 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:01.127 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:01.127 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:01.127 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.127 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setattr_latency": { 2024-09-10T23:37:01.127 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:01.128 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:01.128 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:01.128 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.128 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setdirlayout_latency": { 2024-09-10T23:37:01.128 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:01.128 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:01.128 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:01.128 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.128 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setfilelock_latency": { 2024-09-10T23:37:01.128 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:01.128 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:01.128 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:01.128 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.128 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setlayout_latency": { 2024-09-10T23:37:01.129 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:01.129 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:01.129 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:01.129 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.129 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setxattr_latency": { 2024-09-10T23:37:01.129 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:01.129 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:01.129 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:01.129 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.129 INFO:teuthology.orchestra.run.smithi038.stdout: "req_symlink_latency": { 2024-09-10T23:37:01.129 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:01.129 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:01.129 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:01.129 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.130 INFO:teuthology.orchestra.run.smithi038.stdout: "req_unlink_latency": { 2024-09-10T23:37:01.130 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:01.130 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:01.130 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:01.130 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.130 INFO:teuthology.orchestra.run.smithi038.stdout: "cap_revoke_eviction": 0, 2024-09-10T23:37:01.130 INFO:teuthology.orchestra.run.smithi038.stdout: "cap_acquisition_throttle": 0, 2024-09-10T23:37:01.130 INFO:teuthology.orchestra.run.smithi038.stdout: "req_getvxattr_latency": { 2024-09-10T23:37:01.130 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:01.130 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:01.131 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:01.131 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:37:01.131 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.131 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_sessions": { 2024-09-10T23:37:01.131 INFO:teuthology.orchestra.run.smithi038.stdout: "session_count": 2, 2024-09-10T23:37:01.131 INFO:teuthology.orchestra.run.smithi038.stdout: "session_add": 2, 2024-09-10T23:37:01.131 INFO:teuthology.orchestra.run.smithi038.stdout: "session_remove": 0, 2024-09-10T23:37:01.131 INFO:teuthology.orchestra.run.smithi038.stdout: "sessions_open": 2, 2024-09-10T23:37:01.131 INFO:teuthology.orchestra.run.smithi038.stdout: "sessions_stale": 0, 2024-09-10T23:37:01.131 INFO:teuthology.orchestra.run.smithi038.stdout: "total_load": 5, 2024-09-10T23:37:01.131 INFO:teuthology.orchestra.run.smithi038.stdout: "average_load": 2, 2024-09-10T23:37:01.131 INFO:teuthology.orchestra.run.smithi038.stdout: "avg_session_uptime": 609, 2024-09-10T23:37:01.131 INFO:teuthology.orchestra.run.smithi038.stdout: "mdthresh_evicted": 0 2024-09-10T23:37:01.131 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.131 INFO:teuthology.orchestra.run.smithi038.stdout: "mempool": { 2024-09-10T23:37:01.132 INFO:teuthology.orchestra.run.smithi038.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:37:01.132 INFO:teuthology.orchestra.run.smithi038.stdout: "bloom_filter_items": 0, 2024-09-10T23:37:01.132 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:37:01.132 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:37:01.132 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:37:01.132 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:37:01.132 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:37:01.132 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:37:01.132 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:37:01.132 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:37:01.132 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:37:01.132 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:37:01.132 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:37:01.132 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:37:01.133 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:37:01.133 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_extent_items": 0, 2024-09-10T23:37:01.133 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:37:01.133 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_blob_items": 0, 2024-09-10T23:37:01.133 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:37:01.133 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:37:01.133 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:37:01.133 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:37:01.133 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:37:01.133 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:37:01.133 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:37:01.134 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_txc_items": 0, 2024-09-10T23:37:01.134 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:37:01.134 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:37:01.134 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:37:01.134 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_items": 0, 2024-09-10T23:37:01.134 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_bytes": 0, 2024-09-10T23:37:01.134 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_items": 0, 2024-09-10T23:37:01.134 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:37:01.134 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:37:01.134 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:37:01.134 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:37:01.134 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_anon_bytes": 262823, 2024-09-10T23:37:01.134 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_anon_items": 93, 2024-09-10T23:37:01.134 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:37:01.134 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_meta_items": 0, 2024-09-10T23:37:01.134 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_bytes": 0, 2024-09-10T23:37:01.135 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_items": 0, 2024-09-10T23:37:01.135 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:37:01.135 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mapbl_items": 0, 2024-09-10T23:37:01.135 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:37:01.135 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pglog_items": 0, 2024-09-10T23:37:01.135 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_bytes": 9648, 2024-09-10T23:37:01.135 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_items": 196, 2024-09-10T23:37:01.135 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:37:01.135 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:37:01.135 INFO:teuthology.orchestra.run.smithi038.stdout: "pgmap_bytes": 0, 2024-09-10T23:37:01.135 INFO:teuthology.orchestra.run.smithi038.stdout: "pgmap_items": 0, 2024-09-10T23:37:01.135 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_co_bytes": 84509, 2024-09-10T23:37:01.135 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_co_items": 345, 2024-09-10T23:37:01.135 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_1_bytes": 0, 2024-09-10T23:37:01.135 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_1_items": 0, 2024-09-10T23:37:01.135 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_2_bytes": 0, 2024-09-10T23:37:01.136 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_2_items": 0 2024-09-10T23:37:01.136 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.136 INFO:teuthology.orchestra.run.smithi038.stdout: "objecter": { 2024-09-10T23:37:01.136 INFO:teuthology.orchestra.run.smithi038.stdout: "op_active": 0, 2024-09-10T23:37:01.136 INFO:teuthology.orchestra.run.smithi038.stdout: "op_laggy": 0, 2024-09-10T23:37:01.136 INFO:teuthology.orchestra.run.smithi038.stdout: "op_send": 40, 2024-09-10T23:37:01.136 INFO:teuthology.orchestra.run.smithi038.stdout: "op_send_bytes": 11933, 2024-09-10T23:37:01.136 INFO:teuthology.orchestra.run.smithi038.stdout: "op_resend": 33, 2024-09-10T23:37:01.136 INFO:teuthology.orchestra.run.smithi038.stdout: "op_reply": 40, 2024-09-10T23:37:01.136 INFO:teuthology.orchestra.run.smithi038.stdout: "op_latency": { 2024-09-10T23:37:01.137 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 40, 2024-09-10T23:37:01.137 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.305993995, 2024-09-10T23:37:01.137 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.007649849 2024-09-10T23:37:01.137 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.137 INFO:teuthology.orchestra.run.smithi038.stdout: "op_inflight": 0, 2024-09-10T23:37:01.137 INFO:teuthology.orchestra.run.smithi038.stdout: "oplen_avg": { 2024-09-10T23:37:01.137 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 40, 2024-09-10T23:37:01.137 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 63 2024-09-10T23:37:01.137 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.137 INFO:teuthology.orchestra.run.smithi038.stdout: "op": 40, 2024-09-10T23:37:01.137 INFO:teuthology.orchestra.run.smithi038.stdout: "op_r": 0, 2024-09-10T23:37:01.137 INFO:teuthology.orchestra.run.smithi038.stdout: "op_w": 40, 2024-09-10T23:37:01.137 INFO:teuthology.orchestra.run.smithi038.stdout: "op_rmw": 0, 2024-09-10T23:37:01.137 INFO:teuthology.orchestra.run.smithi038.stdout: "op_pg": 0, 2024-09-10T23:37:01.138 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_stat": 0, 2024-09-10T23:37:01.138 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_create": 10, 2024-09-10T23:37:01.138 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_read": 0, 2024-09-10T23:37:01.138 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_write": 3, 2024-09-10T23:37:01.138 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_writefull": 7, 2024-09-10T23:37:01.138 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_writesame": 0, 2024-09-10T23:37:01.138 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_append": 0, 2024-09-10T23:37:01.138 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_zero": 0, 2024-09-10T23:37:01.138 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_truncate": 0, 2024-09-10T23:37:01.138 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_delete": 6, 2024-09-10T23:37:01.138 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_mapext": 0, 2024-09-10T23:37:01.138 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_sparse_read": 0, 2024-09-10T23:37:01.138 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_clonerange": 0, 2024-09-10T23:37:01.138 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_getxattr": 0, 2024-09-10T23:37:01.139 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_setxattr": 20, 2024-09-10T23:37:01.139 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_cmpxattr": 0, 2024-09-10T23:37:01.139 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_rmxattr": 0, 2024-09-10T23:37:01.139 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_resetxattrs": 0, 2024-09-10T23:37:01.139 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_call": 0, 2024-09-10T23:37:01.139 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_watch": 0, 2024-09-10T23:37:01.139 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_notify": 0, 2024-09-10T23:37:01.139 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T23:37:01.139 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_pgls": 0, 2024-09-10T23:37:01.139 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_pgls_filter": 0, 2024-09-10T23:37:01.139 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_other": 0, 2024-09-10T23:37:01.139 INFO:teuthology.orchestra.run.smithi038.stdout: "linger_active": 0, 2024-09-10T23:37:01.139 INFO:teuthology.orchestra.run.smithi038.stdout: "linger_send": 0, 2024-09-10T23:37:01.139 INFO:teuthology.orchestra.run.smithi038.stdout: "linger_resend": 0, 2024-09-10T23:37:01.139 INFO:teuthology.orchestra.run.smithi038.stdout: "linger_ping": 0, 2024-09-10T23:37:01.140 INFO:teuthology.orchestra.run.smithi038.stdout: "poolop_active": 0, 2024-09-10T23:37:01.140 INFO:teuthology.orchestra.run.smithi038.stdout: "poolop_send": 0, 2024-09-10T23:37:01.140 INFO:teuthology.orchestra.run.smithi038.stdout: "poolop_resend": 0, 2024-09-10T23:37:01.140 INFO:teuthology.orchestra.run.smithi038.stdout: "poolstat_active": 0, 2024-09-10T23:37:01.140 INFO:teuthology.orchestra.run.smithi038.stdout: "poolstat_send": 0, 2024-09-10T23:37:01.140 INFO:teuthology.orchestra.run.smithi038.stdout: "poolstat_resend": 0, 2024-09-10T23:37:01.140 INFO:teuthology.orchestra.run.smithi038.stdout: "statfs_active": 0, 2024-09-10T23:37:01.140 INFO:teuthology.orchestra.run.smithi038.stdout: "statfs_send": 0, 2024-09-10T23:37:01.140 INFO:teuthology.orchestra.run.smithi038.stdout: "statfs_resend": 0, 2024-09-10T23:37:01.140 INFO:teuthology.orchestra.run.smithi038.stdout: "command_active": 0, 2024-09-10T23:37:01.140 INFO:teuthology.orchestra.run.smithi038.stdout: "command_send": 0, 2024-09-10T23:37:01.140 INFO:teuthology.orchestra.run.smithi038.stdout: "command_resend": 0, 2024-09-10T23:37:01.140 INFO:teuthology.orchestra.run.smithi038.stdout: "map_epoch": 98, 2024-09-10T23:37:01.140 INFO:teuthology.orchestra.run.smithi038.stdout: "map_full": 0, 2024-09-10T23:37:01.141 INFO:teuthology.orchestra.run.smithi038.stdout: "map_inc": 10, 2024-09-10T23:37:01.141 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_sessions": 10, 2024-09-10T23:37:01.141 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_session_open": 10, 2024-09-10T23:37:01.141 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_session_close": 0, 2024-09-10T23:37:01.141 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_laggy": 0, 2024-09-10T23:37:01.141 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_wr": 16, 2024-09-10T23:37:01.141 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_rd": 0, 2024-09-10T23:37:01.141 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_del": 1 2024-09-10T23:37:01.141 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.141 INFO:teuthology.orchestra.run.smithi038.stdout: "oft": { 2024-09-10T23:37:01.141 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_total_objs": 1, 2024-09-10T23:37:01.141 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_total_kv_pairs": 0, 2024-09-10T23:37:01.141 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_total_updates": 0, 2024-09-10T23:37:01.141 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_total_removes": 0 2024-09-10T23:37:01.142 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.142 INFO:teuthology.orchestra.run.smithi038.stdout: "purge_queue": { 2024-09-10T23:37:01.142 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executing_ops": 0, 2024-09-10T23:37:01.142 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T23:37:01.142 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executing": 0, 2024-09-10T23:37:01.142 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executing_high_water": 0, 2024-09-10T23:37:01.142 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executed_ops": 0, 2024-09-10T23:37:01.142 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executed": 0, 2024-09-10T23:37:01.142 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_item_in_journal": 0 2024-09-10T23:37:01.142 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.142 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:37:01.142 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-10T23:37:01.142 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 104857600, 2024-09-10T23:37:01.142 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-10T23:37:01.143 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 767, 2024-09-10T23:37:01.143 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 1245915, 2024-09-10T23:37:01.143 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-10T23:37:01.143 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 767, 2024-09-10T23:37:01.143 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 0, 2024-09-10T23:37:01.143 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 0, 2024-09-10T23:37:01.143 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 767, 2024-09-10T23:37:01.143 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 1245915, 2024-09-10T23:37:01.143 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-10T23:37:01.143 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:01.143 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:01.143 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:01.143 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:37:01.143 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.143 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-objecter_bytes": { 2024-09-10T23:37:01.144 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-10T23:37:01.144 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 104857600, 2024-09-10T23:37:01.144 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-10T23:37:01.144 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 0, 2024-09-10T23:37:01.144 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 0, 2024-09-10T23:37:01.144 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-10T23:37:01.144 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 0, 2024-09-10T23:37:01.144 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 40, 2024-09-10T23:37:01.144 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 11933, 2024-09-10T23:37:01.144 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 40, 2024-09-10T23:37:01.144 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 11933, 2024-09-10T23:37:01.144 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-10T23:37:01.144 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:01.144 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:01.145 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:01.145 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:37:01.145 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.145 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-objecter_ops": { 2024-09-10T23:37:01.145 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-10T23:37:01.145 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 1024, 2024-09-10T23:37:01.145 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-10T23:37:01.145 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 0, 2024-09-10T23:37:01.145 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 0, 2024-09-10T23:37:01.145 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-10T23:37:01.145 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 0, 2024-09-10T23:37:01.145 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 40, 2024-09-10T23:37:01.145 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 40, 2024-09-10T23:37:01.146 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 40, 2024-09-10T23:37:01.146 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 40, 2024-09-10T23:37:01.146 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-10T23:37:01.146 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:01.146 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:01.146 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:01.146 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:37:01.146 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.146 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-write_buf_throttle": { 2024-09-10T23:37:01.146 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-10T23:37:01.146 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 3758096384, 2024-09-10T23:37:01.146 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-10T23:37:01.146 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 0, 2024-09-10T23:37:01.146 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 0, 2024-09-10T23:37:01.147 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-10T23:37:01.147 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 0, 2024-09-10T23:37:01.147 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 0, 2024-09-10T23:37:01.147 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 0, 2024-09-10T23:37:01.147 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 0, 2024-09-10T23:37:01.147 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 0, 2024-09-10T23:37:01.147 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-10T23:37:01.147 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:01.147 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:01.147 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:01.147 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:37:01.147 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.147 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-write_buf_throttle-0x55d6f2fac960": { 2024-09-10T23:37:01.147 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-10T23:37:01.147 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 3758096384, 2024-09-10T23:37:01.148 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-10T23:37:01.148 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 4, 2024-09-10T23:37:01.148 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 1472, 2024-09-10T23:37:01.148 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-10T23:37:01.148 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 4, 2024-09-10T23:37:01.148 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 0, 2024-09-10T23:37:01.148 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 0, 2024-09-10T23:37:01.148 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 3, 2024-09-10T23:37:01.148 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 1472, 2024-09-10T23:37:01.148 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-10T23:37:01.148 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:01.148 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:01.148 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:01.148 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:37:01.148 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:01.149 INFO:teuthology.orchestra.run.smithi038.stdout: "trackedop": { 2024-09-10T23:37:01.149 INFO:teuthology.orchestra.run.smithi038.stdout: "slow_ops_count": 20 2024-09-10T23:37:01.149 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:37:01.149 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-10T23:37:02.023 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-10T23:37:02.024 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-10T23:37:02.024 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-10T23:37:02.024 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=17 2024-09-10T23:37:02.024 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=2 2024-09-10T23:37:02.024 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-10T23:37:02.024 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-10T23:37:02.024 DEBUG:tasks.check_counter:Getting stats from k 2024-09-10T23:37:02.024 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-10T23:37:02.403 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:37:02.677 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:02 smithi038 ceph-mon[34225]: pgmap v706: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:37:02.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:02 smithi194 ceph-mon[33904]: pgmap v706: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:37:02.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:02 smithi003 ceph-mon[30348]: pgmap v706: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:37:02.977 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-10T23:37:02.978 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:37:02.978 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 1566, 2024-09-10T23:37:02.978 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 1568, 2024-09-10T23:37:02.978 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 1365020, 2024-09-10T23:37:02.978 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 497998, 2024-09-10T23:37:02.978 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 6, 2024-09-10T23:37:02.978 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 2, 2024-09-10T23:37:02.978 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.228966772, 2024-09-10T23:37:02.978 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.120472214, 2024-09-10T23:37:02.978 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.045020277, 2024-09-10T23:37:02.978 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.041764356, 2024-09-10T23:37:02.978 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:37:02.979 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 1566, 2024-09-10T23:37:02.979 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.091048292, 2024-09-10T23:37:02.979 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000058140 2024-09-10T23:37:02.979 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:02.979 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:37:02.979 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:02.979 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:02.979 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:02.979 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:02.979 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T23:37:02.979 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T23:37:02.979 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:02.979 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:37:02.979 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 9, 2024-09-10T23:37:02.980 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 176, 2024-09-10T23:37:02.980 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 4808, 2024-09-10T23:37:02.980 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 327770, 2024-09-10T23:37:02.980 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 5, 2024-09-10T23:37:02.980 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 4, 2024-09-10T23:37:02.980 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.019398607, 2024-09-10T23:37:02.980 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.011289790, 2024-09-10T23:37:02.981 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.005688990, 2024-09-10T23:37:02.981 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.000081955, 2024-09-10T23:37:02.981 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:37:02.981 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 175, 2024-09-10T23:37:02.981 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.023687882, 2024-09-10T23:37:02.981 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000135359 2024-09-10T23:37:02.981 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:02.981 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:37:02.981 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:02.981 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:02.981 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:02.981 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:02.982 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-10T23:37:02.982 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 326432 2024-09-10T23:37:02.982 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:02.982 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:37:02.982 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 982, 2024-09-10T23:37:02.982 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 973, 2024-09-10T23:37:02.982 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 1352491, 2024-09-10T23:37:02.982 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 373669, 2024-09-10T23:37:02.982 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 3, 2024-09-10T23:37:02.982 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 2, 2024-09-10T23:37:02.982 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.155589899, 2024-09-10T23:37:02.982 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.069171944, 2024-09-10T23:37:02.982 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.060637512, 2024-09-10T23:37:02.983 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.027860838, 2024-09-10T23:37:02.983 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:37:02.983 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 972, 2024-09-10T23:37:02.983 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.055685068, 2024-09-10T23:37:02.983 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000057289 2024-09-10T23:37:02.983 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:02.983 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:37:02.983 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:02.983 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:02.983 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:02.983 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:02.983 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 1171856, 2024-09-10T23:37:02.983 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 140256 2024-09-10T23:37:02.983 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:02.984 INFO:teuthology.orchestra.run.smithi038.stdout: "cct": { 2024-09-10T23:37:02.984 INFO:teuthology.orchestra.run.smithi038.stdout: "total_workers": 1, 2024-09-10T23:37:02.984 INFO:teuthology.orchestra.run.smithi038.stdout: "unhealthy_workers": 0 2024-09-10T23:37:02.984 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:02.984 INFO:teuthology.orchestra.run.smithi038.stdout: "finisher-MDSRank": { 2024-09-10T23:37:02.984 INFO:teuthology.orchestra.run.smithi038.stdout: "queue_len": 0, 2024-09-10T23:37:02.984 INFO:teuthology.orchestra.run.smithi038.stdout: "complete_latency": { 2024-09-10T23:37:02.984 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 3856, 2024-09-10T23:37:02.984 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.109299911, 2024-09-10T23:37:02.985 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000028345 2024-09-10T23:37:02.985 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:37:02.985 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:02.985 INFO:teuthology.orchestra.run.smithi038.stdout: "finisher-PurgeQueue": { 2024-09-10T23:37:02.985 INFO:teuthology.orchestra.run.smithi038.stdout: "queue_len": 0, 2024-09-10T23:37:02.985 INFO:teuthology.orchestra.run.smithi038.stdout: "complete_latency": { 2024-09-10T23:37:02.985 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:02.985 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:02.985 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:02.985 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:37:02.985 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:02.985 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2024-09-10T23:37:02.986 INFO:teuthology.orchestra.run.smithi038.stdout: "request": 0, 2024-09-10T23:37:02.986 INFO:teuthology.orchestra.run.smithi038.stdout: "reply": 0, 2024-09-10T23:37:02.986 INFO:teuthology.orchestra.run.smithi038.stdout: "reply_latency": { 2024-09-10T23:37:02.986 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:02.986 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:02.986 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:02.986 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:02.986 INFO:teuthology.orchestra.run.smithi038.stdout: "slow_reply": 0, 2024-09-10T23:37:02.986 INFO:teuthology.orchestra.run.smithi038.stdout: "forward": 0, 2024-09-10T23:37:02.986 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_fetch_complete": 0, 2024-09-10T23:37:02.986 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_fetch_keys": 0, 2024-09-10T23:37:02.987 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_commit": 0, 2024-09-10T23:37:02.987 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_split": 0, 2024-09-10T23:37:02.987 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_merge": 0, 2024-09-10T23:37:02.987 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes": 31, 2024-09-10T23:37:02.987 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_top": 0, 2024-09-10T23:37:02.987 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_bottom": 31, 2024-09-10T23:37:02.987 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_pin_tail": 0, 2024-09-10T23:37:02.987 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_pinned": 31, 2024-09-10T23:37:02.987 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_expired": 0, 2024-09-10T23:37:02.987 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_with_caps": 0, 2024-09-10T23:37:02.987 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": 0, 2024-09-10T23:37:02.987 INFO:teuthology.orchestra.run.smithi038.stdout: "subtrees": 2, 2024-09-10T23:37:02.987 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse": 0, 2024-09-10T23:37:02.987 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_hit": 0, 2024-09-10T23:37:02.988 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_forward": 0, 2024-09-10T23:37:02.988 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_discover": 0, 2024-09-10T23:37:02.988 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_dir_fetch": 0, 2024-09-10T23:37:02.988 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_remote_ino": 0, 2024-09-10T23:37:02.988 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_lock": 0, 2024-09-10T23:37:02.988 INFO:teuthology.orchestra.run.smithi038.stdout: "load_cent": 0, 2024-09-10T23:37:02.988 INFO:teuthology.orchestra.run.smithi038.stdout: "q": 0, 2024-09-10T23:37:02.988 INFO:teuthology.orchestra.run.smithi038.stdout: "exported": 0, 2024-09-10T23:37:02.988 INFO:teuthology.orchestra.run.smithi038.stdout: "exported_inodes": 0, 2024-09-10T23:37:02.988 INFO:teuthology.orchestra.run.smithi038.stdout: "imported": 0, 2024-09-10T23:37:02.988 INFO:teuthology.orchestra.run.smithi038.stdout: "imported_inodes": 0, 2024-09-10T23:37:02.988 INFO:teuthology.orchestra.run.smithi038.stdout: "openino_dir_fetch": 0, 2024-09-10T23:37:02.988 INFO:teuthology.orchestra.run.smithi038.stdout: "openino_backtrace_fetch": 0, 2024-09-10T23:37:02.989 INFO:teuthology.orchestra.run.smithi038.stdout: "openino_peer_discover": 0, 2024-09-10T23:37:02.989 INFO:teuthology.orchestra.run.smithi038.stdout: "root_rfiles": 4, 2024-09-10T23:37:02.989 INFO:teuthology.orchestra.run.smithi038.stdout: "root_rbytes": 234, 2024-09-10T23:37:02.989 INFO:teuthology.orchestra.run.smithi038.stdout: "root_rsnaps": 6, 2024-09-10T23:37:02.989 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T23:37:02.989 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_set_tag": 0, 2024-09-10T23:37:02.989 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T23:37:02.989 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_inotable_repaired": 0, 2024-09-10T23:37:02.989 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_dir_inodes": 0, 2024-09-10T23:37:02.989 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T23:37:02.989 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T23:37:02.989 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_file_inodes": 0, 2024-09-10T23:37:02.989 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_inode_file_caps": 0, 2024-09-10T23:37:02.990 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T23:37:02.990 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_grant": 0, 2024-09-10T23:37:02.990 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T23:37:02.990 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T23:37:02.990 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T23:37:02.990 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_caps": 0, 2024-09-10T23:37:02.990 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_caps_dirty": 0, 2024-09-10T23:37:02.990 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_cap_release": 0, 2024-09-10T23:37:02.990 INFO:teuthology.orchestra.run.smithi038.stdout: "process_request_cap_release": 0 2024-09-10T23:37:02.990 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:02.990 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_cache": { 2024-09-10T23:37:02.990 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_update": 0, 2024-09-10T23:37:02.990 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_update_receipt": 0, 2024-09-10T23:37:02.990 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_try_discover": 0, 2024-09-10T23:37:02.991 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_send_discover": 0, 2024-09-10T23:37:02.991 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_handle_discover": 0, 2024-09-10T23:37:02.991 INFO:teuthology.orchestra.run.smithi038.stdout: "num_strays": 0, 2024-09-10T23:37:02.991 INFO:teuthology.orchestra.run.smithi038.stdout: "num_strays_delayed": 0, 2024-09-10T23:37:02.991 INFO:teuthology.orchestra.run.smithi038.stdout: "num_strays_enqueuing": 0, 2024-09-10T23:37:02.991 INFO:teuthology.orchestra.run.smithi038.stdout: "strays_created": 0, 2024-09-10T23:37:02.991 INFO:teuthology.orchestra.run.smithi038.stdout: "strays_enqueued": 0, 2024-09-10T23:37:02.991 INFO:teuthology.orchestra.run.smithi038.stdout: "strays_reintegrated": 0, 2024-09-10T23:37:02.991 INFO:teuthology.orchestra.run.smithi038.stdout: "strays_migrated": 0, 2024-09-10T23:37:02.991 INFO:teuthology.orchestra.run.smithi038.stdout: "num_recovering_processing": 0, 2024-09-10T23:37:02.991 INFO:teuthology.orchestra.run.smithi038.stdout: "num_recovering_enqueued": 0, 2024-09-10T23:37:02.991 INFO:teuthology.orchestra.run.smithi038.stdout: "num_recovering_prioritized": 0, 2024-09-10T23:37:02.991 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_started": 0, 2024-09-10T23:37:02.991 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_completed": 0, 2024-09-10T23:37:02.992 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_quiesce_path": 0, 2024-09-10T23:37:02.992 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_quiesce_inode": 0, 2024-09-10T23:37:02.992 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T23:37:02.992 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_exportdir": 0, 2024-09-10T23:37:02.992 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_flush": 0, 2024-09-10T23:37:02.992 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_fragmentdir": 0, 2024-09-10T23:37:02.992 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_fragstats": 0, 2024-09-10T23:37:02.992 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_inodestats": 0, 2024-09-10T23:37:02.992 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-10T23:37:02.992 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_succeeded": 0, 2024-09-10T23:37:02.992 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_write_failed": 0 2024-09-10T23:37:02.992 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:02.992 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_log": { 2024-09-10T23:37:02.992 INFO:teuthology.orchestra.run.smithi038.stdout: "evlrg": 0, 2024-09-10T23:37:02.993 INFO:teuthology.orchestra.run.smithi038.stdout: "evadd": 0, 2024-09-10T23:37:02.993 INFO:teuthology.orchestra.run.smithi038.stdout: "evex": 0, 2024-09-10T23:37:02.993 INFO:teuthology.orchestra.run.smithi038.stdout: "evtrm": 0, 2024-09-10T23:37:02.993 INFO:teuthology.orchestra.run.smithi038.stdout: "ev": 198, 2024-09-10T23:37:02.993 INFO:teuthology.orchestra.run.smithi038.stdout: "evexg": 0, 2024-09-10T23:37:02.993 INFO:teuthology.orchestra.run.smithi038.stdout: "evexd": 0, 2024-09-10T23:37:02.993 INFO:teuthology.orchestra.run.smithi038.stdout: "segadd": 0, 2024-09-10T23:37:02.993 INFO:teuthology.orchestra.run.smithi038.stdout: "segex": 0, 2024-09-10T23:37:02.993 INFO:teuthology.orchestra.run.smithi038.stdout: "segtrm": 0, 2024-09-10T23:37:02.993 INFO:teuthology.orchestra.run.smithi038.stdout: "seg": 2, 2024-09-10T23:37:02.993 INFO:teuthology.orchestra.run.smithi038.stdout: "segmjr": 2, 2024-09-10T23:37:02.993 INFO:teuthology.orchestra.run.smithi038.stdout: "segexg": 0, 2024-09-10T23:37:02.993 INFO:teuthology.orchestra.run.smithi038.stdout: "segexd": 0, 2024-09-10T23:37:02.994 INFO:teuthology.orchestra.run.smithi038.stdout: "expos": 4194304, 2024-09-10T23:37:02.994 INFO:teuthology.orchestra.run.smithi038.stdout: "wrpos": 5095769, 2024-09-10T23:37:02.994 INFO:teuthology.orchestra.run.smithi038.stdout: "rdpos": 5094448, 2024-09-10T23:37:02.994 INFO:teuthology.orchestra.run.smithi038.stdout: "jlat": { 2024-09-10T23:37:02.994 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:02.994 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:02.994 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:02.994 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:02.994 INFO:teuthology.orchestra.run.smithi038.stdout: "replayed": 198 2024-09-10T23:37:02.994 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:02.994 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_mem": { 2024-09-10T23:37:02.994 INFO:teuthology.orchestra.run.smithi038.stdout: "ino": 20, 2024-09-10T23:37:02.994 INFO:teuthology.orchestra.run.smithi038.stdout: "ino+": 24, 2024-09-10T23:37:02.994 INFO:teuthology.orchestra.run.smithi038.stdout: "ino-": 4, 2024-09-10T23:37:02.995 INFO:teuthology.orchestra.run.smithi038.stdout: "dir": 11, 2024-09-10T23:37:02.995 INFO:teuthology.orchestra.run.smithi038.stdout: "dir+": 11, 2024-09-10T23:37:02.995 INFO:teuthology.orchestra.run.smithi038.stdout: "dir-": 0, 2024-09-10T23:37:02.995 INFO:teuthology.orchestra.run.smithi038.stdout: "dn": 31, 2024-09-10T23:37:02.995 INFO:teuthology.orchestra.run.smithi038.stdout: "dn+": 31, 2024-09-10T23:37:02.995 INFO:teuthology.orchestra.run.smithi038.stdout: "dn-": 0, 2024-09-10T23:37:02.995 INFO:teuthology.orchestra.run.smithi038.stdout: "cap": 0, 2024-09-10T23:37:02.995 INFO:teuthology.orchestra.run.smithi038.stdout: "cap+": 0, 2024-09-10T23:37:02.995 INFO:teuthology.orchestra.run.smithi038.stdout: "cap-": 0, 2024-09-10T23:37:02.995 INFO:teuthology.orchestra.run.smithi038.stdout: "rss": 47680, 2024-09-10T23:37:02.995 INFO:teuthology.orchestra.run.smithi038.stdout: "heap": 249290752 2024-09-10T23:37:02.995 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:02.995 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_server": { 2024-09-10T23:37:02.995 INFO:teuthology.orchestra.run.smithi038.stdout: "dispatch_client_request": 0, 2024-09-10T23:37:02.996 INFO:teuthology.orchestra.run.smithi038.stdout: "dispatch_server_request": 0, 2024-09-10T23:37:02.996 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_request": 0, 2024-09-10T23:37:02.996 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_session": 0, 2024-09-10T23:37:02.996 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_peer_request": 0, 2024-09-10T23:37:02.996 INFO:teuthology.orchestra.run.smithi038.stdout: "req_create_latency": { 2024-09-10T23:37:02.996 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:02.996 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:02.996 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:02.997 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:02.997 INFO:teuthology.orchestra.run.smithi038.stdout: "req_getattr_latency": { 2024-09-10T23:37:02.997 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:02.997 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:02.997 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:02.997 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:02.997 INFO:teuthology.orchestra.run.smithi038.stdout: "req_getfilelock_latency": { 2024-09-10T23:37:02.997 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:02.997 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:02.997 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:02.997 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:02.997 INFO:teuthology.orchestra.run.smithi038.stdout: "req_link_latency": { 2024-09-10T23:37:02.997 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:02.997 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:02.998 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:02.998 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:02.998 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookup_latency": { 2024-09-10T23:37:02.998 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:02.998 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:02.998 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:02.998 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:02.998 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookuphash_latency": { 2024-09-10T23:37:02.998 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:02.998 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:02.998 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:02.998 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:02.998 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookupino_latency": { 2024-09-10T23:37:02.998 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:02.999 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:02.999 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:02.999 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:02.999 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookupname_latency": { 2024-09-10T23:37:02.999 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:02.999 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:02.999 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:02.999 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:02.999 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookupparent_latency": { 2024-09-10T23:37:02.999 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:02.999 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:02.999 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:02.999 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:03.000 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookupsnap_latency": { 2024-09-10T23:37:03.000 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:03.000 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:03.000 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:03.000 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:03.000 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lssnap_latency": { 2024-09-10T23:37:03.000 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:03.000 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:03.001 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:03.001 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:03.001 INFO:teuthology.orchestra.run.smithi038.stdout: "req_mkdir_latency": { 2024-09-10T23:37:03.001 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:03.002 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:03.002 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:03.002 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:03.002 INFO:teuthology.orchestra.run.smithi038.stdout: "req_mknod_latency": { 2024-09-10T23:37:03.002 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:03.002 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:03.002 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:03.002 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:03.002 INFO:teuthology.orchestra.run.smithi038.stdout: "req_mksnap_latency": { 2024-09-10T23:37:03.002 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:03.002 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:03.002 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:03.002 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:03.003 INFO:teuthology.orchestra.run.smithi038.stdout: "req_open_latency": { 2024-09-10T23:37:03.003 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:03.003 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:03.003 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:03.003 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:03.003 INFO:teuthology.orchestra.run.smithi038.stdout: "req_readdir_latency": { 2024-09-10T23:37:03.003 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:03.003 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:03.003 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:03.003 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:03.003 INFO:teuthology.orchestra.run.smithi038.stdout: "req_rename_latency": { 2024-09-10T23:37:03.003 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:03.003 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:03.004 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:03.004 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:03.004 INFO:teuthology.orchestra.run.smithi038.stdout: "req_renamesnap_latency": { 2024-09-10T23:37:03.004 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:03.004 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:03.004 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:03.004 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:03.004 INFO:teuthology.orchestra.run.smithi038.stdout: "req_snapdiff_latency": { 2024-09-10T23:37:03.004 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:03.004 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:03.004 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:03.004 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:03.004 INFO:teuthology.orchestra.run.smithi038.stdout: "req_rmdir_latency": { 2024-09-10T23:37:03.004 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:03.005 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:03.005 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:03.005 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:03.005 INFO:teuthology.orchestra.run.smithi038.stdout: "req_rmsnap_latency": { 2024-09-10T23:37:03.005 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:03.005 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:03.005 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:03.005 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:03.005 INFO:teuthology.orchestra.run.smithi038.stdout: "req_rmxattr_latency": { 2024-09-10T23:37:03.005 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:03.005 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:03.005 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:03.005 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:03.006 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setattr_latency": { 2024-09-10T23:37:03.006 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:03.006 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:03.006 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:03.006 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:03.006 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setdirlayout_latency": { 2024-09-10T23:37:03.006 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:03.006 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:03.006 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:03.006 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:03.006 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setfilelock_latency": { 2024-09-10T23:37:03.006 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:03.007 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:03.007 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:03.007 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:03.007 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setlayout_latency": { 2024-09-10T23:37:03.007 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:03.007 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:03.007 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:03.007 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:03.007 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setxattr_latency": { 2024-09-10T23:37:03.007 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:03.007 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:03.007 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:03.008 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:03.008 INFO:teuthology.orchestra.run.smithi038.stdout: "req_symlink_latency": { 2024-09-10T23:37:03.008 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:03.008 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:03.008 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:03.008 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:03.008 INFO:teuthology.orchestra.run.smithi038.stdout: "req_unlink_latency": { 2024-09-10T23:37:03.008 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:03.008 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:03.008 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:03.008 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:03.008 INFO:teuthology.orchestra.run.smithi038.stdout: "cap_revoke_eviction": 0, 2024-09-10T23:37:03.008 INFO:teuthology.orchestra.run.smithi038.stdout: "cap_acquisition_throttle": 0, 2024-09-10T23:37:03.009 INFO:teuthology.orchestra.run.smithi038.stdout: "req_getvxattr_latency": { 2024-09-10T23:37:03.009 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:03.009 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:03.009 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:03.009 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:37:03.009 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:03.009 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_sessions": { 2024-09-10T23:37:03.009 INFO:teuthology.orchestra.run.smithi038.stdout: "session_count": 2, 2024-09-10T23:37:03.009 INFO:teuthology.orchestra.run.smithi038.stdout: "session_add": 5, 2024-09-10T23:37:03.009 INFO:teuthology.orchestra.run.smithi038.stdout: "session_remove": 3, 2024-09-10T23:37:03.009 INFO:teuthology.orchestra.run.smithi038.stdout: "sessions_open": 3, 2024-09-10T23:37:03.009 INFO:teuthology.orchestra.run.smithi038.stdout: "sessions_stale": 0, 2024-09-10T23:37:03.009 INFO:teuthology.orchestra.run.smithi038.stdout: "total_load": 0, 2024-09-10T23:37:03.010 INFO:teuthology.orchestra.run.smithi038.stdout: "average_load": 0, 2024-09-10T23:37:03.010 INFO:teuthology.orchestra.run.smithi038.stdout: "avg_session_uptime": 2547, 2024-09-10T23:37:03.010 INFO:teuthology.orchestra.run.smithi038.stdout: "mdthresh_evicted": 0 2024-09-10T23:37:03.010 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:03.010 INFO:teuthology.orchestra.run.smithi038.stdout: "mempool": { 2024-09-10T23:37:03.010 INFO:teuthology.orchestra.run.smithi038.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:37:03.010 INFO:teuthology.orchestra.run.smithi038.stdout: "bloom_filter_items": 0, 2024-09-10T23:37:03.010 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:37:03.010 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:37:03.010 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:37:03.010 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:37:03.010 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:37:03.010 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:37:03.010 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:37:03.011 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:37:03.011 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:37:03.011 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:37:03.011 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:37:03.011 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:37:03.011 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:37:03.011 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_extent_items": 0, 2024-09-10T23:37:03.011 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:37:03.011 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_blob_items": 0, 2024-09-10T23:37:03.011 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:37:03.011 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:37:03.011 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:37:03.011 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:37:03.012 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:37:03.012 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:37:03.012 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:37:03.012 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_txc_items": 0, 2024-09-10T23:37:03.012 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:37:03.012 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:37:03.012 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:37:03.012 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_items": 0, 2024-09-10T23:37:03.012 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_bytes": 0, 2024-09-10T23:37:03.012 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_items": 0, 2024-09-10T23:37:03.012 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:37:03.012 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:37:03.012 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:37:03.013 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:37:03.013 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_anon_bytes": 190414, 2024-09-10T23:37:03.013 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_anon_items": 51, 2024-09-10T23:37:03.013 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:37:03.013 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_meta_items": 0, 2024-09-10T23:37:03.013 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_bytes": 0, 2024-09-10T23:37:03.013 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_items": 0, 2024-09-10T23:37:03.013 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:37:03.013 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mapbl_items": 0, 2024-09-10T23:37:03.013 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:37:03.013 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pglog_items": 0, 2024-09-10T23:37:03.013 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_bytes": 9648, 2024-09-10T23:37:03.014 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_items": 196, 2024-09-10T23:37:03.014 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:37:03.014 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:37:03.014 INFO:teuthology.orchestra.run.smithi038.stdout: "pgmap_bytes": 0, 2024-09-10T23:37:03.014 INFO:teuthology.orchestra.run.smithi038.stdout: "pgmap_items": 0, 2024-09-10T23:37:03.014 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_co_bytes": 95420, 2024-09-10T23:37:03.014 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_co_items": 595, 2024-09-10T23:37:03.014 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_1_bytes": 0, 2024-09-10T23:37:03.014 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_1_items": 0, 2024-09-10T23:37:03.014 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_2_bytes": 0, 2024-09-10T23:37:03.014 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_2_items": 0 2024-09-10T23:37:03.014 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:03.014 INFO:teuthology.orchestra.run.smithi038.stdout: "objecter": { 2024-09-10T23:37:03.014 INFO:teuthology.orchestra.run.smithi038.stdout: "op_active": 0, 2024-09-10T23:37:03.015 INFO:teuthology.orchestra.run.smithi038.stdout: "op_laggy": 0, 2024-09-10T23:37:03.015 INFO:teuthology.orchestra.run.smithi038.stdout: "op_send": 2304, 2024-09-10T23:37:03.015 INFO:teuthology.orchestra.run.smithi038.stdout: "op_send_bytes": 26, 2024-09-10T23:37:03.015 INFO:teuthology.orchestra.run.smithi038.stdout: "op_resend": 4, 2024-09-10T23:37:03.015 INFO:teuthology.orchestra.run.smithi038.stdout: "op_reply": 2304, 2024-09-10T23:37:03.015 INFO:teuthology.orchestra.run.smithi038.stdout: "op_latency": { 2024-09-10T23:37:03.015 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 2304, 2024-09-10T23:37:03.015 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 1.260975096, 2024-09-10T23:37:03.015 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000547298 2024-09-10T23:37:03.015 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:03.015 INFO:teuthology.orchestra.run.smithi038.stdout: "op_inflight": 0, 2024-09-10T23:37:03.015 INFO:teuthology.orchestra.run.smithi038.stdout: "oplen_avg": { 2024-09-10T23:37:03.015 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 2304, 2024-09-10T23:37:03.016 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 2305 2024-09-10T23:37:03.016 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:03.016 INFO:teuthology.orchestra.run.smithi038.stdout: "op": 2304, 2024-09-10T23:37:03.016 INFO:teuthology.orchestra.run.smithi038.stdout: "op_r": 2304, 2024-09-10T23:37:03.016 INFO:teuthology.orchestra.run.smithi038.stdout: "op_w": 0, 2024-09-10T23:37:03.016 INFO:teuthology.orchestra.run.smithi038.stdout: "op_rmw": 0, 2024-09-10T23:37:03.016 INFO:teuthology.orchestra.run.smithi038.stdout: "op_pg": 0, 2024-09-10T23:37:03.016 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_stat": 1466, 2024-09-10T23:37:03.016 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_create": 0, 2024-09-10T23:37:03.016 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_read": 835, 2024-09-10T23:37:03.016 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_write": 0, 2024-09-10T23:37:03.016 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_writefull": 0, 2024-09-10T23:37:03.016 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_writesame": 0, 2024-09-10T23:37:03.016 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_append": 0, 2024-09-10T23:37:03.017 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_zero": 0, 2024-09-10T23:37:03.017 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_truncate": 0, 2024-09-10T23:37:03.017 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_delete": 0, 2024-09-10T23:37:03.017 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_mapext": 0, 2024-09-10T23:37:03.017 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_sparse_read": 0, 2024-09-10T23:37:03.017 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_clonerange": 0, 2024-09-10T23:37:03.017 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_getxattr": 2, 2024-09-10T23:37:03.017 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_setxattr": 0, 2024-09-10T23:37:03.017 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_cmpxattr": 0, 2024-09-10T23:37:03.017 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_rmxattr": 0, 2024-09-10T23:37:03.018 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_resetxattrs": 0, 2024-09-10T23:37:03.018 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_call": 0, 2024-09-10T23:37:03.018 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_watch": 0, 2024-09-10T23:37:03.018 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_notify": 0, 2024-09-10T23:37:03.018 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T23:37:03.018 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_pgls": 0, 2024-09-10T23:37:03.018 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_pgls_filter": 0, 2024-09-10T23:37:03.018 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_other": 0, 2024-09-10T23:37:03.018 INFO:teuthology.orchestra.run.smithi038.stdout: "linger_active": 0, 2024-09-10T23:37:03.018 INFO:teuthology.orchestra.run.smithi038.stdout: "linger_send": 0, 2024-09-10T23:37:03.018 INFO:teuthology.orchestra.run.smithi038.stdout: "linger_resend": 0, 2024-09-10T23:37:03.018 INFO:teuthology.orchestra.run.smithi038.stdout: "linger_ping": 0, 2024-09-10T23:37:03.018 INFO:teuthology.orchestra.run.smithi038.stdout: "poolop_active": 0, 2024-09-10T23:37:03.018 INFO:teuthology.orchestra.run.smithi038.stdout: "poolop_send": 0, 2024-09-10T23:37:03.019 INFO:teuthology.orchestra.run.smithi038.stdout: "poolop_resend": 0, 2024-09-10T23:37:03.019 INFO:teuthology.orchestra.run.smithi038.stdout: "poolstat_active": 0, 2024-09-10T23:37:03.019 INFO:teuthology.orchestra.run.smithi038.stdout: "poolstat_send": 0, 2024-09-10T23:37:03.019 INFO:teuthology.orchestra.run.smithi038.stdout: "poolstat_resend": 0, 2024-09-10T23:37:03.019 INFO:teuthology.orchestra.run.smithi038.stdout: "statfs_active": 0, 2024-09-10T23:37:03.019 INFO:teuthology.orchestra.run.smithi038.stdout: "statfs_send": 0, 2024-09-10T23:37:03.019 INFO:teuthology.orchestra.run.smithi038.stdout: "statfs_resend": 0, 2024-09-10T23:37:03.019 INFO:teuthology.orchestra.run.smithi038.stdout: "command_active": 0, 2024-09-10T23:37:03.019 INFO:teuthology.orchestra.run.smithi038.stdout: "command_send": 0, 2024-09-10T23:37:03.019 INFO:teuthology.orchestra.run.smithi038.stdout: "command_resend": 0, 2024-09-10T23:37:03.019 INFO:teuthology.orchestra.run.smithi038.stdout: "map_epoch": 98, 2024-09-10T23:37:03.019 INFO:teuthology.orchestra.run.smithi038.stdout: "map_full": 0, 2024-09-10T23:37:03.019 INFO:teuthology.orchestra.run.smithi038.stdout: "map_inc": 10, 2024-09-10T23:37:03.020 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_sessions": 5, 2024-09-10T23:37:03.020 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_session_open": 5, 2024-09-10T23:37:03.020 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_session_close": 0, 2024-09-10T23:37:03.020 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_laggy": 0, 2024-09-10T23:37:03.020 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_wr": 0, 2024-09-10T23:37:03.020 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_rd": 2, 2024-09-10T23:37:03.020 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_del": 0 2024-09-10T23:37:03.020 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:03.021 INFO:teuthology.orchestra.run.smithi038.stdout: "oft": { 2024-09-10T23:37:03.021 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_total_objs": 0, 2024-09-10T23:37:03.021 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_total_kv_pairs": 0, 2024-09-10T23:37:03.021 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_total_updates": 0, 2024-09-10T23:37:03.021 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_total_removes": 0 2024-09-10T23:37:03.021 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:03.021 INFO:teuthology.orchestra.run.smithi038.stdout: "purge_queue": { 2024-09-10T23:37:03.021 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executing_ops": 0, 2024-09-10T23:37:03.021 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T23:37:03.021 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executing": 0, 2024-09-10T23:37:03.021 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executing_high_water": 0, 2024-09-10T23:37:03.021 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executed_ops": 0, 2024-09-10T23:37:03.022 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executed": 0, 2024-09-10T23:37:03.022 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_item_in_journal": 0 2024-09-10T23:37:03.022 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:03.022 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:37:03.022 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-10T23:37:03.022 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 104857600, 2024-09-10T23:37:03.022 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-10T23:37:03.022 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 2553, 2024-09-10T23:37:03.022 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 2476848, 2024-09-10T23:37:03.022 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-10T23:37:03.022 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 2553, 2024-09-10T23:37:03.022 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 0, 2024-09-10T23:37:03.022 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 0, 2024-09-10T23:37:03.022 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 2553, 2024-09-10T23:37:03.023 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 2476848, 2024-09-10T23:37:03.023 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-10T23:37:03.023 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:03.023 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:03.023 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:03.023 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:37:03.023 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:03.023 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-objecter_bytes": { 2024-09-10T23:37:03.023 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-10T23:37:03.023 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 104857600, 2024-09-10T23:37:03.023 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-10T23:37:03.023 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 0, 2024-09-10T23:37:03.023 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 0, 2024-09-10T23:37:03.023 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-10T23:37:03.024 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 0, 2024-09-10T23:37:03.024 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 2304, 2024-09-10T23:37:03.024 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 901475, 2024-09-10T23:37:03.024 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 2304, 2024-09-10T23:37:03.024 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 901475, 2024-09-10T23:37:03.024 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-10T23:37:03.024 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:03.024 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:03.024 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:03.024 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:37:03.024 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:03.024 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-objecter_ops": { 2024-09-10T23:37:03.024 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-10T23:37:03.025 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 1024, 2024-09-10T23:37:03.025 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-10T23:37:03.025 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 0, 2024-09-10T23:37:03.025 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 0, 2024-09-10T23:37:03.025 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-10T23:37:03.025 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 0, 2024-09-10T23:37:03.025 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 2304, 2024-09-10T23:37:03.025 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 2304, 2024-09-10T23:37:03.025 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 2304, 2024-09-10T23:37:03.025 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 2304, 2024-09-10T23:37:03.025 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-10T23:37:03.025 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:03.025 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:03.026 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:03.026 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:37:03.026 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:03.026 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-write_buf_throttle": { 2024-09-10T23:37:03.026 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-10T23:37:03.026 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 3758096384, 2024-09-10T23:37:03.026 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-10T23:37:03.026 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 0, 2024-09-10T23:37:03.026 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 0, 2024-09-10T23:37:03.026 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-10T23:37:03.026 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 0, 2024-09-10T23:37:03.026 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 0, 2024-09-10T23:37:03.026 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 0, 2024-09-10T23:37:03.026 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 0, 2024-09-10T23:37:03.027 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 0, 2024-09-10T23:37:03.027 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-10T23:37:03.027 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:03.027 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:03.027 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:03.027 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:37:03.027 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:03.027 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-write_buf_throttle-0x564a9b8bac80": { 2024-09-10T23:37:03.027 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-10T23:37:03.028 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 3758096384, 2024-09-10T23:37:03.028 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-10T23:37:03.028 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 0, 2024-09-10T23:37:03.028 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 0, 2024-09-10T23:37:03.028 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-10T23:37:03.028 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 0, 2024-09-10T23:37:03.028 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 0, 2024-09-10T23:37:03.028 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 0, 2024-09-10T23:37:03.028 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 0, 2024-09-10T23:37:03.028 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 0, 2024-09-10T23:37:03.028 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-10T23:37:03.028 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-10T23:37:03.028 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-10T23:37:03.029 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-10T23:37:03.029 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:37:03.029 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-10T23:37:03.029 INFO:teuthology.orchestra.run.smithi038.stdout: "trackedop": { 2024-09-10T23:37:03.029 INFO:teuthology.orchestra.run.smithi038.stdout: "slow_ops_count": 0 2024-09-10T23:37:03.029 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-10T23:37:03.029 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-10T23:37:03.950 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-10T23:37:03.950 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-10T23:37:03.950 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-09-10T23:37:03.950 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-09-10T23:37:03.950 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=6 2024-09-10T23:37:03.950 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-09-10T23:37:03.950 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-09-10T23:37:03.950 DEBUG:tasks.check_counter:Getting stats from c 2024-09-10T23:37:03.950 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-10T23:37:04.332 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:37:04.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:04 smithi194 ceph-mon[33904]: pgmap v707: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-10T23:37:04.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:04 smithi003 ceph-mon[30348]: pgmap v707: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-10T23:37:04.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:04 smithi038 ceph-mon[34225]: pgmap v707: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-10T23:37:04.965 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-10T23:37:04.965 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:37:04.966 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 744, 2024-09-10T23:37:04.966 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 746, 2024-09-10T23:37:04.966 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 197616, 2024-09-10T23:37:04.966 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 236656, 2024-09-10T23:37:04.966 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 6, 2024-09-10T23:37:04.966 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 2, 2024-09-10T23:37:04.966 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.104595990, 2024-09-10T23:37:04.966 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.043113141, 2024-09-10T23:37:04.966 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.025496848, 2024-09-10T23:37:04.966 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.023530279, 2024-09-10T23:37:04.966 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:37:04.966 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 744, 2024-09-10T23:37:04.966 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.046647744, 2024-09-10T23:37:04.966 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000062698 2024-09-10T23:37:04.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.967 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:37:04.967 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.967 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.967 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.967 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T23:37:04.967 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T23:37:04.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.967 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:37:04.967 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 650, 2024-09-10T23:37:04.967 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 814, 2024-09-10T23:37:04.967 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 161844, 2024-09-10T23:37:04.967 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 532667, 2024-09-10T23:37:04.968 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 5, 2024-09-10T23:37:04.968 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 4, 2024-09-10T23:37:04.968 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.112743394, 2024-09-10T23:37:04.968 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.047275742, 2024-09-10T23:37:04.968 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.026836306, 2024-09-10T23:37:04.968 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.028682002, 2024-09-10T23:37:04.968 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:37:04.968 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 813, 2024-09-10T23:37:04.968 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.051009252, 2024-09-10T23:37:04.968 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000062742 2024-09-10T23:37:04.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.968 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:37:04.968 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.969 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.969 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.969 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-10T23:37:04.969 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 327552 2024-09-10T23:37:04.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.969 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:37:04.969 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 978, 2024-09-10T23:37:04.969 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 969, 2024-09-10T23:37:04.970 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 1417568, 2024-09-10T23:37:04.970 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 371266, 2024-09-10T23:37:04.970 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 3, 2024-09-10T23:37:04.970 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 2, 2024-09-10T23:37:04.970 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.184678553, 2024-09-10T23:37:04.970 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.083101218, 2024-09-10T23:37:04.970 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.073064259, 2024-09-10T23:37:04.970 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.030307904, 2024-09-10T23:37:04.970 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:37:04.970 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 968, 2024-09-10T23:37:04.970 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.080017042, 2024-09-10T23:37:04.970 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000082662 2024-09-10T23:37:04.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.970 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:37:04.970 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.971 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.971 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.971 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 1170608, 2024-09-10T23:37:04.971 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 137536 2024-09-10T23:37:04.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.971 INFO:teuthology.orchestra.run.smithi194.stdout: "cct": { 2024-09-10T23:37:04.971 INFO:teuthology.orchestra.run.smithi194.stdout: "total_workers": 1, 2024-09-10T23:37:04.971 INFO:teuthology.orchestra.run.smithi194.stdout: "unhealthy_workers": 0 2024-09-10T23:37:04.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.971 INFO:teuthology.orchestra.run.smithi194.stdout: "finisher-MDSRank": { 2024-09-10T23:37:04.971 INFO:teuthology.orchestra.run.smithi194.stdout: "queue_len": 0, 2024-09-10T23:37:04.971 INFO:teuthology.orchestra.run.smithi194.stdout: "complete_latency": { 2024-09-10T23:37:04.972 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 3458, 2024-09-10T23:37:04.972 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.115023390, 2024-09-10T23:37:04.972 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000033262 2024-09-10T23:37:04.972 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-10T23:37:04.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.972 INFO:teuthology.orchestra.run.smithi194.stdout: "finisher-PurgeQueue": { 2024-09-10T23:37:04.972 INFO:teuthology.orchestra.run.smithi194.stdout: "queue_len": 0, 2024-09-10T23:37:04.972 INFO:teuthology.orchestra.run.smithi194.stdout: "complete_latency": { 2024-09-10T23:37:04.972 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.972 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.972 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.972 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-10T23:37:04.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.972 INFO:teuthology.orchestra.run.smithi194.stdout: "mds": { 2024-09-10T23:37:04.973 INFO:teuthology.orchestra.run.smithi194.stdout: "request": 0, 2024-09-10T23:37:04.973 INFO:teuthology.orchestra.run.smithi194.stdout: "reply": 0, 2024-09-10T23:37:04.973 INFO:teuthology.orchestra.run.smithi194.stdout: "reply_latency": { 2024-09-10T23:37:04.973 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.973 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.973 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.973 INFO:teuthology.orchestra.run.smithi194.stdout: "slow_reply": 0, 2024-09-10T23:37:04.973 INFO:teuthology.orchestra.run.smithi194.stdout: "forward": 0, 2024-09-10T23:37:04.973 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_fetch_complete": 0, 2024-09-10T23:37:04.973 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_fetch_keys": 0, 2024-09-10T23:37:04.973 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_commit": 0, 2024-09-10T23:37:04.973 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_split": 0, 2024-09-10T23:37:04.974 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_merge": 0, 2024-09-10T23:37:04.974 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes": 0, 2024-09-10T23:37:04.974 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_top": 0, 2024-09-10T23:37:04.974 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_bottom": 0, 2024-09-10T23:37:04.974 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_pin_tail": 0, 2024-09-10T23:37:04.974 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_pinned": 0, 2024-09-10T23:37:04.974 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_expired": 0, 2024-09-10T23:37:04.974 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_with_caps": 0, 2024-09-10T23:37:04.974 INFO:teuthology.orchestra.run.smithi194.stdout: "caps": 0, 2024-09-10T23:37:04.974 INFO:teuthology.orchestra.run.smithi194.stdout: "subtrees": 1, 2024-09-10T23:37:04.974 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse": 0, 2024-09-10T23:37:04.974 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_hit": 0, 2024-09-10T23:37:04.974 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_forward": 0, 2024-09-10T23:37:04.974 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_discover": 0, 2024-09-10T23:37:04.974 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_dir_fetch": 0, 2024-09-10T23:37:04.975 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_remote_ino": 0, 2024-09-10T23:37:04.975 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_lock": 0, 2024-09-10T23:37:04.975 INFO:teuthology.orchestra.run.smithi194.stdout: "load_cent": 0, 2024-09-10T23:37:04.975 INFO:teuthology.orchestra.run.smithi194.stdout: "q": 0, 2024-09-10T23:37:04.975 INFO:teuthology.orchestra.run.smithi194.stdout: "exported": 0, 2024-09-10T23:37:04.975 INFO:teuthology.orchestra.run.smithi194.stdout: "exported_inodes": 0, 2024-09-10T23:37:04.975 INFO:teuthology.orchestra.run.smithi194.stdout: "imported": 0, 2024-09-10T23:37:04.975 INFO:teuthology.orchestra.run.smithi194.stdout: "imported_inodes": 0, 2024-09-10T23:37:04.975 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_dir_fetch": 0, 2024-09-10T23:37:04.975 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_backtrace_fetch": 0, 2024-09-10T23:37:04.975 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_peer_discover": 0, 2024-09-10T23:37:04.975 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rfiles": 0, 2024-09-10T23:37:04.975 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rbytes": 0, 2024-09-10T23:37:04.975 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rsnaps": 0, 2024-09-10T23:37:04.976 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T23:37:04.976 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_set_tag": 0, 2024-09-10T23:37:04.976 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T23:37:04.976 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_inotable_repaired": 0, 2024-09-10T23:37:04.976 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dir_inodes": 0, 2024-09-10T23:37:04.976 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T23:37:04.976 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T23:37:04.976 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_file_inodes": 0, 2024-09-10T23:37:04.976 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_inode_file_caps": 0, 2024-09-10T23:37:04.976 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T23:37:04.976 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_grant": 0, 2024-09-10T23:37:04.976 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T23:37:04.976 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T23:37:04.976 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T23:37:04.977 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_caps": 0, 2024-09-10T23:37:04.977 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_caps_dirty": 0, 2024-09-10T23:37:04.977 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_cap_release": 0, 2024-09-10T23:37:04.977 INFO:teuthology.orchestra.run.smithi194.stdout: "process_request_cap_release": 0 2024-09-10T23:37:04.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.977 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_cache": { 2024-09-10T23:37:04.977 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_update": 0, 2024-09-10T23:37:04.977 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_update_receipt": 0, 2024-09-10T23:37:04.977 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_try_discover": 0, 2024-09-10T23:37:04.977 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_send_discover": 0, 2024-09-10T23:37:04.977 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_handle_discover": 0, 2024-09-10T23:37:04.977 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays": 0, 2024-09-10T23:37:04.977 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays_delayed": 0, 2024-09-10T23:37:04.977 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays_enqueuing": 0, 2024-09-10T23:37:04.978 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_created": 0, 2024-09-10T23:37:04.978 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_enqueued": 0, 2024-09-10T23:37:04.978 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_reintegrated": 0, 2024-09-10T23:37:04.978 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_migrated": 0, 2024-09-10T23:37:04.978 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_processing": 0, 2024-09-10T23:37:04.978 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_enqueued": 0, 2024-09-10T23:37:04.978 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_prioritized": 0, 2024-09-10T23:37:04.978 INFO:teuthology.orchestra.run.smithi194.stdout: "recovery_started": 0, 2024-09-10T23:37:04.978 INFO:teuthology.orchestra.run.smithi194.stdout: "recovery_completed": 0, 2024-09-10T23:37:04.978 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_quiesce_path": 0, 2024-09-10T23:37:04.978 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_quiesce_inode": 0, 2024-09-10T23:37:04.978 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T23:37:04.978 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_exportdir": 0, 2024-09-10T23:37:04.978 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_flush": 0, 2024-09-10T23:37:04.978 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_fragmentdir": 0, 2024-09-10T23:37:04.978 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_fragstats": 0, 2024-09-10T23:37:04.979 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_inodestats": 0, 2024-09-10T23:37:04.979 INFO:teuthology.orchestra.run.smithi194.stdout: "uninline_started": 0, 2024-09-10T23:37:04.979 INFO:teuthology.orchestra.run.smithi194.stdout: "uninline_succeeded": 0, 2024-09-10T23:37:04.979 INFO:teuthology.orchestra.run.smithi194.stdout: "uninline_write_failed": 0 2024-09-10T23:37:04.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.979 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_log": { 2024-09-10T23:37:04.979 INFO:teuthology.orchestra.run.smithi194.stdout: "evlrg": 0, 2024-09-10T23:37:04.979 INFO:teuthology.orchestra.run.smithi194.stdout: "evadd": 0, 2024-09-10T23:37:04.979 INFO:teuthology.orchestra.run.smithi194.stdout: "evex": 0, 2024-09-10T23:37:04.979 INFO:teuthology.orchestra.run.smithi194.stdout: "evtrm": 0, 2024-09-10T23:37:04.980 INFO:teuthology.orchestra.run.smithi194.stdout: "ev": 7, 2024-09-10T23:37:04.980 INFO:teuthology.orchestra.run.smithi194.stdout: "evexg": 0, 2024-09-10T23:37:04.980 INFO:teuthology.orchestra.run.smithi194.stdout: "evexd": 0, 2024-09-10T23:37:04.980 INFO:teuthology.orchestra.run.smithi194.stdout: "segadd": 0, 2024-09-10T23:37:04.980 INFO:teuthology.orchestra.run.smithi194.stdout: "segex": 0, 2024-09-10T23:37:04.980 INFO:teuthology.orchestra.run.smithi194.stdout: "segtrm": 0, 2024-09-10T23:37:04.980 INFO:teuthology.orchestra.run.smithi194.stdout: "seg": 2, 2024-09-10T23:37:04.980 INFO:teuthology.orchestra.run.smithi194.stdout: "segmjr": 2, 2024-09-10T23:37:04.980 INFO:teuthology.orchestra.run.smithi194.stdout: "segexg": 0, 2024-09-10T23:37:04.980 INFO:teuthology.orchestra.run.smithi194.stdout: "segexd": 0, 2024-09-10T23:37:04.980 INFO:teuthology.orchestra.run.smithi194.stdout: "expos": 4194304, 2024-09-10T23:37:04.980 INFO:teuthology.orchestra.run.smithi194.stdout: "wrpos": 4196449, 2024-09-10T23:37:04.980 INFO:teuthology.orchestra.run.smithi194.stdout: "rdpos": 4196308, 2024-09-10T23:37:04.980 INFO:teuthology.orchestra.run.smithi194.stdout: "jlat": { 2024-09-10T23:37:04.981 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.981 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.981 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.981 INFO:teuthology.orchestra.run.smithi194.stdout: "replayed": 7 2024-09-10T23:37:04.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.981 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_mem": { 2024-09-10T23:37:04.981 INFO:teuthology.orchestra.run.smithi194.stdout: "ino": 3, 2024-09-10T23:37:04.981 INFO:teuthology.orchestra.run.smithi194.stdout: "ino+": 3, 2024-09-10T23:37:04.981 INFO:teuthology.orchestra.run.smithi194.stdout: "ino-": 0, 2024-09-10T23:37:04.981 INFO:teuthology.orchestra.run.smithi194.stdout: "dir": 1, 2024-09-10T23:37:04.981 INFO:teuthology.orchestra.run.smithi194.stdout: "dir+": 1, 2024-09-10T23:37:04.981 INFO:teuthology.orchestra.run.smithi194.stdout: "dir-": 0, 2024-09-10T23:37:04.981 INFO:teuthology.orchestra.run.smithi194.stdout: "dn": 0, 2024-09-10T23:37:04.982 INFO:teuthology.orchestra.run.smithi194.stdout: "dn+": 0, 2024-09-10T23:37:04.982 INFO:teuthology.orchestra.run.smithi194.stdout: "dn-": 0, 2024-09-10T23:37:04.982 INFO:teuthology.orchestra.run.smithi194.stdout: "cap": 0, 2024-09-10T23:37:04.982 INFO:teuthology.orchestra.run.smithi194.stdout: "cap+": 0, 2024-09-10T23:37:04.982 INFO:teuthology.orchestra.run.smithi194.stdout: "cap-": 0, 2024-09-10T23:37:04.982 INFO:teuthology.orchestra.run.smithi194.stdout: "rss": 47312, 2024-09-10T23:37:04.982 INFO:teuthology.orchestra.run.smithi194.stdout: "heap": 249294848 2024-09-10T23:37:04.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.982 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_server": { 2024-09-10T23:37:04.982 INFO:teuthology.orchestra.run.smithi194.stdout: "dispatch_client_request": 0, 2024-09-10T23:37:04.982 INFO:teuthology.orchestra.run.smithi194.stdout: "dispatch_server_request": 0, 2024-09-10T23:37:04.982 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_request": 0, 2024-09-10T23:37:04.982 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_session": 0, 2024-09-10T23:37:04.983 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_peer_request": 0, 2024-09-10T23:37:04.983 INFO:teuthology.orchestra.run.smithi194.stdout: "req_create_latency": { 2024-09-10T23:37:04.983 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.983 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.983 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.983 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getattr_latency": { 2024-09-10T23:37:04.983 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.983 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.983 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.983 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getfilelock_latency": { 2024-09-10T23:37:04.983 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.984 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.984 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.984 INFO:teuthology.orchestra.run.smithi194.stdout: "req_link_latency": { 2024-09-10T23:37:04.984 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.984 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.984 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.984 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookup_latency": { 2024-09-10T23:37:04.984 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.984 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.984 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.984 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookuphash_latency": { 2024-09-10T23:37:04.984 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.985 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.985 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.985 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupino_latency": { 2024-09-10T23:37:04.985 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.985 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.985 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.985 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupname_latency": { 2024-09-10T23:37:04.985 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.985 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.985 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.986 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupparent_latency": { 2024-09-10T23:37:04.986 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.986 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.986 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.986 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupsnap_latency": { 2024-09-10T23:37:04.986 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.986 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.986 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.986 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lssnap_latency": { 2024-09-10T23:37:04.986 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.986 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.987 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.987 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mkdir_latency": { 2024-09-10T23:37:04.987 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.987 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.987 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.987 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mknod_latency": { 2024-09-10T23:37:04.987 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.987 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.987 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.988 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mksnap_latency": { 2024-09-10T23:37:04.988 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.988 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.988 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.988 INFO:teuthology.orchestra.run.smithi194.stdout: "req_open_latency": { 2024-09-10T23:37:04.988 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.988 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.988 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.989 INFO:teuthology.orchestra.run.smithi194.stdout: "req_readdir_latency": { 2024-09-10T23:37:04.989 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.989 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.989 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.989 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rename_latency": { 2024-09-10T23:37:04.989 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.989 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.989 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.989 INFO:teuthology.orchestra.run.smithi194.stdout: "req_renamesnap_latency": { 2024-09-10T23:37:04.989 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.989 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.990 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.990 INFO:teuthology.orchestra.run.smithi194.stdout: "req_snapdiff_latency": { 2024-09-10T23:37:04.990 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.990 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.990 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.990 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmdir_latency": { 2024-09-10T23:37:04.990 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.990 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.991 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.991 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmsnap_latency": { 2024-09-10T23:37:04.991 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.991 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.991 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.991 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmxattr_latency": { 2024-09-10T23:37:04.991 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.991 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.991 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.991 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setattr_latency": { 2024-09-10T23:37:04.991 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.991 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.992 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.992 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setdirlayout_latency": { 2024-09-10T23:37:04.992 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.992 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.992 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.992 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setfilelock_latency": { 2024-09-10T23:37:04.992 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.992 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.992 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.992 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setlayout_latency": { 2024-09-10T23:37:04.992 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.993 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.993 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.993 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setxattr_latency": { 2024-09-10T23:37:04.993 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.993 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.993 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.993 INFO:teuthology.orchestra.run.smithi194.stdout: "req_symlink_latency": { 2024-09-10T23:37:04.993 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.993 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.993 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.993 INFO:teuthology.orchestra.run.smithi194.stdout: "req_unlink_latency": { 2024-09-10T23:37:04.993 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.994 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.994 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.994 INFO:teuthology.orchestra.run.smithi194.stdout: "cap_revoke_eviction": 0, 2024-09-10T23:37:04.994 INFO:teuthology.orchestra.run.smithi194.stdout: "cap_acquisition_throttle": 0, 2024-09-10T23:37:04.994 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getvxattr_latency": { 2024-09-10T23:37:04.994 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:04.994 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:04.994 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:04.994 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-10T23:37:04.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.994 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_sessions": { 2024-09-10T23:37:04.994 INFO:teuthology.orchestra.run.smithi194.stdout: "session_count": 1, 2024-09-10T23:37:04.994 INFO:teuthology.orchestra.run.smithi194.stdout: "session_add": 3, 2024-09-10T23:37:04.994 INFO:teuthology.orchestra.run.smithi194.stdout: "session_remove": 2, 2024-09-10T23:37:04.995 INFO:teuthology.orchestra.run.smithi194.stdout: "sessions_open": 2, 2024-09-10T23:37:04.995 INFO:teuthology.orchestra.run.smithi194.stdout: "sessions_stale": 0, 2024-09-10T23:37:04.995 INFO:teuthology.orchestra.run.smithi194.stdout: "total_load": 0, 2024-09-10T23:37:04.995 INFO:teuthology.orchestra.run.smithi194.stdout: "average_load": 0, 2024-09-10T23:37:04.995 INFO:teuthology.orchestra.run.smithi194.stdout: "avg_session_uptime": 3215, 2024-09-10T23:37:04.995 INFO:teuthology.orchestra.run.smithi194.stdout: "mdthresh_evicted": 0 2024-09-10T23:37:04.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.995 INFO:teuthology.orchestra.run.smithi194.stdout: "mempool": { 2024-09-10T23:37:04.995 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:37:04.995 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_items": 0, 2024-09-10T23:37:04.995 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:37:04.995 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:37:04.995 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:37:04.995 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:37:04.996 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:37:04.996 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:37:04.996 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:37:04.996 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:37:04.996 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:37:04.996 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:37:04.996 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:37:04.996 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:37:04.996 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:37:04.996 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_items": 0, 2024-09-10T23:37:04.996 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:37:04.996 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_items": 0, 2024-09-10T23:37:04.996 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:37:04.996 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:37:04.996 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:37:04.997 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:37:04.997 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:37:04.997 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:37:04.997 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:37:04.997 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_items": 0, 2024-09-10T23:37:04.997 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:37:04.997 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:37:04.997 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:37:04.997 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_items": 0, 2024-09-10T23:37:04.997 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_bytes": 0, 2024-09-10T23:37:04.997 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_items": 0, 2024-09-10T23:37:04.997 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:37:04.997 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:37:04.997 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:37:04.998 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:37:04.998 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_bytes": 190431, 2024-09-10T23:37:04.998 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_items": 52, 2024-09-10T23:37:04.998 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:37:04.998 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_items": 0, 2024-09-10T23:37:04.998 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_bytes": 0, 2024-09-10T23:37:04.998 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_items": 0, 2024-09-10T23:37:04.998 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:37:04.998 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_items": 0, 2024-09-10T23:37:04.998 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:37:04.998 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_items": 0, 2024-09-10T23:37:04.998 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_bytes": 9648, 2024-09-10T23:37:04.998 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_items": 196, 2024-09-10T23:37:04.998 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:37:04.998 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:37:04.999 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_bytes": 0, 2024-09-10T23:37:04.999 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_items": 0, 2024-09-10T23:37:04.999 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_bytes": 8672, 2024-09-10T23:37:04.999 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_items": 13, 2024-09-10T23:37:04.999 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_bytes": 0, 2024-09-10T23:37:04.999 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_items": 0, 2024-09-10T23:37:04.999 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_bytes": 0, 2024-09-10T23:37:04.999 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_items": 0 2024-09-10T23:37:04.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:04.999 INFO:teuthology.orchestra.run.smithi194.stdout: "objecter": { 2024-09-10T23:37:04.999 INFO:teuthology.orchestra.run.smithi194.stdout: "op_active": 0, 2024-09-10T23:37:04.999 INFO:teuthology.orchestra.run.smithi194.stdout: "op_laggy": 0, 2024-09-10T23:37:04.999 INFO:teuthology.orchestra.run.smithi194.stdout: "op_send": 2124, 2024-09-10T23:37:04.999 INFO:teuthology.orchestra.run.smithi194.stdout: "op_send_bytes": 21, 2024-09-10T23:37:04.999 INFO:teuthology.orchestra.run.smithi194.stdout: "op_resend": 3, 2024-09-10T23:37:05.000 INFO:teuthology.orchestra.run.smithi194.stdout: "op_reply": 2124, 2024-09-10T23:37:05.000 INFO:teuthology.orchestra.run.smithi194.stdout: "op_latency": { 2024-09-10T23:37:05.000 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 2124, 2024-09-10T23:37:05.000 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 1.677964960, 2024-09-10T23:37:05.000 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000790002 2024-09-10T23:37:05.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:05.000 INFO:teuthology.orchestra.run.smithi194.stdout: "op_inflight": 0, 2024-09-10T23:37:05.000 INFO:teuthology.orchestra.run.smithi194.stdout: "oplen_avg": { 2024-09-10T23:37:05.000 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 2124, 2024-09-10T23:37:05.000 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 2125 2024-09-10T23:37:05.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:05.000 INFO:teuthology.orchestra.run.smithi194.stdout: "op": 2124, 2024-09-10T23:37:05.001 INFO:teuthology.orchestra.run.smithi194.stdout: "op_r": 2124, 2024-09-10T23:37:05.001 INFO:teuthology.orchestra.run.smithi194.stdout: "op_w": 0, 2024-09-10T23:37:05.001 INFO:teuthology.orchestra.run.smithi194.stdout: "op_rmw": 0, 2024-09-10T23:37:05.001 INFO:teuthology.orchestra.run.smithi194.stdout: "op_pg": 0, 2024-09-10T23:37:05.001 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_stat": 1378, 2024-09-10T23:37:05.001 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_create": 0, 2024-09-10T23:37:05.001 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_read": 744, 2024-09-10T23:37:05.001 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_write": 0, 2024-09-10T23:37:05.001 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_writefull": 0, 2024-09-10T23:37:05.001 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_writesame": 0, 2024-09-10T23:37:05.001 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_append": 0, 2024-09-10T23:37:05.002 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_zero": 0, 2024-09-10T23:37:05.002 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_truncate": 0, 2024-09-10T23:37:05.002 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_delete": 0, 2024-09-10T23:37:05.002 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_mapext": 0, 2024-09-10T23:37:05.002 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_sparse_read": 0, 2024-09-10T23:37:05.002 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_clonerange": 0, 2024-09-10T23:37:05.002 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_getxattr": 1, 2024-09-10T23:37:05.002 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_setxattr": 0, 2024-09-10T23:37:05.002 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_cmpxattr": 0, 2024-09-10T23:37:05.002 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_rmxattr": 0, 2024-09-10T23:37:05.002 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_resetxattrs": 0, 2024-09-10T23:37:05.002 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_call": 0, 2024-09-10T23:37:05.003 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_watch": 0, 2024-09-10T23:37:05.003 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_notify": 0, 2024-09-10T23:37:05.003 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T23:37:05.003 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_pgls": 0, 2024-09-10T23:37:05.003 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_pgls_filter": 0, 2024-09-10T23:37:05.003 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_other": 0, 2024-09-10T23:37:05.003 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_active": 0, 2024-09-10T23:37:05.003 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_send": 0, 2024-09-10T23:37:05.003 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_resend": 0, 2024-09-10T23:37:05.003 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_ping": 0, 2024-09-10T23:37:05.003 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_active": 0, 2024-09-10T23:37:05.003 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_send": 0, 2024-09-10T23:37:05.003 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_resend": 0, 2024-09-10T23:37:05.004 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_active": 0, 2024-09-10T23:37:05.004 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_send": 0, 2024-09-10T23:37:05.004 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_resend": 0, 2024-09-10T23:37:05.004 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_active": 0, 2024-09-10T23:37:05.004 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_send": 0, 2024-09-10T23:37:05.004 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_resend": 0, 2024-09-10T23:37:05.004 INFO:teuthology.orchestra.run.smithi194.stdout: "command_active": 0, 2024-09-10T23:37:05.004 INFO:teuthology.orchestra.run.smithi194.stdout: "command_send": 0, 2024-09-10T23:37:05.004 INFO:teuthology.orchestra.run.smithi194.stdout: "command_resend": 0, 2024-09-10T23:37:05.004 INFO:teuthology.orchestra.run.smithi194.stdout: "map_epoch": 98, 2024-09-10T23:37:05.004 INFO:teuthology.orchestra.run.smithi194.stdout: "map_full": 0, 2024-09-10T23:37:05.004 INFO:teuthology.orchestra.run.smithi194.stdout: "map_inc": 10, 2024-09-10T23:37:05.004 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_sessions": 5, 2024-09-10T23:37:05.005 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_session_open": 5, 2024-09-10T23:37:05.005 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_session_close": 0, 2024-09-10T23:37:05.005 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_laggy": 0, 2024-09-10T23:37:05.005 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_wr": 0, 2024-09-10T23:37:05.005 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_rd": 2, 2024-09-10T23:37:05.005 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_del": 0 2024-09-10T23:37:05.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:05.005 INFO:teuthology.orchestra.run.smithi194.stdout: "oft": { 2024-09-10T23:37:05.005 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_objs": 0, 2024-09-10T23:37:05.005 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_kv_pairs": 0, 2024-09-10T23:37:05.005 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_updates": 0, 2024-09-10T23:37:05.005 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_removes": 0 2024-09-10T23:37:05.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:05.006 INFO:teuthology.orchestra.run.smithi194.stdout: "purge_queue": { 2024-09-10T23:37:05.006 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_ops": 0, 2024-09-10T23:37:05.006 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T23:37:05.006 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing": 0, 2024-09-10T23:37:05.006 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_high_water": 0, 2024-09-10T23:37:05.006 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executed_ops": 0, 2024-09-10T23:37:05.006 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executed": 0, 2024-09-10T23:37:05.006 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_item_in_journal": 0 2024-09-10T23:37:05.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:05.006 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:37:05.006 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-10T23:37:05.006 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 104857600, 2024-09-10T23:37:05.006 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-10T23:37:05.006 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 2368, 2024-09-10T23:37:05.007 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 1548461, 2024-09-10T23:37:05.007 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-10T23:37:05.007 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 2368, 2024-09-10T23:37:05.007 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-09-10T23:37:05.007 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-09-10T23:37:05.007 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 2368, 2024-09-10T23:37:05.007 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 1548461, 2024-09-10T23:37:05.007 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-10T23:37:05.007 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:05.007 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:05.007 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:05.007 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-10T23:37:05.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:05.008 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-objecter_bytes": { 2024-09-10T23:37:05.008 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-10T23:37:05.008 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 104857600, 2024-09-10T23:37:05.008 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-10T23:37:05.008 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2024-09-10T23:37:05.008 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2024-09-10T23:37:05.008 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-10T23:37:05.008 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2024-09-10T23:37:05.008 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 2124, 2024-09-10T23:37:05.008 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 2150, 2024-09-10T23:37:05.008 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 2124, 2024-09-10T23:37:05.008 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 2150, 2024-09-10T23:37:05.009 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-10T23:37:05.009 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:05.009 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:05.009 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:05.009 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-10T23:37:05.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:05.009 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-objecter_ops": { 2024-09-10T23:37:05.009 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-10T23:37:05.009 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 1024, 2024-09-10T23:37:05.009 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-10T23:37:05.009 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2024-09-10T23:37:05.009 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2024-09-10T23:37:05.009 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-10T23:37:05.009 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2024-09-10T23:37:05.009 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 2124, 2024-09-10T23:37:05.010 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 2124, 2024-09-10T23:37:05.010 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 2124, 2024-09-10T23:37:05.010 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 2124, 2024-09-10T23:37:05.010 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-10T23:37:05.010 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:05.010 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:05.010 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:05.010 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-10T23:37:05.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:05.010 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-write_buf_throttle": { 2024-09-10T23:37:05.010 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-10T23:37:05.010 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 3758096384, 2024-09-10T23:37:05.010 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-10T23:37:05.010 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2024-09-10T23:37:05.010 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2024-09-10T23:37:05.011 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-10T23:37:05.011 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2024-09-10T23:37:05.011 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-09-10T23:37:05.011 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-09-10T23:37:05.011 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 0, 2024-09-10T23:37:05.011 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 0, 2024-09-10T23:37:05.011 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-10T23:37:05.011 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:05.011 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:05.011 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:05.012 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-10T23:37:05.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:05.012 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-write_buf_throttle-0x560aecf7ec80": { 2024-09-10T23:37:05.012 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-10T23:37:05.012 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 3758096384, 2024-09-10T23:37:05.012 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-10T23:37:05.012 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2024-09-10T23:37:05.012 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2024-09-10T23:37:05.012 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-10T23:37:05.012 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2024-09-10T23:37:05.012 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-09-10T23:37:05.012 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-09-10T23:37:05.013 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 0, 2024-09-10T23:37:05.013 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 0, 2024-09-10T23:37:05.013 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-10T23:37:05.013 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:05.013 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:05.013 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:05.013 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-10T23:37:05.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:05.013 INFO:teuthology.orchestra.run.smithi194.stdout: "trackedop": { 2024-09-10T23:37:05.013 INFO:teuthology.orchestra.run.smithi194.stdout: "slow_ops_count": 0 2024-09-10T23:37:05.013 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-10T23:37:05.013 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-10T23:37:05.918 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-10T23:37:05.918 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-10T23:37:05.918 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-09-10T23:37:05.918 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-09-10T23:37:05.918 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=0 2024-09-10T23:37:05.918 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-10T23:37:05.918 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-10T23:37:05.918 DEBUG:tasks.check_counter:Getting stats from f 2024-09-10T23:37:05.919 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-10T23:37:06.285 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:37:06.680 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:06 smithi194 ceph-mon[33904]: pgmap v708: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:37:06.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:06 smithi003 ceph-mon[30348]: pgmap v708: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:37:06.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:06 smithi038 ceph-mon[34225]: pgmap v708: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:37:06.994 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-10T23:37:06.995 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:37:06.995 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 4, 2024-09-10T23:37:06.995 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 4, 2024-09-10T23:37:06.995 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 2992, 2024-09-10T23:37:06.995 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 448, 2024-09-10T23:37:06.995 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 4, 2024-09-10T23:37:06.995 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 0, 2024-09-10T23:37:06.995 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.005799358, 2024-09-10T23:37:06.995 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.000086519, 2024-09-10T23:37:06.995 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.003322000, 2024-09-10T23:37:06.995 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:37:06.996 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:37:06.996 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 3, 2024-09-10T23:37:06.996 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.005955975, 2024-09-10T23:37:06.996 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.001985325 2024-09-10T23:37:06.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:06.996 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:37:06.996 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:06.996 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:06.996 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:06.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:06.996 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-10T23:37:06.997 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T23:37:06.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:06.997 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:37:06.997 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 227, 2024-09-10T23:37:06.997 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 220, 2024-09-10T23:37:06.997 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 1139632, 2024-09-10T23:37:06.997 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 135584, 2024-09-10T23:37:06.997 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 2, 2024-09-10T23:37:06.997 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 1, 2024-09-10T23:37:06.997 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.057344269, 2024-09-10T23:37:06.998 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.028097192, 2024-09-10T23:37:06.998 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.039039314, 2024-09-10T23:37:06.998 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:37:06.998 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:37:06.998 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 219, 2024-09-10T23:37:06.998 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.019480307, 2024-09-10T23:37:06.998 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000088951 2024-09-10T23:37:06.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:06.998 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:37:06.998 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:06.998 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:06.998 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:06.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:06.999 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 1139632, 2024-09-10T23:37:06.999 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 135584 2024-09-10T23:37:06.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:06.999 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:37:06.999 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 1, 2024-09-10T23:37:06.999 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 168, 2024-09-10T23:37:06.999 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 160, 2024-09-10T23:37:06.999 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 75376, 2024-09-10T23:37:06.999 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 3, 2024-09-10T23:37:06.999 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 2, 2024-09-10T23:37:06.999 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.019067197, 2024-09-10T23:37:06.999 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.014771506, 2024-09-10T23:37:07.000 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.000996191, 2024-09-10T23:37:07.000 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:37:07.000 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:37:07.000 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 166, 2024-09-10T23:37:07.000 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.014679090, 2024-09-10T23:37:07.000 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000088428 2024-09-10T23:37:07.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:07.000 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:37:07.000 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:07.000 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:07.000 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:07.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:07.001 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T23:37:07.001 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 75376 2024-09-10T23:37:07.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:07.001 INFO:teuthology.orchestra.run.smithi194.stdout: "cct": { 2024-09-10T23:37:07.001 INFO:teuthology.orchestra.run.smithi194.stdout: "total_workers": 0, 2024-09-10T23:37:07.001 INFO:teuthology.orchestra.run.smithi194.stdout: "unhealthy_workers": 0 2024-09-10T23:37:07.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:07.001 INFO:teuthology.orchestra.run.smithi194.stdout: "mempool": { 2024-09-10T23:37:07.001 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:37:07.001 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_items": 0, 2024-09-10T23:37:07.002 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:37:07.002 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:37:07.002 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:37:07.002 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:37:07.002 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:37:07.002 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:37:07.002 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:37:07.002 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:37:07.002 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:37:07.002 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:37:07.002 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:37:07.002 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:37:07.003 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:37:07.003 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_items": 0, 2024-09-10T23:37:07.003 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:37:07.003 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_items": 0, 2024-09-10T23:37:07.003 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:37:07.003 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:37:07.004 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:37:07.004 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:37:07.004 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:37:07.004 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:37:07.004 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:37:07.004 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_items": 0, 2024-09-10T23:37:07.005 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:37:07.005 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:37:07.005 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:37:07.005 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_items": 0, 2024-09-10T23:37:07.005 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_bytes": 0, 2024-09-10T23:37:07.005 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_items": 0, 2024-09-10T23:37:07.006 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:37:07.006 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:37:07.006 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:37:07.006 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:37:07.006 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_bytes": 149998, 2024-09-10T23:37:07.006 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_items": 30, 2024-09-10T23:37:07.007 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:37:07.007 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_items": 0, 2024-09-10T23:37:07.007 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_bytes": 0, 2024-09-10T23:37:07.007 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_items": 0, 2024-09-10T23:37:07.007 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:37:07.007 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_items": 0, 2024-09-10T23:37:07.007 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:37:07.008 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_items": 0, 2024-09-10T23:37:07.008 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_bytes": 0, 2024-09-10T23:37:07.008 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_items": 0, 2024-09-10T23:37:07.008 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:37:07.008 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:37:07.008 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_bytes": 0, 2024-09-10T23:37:07.009 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_items": 0, 2024-09-10T23:37:07.009 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_bytes": 968, 2024-09-10T23:37:07.009 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_items": 2, 2024-09-10T23:37:07.009 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_bytes": 0, 2024-09-10T23:37:07.009 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_items": 0, 2024-09-10T23:37:07.009 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_bytes": 0, 2024-09-10T23:37:07.010 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_items": 0 2024-09-10T23:37:07.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:07.010 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:37:07.010 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-10T23:37:07.010 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 104857600, 2024-09-10T23:37:07.010 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-10T23:37:07.011 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 228, 2024-09-10T23:37:07.011 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 1107558, 2024-09-10T23:37:07.011 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-10T23:37:07.011 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 228, 2024-09-10T23:37:07.011 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-09-10T23:37:07.011 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-09-10T23:37:07.012 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 228, 2024-09-10T23:37:07.012 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 1107558, 2024-09-10T23:37:07.012 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-10T23:37:07.012 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:07.012 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:07.013 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:07.013 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-10T23:37:07.013 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-10T23:37:07.013 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-10T23:37:07.796 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.f 2024-09-10T23:37:07.797 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.f 2024-09-10T23:37:07.797 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.f 2024-09-10T23:37:07.797 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.f 2024-09-10T23:37:07.797 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.f 2024-09-10T23:37:07.797 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.f 2024-09-10T23:37:07.798 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.f 2024-09-10T23:37:07.798 DEBUG:tasks.check_counter:Getting stats from i 2024-09-10T23:37:07.798 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-10T23:37:08.182 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:37:08.499 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:08 smithi194 ceph-mon[33904]: pgmap v709: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:37:08.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:08 smithi003 ceph-mon[30348]: pgmap v709: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:37:08.797 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-10T23:37:08.797 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:37:08.797 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 2114, 2024-09-10T23:37:08.797 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 2114, 2024-09-10T23:37:08.797 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 602481, 2024-09-10T23:37:08.797 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 671435, 2024-09-10T23:37:08.798 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 6, 2024-09-10T23:37:08.798 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 2, 2024-09-10T23:37:08.798 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.283030163, 2024-09-10T23:37:08.798 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.125897894, 2024-09-10T23:37:08.798 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.065266431, 2024-09-10T23:37:08.798 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.068740293, 2024-09-10T23:37:08.798 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:37:08.798 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 2113, 2024-09-10T23:37:08.798 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.129645147, 2024-09-10T23:37:08.798 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000061355 2024-09-10T23:37:08.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.798 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:37:08.798 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.799 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.799 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.799 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-10T23:37:08.799 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T23:37:08.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.799 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:37:08.799 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 244, 2024-09-10T23:37:08.799 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 235, 2024-09-10T23:37:08.799 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 1170892, 2024-09-10T23:37:08.799 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 137594, 2024-09-10T23:37:08.799 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 3, 2024-09-10T23:37:08.800 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 2, 2024-09-10T23:37:08.800 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.060566841, 2024-09-10T23:37:08.800 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.031053454, 2024-09-10T23:37:08.800 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.039063469, 2024-09-10T23:37:08.800 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.000062808, 2024-09-10T23:37:08.800 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:37:08.800 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 234, 2024-09-10T23:37:08.800 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.022024164, 2024-09-10T23:37:08.800 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000094120 2024-09-10T23:37:08.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.800 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:37:08.800 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.800 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.801 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.801 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 1170336, 2024-09-10T23:37:08.801 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 136896 2024-09-10T23:37:08.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.801 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:37:08.801 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 2, 2024-09-10T23:37:08.801 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 167, 2024-09-10T23:37:08.801 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 428, 2024-09-10T23:37:08.801 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 327246, 2024-09-10T23:37:08.801 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 4, 2024-09-10T23:37:08.801 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 3, 2024-09-10T23:37:08.801 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.016682135, 2024-09-10T23:37:08.801 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.011453041, 2024-09-10T23:37:08.802 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.002633618, 2024-09-10T23:37:08.802 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.000023413, 2024-09-10T23:37:08.802 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:37:08.802 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 165, 2024-09-10T23:37:08.802 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.015027571, 2024-09-10T23:37:08.802 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000091076 2024-09-10T23:37:08.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.802 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:37:08.802 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.802 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.802 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.802 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T23:37:08.803 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 326928 2024-09-10T23:37:08.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.803 INFO:teuthology.orchestra.run.smithi194.stdout: "cct": { 2024-09-10T23:37:08.803 INFO:teuthology.orchestra.run.smithi194.stdout: "total_workers": 1, 2024-09-10T23:37:08.803 INFO:teuthology.orchestra.run.smithi194.stdout: "unhealthy_workers": 0 2024-09-10T23:37:08.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.803 INFO:teuthology.orchestra.run.smithi194.stdout: "finisher-MDSRank": { 2024-09-10T23:37:08.803 INFO:teuthology.orchestra.run.smithi194.stdout: "queue_len": 0, 2024-09-10T23:37:08.803 INFO:teuthology.orchestra.run.smithi194.stdout: "complete_latency": { 2024-09-10T23:37:08.803 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 3589, 2024-09-10T23:37:08.803 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.105227931, 2024-09-10T23:37:08.803 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000029319 2024-09-10T23:37:08.803 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-10T23:37:08.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.804 INFO:teuthology.orchestra.run.smithi194.stdout: "finisher-PurgeQueue": { 2024-09-10T23:37:08.804 INFO:teuthology.orchestra.run.smithi194.stdout: "queue_len": 0, 2024-09-10T23:37:08.804 INFO:teuthology.orchestra.run.smithi194.stdout: "complete_latency": { 2024-09-10T23:37:08.804 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.804 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.804 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.804 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-10T23:37:08.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.804 INFO:teuthology.orchestra.run.smithi194.stdout: "mds": { 2024-09-10T23:37:08.804 INFO:teuthology.orchestra.run.smithi194.stdout: "request": 0, 2024-09-10T23:37:08.804 INFO:teuthology.orchestra.run.smithi194.stdout: "reply": 0, 2024-09-10T23:37:08.804 INFO:teuthology.orchestra.run.smithi194.stdout: "reply_latency": { 2024-09-10T23:37:08.804 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.804 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.805 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.805 INFO:teuthology.orchestra.run.smithi194.stdout: "slow_reply": 0, 2024-09-10T23:37:08.805 INFO:teuthology.orchestra.run.smithi194.stdout: "forward": 0, 2024-09-10T23:37:08.805 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_fetch_complete": 0, 2024-09-10T23:37:08.805 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_fetch_keys": 0, 2024-09-10T23:37:08.805 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_commit": 0, 2024-09-10T23:37:08.805 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_split": 0, 2024-09-10T23:37:08.805 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_merge": 0, 2024-09-10T23:37:08.805 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes": 0, 2024-09-10T23:37:08.805 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_top": 0, 2024-09-10T23:37:08.805 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_bottom": 0, 2024-09-10T23:37:08.805 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_pin_tail": 0, 2024-09-10T23:37:08.806 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_pinned": 0, 2024-09-10T23:37:08.806 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_expired": 0, 2024-09-10T23:37:08.806 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_with_caps": 0, 2024-09-10T23:37:08.806 INFO:teuthology.orchestra.run.smithi194.stdout: "caps": 0, 2024-09-10T23:37:08.806 INFO:teuthology.orchestra.run.smithi194.stdout: "subtrees": 1, 2024-09-10T23:37:08.806 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse": 0, 2024-09-10T23:37:08.806 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_hit": 0, 2024-09-10T23:37:08.806 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_forward": 0, 2024-09-10T23:37:08.806 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_discover": 0, 2024-09-10T23:37:08.806 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_dir_fetch": 0, 2024-09-10T23:37:08.807 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_remote_ino": 0, 2024-09-10T23:37:08.807 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_lock": 0, 2024-09-10T23:37:08.807 INFO:teuthology.orchestra.run.smithi194.stdout: "load_cent": 0, 2024-09-10T23:37:08.807 INFO:teuthology.orchestra.run.smithi194.stdout: "q": 0, 2024-09-10T23:37:08.807 INFO:teuthology.orchestra.run.smithi194.stdout: "exported": 0, 2024-09-10T23:37:08.807 INFO:teuthology.orchestra.run.smithi194.stdout: "exported_inodes": 0, 2024-09-10T23:37:08.807 INFO:teuthology.orchestra.run.smithi194.stdout: "imported": 0, 2024-09-10T23:37:08.807 INFO:teuthology.orchestra.run.smithi194.stdout: "imported_inodes": 0, 2024-09-10T23:37:08.807 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_dir_fetch": 0, 2024-09-10T23:37:08.807 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_backtrace_fetch": 0, 2024-09-10T23:37:08.807 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_peer_discover": 0, 2024-09-10T23:37:08.808 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rfiles": 0, 2024-09-10T23:37:08.808 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rbytes": 0, 2024-09-10T23:37:08.808 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rsnaps": 0, 2024-09-10T23:37:08.808 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T23:37:08.808 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_set_tag": 0, 2024-09-10T23:37:08.808 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T23:37:08.808 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_inotable_repaired": 0, 2024-09-10T23:37:08.808 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dir_inodes": 0, 2024-09-10T23:37:08.808 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T23:37:08.808 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T23:37:08.808 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_file_inodes": 0, 2024-09-10T23:37:08.808 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_inode_file_caps": 0, 2024-09-10T23:37:08.808 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T23:37:08.809 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_grant": 0, 2024-09-10T23:37:08.809 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T23:37:08.809 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T23:37:08.809 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T23:37:08.809 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_caps": 0, 2024-09-10T23:37:08.809 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_caps_dirty": 0, 2024-09-10T23:37:08.809 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_cap_release": 0, 2024-09-10T23:37:08.809 INFO:teuthology.orchestra.run.smithi194.stdout: "process_request_cap_release": 0 2024-09-10T23:37:08.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.809 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_cache": { 2024-09-10T23:37:08.810 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_update": 0, 2024-09-10T23:37:08.810 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_update_receipt": 0, 2024-09-10T23:37:08.810 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_try_discover": 0, 2024-09-10T23:37:08.810 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_send_discover": 0, 2024-09-10T23:37:08.810 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_handle_discover": 0, 2024-09-10T23:37:08.810 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays": 0, 2024-09-10T23:37:08.810 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays_delayed": 0, 2024-09-10T23:37:08.810 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays_enqueuing": 0, 2024-09-10T23:37:08.810 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_created": 0, 2024-09-10T23:37:08.810 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_enqueued": 0, 2024-09-10T23:37:08.810 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_reintegrated": 0, 2024-09-10T23:37:08.810 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_migrated": 0, 2024-09-10T23:37:08.810 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_processing": 0, 2024-09-10T23:37:08.810 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_enqueued": 0, 2024-09-10T23:37:08.811 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_prioritized": 0, 2024-09-10T23:37:08.811 INFO:teuthology.orchestra.run.smithi194.stdout: "recovery_started": 0, 2024-09-10T23:37:08.811 INFO:teuthology.orchestra.run.smithi194.stdout: "recovery_completed": 0, 2024-09-10T23:37:08.811 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_quiesce_path": 0, 2024-09-10T23:37:08.811 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_quiesce_inode": 0, 2024-09-10T23:37:08.811 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T23:37:08.811 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_exportdir": 0, 2024-09-10T23:37:08.811 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_flush": 0, 2024-09-10T23:37:08.811 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_fragmentdir": 0, 2024-09-10T23:37:08.811 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_fragstats": 0, 2024-09-10T23:37:08.811 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_inodestats": 0, 2024-09-10T23:37:08.811 INFO:teuthology.orchestra.run.smithi194.stdout: "uninline_started": 0, 2024-09-10T23:37:08.811 INFO:teuthology.orchestra.run.smithi194.stdout: "uninline_succeeded": 0, 2024-09-10T23:37:08.811 INFO:teuthology.orchestra.run.smithi194.stdout: "uninline_write_failed": 0 2024-09-10T23:37:08.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.812 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_log": { 2024-09-10T23:37:08.812 INFO:teuthology.orchestra.run.smithi194.stdout: "evlrg": 0, 2024-09-10T23:37:08.812 INFO:teuthology.orchestra.run.smithi194.stdout: "evadd": 0, 2024-09-10T23:37:08.812 INFO:teuthology.orchestra.run.smithi194.stdout: "evex": 0, 2024-09-10T23:37:08.812 INFO:teuthology.orchestra.run.smithi194.stdout: "evtrm": 0, 2024-09-10T23:37:08.812 INFO:teuthology.orchestra.run.smithi194.stdout: "ev": 4, 2024-09-10T23:37:08.812 INFO:teuthology.orchestra.run.smithi194.stdout: "evexg": 0, 2024-09-10T23:37:08.812 INFO:teuthology.orchestra.run.smithi194.stdout: "evexd": 0, 2024-09-10T23:37:08.812 INFO:teuthology.orchestra.run.smithi194.stdout: "segadd": 0, 2024-09-10T23:37:08.812 INFO:teuthology.orchestra.run.smithi194.stdout: "segex": 0, 2024-09-10T23:37:08.812 INFO:teuthology.orchestra.run.smithi194.stdout: "segtrm": 0, 2024-09-10T23:37:08.812 INFO:teuthology.orchestra.run.smithi194.stdout: "seg": 2, 2024-09-10T23:37:08.812 INFO:teuthology.orchestra.run.smithi194.stdout: "segmjr": 2, 2024-09-10T23:37:08.813 INFO:teuthology.orchestra.run.smithi194.stdout: "segexg": 0, 2024-09-10T23:37:08.813 INFO:teuthology.orchestra.run.smithi194.stdout: "segexd": 0, 2024-09-10T23:37:08.813 INFO:teuthology.orchestra.run.smithi194.stdout: "expos": 4194304, 2024-09-10T23:37:08.813 INFO:teuthology.orchestra.run.smithi194.stdout: "wrpos": 4195776, 2024-09-10T23:37:08.813 INFO:teuthology.orchestra.run.smithi194.stdout: "rdpos": 4195385, 2024-09-10T23:37:08.813 INFO:teuthology.orchestra.run.smithi194.stdout: "jlat": { 2024-09-10T23:37:08.813 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.813 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.813 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.813 INFO:teuthology.orchestra.run.smithi194.stdout: "replayed": 4 2024-09-10T23:37:08.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.814 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_mem": { 2024-09-10T23:37:08.814 INFO:teuthology.orchestra.run.smithi194.stdout: "ino": 3, 2024-09-10T23:37:08.814 INFO:teuthology.orchestra.run.smithi194.stdout: "ino+": 3, 2024-09-10T23:37:08.814 INFO:teuthology.orchestra.run.smithi194.stdout: "ino-": 0, 2024-09-10T23:37:08.814 INFO:teuthology.orchestra.run.smithi194.stdout: "dir": 1, 2024-09-10T23:37:08.814 INFO:teuthology.orchestra.run.smithi194.stdout: "dir+": 1, 2024-09-10T23:37:08.814 INFO:teuthology.orchestra.run.smithi194.stdout: "dir-": 0, 2024-09-10T23:37:08.814 INFO:teuthology.orchestra.run.smithi194.stdout: "dn": 0, 2024-09-10T23:37:08.814 INFO:teuthology.orchestra.run.smithi194.stdout: "dn+": 0, 2024-09-10T23:37:08.814 INFO:teuthology.orchestra.run.smithi194.stdout: "dn-": 0, 2024-09-10T23:37:08.814 INFO:teuthology.orchestra.run.smithi194.stdout: "cap": 0, 2024-09-10T23:37:08.814 INFO:teuthology.orchestra.run.smithi194.stdout: "cap+": 0, 2024-09-10T23:37:08.814 INFO:teuthology.orchestra.run.smithi194.stdout: "cap-": 0, 2024-09-10T23:37:08.815 INFO:teuthology.orchestra.run.smithi194.stdout: "rss": 47704, 2024-09-10T23:37:08.815 INFO:teuthology.orchestra.run.smithi194.stdout: "heap": 249290752 2024-09-10T23:37:08.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.815 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_server": { 2024-09-10T23:37:08.815 INFO:teuthology.orchestra.run.smithi194.stdout: "dispatch_client_request": 0, 2024-09-10T23:37:08.815 INFO:teuthology.orchestra.run.smithi194.stdout: "dispatch_server_request": 0, 2024-09-10T23:37:08.815 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_request": 0, 2024-09-10T23:37:08.815 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_session": 0, 2024-09-10T23:37:08.815 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_peer_request": 0, 2024-09-10T23:37:08.815 INFO:teuthology.orchestra.run.smithi194.stdout: "req_create_latency": { 2024-09-10T23:37:08.815 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.815 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.815 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.816 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getattr_latency": { 2024-09-10T23:37:08.816 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.816 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.816 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.816 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getfilelock_latency": { 2024-09-10T23:37:08.816 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.816 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.816 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.817 INFO:teuthology.orchestra.run.smithi194.stdout: "req_link_latency": { 2024-09-10T23:37:08.817 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.817 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.817 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.818 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookup_latency": { 2024-09-10T23:37:08.818 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.818 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.818 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.818 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookuphash_latency": { 2024-09-10T23:37:08.818 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.818 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.818 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.818 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupino_latency": { 2024-09-10T23:37:08.818 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.818 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.819 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.819 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupname_latency": { 2024-09-10T23:37:08.819 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.819 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.819 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.819 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupparent_latency": { 2024-09-10T23:37:08.819 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.819 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.819 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.819 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupsnap_latency": { 2024-09-10T23:37:08.819 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.820 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.820 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.820 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lssnap_latency": { 2024-09-10T23:37:08.820 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.820 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.821 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.821 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mkdir_latency": { 2024-09-10T23:37:08.821 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.821 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.821 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.821 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mknod_latency": { 2024-09-10T23:37:08.821 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.821 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.821 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.822 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mksnap_latency": { 2024-09-10T23:37:08.822 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.822 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.822 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.822 INFO:teuthology.orchestra.run.smithi194.stdout: "req_open_latency": { 2024-09-10T23:37:08.822 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.822 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.822 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.822 INFO:teuthology.orchestra.run.smithi194.stdout: "req_readdir_latency": { 2024-09-10T23:37:08.822 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.822 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.822 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.823 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rename_latency": { 2024-09-10T23:37:08.823 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.823 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.823 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.823 INFO:teuthology.orchestra.run.smithi194.stdout: "req_renamesnap_latency": { 2024-09-10T23:37:08.823 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.823 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.823 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.824 INFO:teuthology.orchestra.run.smithi194.stdout: "req_snapdiff_latency": { 2024-09-10T23:37:08.824 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.824 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.824 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.824 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmdir_latency": { 2024-09-10T23:37:08.824 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.824 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.824 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.824 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmsnap_latency": { 2024-09-10T23:37:08.825 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.825 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.825 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.825 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmxattr_latency": { 2024-09-10T23:37:08.825 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.825 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.825 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.825 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setattr_latency": { 2024-09-10T23:37:08.825 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.825 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.825 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.826 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setdirlayout_latency": { 2024-09-10T23:37:08.826 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.826 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.826 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.826 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setfilelock_latency": { 2024-09-10T23:37:08.826 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.826 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.826 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.826 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setlayout_latency": { 2024-09-10T23:37:08.826 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.826 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.827 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.827 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setxattr_latency": { 2024-09-10T23:37:08.827 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.827 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.827 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.827 INFO:teuthology.orchestra.run.smithi194.stdout: "req_symlink_latency": { 2024-09-10T23:37:08.827 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.827 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.827 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.828 INFO:teuthology.orchestra.run.smithi194.stdout: "req_unlink_latency": { 2024-09-10T23:37:08.828 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.828 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.828 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.829 INFO:teuthology.orchestra.run.smithi194.stdout: "cap_revoke_eviction": 0, 2024-09-10T23:37:08.829 INFO:teuthology.orchestra.run.smithi194.stdout: "cap_acquisition_throttle": 0, 2024-09-10T23:37:08.829 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getvxattr_latency": { 2024-09-10T23:37:08.829 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.829 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.829 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.830 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-10T23:37:08.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.830 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_sessions": { 2024-09-10T23:37:08.830 INFO:teuthology.orchestra.run.smithi194.stdout: "session_count": 2, 2024-09-10T23:37:08.830 INFO:teuthology.orchestra.run.smithi194.stdout: "session_add": 2, 2024-09-10T23:37:08.830 INFO:teuthology.orchestra.run.smithi194.stdout: "session_remove": 0, 2024-09-10T23:37:08.831 INFO:teuthology.orchestra.run.smithi194.stdout: "sessions_open": 2, 2024-09-10T23:37:08.831 INFO:teuthology.orchestra.run.smithi194.stdout: "sessions_stale": 0, 2024-09-10T23:37:08.831 INFO:teuthology.orchestra.run.smithi194.stdout: "total_load": 0, 2024-09-10T23:37:08.831 INFO:teuthology.orchestra.run.smithi194.stdout: "average_load": 0, 2024-09-10T23:37:08.831 INFO:teuthology.orchestra.run.smithi194.stdout: "avg_session_uptime": 1923, 2024-09-10T23:37:08.831 INFO:teuthology.orchestra.run.smithi194.stdout: "mdthresh_evicted": 0 2024-09-10T23:37:08.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.832 INFO:teuthology.orchestra.run.smithi194.stdout: "mempool": { 2024-09-10T23:37:08.832 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:37:08.832 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_items": 0, 2024-09-10T23:37:08.832 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:37:08.832 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:37:08.832 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:37:08.833 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:37:08.833 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:37:08.833 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:37:08.833 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:37:08.833 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:37:08.833 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:37:08.834 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:37:08.834 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:37:08.834 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:37:08.834 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:37:08.834 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_items": 0, 2024-09-10T23:37:08.834 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:37:08.834 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_items": 0, 2024-09-10T23:37:08.834 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:37:08.834 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:37:08.834 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:37:08.834 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:37:08.834 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:37:08.835 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:37:08.835 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:37:08.835 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_items": 0, 2024-09-10T23:37:08.835 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:37:08.835 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:37:08.835 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:37:08.835 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_items": 0, 2024-09-10T23:37:08.836 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_bytes": 0, 2024-09-10T23:37:08.836 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_items": 0, 2024-09-10T23:37:08.836 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:37:08.836 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:37:08.836 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:37:08.836 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:37:08.836 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_bytes": 181343, 2024-09-10T23:37:08.837 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_items": 47, 2024-09-10T23:37:08.837 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:37:08.837 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_items": 0, 2024-09-10T23:37:08.837 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_bytes": 0, 2024-09-10T23:37:08.837 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_items": 0, 2024-09-10T23:37:08.837 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:37:08.837 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_items": 0, 2024-09-10T23:37:08.838 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:37:08.838 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_items": 0, 2024-09-10T23:37:08.838 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_bytes": 9648, 2024-09-10T23:37:08.838 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_items": 196, 2024-09-10T23:37:08.838 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:37:08.838 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:37:08.839 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_bytes": 0, 2024-09-10T23:37:08.839 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_items": 0, 2024-09-10T23:37:08.839 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_bytes": 8672, 2024-09-10T23:37:08.839 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_items": 13, 2024-09-10T23:37:08.839 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_bytes": 0, 2024-09-10T23:37:08.839 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_items": 0, 2024-09-10T23:37:08.840 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_bytes": 0, 2024-09-10T23:37:08.840 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_items": 0 2024-09-10T23:37:08.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.840 INFO:teuthology.orchestra.run.smithi194.stdout: "objecter": { 2024-09-10T23:37:08.840 INFO:teuthology.orchestra.run.smithi194.stdout: "op_active": 0, 2024-09-10T23:37:08.840 INFO:teuthology.orchestra.run.smithi194.stdout: "op_laggy": 0, 2024-09-10T23:37:08.841 INFO:teuthology.orchestra.run.smithi194.stdout: "op_send": 2113, 2024-09-10T23:37:08.841 INFO:teuthology.orchestra.run.smithi194.stdout: "op_send_bytes": 21, 2024-09-10T23:37:08.841 INFO:teuthology.orchestra.run.smithi194.stdout: "op_resend": 3, 2024-09-10T23:37:08.841 INFO:teuthology.orchestra.run.smithi194.stdout: "op_reply": 2113, 2024-09-10T23:37:08.841 INFO:teuthology.orchestra.run.smithi194.stdout: "op_latency": { 2024-09-10T23:37:08.842 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 2113, 2024-09-10T23:37:08.842 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 1.368971468, 2024-09-10T23:37:08.842 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000647880 2024-09-10T23:37:08.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.842 INFO:teuthology.orchestra.run.smithi194.stdout: "op_inflight": 0, 2024-09-10T23:37:08.842 INFO:teuthology.orchestra.run.smithi194.stdout: "oplen_avg": { 2024-09-10T23:37:08.842 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 2113, 2024-09-10T23:37:08.843 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 2114 2024-09-10T23:37:08.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.843 INFO:teuthology.orchestra.run.smithi194.stdout: "op": 2113, 2024-09-10T23:37:08.843 INFO:teuthology.orchestra.run.smithi194.stdout: "op_r": 2113, 2024-09-10T23:37:08.843 INFO:teuthology.orchestra.run.smithi194.stdout: "op_w": 0, 2024-09-10T23:37:08.843 INFO:teuthology.orchestra.run.smithi194.stdout: "op_rmw": 0, 2024-09-10T23:37:08.843 INFO:teuthology.orchestra.run.smithi194.stdout: "op_pg": 0, 2024-09-10T23:37:08.843 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_stat": 1366, 2024-09-10T23:37:08.844 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_create": 0, 2024-09-10T23:37:08.844 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_read": 745, 2024-09-10T23:37:08.844 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_write": 0, 2024-09-10T23:37:08.844 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_writefull": 0, 2024-09-10T23:37:08.844 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_writesame": 0, 2024-09-10T23:37:08.844 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_append": 0, 2024-09-10T23:37:08.844 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_zero": 0, 2024-09-10T23:37:08.844 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_truncate": 0, 2024-09-10T23:37:08.845 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_delete": 0, 2024-09-10T23:37:08.845 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_mapext": 0, 2024-09-10T23:37:08.845 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_sparse_read": 0, 2024-09-10T23:37:08.845 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_clonerange": 0, 2024-09-10T23:37:08.845 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_getxattr": 1, 2024-09-10T23:37:08.845 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_setxattr": 0, 2024-09-10T23:37:08.845 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_cmpxattr": 0, 2024-09-10T23:37:08.845 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_rmxattr": 0, 2024-09-10T23:37:08.846 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_resetxattrs": 0, 2024-09-10T23:37:08.846 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_call": 0, 2024-09-10T23:37:08.846 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_watch": 0, 2024-09-10T23:37:08.846 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_notify": 0, 2024-09-10T23:37:08.846 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T23:37:08.846 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_pgls": 0, 2024-09-10T23:37:08.847 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_pgls_filter": 0, 2024-09-10T23:37:08.847 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_other": 0, 2024-09-10T23:37:08.847 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_active": 0, 2024-09-10T23:37:08.847 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_send": 0, 2024-09-10T23:37:08.847 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_resend": 0, 2024-09-10T23:37:08.847 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_ping": 0, 2024-09-10T23:37:08.848 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_active": 0, 2024-09-10T23:37:08.848 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_send": 0, 2024-09-10T23:37:08.848 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_resend": 0, 2024-09-10T23:37:08.848 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_active": 0, 2024-09-10T23:37:08.848 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_send": 0, 2024-09-10T23:37:08.848 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_resend": 0, 2024-09-10T23:37:08.849 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_active": 0, 2024-09-10T23:37:08.849 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_send": 0, 2024-09-10T23:37:08.849 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_resend": 0, 2024-09-10T23:37:08.849 INFO:teuthology.orchestra.run.smithi194.stdout: "command_active": 0, 2024-09-10T23:37:08.849 INFO:teuthology.orchestra.run.smithi194.stdout: "command_send": 0, 2024-09-10T23:37:08.850 INFO:teuthology.orchestra.run.smithi194.stdout: "command_resend": 0, 2024-09-10T23:37:08.850 INFO:teuthology.orchestra.run.smithi194.stdout: "map_epoch": 98, 2024-09-10T23:37:08.850 INFO:teuthology.orchestra.run.smithi194.stdout: "map_full": 0, 2024-09-10T23:37:08.850 INFO:teuthology.orchestra.run.smithi194.stdout: "map_inc": 10, 2024-09-10T23:37:08.850 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_sessions": 4, 2024-09-10T23:37:08.850 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_session_open": 4, 2024-09-10T23:37:08.850 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_session_close": 0, 2024-09-10T23:37:08.850 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_laggy": 0, 2024-09-10T23:37:08.850 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_wr": 0, 2024-09-10T23:37:08.850 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_rd": 2, 2024-09-10T23:37:08.851 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_del": 0 2024-09-10T23:37:08.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.851 INFO:teuthology.orchestra.run.smithi194.stdout: "oft": { 2024-09-10T23:37:08.851 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_objs": 0, 2024-09-10T23:37:08.851 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_kv_pairs": 0, 2024-09-10T23:37:08.851 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_updates": 0, 2024-09-10T23:37:08.851 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_removes": 0 2024-09-10T23:37:08.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.851 INFO:teuthology.orchestra.run.smithi194.stdout: "purge_queue": { 2024-09-10T23:37:08.851 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_ops": 0, 2024-09-10T23:37:08.851 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T23:37:08.851 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing": 0, 2024-09-10T23:37:08.851 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_high_water": 0, 2024-09-10T23:37:08.851 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executed_ops": 0, 2024-09-10T23:37:08.852 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executed": 0, 2024-09-10T23:37:08.852 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_item_in_journal": 0 2024-09-10T23:37:08.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.852 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:37:08.852 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-10T23:37:08.852 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 104857600, 2024-09-10T23:37:08.852 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-10T23:37:08.852 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 2356, 2024-09-10T23:37:08.852 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 1546366, 2024-09-10T23:37:08.852 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-10T23:37:08.852 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 2356, 2024-09-10T23:37:08.852 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-09-10T23:37:08.852 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-09-10T23:37:08.853 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 2356, 2024-09-10T23:37:08.853 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 1546366, 2024-09-10T23:37:08.853 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-10T23:37:08.853 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.853 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.853 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.853 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-10T23:37:08.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.853 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-objecter_bytes": { 2024-09-10T23:37:08.854 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-10T23:37:08.854 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 104857600, 2024-09-10T23:37:08.854 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-10T23:37:08.854 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2024-09-10T23:37:08.854 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2024-09-10T23:37:08.854 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-10T23:37:08.854 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2024-09-10T23:37:08.854 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 2113, 2024-09-10T23:37:08.854 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 1477, 2024-09-10T23:37:08.854 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 2113, 2024-09-10T23:37:08.854 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 1477, 2024-09-10T23:37:08.854 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-10T23:37:08.855 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.855 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.855 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.855 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-10T23:37:08.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.855 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-objecter_ops": { 2024-09-10T23:37:08.855 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-10T23:37:08.855 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 1024, 2024-09-10T23:37:08.855 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-10T23:37:08.855 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2024-09-10T23:37:08.855 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2024-09-10T23:37:08.855 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-10T23:37:08.856 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2024-09-10T23:37:08.856 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 2113, 2024-09-10T23:37:08.856 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 2113, 2024-09-10T23:37:08.856 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 2113, 2024-09-10T23:37:08.856 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 2113, 2024-09-10T23:37:08.856 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-10T23:37:08.856 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.856 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.856 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.856 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-10T23:37:08.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.856 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-write_buf_throttle": { 2024-09-10T23:37:08.856 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-10T23:37:08.857 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 3758096384, 2024-09-10T23:37:08.857 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-10T23:37:08.857 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2024-09-10T23:37:08.857 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2024-09-10T23:37:08.857 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-10T23:37:08.857 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2024-09-10T23:37:08.857 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-09-10T23:37:08.857 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-09-10T23:37:08.857 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 0, 2024-09-10T23:37:08.857 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 0, 2024-09-10T23:37:08.857 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-10T23:37:08.857 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.857 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.857 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.858 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-10T23:37:08.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.858 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-write_buf_throttle-0x55765989ac80": { 2024-09-10T23:37:08.858 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-10T23:37:08.858 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 3758096384, 2024-09-10T23:37:08.858 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-10T23:37:08.858 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2024-09-10T23:37:08.858 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2024-09-10T23:37:08.858 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-10T23:37:08.858 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2024-09-10T23:37:08.858 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-09-10T23:37:08.858 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-09-10T23:37:08.858 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 0, 2024-09-10T23:37:08.858 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 0, 2024-09-10T23:37:08.859 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-10T23:37:08.859 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:08.859 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:08.859 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:08.859 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-10T23:37:08.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:08.859 INFO:teuthology.orchestra.run.smithi194.stdout: "trackedop": { 2024-09-10T23:37:08.859 INFO:teuthology.orchestra.run.smithi194.stdout: "slow_ops_count": 0 2024-09-10T23:37:08.859 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-10T23:37:08.859 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-10T23:37:08.860 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:08 smithi038 ceph-mon[34225]: pgmap v709: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:37:09.593 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-10T23:37:09.593 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-09-10T23:37:09.593 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=0 2024-09-10T23:37:09.593 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=0 2024-09-10T23:37:09.593 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=0 2024-09-10T23:37:09.594 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-09-10T23:37:09.594 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-09-10T23:37:09.594 DEBUG:tasks.check_counter:Getting stats from l 2024-09-10T23:37:09.594 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-10T23:37:09.972 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:37:10.552 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-10T23:37:10.552 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:37:10.552 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 237, 2024-09-10T23:37:10.552 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 228, 2024-09-10T23:37:10.552 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 1144256, 2024-09-10T23:37:10.552 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 139872, 2024-09-10T23:37:10.552 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 4, 2024-09-10T23:37:10.552 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 0, 2024-09-10T23:37:10.553 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.063988878, 2024-09-10T23:37:10.553 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.029379555, 2024-09-10T23:37:10.553 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.044795714, 2024-09-10T23:37:10.553 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:37:10.553 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:37:10.553 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 228, 2024-09-10T23:37:10.553 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.025609924, 2024-09-10T23:37:10.553 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000112324 2024-09-10T23:37:10.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:10.553 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:37:10.553 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:10.553 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:10.554 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:10.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:10.554 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 1144256, 2024-09-10T23:37:10.554 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 139872 2024-09-10T23:37:10.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:10.554 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:37:10.554 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 1, 2024-09-10T23:37:10.554 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 173, 2024-09-10T23:37:10.554 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 160, 2024-09-10T23:37:10.554 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 76256, 2024-09-10T23:37:10.554 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 3, 2024-09-10T23:37:10.554 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 2, 2024-09-10T23:37:10.554 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.017435940, 2024-09-10T23:37:10.555 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.013284213, 2024-09-10T23:37:10.555 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.000973396, 2024-09-10T23:37:10.555 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:37:10.555 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:37:10.555 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 171, 2024-09-10T23:37:10.555 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.014912850, 2024-09-10T23:37:10.555 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000087209 2024-09-10T23:37:10.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:10.555 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:37:10.556 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:10.556 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:10.556 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:10.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:10.556 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T23:37:10.556 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 76256 2024-09-10T23:37:10.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:10.557 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:37:10.557 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 0, 2024-09-10T23:37:10.557 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 2, 2024-09-10T23:37:10.557 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 0, 2024-09-10T23:37:10.557 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 0, 2024-09-10T23:37:10.557 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 2, 2024-09-10T23:37:10.557 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 1, 2024-09-10T23:37:10.557 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.000463150, 2024-09-10T23:37:10.557 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T23:37:10.557 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.000325674, 2024-09-10T23:37:10.557 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:37:10.557 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:37:10.557 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:10.558 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:10.558 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:10.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:10.558 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:37:10.558 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:10.558 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:10.558 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:10.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:10.558 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T23:37:10.558 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T23:37:10.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:10.558 INFO:teuthology.orchestra.run.smithi194.stdout: "cct": { 2024-09-10T23:37:10.558 INFO:teuthology.orchestra.run.smithi194.stdout: "total_workers": 0, 2024-09-10T23:37:10.559 INFO:teuthology.orchestra.run.smithi194.stdout: "unhealthy_workers": 0 2024-09-10T23:37:10.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:10.559 INFO:teuthology.orchestra.run.smithi194.stdout: "mempool": { 2024-09-10T23:37:10.559 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:37:10.559 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_items": 0, 2024-09-10T23:37:10.559 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:37:10.559 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:37:10.559 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:37:10.559 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:37:10.559 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:37:10.559 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:37:10.559 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:37:10.559 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:37:10.560 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:37:10.560 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:37:10.560 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:37:10.560 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:37:10.560 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:37:10.560 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_items": 0, 2024-09-10T23:37:10.560 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:37:10.560 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_items": 0, 2024-09-10T23:37:10.560 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:37:10.560 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:37:10.560 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:37:10.560 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:37:10.560 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:37:10.560 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:37:10.561 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:37:10.561 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_items": 0, 2024-09-10T23:37:10.561 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:37:10.561 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:37:10.561 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:37:10.561 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_items": 0, 2024-09-10T23:37:10.561 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_bytes": 0, 2024-09-10T23:37:10.561 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_items": 0, 2024-09-10T23:37:10.561 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:37:10.561 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:37:10.561 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:37:10.561 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:37:10.561 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_bytes": 148945, 2024-09-10T23:37:10.561 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_items": 29, 2024-09-10T23:37:10.561 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:37:10.562 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_items": 0, 2024-09-10T23:37:10.562 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_bytes": 0, 2024-09-10T23:37:10.562 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_items": 0, 2024-09-10T23:37:10.562 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:37:10.562 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_items": 0, 2024-09-10T23:37:10.562 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:37:10.562 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_items": 0, 2024-09-10T23:37:10.562 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_bytes": 0, 2024-09-10T23:37:10.562 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_items": 0, 2024-09-10T23:37:10.562 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:37:10.562 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:37:10.562 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_bytes": 0, 2024-09-10T23:37:10.562 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_items": 0, 2024-09-10T23:37:10.562 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_bytes": 968, 2024-09-10T23:37:10.563 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_items": 2, 2024-09-10T23:37:10.563 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_bytes": 0, 2024-09-10T23:37:10.563 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_items": 0, 2024-09-10T23:37:10.563 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_bytes": 0, 2024-09-10T23:37:10.563 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_items": 0 2024-09-10T23:37:10.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-10T23:37:10.563 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:37:10.563 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-10T23:37:10.563 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 104857600, 2024-09-10T23:37:10.563 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-10T23:37:10.563 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 234, 2024-09-10T23:37:10.563 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 1108338, 2024-09-10T23:37:10.563 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-10T23:37:10.564 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 234, 2024-09-10T23:37:10.564 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-09-10T23:37:10.564 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-09-10T23:37:10.564 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 234, 2024-09-10T23:37:10.564 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 1108338, 2024-09-10T23:37:10.564 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-10T23:37:10.564 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-10T23:37:10.564 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-10T23:37:10.564 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-10T23:37:10.564 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-10T23:37:10.564 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-10T23:37:10.564 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-10T23:37:10.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:10 smithi194 ceph-mon[33904]: pgmap v710: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:37:10.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:10 smithi003 ceph-mon[30348]: pgmap v710: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:37:10.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:10 smithi038 ceph-mon[34225]: pgmap v710: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:37:11.312 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-10T23:37:11.312 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-10T23:37:11.312 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-09-10T23:37:11.312 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-09-10T23:37:11.312 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-09-10T23:37:11.312 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-09-10T23:37:11.312 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-09-10T23:37:11.313 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-10T23:37:11.322 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-10T23:37:11.322 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-10T23:37:11.322 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:37:11.363 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-10T23:37:11.363 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:37:11.443 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-10T23:37:11.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:11 smithi194 ceph-mon[33904]: osdmap e99: 12 total, 12 up, 12 in 2024-09-10T23:37:11.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:11 smithi003 ceph-mon[30348]: osdmap e99: 12 total, 12 up, 12 in 2024-09-10T23:37:11.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:11 smithi038 ceph-mon[34225]: osdmap e99: 12 total, 12 up, 12 in 2024-09-10T23:37:11.867 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:37:12.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.452+0000 7f33b9400640 1 -- 172.21.15.3:0/1919482933 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f33b4077ff0 msgr2=0x7f33b41132a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:12.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.452+0000 7f33b9400640 1 --2- 172.21.15.3:0/1919482933 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f33b4077ff0 0x7f33b41132a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f33a0009900 tx=0x7f33a002a410 comp rx=0 tx=0).stop 2024-09-10T23:37:12.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.452+0000 7f33b9400640 1 -- 172.21.15.3:0/1919482933 shutdown_connections 2024-09-10T23:37:12.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.452+0000 7f33b9400640 1 --2- 172.21.15.3:0/1919482933 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33b41137e0 0x7f33b4115bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:12.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.452+0000 7f33b9400640 1 --2- 172.21.15.3:0/1919482933 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f33b4077ff0 0x7f33b41132a0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:12.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.452+0000 7f33b9400640 1 --2- 172.21.15.3:0/1919482933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33b40776d0 0x7f33b4077ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:12.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.452+0000 7f33b9400640 1 -- 172.21.15.3:0/1919482933 >> 172.21.15.3:0/1919482933 conn(0x7f33b4100840 msgr2=0x7f33b4102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:12.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.452+0000 7f33b9400640 1 -- 172.21.15.3:0/1919482933 shutdown_connections 2024-09-10T23:37:12.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.452+0000 7f33b9400640 1 -- 172.21.15.3:0/1919482933 wait complete. 2024-09-10T23:37:12.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.453+0000 7f33b9400640 1 Processor -- start 2024-09-10T23:37:12.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.454+0000 7f33b9400640 1 -- start start 2024-09-10T23:37:12.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.454+0000 7f33b9400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33b40776d0 0x7f33b419f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:12.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.454+0000 7f33b9400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f33b4077ff0 0x7f33b419fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:12.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.454+0000 7f33b9400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33b41137e0 0x7f33b41a4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:12.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.454+0000 7f33b9400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f33b4119090 con 0x7f33b4077ff0 2024-09-10T23:37:12.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.454+0000 7f33b9400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f33b4118f10 con 0x7f33b41137e0 2024-09-10T23:37:12.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.454+0000 7f33b9400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f33b4119210 con 0x7f33b40776d0 2024-09-10T23:37:12.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.454+0000 7f33b3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f33b4077ff0 0x7f33b419fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:12.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.454+0000 7f33b3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f33b4077ff0 0x7f33b419fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33250/0 (socket says 172.21.15.3:33250) 2024-09-10T23:37:12.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.454+0000 7f33b3400640 1 -- 172.21.15.3:0/1606522055 learned_addr learned my addr 172.21.15.3:0/1606522055 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:37:12.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.455+0000 7f33b3e00640 1 --2- 172.21.15.3:0/1606522055 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33b40776d0 0x7f33b419f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:12.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.455+0000 7f33b3400640 1 -- 172.21.15.3:0/1606522055 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33b40776d0 msgr2=0x7f33b419f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:12.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.455+0000 7f33b3400640 1 --2- 172.21.15.3:0/1606522055 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33b40776d0 0x7f33b419f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:12.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.455+0000 7f33b8a00640 1 --2- 172.21.15.3:0/1606522055 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33b41137e0 0x7f33b41a4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:12.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.455+0000 7f33b3400640 1 -- 172.21.15.3:0/1606522055 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33b41137e0 msgr2=0x7f33b41a4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:12.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.455+0000 7f33b3400640 1 --2- 172.21.15.3:0/1606522055 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33b41137e0 0x7f33b41a4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:12.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.455+0000 7f33b3400640 1 -- 172.21.15.3:0/1606522055 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b41a55f0 con 0x7f33b4077ff0 2024-09-10T23:37:12.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.455+0000 7f33b8a00640 1 --2- 172.21.15.3:0/1606522055 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33b41137e0 0x7f33b41a4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:37:12.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.455+0000 7f33b3400640 1 --2- 172.21.15.3:0/1606522055 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f33b4077ff0 0x7f33b419fa80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f33a0009230 tx=0x7f33a0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:12.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.456+0000 7f33b0c00640 1 -- 172.21.15.3:0/1606522055 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a003f030 con 0x7f33b4077ff0 2024-09-10T23:37:12.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.456+0000 7f33b0c00640 1 -- 172.21.15.3:0/1606522055 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f33a0003a80 con 0x7f33b4077ff0 2024-09-10T23:37:12.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.456+0000 7f33b9400640 1 -- 172.21.15.3:0/1606522055 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33b41a5880 con 0x7f33b4077ff0 2024-09-10T23:37:12.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.456+0000 7f33b0c00640 1 -- 172.21.15.3:0/1606522055 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a0035070 con 0x7f33b4077ff0 2024-09-10T23:37:12.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.456+0000 7f33b9400640 1 -- 172.21.15.3:0/1606522055 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33b41abfa0 con 0x7f33b4077ff0 2024-09-10T23:37:12.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.457+0000 7f33b9400640 1 -- 172.21.15.3:0/1606522055 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33b4077ab0 con 0x7f33b4077ff0 2024-09-10T23:37:12.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.460+0000 7f33b0c00640 1 -- 172.21.15.3:0/1606522055 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 26) ==== 153380+0+0 (secure 0 0 0) 0x7f33a003bc30 con 0x7f33b4077ff0 2024-09-10T23:37:12.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.462+0000 7f33b0c00640 1 --2- 172.21.15.3:0/1606522055 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f33980b5580 0x7f33980b7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:12.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.462+0000 7f33b0c00640 1 -- 172.21.15.3:0/1606522055 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9578+0+0 (secure 0 0 0) 0x7f33a0106ed0 con 0x7f33b4077ff0 2024-09-10T23:37:12.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.462+0000 7f33b3e00640 1 --2- 172.21.15.3:0/1606522055 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f33980b5580 0x7f33980b7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:12.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.463+0000 7f33b3e00640 1 --2- 172.21.15.3:0/1606522055 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f33980b5580 0x7f33980b7a40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f33a4005fd0 tx=0x7f33a4005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:12.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.469+0000 7f33b0c00640 1 -- 172.21.15.3:0/1606522055 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f33a00cd5d0 con 0x7f33b4077ff0 2024-09-10T23:37:12.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.678+0000 7f33b9400640 1 -- 172.21.15.3:0/1606522055 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f33b41a0670 con 0x7f33b4077ff0 2024-09-10T23:37:12.680 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:12 smithi003 ceph-mon[30348]: pgmap v712: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-10T23:37:12.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.679+0000 7f33b0c00640 1 -- 172.21.15.3:0/1606522055 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v99) ==== 81+0+869 (secure 0 0 0) 0x7f33a00cced0 con 0x7f33b4077ff0 2024-09-10T23:37:12.680 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/776988825 2024-09-11T23:16:20.647314+0000 2024-09-10T23:37:12.680 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/2965090335 2024-09-11T23:14:37.169991+0000 2024-09-10T23:37:12.680 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/2364823868 2024-09-11T23:14:37.169991+0000 2024-09-10T23:37:12.681 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/3186881356 2024-09-11T23:14:37.169991+0000 2024-09-10T23:37:12.681 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/911991463 2024-09-11T23:16:20.647314+0000 2024-09-10T23:37:12.681 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6800/2582365069 2024-09-11T23:14:37.169991+0000 2024-09-10T23:37:12.681 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6801/2582365069 2024-09-11T23:14:37.169991+0000 2024-09-10T23:37:12.681 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6801/1528153492 2024-09-11T23:15:05.835734+0000 2024-09-10T23:37:12.681 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6800/1924113958 2024-09-11T23:16:20.647314+0000 2024-09-10T23:37:12.681 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/554479543 2024-09-11T23:15:05.835734+0000 2024-09-10T23:37:12.681 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/4238683346 2024-09-11T23:15:05.835734+0000 2024-09-10T23:37:12.681 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6800/1528153492 2024-09-11T23:15:05.835734+0000 2024-09-10T23:37:12.681 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/285471483 2024-09-11T23:15:05.835734+0000 2024-09-10T23:37:12.681 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/1249510760 2024-09-11T23:16:20.647314+0000 2024-09-10T23:37:12.681 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6801/1924113958 2024-09-11T23:16:20.647314+0000 2024-09-10T23:37:12.682 INFO:teuthology.orchestra.run.smithi003.stderr:listed 15 entries 2024-09-10T23:37:12.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.681+0000 7f33b9400640 1 -- 172.21.15.3:0/1606522055 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f33980b5580 msgr2=0x7f33980b7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:12.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.681+0000 7f33b9400640 1 --2- 172.21.15.3:0/1606522055 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f33980b5580 0x7f33980b7a40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f33a4005fd0 tx=0x7f33a4005850 comp rx=0 tx=0).stop 2024-09-10T23:37:12.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.681+0000 7f33b9400640 1 -- 172.21.15.3:0/1606522055 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f33b4077ff0 msgr2=0x7f33b419fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:12.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.681+0000 7f33b9400640 1 --2- 172.21.15.3:0/1606522055 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f33b4077ff0 0x7f33b419fa80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f33a0009230 tx=0x7f33a0004270 comp rx=0 tx=0).stop 2024-09-10T23:37:12.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.681+0000 7f33b9400640 1 -- 172.21.15.3:0/1606522055 shutdown_connections 2024-09-10T23:37:12.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.681+0000 7f33b9400640 1 --2- 172.21.15.3:0/1606522055 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33b41137e0 0x7f33b41a4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:12.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.681+0000 7f33b9400640 1 --2- 172.21.15.3:0/1606522055 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f33980b5580 0x7f33980b7a40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:12.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.681+0000 7f33b9400640 1 --2- 172.21.15.3:0/1606522055 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f33b4077ff0 0x7f33b419fa80 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:12.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.681+0000 7f33b9400640 1 --2- 172.21.15.3:0/1606522055 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33b40776d0 0x7f33b419f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:12.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.681+0000 7f33b9400640 1 -- 172.21.15.3:0/1606522055 >> 172.21.15.3:0/1606522055 conn(0x7f33b4100840 msgr2=0x7f33b4102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:12.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.682+0000 7f33b9400640 1 -- 172.21.15.3:0/1606522055 shutdown_connections 2024-09-10T23:37:12.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:12.682+0000 7f33b9400640 1 -- 172.21.15.3:0/1606522055 wait complete. 2024-09-10T23:37:12.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:12 smithi038 ceph-mon[34225]: pgmap v712: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-10T23:37:12.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:12 smithi194 ceph-mon[33904]: pgmap v712: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-10T23:37:13.430 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-10T23:37:13.431 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:37:13.468 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-10T23:37:13.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:13 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1606522055' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T23:37:13.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:13 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/1606522055' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T23:37:13.889 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:37:13.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:13 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/1606522055' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T23:37:14.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.467+0000 7f19d7e00640 1 -- 172.21.15.3:0/1048697230 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19d810b180 msgr2=0x7f19d8111980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:14.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.467+0000 7f19d7e00640 1 --2- 172.21.15.3:0/1048697230 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19d810b180 0x7f19d8111980 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f19d0009ca0 tx=0x7f19d002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:37:14.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.467+0000 7f19d7e00640 1 -- 172.21.15.3:0/1048697230 shutdown_connections 2024-09-10T23:37:14.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.467+0000 7f19d7e00640 1 --2- 172.21.15.3:0/1048697230 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19d810b180 0x7f19d8111980 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:14.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.467+0000 7f19d7e00640 1 --2- 172.21.15.3:0/1048697230 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19d810a800 0x7f19d810ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:14.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.467+0000 7f19d7e00640 1 --2- 172.21.15.3:0/1048697230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19d8104df0 0x7f19d81051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:14.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.467+0000 7f19d7e00640 1 -- 172.21.15.3:0/1048697230 >> 172.21.15.3:0/1048697230 conn(0x7f19d8100840 msgr2=0x7f19d8102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:14.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.467+0000 7f19d7e00640 1 -- 172.21.15.3:0/1048697230 shutdown_connections 2024-09-10T23:37:14.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.467+0000 7f19d7e00640 1 -- 172.21.15.3:0/1048697230 wait complete. 2024-09-10T23:37:14.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.468+0000 7f19d7e00640 1 Processor -- start 2024-09-10T23:37:14.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.468+0000 7f19d7e00640 1 -- start start 2024-09-10T23:37:14.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.469+0000 7f19d7e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19d8104df0 0x7f19d819b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:14.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.469+0000 7f19d7e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19d810a800 0x7f19d819b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:14.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.469+0000 7f19d7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19d810b180 0x7f19d81a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:14.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.469+0000 7f19d7e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f19d8114d00 con 0x7f19d810b180 2024-09-10T23:37:14.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.469+0000 7f19d7e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f19d8114b80 con 0x7f19d810a800 2024-09-10T23:37:14.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.469+0000 7f19d7e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f19d8114e80 con 0x7f19d8104df0 2024-09-10T23:37:14.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.469+0000 7f19d7400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19d810b180 0x7f19d81a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:14.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.469+0000 7f19d7400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19d810b180 0x7f19d81a0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33254/0 (socket says 172.21.15.3:33254) 2024-09-10T23:37:14.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.469+0000 7f19d7400640 1 -- 172.21.15.3:0/2345852947 learned_addr learned my addr 172.21.15.3:0/2345852947 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:37:14.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.469+0000 7f19d6000640 1 --2- 172.21.15.3:0/2345852947 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19d810a800 0x7f19d819b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:14.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.469+0000 7f19d6a00640 1 --2- 172.21.15.3:0/2345852947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19d8104df0 0x7f19d819b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:14.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.470+0000 7f19d7400640 1 -- 172.21.15.3:0/2345852947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19d8104df0 msgr2=0x7f19d819b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:14.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.470+0000 7f19d7400640 1 --2- 172.21.15.3:0/2345852947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19d8104df0 0x7f19d819b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:14.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.470+0000 7f19d7400640 1 -- 172.21.15.3:0/2345852947 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19d810a800 msgr2=0x7f19d819b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:14.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.470+0000 7f19d7400640 1 --2- 172.21.15.3:0/2345852947 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19d810a800 0x7f19d819b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:14.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.470+0000 7f19d7400640 1 -- 172.21.15.3:0/2345852947 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d81a1220 con 0x7f19d810b180 2024-09-10T23:37:14.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.470+0000 7f19d7400640 1 --2- 172.21.15.3:0/2345852947 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19d810b180 0x7f19d81a0a50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f19d0005e30 tx=0x7f19d00093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:14.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.473+0000 7f19cf400640 1 -- 172.21.15.3:0/2345852947 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d0032d10 con 0x7f19d810b180 2024-09-10T23:37:14.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.473+0000 7f19cf400640 1 -- 172.21.15.3:0/2345852947 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f19d0032eb0 con 0x7f19d810b180 2024-09-10T23:37:14.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.473+0000 7f19cf400640 1 -- 172.21.15.3:0/2345852947 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d0030b20 con 0x7f19d810b180 2024-09-10T23:37:14.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.473+0000 7f19d7e00640 1 -- 172.21.15.3:0/2345852947 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19d81a14b0 con 0x7f19d810b180 2024-09-10T23:37:14.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.473+0000 7f19d7e00640 1 -- 172.21.15.3:0/2345852947 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19d81a7bd0 con 0x7f19d810b180 2024-09-10T23:37:14.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.474+0000 7f19d7e00640 1 -- 172.21.15.3:0/2345852947 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19d81051d0 con 0x7f19d810b180 2024-09-10T23:37:14.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.476+0000 7f19cf400640 1 -- 172.21.15.3:0/2345852947 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 26) ==== 153380+0+0 (secure 0 0 0) 0x7f19d0030ce0 con 0x7f19d810b180 2024-09-10T23:37:14.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.478+0000 7f19cf400640 1 --2- 172.21.15.3:0/2345852947 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f19bc0b5500 0x7f19bc0b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:14.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.478+0000 7f19cf400640 1 -- 172.21.15.3:0/2345852947 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9578+0+0 (secure 0 0 0) 0x7f19d01075d0 con 0x7f19d810b180 2024-09-10T23:37:14.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.478+0000 7f19d6a00640 1 --2- 172.21.15.3:0/2345852947 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f19bc0b5500 0x7f19bc0b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:14.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.479+0000 7f19d6a00640 1 --2- 172.21.15.3:0/2345852947 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f19bc0b5500 0x7f19bc0b79c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f19c800bbe0 tx=0x7f19c800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:14.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.482+0000 7f19cf400640 1 -- 172.21.15.3:0/2345852947 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f19d00cdcd0 con 0x7f19d810b180 2024-09-10T23:37:14.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.690+0000 7f19d7e00640 1 -- 172.21.15.3:0/2345852947 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f19d81a7e00 con 0x7f19d810b180 2024-09-10T23:37:14.691 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:14 smithi003 ceph-mon[30348]: pgmap v713: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:37:14.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.690+0000 7f19cf400640 1 -- 172.21.15.3:0/2345852947 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v99) ==== 81+0+869 (secure 0 0 0) 0x7f19d00cd5d0 con 0x7f19d810b180 2024-09-10T23:37:14.692 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/776988825 2024-09-11T23:16:20.647314+0000 2024-09-10T23:37:14.692 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/2965090335 2024-09-11T23:14:37.169991+0000 2024-09-10T23:37:14.692 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/2364823868 2024-09-11T23:14:37.169991+0000 2024-09-10T23:37:14.692 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/3186881356 2024-09-11T23:14:37.169991+0000 2024-09-10T23:37:14.693 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/911991463 2024-09-11T23:16:20.647314+0000 2024-09-10T23:37:14.693 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6800/2582365069 2024-09-11T23:14:37.169991+0000 2024-09-10T23:37:14.693 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6801/2582365069 2024-09-11T23:14:37.169991+0000 2024-09-10T23:37:14.693 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6801/1528153492 2024-09-11T23:15:05.835734+0000 2024-09-10T23:37:14.693 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6800/1924113958 2024-09-11T23:16:20.647314+0000 2024-09-10T23:37:14.693 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/554479543 2024-09-11T23:15:05.835734+0000 2024-09-10T23:37:14.693 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/4238683346 2024-09-11T23:15:05.835734+0000 2024-09-10T23:37:14.693 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6800/1528153492 2024-09-11T23:15:05.835734+0000 2024-09-10T23:37:14.693 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/285471483 2024-09-11T23:15:05.835734+0000 2024-09-10T23:37:14.693 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/1249510760 2024-09-11T23:16:20.647314+0000 2024-09-10T23:37:14.693 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6801/1924113958 2024-09-11T23:16:20.647314+0000 2024-09-10T23:37:14.693 INFO:teuthology.orchestra.run.smithi003.stderr:listed 15 entries 2024-09-10T23:37:14.694 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.693+0000 7f19d7e00640 1 -- 172.21.15.3:0/2345852947 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f19bc0b5500 msgr2=0x7f19bc0b79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:14.694 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.693+0000 7f19d7e00640 1 --2- 172.21.15.3:0/2345852947 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f19bc0b5500 0x7f19bc0b79c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f19c800bbe0 tx=0x7f19c800b390 comp rx=0 tx=0).stop 2024-09-10T23:37:14.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.693+0000 7f19d7e00640 1 -- 172.21.15.3:0/2345852947 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19d810b180 msgr2=0x7f19d81a0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:14.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.693+0000 7f19d7e00640 1 --2- 172.21.15.3:0/2345852947 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19d810b180 0x7f19d81a0a50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f19d0005e30 tx=0x7f19d00093d0 comp rx=0 tx=0).stop 2024-09-10T23:37:14.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.693+0000 7f19d7e00640 1 -- 172.21.15.3:0/2345852947 shutdown_connections 2024-09-10T23:37:14.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.693+0000 7f19d7e00640 1 --2- 172.21.15.3:0/2345852947 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f19bc0b5500 0x7f19bc0b79c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:14.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.693+0000 7f19d7e00640 1 --2- 172.21.15.3:0/2345852947 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19d810b180 0x7f19d81a0a50 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:14.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.693+0000 7f19d7e00640 1 --2- 172.21.15.3:0/2345852947 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19d810a800 0x7f19d819b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:14.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.693+0000 7f19d7e00640 1 --2- 172.21.15.3:0/2345852947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19d8104df0 0x7f19d819b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:14.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.693+0000 7f19d7e00640 1 -- 172.21.15.3:0/2345852947 >> 172.21.15.3:0/2345852947 conn(0x7f19d8100840 msgr2=0x7f19d8101030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:14.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.693+0000 7f19d7e00640 1 -- 172.21.15.3:0/2345852947 shutdown_connections 2024-09-10T23:37:14.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:14.693+0000 7f19d7e00640 1 -- 172.21.15.3:0/2345852947 wait complete. 2024-09-10T23:37:14.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:14 smithi038 ceph-mon[34225]: pgmap v713: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:37:14.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:14 smithi194 ceph-mon[33904]: pgmap v713: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:37:15.482 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi003.front.sepia.ceph.com... 2024-09-10T23:37:15.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:37:15.483 DEBUG:teuthology.orchestra.run.smithi003:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T23:37:15.542 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:37:15.545 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi003.stderr:ceph-fuse[89332]: fuse finished with error 0 and tester_r 0 2024-09-10T23:37:15.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:15 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2345852947' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T23:37:15.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:15 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2345852947' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T23:37:15.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:15 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2345852947' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T23:37:16.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:16 smithi038 ceph-mon[34225]: pgmap v714: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:37:16.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:16 smithi194 ceph-mon[33904]: pgmap v714: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:37:16.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:16 smithi003 ceph-mon[30348]: pgmap v714: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:37:17.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:17 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:37:17.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:17 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:17.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:17 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:37:17.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:17 smithi038 ceph-mon[34225]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:37:17.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:17 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:37:17.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:17 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:17.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:17 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:37:17.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:17 smithi194 ceph-mon[33904]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:37:17.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:17 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:37:17.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:17 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:17.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:17 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:37:17.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:17 smithi003 ceph-mon[30348]: from='mgr.14223 ' entity='mgr.x' 2024-09-10T23:37:18.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:18 smithi194 ceph-mon[33904]: pgmap v715: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 614 B/s wr, 6 op/s 2024-09-10T23:37:18.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:18 smithi194 ceph-mon[33904]: osdmap e100: 12 total, 12 up, 12 in 2024-09-10T23:37:18.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:18 smithi038 ceph-mon[34225]: pgmap v715: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 614 B/s wr, 6 op/s 2024-09-10T23:37:18.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:18 smithi038 ceph-mon[34225]: osdmap e100: 12 total, 12 up, 12 in 2024-09-10T23:37:18.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:18 smithi003 ceph-mon[30348]: pgmap v715: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 614 B/s wr, 6 op/s 2024-09-10T23:37:18.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:18 smithi003 ceph-mon[30348]: osdmap e100: 12 total, 12 up, 12 in 2024-09-10T23:37:20.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:20 smithi038 ceph-mon[34225]: pgmap v717: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-10T23:37:20.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:20 smithi194 ceph-mon[33904]: pgmap v717: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-10T23:37:20.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:20 smithi003 ceph-mon[30348]: pgmap v717: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-10T23:37:21.644 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi003.front.sepia.ceph.com 2024-09-10T23:37:21.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:37:21.645 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T23:37:21.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:37:21.686 DEBUG:teuthology.orchestra.run.smithi003:> ip netns list 2024-09-10T23:37:21.764 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:37:21.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:37:21.765 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:37:21.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:37:21.866 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link delete ceph-brx 2024-09-10T23:37:22.226 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-10T23:37:22.237 INFO:tasks.cephadm:Teardown begin 2024-09-10T23:37:22.237 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T23:37:22.237 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:37:22.648 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:37:22.788 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:22 smithi003 ceph-mon[30348]: pgmap v718: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-10T23:37:22.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:22 smithi038 ceph-mon[34225]: pgmap v718: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-10T23:37:22.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:22 smithi194 ceph-mon[33904]: pgmap v718: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-10T23:37:23.224 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.222+0000 7fef8ae00640 1 -- 172.21.15.3:0/2133595282 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef8410f220 msgr2=0x7fef84111610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:23.224 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.222+0000 7fef8ae00640 1 --2- 172.21.15.3:0/2133595282 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef8410f220 0x7fef84111610 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fef7c009ca0 tx=0x7fef7c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:37:23.225 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.222+0000 7fef8ae00640 1 -- 172.21.15.3:0/2133595282 shutdown_connections 2024-09-10T23:37:23.225 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.222+0000 7fef8ae00640 1 --2- 172.21.15.3:0/2133595282 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef8410f220 0x7fef84111610 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:23.225 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.222+0000 7fef8ae00640 1 --2- 172.21.15.3:0/2133595282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef84075de0 0x7fef8410ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:23.225 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.222+0000 7fef8ae00640 1 --2- 172.21.15.3:0/2133595282 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef840754c0 0x7fef840758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:23.225 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.222+0000 7fef8ae00640 1 -- 172.21.15.3:0/2133595282 >> 172.21.15.3:0/2133595282 conn(0x7fef840fe660 msgr2=0x7fef84100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:23.225 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.222+0000 7fef8ae00640 1 -- 172.21.15.3:0/2133595282 shutdown_connections 2024-09-10T23:37:23.225 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.222+0000 7fef8ae00640 1 -- 172.21.15.3:0/2133595282 wait complete. 2024-09-10T23:37:23.225 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.223+0000 7fef8ae00640 1 Processor -- start 2024-09-10T23:37:23.226 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.223+0000 7fef8ae00640 1 -- start start 2024-09-10T23:37:23.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.224+0000 7fef8ae00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef840754c0 0x7fef8419b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:23.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.224+0000 7fef8ae00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef84075de0 0x7fef8419b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:23.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.224+0000 7fef8ae00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef8410f220 0x7fef841a0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:23.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.224+0000 7fef8ae00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fef84114d00 con 0x7fef8410f220 2024-09-10T23:37:23.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.224+0000 7fef8ae00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fef84114b80 con 0x7fef84075de0 2024-09-10T23:37:23.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.224+0000 7fef8ae00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fef84114e80 con 0x7fef840754c0 2024-09-10T23:37:23.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.224+0000 7fef89000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef84075de0 0x7fef8419b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:23.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.224+0000 7fef8a400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef8410f220 0x7fef841a0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:23.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.224+0000 7fef89a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef840754c0 0x7fef8419b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:23.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.224+0000 7fef89000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef84075de0 0x7fef8419b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.3:49030/0 (socket says 172.21.15.3:49030) 2024-09-10T23:37:23.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.224+0000 7fef89000640 1 -- 172.21.15.3:0/4248156746 learned_addr learned my addr 172.21.15.3:0/4248156746 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:37:23.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.225+0000 7fef8a400640 1 -- 172.21.15.3:0/4248156746 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef840754c0 msgr2=0x7fef8419b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:23.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.225+0000 7fef8a400640 1 --2- 172.21.15.3:0/4248156746 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef840754c0 0x7fef8419b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:23.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.225+0000 7fef8a400640 1 -- 172.21.15.3:0/4248156746 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef84075de0 msgr2=0x7fef8419b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:23.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.225+0000 7fef8a400640 1 --2- 172.21.15.3:0/4248156746 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef84075de0 0x7fef8419b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:23.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.225+0000 7fef8a400640 1 -- 172.21.15.3:0/4248156746 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef841a11e0 con 0x7fef8410f220 2024-09-10T23:37:23.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.225+0000 7fef89a00640 1 --2- 172.21.15.3:0/4248156746 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef840754c0 0x7fef8419b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:37:23.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.225+0000 7fef8a400640 1 --2- 172.21.15.3:0/4248156746 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef8410f220 0x7fef841a0a10 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fef7c02ade0 tx=0x7fef7c032990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:23.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.225+0000 7fef82000640 1 -- 172.21.15.3:0/4248156746 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c032d80 con 0x7fef8410f220 2024-09-10T23:37:23.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.226+0000 7fef82000640 1 -- 172.21.15.3:0/4248156746 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef7c0044d0 con 0x7fef8410f220 2024-09-10T23:37:23.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.226+0000 7fef82000640 1 -- 172.21.15.3:0/4248156746 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c030b90 con 0x7fef8410f220 2024-09-10T23:37:23.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.226+0000 7fef8ae00640 1 -- 172.21.15.3:0/4248156746 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef841a1470 con 0x7fef8410f220 2024-09-10T23:37:23.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.226+0000 7fef8ae00640 1 -- 172.21.15.3:0/4248156746 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef841a7b90 con 0x7fef8410f220 2024-09-10T23:37:23.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.227+0000 7fef8ae00640 1 -- 172.21.15.3:0/4248156746 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef840769d0 con 0x7fef8410f220 2024-09-10T23:37:23.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.229+0000 7fef82000640 1 -- 172.21.15.3:0/4248156746 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 26) ==== 153380+0+0 (secure 0 0 0) 0x7fef7c004040 con 0x7fef8410f220 2024-09-10T23:37:23.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.231+0000 7fef82000640 1 --2- 172.21.15.3:0/4248156746 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fef6c0b5500 0x7fef6c0b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:23.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.231+0000 7fef82000640 1 -- 172.21.15.3:0/4248156746 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9490+0+0 (secure 0 0 0) 0x7fef7c107680 con 0x7fef8410f220 2024-09-10T23:37:23.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.231+0000 7fef89a00640 1 --2- 172.21.15.3:0/4248156746 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fef6c0b5500 0x7fef6c0b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:23.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.232+0000 7fef89a00640 1 --2- 172.21.15.3:0/4248156746 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fef6c0b5500 0x7fef6c0b79c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fef7800bfd0 tx=0x7fef7800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:23.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.233+0000 7fef82000640 1 -- 172.21.15.3:0/4248156746 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fef7c0cddd0 con 0x7fef8410f220 2024-09-10T23:37:23.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.467+0000 7fef8ae00640 1 -- 172.21.15.3:0/4248156746 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef841a7dc0 con 0x7fef8410f220 2024-09-10T23:37:23.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.468+0000 7fef82000640 1 -- 172.21.15.3:0/4248156746 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11891 (secure 0 0 0) 0x7fef7c0cd6d0 con 0x7fef8410f220 2024-09-10T23:37:23.470 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:37:23.470 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":26,"btime":"2024-09-10T23:26:42:260644+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/1495411512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":1495411512},{"type":"v1","addr":"172.21.15.3:6835","nonce":1495411512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/1857372777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1857372777},{"type":"v1","addr":"172.21.15.3:6837","nonce":1857372777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14862,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6839/493850676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":493850676},{"type":"v1","addr":"172.21.15.3:6839","nonce":493850676}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14874,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6841/1580524358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":1580524358},{"type":"v1","addr":"172.21.15.3:6841","nonce":1580524358}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/352514665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":352514665},{"type":"v1","addr":"172.21.15.194:6833","nonce":352514665}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2380508105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2380508105},{"type":"v1","addr":"172.21.15.194:6835","nonce":2380508105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:23:58.866253+0000","modified":"2024-09-10T23:26:41.694795+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34724,"mds_1":34682,"mds_2":34652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24649":{"gid":24649,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/739730313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":739730313},{"type":"v1","addr":"172.21.15.194:6837","nonce":739730313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/3198777710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3198777710},{"type":"v1","addr":"172.21.15.194:6839","nonce":3198777710}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34619":{"gid":34619,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6833/1194099617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1194099617},{"type":"v1","addr":"172.21.15.38:6833","nonce":1194099617}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34652":{"gid":34652,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.38:6835/218783320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":218783320},{"type":"v1","addr":"172.21.15.38:6835","nonce":218783320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34682":{"gid":34682,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":21,"addr":"172.21.15.38:6837/1821839397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":1821839397},{"type":"v1","addr":"172.21.15.38:6837","nonce":1821839397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34724":{"gid":34724,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.38:6839/458259815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":458259815},{"type":"v1","addr":"172.21.15.38:6839","nonce":458259815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34724,"qdb_cluster":[34724,34682,34652]},"id":1}]} 2024-09-10T23:37:23.470 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 26 2024-09-10T23:37:23.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.471+0000 7fef8ae00640 1 -- 172.21.15.3:0/4248156746 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fef6c0b5500 msgr2=0x7fef6c0b79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:23.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.471+0000 7fef8ae00640 1 --2- 172.21.15.3:0/4248156746 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fef6c0b5500 0x7fef6c0b79c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fef7800bfd0 tx=0x7fef7800b390 comp rx=0 tx=0).stop 2024-09-10T23:37:23.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.471+0000 7fef8ae00640 1 -- 172.21.15.3:0/4248156746 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef8410f220 msgr2=0x7fef841a0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:23.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.471+0000 7fef8ae00640 1 --2- 172.21.15.3:0/4248156746 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef8410f220 0x7fef841a0a10 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fef7c02ade0 tx=0x7fef7c032990 comp rx=0 tx=0).stop 2024-09-10T23:37:23.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.471+0000 7fef8ae00640 1 -- 172.21.15.3:0/4248156746 shutdown_connections 2024-09-10T23:37:23.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.471+0000 7fef8ae00640 1 --2- 172.21.15.3:0/4248156746 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fef6c0b5500 0x7fef6c0b79c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:23.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.471+0000 7fef8ae00640 1 --2- 172.21.15.3:0/4248156746 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef8410f220 0x7fef841a0a10 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:23.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.471+0000 7fef8ae00640 1 --2- 172.21.15.3:0/4248156746 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef84075de0 0x7fef8419b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:23.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.471+0000 7fef8ae00640 1 --2- 172.21.15.3:0/4248156746 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef840754c0 0x7fef8419b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:23.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.471+0000 7fef8ae00640 1 -- 172.21.15.3:0/4248156746 >> 172.21.15.3:0/4248156746 conn(0x7fef840fe660 msgr2=0x7fef841113a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:23.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.471+0000 7fef8ae00640 1 -- 172.21.15.3:0/4248156746 shutdown_connections 2024-09-10T23:37:23.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:23.471+0000 7fef8ae00640 1 -- 172.21.15.3:0/4248156746 wait complete. 2024-09-10T23:37:23.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:23 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/4248156746' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:37:23.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:23 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/4248156746' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:37:23.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:23 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/4248156746' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:37:24.279 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:37:24.662 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:37:24.801 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:24 smithi003 ceph-mon[30348]: pgmap v719: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 818 B/s wr, 7 op/s 2024-09-10T23:37:24.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:24 smithi038 ceph-mon[34225]: pgmap v719: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 818 B/s wr, 7 op/s 2024-09-10T23:37:24.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:24 smithi194 ceph-mon[33904]: pgmap v719: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 818 B/s wr, 7 op/s 2024-09-10T23:37:25.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.201+0000 7fb71ec00640 1 -- 172.21.15.3:0/3362553008 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb718104f90 msgr2=0x7fb718105370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:25.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.201+0000 7fb71ec00640 1 --2- 172.21.15.3:0/3362553008 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb718104f90 0x7fb718105370 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb708009900 tx=0x7fb70802a410 comp rx=0 tx=0).stop 2024-09-10T23:37:25.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.201+0000 7fb71ec00640 1 -- 172.21.15.3:0/3362553008 shutdown_connections 2024-09-10T23:37:25.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.201+0000 7fb71ec00640 1 --2- 172.21.15.3:0/3362553008 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb71810b320 0x7fb718111b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:25.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.201+0000 7fb71ec00640 1 --2- 172.21.15.3:0/3362553008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb71810a9a0 0x7fb71810ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:25.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.201+0000 7fb71ec00640 1 --2- 172.21.15.3:0/3362553008 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb718104f90 0x7fb718105370 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:25.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.201+0000 7fb71ec00640 1 -- 172.21.15.3:0/3362553008 >> 172.21.15.3:0/3362553008 conn(0x7fb718100a00 msgr2=0x7fb718102e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:25.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.201+0000 7fb71ec00640 1 -- 172.21.15.3:0/3362553008 shutdown_connections 2024-09-10T23:37:25.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.201+0000 7fb71ec00640 1 -- 172.21.15.3:0/3362553008 wait complete. 2024-09-10T23:37:25.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.202+0000 7fb71ec00640 1 Processor -- start 2024-09-10T23:37:25.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.202+0000 7fb71ec00640 1 -- start start 2024-09-10T23:37:25.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.202+0000 7fb71ec00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb718104f90 0x7fb71819b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:25.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.202+0000 7fb71ec00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb71810a9a0 0x7fb71819b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:25.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.202+0000 7fb71ec00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb71810b320 0x7fb7181a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:25.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.202+0000 7fb71ec00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb718114e30 con 0x7fb71810a9a0 2024-09-10T23:37:25.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.202+0000 7fb71ec00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb718114cb0 con 0x7fb71810b320 2024-09-10T23:37:25.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.202+0000 7fb71ec00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb718114fb0 con 0x7fb718104f90 2024-09-10T23:37:25.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.203+0000 7fb717400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb71810a9a0 0x7fb71819b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:25.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.203+0000 7fb717400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb71810a9a0 0x7fb71819b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47418/0 (socket says 172.21.15.3:47418) 2024-09-10T23:37:25.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.203+0000 7fb717400640 1 -- 172.21.15.3:0/1542925959 learned_addr learned my addr 172.21.15.3:0/1542925959 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:37:25.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.203+0000 7fb717e00640 1 --2- 172.21.15.3:0/1542925959 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb718104f90 0x7fb71819b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:25.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.203+0000 7fb71cc00640 1 --2- 172.21.15.3:0/1542925959 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb71810b320 0x7fb7181a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:25.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.203+0000 7fb717400640 1 -- 172.21.15.3:0/1542925959 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb718104f90 msgr2=0x7fb71819b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:25.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.203+0000 7fb717400640 1 --2- 172.21.15.3:0/1542925959 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb718104f90 0x7fb71819b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:25.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.203+0000 7fb717400640 1 -- 172.21.15.3:0/1542925959 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb71810b320 msgr2=0x7fb7181a0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:25.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.203+0000 7fb717400640 1 --2- 172.21.15.3:0/1542925959 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb71810b320 0x7fb7181a0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:25.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.203+0000 7fb717400640 1 -- 172.21.15.3:0/1542925959 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7181a1430 con 0x7fb71810a9a0 2024-09-10T23:37:25.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.203+0000 7fb71cc00640 1 --2- 172.21.15.3:0/1542925959 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb71810b320 0x7fb7181a0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:37:25.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.204+0000 7fb717400640 1 --2- 172.21.15.3:0/1542925959 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb71810a9a0 0x7fb71819b8c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb70400d950 tx=0x7fb70400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:25.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.204+0000 7fb714c00640 1 -- 172.21.15.3:0/1542925959 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb704017070 con 0x7fb71810a9a0 2024-09-10T23:37:25.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.204+0000 7fb71ec00640 1 -- 172.21.15.3:0/1542925959 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7181a1720 con 0x7fb71810a9a0 2024-09-10T23:37:25.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.204+0000 7fb714c00640 1 -- 172.21.15.3:0/1542925959 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb704009c30 con 0x7fb71810a9a0 2024-09-10T23:37:25.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.204+0000 7fb714c00640 1 -- 172.21.15.3:0/1542925959 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70400f620 con 0x7fb71810a9a0 2024-09-10T23:37:25.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.204+0000 7fb71ec00640 1 -- 172.21.15.3:0/1542925959 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7181a7fb0 con 0x7fb71810a9a0 2024-09-10T23:37:25.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.205+0000 7fb71ec00640 1 -- 172.21.15.3:0/1542925959 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb718105370 con 0x7fb71810a9a0 2024-09-10T23:37:25.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.208+0000 7fb714c00640 1 -- 172.21.15.3:0/1542925959 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 26) ==== 153380+0+0 (secure 0 0 0) 0x7fb704010460 con 0x7fb71810a9a0 2024-09-10T23:37:25.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.209+0000 7fb714c00640 1 --2- 172.21.15.3:0/1542925959 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb6fc0b54d0 0x7fb6fc0b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:25.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.210+0000 7fb714c00640 1 -- 172.21.15.3:0/1542925959 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9490+0+0 (secure 0 0 0) 0x7fb7040e5fd0 con 0x7fb71810a9a0 2024-09-10T23:37:25.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.210+0000 7fb717e00640 1 --2- 172.21.15.3:0/1542925959 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb6fc0b54d0 0x7fb6fc0b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:25.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.210+0000 7fb717e00640 1 --2- 172.21.15.3:0/1542925959 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb6fc0b54d0 0x7fb6fc0b7990 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb708006010 tx=0x7fb708005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:25.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.213+0000 7fb714c00640 1 -- 172.21.15.3:0/1542925959 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb7040ac720 con 0x7fb71810a9a0 2024-09-10T23:37:25.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.445+0000 7fb71ec00640 1 -- 172.21.15.3:0/1542925959 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb71810d100 con 0x7fb71810a9a0 2024-09-10T23:37:25.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.446+0000 7fb714c00640 1 -- 172.21.15.3:0/1542925959 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11891 (secure 0 0 0) 0x7fb704009de0 con 0x7fb71810a9a0 2024-09-10T23:37:25.447 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:37:25.448 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":26,"btime":"2024-09-10T23:26:42:260644+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/1495411512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":1495411512},{"type":"v1","addr":"172.21.15.3:6835","nonce":1495411512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/1857372777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":1857372777},{"type":"v1","addr":"172.21.15.3:6837","nonce":1857372777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14862,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6839/493850676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":493850676},{"type":"v1","addr":"172.21.15.3:6839","nonce":493850676}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14874,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6841/1580524358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":1580524358},{"type":"v1","addr":"172.21.15.3:6841","nonce":1580524358}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/352514665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":352514665},{"type":"v1","addr":"172.21.15.194:6833","nonce":352514665}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2380508105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2380508105},{"type":"v1","addr":"172.21.15.194:6835","nonce":2380508105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:23:58.866253+0000","modified":"2024-09-10T23:26:41.694795+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34724,"mds_1":34682,"mds_2":34652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24649":{"gid":24649,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/739730313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":739730313},{"type":"v1","addr":"172.21.15.194:6837","nonce":739730313}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/3198777710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3198777710},{"type":"v1","addr":"172.21.15.194:6839","nonce":3198777710}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34619":{"gid":34619,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6833/1194099617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1194099617},{"type":"v1","addr":"172.21.15.38:6833","nonce":1194099617}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34652":{"gid":34652,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":24,"addr":"172.21.15.38:6835/218783320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":218783320},{"type":"v1","addr":"172.21.15.38:6835","nonce":218783320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34682":{"gid":34682,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":21,"addr":"172.21.15.38:6837/1821839397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":1821839397},{"type":"v1","addr":"172.21.15.38:6837","nonce":1821839397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34724":{"gid":34724,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.38:6839/458259815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":458259815},{"type":"v1","addr":"172.21.15.38:6839","nonce":458259815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34724,"qdb_cluster":[34724,34682,34652]},"id":1}]} 2024-09-10T23:37:25.448 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 26 2024-09-10T23:37:25.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.448+0000 7fb71ec00640 1 -- 172.21.15.3:0/1542925959 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb6fc0b54d0 msgr2=0x7fb6fc0b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:25.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.448+0000 7fb71ec00640 1 --2- 172.21.15.3:0/1542925959 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb6fc0b54d0 0x7fb6fc0b7990 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb708006010 tx=0x7fb708005e80 comp rx=0 tx=0).stop 2024-09-10T23:37:25.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.448+0000 7fb71ec00640 1 -- 172.21.15.3:0/1542925959 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb71810a9a0 msgr2=0x7fb71819b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:25.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.448+0000 7fb71ec00640 1 --2- 172.21.15.3:0/1542925959 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb71810a9a0 0x7fb71819b8c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb70400d950 tx=0x7fb70400de10 comp rx=0 tx=0).stop 2024-09-10T23:37:25.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.448+0000 7fb71ec00640 1 -- 172.21.15.3:0/1542925959 shutdown_connections 2024-09-10T23:37:25.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.448+0000 7fb71ec00640 1 --2- 172.21.15.3:0/1542925959 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb71810b320 0x7fb7181a0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:25.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.448+0000 7fb71ec00640 1 --2- 172.21.15.3:0/1542925959 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fb6fc0b54d0 0x7fb6fc0b7990 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:25.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.448+0000 7fb71ec00640 1 --2- 172.21.15.3:0/1542925959 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb71810a9a0 0x7fb71819b8c0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:25.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.448+0000 7fb71ec00640 1 --2- 172.21.15.3:0/1542925959 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb718104f90 0x7fb71819b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:25.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.449+0000 7fb71ec00640 1 -- 172.21.15.3:0/1542925959 >> 172.21.15.3:0/1542925959 conn(0x7fb718100a00 msgr2=0x7fb718101360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:25.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.449+0000 7fb71ec00640 1 -- 172.21.15.3:0/1542925959 shutdown_connections 2024-09-10T23:37:25.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:25.449+0000 7fb71ec00640 1 -- 172.21.15.3:0/1542925959 wait complete. 2024-09-10T23:37:25.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:25 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1542925959' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:37:25.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:25 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/1542925959' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:37:25.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:25 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/1542925959' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:37:26.245 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:37:26.627 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:37:26.808 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:26 smithi003 ceph-mon[30348]: pgmap v720: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 818 B/s wr, 7 op/s 2024-09-10T23:37:26.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:26 smithi038 ceph-mon[34225]: pgmap v720: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 818 B/s wr, 7 op/s 2024-09-10T23:37:26.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:26 smithi194 ceph-mon[33904]: pgmap v720: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 818 B/s wr, 7 op/s 2024-09-10T23:37:27.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.320+0000 7fcda7400640 1 -- 172.21.15.3:0/1021378968 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcda00776d0 msgr2=0x7fcda0077ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:27.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.320+0000 7fcda7400640 1 --2- 172.21.15.3:0/1021378968 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcda00776d0 0x7fcda0077ab0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fcd94009900 tx=0x7fcd9402a410 comp rx=0 tx=0).stop 2024-09-10T23:37:27.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.320+0000 7fcda7400640 1 -- 172.21.15.3:0/1021378968 shutdown_connections 2024-09-10T23:37:27.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.320+0000 7fcda7400640 1 --2- 172.21.15.3:0/1021378968 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcda0113990 0x7fcda0115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:27.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.320+0000 7fcda7400640 1 --2- 172.21.15.3:0/1021378968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcda0077ff0 0x7fcda0113450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:27.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.320+0000 7fcda7400640 1 --2- 172.21.15.3:0/1021378968 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcda00776d0 0x7fcda0077ab0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:27.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.320+0000 7fcda7400640 1 -- 172.21.15.3:0/1021378968 >> 172.21.15.3:0/1021378968 conn(0x7fcda0100a50 msgr2=0x7fcda0102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:27.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.320+0000 7fcda7400640 1 -- 172.21.15.3:0/1021378968 shutdown_connections 2024-09-10T23:37:27.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.320+0000 7fcda7400640 1 -- 172.21.15.3:0/1021378968 wait complete. 2024-09-10T23:37:27.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.321+0000 7fcda7400640 1 Processor -- start 2024-09-10T23:37:27.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.321+0000 7fcda7400640 1 -- start start 2024-09-10T23:37:27.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.322+0000 7fcda7400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcda00776d0 0x7fcda019f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:27.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.322+0000 7fcda7400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcda0077ff0 0x7fcda019fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:27.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.322+0000 7fcda7400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcda0113990 0x7fcda01a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:27.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.322+0000 7fcda7400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fcda01192a0 con 0x7fcda00776d0 2024-09-10T23:37:27.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.322+0000 7fcda7400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fcda0119120 con 0x7fcda0077ff0 2024-09-10T23:37:27.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.322+0000 7fcda7400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcda0119420 con 0x7fcda0113990 2024-09-10T23:37:27.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.322+0000 7fcda4a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcda00776d0 0x7fcda019f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:27.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.322+0000 7fcda4a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcda00776d0 0x7fcda019f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47436/0 (socket says 172.21.15.3:47436) 2024-09-10T23:37:27.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.322+0000 7fcda4a00640 1 -- 172.21.15.3:0/4004607548 learned_addr learned my addr 172.21.15.3:0/4004607548 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:37:27.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.322+0000 7fcd9fe00640 1 --2- 172.21.15.3:0/4004607548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcda0077ff0 0x7fcda019fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:27.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.322+0000 7fcda5400640 1 --2- 172.21.15.3:0/4004607548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcda0113990 0x7fcda01a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:27.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.322+0000 7fcda4a00640 1 -- 172.21.15.3:0/4004607548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcda0113990 msgr2=0x7fcda01a50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:27.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.322+0000 7fcda4a00640 1 --2- 172.21.15.3:0/4004607548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcda0113990 0x7fcda01a50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:27.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.322+0000 7fcda4a00640 1 -- 172.21.15.3:0/4004607548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcda0077ff0 msgr2=0x7fcda019fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:27.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.322+0000 7fcda4a00640 1 --2- 172.21.15.3:0/4004607548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcda0077ff0 0x7fcda019fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:27.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.322+0000 7fcda4a00640 1 -- 172.21.15.3:0/4004607548 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcda01a58c0 con 0x7fcda00776d0 2024-09-10T23:37:27.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.322+0000 7fcd9fe00640 1 --2- 172.21.15.3:0/4004607548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcda0077ff0 0x7fcda019fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:37:27.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.323+0000 7fcda4a00640 1 --2- 172.21.15.3:0/4004607548 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcda00776d0 0x7fcda019f810 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fcd94009230 tx=0x7fcd94004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:27.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.323+0000 7fcd9d600640 1 -- 172.21.15.3:0/4004607548 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9403f030 con 0x7fcda00776d0 2024-09-10T23:37:27.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.323+0000 7fcda7400640 1 -- 172.21.15.3:0/4004607548 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcda01a5b50 con 0x7fcda00776d0 2024-09-10T23:37:27.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.323+0000 7fcd9d600640 1 -- 172.21.15.3:0/4004607548 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd94003a80 con 0x7fcda00776d0 2024-09-10T23:37:27.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.323+0000 7fcd9d600640 1 -- 172.21.15.3:0/4004607548 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd94035070 con 0x7fcda00776d0 2024-09-10T23:37:27.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.323+0000 7fcda7400640 1 -- 172.21.15.3:0/4004607548 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcda01ac270 con 0x7fcda00776d0 2024-09-10T23:37:27.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.325+0000 7fcda7400640 1 -- 172.21.15.3:0/4004607548 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcda0077ab0 con 0x7fcda00776d0 2024-09-10T23:37:27.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.327+0000 7fcd9d600640 1 -- 172.21.15.3:0/4004607548 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 26) ==== 153380+0+0 (secure 0 0 0) 0x7fcd9403bc30 con 0x7fcda00776d0 2024-09-10T23:37:27.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.328+0000 7fcd9d600640 1 --2- 172.21.15.3:0/4004607548 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcd880b5450 0x7fcd880b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:27.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.328+0000 7fcd9d600640 1 -- 172.21.15.3:0/4004607548 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9490+0+0 (secure 0 0 0) 0x7fcd94106f00 con 0x7fcda00776d0 2024-09-10T23:37:27.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.328+0000 7fcd9fe00640 1 --2- 172.21.15.3:0/4004607548 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcd880b5450 0x7fcd880b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:27.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.329+0000 7fcd9fe00640 1 --2- 172.21.15.3:0/4004607548 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcd880b5450 0x7fcd880b7910 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fcda0116110 tx=0x7fcd8c008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:27.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.332+0000 7fcd9d600640 1 -- 172.21.15.3:0/4004607548 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcd940cd650 con 0x7fcda00776d0 2024-09-10T23:37:27.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.532+0000 7fcda7400640 1 -- 172.21.15.3:0/4004607548 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcda01a0940 con 0x7fcda00776d0 2024-09-10T23:37:27.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.534+0000 7fcd9d600640 1 -- 172.21.15.3:0/4004607548 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) ==== 74+0+25294 (secure 0 0 0) 0x7fcd940ccf50 con 0x7fcda00776d0 2024-09-10T23:37:27.535 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-10T23:37:27.536 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":100,"fsid":"3f4e30d0-6fca-11ef-bcea-c7b262605968","created":"2024-09-10T23:14:12.377466+0000","modified":"2024-09-10T23:37:18.328524+0000","last_up_change":"2024-09-10T23:22:54.895554+0000","last_in_change":"2024-09-10T23:22:29.701108+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:18:27.131879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:23:53.689954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:23:55.864693+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":99,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:24:03.869094+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":99,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a38330ed-a85b-4e61-b373-dd8f1d5f7ba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6803","nonce":824467747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6805","nonce":824467747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6809","nonce":824467747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":824467747},{"type":"v1","addr":"172.21.15.3:6807","nonce":824467747}]},"public_addr":"172.21.15.3:6803/824467747","cluster_addr":"172.21.15.3:6805/824467747","heartbeat_back_addr":"172.21.15.3:6809/824467747","heartbeat_front_addr":"172.21.15.3:6807/824467747","state":["exists","up"]},{"osd":1,"uuid":"49bb1212-a83e-4f85-ad71-d863880d8268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6801","nonce":1447444485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6803","nonce":1447444485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6807","nonce":1447444485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":1447444485},{"type":"v1","addr":"172.21.15.38:6805","nonce":1447444485}]},"public_addr":"172.21.15.38:6801/1447444485","cluster_addr":"172.21.15.38:6803/1447444485","heartbeat_back_addr":"172.21.15.38:6807/1447444485","heartbeat_front_addr":"172.21.15.38:6805/1447444485","state":["exists","up"]},{"osd":2,"uuid":"ea53eb27-e7fa-4783-9a53-8b44b4e293ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6801","nonce":3191263316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6803","nonce":3191263316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6807","nonce":3191263316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3191263316},{"type":"v1","addr":"172.21.15.194:6805","nonce":3191263316}]},"public_addr":"172.21.15.194:6801/3191263316","cluster_addr":"172.21.15.194:6803/3191263316","heartbeat_back_addr":"172.21.15.194:6807/3191263316","heartbeat_front_addr":"172.21.15.194:6805/3191263316","state":["exists","up"]},{"osd":3,"uuid":"75067769-7be5-4a99-9e02-f7735b2e69c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6811","nonce":2061990952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6813","nonce":2061990952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6817","nonce":2061990952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":2061990952},{"type":"v1","addr":"172.21.15.3:6815","nonce":2061990952}]},"public_addr":"172.21.15.3:6811/2061990952","cluster_addr":"172.21.15.3:6813/2061990952","heartbeat_back_addr":"172.21.15.3:6817/2061990952","heartbeat_front_addr":"172.21.15.3:6815/2061990952","state":["exists","up"]},{"osd":4,"uuid":"872e90ca-b711-4206-b586-e7fa41122199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6809","nonce":413294160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6811","nonce":413294160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6815","nonce":413294160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":413294160},{"type":"v1","addr":"172.21.15.38:6813","nonce":413294160}]},"public_addr":"172.21.15.38:6809/413294160","cluster_addr":"172.21.15.38:6811/413294160","heartbeat_back_addr":"172.21.15.38:6815/413294160","heartbeat_front_addr":"172.21.15.38:6813/413294160","state":["exists","up"]},{"osd":5,"uuid":"2cfa107c-6dae-4c26-9e29-8175b1237b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6809","nonce":4117812658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6811","nonce":4117812658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6815","nonce":4117812658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":4117812658},{"type":"v1","addr":"172.21.15.194:6813","nonce":4117812658}]},"public_addr":"172.21.15.194:6809/4117812658","cluster_addr":"172.21.15.194:6811/4117812658","heartbeat_back_addr":"172.21.15.194:6815/4117812658","heartbeat_front_addr":"172.21.15.194:6813/4117812658","state":["exists","up"]},{"osd":6,"uuid":"d2e4e309-c587-4725-a5b3-cbc7b1226750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6819","nonce":3470543721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6821","nonce":3470543721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6825","nonce":3470543721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":3470543721},{"type":"v1","addr":"172.21.15.3:6823","nonce":3470543721}]},"public_addr":"172.21.15.3:6819/3470543721","cluster_addr":"172.21.15.3:6821/3470543721","heartbeat_back_addr":"172.21.15.3:6825/3470543721","heartbeat_front_addr":"172.21.15.3:6823/3470543721","state":["exists","up"]},{"osd":7,"uuid":"46ecaec5-29da-4e1d-ac2f-42bbbd77e949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6817","nonce":2054203924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6819","nonce":2054203924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6823","nonce":2054203924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":2054203924},{"type":"v1","addr":"172.21.15.38:6821","nonce":2054203924}]},"public_addr":"172.21.15.38:6817/2054203924","cluster_addr":"172.21.15.38:6819/2054203924","heartbeat_back_addr":"172.21.15.38:6823/2054203924","heartbeat_front_addr":"172.21.15.38:6821/2054203924","state":["exists","up"]},{"osd":8,"uuid":"57fd8e43-9612-4f74-8eb2-8bdbbf7c0417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6817","nonce":170051722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6819","nonce":170051722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6823","nonce":170051722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":170051722},{"type":"v1","addr":"172.21.15.194:6821","nonce":170051722}]},"public_addr":"172.21.15.194:6817/170051722","cluster_addr":"172.21.15.194:6819/170051722","heartbeat_back_addr":"172.21.15.194:6823/170051722","heartbeat_front_addr":"172.21.15.194:6821/170051722","state":["exists","up"]},{"osd":9,"uuid":"aeaaf23b-d2e2-4e30-9a49-de4aaba53900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6827","nonce":3967749600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6829","nonce":3967749600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6833","nonce":3967749600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":3967749600},{"type":"v1","addr":"172.21.15.3:6831","nonce":3967749600}]},"public_addr":"172.21.15.3:6827/3967749600","cluster_addr":"172.21.15.3:6829/3967749600","heartbeat_back_addr":"172.21.15.3:6833/3967749600","heartbeat_front_addr":"172.21.15.3:6831/3967749600","state":["exists","up"]},{"osd":10,"uuid":"b0ece81b-1c5b-40da-b579-fb99bacb005d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6825","nonce":1671957178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6827","nonce":1671957178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6831","nonce":1671957178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1671957178},{"type":"v1","addr":"172.21.15.38:6829","nonce":1671957178}]},"public_addr":"172.21.15.38:6825/1671957178","cluster_addr":"172.21.15.38:6827/1671957178","heartbeat_back_addr":"172.21.15.38:6831/1671957178","heartbeat_front_addr":"172.21.15.38:6829/1671957178","state":["exists","up"]},{"osd":11,"uuid":"a0036526-54bf-4e8b-95cc-e7b75725961c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6825","nonce":1048859686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6827","nonce":1048859686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6831","nonce":1048859686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1048859686},{"type":"v1","addr":"172.21.15.194:6829","nonce":1048859686}]},"public_addr":"172.21.15.194:6825/1048859686","cluster_addr":"172.21.15.194:6827/1048859686","heartbeat_back_addr":"172.21.15.194:6831/1048859686","heartbeat_front_addr":"172.21.15.194:6829/1048859686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:27.013354+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:17:56.609046+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:24.878988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:18:55.218204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:25.224770+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:19:54.614336+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:25.385483+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:20:55.317137+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:25.064825+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:21:54.655361+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:22:24.080027+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:22:52.886412+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":4,"to":6},{"from":5,"to":9}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.3:0/776988825":"2024-09-11T23:16:20.647314+0000","172.21.15.3:0/2965090335":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/2364823868":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/3186881356":"2024-09-11T23:14:37.169991+0000","172.21.15.3:0/911991463":"2024-09-11T23:16:20.647314+0000","172.21.15.3:6800/2582365069":"2024-09-11T23:14:37.169991+0000","172.21.15.3:6801/2582365069":"2024-09-11T23:14:37.169991+0000","172.21.15.3:6801/1528153492":"2024-09-11T23:15:05.835734+0000","172.21.15.3:6800/1924113958":"2024-09-11T23:16:20.647314+0000","172.21.15.3:0/554479543":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/4238683346":"2024-09-11T23:15:05.835734+0000","172.21.15.3:6800/1528153492":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/285471483":"2024-09-11T23:15:05.835734+0000","172.21.15.3:0/1249510760":"2024-09-11T23:16:20.647314+0000","172.21.15.3:6801/1924113958":"2024-09-11T23:16:20.647314+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]},{"pool":4,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:37:27.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.536+0000 7fcda7400640 1 -- 172.21.15.3:0/4004607548 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcd880b5450 msgr2=0x7fcd880b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:27.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.536+0000 7fcda7400640 1 --2- 172.21.15.3:0/4004607548 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcd880b5450 0x7fcd880b7910 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fcda0116110 tx=0x7fcd8c008040 comp rx=0 tx=0).stop 2024-09-10T23:37:27.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.536+0000 7fcda7400640 1 -- 172.21.15.3:0/4004607548 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcda00776d0 msgr2=0x7fcda019f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:27.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.536+0000 7fcda7400640 1 --2- 172.21.15.3:0/4004607548 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcda00776d0 0x7fcda019f810 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fcd94009230 tx=0x7fcd94004270 comp rx=0 tx=0).stop 2024-09-10T23:37:27.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.536+0000 7fcda7400640 1 -- 172.21.15.3:0/4004607548 shutdown_connections 2024-09-10T23:37:27.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.536+0000 7fcda7400640 1 --2- 172.21.15.3:0/4004607548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcda0113990 0x7fcda01a50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:27.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.536+0000 7fcda7400640 1 --2- 172.21.15.3:0/4004607548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcda0077ff0 0x7fcda019fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:27.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.536+0000 7fcda7400640 1 --2- 172.21.15.3:0/4004607548 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fcd880b5450 0x7fcd880b7910 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:27.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.536+0000 7fcda7400640 1 --2- 172.21.15.3:0/4004607548 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcda00776d0 0x7fcda019f810 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:27.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.536+0000 7fcda7400640 1 -- 172.21.15.3:0/4004607548 >> 172.21.15.3:0/4004607548 conn(0x7fcda0100a50 msgr2=0x7fcda0102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:27.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.537+0000 7fcda7400640 1 -- 172.21.15.3:0/4004607548 shutdown_connections 2024-09-10T23:37:27.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:27.537+0000 7fcda7400640 1 -- 172.21.15.3:0/4004607548 wait complete. 2024-09-10T23:37:28.450 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-10T23:37:28.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:28 smithi003 ceph-mon[30348]: pgmap v721: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-10T23:37:28.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:28 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/4004607548' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:37:28.831 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:37:28.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:28 smithi038 ceph-mon[34225]: pgmap v721: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-10T23:37:28.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:28 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/4004607548' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:37:28.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:28 smithi194 ceph-mon[33904]: pgmap v721: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-10T23:37:28.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:28 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/4004607548' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:37:29.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.364+0000 7f7ff3600640 1 -- 172.21.15.3:0/3548222203 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fec1087b0 msgr2=0x7f7fec108bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:29.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.364+0000 7f7ff3600640 1 --2- 172.21.15.3:0/3548222203 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fec1087b0 0x7f7fec108bf0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8009900 tx=0x7f7fd802a410 comp rx=0 tx=0).stop 2024-09-10T23:37:29.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.364+0000 7f7ff3600640 1 -- 172.21.15.3:0/3548222203 shutdown_connections 2024-09-10T23:37:29.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.364+0000 7f7ff3600640 1 --2- 172.21.15.3:0/3548222203 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fec109130 0x7f7fec10f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:29.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.364+0000 7f7ff3600640 1 --2- 172.21.15.3:0/3548222203 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fec1087b0 0x7f7fec108bf0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:29.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.364+0000 7f7ff3600640 1 --2- 172.21.15.3:0/3548222203 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fec102da0 0x7f7fec103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:29.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.364+0000 7f7ff3600640 1 -- 172.21.15.3:0/3548222203 >> 172.21.15.3:0/3548222203 conn(0x7f7fec0fe810 msgr2=0x7f7fec100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:29.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.364+0000 7f7ff3600640 1 -- 172.21.15.3:0/3548222203 shutdown_connections 2024-09-10T23:37:29.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.364+0000 7f7ff3600640 1 -- 172.21.15.3:0/3548222203 wait complete. 2024-09-10T23:37:29.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.365+0000 7f7ff3600640 1 Processor -- start 2024-09-10T23:37:29.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.365+0000 7f7ff3600640 1 -- start start 2024-09-10T23:37:29.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.365+0000 7f7ff3600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fec102da0 0x7f7fec19b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:29.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.365+0000 7f7ff3600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fec1087b0 0x7f7fec19b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:29.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.366+0000 7f7ff3600640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fec109130 0x7f7fec1a0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:29.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.366+0000 7f7ff3600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7fec112cb0 con 0x7f7fec1087b0 2024-09-10T23:37:29.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.366+0000 7f7ff3600640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7fec112b30 con 0x7f7fec109130 2024-09-10T23:37:29.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.366+0000 7f7ff3600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7fec112e30 con 0x7f7fec102da0 2024-09-10T23:37:29.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.366+0000 7f7febe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fec1087b0 0x7f7fec19b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:29.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.366+0000 7f7febe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fec1087b0 0x7f7fec19b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47458/0 (socket says 172.21.15.3:47458) 2024-09-10T23:37:29.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.366+0000 7f7febe00640 1 -- 172.21.15.3:0/3973106168 learned_addr learned my addr 172.21.15.3:0/3973106168 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:37:29.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.366+0000 7f7ff1600640 1 --2- 172.21.15.3:0/3973106168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fec109130 0x7f7fec1a0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:29.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.366+0000 7f7ff0c00640 1 --2- 172.21.15.3:0/3973106168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fec102da0 0x7f7fec19b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:29.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.366+0000 7f7febe00640 1 -- 172.21.15.3:0/3973106168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fec102da0 msgr2=0x7f7fec19b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:29.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.366+0000 7f7febe00640 1 --2- 172.21.15.3:0/3973106168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fec102da0 0x7f7fec19b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:29.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.366+0000 7f7febe00640 1 -- 172.21.15.3:0/3973106168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fec109130 msgr2=0x7f7fec1a0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:29.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.366+0000 7f7febe00640 1 --2- 172.21.15.3:0/3973106168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fec109130 0x7f7fec1a0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:29.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.366+0000 7f7febe00640 1 -- 172.21.15.3:0/3973106168 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fec1a1480 con 0x7f7fec1087b0 2024-09-10T23:37:29.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.366+0000 7f7ff1600640 1 --2- 172.21.15.3:0/3973106168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fec109130 0x7f7fec1a0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:37:29.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.367+0000 7f7febe00640 1 --2- 172.21.15.3:0/3973106168 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fec1087b0 0x7f7fec19b910 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7fd802a930 tx=0x7f7fd8003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:29.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.367+0000 7f7fe9600640 1 -- 172.21.15.3:0/3973106168 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd803f070 con 0x7f7fec1087b0 2024-09-10T23:37:29.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.367+0000 7f7fe9600640 1 -- 172.21.15.3:0/3973106168 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7fd803baf0 con 0x7f7fec1087b0 2024-09-10T23:37:29.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.367+0000 7f7ff3600640 1 -- 172.21.15.3:0/3973106168 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fec1a1710 con 0x7f7fec1087b0 2024-09-10T23:37:29.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.367+0000 7f7fe9600640 1 -- 172.21.15.3:0/3973106168 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8035030 con 0x7f7fec1087b0 2024-09-10T23:37:29.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.367+0000 7f7ff3600640 1 -- 172.21.15.3:0/3973106168 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fec1a7e30 con 0x7f7fec1087b0 2024-09-10T23:37:29.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.368+0000 7f7ff3600640 1 -- 172.21.15.3:0/3973106168 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fec103180 con 0x7f7fec1087b0 2024-09-10T23:37:29.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.370+0000 7f7fe9600640 1 -- 172.21.15.3:0/3973106168 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 26) ==== 153380+0+0 (secure 0 0 0) 0x7f7fd803b660 con 0x7f7fec1087b0 2024-09-10T23:37:29.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.372+0000 7f7fe9600640 1 --2- 172.21.15.3:0/3973106168 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f7fd40b54d0 0x7f7fd40b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:29.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.373+0000 7f7fe9600640 1 -- 172.21.15.3:0/3973106168 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9490+0+0 (secure 0 0 0) 0x7f7fd8106e70 con 0x7f7fec1087b0 2024-09-10T23:37:29.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.373+0000 7f7ff0c00640 1 --2- 172.21.15.3:0/3973106168 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f7fd40b54d0 0x7f7fd40b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:29.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.373+0000 7f7ff0c00640 1 --2- 172.21.15.3:0/3973106168 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f7fd40b54d0 0x7f7fd40b7990 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0009b60 tx=0x7f7fe0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:29.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.377+0000 7f7fe9600640 1 -- 172.21.15.3:0/3973106168 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7fd80cd5c0 con 0x7f7fec1087b0 2024-09-10T23:37:29.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.609+0000 7f7ff3600640 1 -- 172.21.15.3:0/3973106168 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f7fec10ed90 con 0x7f7fec1087b0 2024-09-10T23:37:29.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.612+0000 7f7fe9600640 1 -- 172.21.15.3:0/3973106168 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) ==== 161+0+0 (secure 0 0 0) 0x7f7fd80ccec0 con 0x7f7fec1087b0 2024-09-10T23:37:29.614 INFO:teuthology.orchestra.run.smithi003.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T23:37:29.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.616+0000 7f7ff3600640 1 -- 172.21.15.3:0/3973106168 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f7fd40b54d0 msgr2=0x7f7fd40b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:29.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.616+0000 7f7ff3600640 1 --2- 172.21.15.3:0/3973106168 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f7fd40b54d0 0x7f7fd40b7990 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0009b60 tx=0x7f7fe0005f90 comp rx=0 tx=0).stop 2024-09-10T23:37:29.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.616+0000 7f7ff3600640 1 -- 172.21.15.3:0/3973106168 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fec1087b0 msgr2=0x7f7fec19b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:29.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.616+0000 7f7ff3600640 1 --2- 172.21.15.3:0/3973106168 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fec1087b0 0x7f7fec19b910 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7fd802a930 tx=0x7f7fd8003b90 comp rx=0 tx=0).stop 2024-09-10T23:37:29.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.616+0000 7f7ff3600640 1 -- 172.21.15.3:0/3973106168 shutdown_connections 2024-09-10T23:37:29.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.616+0000 7f7ff3600640 1 --2- 172.21.15.3:0/3973106168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fec109130 0x7f7fec1a0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:29.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.616+0000 7f7ff3600640 1 --2- 172.21.15.3:0/3973106168 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f7fd40b54d0 0x7f7fd40b7990 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:29.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.616+0000 7f7ff3600640 1 --2- 172.21.15.3:0/3973106168 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fec1087b0 0x7f7fec19b910 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:29.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.616+0000 7f7ff3600640 1 --2- 172.21.15.3:0/3973106168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fec102da0 0x7f7fec19b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:29.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.616+0000 7f7ff3600640 1 -- 172.21.15.3:0/3973106168 >> 172.21.15.3:0/3973106168 conn(0x7f7fec0fe810 msgr2=0x7f7fec105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:29.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.616+0000 7f7ff3600640 1 -- 172.21.15.3:0/3973106168 shutdown_connections 2024-09-10T23:37:29.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:29.616+0000 7f7ff3600640 1 -- 172.21.15.3:0/3973106168 wait complete. 2024-09-10T23:37:29.948 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 10 23:37:29 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-c[66053]: ignoring --setuser ceph since I am not root 2024-09-10T23:37:29.948 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 10 23:37:29 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-c[66053]: ignoring --setgroup ceph since I am not root 2024-09-10T23:37:29.948 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 10 23:37:29 smithi194 ceph-mds[66057]: -- 172.21.15.194:0/704292409 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dc7dac3c20 con 0x55dc7daa1000 2024-09-10T23:37:29.948 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 10 23:37:29 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-c[66053]: starting mds.c at 2024-09-10T23:37:29.948 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 10 23:37:29 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-i[66353]: ignoring --setuser ceph since I am not root 2024-09-10T23:37:29.948 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 10 23:37:29 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-i[66353]: ignoring --setgroup ceph since I am not root 2024-09-10T23:37:29.948 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 10 23:37:29 smithi194 ceph-mds[66357]: -- 172.21.15.194:0/4255683306 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556d73039860 con 0x556d73016800 2024-09-10T23:37:29.948 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 10 23:37:29 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-i[66353]: starting mds.i at 2024-09-10T23:37:29.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:29 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mon-a[30344]: 2024-09-10T23:37:29.610+0000 7f2cdd200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:37:30.097 INFO:journalctl@ceph.mds.h.smithi038.stdout:Sep 10 23:37:29 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-h[65339]: ignoring --setuser ceph since I am not root 2024-09-10T23:37:30.098 INFO:journalctl@ceph.mds.h.smithi038.stdout:Sep 10 23:37:29 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-h[65339]: ignoring --setgroup ceph since I am not root 2024-09-10T23:37:30.098 INFO:journalctl@ceph.mds.h.smithi038.stdout:Sep 10 23:37:29 smithi038 ceph-mds[65343]: -- 172.21.15.38:0/2641424321 <== mon.0 v2:172.21.15.3:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55635d9e7860 con 0x55635d9c5000 2024-09-10T23:37:30.098 INFO:journalctl@ceph.mds.h.smithi038.stdout:Sep 10 23:37:29 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-h[65339]: starting mds.h at 2024-09-10T23:37:30.098 INFO:journalctl@ceph.mds.e.smithi038.stdout:Sep 10 23:37:29 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-e[65041]: ignoring --setuser ceph since I am not root 2024-09-10T23:37:30.098 INFO:journalctl@ceph.mds.e.smithi038.stdout:Sep 10 23:37:29 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-e[65041]: ignoring --setgroup ceph since I am not root 2024-09-10T23:37:30.098 INFO:journalctl@ceph.mds.e.smithi038.stdout:Sep 10 23:37:29 smithi038 ceph-mds[65045]: -- 172.21.15.38:0/1038860878 <== mon.0 v2:172.21.15.3:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556ca380f860 con 0x556ca37ec800 2024-09-10T23:37:30.099 INFO:journalctl@ceph.mds.e.smithi038.stdout:Sep 10 23:37:29 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-e[65041]: starting mds.e at 2024-09-10T23:37:30.099 INFO:journalctl@ceph.mds.k.smithi038.stdout:Sep 10 23:37:29 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-k[64736]: ignoring --setuser ceph since I am not root 2024-09-10T23:37:30.099 INFO:journalctl@ceph.mds.k.smithi038.stdout:Sep 10 23:37:29 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-k[64736]: ignoring --setgroup ceph since I am not root 2024-09-10T23:37:30.099 INFO:journalctl@ceph.mds.k.smithi038.stdout:Sep 10 23:37:29 smithi038 ceph-mds[64740]: -- 172.21.15.38:0/3019430421 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ddb31afc20 con 0x55ddb318c800 2024-09-10T23:37:30.099 INFO:journalctl@ceph.mds.k.smithi038.stdout:Sep 10 23:37:29 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-k[64736]: starting mds.k at 2024-09-10T23:37:30.099 INFO:journalctl@ceph.mds.b.smithi038.stdout:Sep 10 23:37:29 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-b[65649]: ignoring --setuser ceph since I am not root 2024-09-10T23:37:30.100 INFO:journalctl@ceph.mds.b.smithi038.stdout:Sep 10 23:37:29 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-b[65649]: ignoring --setgroup ceph since I am not root 2024-09-10T23:37:30.100 INFO:journalctl@ceph.mds.b.smithi038.stdout:Sep 10 23:37:29 smithi038 ceph-mds[65653]: -- 172.21.15.38:0/2753060896 <== mon.0 v2:172.21.15.3:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fe2a3d9860 con 0x55fe2a3b6800 2024-09-10T23:37:30.100 INFO:journalctl@ceph.mds.b.smithi038.stdout:Sep 10 23:37:29 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-b[65649]: starting mds.b at 2024-09-10T23:37:30.378 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T23:37:30.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:30 smithi194 ceph-mon[33904]: pgmap v722: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T23:37:30.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:30 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3973106168' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-10T23:37:30.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:30 smithi194 ceph-mon[33904]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T23:37:30.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:30 smithi194 ceph-mon[33904]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:37:30.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:30 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/3973106168' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T23:37:30.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:30 smithi194 ceph-mon[33904]: osdmap e101: 12 total, 12 up, 12 in 2024-09-10T23:37:30.698 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:30 smithi194 ceph-mon[33904]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-10T23:37:30.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:30 smithi003 ceph-mon[30348]: pgmap v722: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T23:37:30.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:30 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3973106168' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-10T23:37:30.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:30 smithi003 ceph-mon[30348]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T23:37:30.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:30 smithi003 ceph-mon[30348]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:37:30.720 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:30 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/3973106168' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T23:37:30.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:30 smithi003 ceph-mon[30348]: osdmap e101: 12 total, 12 up, 12 in 2024-09-10T23:37:30.721 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:30 smithi003 ceph-mon[30348]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-10T23:37:30.761 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:37:30.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:30 smithi038 ceph-mon[34225]: pgmap v722: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T23:37:30.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:30 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3973106168' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-10T23:37:30.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:30 smithi038 ceph-mon[34225]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T23:37:30.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:30 smithi038 ceph-mon[34225]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:37:30.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:30 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/3973106168' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T23:37:30.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:30 smithi038 ceph-mon[34225]: osdmap e101: 12 total, 12 up, 12 in 2024-09-10T23:37:30.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:30 smithi038 ceph-mon[34225]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-10T23:37:31.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.308+0000 7f2f8e800640 1 -- 172.21.15.3:0/166961871 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f88102da0 msgr2=0x7f2f88103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:31.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.308+0000 7f2f8e800640 1 --2- 172.21.15.3:0/166961871 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f88102da0 0x7f2f88103180 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2f78009900 tx=0x7f2f7802a400 comp rx=0 tx=0).stop 2024-09-10T23:37:31.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.308+0000 7f2f8e800640 1 -- 172.21.15.3:0/166961871 shutdown_connections 2024-09-10T23:37:31.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.308+0000 7f2f8e800640 1 --2- 172.21.15.3:0/166961871 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f88109130 0x7f2f8810f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:31.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.308+0000 7f2f8e800640 1 --2- 172.21.15.3:0/166961871 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f881087b0 0x7f2f88108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:31.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.308+0000 7f2f8e800640 1 --2- 172.21.15.3:0/166961871 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f88102da0 0x7f2f88103180 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:31.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.308+0000 7f2f8e800640 1 -- 172.21.15.3:0/166961871 >> 172.21.15.3:0/166961871 conn(0x7f2f880fe810 msgr2=0x7f2f88100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:31.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.309+0000 7f2f8e800640 1 -- 172.21.15.3:0/166961871 shutdown_connections 2024-09-10T23:37:31.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.309+0000 7f2f8e800640 1 -- 172.21.15.3:0/166961871 wait complete. 2024-09-10T23:37:31.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.310+0000 7f2f8e800640 1 Processor -- start 2024-09-10T23:37:31.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.310+0000 7f2f8e800640 1 -- start start 2024-09-10T23:37:31.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.310+0000 7f2f8e800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f88102da0 0x7f2f8819b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:31.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.310+0000 7f2f8e800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f881087b0 0x7f2f8819b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:31.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.310+0000 7f2f8e800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f88109130 0x7f2f881a0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:31.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.310+0000 7f2f8e800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2f88112cf0 con 0x7f2f88109130 2024-09-10T23:37:31.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.310+0000 7f2f8e800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2f88112b70 con 0x7f2f88102da0 2024-09-10T23:37:31.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.310+0000 7f2f8e800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2f88112e70 con 0x7f2f881087b0 2024-09-10T23:37:31.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.310+0000 7f2f87e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f88109130 0x7f2f881a0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:31.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.310+0000 7f2f87400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f88102da0 0x7f2f8819b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:31.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.310+0000 7f2f87e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f88109130 0x7f2f881a0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60208/0 (socket says 172.21.15.3:60208) 2024-09-10T23:37:31.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.310+0000 7f2f87e00640 1 -- 172.21.15.3:0/1616552827 learned_addr learned my addr 172.21.15.3:0/1616552827 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:37:31.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.310+0000 7f2f7ea00640 1 --2- 172.21.15.3:0/1616552827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f881087b0 0x7f2f8819b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:31.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.311+0000 7f2f87e00640 1 -- 172.21.15.3:0/1616552827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f881087b0 msgr2=0x7f2f8819b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:31.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.311+0000 7f2f87e00640 1 --2- 172.21.15.3:0/1616552827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f881087b0 0x7f2f8819b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:31.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.311+0000 7f2f87e00640 1 -- 172.21.15.3:0/1616552827 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f88102da0 msgr2=0x7f2f8819b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:31.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.311+0000 7f2f87e00640 1 --2- 172.21.15.3:0/1616552827 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f88102da0 0x7f2f8819b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:31.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.311+0000 7f2f87e00640 1 -- 172.21.15.3:0/1616552827 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f881a1490 con 0x7f2f88109130 2024-09-10T23:37:31.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.311+0000 7f2f87400640 1 --2- 172.21.15.3:0/1616552827 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f88102da0 0x7f2f8819b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:37:31.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.311+0000 7f2f87e00640 1 --2- 172.21.15.3:0/1616552827 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f88109130 0x7f2f881a0cc0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009fd0 tx=0x7f2f8000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:31.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.311+0000 7f2f84c00640 1 -- 172.21.15.3:0/1616552827 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f80017070 con 0x7f2f88109130 2024-09-10T23:37:31.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.312+0000 7f2f8e800640 1 -- 172.21.15.3:0/1616552827 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f881a1780 con 0x7f2f88109130 2024-09-10T23:37:31.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.312+0000 7f2f84c00640 1 -- 172.21.15.3:0/1616552827 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f80003e00 con 0x7f2f88109130 2024-09-10T23:37:31.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.312+0000 7f2f84c00640 1 -- 172.21.15.3:0/1616552827 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f80010460 con 0x7f2f88109130 2024-09-10T23:37:31.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.312+0000 7f2f8e800640 1 -- 172.21.15.3:0/1616552827 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f881a7e40 con 0x7f2f88109130 2024-09-10T23:37:31.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.313+0000 7f2f8e800640 1 -- 172.21.15.3:0/1616552827 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f88103180 con 0x7f2f88109130 2024-09-10T23:37:31.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.315+0000 7f2f84c00640 1 -- 172.21.15.3:0/1616552827 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 26) ==== 153380+0+0 (secure 0 0 0) 0x7f2f80003970 con 0x7f2f88109130 2024-09-10T23:37:31.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.316+0000 7f2f84c00640 1 --2- 172.21.15.3:0/1616552827 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f2f6c0b5450 0x7f2f6c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:31.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.317+0000 7f2f84c00640 1 -- 172.21.15.3:0/1616552827 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9660+0+0 (secure 0 0 0) 0x7f2f800e65c0 con 0x7f2f88109130 2024-09-10T23:37:31.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.317+0000 7f2f87400640 1 --2- 172.21.15.3:0/1616552827 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f2f6c0b5450 0x7f2f6c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:31.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.317+0000 7f2f87400640 1 --2- 172.21.15.3:0/1616552827 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f2f6c0b5450 0x7f2f6c0b7910 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2f78006010 tx=0x7f2f78000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:31.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.320+0000 7f2f84c00640 1 -- 172.21.15.3:0/1616552827 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2f800ac620 con 0x7f2f88109130 2024-09-10T23:37:31.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.556+0000 7f2f8e800640 1 -- 172.21.15.3:0/1616552827 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f2f8802e5c0 con 0x7f2f88109130 2024-09-10T23:37:31.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.621+0000 7f2f84c00640 1 -- 172.21.15.3:0/1616552827 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v29) ==== 104+0+0 (secure 0 0 0) 0x7f2f800b5420 con 0x7f2f88109130 2024-09-10T23:37:31.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.624+0000 7f2f8e800640 1 -- 172.21.15.3:0/1616552827 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f2f6c0b5450 msgr2=0x7f2f6c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:31.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.624+0000 7f2f8e800640 1 --2- 172.21.15.3:0/1616552827 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f2f6c0b5450 0x7f2f6c0b7910 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2f78006010 tx=0x7f2f78000bc0 comp rx=0 tx=0).stop 2024-09-10T23:37:31.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.624+0000 7f2f8e800640 1 -- 172.21.15.3:0/1616552827 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f88109130 msgr2=0x7f2f881a0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:31.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.624+0000 7f2f8e800640 1 --2- 172.21.15.3:0/1616552827 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f88109130 0x7f2f881a0cc0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009fd0 tx=0x7f2f8000b260 comp rx=0 tx=0).stop 2024-09-10T23:37:31.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.624+0000 7f2f8e800640 1 -- 172.21.15.3:0/1616552827 shutdown_connections 2024-09-10T23:37:31.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.624+0000 7f2f8e800640 1 --2- 172.21.15.3:0/1616552827 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f2f6c0b5450 0x7f2f6c0b7910 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:31.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.624+0000 7f2f8e800640 1 --2- 172.21.15.3:0/1616552827 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f88109130 0x7f2f881a0cc0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:31.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.624+0000 7f2f8e800640 1 --2- 172.21.15.3:0/1616552827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f881087b0 0x7f2f8819b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:31.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.624+0000 7f2f8e800640 1 --2- 172.21.15.3:0/1616552827 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f88102da0 0x7f2f8819b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:31.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.624+0000 7f2f8e800640 1 -- 172.21.15.3:0/1616552827 >> 172.21.15.3:0/1616552827 conn(0x7f2f880fe810 msgr2=0x7f2f88104d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:31.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.624+0000 7f2f8e800640 1 -- 172.21.15.3:0/1616552827 shutdown_connections 2024-09-10T23:37:31.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:31.624+0000 7f2f8e800640 1 -- 172.21.15.3:0/1616552827 wait complete. 2024-09-10T23:37:31.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:31 smithi194 ceph-mon[33904]: mds.? [v2:172.21.15.194:6836/189685492,v1:172.21.15.194:6838/189685492] up:boot 2024-09-10T23:37:31.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:31 smithi194 ceph-mon[33904]: mds.? [v2:172.21.15.194:6837/3289629722,v1:172.21.15.194:6839/3289629722] up:boot 2024-09-10T23:37:31.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:31 smithi194 ceph-mon[33904]: mds.? [v2:172.21.15.38:6832/3937231355,v1:172.21.15.38:6834/3937231355] up:boot 2024-09-10T23:37:31.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:31 smithi194 ceph-mon[33904]: mds.? [v2:172.21.15.38:6833/1843680418,v1:172.21.15.38:6835/1843680418] up:boot 2024-09-10T23:37:31.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:31 smithi194 ceph-mon[33904]: mds.? [v2:172.21.15.38:6836/1800394158,v1:172.21.15.38:6837/1800394158] up:boot 2024-09-10T23:37:31.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:31 smithi194 ceph-mon[33904]: mds.? [v2:172.21.15.38:6838/2017084215,v1:172.21.15.38:6839/2017084215] up:boot 2024-09-10T23:37:31.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:31 smithi194 ceph-mon[33904]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-10T23:37:31.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:31 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T23:37:31.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:31 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T23:37:31.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:31 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T23:37:31.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:31 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T23:37:31.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:31 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T23:37:31.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:31 smithi194 ceph-mon[33904]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T23:37:31.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:31 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/1616552827' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:37:31.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:31 smithi003 ceph-mon[30348]: mds.? [v2:172.21.15.194:6836/189685492,v1:172.21.15.194:6838/189685492] up:boot 2024-09-10T23:37:31.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:31 smithi003 ceph-mon[30348]: mds.? [v2:172.21.15.194:6837/3289629722,v1:172.21.15.194:6839/3289629722] up:boot 2024-09-10T23:37:31.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:31 smithi003 ceph-mon[30348]: mds.? [v2:172.21.15.38:6832/3937231355,v1:172.21.15.38:6834/3937231355] up:boot 2024-09-10T23:37:31.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:31 smithi003 ceph-mon[30348]: mds.? [v2:172.21.15.38:6833/1843680418,v1:172.21.15.38:6835/1843680418] up:boot 2024-09-10T23:37:31.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:31 smithi003 ceph-mon[30348]: mds.? [v2:172.21.15.38:6836/1800394158,v1:172.21.15.38:6837/1800394158] up:boot 2024-09-10T23:37:31.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:31 smithi003 ceph-mon[30348]: mds.? [v2:172.21.15.38:6838/2017084215,v1:172.21.15.38:6839/2017084215] up:boot 2024-09-10T23:37:31.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:31 smithi003 ceph-mon[30348]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-10T23:37:31.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:31 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T23:37:31.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:31 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T23:37:31.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:31 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T23:37:31.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:31 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T23:37:31.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:31 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T23:37:31.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:31 smithi003 ceph-mon[30348]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T23:37:31.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:31 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1616552827' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:37:32.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:31 smithi038 ceph-mon[34225]: mds.? [v2:172.21.15.194:6836/189685492,v1:172.21.15.194:6838/189685492] up:boot 2024-09-10T23:37:32.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:31 smithi038 ceph-mon[34225]: mds.? [v2:172.21.15.194:6837/3289629722,v1:172.21.15.194:6839/3289629722] up:boot 2024-09-10T23:37:32.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:31 smithi038 ceph-mon[34225]: mds.? [v2:172.21.15.38:6832/3937231355,v1:172.21.15.38:6834/3937231355] up:boot 2024-09-10T23:37:32.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:31 smithi038 ceph-mon[34225]: mds.? [v2:172.21.15.38:6833/1843680418,v1:172.21.15.38:6835/1843680418] up:boot 2024-09-10T23:37:32.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:31 smithi038 ceph-mon[34225]: mds.? [v2:172.21.15.38:6836/1800394158,v1:172.21.15.38:6837/1800394158] up:boot 2024-09-10T23:37:32.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:31 smithi038 ceph-mon[34225]: mds.? [v2:172.21.15.38:6838/2017084215,v1:172.21.15.38:6839/2017084215] up:boot 2024-09-10T23:37:32.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:31 smithi038 ceph-mon[34225]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-10T23:37:32.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:31 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T23:37:32.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:31 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T23:37:32.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:31 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T23:37:32.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:31 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T23:37:32.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:31 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T23:37:32.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:31 smithi038 ceph-mon[34225]: from='mgr.14223 172.21.15.3:0/2891455004' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T23:37:32.098 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:31 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/1616552827' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:37:32.402 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T23:37:32.784 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:37:32.923 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:32 smithi003 ceph-mon[30348]: pgmap v724: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-10T23:37:32.923 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:32 smithi003 ceph-mon[30348]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T23:37:32.923 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:32 smithi003 ceph-mon[30348]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T23:37:32.923 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:32 smithi003 ceph-mon[30348]: Cluster is now healthy 2024-09-10T23:37:32.923 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:32 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/1616552827' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T23:37:32.923 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:32 smithi003 ceph-mon[30348]: fsmap 12 up:standby 2024-09-10T23:37:32.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:32 smithi194 ceph-mon[33904]: pgmap v724: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-10T23:37:32.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:32 smithi194 ceph-mon[33904]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T23:37:32.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:32 smithi194 ceph-mon[33904]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T23:37:32.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:32 smithi194 ceph-mon[33904]: Cluster is now healthy 2024-09-10T23:37:32.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:32 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/1616552827' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T23:37:32.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:32 smithi194 ceph-mon[33904]: fsmap 12 up:standby 2024-09-10T23:37:32.999 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:32 smithi038 ceph-mon[34225]: pgmap v724: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-10T23:37:32.999 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:32 smithi038 ceph-mon[34225]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T23:37:32.999 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:32 smithi038 ceph-mon[34225]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T23:37:32.999 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:32 smithi038 ceph-mon[34225]: Cluster is now healthy 2024-09-10T23:37:32.999 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:32 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/1616552827' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T23:37:32.999 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:32 smithi038 ceph-mon[34225]: fsmap 12 up:standby 2024-09-10T23:37:33.343 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.342+0000 7f7679800640 1 -- 172.21.15.3:0/1089394866 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76741137e0 msgr2=0x7f7674115bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:33.343 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.342+0000 7f7679800640 1 --2- 172.21.15.3:0/1089394866 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76741137e0 0x7f7674115bd0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f766c009900 tx=0x7f766c02a410 comp rx=0 tx=0).stop 2024-09-10T23:37:33.343 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.342+0000 7f7679800640 1 -- 172.21.15.3:0/1089394866 shutdown_connections 2024-09-10T23:37:33.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.342+0000 7f7679800640 1 --2- 172.21.15.3:0/1089394866 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76741137e0 0x7f7674115bd0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:33.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.342+0000 7f7679800640 1 --2- 172.21.15.3:0/1089394866 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7674077ff0 0x7f76741132a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:33.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.342+0000 7f7679800640 1 --2- 172.21.15.3:0/1089394866 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76740776d0 0x7f7674077ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:33.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.342+0000 7f7679800640 1 -- 172.21.15.3:0/1089394866 >> 172.21.15.3:0/1089394866 conn(0x7f7674100840 msgr2=0x7f7674102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:33.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.342+0000 7f7679800640 1 -- 172.21.15.3:0/1089394866 shutdown_connections 2024-09-10T23:37:33.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.342+0000 7f7679800640 1 -- 172.21.15.3:0/1089394866 wait complete. 2024-09-10T23:37:33.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.343+0000 7f7679800640 1 Processor -- start 2024-09-10T23:37:33.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.343+0000 7f7679800640 1 -- start start 2024-09-10T23:37:33.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.343+0000 7f7679800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76740776d0 0x7f767419f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:33.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.343+0000 7f7679800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7674077ff0 0x7f767419fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:33.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.343+0000 7f7679800640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76741137e0 0x7f76741a4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:33.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.343+0000 7f7679800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f76741190c0 con 0x7f76740776d0 2024-09-10T23:37:33.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.343+0000 7f7679800640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7674118f40 con 0x7f76741137e0 2024-09-10T23:37:33.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.343+0000 7f7679800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7674119240 con 0x7f7674077ff0 2024-09-10T23:37:33.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.344+0000 7f7673e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76740776d0 0x7f767419f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:33.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.344+0000 7f7673e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76740776d0 0x7f767419f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60220/0 (socket says 172.21.15.3:60220) 2024-09-10T23:37:33.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.344+0000 7f7673e00640 1 -- 172.21.15.3:0/4041881842 learned_addr learned my addr 172.21.15.3:0/4041881842 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:37:33.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.344+0000 7f7678e00640 1 --2- 172.21.15.3:0/4041881842 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76741137e0 0x7f76741a4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:33.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.344+0000 7f7673400640 1 --2- 172.21.15.3:0/4041881842 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7674077ff0 0x7f767419fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:33.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.344+0000 7f7673e00640 1 -- 172.21.15.3:0/4041881842 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7674077ff0 msgr2=0x7f767419fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:33.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.344+0000 7f7673e00640 1 --2- 172.21.15.3:0/4041881842 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7674077ff0 0x7f767419fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:33.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.344+0000 7f7673e00640 1 -- 172.21.15.3:0/4041881842 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76741137e0 msgr2=0x7f76741a4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:33.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.344+0000 7f7673e00640 1 --2- 172.21.15.3:0/4041881842 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76741137e0 0x7f76741a4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:33.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.344+0000 7f7673e00640 1 -- 172.21.15.3:0/4041881842 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76741a5620 con 0x7f76740776d0 2024-09-10T23:37:33.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.344+0000 7f7673e00640 1 --2- 172.21.15.3:0/4041881842 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76740776d0 0x7f767419f570 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f766400ea80 tx=0x7f766400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:33.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.345+0000 7f7670c00640 1 -- 172.21.15.3:0/4041881842 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766400ce40 con 0x7f76740776d0 2024-09-10T23:37:33.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.345+0000 7f7670c00640 1 -- 172.21.15.3:0/4041881842 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7664005020 con 0x7f76740776d0 2024-09-10T23:37:33.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.345+0000 7f7679800640 1 -- 172.21.15.3:0/4041881842 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76741a5910 con 0x7f76740776d0 2024-09-10T23:37:33.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.345+0000 7f7670c00640 1 -- 172.21.15.3:0/4041881842 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76640116d0 con 0x7f76740776d0 2024-09-10T23:37:33.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.345+0000 7f7679800640 1 -- 172.21.15.3:0/4041881842 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76741abfd0 con 0x7f76740776d0 2024-09-10T23:37:33.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.346+0000 7f7679800640 1 -- 172.21.15.3:0/4041881842 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7674077ab0 con 0x7f76740776d0 2024-09-10T23:37:33.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.348+0000 7f7670c00640 1 -- 172.21.15.3:0/4041881842 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 26) ==== 153380+0+0 (secure 0 0 0) 0x7f766400f040 con 0x7f76740776d0 2024-09-10T23:37:33.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.349+0000 7f7670c00640 1 --2- 172.21.15.3:0/4041881842 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f76580b5500 0x7f76580b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:33.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.350+0000 7f7670c00640 1 -- 172.21.15.3:0/4041881842 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9660+0+0 (secure 0 0 0) 0x7f76640e6720 con 0x7f76740776d0 2024-09-10T23:37:33.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.350+0000 7f7673400640 1 --2- 172.21.15.3:0/4041881842 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f76580b5500 0x7f76580b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:33.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.351+0000 7f7673400640 1 --2- 172.21.15.3:0/4041881842 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f76580b5500 0x7f76580b79c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7674103450 tx=0x7f7660005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:33.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.354+0000 7f7670c00640 1 -- 172.21.15.3:0/4041881842 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7664016030 con 0x7f76740776d0 2024-09-10T23:37:33.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.549+0000 7f7679800640 1 -- 172.21.15.3:0/4041881842 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f76741ac310 con 0x7f76740776d0 2024-09-10T23:37:33.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.631+0000 7f7670c00640 1 -- 172.21.15.3:0/4041881842 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v102) ==== 181+0+0 (secure 0 0 0) 0x7f76640acdd0 con 0x7f76740776d0 2024-09-10T23:37:33.633 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_metadata' removed 2024-09-10T23:37:33.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.635+0000 7f7679800640 1 -- 172.21.15.3:0/4041881842 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f76580b5500 msgr2=0x7f76580b79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:33.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.635+0000 7f7679800640 1 --2- 172.21.15.3:0/4041881842 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f76580b5500 0x7f76580b79c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7674103450 tx=0x7f7660005f90 comp rx=0 tx=0).stop 2024-09-10T23:37:33.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.635+0000 7f7679800640 1 -- 172.21.15.3:0/4041881842 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76740776d0 msgr2=0x7f767419f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:33.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.635+0000 7f7679800640 1 --2- 172.21.15.3:0/4041881842 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76740776d0 0x7f767419f570 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f766400ea80 tx=0x7f766400ef40 comp rx=0 tx=0).stop 2024-09-10T23:37:33.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.635+0000 7f7679800640 1 -- 172.21.15.3:0/4041881842 shutdown_connections 2024-09-10T23:37:33.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.635+0000 7f7679800640 1 --2- 172.21.15.3:0/4041881842 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76741137e0 0x7f76741a4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:33.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.635+0000 7f7679800640 1 --2- 172.21.15.3:0/4041881842 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7674077ff0 0x7f767419fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:33.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.635+0000 7f7679800640 1 --2- 172.21.15.3:0/4041881842 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f76580b5500 0x7f76580b79c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:33.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.635+0000 7f7679800640 1 --2- 172.21.15.3:0/4041881842 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76740776d0 0x7f767419f570 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:33.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.635+0000 7f7679800640 1 -- 172.21.15.3:0/4041881842 >> 172.21.15.3:0/4041881842 conn(0x7f7674100840 msgr2=0x7f7674102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:33.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.636+0000 7f7679800640 1 -- 172.21.15.3:0/4041881842 shutdown_connections 2024-09-10T23:37:33.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:33.636+0000 7f7679800640 1 -- 172.21.15.3:0/4041881842 wait complete. 2024-09-10T23:37:33.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:33 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/4041881842' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T23:37:33.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:33 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/4041881842' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T23:37:34.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:33 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/4041881842' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T23:37:34.415 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T23:37:34.799 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:37:34.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:34 smithi038 ceph-mon[34225]: pgmap v725: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-10T23:37:34.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:34 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/4041881842' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T23:37:34.848 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:34 smithi038 ceph-mon[34225]: osdmap e102: 12 total, 12 up, 12 in 2024-09-10T23:37:34.939 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:34 smithi003 ceph-mon[30348]: pgmap v725: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-10T23:37:34.939 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:34 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/4041881842' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T23:37:34.939 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:34 smithi003 ceph-mon[30348]: osdmap e102: 12 total, 12 up, 12 in 2024-09-10T23:37:34.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:34 smithi194 ceph-mon[33904]: pgmap v725: 129 pgs: 129 active+clean; 2.2 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-10T23:37:34.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:34 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/4041881842' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T23:37:34.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:34 smithi194 ceph-mon[33904]: osdmap e102: 12 total, 12 up, 12 in 2024-09-10T23:37:35.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.392+0000 7fc058400640 1 -- 172.21.15.3:0/2061198434 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc050102dc0 msgr2=0x7fc0501031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:35.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.392+0000 7fc058400640 1 --2- 172.21.15.3:0/2061198434 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc050102dc0 0x7fc0501031a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc044009900 tx=0x7fc04402a410 comp rx=0 tx=0).stop 2024-09-10T23:37:35.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.392+0000 7fc058400640 1 -- 172.21.15.3:0/2061198434 shutdown_connections 2024-09-10T23:37:35.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.392+0000 7fc058400640 1 --2- 172.21.15.3:0/2061198434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc050109150 0x7fc05010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:35.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.392+0000 7fc058400640 1 --2- 172.21.15.3:0/2061198434 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0501087d0 0x7fc050108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:35.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.392+0000 7fc058400640 1 --2- 172.21.15.3:0/2061198434 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc050102dc0 0x7fc0501031a0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:35.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.392+0000 7fc058400640 1 -- 172.21.15.3:0/2061198434 >> 172.21.15.3:0/2061198434 conn(0x7fc0500fe830 msgr2=0x7fc050100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:35.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.392+0000 7fc058400640 1 -- 172.21.15.3:0/2061198434 shutdown_connections 2024-09-10T23:37:35.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.392+0000 7fc058400640 1 -- 172.21.15.3:0/2061198434 wait complete. 2024-09-10T23:37:35.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.393+0000 7fc058400640 1 Processor -- start 2024-09-10T23:37:35.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.394+0000 7fc058400640 1 -- start start 2024-09-10T23:37:35.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.394+0000 7fc058400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc050102dc0 0x7fc0500754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:35.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.394+0000 7fc058400640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0501087d0 0x7fc0500759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:35.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.394+0000 7fc058400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc050109150 0x7fc050075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:35.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.394+0000 7fc058400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc050112d10 con 0x7fc050102dc0 2024-09-10T23:37:35.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.394+0000 7fc058400640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fc050112b90 con 0x7fc0501087d0 2024-09-10T23:37:35.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.394+0000 7fc058400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc050112e90 con 0x7fc050109150 2024-09-10T23:37:35.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.394+0000 7fc055a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc050102dc0 0x7fc0500754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:35.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.394+0000 7fc055a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc050102dc0 0x7fc0500754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60224/0 (socket says 172.21.15.3:60224) 2024-09-10T23:37:35.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.394+0000 7fc055a00640 1 -- 172.21.15.3:0/2784934112 learned_addr learned my addr 172.21.15.3:0/2784934112 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:37:35.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.394+0000 7fc055000640 1 --2- 172.21.15.3:0/2784934112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0501087d0 0x7fc0500759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:35.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.395+0000 7fc056400640 1 --2- 172.21.15.3:0/2784934112 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc050109150 0x7fc050075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:35.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.395+0000 7fc055a00640 1 -- 172.21.15.3:0/2784934112 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc050109150 msgr2=0x7fc050075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:35.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.395+0000 7fc055a00640 1 --2- 172.21.15.3:0/2784934112 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc050109150 0x7fc050075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:35.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.395+0000 7fc055a00640 1 -- 172.21.15.3:0/2784934112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0501087d0 msgr2=0x7fc0500759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:35.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.395+0000 7fc055a00640 1 --2- 172.21.15.3:0/2784934112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0501087d0 0x7fc0500759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:35.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.395+0000 7fc055a00640 1 -- 172.21.15.3:0/2784934112 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0501a7620 con 0x7fc050102dc0 2024-09-10T23:37:35.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.395+0000 7fc055a00640 1 --2- 172.21.15.3:0/2784934112 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc050102dc0 0x7fc0500754a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc04402a930 tx=0x7fc044003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:35.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.395+0000 7fc04e000640 1 -- 172.21.15.3:0/2784934112 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04403f070 con 0x7fc050102dc0 2024-09-10T23:37:35.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.395+0000 7fc058400640 1 -- 172.21.15.3:0/2784934112 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0501a78b0 con 0x7fc050102dc0 2024-09-10T23:37:35.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.395+0000 7fc04e000640 1 -- 172.21.15.3:0/2784934112 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc044003e40 con 0x7fc050102dc0 2024-09-10T23:37:35.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.396+0000 7fc058400640 1 -- 172.21.15.3:0/2784934112 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0501a7e10 con 0x7fc050102dc0 2024-09-10T23:37:35.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.396+0000 7fc04e000640 1 -- 172.21.15.3:0/2784934112 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc044049060 con 0x7fc050102dc0 2024-09-10T23:37:35.399 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.397+0000 7fc058400640 1 -- 172.21.15.3:0/2784934112 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0501031a0 con 0x7fc050102dc0 2024-09-10T23:37:35.400 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.399+0000 7fc04e000640 1 -- 172.21.15.3:0/2784934112 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 26) ==== 153380+0+0 (secure 0 0 0) 0x7fc044031400 con 0x7fc050102dc0 2024-09-10T23:37:35.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.400+0000 7fc04e000640 1 --2- 172.21.15.3:0/2784934112 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc0380b5450 0x7fc0380b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:35.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.400+0000 7fc04e000640 1 -- 172.21.15.3:0/2784934112 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9106+0+0 (secure 0 0 0) 0x7fc0441070e0 con 0x7fc050102dc0 2024-09-10T23:37:35.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.401+0000 7fc055000640 1 --2- 172.21.15.3:0/2784934112 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc0380b5450 0x7fc0380b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:35.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.401+0000 7fc055000640 1 --2- 172.21.15.3:0/2784934112 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc0380b5450 0x7fc0380b7910 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc050076f90 tx=0x7fc03c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:35.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.404+0000 7fc04e000640 1 -- 172.21.15.3:0/2784934112 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc0440cd9b0 con 0x7fc050102dc0 2024-09-10T23:37:35.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.603+0000 7fc058400640 1 -- 172.21.15.3:0/2784934112 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc05002e5c0 con 0x7fc050102dc0 2024-09-10T23:37:35.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.640+0000 7fc04e000640 1 -- 172.21.15.3:0/2784934112 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v103) ==== 169+0+0 (secure 0 0 0) 0x7fc0440cd2b0 con 0x7fc050102dc0 2024-09-10T23:37:35.641 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_data' removed 2024-09-10T23:37:35.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.643+0000 7fc058400640 1 -- 172.21.15.3:0/2784934112 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc0380b5450 msgr2=0x7fc0380b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:35.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.643+0000 7fc058400640 1 --2- 172.21.15.3:0/2784934112 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc0380b5450 0x7fc0380b7910 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc050076f90 tx=0x7fc03c00b390 comp rx=0 tx=0).stop 2024-09-10T23:37:35.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.643+0000 7fc058400640 1 -- 172.21.15.3:0/2784934112 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc050102dc0 msgr2=0x7fc0500754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:35.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.643+0000 7fc058400640 1 --2- 172.21.15.3:0/2784934112 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc050102dc0 0x7fc0500754a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc04402a930 tx=0x7fc044003c20 comp rx=0 tx=0).stop 2024-09-10T23:37:35.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.643+0000 7fc058400640 1 -- 172.21.15.3:0/2784934112 shutdown_connections 2024-09-10T23:37:35.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.643+0000 7fc058400640 1 --2- 172.21.15.3:0/2784934112 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc050109150 0x7fc050075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:35.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.643+0000 7fc058400640 1 --2- 172.21.15.3:0/2784934112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0501087d0 0x7fc0500759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:35.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.643+0000 7fc058400640 1 --2- 172.21.15.3:0/2784934112 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7fc0380b5450 0x7fc0380b7910 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:35.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.643+0000 7fc058400640 1 --2- 172.21.15.3:0/2784934112 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc050102dc0 0x7fc0500754a0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:35.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.643+0000 7fc058400640 1 -- 172.21.15.3:0/2784934112 >> 172.21.15.3:0/2784934112 conn(0x7fc0500fe830 msgr2=0x7fc050100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:35.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.644+0000 7fc058400640 1 -- 172.21.15.3:0/2784934112 shutdown_connections 2024-09-10T23:37:35.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:35.645+0000 7fc058400640 1 -- 172.21.15.3:0/2784934112 wait complete. 2024-09-10T23:37:35.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:35 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2784934112' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T23:37:35.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:35 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2784934112' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T23:37:36.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:35 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2784934112' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T23:37:36.396 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-10T23:37:36.780 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:37:36.919 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:36 smithi003 ceph-mon[30348]: pgmap v727: 97 pgs: 97 active+clean; 577 KiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:36.919 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:36 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2784934112' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T23:37:36.919 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:36 smithi003 ceph-mon[30348]: osdmap e103: 12 total, 12 up, 12 in 2024-09-10T23:37:36.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:36 smithi194 ceph-mon[33904]: pgmap v727: 97 pgs: 97 active+clean; 577 KiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:36.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:36 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2784934112' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T23:37:36.948 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:36 smithi194 ceph-mon[33904]: osdmap e103: 12 total, 12 up, 12 in 2024-09-10T23:37:37.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:36 smithi038 ceph-mon[34225]: pgmap v727: 97 pgs: 97 active+clean; 577 KiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:37.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:36 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2784934112' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T23:37:37.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:36 smithi038 ceph-mon[34225]: osdmap e103: 12 total, 12 up, 12 in 2024-09-10T23:37:37.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.366+0000 7f0f67e00640 1 -- 172.21.15.3:0/3629539606 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f6810a800 msgr2=0x7f0f6810ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:37.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.366+0000 7f0f67e00640 1 --2- 172.21.15.3:0/3629539606 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f6810a800 0x7f0f6810ac40 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0f54009900 tx=0x7f0f5402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:37:37.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.366+0000 7f0f67e00640 1 -- 172.21.15.3:0/3629539606 shutdown_connections 2024-09-10T23:37:37.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.366+0000 7f0f67e00640 1 --2- 172.21.15.3:0/3629539606 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f6810b180 0x7f0f68111980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:37.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.366+0000 7f0f67e00640 1 --2- 172.21.15.3:0/3629539606 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f6810a800 0x7f0f6810ac40 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:37.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.366+0000 7f0f67e00640 1 --2- 172.21.15.3:0/3629539606 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f68104df0 0x7f0f681051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:37.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.366+0000 7f0f67e00640 1 -- 172.21.15.3:0/3629539606 >> 172.21.15.3:0/3629539606 conn(0x7f0f68100840 msgr2=0x7f0f68102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:37.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.366+0000 7f0f67e00640 1 -- 172.21.15.3:0/3629539606 shutdown_connections 2024-09-10T23:37:37.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.366+0000 7f0f67e00640 1 -- 172.21.15.3:0/3629539606 wait complete. 2024-09-10T23:37:37.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.367+0000 7f0f67e00640 1 Processor -- start 2024-09-10T23:37:37.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.367+0000 7f0f67e00640 1 -- start start 2024-09-10T23:37:37.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.368+0000 7f0f67e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f68104df0 0x7f0f6819b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:37.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.368+0000 7f0f67e00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f6810a800 0x7f0f6819b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:37.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.368+0000 7f0f67e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f6810b180 0x7f0f681a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:37.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.368+0000 7f0f67e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0f68114d40 con 0x7f0f6810b180 2024-09-10T23:37:37.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.368+0000 7f0f67e00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0f68114bc0 con 0x7f0f6810a800 2024-09-10T23:37:37.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.368+0000 7f0f67e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0f68114ec0 con 0x7f0f68104df0 2024-09-10T23:37:37.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.368+0000 7f0f67400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f6810b180 0x7f0f681a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:37.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.368+0000 7f0f66000640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f6810a800 0x7f0f6819b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:37.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.368+0000 7f0f67400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f6810b180 0x7f0f681a0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60234/0 (socket says 172.21.15.3:60234) 2024-09-10T23:37:37.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.368+0000 7f0f67400640 1 -- 172.21.15.3:0/2982516923 learned_addr learned my addr 172.21.15.3:0/2982516923 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-10T23:37:37.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.368+0000 7f0f66a00640 1 --2- 172.21.15.3:0/2982516923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f68104df0 0x7f0f6819b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:37.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.369+0000 7f0f67400640 1 -- 172.21.15.3:0/2982516923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f68104df0 msgr2=0x7f0f6819b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:37.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.369+0000 7f0f67400640 1 --2- 172.21.15.3:0/2982516923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f68104df0 0x7f0f6819b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:37.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.369+0000 7f0f67400640 1 -- 172.21.15.3:0/2982516923 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f6810a800 msgr2=0x7f0f6819b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:37.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.369+0000 7f0f67400640 1 --2- 172.21.15.3:0/2982516923 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f6810a800 0x7f0f6819b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:37.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.369+0000 7f0f67400640 1 -- 172.21.15.3:0/2982516923 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f681a1280 con 0x7f0f6810b180 2024-09-10T23:37:37.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.369+0000 7f0f67400640 1 --2- 172.21.15.3:0/2982516923 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f6810b180 0x7f0f681a0ab0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0f6000cce0 tx=0x7f0f6000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:37.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.369+0000 7f0f5f400640 1 -- 172.21.15.3:0/2982516923 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6000f450 con 0x7f0f6810b180 2024-09-10T23:37:37.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.369+0000 7f0f5f400640 1 -- 172.21.15.3:0/2982516923 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0f6000fa80 con 0x7f0f6810b180 2024-09-10T23:37:37.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.369+0000 7f0f67e00640 1 -- 172.21.15.3:0/2982516923 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f681a1570 con 0x7f0f6810b180 2024-09-10T23:37:37.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.369+0000 7f0f5f400640 1 -- 172.21.15.3:0/2982516923 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f60018ad0 con 0x7f0f6810b180 2024-09-10T23:37:37.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.370+0000 7f0f67e00640 1 -- 172.21.15.3:0/2982516923 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f681a7c30 con 0x7f0f6810b180 2024-09-10T23:37:37.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.371+0000 7f0f67e00640 1 -- 172.21.15.3:0/2982516923 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f681051d0 con 0x7f0f6810b180 2024-09-10T23:37:37.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.373+0000 7f0f5f400640 1 -- 172.21.15.3:0/2982516923 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 26) ==== 153380+0+0 (secure 0 0 0) 0x7f0f6000f5f0 con 0x7f0f6810b180 2024-09-10T23:37:37.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.374+0000 7f0f5f400640 1 --2- 172.21.15.3:0/2982516923 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0f4c0b5580 0x7f0f4c0b7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:37.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.374+0000 7f0f5f400640 1 -- 172.21.15.3:0/2982516923 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8539+0+0 (secure 0 0 0) 0x7f0f600e6690 con 0x7f0f6810b180 2024-09-10T23:37:37.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.375+0000 7f0f66a00640 1 --2- 172.21.15.3:0/2982516923 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0f4c0b5580 0x7f0f4c0b7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:37.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.375+0000 7f0f66a00640 1 --2- 172.21.15.3:0/2982516923 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0f4c0b5580 0x7f0f4c0b7a40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0f58005fd0 tx=0x7f0f5800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:37.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.378+0000 7f0f5f400640 1 -- 172.21.15.3:0/2982516923 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0f60014030 con 0x7f0f6810b180 2024-09-10T23:37:37.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.576+0000 7f0f67e00640 1 -- 172.21.15.3:0/2982516923 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0f6810cf60 con 0x7f0f6810b180 2024-09-10T23:37:37.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.657+0000 7f0f5f400640 1 -- 172.21.15.3:0/2982516923 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v104) ==== 178+0+0 (secure 0 0 0) 0x7f0f600ad1a0 con 0x7f0f6810b180 2024-09-10T23:37:37.658 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_data_ec' removed 2024-09-10T23:37:37.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.660+0000 7f0f67e00640 1 -- 172.21.15.3:0/2982516923 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0f4c0b5580 msgr2=0x7f0f4c0b7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:37.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.660+0000 7f0f67e00640 1 --2- 172.21.15.3:0/2982516923 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0f4c0b5580 0x7f0f4c0b7a40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0f58005fd0 tx=0x7f0f5800b390 comp rx=0 tx=0).stop 2024-09-10T23:37:37.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.660+0000 7f0f67e00640 1 -- 172.21.15.3:0/2982516923 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f6810b180 msgr2=0x7f0f681a0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:37.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.660+0000 7f0f67e00640 1 --2- 172.21.15.3:0/2982516923 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f6810b180 0x7f0f681a0ab0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0f6000cce0 tx=0x7f0f6000a620 comp rx=0 tx=0).stop 2024-09-10T23:37:37.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.661+0000 7f0f67e00640 1 -- 172.21.15.3:0/2982516923 shutdown_connections 2024-09-10T23:37:37.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.662+0000 7f0f67e00640 1 --2- 172.21.15.3:0/2982516923 >> [v2:172.21.15.3:6800/536493997,v1:172.21.15.3:6801/536493997] conn(0x7f0f4c0b5580 0x7f0f4c0b7a40 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:37.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.662+0000 7f0f67e00640 1 --2- 172.21.15.3:0/2982516923 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f6810b180 0x7f0f681a0ab0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:37.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.662+0000 7f0f67e00640 1 --2- 172.21.15.3:0/2982516923 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f6810a800 0x7f0f6819b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:37.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.662+0000 7f0f67e00640 1 --2- 172.21.15.3:0/2982516923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f68104df0 0x7f0f6819b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:37.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.662+0000 7f0f67e00640 1 -- 172.21.15.3:0/2982516923 >> 172.21.15.3:0/2982516923 conn(0x7f0f68100840 msgr2=0x7f0f68106db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:37.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.663+0000 7f0f67e00640 1 -- 172.21.15.3:0/2982516923 shutdown_connections 2024-09-10T23:37:37.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-10T23:37:37.663+0000 7f0f67e00640 1 -- 172.21.15.3:0/2982516923 wait complete. 2024-09-10T23:37:37.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:37 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2982516923' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T23:37:37.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:37 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2982516923' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T23:37:38.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:37 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2982516923' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T23:37:38.553 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:37:38.610 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:37:38.677 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:37:38.743 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-10T23:37:38.744 DEBUG:teuthology.orchestra.run.smithi003:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T23:37:38.779 DEBUG:teuthology.orchestra.run.smithi038:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T23:37:38.819 DEBUG:teuthology.orchestra.run.smithi194:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T23:37:38.856 INFO:tasks.cephadm:Stopping all daemons... 2024-09-10T23:37:38.856 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-10T23:37:38.856 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mon.a 2024-09-10T23:37:38.904 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:38 smithi003 ceph-mon[30348]: pgmap v729: 33 pgs: 33 active+clean; 577 KiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:38.904 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:38 smithi003 ceph-mon[30348]: from='client.? 172.21.15.3:0/2982516923' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T23:37:38.904 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:38 smithi003 ceph-mon[30348]: osdmap e104: 12 total, 12 up, 12 in 2024-09-10T23:37:38.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:38 smithi194 ceph-mon[33904]: pgmap v729: 33 pgs: 33 active+clean; 577 KiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:38.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:38 smithi194 ceph-mon[33904]: from='client.? 172.21.15.3:0/2982516923' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T23:37:38.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:38 smithi194 ceph-mon[33904]: osdmap e104: 12 total, 12 up, 12 in 2024-09-10T23:37:39.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:38 smithi038 ceph-mon[34225]: pgmap v729: 33 pgs: 33 active+clean; 577 KiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:39.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:38 smithi038 ceph-mon[34225]: from='client.? 172.21.15.3:0/2982516923' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T23:37:39.097 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:38 smithi038 ceph-mon[34225]: osdmap e104: 12 total, 12 up, 12 in 2024-09-10T23:37:39.191 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:38 smithi003 systemd[1]: Stopping Ceph mon.a for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:37:39.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:39 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mon-a[30344]: 2024-09-10T23:37:39.280+0000 7f2ce4000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:37:39.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:39 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mon-a[30344]: 2024-09-10T23:37:39.280+0000 7f2ce4000640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-10T23:37:39.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:39 smithi003 podman[97049]: 2024-09-10 23:37:39.373503113 +0000 UTC m=+0.235208195 container died 3744d202b7ecf0be37c7e7a56a24f7567a0c593d64857c7d9634c594a813d11a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mon-a, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-10T23:37:40.180 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:39 smithi003 podman[97049]: 2024-09-10 23:37:39.845255686 +0000 UTC m=+0.706960767 container cleanup 3744d202b7ecf0be37c7e7a56a24f7567a0c593d64857c7d9634c594a813d11a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mon-a, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-10T23:37:40.180 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:39 smithi003 bash[97049]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mon-a 2024-09-10T23:37:40.470 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 10 23:37:40 smithi003 podman[97061]: 2024-09-10 23:37:40.179850044 +0000 UTC m=+0.793159668 container remove 3744d202b7ecf0be37c7e7a56a24f7567a0c593d64857c7d9634c594a813d11a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-10T23:37:40.504 DEBUG:teuthology.orchestra.run.smithi003:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mon.a.service' 2024-09-10T23:37:40.594 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:37:40.595 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-10T23:37:40.595 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-10T23:37:40.595 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mon.b 2024-09-10T23:37:41.053 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:40 smithi038 systemd[1]: Stopping Ceph mon.b for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:37:41.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:41 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mon-b[34221]: 2024-09-10T23:37:41.051+0000 7fd24d600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:37:41.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:41 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mon-b[34221]: 2024-09-10T23:37:41.051+0000 7fd24d600640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-10T23:37:41.347 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:41 smithi038 podman[70127]: 2024-09-10 23:37:41.257720028 +0000 UTC m=+0.364537447 container died 7a803f8f539b60e120fe5b1bce6e23d4616af50e9ce2d72f2729cbca9d78e4fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mon-b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:37:41.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:41 smithi038 podman[70127]: 2024-09-10 23:37:41.690561858 +0000 UTC m=+0.797379267 container cleanup 7a803f8f539b60e120fe5b1bce6e23d4616af50e9ce2d72f2729cbca9d78e4fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mon-b, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux ) 2024-09-10T23:37:41.847 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:41 smithi038 bash[70127]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mon-b 2024-09-10T23:37:42.215 INFO:journalctl@ceph.mon.b.smithi038.stdout:Sep 10 23:37:41 smithi038 podman[70139]: 2024-09-10 23:37:41.934112817 +0000 UTC m=+0.662969495 container remove 7a803f8f539b60e120fe5b1bce6e23d4616af50e9ce2d72f2729cbca9d78e4fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mon-b, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True) 2024-09-10T23:37:42.241 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mon.b.service' 2024-09-10T23:37:42.325 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:37:42.325 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-10T23:37:42.326 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-10T23:37:42.326 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mon.c 2024-09-10T23:37:42.697 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:42 smithi194 systemd[1]: Stopping Ceph mon.c for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:37:43.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:42 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mon-c[33900]: 2024-09-10T23:37:42.745+0000 7f4d85e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:37:43.197 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:42 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mon-c[33900]: 2024-09-10T23:37:42.745+0000 7f4d85e00640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-10T23:37:43.198 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:42 smithi194 podman[70674]: 2024-09-10 23:37:42.919746686 +0000 UTC m=+0.305462356 container died 5dd3906c776c03ae7c71648abd91156910218eb7a3b374a29af36e1c76f60f96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mon-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-10T23:37:43.593 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:43 smithi194 podman[70674]: 2024-09-10 23:37:43.34167345 +0000 UTC m=+0.727389119 container cleanup 5dd3906c776c03ae7c71648abd91156910218eb7a3b374a29af36e1c76f60f96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mon-c, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-10T23:37:43.593 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:43 smithi194 bash[70674]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mon-c 2024-09-10T23:37:43.861 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 10 23:37:43 smithi194 podman[70688]: 2024-09-10 23:37:43.593182206 +0000 UTC m=+0.661385639 container remove 5dd3906c776c03ae7c71648abd91156910218eb7a3b374a29af36e1c76f60f96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mon-c, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-10T23:37:43.877 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mon.c.service' 2024-09-10T23:37:43.965 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:37:43.965 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-10T23:37:43.965 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-10T23:37:43.965 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mgr.x 2024-09-10T23:37:44.405 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:37:44 smithi003 systemd[1]: Stopping Ceph mgr.x for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:37:44.405 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:37:44 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T23:37:44.401+0000 7f7137200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:37:44.405 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:37:44 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T23:37:44.401+0000 7f7137200640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-10T23:37:44.720 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:37:44 smithi003 podman[97166]: 2024-09-10 23:37:44.495651121 +0000 UTC m=+0.229620841 container died a0f70d5992d395319a32d5ccbc6c33158da4614204e13f291f76b1178378617c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:37:45.169 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:37:44 smithi003 podman[97166]: 2024-09-10 23:37:44.966971176 +0000 UTC m=+0.700940896 container cleanup a0f70d5992d395319a32d5ccbc6c33158da4614204e13f291f76b1178378617c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:37:45.169 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:37:44 smithi003 bash[97166]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x 2024-09-10T23:37:45.452 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 10 23:37:45 smithi003 podman[97177]: 2024-09-10 23:37:45.168842008 +0000 UTC m=+0.664232791 container remove a0f70d5992d395319a32d5ccbc6c33158da4614204e13f291f76b1178378617c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-x, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:37:45.473 DEBUG:teuthology.orchestra.run.smithi003:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-10T23:37:45.546 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:37:45.546 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-10T23:37:45.547 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-10T23:37:45.547 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mgr.y 2024-09-10T23:37:46.067 INFO:journalctl@ceph.mgr.y.smithi038.stdout:Sep 10 23:37:45 smithi038 systemd[1]: Stopping Ceph mgr.y for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:37:46.347 INFO:journalctl@ceph.mgr.y.smithi038.stdout:Sep 10 23:37:46 smithi038 podman[70248]: 2024-09-10 23:37:46.066722381 +0000 UTC m=+0.224661678 container died 812af8ed3c9629ed2a85a6314595271b5d4a7bc2e08b78769a7ffd6b2f723ed1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:37:46.739 INFO:journalctl@ceph.mgr.y.smithi038.stdout:Sep 10 23:37:46 smithi038 podman[70248]: 2024-09-10 23:37:46.529322129 +0000 UTC m=+0.687261425 container cleanup 812af8ed3c9629ed2a85a6314595271b5d4a7bc2e08b78769a7ffd6b2f723ed1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-y, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:37:46.740 INFO:journalctl@ceph.mgr.y.smithi038.stdout:Sep 10 23:37:46 smithi038 bash[70248]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-y 2024-09-10T23:37:47.000 INFO:journalctl@ceph.mgr.y.smithi038.stdout:Sep 10 23:37:46 smithi038 podman[70261]: 2024-09-10 23:37:46.739321483 +0000 UTC m=+0.665759536 container remove 812af8ed3c9629ed2a85a6314595271b5d4a7bc2e08b78769a7ffd6b2f723ed1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:37:47.000 INFO:journalctl@ceph.mgr.y.smithi038.stdout:Sep 10 23:37:46 smithi038 systemd[1]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-09-10T23:37:47.026 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-10T23:37:47.101 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:37:47.102 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-10T23:37:47.102 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-10T23:37:47.102 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mgr.z 2024-09-10T23:37:47.447 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 10 23:37:47 smithi194 systemd[1]: Stopping Ceph mgr.z for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:37:47.882 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 10 23:37:47 smithi194 podman[70806]: 2024-09-10 23:37:47.569820162 +0000 UTC m=+0.186679236 container died dc5e48ebe4622c75cf2fdce70479fc237623c558325252102492ab8c3c75bb1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-10T23:37:48.197 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 10 23:37:48 smithi194 podman[70806]: 2024-09-10 23:37:48.038436797 +0000 UTC m=+0.655295868 container cleanup dc5e48ebe4622c75cf2fdce70479fc237623c558325252102492ab8c3c75bb1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-z, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:37:48.197 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 10 23:37:48 smithi194 bash[70806]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-z 2024-09-10T23:37:48.553 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 10 23:37:48 smithi194 podman[70819]: 2024-09-10 23:37:48.282013705 +0000 UTC m=+0.695588097 container remove dc5e48ebe4622c75cf2fdce70479fc237623c558325252102492ab8c3c75bb1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-10T23:37:48.553 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 10 23:37:48 smithi194 systemd[1]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-09-10T23:37:48.577 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-10T23:37:48.650 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:37:48.651 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-10T23:37:48.651 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-10T23:37:48.651 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.0 2024-09-10T23:37:48.970 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 10 23:37:48 smithi003 systemd[1]: Stopping Ceph osd.0 for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:37:49.470 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 10 23:37:49 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-0[48724]: 2024-09-10T23:37:49.074+0000 7ff450c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:37:49.470 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 10 23:37:49 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-0[48724]: 2024-09-10T23:37:49.074+0000 7ff450c00640 -1 osd.0 104 *** Got signal Terminated *** 2024-09-10T23:37:49.470 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 10 23:37:49 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-0[48724]: 2024-09-10T23:37:49.074+0000 7ff450c00640 -1 osd.0 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:37:54.757 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 10 23:37:54 smithi003 podman[97286]: 2024-09-10 23:37:54.484780938 +0000 UTC m=+5.545246973 container died 62a06809a8f3c74dbccc9f2268f7be709a25d9e7a2f6b4c94b9b7e7e27fccc9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-10T23:37:55.165 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 10 23:37:54 smithi003 podman[97286]: 2024-09-10 23:37:54.93839676 +0000 UTC m=+5.998862794 container cleanup 62a06809a8f3c74dbccc9f2268f7be709a25d9e7a2f6b4c94b9b7e7e27fccc9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-10T23:37:55.166 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 10 23:37:54 smithi003 bash[97286]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-0 2024-09-10T23:37:55.470 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 10 23:37:55 smithi003 podman[97304]: 2024-09-10 23:37:55.165357502 +0000 UTC m=+0.672869808 container remove 62a06809a8f3c74dbccc9f2268f7be709a25d9e7a2f6b4c94b9b7e7e27fccc9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-10T23:37:55.977 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 10 23:37:55 smithi003 podman[97398]: 2024-09-10 23:37:55.624938707 +0000 UTC m=+0.027095472 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:37:55.977 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 10 23:37:55 smithi003 podman[97398]: 2024-09-10 23:37:55.732870913 +0000 UTC m=+0.135027656 container create 631465f1125c1e4489184a3af8e9fabea5303fd651a90eacfc03834171b288c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-10T23:37:55.977 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 10 23:37:55 smithi003 podman[97398]: 2024-09-10 23:37:55.977336943 +0000 UTC m=+0.379493711 container init 631465f1125c1e4489184a3af8e9fabea5303fd651a90eacfc03834171b288c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-10T23:37:56.252 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 10 23:37:55 smithi003 podman[97398]: 2024-09-10 23:37:55.984255724 +0000 UTC m=+0.386412467 container start 631465f1125c1e4489184a3af8e9fabea5303fd651a90eacfc03834171b288c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-10T23:37:56.252 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 10 23:37:56 smithi003 podman[97398]: 2024-09-10 23:37:56.068846044 +0000 UTC m=+0.471002798 container attach 631465f1125c1e4489184a3af8e9fabea5303fd651a90eacfc03834171b288c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-10T23:37:56.597 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 10 23:37:56 smithi003 podman[97398]: 2024-09-10 23:37:56.2523157 +0000 UTC m=+0.654472449 container died 631465f1125c1e4489184a3af8e9fabea5303fd651a90eacfc03834171b288c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-10T23:37:56.989 DEBUG:teuthology.orchestra.run.smithi003:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.0.service' 2024-09-10T23:37:57.066 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:37:57.066 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-10T23:37:57.066 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-10T23:37:57.066 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.1 2024-09-10T23:37:57.496 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 10 23:37:57 smithi038 systemd[1]: Stopping Ceph osd.1 for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:37:57.847 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 10 23:37:57 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-1[39981]: 2024-09-10T23:37:57.494+0000 7f8c1e000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:37:57.847 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 10 23:37:57 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-1[39981]: 2024-09-10T23:37:57.494+0000 7f8c1e000640 -1 osd.1 104 *** Got signal Terminated *** 2024-09-10T23:37:57.847 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 10 23:37:57 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-1[39981]: 2024-09-10T23:37:57.494+0000 7f8c1e000640 -1 osd.1 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:38:03.433 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 10 23:38:03 smithi038 podman[70377]: 2024-09-10 23:38:03.115503568 +0000 UTC m=+5.743744502 container died 9fcc80541c37ecda1e05c93d220896d51d628134231e14dc47c5f0a81411c6be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-1, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:38:03.847 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 10 23:38:03 smithi038 podman[70377]: 2024-09-10 23:38:03.576122216 +0000 UTC m=+6.204363156 container cleanup 9fcc80541c37ecda1e05c93d220896d51d628134231e14dc47c5f0a81411c6be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-1, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True) 2024-09-10T23:38:03.847 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 10 23:38:03 smithi038 bash[70377]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-1 2024-09-10T23:38:04.347 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 10 23:38:03 smithi038 podman[70393]: 2024-09-10 23:38:03.919910812 +0000 UTC m=+0.799184074 container remove 9fcc80541c37ecda1e05c93d220896d51d628134231e14dc47c5f0a81411c6be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-1, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:38:04.774 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 10 23:38:04 smithi038 podman[70493]: 2024-09-10 23:38:04.355972592 +0000 UTC m=+0.028470782 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:38:04.775 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 10 23:38:04 smithi038 podman[70493]: 2024-09-10 23:38:04.521136292 +0000 UTC m=+0.193634481 container create 9b2712ce48af9baf3961a506c251aec2f233cc19522818f5badaa13f8928d550 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-10T23:38:05.040 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 10 23:38:04 smithi038 podman[70493]: 2024-09-10 23:38:04.77397926 +0000 UTC m=+0.446477450 container init 9b2712ce48af9baf3961a506c251aec2f233cc19522818f5badaa13f8928d550 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:38:05.041 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 10 23:38:04 smithi038 podman[70493]: 2024-09-10 23:38:04.781422024 +0000 UTC m=+0.453920218 container start 9b2712ce48af9baf3961a506c251aec2f233cc19522818f5badaa13f8928d550 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-10T23:38:05.041 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 10 23:38:04 smithi038 podman[70493]: 2024-09-10 23:38:04.86559894 +0000 UTC m=+0.538097141 container attach 9b2712ce48af9baf3961a506c251aec2f233cc19522818f5badaa13f8928d550 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:38:05.347 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 10 23:38:05 smithi038 podman[70493]: 2024-09-10 23:38:05.040678212 +0000 UTC m=+0.713176414 container died 9b2712ce48af9baf3961a506c251aec2f233cc19522818f5badaa13f8928d550 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True) 2024-09-10T23:38:05.796 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.1.service' 2024-09-10T23:38:05.872 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:38:05.873 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-10T23:38:05.873 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-10T23:38:05.873 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.2 2024-09-10T23:38:06.197 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 10 23:38:05 smithi194 systemd[1]: Stopping Ceph osd.2 for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:38:06.697 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 10 23:38:06 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-2[40205]: 2024-09-10T23:38:06.294+0000 7efc1c600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:38:06.697 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 10 23:38:06 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-2[40205]: 2024-09-10T23:38:06.294+0000 7efc1c600640 -1 osd.2 104 *** Got signal Terminated *** 2024-09-10T23:38:06.698 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 10 23:38:06 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-2[40205]: 2024-09-10T23:38:06.294+0000 7efc1c600640 -1 osd.2 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:38:12.044 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 10 23:38:11 smithi194 podman[70931]: 2024-09-10 23:38:11.742729982 +0000 UTC m=+5.575387416 container died d1f22cfffa63939c974ad42f6533f8ff5be464b23509665cfad94b2944d4fb4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:38:12.411 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 10 23:38:12 smithi194 podman[70931]: 2024-09-10 23:38:12.175775794 +0000 UTC m=+6.008433207 container cleanup d1f22cfffa63939c974ad42f6533f8ff5be464b23509665cfad94b2944d4fb4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:38:12.411 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 10 23:38:12 smithi194 bash[70931]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-2 2024-09-10T23:38:12.697 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 10 23:38:12 smithi194 podman[70960]: 2024-09-10 23:38:12.41062758 +0000 UTC m=+0.660024624 container remove d1f22cfffa63939c974ad42f6533f8ff5be464b23509665cfad94b2944d4fb4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-10T23:38:13.197 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 10 23:38:12 smithi194 podman[71049]: 2024-09-10 23:38:12.842075951 +0000 UTC m=+0.027394960 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:38:13.198 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 10 23:38:12 smithi194 podman[71049]: 2024-09-10 23:38:12.969930336 +0000 UTC m=+0.155249349 container create 4d06f9a5b908ed19c84a81439757a9c8cbd038591a2e39299cfeabdfe24f85ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:38:13.501 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 10 23:38:13 smithi194 podman[71049]: 2024-09-10 23:38:13.231667398 +0000 UTC m=+0.416986422 container init 4d06f9a5b908ed19c84a81439757a9c8cbd038591a2e39299cfeabdfe24f85ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:38:13.501 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 10 23:38:13 smithi194 podman[71049]: 2024-09-10 23:38:13.238740403 +0000 UTC m=+0.424059420 container start 4d06f9a5b908ed19c84a81439757a9c8cbd038591a2e39299cfeabdfe24f85ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, io.buildah.version=1.37.2) 2024-09-10T23:38:13.501 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 10 23:38:13 smithi194 podman[71049]: 2024-09-10 23:38:13.33102259 +0000 UTC m=+0.516341635 container attach 4d06f9a5b908ed19c84a81439757a9c8cbd038591a2e39299cfeabdfe24f85ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-2-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-10T23:38:13.834 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 10 23:38:13 smithi194 podman[71049]: 2024-09-10 23:38:13.501183445 +0000 UTC m=+0.686502463 container died 4d06f9a5b908ed19c84a81439757a9c8cbd038591a2e39299cfeabdfe24f85ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-10T23:38:14.193 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.2.service' 2024-09-10T23:38:14.269 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:38:14.269 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-10T23:38:14.269 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-10T23:38:14.269 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.3 2024-09-10T23:38:14.688 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 10 23:38:14 smithi003 systemd[1]: Stopping Ceph osd.3 for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:38:14.970 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 10 23:38:14 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-3[55616]: 2024-09-10T23:38:14.686+0000 7f060c400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:38:14.971 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 10 23:38:14 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-3[55616]: 2024-09-10T23:38:14.686+0000 7f060c400640 -1 osd.3 104 *** Got signal Terminated *** 2024-09-10T23:38:14.971 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 10 23:38:14 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-3[55616]: 2024-09-10T23:38:14.686+0000 7f060c400640 -1 osd.3 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:38:15.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:15 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:15.669+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:16.198 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:15 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:15.746+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:16.470 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 10 23:38:16 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-3[55616]: 2024-09-10T23:38:16.189+0000 7f0602e00640 -1 osd.3 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.339729+0000 front 2024-09-10T23:37:50.339763+0000 (oldest deadline 2024-09-10T23:38:15.639952+0000) 2024-09-10T23:38:16.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:16 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:16.634+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:17.197 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:16 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:16.734+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:17.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:16 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:16.969+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:17.470 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 10 23:38:17 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-3[55616]: 2024-09-10T23:38:17.147+0000 7f0602e00640 -1 osd.3 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.339729+0000 front 2024-09-10T23:37:50.339763+0000 (oldest deadline 2024-09-10T23:38:15.639952+0000) 2024-09-10T23:38:17.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:17 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:17.648+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:18.009 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:17 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:17.705+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:18.447 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:18 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:18.008+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:18.470 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 10 23:38:18 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-3[55616]: 2024-09-10T23:38:18.127+0000 7f0602e00640 -1 osd.3 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.339729+0000 front 2024-09-10T23:37:50.339763+0000 (oldest deadline 2024-09-10T23:38:15.639952+0000) 2024-09-10T23:38:18.947 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:18 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:18.690+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:18.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:18 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:18.697+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:19.447 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:19 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:19.034+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:19.470 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 10 23:38:19 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-3[55616]: 2024-09-10T23:38:19.174+0000 7f0602e00640 -1 osd.3 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.339729+0000 front 2024-09-10T23:37:50.339763+0000 (oldest deadline 2024-09-10T23:38:15.639952+0000) 2024-09-10T23:38:19.947 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:19 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:19.679+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:19.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:19 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:19.677+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:20.447 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:20 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:20.010+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:20.551 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 10 23:38:20 smithi003 podman[97514]: 2024-09-10 23:38:20.257336153 +0000 UTC m=+5.695467011 container died 3df54912c9bdfa9558031feda7b98a2d6b71d8f4033b7dc9525212b734f6cc29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-3, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-10T23:38:20.947 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:20 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:20.645+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:20.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:20 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:20.715+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:20.971 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 10 23:38:20 smithi003 podman[97514]: 2024-09-10 23:38:20.6833005 +0000 UTC m=+6.121431349 container cleanup 3df54912c9bdfa9558031feda7b98a2d6b71d8f4033b7dc9525212b734f6cc29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-3, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-10T23:38:20.971 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 10 23:38:20 smithi003 bash[97514]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-3 2024-09-10T23:38:21.447 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:20 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:20.998+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:21.470 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 10 23:38:20 smithi003 podman[97532]: 2024-09-10 23:38:20.976454034 +0000 UTC m=+0.704868944 container remove 3df54912c9bdfa9558031feda7b98a2d6b71d8f4033b7dc9525212b734f6cc29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True) 2024-09-10T23:38:21.931 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:21 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:21.719+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:21.932 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 10 23:38:21 smithi003 podman[97616]: 2024-09-10 23:38:21.526185653 +0000 UTC m=+0.027363369 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:38:21.932 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 10 23:38:21 smithi003 podman[97616]: 2024-09-10 23:38:21.669590016 +0000 UTC m=+0.170767732 container create a9006ebfb29aa9ec8513764aa01b59199f3082e9d2342576c7a86011deca1a04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-10T23:38:21.932 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 10 23:38:21 smithi003 podman[97616]: 2024-09-10 23:38:21.930451006 +0000 UTC m=+0.431628723 container init a9006ebfb29aa9ec8513764aa01b59199f3082e9d2342576c7a86011deca1a04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-10T23:38:21.947 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:21 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:21.686+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:22.219 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 10 23:38:21 smithi003 podman[97616]: 2024-09-10 23:38:21.937855963 +0000 UTC m=+0.439033695 container start a9006ebfb29aa9ec8513764aa01b59199f3082e9d2342576c7a86011deca1a04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-10T23:38:22.219 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 10 23:38:22 smithi003 podman[97616]: 2024-09-10 23:38:22.03031261 +0000 UTC m=+0.531490326 container attach a9006ebfb29aa9ec8513764aa01b59199f3082e9d2342576c7a86011deca1a04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:38:22.447 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:21 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:21.987+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:22.470 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 10 23:38:22 smithi003 podman[97616]: 2024-09-10 23:38:22.218857009 +0000 UTC m=+0.720034733 container died a9006ebfb29aa9ec8513764aa01b59199f3082e9d2342576c7a86011deca1a04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-3-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD) 2024-09-10T23:38:22.834 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:22 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:22.720+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:22.865 DEBUG:teuthology.orchestra.run.smithi003:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.3.service' 2024-09-10T23:38:22.941 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:38:22.942 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-10T23:38:22.942 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-10T23:38:22.942 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.4 2024-09-10T23:38:22.947 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:22 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:22.653+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:23.347 INFO:journalctl@ceph.osd.4.smithi038.stdout:Sep 10 23:38:23 smithi038 systemd[1]: Stopping Ceph osd.4 for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:38:23.447 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:22 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:22.964+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:23.847 INFO:journalctl@ceph.osd.4.smithi038.stdout:Sep 10 23:38:23 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-4[46621]: 2024-09-10T23:38:23.376+0000 7f1d28000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:38:23.847 INFO:journalctl@ceph.osd.4.smithi038.stdout:Sep 10 23:38:23 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-4[46621]: 2024-09-10T23:38:23.376+0000 7f1d28000640 -1 osd.4 104 *** Got signal Terminated *** 2024-09-10T23:38:23.847 INFO:journalctl@ceph.osd.4.smithi038.stdout:Sep 10 23:38:23 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-4[46621]: 2024-09-10T23:38:23.376+0000 7f1d28000640 -1 osd.4 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:38:23.941 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:23 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:23.652+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:23.964 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:23 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:23.695+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:23.964 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:23 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:23.695+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:24.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:23 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:23.940+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:24.220 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:23 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:23.963+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.541646+0000 front 2024-09-10T23:38:01.541449+0000 (oldest deadline 2024-09-10T23:38:23.241435+0000) 2024-09-10T23:38:24.697 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:24 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:24.616+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:24.698 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 10 23:38:24 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-5[46899]: 2024-09-10T23:38:24.390+0000 7fd4c1200640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:58.857261+0000 front 2024-09-10T23:37:58.857344+0000 (oldest deadline 2024-09-10T23:38:24.057490+0000) 2024-09-10T23:38:24.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:24 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:24.684+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:24.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:24 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:24.684+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:25.097 INFO:journalctl@ceph.osd.4.smithi038.stdout:Sep 10 23:38:24 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-4[46621]: 2024-09-10T23:38:24.735+0000 7f1d23a00640 -1 osd.4 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.657936+0000 front 2024-09-10T23:38:00.657968+0000 (oldest deadline 2024-09-10T23:38:24.158170+0000) 2024-09-10T23:38:25.097 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:24 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:24.796+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:59.815484+0000 front 2024-09-10T23:37:59.815632+0000 (oldest deadline 2024-09-10T23:38:23.915648+0000) 2024-09-10T23:38:25.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:24 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:24.906+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:25.470 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:24 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:24.985+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.541646+0000 front 2024-09-10T23:38:01.541449+0000 (oldest deadline 2024-09-10T23:38:23.241435+0000) 2024-09-10T23:38:25.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:25 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:25.189+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:25.697 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 10 23:38:25 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-5[46899]: 2024-09-10T23:38:25.438+0000 7fd4c1200640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:58.857261+0000 front 2024-09-10T23:37:58.857344+0000 (oldest deadline 2024-09-10T23:38:24.057490+0000) 2024-09-10T23:38:25.698 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:25 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:25.585+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:25.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:25 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:25.635+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:25.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:25 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:25.635+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:26.097 INFO:journalctl@ceph.osd.4.smithi038.stdout:Sep 10 23:38:25 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-4[46621]: 2024-09-10T23:38:25.774+0000 7f1d23a00640 -1 osd.4 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.657936+0000 front 2024-09-10T23:38:00.657968+0000 (oldest deadline 2024-09-10T23:38:24.158170+0000) 2024-09-10T23:38:26.097 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:25 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:25.834+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:59.815484+0000 front 2024-09-10T23:37:59.815632+0000 (oldest deadline 2024-09-10T23:38:23.915648+0000) 2024-09-10T23:38:26.439 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:25 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:25.948+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:26.439 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:25 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:25.948+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:38:26.470 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:26 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:26.029+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.541646+0000 front 2024-09-10T23:38:01.541449+0000 (oldest deadline 2024-09-10T23:38:23.241435+0000) 2024-09-10T23:38:26.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:26 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:26.150+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:26.697 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 10 23:38:26 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-5[46899]: 2024-09-10T23:38:26.438+0000 7fd4c1200640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:58.857261+0000 front 2024-09-10T23:37:58.857344+0000 (oldest deadline 2024-09-10T23:38:24.057490+0000) 2024-09-10T23:38:26.698 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:26 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:26.616+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:26.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:26 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:26.649+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:26.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:26 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:26.649+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:27.097 INFO:journalctl@ceph.osd.4.smithi038.stdout:Sep 10 23:38:26 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-4[46621]: 2024-09-10T23:38:26.763+0000 7f1d23a00640 -1 osd.4 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.657936+0000 front 2024-09-10T23:38:00.657968+0000 (oldest deadline 2024-09-10T23:38:24.158170+0000) 2024-09-10T23:38:27.098 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:26 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:26.825+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:59.815484+0000 front 2024-09-10T23:37:59.815632+0000 (oldest deadline 2024-09-10T23:38:23.915648+0000) 2024-09-10T23:38:27.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:26 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:26.914+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:27.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:26 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:26.914+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:38:27.470 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:27 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:27.059+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.541646+0000 front 2024-09-10T23:38:01.541449+0000 (oldest deadline 2024-09-10T23:38:23.241435+0000) 2024-09-10T23:38:27.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:27 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:27.135+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:27.698 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 10 23:38:27 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-5[46899]: 2024-09-10T23:38:27.414+0000 7fd4c1200640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:58.857261+0000 front 2024-09-10T23:37:58.857344+0000 (oldest deadline 2024-09-10T23:38:24.057490+0000) 2024-09-10T23:38:27.698 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:27 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:27.612+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:27.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:27 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:27.667+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:27.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:27 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:27.667+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:28.097 INFO:journalctl@ceph.osd.4.smithi038.stdout:Sep 10 23:38:27 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-4[46621]: 2024-09-10T23:38:27.737+0000 7f1d23a00640 -1 osd.4 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.657936+0000 front 2024-09-10T23:38:00.657968+0000 (oldest deadline 2024-09-10T23:38:24.158170+0000) 2024-09-10T23:38:28.098 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:27 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:27.806+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:59.815484+0000 front 2024-09-10T23:37:59.815632+0000 (oldest deadline 2024-09-10T23:38:23.915648+0000) 2024-09-10T23:38:28.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:27 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:27.932+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:28.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:27 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:27.932+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:38:28.470 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:28 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:28.080+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.541646+0000 front 2024-09-10T23:38:01.541449+0000 (oldest deadline 2024-09-10T23:38:23.241435+0000) 2024-09-10T23:38:28.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:28 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:28.147+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:28.697 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 10 23:38:28 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-5[46899]: 2024-09-10T23:38:28.394+0000 7fd4c1200640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:58.857261+0000 front 2024-09-10T23:37:58.857344+0000 (oldest deadline 2024-09-10T23:38:24.057490+0000) 2024-09-10T23:38:28.698 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:28 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:28.605+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:28.811 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:28 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:28.690+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:28.811 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:28 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:28.690+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:29.097 INFO:journalctl@ceph.osd.4.smithi038.stdout:Sep 10 23:38:28 smithi038 podman[70598]: 2024-09-10 23:38:28.960774171 +0000 UTC m=+5.722407080 container died 63c2e0a13362c500b8f5f0320ac663e0646a2eebea05a31110af32c7e72e7054 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-4, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2) 2024-09-10T23:38:29.098 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:28 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:28.787+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:59.815484+0000 front 2024-09-10T23:37:59.815632+0000 (oldest deadline 2024-09-10T23:38:23.915648+0000) 2024-09-10T23:38:29.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:28 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:28.935+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:29.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:28 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:28.935+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:38:29.470 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:29 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:29.079+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.541646+0000 front 2024-09-10T23:38:01.541449+0000 (oldest deadline 2024-09-10T23:38:23.241435+0000) 2024-09-10T23:38:29.583 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:29 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:29.144+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:29.584 INFO:journalctl@ceph.osd.4.smithi038.stdout:Sep 10 23:38:29 smithi038 podman[70598]: 2024-09-10 23:38:29.330877914 +0000 UTC m=+6.092510813 container cleanup 63c2e0a13362c500b8f5f0320ac663e0646a2eebea05a31110af32c7e72e7054 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-10T23:38:29.584 INFO:journalctl@ceph.osd.4.smithi038.stdout:Sep 10 23:38:29 smithi038 bash[70598]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-4 2024-09-10T23:38:29.697 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:29 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:29.614+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:29.697 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 10 23:38:29 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-5[46899]: 2024-09-10T23:38:29.370+0000 7fd4c1200640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:58.857261+0000 front 2024-09-10T23:37:58.857344+0000 (oldest deadline 2024-09-10T23:38:24.057490+0000) 2024-09-10T23:38:29.847 INFO:journalctl@ceph.osd.4.smithi038.stdout:Sep 10 23:38:29 smithi038 podman[70615]: 2024-09-10 23:38:29.582819216 +0000 UTC m=+0.615943138 container remove 63c2e0a13362c500b8f5f0320ac663e0646a2eebea05a31110af32c7e72e7054 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-4, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-10T23:38:29.848 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:29 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:29.767+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:59.815484+0000 front 2024-09-10T23:37:59.815632+0000 (oldest deadline 2024-09-10T23:38:23.915648+0000) 2024-09-10T23:38:29.984 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:29 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:29.731+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:29.984 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:29 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:29.731+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:30.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:29 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:29.936+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:30.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:29 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:29.936+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:38:30.405 INFO:journalctl@ceph.osd.4.smithi038.stdout:Sep 10 23:38:30 smithi038 podman[70699]: 2024-09-10 23:38:30.03405692 +0000 UTC m=+0.028034023 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:38:30.405 INFO:journalctl@ceph.osd.4.smithi038.stdout:Sep 10 23:38:30 smithi038 podman[70699]: 2024-09-10 23:38:30.150726511 +0000 UTC m=+0.144703592 container create da8301f0070cc1b19c777453fb4d7a70c0563301d59c1bfab0569346443dd369 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-4-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:38:30.405 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:30 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:30.127+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:30.470 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:30 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:30.072+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.541646+0000 front 2024-09-10T23:38:01.541449+0000 (oldest deadline 2024-09-10T23:38:23.241435+0000) 2024-09-10T23:38:30.664 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 10 23:38:30 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-5[46899]: 2024-09-10T23:38:30.399+0000 7fd4c1200640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:58.857261+0000 front 2024-09-10T23:37:58.857344+0000 (oldest deadline 2024-09-10T23:38:24.057490+0000) 2024-09-10T23:38:30.674 INFO:journalctl@ceph.osd.4.smithi038.stdout:Sep 10 23:38:30 smithi038 podman[70699]: 2024-09-10 23:38:30.403916767 +0000 UTC m=+0.397893858 container init da8301f0070cc1b19c777453fb4d7a70c0563301d59c1bfab0569346443dd369 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:38:30.674 INFO:journalctl@ceph.osd.4.smithi038.stdout:Sep 10 23:38:30 smithi038 podman[70699]: 2024-09-10 23:38:30.411349866 +0000 UTC m=+0.405326947 container start da8301f0070cc1b19c777453fb4d7a70c0563301d59c1bfab0569346443dd369 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-10T23:38:30.674 INFO:journalctl@ceph.osd.4.smithi038.stdout:Sep 10 23:38:30 smithi038 podman[70699]: 2024-09-10 23:38:30.545093612 +0000 UTC m=+0.539070697 container attach da8301f0070cc1b19c777453fb4d7a70c0563301d59c1bfab0569346443dd369 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-10T23:38:30.947 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:30 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:30.663+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:30.948 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:30 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:30.902+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:30.948 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:30 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:30.902+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:38:31.023 INFO:journalctl@ceph.osd.4.smithi038.stdout:Sep 10 23:38:30 smithi038 podman[70699]: 2024-09-10 23:38:30.674371362 +0000 UTC m=+0.668348452 container died da8301f0070cc1b19c777453fb4d7a70c0563301d59c1bfab0569346443dd369 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-10T23:38:31.023 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:30 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:30.800+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:59.815484+0000 front 2024-09-10T23:37:59.815632+0000 (oldest deadline 2024-09-10T23:38:23.915648+0000) 2024-09-10T23:38:31.053 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:30 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:30.741+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:31.053 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:30 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:30.741+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:31.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:31 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:31.162+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:31.401 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.4.service' 2024-09-10T23:38:31.470 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:31 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:31.052+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.541646+0000 front 2024-09-10T23:38:01.541449+0000 (oldest deadline 2024-09-10T23:38:23.241435+0000) 2024-09-10T23:38:31.480 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:38:31.481 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-10T23:38:31.481 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-10T23:38:31.481 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.5 2024-09-10T23:38:31.641 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 10 23:38:31 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-5[46899]: 2024-09-10T23:38:31.386+0000 7fd4c1200640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:58.857261+0000 front 2024-09-10T23:37:58.857344+0000 (oldest deadline 2024-09-10T23:38:24.057490+0000) 2024-09-10T23:38:31.642 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 10 23:38:31 smithi194 systemd[1]: Stopping Ceph osd.5 for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:38:31.947 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:31 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:31.640+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:31.948 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 10 23:38:31 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-5[46899]: 2024-09-10T23:38:31.882+0000 7fd4ca800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:38:31.948 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 10 23:38:31 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-5[46899]: 2024-09-10T23:38:31.882+0000 7fd4ca800640 -1 osd.5 104 *** Got signal Terminated *** 2024-09-10T23:38:31.948 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 10 23:38:31 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-5[46899]: 2024-09-10T23:38:31.882+0000 7fd4ca800640 -1 osd.5 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:38:31.948 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:31 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:31.855+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:31.948 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:31 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:31.855+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:38:31.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:31 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:31.694+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:31.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:31 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:31.694+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:32.040 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:31 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:31.845+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:59.815484+0000 front 2024-09-10T23:37:59.815632+0000 (oldest deadline 2024-09-10T23:38:23.915648+0000) 2024-09-10T23:38:32.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:32 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:32.123+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:32.470 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:32 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:32.060+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.541646+0000 front 2024-09-10T23:38:01.541449+0000 (oldest deadline 2024-09-10T23:38:23.241435+0000) 2024-09-10T23:38:32.654 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 10 23:38:32 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-5[46899]: 2024-09-10T23:38:32.357+0000 7fd4c1200640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:58.857261+0000 front 2024-09-10T23:37:58.857344+0000 (oldest deadline 2024-09-10T23:38:24.057490+0000) 2024-09-10T23:38:32.947 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:32 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:32.654+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:32.948 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:32 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:32.835+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:32.948 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:32 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:32.835+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:38:32.948 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:32 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:32.835+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:38:32.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:32 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:32.709+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:32.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:32 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:32.709+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:33.143 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:32 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:32.873+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:59.815484+0000 front 2024-09-10T23:37:59.815632+0000 (oldest deadline 2024-09-10T23:38:23.915648+0000) 2024-09-10T23:38:33.144 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:32 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:32.873+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:08.016952+0000 front 2024-09-10T23:38:08.016988+0000 (oldest deadline 2024-09-10T23:38:32.117147+0000) 2024-09-10T23:38:33.470 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:33 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:33.022+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.541646+0000 front 2024-09-10T23:38:01.541449+0000 (oldest deadline 2024-09-10T23:38:23.241435+0000) 2024-09-10T23:38:33.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:33 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:33.142+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:33.625 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 10 23:38:33 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-5[46899]: 2024-09-10T23:38:33.344+0000 7fd4c1200640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:58.857261+0000 front 2024-09-10T23:37:58.857344+0000 (oldest deadline 2024-09-10T23:38:24.057490+0000) 2024-09-10T23:38:33.886 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:33 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:33.625+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:33.886 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:33 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:33.625+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.187474+0000 front 2024-09-10T23:38:09.187495+0000 (oldest deadline 2024-09-10T23:38:33.287360+0000) 2024-09-10T23:38:33.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:33 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:33.684+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:33.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:33 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:33.684+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:34.156 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:34 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:34.099+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:34.157 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:33 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:33.855+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:59.815484+0000 front 2024-09-10T23:37:59.815632+0000 (oldest deadline 2024-09-10T23:38:23.915648+0000) 2024-09-10T23:38:34.157 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:33 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:33.855+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:08.016952+0000 front 2024-09-10T23:38:08.016988+0000 (oldest deadline 2024-09-10T23:38:32.117147+0000) 2024-09-10T23:38:34.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:33 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:33.886+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:34.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:33 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:33.886+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:38:34.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:33 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:33.886+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:38:34.470 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:34 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:34.003+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.541646+0000 front 2024-09-10T23:38:01.541449+0000 (oldest deadline 2024-09-10T23:38:23.241435+0000) 2024-09-10T23:38:34.470 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:34 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:34.003+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.643199+0000 front 2024-09-10T23:38:09.643267+0000 (oldest deadline 2024-09-10T23:38:33.143378+0000) 2024-09-10T23:38:34.592 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 10 23:38:34 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-5[46899]: 2024-09-10T23:38:34.336+0000 7fd4c1200640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:58.857261+0000 front 2024-09-10T23:37:58.857344+0000 (oldest deadline 2024-09-10T23:38:24.057490+0000) 2024-09-10T23:38:34.592 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 10 23:38:34 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-5[46899]: 2024-09-10T23:38:34.336+0000 7fd4c1200640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:11.059202+0000 front 2024-09-10T23:38:11.059267+0000 (oldest deadline 2024-09-10T23:38:33.359334+0000) 2024-09-10T23:38:34.935 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:34 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:34.591+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:34.935 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:34 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:34.591+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.187474+0000 front 2024-09-10T23:38:09.187495+0000 (oldest deadline 2024-09-10T23:38:33.287360+0000) 2024-09-10T23:38:34.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:34 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:34.637+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:34.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:34 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:34.637+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:35.097 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:34 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:34.841+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:59.815484+0000 front 2024-09-10T23:37:59.815632+0000 (oldest deadline 2024-09-10T23:38:23.915648+0000) 2024-09-10T23:38:35.097 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:34 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:34.841+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:08.016952+0000 front 2024-09-10T23:38:08.016988+0000 (oldest deadline 2024-09-10T23:38:32.117147+0000) 2024-09-10T23:38:35.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:34 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:34.934+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:35.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:34 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:34.934+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:38:35.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:34 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:34.934+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:38:35.470 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:35 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:35.015+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.541646+0000 front 2024-09-10T23:38:01.541449+0000 (oldest deadline 2024-09-10T23:38:23.241435+0000) 2024-09-10T23:38:35.471 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:35 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:35.015+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.643199+0000 front 2024-09-10T23:38:09.643267+0000 (oldest deadline 2024-09-10T23:38:33.143378+0000) 2024-09-10T23:38:35.543 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:35 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:35.542+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:35.543 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:35 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:35.542+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.187474+0000 front 2024-09-10T23:38:09.187495+0000 (oldest deadline 2024-09-10T23:38:33.287360+0000) 2024-09-10T23:38:35.543 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 10 23:38:35 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-5[46899]: 2024-09-10T23:38:35.292+0000 7fd4c1200640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:58.857261+0000 front 2024-09-10T23:37:58.857344+0000 (oldest deadline 2024-09-10T23:38:24.057490+0000) 2024-09-10T23:38:35.544 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 10 23:38:35 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-5[46899]: 2024-09-10T23:38:35.292+0000 7fd4c1200640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:11.059202+0000 front 2024-09-10T23:38:11.059267+0000 (oldest deadline 2024-09-10T23:38:33.359334+0000) 2024-09-10T23:38:35.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:35 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:35.102+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:35.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:35 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:35.102+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:38:35.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:35 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:35.626+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:35.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:35 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:35.626+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:36.097 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:35 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:35.843+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:59.815484+0000 front 2024-09-10T23:37:59.815632+0000 (oldest deadline 2024-09-10T23:38:23.915648+0000) 2024-09-10T23:38:36.097 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:35 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:35.843+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:08.016952+0000 front 2024-09-10T23:38:08.016988+0000 (oldest deadline 2024-09-10T23:38:32.117147+0000) 2024-09-10T23:38:36.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:35 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:35.929+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:36.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:35 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:35.929+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:38:36.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:35 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:35.929+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:38:36.471 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:36 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:36.047+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.541646+0000 front 2024-09-10T23:38:01.541449+0000 (oldest deadline 2024-09-10T23:38:23.241435+0000) 2024-09-10T23:38:36.471 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:36 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:36.047+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.643199+0000 front 2024-09-10T23:38:09.643267+0000 (oldest deadline 2024-09-10T23:38:33.143378+0000) 2024-09-10T23:38:36.553 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 10 23:38:36 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-5[46899]: 2024-09-10T23:38:36.294+0000 7fd4c1200640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:58.857261+0000 front 2024-09-10T23:37:58.857344+0000 (oldest deadline 2024-09-10T23:38:24.057490+0000) 2024-09-10T23:38:36.553 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 10 23:38:36 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-5[46899]: 2024-09-10T23:38:36.294+0000 7fd4c1200640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:11.059202+0000 front 2024-09-10T23:38:11.059267+0000 (oldest deadline 2024-09-10T23:38:33.359334+0000) 2024-09-10T23:38:36.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:36 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:36.145+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:36.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:36 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:36.145+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:38:36.918 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:36 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:36.552+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:36.918 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:36 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:36.552+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.187474+0000 front 2024-09-10T23:38:09.187495+0000 (oldest deadline 2024-09-10T23:38:33.287360+0000) 2024-09-10T23:38:36.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:36 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:36.618+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:36.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:36 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:36.618+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:36.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:36 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:36.618+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.666181+0000 front 2024-09-10T23:38:10.666203+0000 (oldest deadline 2024-09-10T23:38:36.566198+0000) 2024-09-10T23:38:37.097 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:36 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:36.826+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:59.815484+0000 front 2024-09-10T23:37:59.815632+0000 (oldest deadline 2024-09-10T23:38:23.915648+0000) 2024-09-10T23:38:37.097 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:36 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:36.826+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:08.016952+0000 front 2024-09-10T23:38:08.016988+0000 (oldest deadline 2024-09-10T23:38:32.117147+0000) 2024-09-10T23:38:37.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:36 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:36.917+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:37.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:36 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:36.917+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:38:37.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:36 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:36.917+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:38:37.470 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:37 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:37.062+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.541646+0000 front 2024-09-10T23:38:01.541449+0000 (oldest deadline 2024-09-10T23:38:23.241435+0000) 2024-09-10T23:38:37.470 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:37 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:37.062+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.643199+0000 front 2024-09-10T23:38:09.643267+0000 (oldest deadline 2024-09-10T23:38:33.143378+0000) 2024-09-10T23:38:37.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:37 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:37.108+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:37.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:37 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:37.108+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:38:37.798 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 10 23:38:37 smithi194 podman[71152]: 2024-09-10 23:38:37.46274781 +0000 UTC m=+5.703131126 container died 718b563aedee0f7e8fa423e56fb7dd665a452399be2fb0b98c54cb5020e94b61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-10T23:38:37.798 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:37 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:37.515+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:37.798 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:37 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:37.515+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.187474+0000 front 2024-09-10T23:38:09.187495+0000 (oldest deadline 2024-09-10T23:38:33.287360+0000) 2024-09-10T23:38:37.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:37 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:37.593+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:37.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:37 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:37.593+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:37.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:37 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:37.593+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.666181+0000 front 2024-09-10T23:38:10.666203+0000 (oldest deadline 2024-09-10T23:38:36.566198+0000) 2024-09-10T23:38:38.085 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:37 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:37.816+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:59.815484+0000 front 2024-09-10T23:37:59.815632+0000 (oldest deadline 2024-09-10T23:38:23.915648+0000) 2024-09-10T23:38:38.085 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:37 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:37.816+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:08.016952+0000 front 2024-09-10T23:38:08.016988+0000 (oldest deadline 2024-09-10T23:38:32.117147+0000) 2024-09-10T23:38:38.123 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 10 23:38:37 smithi194 podman[71152]: 2024-09-10 23:38:37.937375213 +0000 UTC m=+6.177758528 container cleanup 718b563aedee0f7e8fa423e56fb7dd665a452399be2fb0b98c54cb5020e94b61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0) 2024-09-10T23:38:38.123 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 10 23:38:37 smithi194 bash[71152]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-5 2024-09-10T23:38:38.123 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:37 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:37.901+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:38.123 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:37 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:37.901+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:38:38.124 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:37 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:37.901+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:38:38.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:38 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:38.083+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:38.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:38 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:38.083+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:38:38.447 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 10 23:38:38 smithi194 podman[71171]: 2024-09-10 23:38:38.122292762 +0000 UTC m=+0.648673638 container remove 718b563aedee0f7e8fa423e56fb7dd665a452399be2fb0b98c54cb5020e94b61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:38:38.470 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:38 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:38.061+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.541646+0000 front 2024-09-10T23:38:01.541449+0000 (oldest deadline 2024-09-10T23:38:23.241435+0000) 2024-09-10T23:38:38.470 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:38 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:38.061+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.643199+0000 front 2024-09-10T23:38:09.643267+0000 (oldest deadline 2024-09-10T23:38:33.143378+0000) 2024-09-10T23:38:38.742 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 10 23:38:38 smithi194 podman[71257]: 2024-09-10 23:38:38.59586253 +0000 UTC m=+0.026347967 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:38:38.743 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:38 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:38.478+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:38.743 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:38 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:38.478+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.187474+0000 front 2024-09-10T23:38:09.187495+0000 (oldest deadline 2024-09-10T23:38:33.287360+0000) 2024-09-10T23:38:38.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:38 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:38.630+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:38.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:38 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:38.630+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:38.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:38 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:38.630+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.666181+0000 front 2024-09-10T23:38:10.666203+0000 (oldest deadline 2024-09-10T23:38:36.566198+0000) 2024-09-10T23:38:39.084 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 10 23:38:38 smithi194 podman[71257]: 2024-09-10 23:38:38.742517785 +0000 UTC m=+0.173003218 container create 55c7575300b044c6025d36483e938eefddc6b00286e2c1e4260ef5fad5cfe6de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-10T23:38:39.085 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 10 23:38:38 smithi194 podman[71257]: 2024-09-10 23:38:38.984747611 +0000 UTC m=+0.415233048 container init 55c7575300b044c6025d36483e938eefddc6b00286e2c1e4260ef5fad5cfe6de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-10T23:38:39.085 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 10 23:38:38 smithi194 podman[71257]: 2024-09-10 23:38:38.99177969 +0000 UTC m=+0.422265134 container start 55c7575300b044c6025d36483e938eefddc6b00286e2c1e4260ef5fad5cfe6de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:38:39.085 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:38 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:38.906+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:39.085 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:38 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:38.906+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:38:39.085 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:38 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:38.906+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:38:39.097 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:38 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:38.816+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:59.815484+0000 front 2024-09-10T23:37:59.815632+0000 (oldest deadline 2024-09-10T23:38:23.915648+0000) 2024-09-10T23:38:39.097 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:38 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:38.816+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:08.016952+0000 front 2024-09-10T23:38:08.016988+0000 (oldest deadline 2024-09-10T23:38:32.117147+0000) 2024-09-10T23:38:39.448 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 10 23:38:39 smithi194 podman[71257]: 2024-09-10 23:38:39.084175161 +0000 UTC m=+0.514660601 container attach 55c7575300b044c6025d36483e938eefddc6b00286e2c1e4260ef5fad5cfe6de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-10T23:38:39.448 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 10 23:38:39 smithi194 podman[71257]: 2024-09-10 23:38:39.253805299 +0000 UTC m=+0.684290736 container died 55c7575300b044c6025d36483e938eefddc6b00286e2c1e4260ef5fad5cfe6de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-5-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-10T23:38:39.455 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:39 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:39.015+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.541646+0000 front 2024-09-10T23:38:01.541449+0000 (oldest deadline 2024-09-10T23:38:23.241435+0000) 2024-09-10T23:38:39.455 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:39 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:39.015+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.643199+0000 front 2024-09-10T23:38:09.643267+0000 (oldest deadline 2024-09-10T23:38:33.143378+0000) 2024-09-10T23:38:39.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:39 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:39.112+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:39.598 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:39 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:39.112+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:38:39.720 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:39 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:39.590+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:39.721 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:39 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:39.590+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:39.721 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:39 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:39.590+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.666181+0000 front 2024-09-10T23:38:10.666203+0000 (oldest deadline 2024-09-10T23:38:36.566198+0000) 2024-09-10T23:38:39.747 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:39 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:39.446+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:39.747 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:39 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:39.446+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.187474+0000 front 2024-09-10T23:38:09.187495+0000 (oldest deadline 2024-09-10T23:38:33.287360+0000) 2024-09-10T23:38:39.902 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.5.service' 2024-09-10T23:38:39.976 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:38:39.977 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-10T23:38:39.977 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-10T23:38:39.977 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.6 2024-09-10T23:38:40.111 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:39 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:39.857+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:59.815484+0000 front 2024-09-10T23:37:59.815632+0000 (oldest deadline 2024-09-10T23:38:23.915648+0000) 2024-09-10T23:38:40.112 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:39 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:39.857+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:08.016952+0000 front 2024-09-10T23:38:08.016988+0000 (oldest deadline 2024-09-10T23:38:32.117147+0000) 2024-09-10T23:38:40.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:39 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:39.867+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:40.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:39 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:39.867+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:38:40.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:39 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:39.867+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:38:40.415 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:40 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:40.038+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.541646+0000 front 2024-09-10T23:38:01.541449+0000 (oldest deadline 2024-09-10T23:38:23.241435+0000) 2024-09-10T23:38:40.416 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:40 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:40.038+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.643199+0000 front 2024-09-10T23:38:09.643267+0000 (oldest deadline 2024-09-10T23:38:33.143378+0000) 2024-09-10T23:38:40.416 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:40 smithi003 systemd[1]: Stopping Ceph osd.6 for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:38:40.416 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:40 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:40.413+0000 7f68dae00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:38:40.416 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:40 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:40.413+0000 7f68dae00640 -1 osd.6 104 *** Got signal Terminated *** 2024-09-10T23:38:40.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:40 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:40.110+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:40.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:40 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:40.110+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:38:40.697 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:40 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:40.439+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:40.698 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:40 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:40.439+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.187474+0000 front 2024-09-10T23:38:09.187495+0000 (oldest deadline 2024-09-10T23:38:33.287360+0000) 2024-09-10T23:38:40.720 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:40 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:40.413+0000 7f68dae00640 -1 osd.6 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:38:40.720 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:40 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:40.596+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:40.721 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:40 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:40.596+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:40.721 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:40 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:40.596+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.666181+0000 front 2024-09-10T23:38:10.666203+0000 (oldest deadline 2024-09-10T23:38:36.566198+0000) 2024-09-10T23:38:41.097 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:40 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:40.813+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:59.815484+0000 front 2024-09-10T23:37:59.815632+0000 (oldest deadline 2024-09-10T23:38:23.915648+0000) 2024-09-10T23:38:41.098 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:40 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:40.813+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:08.016952+0000 front 2024-09-10T23:38:08.016988+0000 (oldest deadline 2024-09-10T23:38:32.117147+0000) 2024-09-10T23:38:41.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:40 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:40.846+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:41.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:40 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:40.846+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:38:41.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:40 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:40.846+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:38:41.470 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:41 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:41.004+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.541646+0000 front 2024-09-10T23:38:01.541449+0000 (oldest deadline 2024-09-10T23:38:23.241435+0000) 2024-09-10T23:38:41.470 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:41 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:41.004+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.643199+0000 front 2024-09-10T23:38:09.643267+0000 (oldest deadline 2024-09-10T23:38:33.143378+0000) 2024-09-10T23:38:41.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:41 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:41.146+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:41.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:41 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:41.146+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:38:41.892 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:41 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:41.486+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:41.892 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:41 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:41.486+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.187474+0000 front 2024-09-10T23:38:09.187495+0000 (oldest deadline 2024-09-10T23:38:33.287360+0000) 2024-09-10T23:38:41.892 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:41 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:41.486+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:15.489193+0000 front 2024-09-10T23:38:15.489211+0000 (oldest deadline 2024-09-10T23:38:40.788883+0000) 2024-09-10T23:38:41.963 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:41 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:41.628+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:41.963 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:41 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:41.628+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:41.963 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:41 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:41.628+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.666181+0000 front 2024-09-10T23:38:10.666203+0000 (oldest deadline 2024-09-10T23:38:36.566198+0000) 2024-09-10T23:38:42.097 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:41 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:41.843+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:59.815484+0000 front 2024-09-10T23:37:59.815632+0000 (oldest deadline 2024-09-10T23:38:23.915648+0000) 2024-09-10T23:38:42.097 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:41 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:41.843+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:08.016952+0000 front 2024-09-10T23:38:08.016988+0000 (oldest deadline 2024-09-10T23:38:32.117147+0000) 2024-09-10T23:38:42.098 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:41 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:41.843+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:15.618433+0000 front 2024-09-10T23:38:15.618477+0000 (oldest deadline 2024-09-10T23:38:41.518141+0000) 2024-09-10T23:38:42.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:41 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:41.890+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:42.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:41 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:41.890+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:38:42.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:41 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:41.890+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:38:42.220 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:41 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:41.962+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.541646+0000 front 2024-09-10T23:38:01.541449+0000 (oldest deadline 2024-09-10T23:38:23.241435+0000) 2024-09-10T23:38:42.220 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:41 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:41.962+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.643199+0000 front 2024-09-10T23:38:09.643267+0000 (oldest deadline 2024-09-10T23:38:33.143378+0000) 2024-09-10T23:38:42.220 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:41 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:41.962+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:16.044496+0000 front 2024-09-10T23:38:16.044544+0000 (oldest deadline 2024-09-10T23:38:41.245381+0000) 2024-09-10T23:38:42.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:42 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:42.109+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:42.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:42 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:42.109+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:38:42.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:42 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:42.109+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:38:42.874 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:42 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:42.533+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:42.875 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:42 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:42.533+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.187474+0000 front 2024-09-10T23:38:09.187495+0000 (oldest deadline 2024-09-10T23:38:33.287360+0000) 2024-09-10T23:38:42.875 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:42 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:42.533+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:15.489193+0000 front 2024-09-10T23:38:15.489211+0000 (oldest deadline 2024-09-10T23:38:40.788883+0000) 2024-09-10T23:38:42.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:42 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:42.579+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:42.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:42 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:42.579+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:42.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:42 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:42.579+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.666181+0000 front 2024-09-10T23:38:10.666203+0000 (oldest deadline 2024-09-10T23:38:36.566198+0000) 2024-09-10T23:38:42.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:42 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:42.579+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:16.566525+0000 front 2024-09-10T23:38:16.566671+0000 (oldest deadline 2024-09-10T23:38:41.866701+0000) 2024-09-10T23:38:43.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:42 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:42.873+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:43.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:42 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:42.873+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:38:43.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:42 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:42.873+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:38:43.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:43 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:43.089+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:43.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:43 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:43.089+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:38:43.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:43 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:43.089+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:38:43.348 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:42 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:42.855+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:59.815484+0000 front 2024-09-10T23:37:59.815632+0000 (oldest deadline 2024-09-10T23:38:23.915648+0000) 2024-09-10T23:38:43.348 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:42 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:42.855+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:08.016952+0000 front 2024-09-10T23:38:08.016988+0000 (oldest deadline 2024-09-10T23:38:32.117147+0000) 2024-09-10T23:38:43.348 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:42 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:42.855+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:15.618433+0000 front 2024-09-10T23:38:15.618477+0000 (oldest deadline 2024-09-10T23:38:41.518141+0000) 2024-09-10T23:38:43.470 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:42 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:42.973+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.541646+0000 front 2024-09-10T23:38:01.541449+0000 (oldest deadline 2024-09-10T23:38:23.241435+0000) 2024-09-10T23:38:43.470 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:42 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:42.973+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.643199+0000 front 2024-09-10T23:38:09.643267+0000 (oldest deadline 2024-09-10T23:38:33.143378+0000) 2024-09-10T23:38:43.470 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:42 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:42.973+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:16.044496+0000 front 2024-09-10T23:38:16.044544+0000 (oldest deadline 2024-09-10T23:38:41.245381+0000) 2024-09-10T23:38:43.861 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:43 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:43.575+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:43.861 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:43 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:43.575+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.187474+0000 front 2024-09-10T23:38:09.187495+0000 (oldest deadline 2024-09-10T23:38:33.287360+0000) 2024-09-10T23:38:43.861 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:43 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:43.575+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:15.489193+0000 front 2024-09-10T23:38:15.489211+0000 (oldest deadline 2024-09-10T23:38:40.788883+0000) 2024-09-10T23:38:43.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:43 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:43.623+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:43.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:43 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:43.623+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:43.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:43 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:43.623+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.666181+0000 front 2024-09-10T23:38:10.666203+0000 (oldest deadline 2024-09-10T23:38:36.566198+0000) 2024-09-10T23:38:43.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:43 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:43.623+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:16.566525+0000 front 2024-09-10T23:38:16.566671+0000 (oldest deadline 2024-09-10T23:38:41.866701+0000) 2024-09-10T23:38:44.097 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:43 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:43.832+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:59.815484+0000 front 2024-09-10T23:37:59.815632+0000 (oldest deadline 2024-09-10T23:38:23.915648+0000) 2024-09-10T23:38:44.097 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:43 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:43.832+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:08.016952+0000 front 2024-09-10T23:38:08.016988+0000 (oldest deadline 2024-09-10T23:38:32.117147+0000) 2024-09-10T23:38:44.097 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:43 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:43.832+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:15.618433+0000 front 2024-09-10T23:38:15.618477+0000 (oldest deadline 2024-09-10T23:38:41.518141+0000) 2024-09-10T23:38:44.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:43 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:43.859+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:44.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:43 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:43.859+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:38:44.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:43 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:43.859+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:38:44.470 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:44 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:44.006+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.541646+0000 front 2024-09-10T23:38:01.541449+0000 (oldest deadline 2024-09-10T23:38:23.241435+0000) 2024-09-10T23:38:44.470 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:44 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:44.006+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.643199+0000 front 2024-09-10T23:38:09.643267+0000 (oldest deadline 2024-09-10T23:38:33.143378+0000) 2024-09-10T23:38:44.471 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:44 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:44.006+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:16.044496+0000 front 2024-09-10T23:38:16.044544+0000 (oldest deadline 2024-09-10T23:38:41.245381+0000) 2024-09-10T23:38:44.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:44 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:44.104+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:44.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:44 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:44.104+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:38:44.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:44 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:44.104+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:38:44.905 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:44 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:44.623+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:44.906 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:44 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:44.623+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.187474+0000 front 2024-09-10T23:38:09.187495+0000 (oldest deadline 2024-09-10T23:38:33.287360+0000) 2024-09-10T23:38:44.906 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:44 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:44.623+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:15.489193+0000 front 2024-09-10T23:38:15.489211+0000 (oldest deadline 2024-09-10T23:38:40.788883+0000) 2024-09-10T23:38:44.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:44 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:44.612+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:44.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:44 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:44.612+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:44.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:44 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:44.612+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.666181+0000 front 2024-09-10T23:38:10.666203+0000 (oldest deadline 2024-09-10T23:38:36.566198+0000) 2024-09-10T23:38:44.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:44 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:44.612+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:16.566525+0000 front 2024-09-10T23:38:16.566671+0000 (oldest deadline 2024-09-10T23:38:41.866701+0000) 2024-09-10T23:38:45.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:44 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:44.904+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:45.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:44 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:44.904+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:38:45.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:44 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:44.904+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:38:45.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:45 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:45.116+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:45.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:45 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:45.116+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:38:45.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:45 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:45.116+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:38:45.348 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:44 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:44.874+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:59.815484+0000 front 2024-09-10T23:37:59.815632+0000 (oldest deadline 2024-09-10T23:38:23.915648+0000) 2024-09-10T23:38:45.348 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:44 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:44.874+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:08.016952+0000 front 2024-09-10T23:38:08.016988+0000 (oldest deadline 2024-09-10T23:38:32.117147+0000) 2024-09-10T23:38:45.348 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:44 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:44.874+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:15.618433+0000 front 2024-09-10T23:38:15.618477+0000 (oldest deadline 2024-09-10T23:38:41.518141+0000) 2024-09-10T23:38:45.470 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:44 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:44.985+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.541646+0000 front 2024-09-10T23:38:01.541449+0000 (oldest deadline 2024-09-10T23:38:23.241435+0000) 2024-09-10T23:38:45.471 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:44 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:44.985+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.643199+0000 front 2024-09-10T23:38:09.643267+0000 (oldest deadline 2024-09-10T23:38:33.143378+0000) 2024-09-10T23:38:45.471 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:44 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6[62561]: 2024-09-10T23:38:44.985+0000 7f68d6800640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:16.044496+0000 front 2024-09-10T23:38:16.044544+0000 (oldest deadline 2024-09-10T23:38:41.245381+0000) 2024-09-10T23:38:45.871 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:45 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:45.601+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:45.871 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:45 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:45.601+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:45.871 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:45 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:45.601+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.666181+0000 front 2024-09-10T23:38:10.666203+0000 (oldest deadline 2024-09-10T23:38:36.566198+0000) 2024-09-10T23:38:45.872 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:45 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:45.601+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:16.566525+0000 front 2024-09-10T23:38:16.566671+0000 (oldest deadline 2024-09-10T23:38:41.866701+0000) 2024-09-10T23:38:45.888 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:45 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:45.581+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:45.889 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:45 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:45.581+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.187474+0000 front 2024-09-10T23:38:09.187495+0000 (oldest deadline 2024-09-10T23:38:33.287360+0000) 2024-09-10T23:38:45.889 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:45 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:45.581+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:15.489193+0000 front 2024-09-10T23:38:15.489211+0000 (oldest deadline 2024-09-10T23:38:40.788883+0000) 2024-09-10T23:38:46.124 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:45 smithi003 podman[97731]: 2024-09-10 23:38:45.871203657 +0000 UTC m=+5.593877617 container died 447dcbe605e2a552e3fb2ed8f1b56ca26bf18d1658cc2b0bf2539c5d4ab875fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-10T23:38:46.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:45 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:45.887+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:46.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:45 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:45.887+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:38:46.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:45 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:45.887+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:38:46.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:46 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:46.128+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:46.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:46 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:46.128+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:38:46.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:46 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:46.128+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:38:46.348 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:45 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:45.905+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:59.815484+0000 front 2024-09-10T23:37:59.815632+0000 (oldest deadline 2024-09-10T23:38:23.915648+0000) 2024-09-10T23:38:46.348 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:45 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:45.905+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:08.016952+0000 front 2024-09-10T23:38:08.016988+0000 (oldest deadline 2024-09-10T23:38:32.117147+0000) 2024-09-10T23:38:46.348 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:45 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:45.905+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:15.618433+0000 front 2024-09-10T23:38:15.618477+0000 (oldest deadline 2024-09-10T23:38:41.518141+0000) 2024-09-10T23:38:46.429 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:46 smithi003 podman[97731]: 2024-09-10 23:38:46.202626707 +0000 UTC m=+5.925300671 container cleanup 447dcbe605e2a552e3fb2ed8f1b56ca26bf18d1658cc2b0bf2539c5d4ab875fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-10T23:38:46.429 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:46 smithi003 bash[97731]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6 2024-09-10T23:38:46.720 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:46 smithi003 podman[97750]: 2024-09-10 23:38:46.428633161 +0000 UTC m=+0.550388247 container remove 447dcbe605e2a552e3fb2ed8f1b56ca26bf18d1658cc2b0bf2539c5d4ab875fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-10T23:38:46.721 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:46 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:46.577+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:46.721 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:46 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:46.577+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:46.721 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:46 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:46.577+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.666181+0000 front 2024-09-10T23:38:10.666203+0000 (oldest deadline 2024-09-10T23:38:36.566198+0000) 2024-09-10T23:38:46.721 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:46 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:46.577+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:16.566525+0000 front 2024-09-10T23:38:16.566671+0000 (oldest deadline 2024-09-10T23:38:41.866701+0000) 2024-09-10T23:38:46.861 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:46 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:46.575+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:46.861 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:46 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:46.575+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.187474+0000 front 2024-09-10T23:38:09.187495+0000 (oldest deadline 2024-09-10T23:38:33.287360+0000) 2024-09-10T23:38:46.861 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:46 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:46.575+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:15.489193+0000 front 2024-09-10T23:38:15.489211+0000 (oldest deadline 2024-09-10T23:38:40.788883+0000) 2024-09-10T23:38:47.113 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:46 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:46.856+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:59.815484+0000 front 2024-09-10T23:37:59.815632+0000 (oldest deadline 2024-09-10T23:38:23.915648+0000) 2024-09-10T23:38:47.113 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:46 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:46.856+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:08.016952+0000 front 2024-09-10T23:38:08.016988+0000 (oldest deadline 2024-09-10T23:38:32.117147+0000) 2024-09-10T23:38:47.113 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:46 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:46.856+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:15.618433+0000 front 2024-09-10T23:38:15.618477+0000 (oldest deadline 2024-09-10T23:38:41.518141+0000) 2024-09-10T23:38:47.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:46 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:46.859+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:47.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:46 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:46.859+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:38:47.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:46 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:46.859+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:38:47.224 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:46 smithi003 podman[97838]: 2024-09-10 23:38:46.874764944 +0000 UTC m=+0.027764560 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:38:47.224 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:47 smithi003 podman[97838]: 2024-09-10 23:38:47.004503768 +0000 UTC m=+0.157503361 container create a613b5493003605e30324640f3b3aa4e2081a9ea920a1968dbdee106fdfaf7c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-10T23:38:47.224 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:47 smithi003 podman[97838]: 2024-09-10 23:38:47.223695577 +0000 UTC m=+0.376695183 container init a613b5493003605e30324640f3b3aa4e2081a9ea920a1968dbdee106fdfaf7c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-10T23:38:47.494 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:47 smithi003 podman[97838]: 2024-09-10 23:38:47.230541659 +0000 UTC m=+0.383541253 container start a613b5493003605e30324640f3b3aa4e2081a9ea920a1968dbdee106fdfaf7c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-10T23:38:47.494 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:47 smithi003 podman[97838]: 2024-09-10 23:38:47.298307538 +0000 UTC m=+0.451307133 container attach a613b5493003605e30324640f3b3aa4e2081a9ea920a1968dbdee106fdfaf7c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True) 2024-09-10T23:38:47.494 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 10 23:38:47 smithi003 podman[97838]: 2024-09-10 23:38:47.4938839 +0000 UTC m=+0.646883502 container died a613b5493003605e30324640f3b3aa4e2081a9ea920a1968dbdee106fdfaf7c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-6-deactivate, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-10T23:38:47.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:47 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:47.111+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:47.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:47 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:47.111+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:38:47.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:47 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:47.111+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:38:47.818 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:47 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:47.609+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:47.818 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:47 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:47.609+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:47.819 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:47 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:47.609+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.666181+0000 front 2024-09-10T23:38:10.666203+0000 (oldest deadline 2024-09-10T23:38:36.566198+0000) 2024-09-10T23:38:47.819 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:47 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:47.609+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:16.566525+0000 front 2024-09-10T23:38:16.566671+0000 (oldest deadline 2024-09-10T23:38:41.866701+0000) 2024-09-10T23:38:47.863 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:47 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:47.531+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:47.863 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:47 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:47.531+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.187474+0000 front 2024-09-10T23:38:09.187495+0000 (oldest deadline 2024-09-10T23:38:33.287360+0000) 2024-09-10T23:38:47.863 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:47 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:47.531+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:15.489193+0000 front 2024-09-10T23:38:15.489211+0000 (oldest deadline 2024-09-10T23:38:40.788883+0000) 2024-09-10T23:38:48.097 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:47 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:47.825+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:59.815484+0000 front 2024-09-10T23:37:59.815632+0000 (oldest deadline 2024-09-10T23:38:23.915648+0000) 2024-09-10T23:38:48.097 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:47 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:47.825+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:08.016952+0000 front 2024-09-10T23:38:08.016988+0000 (oldest deadline 2024-09-10T23:38:32.117147+0000) 2024-09-10T23:38:48.097 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:47 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:47.825+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:15.618433+0000 front 2024-09-10T23:38:15.618477+0000 (oldest deadline 2024-09-10T23:38:41.518141+0000) 2024-09-10T23:38:48.164 DEBUG:teuthology.orchestra.run.smithi003:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.6.service' 2024-09-10T23:38:48.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:47 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:47.861+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:48.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:47 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:47.861+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:38:48.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:47 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:47.861+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:38:48.239 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:38:48.239 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-10T23:38:48.239 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-10T23:38:48.240 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.7 2024-09-10T23:38:48.598 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:48 smithi038 systemd[1]: Stopping Ceph osd.7 for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:38:48.598 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:48 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:48.124+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:48.598 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:48 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:48.124+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:38:48.598 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:48 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:48.124+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:38:48.863 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:48 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:48.546+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:48.863 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:48 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:48.546+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.187474+0000 front 2024-09-10T23:38:09.187495+0000 (oldest deadline 2024-09-10T23:38:33.287360+0000) 2024-09-10T23:38:48.864 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:48 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:48.546+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:15.489193+0000 front 2024-09-10T23:38:15.489211+0000 (oldest deadline 2024-09-10T23:38:40.788883+0000) 2024-09-10T23:38:48.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:48 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:48.601+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:48.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:48 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:48.601+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:48.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:48 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:48.601+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.666181+0000 front 2024-09-10T23:38:10.666203+0000 (oldest deadline 2024-09-10T23:38:36.566198+0000) 2024-09-10T23:38:48.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:48 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:48.601+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:16.566525+0000 front 2024-09-10T23:38:16.566671+0000 (oldest deadline 2024-09-10T23:38:41.866701+0000) 2024-09-10T23:38:49.097 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:48 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:48.662+0000 7fb3ee400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:38:49.098 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:48 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:48.662+0000 7fb3ee400640 -1 osd.7 104 *** Got signal Terminated *** 2024-09-10T23:38:49.098 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:48 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:48.662+0000 7fb3ee400640 -1 osd.7 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:38:49.098 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:48 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:48.778+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:59.815484+0000 front 2024-09-10T23:37:59.815632+0000 (oldest deadline 2024-09-10T23:38:23.915648+0000) 2024-09-10T23:38:49.098 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:48 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:48.778+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:08.016952+0000 front 2024-09-10T23:38:08.016988+0000 (oldest deadline 2024-09-10T23:38:32.117147+0000) 2024-09-10T23:38:49.098 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:48 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:48.778+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:15.618433+0000 front 2024-09-10T23:38:15.618477+0000 (oldest deadline 2024-09-10T23:38:41.518141+0000) 2024-09-10T23:38:49.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:48 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:48.861+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:49.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:48 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:48.862+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:38:49.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:48 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:48.862+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:38:49.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:49 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:49.106+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:49.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:49 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:49.106+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:38:49.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:49 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:49.106+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:38:49.824 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:49 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:49.517+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:49.824 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:49 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:49.517+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.187474+0000 front 2024-09-10T23:38:09.187495+0000 (oldest deadline 2024-09-10T23:38:33.287360+0000) 2024-09-10T23:38:49.824 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:49 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:49.517+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:15.489193+0000 front 2024-09-10T23:38:15.489211+0000 (oldest deadline 2024-09-10T23:38:40.788883+0000) 2024-09-10T23:38:49.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:49 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:49.641+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:49.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:49 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:49.641+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:49.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:49 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:49.641+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.666181+0000 front 2024-09-10T23:38:10.666203+0000 (oldest deadline 2024-09-10T23:38:36.566198+0000) 2024-09-10T23:38:49.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:49 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:49.641+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:16.566525+0000 front 2024-09-10T23:38:16.566671+0000 (oldest deadline 2024-09-10T23:38:41.866701+0000) 2024-09-10T23:38:50.097 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:49 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:49.742+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:59.815484+0000 front 2024-09-10T23:37:59.815632+0000 (oldest deadline 2024-09-10T23:38:23.915648+0000) 2024-09-10T23:38:50.097 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:49 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:49.742+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:08.016952+0000 front 2024-09-10T23:38:08.016988+0000 (oldest deadline 2024-09-10T23:38:32.117147+0000) 2024-09-10T23:38:50.098 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:49 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:49.742+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:15.618433+0000 front 2024-09-10T23:38:15.618477+0000 (oldest deadline 2024-09-10T23:38:41.518141+0000) 2024-09-10T23:38:50.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:49 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:49.823+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:50.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:49 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:49.823+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:38:50.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:49 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:49.823+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:38:50.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:50 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:50.104+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:50.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:50 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:50.104+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:38:50.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:50 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:50.104+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:38:50.868 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:50 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:50.561+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:50.868 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:50 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:50.561+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.187474+0000 front 2024-09-10T23:38:09.187495+0000 (oldest deadline 2024-09-10T23:38:33.287360+0000) 2024-09-10T23:38:50.868 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:50 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:50.561+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:15.489193+0000 front 2024-09-10T23:38:15.489211+0000 (oldest deadline 2024-09-10T23:38:40.788883+0000) 2024-09-10T23:38:50.868 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:50 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:50.561+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.090219+0000 front 2024-09-10T23:38:26.090294+0000 (oldest deadline 2024-09-10T23:38:49.589978+0000) 2024-09-10T23:38:50.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:50 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:50.615+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:50.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:50 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:50.615+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:50.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:50 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:50.615+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.666181+0000 front 2024-09-10T23:38:10.666203+0000 (oldest deadline 2024-09-10T23:38:36.566198+0000) 2024-09-10T23:38:50.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:50 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:50.615+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:16.566525+0000 front 2024-09-10T23:38:16.566671+0000 (oldest deadline 2024-09-10T23:38:41.866701+0000) 2024-09-10T23:38:51.097 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:50 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:50.781+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:59.815484+0000 front 2024-09-10T23:37:59.815632+0000 (oldest deadline 2024-09-10T23:38:23.915648+0000) 2024-09-10T23:38:51.098 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:50 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:50.781+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:08.016952+0000 front 2024-09-10T23:38:08.016988+0000 (oldest deadline 2024-09-10T23:38:32.117147+0000) 2024-09-10T23:38:51.098 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:50 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:50.781+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:15.618433+0000 front 2024-09-10T23:38:15.618477+0000 (oldest deadline 2024-09-10T23:38:41.518141+0000) 2024-09-10T23:38:51.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:50 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:50.866+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:51.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:50 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:50.866+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:38:51.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:50 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:50.866+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:38:51.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:51 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:51.097+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:51.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:51 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:51.097+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:38:51.598 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:51 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:51.097+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:38:51.598 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:51 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:51.097+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:25.384193+0000 front 2024-09-10T23:38:25.384222+0000 (oldest deadline 2024-09-10T23:38:50.684332+0000) 2024-09-10T23:38:51.885 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:51 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:51.520+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:51.886 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:51 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:51.520+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.187474+0000 front 2024-09-10T23:38:09.187495+0000 (oldest deadline 2024-09-10T23:38:33.287360+0000) 2024-09-10T23:38:51.886 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:51 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:51.520+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:15.489193+0000 front 2024-09-10T23:38:15.489211+0000 (oldest deadline 2024-09-10T23:38:40.788883+0000) 2024-09-10T23:38:51.886 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:51 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:51.520+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.090219+0000 front 2024-09-10T23:38:26.090294+0000 (oldest deadline 2024-09-10T23:38:49.589978+0000) 2024-09-10T23:38:51.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:51 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:51.623+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:51.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:51 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:51.623+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:51.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:51 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:51.623+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.666181+0000 front 2024-09-10T23:38:10.666203+0000 (oldest deadline 2024-09-10T23:38:36.566198+0000) 2024-09-10T23:38:51.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:51 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:51.623+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:16.566525+0000 front 2024-09-10T23:38:16.566671+0000 (oldest deadline 2024-09-10T23:38:41.866701+0000) 2024-09-10T23:38:51.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:51 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:51.623+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.968664+0000 front 2024-09-10T23:38:26.968691+0000 (oldest deadline 2024-09-10T23:38:51.068503+0000) 2024-09-10T23:38:52.072 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:51 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:51.748+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:59.815484+0000 front 2024-09-10T23:37:59.815632+0000 (oldest deadline 2024-09-10T23:38:23.915648+0000) 2024-09-10T23:38:52.072 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:51 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:51.748+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:08.016952+0000 front 2024-09-10T23:38:08.016988+0000 (oldest deadline 2024-09-10T23:38:32.117147+0000) 2024-09-10T23:38:52.072 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:51 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:51.748+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:15.618433+0000 front 2024-09-10T23:38:15.618477+0000 (oldest deadline 2024-09-10T23:38:41.518141+0000) 2024-09-10T23:38:52.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:51 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:51.883+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:52.274 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:51 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:51.883+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:38:52.274 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:51 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:51.883+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:38:52.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:52 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:52.070+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:52.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:52 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:52.070+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:38:52.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:52 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:52.070+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:38:52.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:52 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:52.070+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:25.384193+0000 front 2024-09-10T23:38:25.384222+0000 (oldest deadline 2024-09-10T23:38:50.684332+0000) 2024-09-10T23:38:52.838 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:52 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:52.541+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:52.839 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:52 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:52.541+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.187474+0000 front 2024-09-10T23:38:09.187495+0000 (oldest deadline 2024-09-10T23:38:33.287360+0000) 2024-09-10T23:38:52.839 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:52 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:52.541+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:15.489193+0000 front 2024-09-10T23:38:15.489211+0000 (oldest deadline 2024-09-10T23:38:40.788883+0000) 2024-09-10T23:38:52.839 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:52 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:52.541+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.090219+0000 front 2024-09-10T23:38:26.090294+0000 (oldest deadline 2024-09-10T23:38:49.589978+0000) 2024-09-10T23:38:52.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:52 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:52.667+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:52.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:52 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:52.667+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:52.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:52 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:52.667+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.666181+0000 front 2024-09-10T23:38:10.666203+0000 (oldest deadline 2024-09-10T23:38:36.566198+0000) 2024-09-10T23:38:52.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:52 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:52.667+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:16.566525+0000 front 2024-09-10T23:38:16.566671+0000 (oldest deadline 2024-09-10T23:38:41.866701+0000) 2024-09-10T23:38:52.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:52 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:52.667+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.968664+0000 front 2024-09-10T23:38:26.968691+0000 (oldest deadline 2024-09-10T23:38:51.068503+0000) 2024-09-10T23:38:53.097 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:52 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:52.788+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:37:59.815484+0000 front 2024-09-10T23:37:59.815632+0000 (oldest deadline 2024-09-10T23:38:23.915648+0000) 2024-09-10T23:38:53.097 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:52 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:52.788+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:08.016952+0000 front 2024-09-10T23:38:08.016988+0000 (oldest deadline 2024-09-10T23:38:32.117147+0000) 2024-09-10T23:38:53.098 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:52 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7[53532]: 2024-09-10T23:38:52.788+0000 7fb3e4e00640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:15.618433+0000 front 2024-09-10T23:38:15.618477+0000 (oldest deadline 2024-09-10T23:38:41.518141+0000) 2024-09-10T23:38:53.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:52 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:52.837+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:53.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:52 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:52.837+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:38:53.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:52 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:52.837+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:38:53.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:52 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:52.837+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:38:53.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:53 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:53.109+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:53.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:53 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:53.109+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:38:53.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:53 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:53.109+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:38:53.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:53 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:53.109+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:25.384193+0000 front 2024-09-10T23:38:25.384222+0000 (oldest deadline 2024-09-10T23:38:50.684332+0000) 2024-09-10T23:38:53.852 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:53 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:53.533+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:53.852 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:53 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:53.533+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.187474+0000 front 2024-09-10T23:38:09.187495+0000 (oldest deadline 2024-09-10T23:38:33.287360+0000) 2024-09-10T23:38:53.852 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:53 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:53.533+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:15.489193+0000 front 2024-09-10T23:38:15.489211+0000 (oldest deadline 2024-09-10T23:38:40.788883+0000) 2024-09-10T23:38:53.852 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:53 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:53.533+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.090219+0000 front 2024-09-10T23:38:26.090294+0000 (oldest deadline 2024-09-10T23:38:49.589978+0000) 2024-09-10T23:38:53.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:53 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:53.631+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:53.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:53 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:53.631+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:53.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:53 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:53.631+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.666181+0000 front 2024-09-10T23:38:10.666203+0000 (oldest deadline 2024-09-10T23:38:36.566198+0000) 2024-09-10T23:38:53.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:53 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:53.631+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:16.566525+0000 front 2024-09-10T23:38:16.566671+0000 (oldest deadline 2024-09-10T23:38:41.866701+0000) 2024-09-10T23:38:53.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:53 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:53.631+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.968664+0000 front 2024-09-10T23:38:26.968691+0000 (oldest deadline 2024-09-10T23:38:51.068503+0000) 2024-09-10T23:38:54.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:53 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:53.851+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:54.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:53 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:53.851+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:38:54.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:53 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:53.851+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:38:54.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:53 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:53.851+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:38:54.347 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:54 smithi038 podman[70813]: 2024-09-10 23:38:54.076595592 +0000 UTC m=+5.541979035 container died dd3f818c75b9f0e63af01ca7f63f19a51446a5d83e7cab912431e976e81744af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-10T23:38:54.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:54 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:54.085+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:54.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:54 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:54.085+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:38:54.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:54 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:54.085+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:38:54.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:54 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:54.085+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:25.384193+0000 front 2024-09-10T23:38:25.384222+0000 (oldest deadline 2024-09-10T23:38:50.684332+0000) 2024-09-10T23:38:54.753 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:54 smithi038 podman[70813]: 2024-09-10 23:38:54.468420406 +0000 UTC m=+5.933803847 container cleanup dd3f818c75b9f0e63af01ca7f63f19a51446a5d83e7cab912431e976e81744af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-10T23:38:54.753 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:54 smithi038 bash[70813]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7 2024-09-10T23:38:54.881 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:54 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:54.542+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:54.881 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:54 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:54.542+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.187474+0000 front 2024-09-10T23:38:09.187495+0000 (oldest deadline 2024-09-10T23:38:33.287360+0000) 2024-09-10T23:38:54.881 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:54 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:54.542+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:15.489193+0000 front 2024-09-10T23:38:15.489211+0000 (oldest deadline 2024-09-10T23:38:40.788883+0000) 2024-09-10T23:38:54.881 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:54 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:54.542+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.090219+0000 front 2024-09-10T23:38:26.090294+0000 (oldest deadline 2024-09-10T23:38:49.589978+0000) 2024-09-10T23:38:54.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:54 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:54.669+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:54.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:54 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:54.669+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:54.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:54 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:54.669+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.666181+0000 front 2024-09-10T23:38:10.666203+0000 (oldest deadline 2024-09-10T23:38:36.566198+0000) 2024-09-10T23:38:54.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:54 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:54.669+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:16.566525+0000 front 2024-09-10T23:38:16.566671+0000 (oldest deadline 2024-09-10T23:38:41.866701+0000) 2024-09-10T23:38:54.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:54 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:54.669+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.968664+0000 front 2024-09-10T23:38:26.968691+0000 (oldest deadline 2024-09-10T23:38:51.068503+0000) 2024-09-10T23:38:55.055 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:54 smithi038 podman[70830]: 2024-09-10 23:38:54.752818259 +0000 UTC m=+0.669077650 container remove dd3f818c75b9f0e63af01ca7f63f19a51446a5d83e7cab912431e976e81744af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:38:55.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:54 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:54.879+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:55.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:54 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:54.879+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:38:55.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:54 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:54.879+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:38:55.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:54 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:54.879+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:38:55.347 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:55 smithi038 podman[70917]: 2024-09-10 23:38:55.105969384 +0000 UTC m=+0.027830761 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:38:55.347 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:55 smithi038 podman[70917]: 2024-09-10 23:38:55.237584343 +0000 UTC m=+0.159445690 container create 910b506905071515734764d33e7937fe3a3c0792e08905ee444ab178bd7c18a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-10T23:38:55.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:55 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:55.054+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:55.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:55 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:55.054+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:38:55.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:55 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:55.054+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:38:55.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:55 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:55.054+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:25.384193+0000 front 2024-09-10T23:38:25.384222+0000 (oldest deadline 2024-09-10T23:38:50.684332+0000) 2024-09-10T23:38:55.742 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:55 smithi038 podman[70917]: 2024-09-10 23:38:55.456858252 +0000 UTC m=+0.378719629 container init 910b506905071515734764d33e7937fe3a3c0792e08905ee444ab178bd7c18a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True) 2024-09-10T23:38:55.743 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:55 smithi038 podman[70917]: 2024-09-10 23:38:55.463557237 +0000 UTC m=+0.385418588 container start 910b506905071515734764d33e7937fe3a3c0792e08905ee444ab178bd7c18a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7-deactivate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:38:55.743 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:55 smithi038 podman[70917]: 2024-09-10 23:38:55.581595084 +0000 UTC m=+0.503456440 container attach 910b506905071515734764d33e7937fe3a3c0792e08905ee444ab178bd7c18a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-10T23:38:55.837 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:55 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:55.544+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:55.837 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:55 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:55.544+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.187474+0000 front 2024-09-10T23:38:09.187495+0000 (oldest deadline 2024-09-10T23:38:33.287360+0000) 2024-09-10T23:38:55.837 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:55 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:55.544+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:15.489193+0000 front 2024-09-10T23:38:15.489211+0000 (oldest deadline 2024-09-10T23:38:40.788883+0000) 2024-09-10T23:38:55.837 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:55 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:55.544+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.090219+0000 front 2024-09-10T23:38:26.090294+0000 (oldest deadline 2024-09-10T23:38:49.589978+0000) 2024-09-10T23:38:55.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:55 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:55.632+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:55.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:55 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:55.632+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:55.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:55 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:55.632+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.666181+0000 front 2024-09-10T23:38:10.666203+0000 (oldest deadline 2024-09-10T23:38:36.566198+0000) 2024-09-10T23:38:55.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:55 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:55.632+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:16.566525+0000 front 2024-09-10T23:38:16.566671+0000 (oldest deadline 2024-09-10T23:38:41.866701+0000) 2024-09-10T23:38:55.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:55 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:55.632+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.968664+0000 front 2024-09-10T23:38:26.968691+0000 (oldest deadline 2024-09-10T23:38:51.068503+0000) 2024-09-10T23:38:56.097 INFO:journalctl@ceph.osd.7.smithi038.stdout:Sep 10 23:38:55 smithi038 podman[70940]: 2024-09-10 23:38:55.783657329 +0000 UTC m=+0.027653653 container died 910b506905071515734764d33e7937fe3a3c0792e08905ee444ab178bd7c18a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:38:56.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:55 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:55.835+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:56.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:55 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:55.835+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:38:56.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:55 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:55.835+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:38:56.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:55 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:55.835+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:38:56.393 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:56 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:56.096+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:56.394 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:56 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:56.096+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:38:56.394 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:56 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:56.096+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:38:56.394 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:56 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:56.096+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:25.384193+0000 front 2024-09-10T23:38:25.384222+0000 (oldest deadline 2024-09-10T23:38:50.684332+0000) 2024-09-10T23:38:56.421 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.7.service' 2024-09-10T23:38:56.497 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:38:56.497 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-10T23:38:56.497 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-10T23:38:56.498 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.8 2024-09-10T23:38:56.882 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:56 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:56.559+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:56.883 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:56 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:56.559+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.187474+0000 front 2024-09-10T23:38:09.187495+0000 (oldest deadline 2024-09-10T23:38:33.287360+0000) 2024-09-10T23:38:56.883 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:56 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:56.559+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:15.489193+0000 front 2024-09-10T23:38:15.489211+0000 (oldest deadline 2024-09-10T23:38:40.788883+0000) 2024-09-10T23:38:56.883 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:56 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:56.559+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.090219+0000 front 2024-09-10T23:38:26.090294+0000 (oldest deadline 2024-09-10T23:38:49.589978+0000) 2024-09-10T23:38:56.883 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:56 smithi194 systemd[1]: Stopping Ceph osd.8 for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:38:56.972 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:56 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:56.640+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:56.972 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:56 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:56.640+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:56.972 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:56 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:56.640+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.666181+0000 front 2024-09-10T23:38:10.666203+0000 (oldest deadline 2024-09-10T23:38:36.566198+0000) 2024-09-10T23:38:56.972 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:56 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:56.640+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:16.566525+0000 front 2024-09-10T23:38:16.566671+0000 (oldest deadline 2024-09-10T23:38:41.866701+0000) 2024-09-10T23:38:56.972 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:56 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:56.640+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.968664+0000 front 2024-09-10T23:38:26.968691+0000 (oldest deadline 2024-09-10T23:38:51.068503+0000) 2024-09-10T23:38:57.197 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:56 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:56.942+0000 7f04f9c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:38:57.197 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:56 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:56.942+0000 7f04f9c00640 -1 osd.8 104 *** Got signal Terminated *** 2024-09-10T23:38:57.197 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:56 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:56.942+0000 7f04f9c00640 -1 osd.8 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:38:57.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:56 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:56.881+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:57.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:56 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:56.881+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:38:57.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:56 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:56.881+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:38:57.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:56 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:56.881+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:38:57.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:57 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:57.054+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:57.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:57 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:57.054+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:38:57.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:57 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:57.054+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:38:57.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:57 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:57.054+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:25.384193+0000 front 2024-09-10T23:38:25.384222+0000 (oldest deadline 2024-09-10T23:38:50.684332+0000) 2024-09-10T23:38:57.855 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:57 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:57.576+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:57.855 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:57 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:57.576+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.187474+0000 front 2024-09-10T23:38:09.187495+0000 (oldest deadline 2024-09-10T23:38:33.287360+0000) 2024-09-10T23:38:57.856 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:57 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:57.576+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:15.489193+0000 front 2024-09-10T23:38:15.489211+0000 (oldest deadline 2024-09-10T23:38:40.788883+0000) 2024-09-10T23:38:57.856 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:57 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:57.576+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.090219+0000 front 2024-09-10T23:38:26.090294+0000 (oldest deadline 2024-09-10T23:38:49.589978+0000) 2024-09-10T23:38:57.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:57 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:57.626+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:57.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:57 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:57.626+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:57.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:57 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:57.626+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.666181+0000 front 2024-09-10T23:38:10.666203+0000 (oldest deadline 2024-09-10T23:38:36.566198+0000) 2024-09-10T23:38:57.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:57 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:57.626+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:16.566525+0000 front 2024-09-10T23:38:16.566671+0000 (oldest deadline 2024-09-10T23:38:41.866701+0000) 2024-09-10T23:38:57.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:57 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:57.626+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.968664+0000 front 2024-09-10T23:38:26.968691+0000 (oldest deadline 2024-09-10T23:38:51.068503+0000) 2024-09-10T23:38:58.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:57 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:57.854+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:58.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:57 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:57.854+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:38:58.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:57 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:57.854+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:38:58.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:57 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:57.854+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:38:58.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:58 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:58.063+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:58.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:58 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:58.063+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:38:58.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:58 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:58.063+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:38:58.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:58 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:58.063+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:25.384193+0000 front 2024-09-10T23:38:25.384222+0000 (oldest deadline 2024-09-10T23:38:50.684332+0000) 2024-09-10T23:38:58.838 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:58 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:58.556+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:58.839 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:58 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:58.556+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.187474+0000 front 2024-09-10T23:38:09.187495+0000 (oldest deadline 2024-09-10T23:38:33.287360+0000) 2024-09-10T23:38:58.839 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:58 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:58.556+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:15.489193+0000 front 2024-09-10T23:38:15.489211+0000 (oldest deadline 2024-09-10T23:38:40.788883+0000) 2024-09-10T23:38:58.839 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:58 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:58.556+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.090219+0000 front 2024-09-10T23:38:26.090294+0000 (oldest deadline 2024-09-10T23:38:49.589978+0000) 2024-09-10T23:38:58.839 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:58 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:58.556+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:31.890940+0000 front 2024-09-10T23:38:31.890990+0000 (oldest deadline 2024-09-10T23:38:57.791078+0000) 2024-09-10T23:38:58.872 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:58 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:58.609+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:58.872 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:58 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:58.609+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:58.872 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:58 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:58.609+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.666181+0000 front 2024-09-10T23:38:10.666203+0000 (oldest deadline 2024-09-10T23:38:36.566198+0000) 2024-09-10T23:38:58.872 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:58 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:58.609+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:16.566525+0000 front 2024-09-10T23:38:16.566671+0000 (oldest deadline 2024-09-10T23:38:41.866701+0000) 2024-09-10T23:38:58.872 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:58 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:58.609+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.968664+0000 front 2024-09-10T23:38:26.968691+0000 (oldest deadline 2024-09-10T23:38:51.068503+0000) 2024-09-10T23:38:59.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:58 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:58.837+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:38:59.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:58 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:58.837+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:38:59.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:58 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:58.837+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:38:59.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:58 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:58.837+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:38:59.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:58 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:58.837+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:32.187023+0000 front 2024-09-10T23:38:32.187049+0000 (oldest deadline 2024-09-10T23:38:58.087135+0000) 2024-09-10T23:38:59.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:59 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:59.025+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:38:59.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:59 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:59.025+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:38:59.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:59 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:59.025+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:38:59.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:38:59 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:38:59.025+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:25.384193+0000 front 2024-09-10T23:38:25.384222+0000 (oldest deadline 2024-09-10T23:38:50.684332+0000) 2024-09-10T23:38:59.840 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:59 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:59.515+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:38:59.841 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:59 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:59.515+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.187474+0000 front 2024-09-10T23:38:09.187495+0000 (oldest deadline 2024-09-10T23:38:33.287360+0000) 2024-09-10T23:38:59.841 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:59 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:59.515+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:15.489193+0000 front 2024-09-10T23:38:15.489211+0000 (oldest deadline 2024-09-10T23:38:40.788883+0000) 2024-09-10T23:38:59.841 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:59 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:59.515+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.090219+0000 front 2024-09-10T23:38:26.090294+0000 (oldest deadline 2024-09-10T23:38:49.589978+0000) 2024-09-10T23:38:59.841 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:38:59 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:38:59.515+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:31.890940+0000 front 2024-09-10T23:38:31.890990+0000 (oldest deadline 2024-09-10T23:38:57.791078+0000) 2024-09-10T23:38:59.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:59 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:59.656+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:38:59.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:59 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:59.656+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:38:59.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:59 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:59.656+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.666181+0000 front 2024-09-10T23:38:10.666203+0000 (oldest deadline 2024-09-10T23:38:36.566198+0000) 2024-09-10T23:38:59.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:59 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:59.656+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:16.566525+0000 front 2024-09-10T23:38:16.566671+0000 (oldest deadline 2024-09-10T23:38:41.866701+0000) 2024-09-10T23:38:59.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:38:59 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:38:59.656+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.968664+0000 front 2024-09-10T23:38:26.968691+0000 (oldest deadline 2024-09-10T23:38:51.068503+0000) 2024-09-10T23:39:00.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:59 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:59.839+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:39:00.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:59 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:59.839+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:39:00.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:59 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:59.839+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:39:00.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:59 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:59.839+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:39:00.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:38:59 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:38:59.839+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:32.187023+0000 front 2024-09-10T23:38:32.187049+0000 (oldest deadline 2024-09-10T23:38:58.087135+0000) 2024-09-10T23:39:00.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:00 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:00.037+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:39:00.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:00 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:00.037+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:39:00.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:00 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:00.037+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:39:00.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:00 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:00.037+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:25.384193+0000 front 2024-09-10T23:38:25.384222+0000 (oldest deadline 2024-09-10T23:38:50.684332+0000) 2024-09-10T23:39:00.851 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:39:00 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:39:00.527+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:39:00.851 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:39:00 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:39:00.527+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.187474+0000 front 2024-09-10T23:38:09.187495+0000 (oldest deadline 2024-09-10T23:38:33.287360+0000) 2024-09-10T23:39:00.851 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:39:00 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:39:00.527+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:15.489193+0000 front 2024-09-10T23:38:15.489211+0000 (oldest deadline 2024-09-10T23:38:40.788883+0000) 2024-09-10T23:39:00.851 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:39:00 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:39:00.527+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.090219+0000 front 2024-09-10T23:38:26.090294+0000 (oldest deadline 2024-09-10T23:38:49.589978+0000) 2024-09-10T23:39:00.851 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:39:00 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:39:00.527+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:31.890940+0000 front 2024-09-10T23:38:31.890990+0000 (oldest deadline 2024-09-10T23:38:57.791078+0000) 2024-09-10T23:39:00.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:00 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:00.606+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:39:00.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:00 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:00.606+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:39:00.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:00 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:00.606+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.666181+0000 front 2024-09-10T23:38:10.666203+0000 (oldest deadline 2024-09-10T23:38:36.566198+0000) 2024-09-10T23:39:00.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:00 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:00.606+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:16.566525+0000 front 2024-09-10T23:38:16.566671+0000 (oldest deadline 2024-09-10T23:38:41.866701+0000) 2024-09-10T23:39:00.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:00 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:00.606+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.968664+0000 front 2024-09-10T23:38:26.968691+0000 (oldest deadline 2024-09-10T23:38:51.068503+0000) 2024-09-10T23:39:01.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:00 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:00.850+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:39:01.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:00 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:00.850+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:39:01.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:00 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:00.850+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:39:01.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:00 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:00.850+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:39:01.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:00 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:00.850+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:32.187023+0000 front 2024-09-10T23:38:32.187049+0000 (oldest deadline 2024-09-10T23:38:58.087135+0000) 2024-09-10T23:39:01.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:01 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:01.054+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:39:01.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:01 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:01.054+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:39:01.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:01 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:01.054+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:39:01.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:01 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:01.054+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:25.384193+0000 front 2024-09-10T23:38:25.384222+0000 (oldest deadline 2024-09-10T23:38:50.684332+0000) 2024-09-10T23:39:01.721 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:01 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:01.563+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:39:01.721 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:01 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:01.563+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:39:01.721 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:01 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:01.563+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.666181+0000 front 2024-09-10T23:38:10.666203+0000 (oldest deadline 2024-09-10T23:38:36.566198+0000) 2024-09-10T23:39:01.721 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:01 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:01.563+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:16.566525+0000 front 2024-09-10T23:38:16.566671+0000 (oldest deadline 2024-09-10T23:38:41.866701+0000) 2024-09-10T23:39:01.721 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:01 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:01.563+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.968664+0000 front 2024-09-10T23:38:26.968691+0000 (oldest deadline 2024-09-10T23:38:51.068503+0000) 2024-09-10T23:39:01.721 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:01 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:01.563+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:36.170773+0000 front 2024-09-10T23:38:36.170722+0000 (oldest deadline 2024-09-10T23:39:01.470350+0000) 2024-09-10T23:39:01.809 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:39:01 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:39:01.557+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:50.683724+0000 front 2024-09-10T23:37:50.683650+0000 (oldest deadline 2024-09-10T23:38:14.783533+0000) 2024-09-10T23:39:01.809 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:39:01 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:39:01.557+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:09.187474+0000 front 2024-09-10T23:38:09.187495+0000 (oldest deadline 2024-09-10T23:38:33.287360+0000) 2024-09-10T23:39:01.809 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:39:01 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:39:01.557+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:15.489193+0000 front 2024-09-10T23:38:15.489211+0000 (oldest deadline 2024-09-10T23:38:40.788883+0000) 2024-09-10T23:39:01.810 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:39:01 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:39:01.557+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.090219+0000 front 2024-09-10T23:38:26.090294+0000 (oldest deadline 2024-09-10T23:38:49.589978+0000) 2024-09-10T23:39:01.810 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:39:01 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8[53945]: 2024-09-10T23:39:01.557+0000 7f04f5600640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:31.890940+0000 front 2024-09-10T23:38:31.890990+0000 (oldest deadline 2024-09-10T23:38:57.791078+0000) 2024-09-10T23:39:02.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:01 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:01.808+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:39:02.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:01 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:01.808+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:39:02.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:01 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:01.808+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:39:02.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:01 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:01.808+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:39:02.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:01 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:01.808+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:32.187023+0000 front 2024-09-10T23:38:32.187049+0000 (oldest deadline 2024-09-10T23:38:58.087135+0000) 2024-09-10T23:39:02.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:02 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:02.016+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:39:02.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:02 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:02.016+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:39:02.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:02 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:02.016+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:39:02.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:02 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:02.016+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:25.384193+0000 front 2024-09-10T23:38:25.384222+0000 (oldest deadline 2024-09-10T23:38:50.684332+0000) 2024-09-10T23:39:02.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:02 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:02.016+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:35.985416+0000 front 2024-09-10T23:38:35.985564+0000 (oldest deadline 2024-09-10T23:39:01.285407+0000) 2024-09-10T23:39:02.658 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:39:02 smithi194 podman[71360]: 2024-09-10 23:39:02.363890457 +0000 UTC m=+5.574445154 container died ff7b8061ec7902faca4318275ea8fddb1a992928f412afc54026609372204a4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:39:02.947 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:39:02 smithi194 podman[71360]: 2024-09-10 23:39:02.78130997 +0000 UTC m=+5.991864666 container cleanup ff7b8061ec7902faca4318275ea8fddb1a992928f412afc54026609372204a4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-10T23:39:02.947 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:39:02 smithi194 bash[71360]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8 2024-09-10T23:39:02.948 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:02 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:02.847+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:39:02.948 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:02 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:02.847+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:39:02.948 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:02 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:02.847+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:39:02.948 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:02 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:02.847+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:39:02.948 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:02 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:02.847+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:32.187023+0000 front 2024-09-10T23:38:32.187049+0000 (oldest deadline 2024-09-10T23:38:58.087135+0000) 2024-09-10T23:39:02.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:02 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:02.569+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:39:02.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:02 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:02.569+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:39:02.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:02 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:02.569+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.666181+0000 front 2024-09-10T23:38:10.666203+0000 (oldest deadline 2024-09-10T23:38:36.566198+0000) 2024-09-10T23:39:02.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:02 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:02.569+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:16.566525+0000 front 2024-09-10T23:38:16.566671+0000 (oldest deadline 2024-09-10T23:38:41.866701+0000) 2024-09-10T23:39:02.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:02 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:02.570+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.968664+0000 front 2024-09-10T23:38:26.968691+0000 (oldest deadline 2024-09-10T23:38:51.068503+0000) 2024-09-10T23:39:02.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:02 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:02.570+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:36.170773+0000 front 2024-09-10T23:38:36.170722+0000 (oldest deadline 2024-09-10T23:39:01.470350+0000) 2024-09-10T23:39:03.249 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:02 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:02.974+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:39:03.249 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:02 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:02.974+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:39:03.249 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:02 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:02.974+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:39:03.249 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:02 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:02.974+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:25.384193+0000 front 2024-09-10T23:38:25.384222+0000 (oldest deadline 2024-09-10T23:38:50.684332+0000) 2024-09-10T23:39:03.249 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:02 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:02.974+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:35.985416+0000 front 2024-09-10T23:38:35.985564+0000 (oldest deadline 2024-09-10T23:39:01.285407+0000) 2024-09-10T23:39:03.447 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:39:03 smithi194 podman[71376]: 2024-09-10 23:39:03.074331164 +0000 UTC m=+0.696633995 container remove ff7b8061ec7902faca4318275ea8fddb1a992928f412afc54026609372204a4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-10T23:39:03.947 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:39:03 smithi194 podman[71460]: 2024-09-10 23:39:03.595209989 +0000 UTC m=+0.026800868 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:39:03.948 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:39:03 smithi194 podman[71460]: 2024-09-10 23:39:03.700184031 +0000 UTC m=+0.131774910 container create 3f6e84281faa51eda1a4c16e9eb93855078204781cc0b9832372de9d9ca03230 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-10T23:39:03.948 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:03 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:03.847+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:39:03.948 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:03 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:03.847+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:39:03.948 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:03 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:03.847+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:39:03.948 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:03 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:03.847+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:39:03.948 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:03 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:03.847+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:32.187023+0000 front 2024-09-10T23:38:32.187049+0000 (oldest deadline 2024-09-10T23:38:58.087135+0000) 2024-09-10T23:39:03.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:03 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:03.584+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:39:03.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:03 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:03.584+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:39:03.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:03 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:03.584+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.666181+0000 front 2024-09-10T23:38:10.666203+0000 (oldest deadline 2024-09-10T23:38:36.566198+0000) 2024-09-10T23:39:03.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:03 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:03.584+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:16.566525+0000 front 2024-09-10T23:38:16.566671+0000 (oldest deadline 2024-09-10T23:38:41.866701+0000) 2024-09-10T23:39:03.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:03 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:03.584+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.968664+0000 front 2024-09-10T23:38:26.968691+0000 (oldest deadline 2024-09-10T23:38:51.068503+0000) 2024-09-10T23:39:03.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:03 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:03.584+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:36.170773+0000 front 2024-09-10T23:38:36.170722+0000 (oldest deadline 2024-09-10T23:39:01.470350+0000) 2024-09-10T23:39:04.226 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:39:03 smithi194 podman[71460]: 2024-09-10 23:39:03.964426774 +0000 UTC m=+0.396017654 container init 3f6e84281faa51eda1a4c16e9eb93855078204781cc0b9832372de9d9ca03230 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-10T23:39:04.226 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:39:03 smithi194 podman[71460]: 2024-09-10 23:39:03.971315001 +0000 UTC m=+0.402905888 container start 3f6e84281faa51eda1a4c16e9eb93855078204781cc0b9832372de9d9ca03230 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:39:04.227 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:39:04 smithi194 podman[71460]: 2024-09-10 23:39:04.044090187 +0000 UTC m=+0.475681079 container attach 3f6e84281faa51eda1a4c16e9eb93855078204781cc0b9832372de9d9ca03230 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:39:04.278 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:03 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:03.962+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:39:04.278 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:03 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:03.962+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:39:04.278 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:03 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:03.962+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:39:04.278 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:03 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:03.962+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:25.384193+0000 front 2024-09-10T23:38:25.384222+0000 (oldest deadline 2024-09-10T23:38:50.684332+0000) 2024-09-10T23:39:04.278 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:03 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:03.962+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:35.985416+0000 front 2024-09-10T23:38:35.985564+0000 (oldest deadline 2024-09-10T23:39:01.285407+0000) 2024-09-10T23:39:04.567 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 10 23:39:04 smithi194 podman[71483]: 2024-09-10 23:39:04.266384413 +0000 UTC m=+0.026540640 container died 3f6e84281faa51eda1a4c16e9eb93855078204781cc0b9832372de9d9ca03230 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-10T23:39:04.971 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.8.service' 2024-09-10T23:39:04.972 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:04 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:04.616+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:39:04.972 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:04 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:04.616+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:39:04.972 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:04 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:04.616+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.666181+0000 front 2024-09-10T23:38:10.666203+0000 (oldest deadline 2024-09-10T23:38:36.566198+0000) 2024-09-10T23:39:04.972 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:04 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:04.616+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:16.566525+0000 front 2024-09-10T23:38:16.566671+0000 (oldest deadline 2024-09-10T23:38:41.866701+0000) 2024-09-10T23:39:04.972 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:04 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:04.616+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.968664+0000 front 2024-09-10T23:38:26.968691+0000 (oldest deadline 2024-09-10T23:38:51.068503+0000) 2024-09-10T23:39:04.972 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:04 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:04.616+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:36.170773+0000 front 2024-09-10T23:38:36.170722+0000 (oldest deadline 2024-09-10T23:39:01.470350+0000) 2024-09-10T23:39:05.049 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:39:05.049 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-10T23:39:05.050 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-10T23:39:05.050 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.9 2024-09-10T23:39:05.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:04 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:04.849+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:39:05.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:04 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:04.849+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:39:05.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:04 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:04.849+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:39:05.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:04 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:04.849+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:39:05.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:04 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:04.849+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:32.187023+0000 front 2024-09-10T23:38:32.187049+0000 (oldest deadline 2024-09-10T23:38:58.087135+0000) 2024-09-10T23:39:05.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:04 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:04.956+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:39:05.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:04 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:04.956+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:39:05.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:04 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:04.956+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:39:05.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:04 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:04.956+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:25.384193+0000 front 2024-09-10T23:38:25.384222+0000 (oldest deadline 2024-09-10T23:38:50.684332+0000) 2024-09-10T23:39:05.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:04 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:04.956+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:35.985416+0000 front 2024-09-10T23:38:35.985564+0000 (oldest deadline 2024-09-10T23:39:01.285407+0000) 2024-09-10T23:39:05.470 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:05 smithi003 systemd[1]: Stopping Ceph osd.9 for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:39:05.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:05 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:05.481+0000 7ff28a800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:39:05.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:05 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:05.481+0000 7ff28a800640 -1 osd.9 104 *** Got signal Terminated *** 2024-09-10T23:39:05.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:05 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:05.481+0000 7ff28a800640 -1 osd.9 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:39:05.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:05 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:05.607+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:39:05.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:05 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:05.607+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:39:05.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:05 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:05.607+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.666181+0000 front 2024-09-10T23:38:10.666203+0000 (oldest deadline 2024-09-10T23:38:36.566198+0000) 2024-09-10T23:39:05.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:05 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:05.607+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:16.566525+0000 front 2024-09-10T23:38:16.566671+0000 (oldest deadline 2024-09-10T23:38:41.866701+0000) 2024-09-10T23:39:05.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:05 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:05.607+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.968664+0000 front 2024-09-10T23:38:26.968691+0000 (oldest deadline 2024-09-10T23:38:51.068503+0000) 2024-09-10T23:39:05.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:05 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:05.607+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:36.170773+0000 front 2024-09-10T23:38:36.170722+0000 (oldest deadline 2024-09-10T23:39:01.470350+0000) 2024-09-10T23:39:06.097 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:05 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:05.933+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:39:06.098 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:05 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:05.933+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:39:06.098 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:05 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:05.933+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:39:06.098 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:05 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:05.933+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:25.384193+0000 front 2024-09-10T23:38:25.384222+0000 (oldest deadline 2024-09-10T23:38:50.684332+0000) 2024-09-10T23:39:06.098 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:05 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:05.933+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:35.985416+0000 front 2024-09-10T23:38:35.985564+0000 (oldest deadline 2024-09-10T23:39:01.285407+0000) 2024-09-10T23:39:06.099 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:05 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:05.812+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:39:06.099 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:05 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:05.812+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:39:06.099 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:05 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:05.812+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:39:06.100 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:05 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:05.812+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:39:06.100 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:05 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:05.812+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:32.187023+0000 front 2024-09-10T23:38:32.187049+0000 (oldest deadline 2024-09-10T23:38:58.087135+0000) 2024-09-10T23:39:06.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:06 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:06.623+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:39:06.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:06 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:06.623+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:39:06.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:06 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:06.623+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.666181+0000 front 2024-09-10T23:38:10.666203+0000 (oldest deadline 2024-09-10T23:38:36.566198+0000) 2024-09-10T23:39:06.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:06 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:06.623+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:16.566525+0000 front 2024-09-10T23:38:16.566671+0000 (oldest deadline 2024-09-10T23:38:41.866701+0000) 2024-09-10T23:39:06.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:06 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:06.623+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.968664+0000 front 2024-09-10T23:38:26.968691+0000 (oldest deadline 2024-09-10T23:38:51.068503+0000) 2024-09-10T23:39:06.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:06 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:06.623+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:36.170773+0000 front 2024-09-10T23:38:36.170722+0000 (oldest deadline 2024-09-10T23:39:01.470350+0000) 2024-09-10T23:39:07.112 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:06 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:06.861+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:39:07.113 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:06 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:06.861+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:39:07.113 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:06 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:06.861+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:39:07.113 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:06 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:06.861+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:39:07.113 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:06 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:06.861+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:32.187023+0000 front 2024-09-10T23:38:32.187049+0000 (oldest deadline 2024-09-10T23:38:58.087135+0000) 2024-09-10T23:39:07.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:06 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:06.903+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:39:07.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:06 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:06.903+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:39:07.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:06 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:06.903+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:39:07.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:06 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:06.903+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:25.384193+0000 front 2024-09-10T23:38:25.384222+0000 (oldest deadline 2024-09-10T23:38:50.684332+0000) 2024-09-10T23:39:07.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:06 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:06.903+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:35.985416+0000 front 2024-09-10T23:38:35.985564+0000 (oldest deadline 2024-09-10T23:39:01.285407+0000) 2024-09-10T23:39:07.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:07 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:07.638+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:39:07.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:07 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:07.638+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:39:07.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:07 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:07.638+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.666181+0000 front 2024-09-10T23:38:10.666203+0000 (oldest deadline 2024-09-10T23:38:36.566198+0000) 2024-09-10T23:39:07.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:07 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:07.638+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:16.566525+0000 front 2024-09-10T23:38:16.566671+0000 (oldest deadline 2024-09-10T23:38:41.866701+0000) 2024-09-10T23:39:07.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:07 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:07.638+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.968664+0000 front 2024-09-10T23:38:26.968691+0000 (oldest deadline 2024-09-10T23:38:51.068503+0000) 2024-09-10T23:39:07.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:07 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:07.638+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:36.170773+0000 front 2024-09-10T23:38:36.170722+0000 (oldest deadline 2024-09-10T23:39:01.470350+0000) 2024-09-10T23:39:08.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:07 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:07.879+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:39:08.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:07 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:07.879+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:39:08.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:07 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:07.879+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:39:08.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:07 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:07.879+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:39:08.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:07 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:07.879+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:32.187023+0000 front 2024-09-10T23:38:32.187049+0000 (oldest deadline 2024-09-10T23:38:58.087135+0000) 2024-09-10T23:39:08.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:07 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:07.879+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-10T23:38:42.788555+0000 front 2024-09-10T23:38:42.788470+0000 (oldest deadline 2024-09-10T23:39:06.888362+0000) 2024-09-10T23:39:08.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:07 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:07.912+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:39:08.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:07 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:07.912+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:39:08.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:07 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:07.912+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:39:08.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:07 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:07.912+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:25.384193+0000 front 2024-09-10T23:38:25.384222+0000 (oldest deadline 2024-09-10T23:38:50.684332+0000) 2024-09-10T23:39:08.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:07 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:07.912+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:35.985416+0000 front 2024-09-10T23:38:35.985564+0000 (oldest deadline 2024-09-10T23:39:01.285407+0000) 2024-09-10T23:39:08.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:08 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:08.659+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:39:08.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:08 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:08.659+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:39:08.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:08 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:08.659+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.666181+0000 front 2024-09-10T23:38:10.666203+0000 (oldest deadline 2024-09-10T23:38:36.566198+0000) 2024-09-10T23:39:08.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:08 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:08.659+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:16.566525+0000 front 2024-09-10T23:38:16.566671+0000 (oldest deadline 2024-09-10T23:38:41.866701+0000) 2024-09-10T23:39:08.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:08 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:08.659+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.968664+0000 front 2024-09-10T23:38:26.968691+0000 (oldest deadline 2024-09-10T23:38:51.068503+0000) 2024-09-10T23:39:08.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:08 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:08.659+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:36.170773+0000 front 2024-09-10T23:38:36.170722+0000 (oldest deadline 2024-09-10T23:39:01.470350+0000) 2024-09-10T23:39:09.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:08 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:08.848+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:39:09.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:08 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:08.848+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:39:09.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:08 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:08.848+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:39:09.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:08 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:08.848+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:39:09.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:08 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:08.848+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:32.187023+0000 front 2024-09-10T23:38:32.187049+0000 (oldest deadline 2024-09-10T23:38:58.087135+0000) 2024-09-10T23:39:09.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:08 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:08.848+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-10T23:38:42.788555+0000 front 2024-09-10T23:38:42.788470+0000 (oldest deadline 2024-09-10T23:39:06.888362+0000) 2024-09-10T23:39:09.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:08 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:08.930+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:39:09.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:08 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:08.930+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:39:09.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:08 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:08.930+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:39:09.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:08 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:08.930+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:25.384193+0000 front 2024-09-10T23:38:25.384222+0000 (oldest deadline 2024-09-10T23:38:50.684332+0000) 2024-09-10T23:39:09.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:08 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:08.930+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:35.985416+0000 front 2024-09-10T23:38:35.985564+0000 (oldest deadline 2024-09-10T23:39:01.285407+0000) 2024-09-10T23:39:09.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:09 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:09.649+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:49.062345+0000 front 2024-09-10T23:37:49.062546+0000 (oldest deadline 2024-09-10T23:38:14.962403+0000) 2024-09-10T23:39:09.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:09 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:09.649+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:01.964115+0000 front 2024-09-10T23:38:01.964367+0000 (oldest deadline 2024-09-10T23:38:23.664318+0000) 2024-09-10T23:39:09.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:09 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:09.649+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.666181+0000 front 2024-09-10T23:38:10.666203+0000 (oldest deadline 2024-09-10T23:38:36.566198+0000) 2024-09-10T23:39:09.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:09 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:09.649+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:16.566525+0000 front 2024-09-10T23:38:16.566671+0000 (oldest deadline 2024-09-10T23:38:41.866701+0000) 2024-09-10T23:39:09.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:09 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:09.649+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.968664+0000 front 2024-09-10T23:38:26.968691+0000 (oldest deadline 2024-09-10T23:38:51.068503+0000) 2024-09-10T23:39:09.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:09 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9[69502]: 2024-09-10T23:39:09.649+0000 7ff286200640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:36.170773+0000 front 2024-09-10T23:38:36.170722+0000 (oldest deadline 2024-09-10T23:39:01.470350+0000) 2024-09-10T23:39:10.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:09 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:09.884+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:39:10.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:09 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:09.884+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:39:10.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:09 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:09.884+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:39:10.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:09 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:09.884+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:39:10.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:09 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:09.884+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:32.187023+0000 front 2024-09-10T23:38:32.187049+0000 (oldest deadline 2024-09-10T23:38:58.087135+0000) 2024-09-10T23:39:10.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:09 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:09.884+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-10T23:38:42.788555+0000 front 2024-09-10T23:38:42.788470+0000 (oldest deadline 2024-09-10T23:39:06.888362+0000) 2024-09-10T23:39:10.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:09 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:09.902+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:39:10.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:09 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:09.902+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:39:10.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:09 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:09.902+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:39:10.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:09 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:09.902+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:25.384193+0000 front 2024-09-10T23:38:25.384222+0000 (oldest deadline 2024-09-10T23:38:50.684332+0000) 2024-09-10T23:39:10.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:09 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:09.902+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:35.985416+0000 front 2024-09-10T23:38:35.985564+0000 (oldest deadline 2024-09-10T23:39:01.285407+0000) 2024-09-10T23:39:10.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:09 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:09.902+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-10T23:38:44.686931+0000 front 2024-09-10T23:38:44.686910+0000 (oldest deadline 2024-09-10T23:39:09.386789+0000) 2024-09-10T23:39:11.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:10 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:10.918+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:39:11.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:10 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:10.918+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:39:11.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:10 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:10.918+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:39:11.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:10 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:10.918+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:39:11.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:10 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:10.918+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:32.187023+0000 front 2024-09-10T23:38:32.187049+0000 (oldest deadline 2024-09-10T23:38:58.087135+0000) 2024-09-10T23:39:11.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:10 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:10.918+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-10T23:38:42.788555+0000 front 2024-09-10T23:38:42.788470+0000 (oldest deadline 2024-09-10T23:39:06.888362+0000) 2024-09-10T23:39:11.220 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:11 smithi003 podman[97949]: 2024-09-10 23:39:11.059440991 +0000 UTC m=+5.718894507 container died 7ebb7dab0d1de28f437d680afe573d9b47d780ae034b07927c65aaf8238e3647 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-10T23:39:11.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:10 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:10.883+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:39:11.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:10 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:10.883+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:39:11.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:10 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:10.883+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:39:11.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:10 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:10.883+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:25.384193+0000 front 2024-09-10T23:38:25.384222+0000 (oldest deadline 2024-09-10T23:38:50.684332+0000) 2024-09-10T23:39:11.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:10 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:10.883+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:35.985416+0000 front 2024-09-10T23:38:35.985564+0000 (oldest deadline 2024-09-10T23:39:01.285407+0000) 2024-09-10T23:39:11.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:10 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:10.883+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-10T23:38:44.686931+0000 front 2024-09-10T23:38:44.686910+0000 (oldest deadline 2024-09-10T23:39:09.386789+0000) 2024-09-10T23:39:11.672 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:11 smithi003 podman[97949]: 2024-09-10 23:39:11.453615387 +0000 UTC m=+6.113068899 container cleanup 7ebb7dab0d1de28f437d680afe573d9b47d780ae034b07927c65aaf8238e3647 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:39:11.672 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:11 smithi003 bash[97949]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9 2024-09-10T23:39:11.970 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:11 smithi003 podman[97967]: 2024-09-10 23:39:11.671279223 +0000 UTC m=+0.603839171 container remove 7ebb7dab0d1de28f437d680afe573d9b47d780ae034b07927c65aaf8238e3647 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2) 2024-09-10T23:39:12.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:11 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:11.938+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:39:12.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:11 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:11.938+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:39:12.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:11 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:11.938+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:39:12.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:11 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:11.938+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:39:12.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:11 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:11.938+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:32.187023+0000 front 2024-09-10T23:38:32.187049+0000 (oldest deadline 2024-09-10T23:38:58.087135+0000) 2024-09-10T23:39:12.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:11 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:11.938+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-10T23:38:42.788555+0000 front 2024-09-10T23:38:42.788470+0000 (oldest deadline 2024-09-10T23:39:06.888362+0000) 2024-09-10T23:39:12.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:11 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:11.865+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:39:12.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:11 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:11.865+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:39:12.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:11 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:11.865+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:39:12.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:11 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:11.865+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:25.384193+0000 front 2024-09-10T23:38:25.384222+0000 (oldest deadline 2024-09-10T23:38:50.684332+0000) 2024-09-10T23:39:12.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:11 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:11.865+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:35.985416+0000 front 2024-09-10T23:38:35.985564+0000 (oldest deadline 2024-09-10T23:39:01.285407+0000) 2024-09-10T23:39:12.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:11 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:11.865+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-10T23:38:44.686931+0000 front 2024-09-10T23:38:44.686910+0000 (oldest deadline 2024-09-10T23:39:09.386789+0000) 2024-09-10T23:39:12.533 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:12 smithi003 podman[98051]: 2024-09-10 23:39:12.247059663 +0000 UTC m=+0.113048769 container create 80d683ad4d8554cee8548f78c647d6586bb4e7ac8888371d9f1a15a5b92d16a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-10T23:39:12.533 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:12 smithi003 podman[98051]: 2024-09-10 23:39:12.16139325 +0000 UTC m=+0.027382366 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:39:12.533 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:12 smithi003 podman[98051]: 2024-09-10 23:39:12.449413357 +0000 UTC m=+0.315402473 container init 80d683ad4d8554cee8548f78c647d6586bb4e7ac8888371d9f1a15a5b92d16a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-10T23:39:12.533 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:12 smithi003 podman[98051]: 2024-09-10 23:39:12.456150976 +0000 UTC m=+0.322140091 container start 80d683ad4d8554cee8548f78c647d6586bb4e7ac8888371d9f1a15a5b92d16a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-10T23:39:12.533 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:12 smithi003 podman[98051]: 2024-09-10 23:39:12.532431172 +0000 UTC m=+0.398420288 container attach 80d683ad4d8554cee8548f78c647d6586bb4e7ac8888371d9f1a15a5b92d16a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-10T23:39:12.971 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 10 23:39:12 smithi003 podman[98051]: 2024-09-10 23:39:12.724293826 +0000 UTC m=+0.590282933 container died 80d683ad4d8554cee8548f78c647d6586bb4e7ac8888371d9f1a15a5b92d16a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-10T23:39:13.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:12 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:12.939+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:39:13.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:12 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:12.939+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:39:13.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:12 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:12.939+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:39:13.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:12 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:12.939+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:39:13.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:12 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:12.939+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:32.187023+0000 front 2024-09-10T23:38:32.187049+0000 (oldest deadline 2024-09-10T23:38:58.087135+0000) 2024-09-10T23:39:13.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:12 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:12.939+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-10T23:38:42.788555+0000 front 2024-09-10T23:38:42.788470+0000 (oldest deadline 2024-09-10T23:39:06.888362+0000) 2024-09-10T23:39:13.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:12 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:12.889+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:39:13.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:12 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:12.889+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:39:13.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:12 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:12.889+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:39:13.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:12 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:12.889+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:25.384193+0000 front 2024-09-10T23:38:25.384222+0000 (oldest deadline 2024-09-10T23:38:50.684332+0000) 2024-09-10T23:39:13.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:12 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:12.889+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:35.985416+0000 front 2024-09-10T23:38:35.985564+0000 (oldest deadline 2024-09-10T23:39:01.285407+0000) 2024-09-10T23:39:13.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:12 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:12.889+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-10T23:38:44.686931+0000 front 2024-09-10T23:38:44.686910+0000 (oldest deadline 2024-09-10T23:39:09.386789+0000) 2024-09-10T23:39:13.489 DEBUG:teuthology.orchestra.run.smithi003:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.9.service' 2024-09-10T23:39:13.565 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:39:13.565 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-10T23:39:13.566 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-10T23:39:13.566 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.10 2024-09-10T23:39:13.937 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:13 smithi038 systemd[1]: Stopping Ceph osd.10 for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:39:14.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:13 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:13.914+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:39:14.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:13 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:13.914+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:39:14.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:13 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:13.914+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:39:14.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:13 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:13.914+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:39:14.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:13 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:13.914+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:32.187023+0000 front 2024-09-10T23:38:32.187049+0000 (oldest deadline 2024-09-10T23:38:58.087135+0000) 2024-09-10T23:39:14.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:13 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:13.914+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-10T23:38:42.788555+0000 front 2024-09-10T23:38:42.788470+0000 (oldest deadline 2024-09-10T23:39:06.888362+0000) 2024-09-10T23:39:14.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:13 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:13.936+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:39:14.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:13 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:13.936+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:39:14.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:13 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:13.936+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:39:14.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:13 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:13.936+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:25.384193+0000 front 2024-09-10T23:38:25.384222+0000 (oldest deadline 2024-09-10T23:38:50.684332+0000) 2024-09-10T23:39:14.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:13 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:13.936+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:35.985416+0000 front 2024-09-10T23:38:35.985564+0000 (oldest deadline 2024-09-10T23:39:01.285407+0000) 2024-09-10T23:39:14.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:13 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:13.936+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-10T23:38:44.686931+0000 front 2024-09-10T23:38:44.686910+0000 (oldest deadline 2024-09-10T23:39:09.386789+0000) 2024-09-10T23:39:14.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:14 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:14.008+0000 7f2519200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:39:14.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:14 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:14.008+0000 7f2519200640 -1 osd.10 104 *** Got signal Terminated *** 2024-09-10T23:39:14.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:14 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:14.008+0000 7f2519200640 -1 osd.10 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:39:15.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:14 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:14.880+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:39:15.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:14 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:14.880+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:39:15.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:14 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:14.880+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:39:15.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:14 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:14.880+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:39:15.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:14 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:14.880+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:32.187023+0000 front 2024-09-10T23:38:32.187049+0000 (oldest deadline 2024-09-10T23:38:58.087135+0000) 2024-09-10T23:39:15.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:14 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:14.880+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-10T23:38:42.788555+0000 front 2024-09-10T23:38:42.788470+0000 (oldest deadline 2024-09-10T23:39:06.888362+0000) 2024-09-10T23:39:15.257 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:14 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:14.947+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:39:15.257 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:14 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:14.947+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:39:15.257 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:14 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:14.947+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:39:15.257 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:14 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:14.947+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:25.384193+0000 front 2024-09-10T23:38:25.384222+0000 (oldest deadline 2024-09-10T23:38:50.684332+0000) 2024-09-10T23:39:15.257 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:14 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:14.947+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:35.985416+0000 front 2024-09-10T23:38:35.985564+0000 (oldest deadline 2024-09-10T23:39:01.285407+0000) 2024-09-10T23:39:15.257 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:14 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:14.947+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-10T23:38:44.686931+0000 front 2024-09-10T23:38:44.686910+0000 (oldest deadline 2024-09-10T23:39:09.386789+0000) 2024-09-10T23:39:15.258 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:14 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:14.947+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6820 osd.7 since back 2024-09-10T23:38:52.887785+0000 front 2024-09-10T23:38:52.887820+0000 (oldest deadline 2024-09-10T23:39:14.488429+0000) 2024-09-10T23:39:16.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:15 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:15.901+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:39:16.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:15 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:15.901+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:39:16.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:15 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:15.901+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:39:16.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:15 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:15.901+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:39:16.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:15 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:15.901+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:32.187023+0000 front 2024-09-10T23:38:32.187049+0000 (oldest deadline 2024-09-10T23:38:58.087135+0000) 2024-09-10T23:39:16.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:15 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:15.901+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-10T23:38:42.788555+0000 front 2024-09-10T23:38:42.788470+0000 (oldest deadline 2024-09-10T23:39:06.888362+0000) 2024-09-10T23:39:16.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:15 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:15.976+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:39:16.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:15 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:15.976+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:39:16.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:15 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:15.976+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:39:16.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:15 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:15.976+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:25.384193+0000 front 2024-09-10T23:38:25.384222+0000 (oldest deadline 2024-09-10T23:38:50.684332+0000) 2024-09-10T23:39:16.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:15 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:15.976+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:35.985416+0000 front 2024-09-10T23:38:35.985564+0000 (oldest deadline 2024-09-10T23:39:01.285407+0000) 2024-09-10T23:39:16.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:15 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:15.976+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-10T23:38:44.686931+0000 front 2024-09-10T23:38:44.686910+0000 (oldest deadline 2024-09-10T23:39:09.386789+0000) 2024-09-10T23:39:16.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:15 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:15.976+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6820 osd.7 since back 2024-09-10T23:38:52.887785+0000 front 2024-09-10T23:38:52.887820+0000 (oldest deadline 2024-09-10T23:39:14.488429+0000) 2024-09-10T23:39:17.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:16 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:16.941+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:39:17.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:16 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:16.941+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:39:17.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:16 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:16.941+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:39:17.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:16 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:16.941+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:39:17.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:16 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:16.941+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:32.187023+0000 front 2024-09-10T23:38:32.187049+0000 (oldest deadline 2024-09-10T23:38:58.087135+0000) 2024-09-10T23:39:17.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:16 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:16.941+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-10T23:38:42.788555+0000 front 2024-09-10T23:38:42.788470+0000 (oldest deadline 2024-09-10T23:39:06.888362+0000) 2024-09-10T23:39:17.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:16 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:16.953+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:39:17.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:16 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:16.953+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:39:17.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:16 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:16.953+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:39:17.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:16 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:16.953+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:25.384193+0000 front 2024-09-10T23:38:25.384222+0000 (oldest deadline 2024-09-10T23:38:50.684332+0000) 2024-09-10T23:39:17.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:16 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:16.953+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:35.985416+0000 front 2024-09-10T23:38:35.985564+0000 (oldest deadline 2024-09-10T23:39:01.285407+0000) 2024-09-10T23:39:17.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:16 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:16.953+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-10T23:38:44.686931+0000 front 2024-09-10T23:38:44.686910+0000 (oldest deadline 2024-09-10T23:39:09.386789+0000) 2024-09-10T23:39:17.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:16 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:16.953+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6820 osd.7 since back 2024-09-10T23:38:52.887785+0000 front 2024-09-10T23:38:52.887820+0000 (oldest deadline 2024-09-10T23:39:14.488429+0000) 2024-09-10T23:39:18.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:17 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:17.915+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:39:18.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:17 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:17.915+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:39:18.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:17 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:17.915+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:39:18.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:17 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:17.915+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:39:18.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:17 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:17.915+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:32.187023+0000 front 2024-09-10T23:38:32.187049+0000 (oldest deadline 2024-09-10T23:38:58.087135+0000) 2024-09-10T23:39:18.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:17 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:17.915+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-10T23:38:42.788555+0000 front 2024-09-10T23:38:42.788470+0000 (oldest deadline 2024-09-10T23:39:06.888362+0000) 2024-09-10T23:39:18.347 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:17 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:17.993+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:39:18.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:17 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:17.993+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:39:18.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:17 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:17.993+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:39:18.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:17 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:17.993+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:25.384193+0000 front 2024-09-10T23:38:25.384222+0000 (oldest deadline 2024-09-10T23:38:50.684332+0000) 2024-09-10T23:39:18.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:17 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:17.993+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:35.985416+0000 front 2024-09-10T23:38:35.985564+0000 (oldest deadline 2024-09-10T23:39:01.285407+0000) 2024-09-10T23:39:18.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:17 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:17.993+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-10T23:38:44.686931+0000 front 2024-09-10T23:38:44.686910+0000 (oldest deadline 2024-09-10T23:39:09.386789+0000) 2024-09-10T23:39:18.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:17 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:17.993+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6820 osd.7 since back 2024-09-10T23:38:52.887785+0000 front 2024-09-10T23:38:52.887820+0000 (oldest deadline 2024-09-10T23:39:14.488429+0000) 2024-09-10T23:39:19.197 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:18 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:18.943+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:39:19.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:18 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:18.943+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:39:19.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:18 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:18.943+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:39:19.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:18 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:18.943+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:39:19.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:18 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:18.943+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:32.187023+0000 front 2024-09-10T23:38:32.187049+0000 (oldest deadline 2024-09-10T23:38:58.087135+0000) 2024-09-10T23:39:19.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:18 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:18.943+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-10T23:38:42.788555+0000 front 2024-09-10T23:38:42.788470+0000 (oldest deadline 2024-09-10T23:39:06.888362+0000) 2024-09-10T23:39:19.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:18 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:18.943+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6820 osd.7 since back 2024-09-10T23:38:52.090017+0000 front 2024-09-10T23:38:52.090209+0000 (oldest deadline 2024-09-10T23:39:17.989779+0000) 2024-09-10T23:39:19.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:18 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:18.946+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.379511+0000 front 2024-09-10T23:38:00.379825+0000 (oldest deadline 2024-09-10T23:38:24.980048+0000) 2024-09-10T23:39:19.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:18 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:18.946+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.782116+0000 front 2024-09-10T23:38:10.782203+0000 (oldest deadline 2024-09-10T23:38:34.281942+0000) 2024-09-10T23:39:19.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:18 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:18.946+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-10T23:38:19.583233+0000 front 2024-09-10T23:38:19.583030+0000 (oldest deadline 2024-09-10T23:38:41.283133+0000) 2024-09-10T23:39:19.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:18 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:18.946+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:25.384193+0000 front 2024-09-10T23:38:25.384222+0000 (oldest deadline 2024-09-10T23:38:50.684332+0000) 2024-09-10T23:39:19.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:18 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:18.946+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:35.985416+0000 front 2024-09-10T23:38:35.985564+0000 (oldest deadline 2024-09-10T23:39:01.285407+0000) 2024-09-10T23:39:19.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:18 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:18.946+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-10T23:38:44.686931+0000 front 2024-09-10T23:38:44.686910+0000 (oldest deadline 2024-09-10T23:39:09.386789+0000) 2024-09-10T23:39:19.348 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:18 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10[60049]: 2024-09-10T23:39:18.946+0000 7f2514c00640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.38:6820 osd.7 since back 2024-09-10T23:38:52.887785+0000 front 2024-09-10T23:38:52.887820+0000 (oldest deadline 2024-09-10T23:39:14.488429+0000) 2024-09-10T23:39:19.908 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:19 smithi038 podman[71032]: 2024-09-10 23:39:19.617566194 +0000 UTC m=+5.762230797 container died c0a67ed624600027806d3d5ab3c925e6760e18340c4d205c20d0d72879070bfa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-10T23:39:20.273 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:20 smithi038 podman[71032]: 2024-09-10 23:39:20.01290815 +0000 UTC m=+6.157572750 container cleanup c0a67ed624600027806d3d5ab3c925e6760e18340c4d205c20d0d72879070bfa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-10T23:39:20.273 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:20 smithi038 bash[71032]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10 2024-09-10T23:39:20.447 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:19 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:19.975+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:39:20.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:19 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:19.975+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:39:20.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:19 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:19.975+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:39:20.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:19 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:19.975+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:39:20.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:19 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:19.975+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:32.187023+0000 front 2024-09-10T23:38:32.187049+0000 (oldest deadline 2024-09-10T23:38:58.087135+0000) 2024-09-10T23:39:20.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:19 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:19.975+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-10T23:38:42.788555+0000 front 2024-09-10T23:38:42.788470+0000 (oldest deadline 2024-09-10T23:39:06.888362+0000) 2024-09-10T23:39:20.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:19 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:19.975+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6820 osd.7 since back 2024-09-10T23:38:52.090017+0000 front 2024-09-10T23:38:52.090209+0000 (oldest deadline 2024-09-10T23:39:17.989779+0000) 2024-09-10T23:39:20.597 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:20 smithi038 podman[71051]: 2024-09-10 23:39:20.272401558 +0000 UTC m=+0.646126336 container remove c0a67ed624600027806d3d5ab3c925e6760e18340c4d205c20d0d72879070bfa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-10T23:39:20.957 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:20 smithi038 podman[71139]: 2024-09-10 23:39:20.611979503 +0000 UTC m=+0.027363496 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:39:20.958 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:20 smithi038 podman[71139]: 2024-09-10 23:39:20.7148593 +0000 UTC m=+0.130243292 container create 3f3aae76df6185c8ac4501028c1a1a8718bd2fbd1d87cf082c45c268f091c03c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-10T23:39:20.958 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:20 smithi038 podman[71139]: 2024-09-10 23:39:20.950719618 +0000 UTC m=+0.366103611 container init 3f3aae76df6185c8ac4501028c1a1a8718bd2fbd1d87cf082c45c268f091c03c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:39:20.958 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:20 smithi038 podman[71139]: 2024-09-10 23:39:20.957434496 +0000 UTC m=+0.372818499 container start 3f3aae76df6185c8ac4501028c1a1a8718bd2fbd1d87cf082c45c268f091c03c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-10T23:39:21.216 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:21 smithi038 podman[71139]: 2024-09-10 23:39:21.067089002 +0000 UTC m=+0.482473006 container attach 3f3aae76df6185c8ac4501028c1a1a8718bd2fbd1d87cf082c45c268f091c03c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-10T23:39:21.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:21 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:21.000+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:39:21.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:21 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:21.000+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:39:21.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:21 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:21.000+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:39:21.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:21 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:21.000+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:39:21.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:21 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:21.000+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:32.187023+0000 front 2024-09-10T23:38:32.187049+0000 (oldest deadline 2024-09-10T23:38:58.087135+0000) 2024-09-10T23:39:21.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:21 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:21.000+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-10T23:38:42.788555+0000 front 2024-09-10T23:38:42.788470+0000 (oldest deadline 2024-09-10T23:39:06.888362+0000) 2024-09-10T23:39:21.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:21 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:21.000+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6820 osd.7 since back 2024-09-10T23:38:52.090017+0000 front 2024-09-10T23:38:52.090209+0000 (oldest deadline 2024-09-10T23:39:17.989779+0000) 2024-09-10T23:39:21.563 INFO:journalctl@ceph.osd.10.smithi038.stdout:Sep 10 23:39:21 smithi038 podman[71139]: 2024-09-10 23:39:21.216048116 +0000 UTC m=+0.631432115 container died 3f3aae76df6185c8ac4501028c1a1a8718bd2fbd1d87cf082c45c268f091c03c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-10T23:39:21.929 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.10.service' 2024-09-10T23:39:22.006 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:39:22.006 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-10T23:39:22.006 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-10T23:39:22.007 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.11 2024-09-10T23:39:22.421 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:21 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:21.976+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:39:22.421 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:21 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:21.976+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:39:22.421 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:21 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:21.976+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:39:22.421 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:21 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:21.976+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:39:22.422 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:21 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:21.976+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:32.187023+0000 front 2024-09-10T23:38:32.187049+0000 (oldest deadline 2024-09-10T23:38:58.087135+0000) 2024-09-10T23:39:22.422 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:21 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:21.976+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-10T23:38:42.788555+0000 front 2024-09-10T23:38:42.788470+0000 (oldest deadline 2024-09-10T23:39:06.888362+0000) 2024-09-10T23:39:22.422 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:21 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:21.976+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6820 osd.7 since back 2024-09-10T23:38:52.090017+0000 front 2024-09-10T23:38:52.090209+0000 (oldest deadline 2024-09-10T23:39:17.989779+0000) 2024-09-10T23:39:22.422 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:22 smithi194 systemd[1]: Stopping Ceph osd.11 for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:39:22.422 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:22 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:22.419+0000 7f66a7800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:39:22.422 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:22 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:22.419+0000 7f66a7800640 -1 osd.11 104 *** Got signal Terminated *** 2024-09-10T23:39:22.422 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:22 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:22.419+0000 7f66a7800640 -1 osd.11 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:39:23.447 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:22 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:22.998+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:39:23.447 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:22 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:22.998+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:39:23.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:22 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:22.998+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:39:23.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:22 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:22.998+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:39:23.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:22 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:22.998+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:32.187023+0000 front 2024-09-10T23:38:32.187049+0000 (oldest deadline 2024-09-10T23:38:58.087135+0000) 2024-09-10T23:39:23.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:22 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:22.998+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-10T23:38:42.788555+0000 front 2024-09-10T23:38:42.788470+0000 (oldest deadline 2024-09-10T23:39:06.888362+0000) 2024-09-10T23:39:23.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:22 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:22.998+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6820 osd.7 since back 2024-09-10T23:38:52.090017+0000 front 2024-09-10T23:38:52.090209+0000 (oldest deadline 2024-09-10T23:39:17.989779+0000) 2024-09-10T23:39:24.447 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:23 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:23.979+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:39:24.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:23 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:23.979+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:39:24.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:23 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:23.979+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:39:24.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:23 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:23.979+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:39:24.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:23 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:23.979+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:32.187023+0000 front 2024-09-10T23:38:32.187049+0000 (oldest deadline 2024-09-10T23:38:58.087135+0000) 2024-09-10T23:39:24.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:23 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:23.979+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-10T23:38:42.788555+0000 front 2024-09-10T23:38:42.788470+0000 (oldest deadline 2024-09-10T23:39:06.888362+0000) 2024-09-10T23:39:24.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:23 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:23.979+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6820 osd.7 since back 2024-09-10T23:38:52.090017+0000 front 2024-09-10T23:38:52.090209+0000 (oldest deadline 2024-09-10T23:39:17.989779+0000) 2024-09-10T23:39:25.447 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:24 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:24.956+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:39:25.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:24 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:24.956+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:39:25.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:24 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:24.956+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:39:25.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:24 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:24.956+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:39:25.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:24 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:24.956+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:32.187023+0000 front 2024-09-10T23:38:32.187049+0000 (oldest deadline 2024-09-10T23:38:58.087135+0000) 2024-09-10T23:39:25.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:24 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:24.956+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-10T23:38:42.788555+0000 front 2024-09-10T23:38:42.788470+0000 (oldest deadline 2024-09-10T23:39:06.888362+0000) 2024-09-10T23:39:25.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:24 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:24.956+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6820 osd.7 since back 2024-09-10T23:38:52.090017+0000 front 2024-09-10T23:38:52.090209+0000 (oldest deadline 2024-09-10T23:39:17.989779+0000) 2024-09-10T23:39:26.447 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:25 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:25.968+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:39:26.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:25 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:25.968+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:39:26.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:25 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:25.968+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:39:26.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:25 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:25.968+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:39:26.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:25 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:25.968+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:32.187023+0000 front 2024-09-10T23:38:32.187049+0000 (oldest deadline 2024-09-10T23:38:58.087135+0000) 2024-09-10T23:39:26.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:25 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:25.968+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-10T23:38:42.788555+0000 front 2024-09-10T23:38:42.788470+0000 (oldest deadline 2024-09-10T23:39:06.888362+0000) 2024-09-10T23:39:26.448 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:25 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:25.968+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6820 osd.7 since back 2024-09-10T23:38:52.090017+0000 front 2024-09-10T23:38:52.090209+0000 (oldest deadline 2024-09-10T23:39:17.989779+0000) 2024-09-10T23:39:27.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:26 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:26.934+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-10T23:37:52.679640+0000 front 2024-09-10T23:37:52.679734+0000 (oldest deadline 2024-09-10T23:38:16.080179+0000) 2024-09-10T23:39:27.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:26 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:26.934+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6804 osd.1 since back 2024-09-10T23:38:00.181431+0000 front 2024-09-10T23:38:00.181459+0000 (oldest deadline 2024-09-10T23:38:25.481492+0000) 2024-09-10T23:39:27.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:26 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:26.934+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-10T23:38:10.182490+0000 front 2024-09-10T23:38:10.182473+0000 (oldest deadline 2024-09-10T23:38:31.882720+0000) 2024-09-10T23:39:27.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:26 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:26.934+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6812 osd.4 since back 2024-09-10T23:38:26.287012+0000 front 2024-09-10T23:38:26.286893+0000 (oldest deadline 2024-09-10T23:38:52.186698+0000) 2024-09-10T23:39:27.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:26 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:26.934+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-10T23:38:32.187023+0000 front 2024-09-10T23:38:32.187049+0000 (oldest deadline 2024-09-10T23:38:58.087135+0000) 2024-09-10T23:39:27.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:26 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:26.934+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-10T23:38:42.788555+0000 front 2024-09-10T23:38:42.788470+0000 (oldest deadline 2024-09-10T23:39:06.888362+0000) 2024-09-10T23:39:27.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:26 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:26.934+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.38:6820 osd.7 since back 2024-09-10T23:38:52.090017+0000 front 2024-09-10T23:38:52.090209+0000 (oldest deadline 2024-09-10T23:39:17.989779+0000) 2024-09-10T23:39:27.198 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:26 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11[60773]: 2024-09-10T23:39:26.934+0000 7f669e200640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.194:6820 osd.8 since back 2024-09-10T23:39:00.890769+0000 front 2024-09-10T23:39:00.890792+0000 (oldest deadline 2024-09-10T23:39:26.190848+0000) 2024-09-10T23:39:28.093 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:27 smithi194 podman[71576]: 2024-09-10 23:39:27.840560631 +0000 UTC m=+5.545129445 container died fdd650e1254f77d8308dd1b49e9c7f9cb74dcd940f88428a922430253ab83ac8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True) 2024-09-10T23:39:28.359 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:28 smithi194 podman[71576]: 2024-09-10 23:39:28.199310594 +0000 UTC m=+5.903879414 container cleanup fdd650e1254f77d8308dd1b49e9c7f9cb74dcd940f88428a922430253ab83ac8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-10T23:39:28.360 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:28 smithi194 bash[71576]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11 2024-09-10T23:39:28.697 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:28 smithi194 podman[71595]: 2024-09-10 23:39:28.35924622 +0000 UTC m=+0.508254722 container remove fdd650e1254f77d8308dd1b49e9c7f9cb74dcd940f88428a922430253ab83ac8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-10T23:39:29.187 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:28 smithi194 podman[71682]: 2024-09-10 23:39:28.803353856 +0000 UTC m=+0.026378042 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:39:29.187 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:28 smithi194 podman[71682]: 2024-09-10 23:39:28.901406813 +0000 UTC m=+0.124430989 container create 217ee9a79b4d42f4c90f6606f595e1f44032fdfad44da8acc0282258e62e8c80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T23:39:29.188 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:29 smithi194 podman[71682]: 2024-09-10 23:39:29.103833732 +0000 UTC m=+0.326857906 container init 217ee9a79b4d42f4c90f6606f595e1f44032fdfad44da8acc0282258e62e8c80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-10T23:39:29.188 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:29 smithi194 podman[71682]: 2024-09-10 23:39:29.110537336 +0000 UTC m=+0.333561518 container start 217ee9a79b4d42f4c90f6606f595e1f44032fdfad44da8acc0282258e62e8c80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-10T23:39:29.188 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:29 smithi194 podman[71682]: 2024-09-10 23:39:29.186832041 +0000 UTC m=+0.409856223 container attach 217ee9a79b4d42f4c90f6606f595e1f44032fdfad44da8acc0282258e62e8c80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-10T23:39:29.447 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 10 23:39:29 smithi194 podman[71682]: 2024-09-10 23:39:29.373866217 +0000 UTC m=+0.596890402 container died 217ee9a79b4d42f4c90f6606f595e1f44032fdfad44da8acc0282258e62e8c80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:39:29.996 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@osd.11.service' 2024-09-10T23:39:30.069 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:39:30.070 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-10T23:39:30.070 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-10T23:39:30.070 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.a 2024-09-10T23:39:30.471 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 10 23:39:30 smithi003 systemd[1]: Stopping Ceph mds.a for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:39:30.807 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 10 23:39:30 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-a[76417]: 2024-09-10T23:39:30.480+0000 7f8a3e200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:39:30.807 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 10 23:39:30 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-a[76417]: 2024-09-10T23:39:30.480+0000 7f8a3e200640 -1 mds.a *** got signal Terminated *** 2024-09-10T23:39:34.141 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 10 23:39:33 smithi003 podman[98153]: 2024-09-10 23:39:33.882260228 +0000 UTC m=+3.516711793 container died 0200c64007a9d101c0c22bcef0aef11979f386a6ca996b97a1c57269a29d28bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-a, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T23:39:34.432 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 10 23:39:34 smithi003 podman[98153]: 2024-09-10 23:39:34.246542676 +0000 UTC m=+3.880994241 container cleanup 0200c64007a9d101c0c22bcef0aef11979f386a6ca996b97a1c57269a29d28bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-a, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-10T23:39:34.432 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 10 23:39:34 smithi003 bash[98153]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-a 2024-09-10T23:39:34.696 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 10 23:39:34 smithi003 podman[98177]: 2024-09-10 23:39:34.431353561 +0000 UTC m=+0.532394507 container remove 0200c64007a9d101c0c22bcef0aef11979f386a6ca996b97a1c57269a29d28bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-a, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-10T23:39:34.705 DEBUG:teuthology.orchestra.run.smithi003:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.a.service' 2024-09-10T23:39:34.777 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:39:34.777 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-10T23:39:34.777 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-10T23:39:34.778 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.d 2024-09-10T23:39:34.971 INFO:journalctl@ceph.mds.d.smithi003.stdout:Sep 10 23:39:34 smithi003 systemd[1]: Stopping Ceph mds.d for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:39:35.720 INFO:journalctl@ceph.mds.d.smithi003.stdout:Sep 10 23:39:35 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-d[75129]: 2024-09-10T23:39:35.294+0000 7ff0b2600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:39:35.721 INFO:journalctl@ceph.mds.d.smithi003.stdout:Sep 10 23:39:35 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-d[75129]: 2024-09-10T23:39:35.294+0000 7ff0b2600640 -1 mds.d *** got signal Terminated *** 2024-09-10T23:39:37.177 INFO:journalctl@ceph.mds.d.smithi003.stdout:Sep 10 23:39:36 smithi003 podman[98284]: 2024-09-10 23:39:36.732981207 +0000 UTC m=+1.665939212 container died c1747fac5bd3c4b4ec35b89d83b5107e987ac970dd4f5ad77a26bcfeae78e2da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-d, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-10T23:39:37.468 INFO:journalctl@ceph.mds.d.smithi003.stdout:Sep 10 23:39:37 smithi003 podman[98284]: 2024-09-10 23:39:37.2919021 +0000 UTC m=+2.224860113 container cleanup c1747fac5bd3c4b4ec35b89d83b5107e987ac970dd4f5ad77a26bcfeae78e2da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-d, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-10T23:39:37.469 INFO:journalctl@ceph.mds.d.smithi003.stdout:Sep 10 23:39:37 smithi003 bash[98284]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-d 2024-09-10T23:39:37.720 INFO:journalctl@ceph.mds.d.smithi003.stdout:Sep 10 23:39:37 smithi003 podman[98297]: 2024-09-10 23:39:37.468223274 +0000 UTC m=+0.722326665 container remove c1747fac5bd3c4b4ec35b89d83b5107e987ac970dd4f5ad77a26bcfeae78e2da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-d, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:39:37.736 DEBUG:teuthology.orchestra.run.smithi003:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.d.service' 2024-09-10T23:39:37.808 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:39:37.808 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-10T23:39:37.808 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-10T23:39:37.808 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.g 2024-09-10T23:39:38.220 INFO:journalctl@ceph.mds.g.smithi003.stdout:Sep 10 23:39:37 smithi003 systemd[1]: Stopping Ceph mds.g for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:39:38.720 INFO:journalctl@ceph.mds.g.smithi003.stdout:Sep 10 23:39:38 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-g[76004]: 2024-09-10T23:39:38.324+0000 7f5311e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:39:38.721 INFO:journalctl@ceph.mds.g.smithi003.stdout:Sep 10 23:39:38 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-g[76004]: 2024-09-10T23:39:38.324+0000 7f5311e00640 -1 mds.g *** got signal Terminated *** 2024-09-10T23:39:41.931 INFO:journalctl@ceph.mds.g.smithi003.stdout:Sep 10 23:39:41 smithi003 podman[98403]: 2024-09-10 23:39:41.504653231 +0000 UTC m=+3.417860201 container died cbbf94f8749d7c50788fc68f766d2c971dda9979805fa7f270ba9f7fda53f40f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-g, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-10T23:39:42.221 INFO:journalctl@ceph.mds.g.smithi003.stdout:Sep 10 23:39:42 smithi003 podman[98403]: 2024-09-10 23:39:42.037213678 +0000 UTC m=+3.950420647 container cleanup cbbf94f8749d7c50788fc68f766d2c971dda9979805fa7f270ba9f7fda53f40f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-g, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:39:42.221 INFO:journalctl@ceph.mds.g.smithi003.stdout:Sep 10 23:39:42 smithi003 bash[98403]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-g 2024-09-10T23:39:42.637 INFO:journalctl@ceph.mds.g.smithi003.stdout:Sep 10 23:39:42 smithi003 podman[98415]: 2024-09-10 23:39:42.380449082 +0000 UTC m=+0.862083591 container remove cbbf94f8749d7c50788fc68f766d2c971dda9979805fa7f270ba9f7fda53f40f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-g, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-10T23:39:42.645 DEBUG:teuthology.orchestra.run.smithi003:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.g.service' 2024-09-10T23:39:42.716 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:39:42.716 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-10T23:39:42.716 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-10T23:39:42.716 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.j 2024-09-10T23:39:42.971 INFO:journalctl@ceph.mds.j.smithi003.stdout:Sep 10 23:39:42 smithi003 systemd[1]: Stopping Ceph mds.j for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:39:43.470 INFO:journalctl@ceph.mds.j.smithi003.stdout:Sep 10 23:39:43 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-j[74718]: 2024-09-10T23:39:43.102+0000 7f2eaa200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:39:43.471 INFO:journalctl@ceph.mds.j.smithi003.stdout:Sep 10 23:39:43 smithi003 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-j[74718]: 2024-09-10T23:39:43.102+0000 7f2eaa200640 -1 mds.j *** got signal Terminated *** 2024-09-10T23:39:44.893 INFO:journalctl@ceph.mds.j.smithi003.stdout:Sep 10 23:39:44 smithi003 podman[98523]: 2024-09-10 23:39:44.511656036 +0000 UTC m=+1.518184840 container died be87cbba1f889059870f8e88642152d2d0d496c1fa0274f25b738a156e81fe46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-j, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-10T23:39:45.220 INFO:journalctl@ceph.mds.j.smithi003.stdout:Sep 10 23:39:44 smithi003 podman[98523]: 2024-09-10 23:39:44.999124976 +0000 UTC m=+2.005653785 container cleanup be87cbba1f889059870f8e88642152d2d0d496c1fa0274f25b738a156e81fe46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-j, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-10T23:39:45.220 INFO:journalctl@ceph.mds.j.smithi003.stdout:Sep 10 23:39:44 smithi003 bash[98523]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-j 2024-09-10T23:39:45.422 DEBUG:teuthology.orchestra.run.smithi003:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.j.service' 2024-09-10T23:39:45.491 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:39:45.491 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-10T23:39:45.491 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-10T23:39:45.492 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.b 2024-09-10T23:39:45.847 INFO:journalctl@ceph.mds.b.smithi038.stdout:Sep 10 23:39:45 smithi038 systemd[1]: Stopping Ceph mds.b for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:39:46.347 INFO:journalctl@ceph.mds.b.smithi038.stdout:Sep 10 23:39:45 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-b[65649]: 2024-09-10T23:39:45.900+0000 7fa3a2c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:39:46.347 INFO:journalctl@ceph.mds.b.smithi038.stdout:Sep 10 23:39:45 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-b[65649]: 2024-09-10T23:39:45.900+0000 7fa3a2c00640 -1 mds.b *** got signal Terminated *** 2024-09-10T23:39:50.007 INFO:journalctl@ceph.mds.b.smithi038.stdout:Sep 10 23:39:49 smithi038 podman[71252]: 2024-09-10 23:39:49.724829324 +0000 UTC m=+3.944185527 container died ac6480bce797be8d0f63c7fe91a076719eeee1d5e78299305e2a753fd514f018 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-b, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:39:50.347 INFO:journalctl@ceph.mds.b.smithi038.stdout:Sep 10 23:39:50 smithi038 podman[71252]: 2024-09-10 23:39:50.12198348 +0000 UTC m=+4.341339681 container cleanup ac6480bce797be8d0f63c7fe91a076719eeee1d5e78299305e2a753fd514f018 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-10T23:39:50.347 INFO:journalctl@ceph.mds.b.smithi038.stdout:Sep 10 23:39:50 smithi038 bash[71252]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-b 2024-09-10T23:39:50.655 INFO:journalctl@ceph.mds.b.smithi038.stdout:Sep 10 23:39:50 smithi038 podman[71265]: 2024-09-10 23:39:50.465472877 +0000 UTC m=+0.732675333 container remove ac6480bce797be8d0f63c7fe91a076719eeee1d5e78299305e2a753fd514f018 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-b, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True) 2024-09-10T23:39:50.680 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.b.service' 2024-09-10T23:39:50.750 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:39:50.750 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-10T23:39:50.750 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-10T23:39:50.750 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.e 2024-09-10T23:39:51.097 INFO:journalctl@ceph.mds.e.smithi038.stdout:Sep 10 23:39:50 smithi038 systemd[1]: Stopping Ceph mds.e for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:39:51.597 INFO:journalctl@ceph.mds.e.smithi038.stdout:Sep 10 23:39:51 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-e[65041]: 2024-09-10T23:39:51.188+0000 7fec86a00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:39:51.597 INFO:journalctl@ceph.mds.e.smithi038.stdout:Sep 10 23:39:51 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-e[65041]: 2024-09-10T23:39:51.188+0000 7fec86a00640 -1 mds.e *** got signal Terminated *** 2024-09-10T23:39:53.994 INFO:journalctl@ceph.mds.e.smithi038.stdout:Sep 10 23:39:53 smithi038 podman[71372]: 2024-09-10 23:39:53.717529436 +0000 UTC m=+2.695733098 container died 2b69464e30fbedf5f88868e3c513bc4d8607107847a8f75595461bd945e75f21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-e, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:39:54.347 INFO:journalctl@ceph.mds.e.smithi038.stdout:Sep 10 23:39:54 smithi038 podman[71372]: 2024-09-10 23:39:54.143018853 +0000 UTC m=+3.121222515 container cleanup 2b69464e30fbedf5f88868e3c513bc4d8607107847a8f75595461bd945e75f21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-e, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-10T23:39:54.347 INFO:journalctl@ceph.mds.e.smithi038.stdout:Sep 10 23:39:54 smithi038 bash[71372]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-e 2024-09-10T23:39:54.622 INFO:journalctl@ceph.mds.e.smithi038.stdout:Sep 10 23:39:54 smithi038 podman[71396]: 2024-09-10 23:39:54.369155534 +0000 UTC m=+0.638630586 container remove 2b69464e30fbedf5f88868e3c513bc4d8607107847a8f75595461bd945e75f21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-e, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-10T23:39:54.642 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.e.service' 2024-09-10T23:39:54.714 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:39:54.715 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-10T23:39:54.715 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-10T23:39:54.715 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.h 2024-09-10T23:39:55.097 INFO:journalctl@ceph.mds.h.smithi038.stdout:Sep 10 23:39:54 smithi038 systemd[1]: Stopping Ceph mds.h for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:39:55.597 INFO:journalctl@ceph.mds.h.smithi038.stdout:Sep 10 23:39:55 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-h[65339]: 2024-09-10T23:39:55.166+0000 7f0b9fa00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:39:55.597 INFO:journalctl@ceph.mds.h.smithi038.stdout:Sep 10 23:39:55 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-h[65339]: 2024-09-10T23:39:55.166+0000 7f0b9fa00640 -1 mds.h *** got signal Terminated *** 2024-09-10T23:39:58.040 INFO:journalctl@ceph.mds.h.smithi038.stdout:Sep 10 23:39:57 smithi038 podman[71502]: 2024-09-10 23:39:57.737553889 +0000 UTC m=+2.703965571 container died f5826b115319c814e3f64cd7114886c2563bb5bf6d66d1658b026e61ea513b20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-h, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-10T23:39:58.347 INFO:journalctl@ceph.mds.h.smithi038.stdout:Sep 10 23:39:58 smithi038 podman[71502]: 2024-09-10 23:39:58.155403448 +0000 UTC m=+3.121815129 container cleanup f5826b115319c814e3f64cd7114886c2563bb5bf6d66d1658b026e61ea513b20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-h, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True) 2024-09-10T23:39:58.347 INFO:journalctl@ceph.mds.h.smithi038.stdout:Sep 10 23:39:58 smithi038 bash[71502]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-h 2024-09-10T23:39:58.642 INFO:journalctl@ceph.mds.h.smithi038.stdout:Sep 10 23:39:58 smithi038 podman[71514]: 2024-09-10 23:39:58.390188911 +0000 UTC m=+0.641549079 container remove f5826b115319c814e3f64cd7114886c2563bb5bf6d66d1658b026e61ea513b20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-h, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-10T23:39:58.651 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.h.service' 2024-09-10T23:39:58.721 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:39:58.721 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-10T23:39:58.721 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-10T23:39:58.721 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.k 2024-09-10T23:39:59.088 INFO:journalctl@ceph.mds.k.smithi038.stdout:Sep 10 23:39:58 smithi038 systemd[1]: Stopping Ceph mds.k for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:39:59.347 INFO:journalctl@ceph.mds.k.smithi038.stdout:Sep 10 23:39:59 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-k[64736]: 2024-09-10T23:39:59.087+0000 7fc27e200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:39:59.347 INFO:journalctl@ceph.mds.k.smithi038.stdout:Sep 10 23:39:59 smithi038 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-k[64736]: 2024-09-10T23:39:59.087+0000 7fc27e200640 -1 mds.k *** got signal Terminated *** 2024-09-10T23:40:02.036 INFO:journalctl@ceph.mds.k.smithi038.stdout:Sep 10 23:40:01 smithi038 podman[71620]: 2024-09-10 23:40:01.738948985 +0000 UTC m=+2.751657254 container died 3eb8d873169e2acf43c940df9c349e9ef96d4f1227041554e12c1b32c3a9de9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-10T23:40:02.347 INFO:journalctl@ceph.mds.k.smithi038.stdout:Sep 10 23:40:02 smithi038 podman[71620]: 2024-09-10 23:40:02.12574523 +0000 UTC m=+3.138453499 container cleanup 3eb8d873169e2acf43c940df9c349e9ef96d4f1227041554e12c1b32c3a9de9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-k, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:40:02.347 INFO:journalctl@ceph.mds.k.smithi038.stdout:Sep 10 23:40:02 smithi038 bash[71620]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-k 2024-09-10T23:40:02.559 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.k.service' 2024-09-10T23:40:02.628 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:40:02.628 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-10T23:40:02.629 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-10T23:40:02.629 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.c 2024-09-10T23:40:02.947 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 10 23:40:02 smithi194 systemd[1]: Stopping Ceph mds.c for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:40:03.447 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 10 23:40:03 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-c[66053]: 2024-09-10T23:40:03.035+0000 7fdf24200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:40:03.447 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 10 23:40:03 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-c[66053]: 2024-09-10T23:40:03.035+0000 7fdf24200640 -1 mds.c *** got signal Terminated *** 2024-09-10T23:40:06.026 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 10 23:40:05 smithi194 podman[71785]: 2024-09-10 23:40:05.717457006 +0000 UTC m=+2.809408147 container died 2466729636bd0b066a58fbbbd54289a594bc8d86d2ae4b04872334b00a0cd2d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:40:06.351 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 10 23:40:06 smithi194 podman[71785]: 2024-09-10 23:40:06.140522566 +0000 UTC m=+3.232473717 container cleanup 2466729636bd0b066a58fbbbd54289a594bc8d86d2ae4b04872334b00a0cd2d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-c, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-10T23:40:06.351 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 10 23:40:06 smithi194 bash[71785]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-c 2024-09-10T23:40:06.622 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 10 23:40:06 smithi194 podman[71810]: 2024-09-10 23:40:06.349811853 +0000 UTC m=+0.618383003 container remove 2466729636bd0b066a58fbbbd54289a594bc8d86d2ae4b04872334b00a0cd2d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-c, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-10T23:40:06.648 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.c.service' 2024-09-10T23:40:06.722 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:40:06.722 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-10T23:40:06.723 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-10T23:40:06.723 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.f 2024-09-10T23:40:06.947 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 10 23:40:06 smithi194 systemd[1]: Stopping Ceph mds.f for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:40:07.448 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 10 23:40:07 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-f[65739]: 2024-09-10T23:40:07.147+0000 7f5180e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:40:07.448 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 10 23:40:07 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-f[65739]: 2024-09-10T23:40:07.147+0000 7f5180e00640 -1 mds.f *** got signal Terminated *** 2024-09-10T23:40:11.437 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 10 23:40:11 smithi194 podman[71917]: 2024-09-10 23:40:11.164353695 +0000 UTC m=+4.134968998 container died ca0eeceaff69b56486304de381b84d6d352b5cc473698a0d1ddbb4a9a9413458 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-10T23:40:11.697 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 10 23:40:11 smithi194 podman[71917]: 2024-09-10 23:40:11.54347801 +0000 UTC m=+4.514093306 container cleanup ca0eeceaff69b56486304de381b84d6d352b5cc473698a0d1ddbb4a9a9413458 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-f, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-10T23:40:11.698 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 10 23:40:11 smithi194 bash[71917]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-f 2024-09-10T23:40:12.039 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.f.service' 2024-09-10T23:40:12.087 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 10 23:40:11 smithi194 podman[71929]: 2024-09-10 23:40:11.836249598 +0000 UTC m=+0.665113017 container remove ca0eeceaff69b56486304de381b84d6d352b5cc473698a0d1ddbb4a9a9413458 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:40:12.088 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 10 23:40:12 smithi194 systemd[1]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.f.service: Deactivated successfully. 2024-09-10T23:40:12.088 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 10 23:40:12 smithi194 systemd[1]: Stopped Ceph mds.f for 3f4e30d0-6fca-11ef-bcea-c7b262605968. 2024-09-10T23:40:12.088 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 10 23:40:12 smithi194 systemd[1]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.f.service: Consumed 1.633s CPU time. 2024-09-10T23:40:12.110 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:40:12.110 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-10T23:40:12.110 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-10T23:40:12.110 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.i 2024-09-10T23:40:12.447 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 10 23:40:12 smithi194 systemd[1]: Stopping Ceph mds.i for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:40:12.947 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 10 23:40:12 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-i[66353]: 2024-09-10T23:40:12.474+0000 7f844b600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:40:12.947 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 10 23:40:12 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-i[66353]: 2024-09-10T23:40:12.474+0000 7f844b600640 -1 mds.i *** got signal Terminated *** 2024-09-10T23:40:13.999 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 10 23:40:13 smithi194 podman[72033]: 2024-09-10 23:40:13.717965997 +0000 UTC m=+1.343663406 container died a1a9eedf5869029543da3955ad96e15fa0eca49b6d8a45305ded7d20b7b883be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-i, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-10T23:40:14.348 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 10 23:40:14 smithi194 podman[72033]: 2024-09-10 23:40:14.105344447 +0000 UTC m=+1.731041856 container cleanup a1a9eedf5869029543da3955ad96e15fa0eca49b6d8a45305ded7d20b7b883be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-i, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-10T23:40:14.349 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 10 23:40:14 smithi194 bash[72033]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-i 2024-09-10T23:40:14.517 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.i.service' 2024-09-10T23:40:14.585 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:40:14.586 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-10T23:40:14.586 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-10T23:40:14.586 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.l 2024-09-10T23:40:14.947 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 10 23:40:14 smithi194 systemd[1]: Stopping Ceph mds.l for 3f4e30d0-6fca-11ef-bcea-c7b262605968... 2024-09-10T23:40:15.447 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 10 23:40:14 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-l[65442]: 2024-09-10T23:40:14.969+0000 7fd5b6400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:40:15.448 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 10 23:40:14 smithi194 ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-l[65442]: 2024-09-10T23:40:14.969+0000 7fd5b6400640 -1 mds.l *** got signal Terminated *** 2024-09-10T23:40:16.918 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 10 23:40:16 smithi194 podman[72155]: 2024-09-10 23:40:16.650821275 +0000 UTC m=+1.790402157 container died 8e7fa99ead2b245ab7655699ffcae8f24727a6cb345ceb2422a7b0ede11ea232 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-l, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-10T23:40:17.198 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 10 23:40:17 smithi194 podman[72155]: 2024-09-10 23:40:17.025092229 +0000 UTC m=+2.164673102 container cleanup 8e7fa99ead2b245ab7655699ffcae8f24727a6cb345ceb2422a7b0ede11ea232 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-l, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True) 2024-09-10T23:40:17.198 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 10 23:40:17 smithi194 bash[72155]: ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-l 2024-09-10T23:40:17.198 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 10 23:40:17 smithi194 podman[72169]: 2024-09-10 23:40:17.151033705 +0000 UTC m=+0.481396732 container remove 8e7fa99ead2b245ab7655699ffcae8f24727a6cb345ceb2422a7b0ede11ea232 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968-mds-l, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD) 2024-09-10T23:40:17.418 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3f4e30d0-6fca-11ef-bcea-c7b262605968@mds.l.service' 2024-09-10T23:40:17.486 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:40:17.486 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-10T23:40:17.487 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T23:40:17.770 INFO:teuthology.orchestra.run.smithi003.stdout:Deleting cluster with fsid: 3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:40:21.659 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T23:40:21.945 INFO:teuthology.orchestra.run.smithi038.stdout:Deleting cluster with fsid: 3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:40:25.817 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T23:40:26.095 INFO:teuthology.orchestra.run.smithi194.stdout:Deleting cluster with fsid: 3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:40:29.983 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:40:30.047 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:40:30.111 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:40:30.169 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-10T23:40:30.172 DEBUG:teuthology.misc:Transferring archived files from smithi003:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899776/remote/smithi003/crash 2024-09-10T23:40:30.173 DEBUG:teuthology.orchestra.run.smithi003:> sudo tar c -f - -C /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/crash -- . 2024-09-10T23:40:30.245 INFO:teuthology.orchestra.run.smithi003.stderr:tar: /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T23:40:30.246 INFO:teuthology.orchestra.run.smithi003.stderr:tar: Error is not recoverable: exiting now 2024-09-10T23:40:30.249 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899776/remote/smithi038/crash 2024-09-10T23:40:30.250 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/crash -- . 2024-09-10T23:40:30.322 INFO:teuthology.orchestra.run.smithi038.stderr:tar: /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T23:40:30.323 INFO:teuthology.orchestra.run.smithi038.stderr:tar: Error is not recoverable: exiting now 2024-09-10T23:40:30.326 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899776/remote/smithi194/crash 2024-09-10T23:40:30.327 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/crash -- . 2024-09-10T23:40:30.390 INFO:teuthology.orchestra.run.smithi194.stderr:tar: /var/lib/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T23:40:30.391 INFO:teuthology.orchestra.run.smithi194.stderr:tar: Error is not recoverable: exiting now 2024-09-10T23:40:30.393 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-10T23:40:30.393 DEBUG:teuthology.orchestra.run.smithi003:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-10T23:40:30.482 INFO:tasks.cephadm:Compressing logs... 2024-09-10T23:40:30.482 DEBUG:teuthology.orchestra.run.smithi003:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T23:40:30.487 DEBUG:teuthology.orchestra.run.smithi038:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T23:40:30.491 DEBUG:teuthology.orchestra.run.smithi194:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T23:40:30.536 INFO:teuthology.orchestra.run.smithi003.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-10T23:40:30.537 INFO:teuthology.orchestra.run.smithi003.stderr:: No such file or directory 2024-09-10T23:40:30.537 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-10T23:40:30.538 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T23:40:30.539 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T23:40:30.539 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-10T23:40:30.541 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T23:40:30.542 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-10T23:40:30.543 INFO:teuthology.orchestra.run.smithi038.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-10T23:40:30.543 INFO:teuthology.orchestra.run.smithi038.stderr:: No such file or directory 2024-09-10T23:40:30.544 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-10T23:40:30.544 INFO:teuthology.orchestra.run.smithi003.stderr: 83.9% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T23:40:30.544 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mon.a.log: 89.8% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T23:40:30.546 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-10T23:40:30.546 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-10T23:40:30.546 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-10T23:40:30.546 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T23:40:30.547 INFO:teuthology.orchestra.run.smithi194.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-10T23:40:30.547 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T23:40:30.547 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T23:40:30.547 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-10T23:40:30.548 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-10T23:40:30.549 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph.log 2024-09-10T23:40:30.550 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-10T23:40:30.550 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-10T23:40:30.550 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-10T23:40:30.551 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T23:40:30.551 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-10T23:40:30.551 INFO:teuthology.orchestra.run.smithi194.stderr: 90.0% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T23:40:30.551 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-10T23:40:30.551 INFO:teuthology.orchestra.run.smithi194.stderr: 81.1% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T23:40:30.552 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-10T23:40:30.553 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.6.log: /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph.log: 95.0% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-10T23:40:30.553 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-10T23:40:30.554 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph.log 2024-09-10T23:40:30.554 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-10T23:40:30.554 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T23:40:30.554 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.4.log: /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T23:40:30.555 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-10T23:40:30.556 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-10T23:40:30.556 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mgr.x.log: 95.1% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-10T23:40:30.556 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-10T23:40:30.556 INFO:teuthology.orchestra.run.smithi003.stderr: 87.4% 91.0% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph.log.gz -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T23:40:30.556 INFO:teuthology.orchestra.run.smithi003.stderr: 2024-09-10T23:40:30.556 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-09-10T23:40:30.559 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-10T23:40:30.559 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph.log: /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-10T23:40:30.559 INFO:teuthology.orchestra.run.smithi194.stderr: 87.4% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T23:40:30.559 INFO:teuthology.orchestra.run.smithi194.stderr: 91.0% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T23:40:30.559 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-10T23:40:30.561 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log/var/log/ceph/ceph-client.admin.log: 95.0% 2024-09-10T23:40:30.561 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-10T23:40:30.561 INFO:teuthology.orchestra.run.smithi003.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-10T23:40:30.561 INFO:teuthology.orchestra.run.smithi038.stderr: 81.2%gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph.log 2024-09-10T23:40:30.562 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T23:40:30.562 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T23:40:30.563 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.8.log: /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-10T23:40:30.563 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mgr.y.log: 89.9% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T23:40:30.563 INFO:teuthology.orchestra.run.smithi038.stderr: 91.0% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T23:40:30.564 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-10T23:40:30.565 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-10T23:40:30.566 INFO:teuthology.orchestra.run.smithi194.stderr: 95.0% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-10T23:40:30.568 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph.log: /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.h.log: 87.5% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T23:40:30.569 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.0.log: /var/log/ceph/cephadm.log: 92.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T23:40:30.570 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T23:40:30.571 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-10T23:40:30.573 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-10T23:40:30.573 INFO:teuthology.orchestra.run.smithi003.stderr: 95.0% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-10T23:40:30.575 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T23:40:30.577 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.4% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-10T23:40:30.577 INFO:teuthology.orchestra.run.smithi194.stderr: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T23:40:30.585 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 92.4% 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T23:40:30.585 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-10T23:40:30.587 INFO:teuthology.orchestra.run.smithi194.stderr: 94.9% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-10T23:40:30.648 INFO:teuthology.orchestra.run.smithi194.stderr: 94.4% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-10T23:40:30.649 INFO:teuthology.orchestra.run.smithi038.stderr: 93.1% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-10T23:40:30.658 INFO:teuthology.orchestra.run.smithi194.stderr: 94.3% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-10T23:40:30.671 INFO:teuthology.orchestra.run.smithi038.stderr: 93.8% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-10T23:40:30.685 INFO:teuthology.orchestra.run.smithi038.stderr: 93.2% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-10T23:40:30.952 INFO:teuthology.orchestra.run.smithi003.stderr: 90.3% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-10T23:40:30.953 INFO:teuthology.orchestra.run.smithi194.stderr: 92.2% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-10T23:40:30.980 INFO:teuthology.orchestra.run.smithi038.stderr: 93.2% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-10T23:40:31.067 INFO:teuthology.orchestra.run.smithi038.stderr: 91.7% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-10T23:40:31.929 INFO:teuthology.orchestra.run.smithi003.stderr: 90.4% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-10T23:40:36.885 INFO:teuthology.orchestra.run.smithi194.stderr: 91.2% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-10T23:40:37.903 INFO:teuthology.orchestra.run.smithi003.stderr: 96.3% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-10T23:40:38.542 INFO:teuthology.orchestra.run.smithi038.stderr: 91.3% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-10T23:40:38.569 INFO:teuthology.orchestra.run.smithi038.stderr: 91.1% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-10T23:40:39.062 INFO:teuthology.orchestra.run.smithi194.stderr: 91.4% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-10T23:40:40.331 INFO:teuthology.orchestra.run.smithi194.stderr: 91.4% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-10T23:40:40.397 INFO:teuthology.orchestra.run.smithi003.stderr: 91.0% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-10T23:40:40.495 INFO:teuthology.orchestra.run.smithi003.stderr: 91.2% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-10T23:40:40.960 INFO:teuthology.orchestra.run.smithi038.stderr: 91.1% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-10T23:40:42.287 INFO:teuthology.orchestra.run.smithi038.stderr: 91.2% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-10T23:40:42.291 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-09-10T23:40:42.291 INFO:teuthology.orchestra.run.smithi038.stderr:real 0m11.770s 2024-09-10T23:40:42.291 INFO:teuthology.orchestra.run.smithi038.stderr:user 0m35.980s 2024-09-10T23:40:42.291 INFO:teuthology.orchestra.run.smithi038.stderr:sys 0m2.785s 2024-09-10T23:40:42.631 INFO:teuthology.orchestra.run.smithi003.stderr: 91.3% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-10T23:40:43.507 INFO:teuthology.orchestra.run.smithi194.stderr: 91.2% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-10T23:40:43.510 INFO:teuthology.orchestra.run.smithi194.stderr: 2024-09-10T23:40:43.510 INFO:teuthology.orchestra.run.smithi194.stderr:real 0m12.986s 2024-09-10T23:40:43.510 INFO:teuthology.orchestra.run.smithi194.stderr:user 0m35.446s 2024-09-10T23:40:43.511 INFO:teuthology.orchestra.run.smithi194.stderr:sys 0m2.830s 2024-09-10T23:40:44.439 INFO:teuthology.orchestra.run.smithi003.stderr: 91.0% -- replaced with /var/log/ceph/3f4e30d0-6fca-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-10T23:40:44.442 INFO:teuthology.orchestra.run.smithi003.stderr: 2024-09-10T23:40:44.442 INFO:teuthology.orchestra.run.smithi003.stderr:real 0m13.927s 2024-09-10T23:40:44.442 INFO:teuthology.orchestra.run.smithi003.stderr:user 0m51.029s 2024-09-10T23:40:44.442 INFO:teuthology.orchestra.run.smithi003.stderr:sys 0m4.002s 2024-09-10T23:40:44.444 INFO:tasks.cephadm:Archiving logs... 2024-09-10T23:40:44.444 DEBUG:teuthology.misc:Transferring archived files from smithi003:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899776/remote/smithi003/log 2024-09-10T23:40:44.445 DEBUG:teuthology.orchestra.run.smithi003:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T23:40:52.218 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899776/remote/smithi038/log 2024-09-10T23:40:52.219 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T23:40:58.176 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899776/remote/smithi194/log 2024-09-10T23:40:58.177 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T23:41:04.317 INFO:tasks.cephadm:Removing cluster... 2024-09-10T23:41:04.317 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 --force 2024-09-10T23:41:04.603 INFO:teuthology.orchestra.run.smithi003.stdout:Deleting cluster with fsid: 3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:41:05.211 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 --force 2024-09-10T23:41:05.496 INFO:teuthology.orchestra.run.smithi038.stdout:Deleting cluster with fsid: 3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:41:06.085 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3f4e30d0-6fca-11ef-bcea-c7b262605968 --force 2024-09-10T23:41:06.357 INFO:teuthology.orchestra.run.smithi194.stdout:Deleting cluster with fsid: 3f4e30d0-6fca-11ef-bcea-c7b262605968 2024-09-10T23:41:06.945 INFO:tasks.cephadm:Removing cephadm ... 2024-09-10T23:41:06.945 DEBUG:teuthology.orchestra.run.smithi003:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T23:41:06.986 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T23:41:07.027 DEBUG:teuthology.orchestra.run.smithi194:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T23:41:07.063 INFO:tasks.cephadm:Teardown complete 2024-09-10T23:41:07.063 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T23:41:07.074 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T23:41:07.074 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T23:41:07.079 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T23:41:07.083 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T23:41:07.236 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T23:41:07.247 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T23:41:07.248 DEBUG:teuthology.orchestra.run.smithi003:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:41:07.253 DEBUG:teuthology.orchestra.run.smithi038:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:41:07.256 DEBUG:teuthology.orchestra.run.smithi194:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:41:07.284 INFO:teuthology.orchestra.run.smithi003.stderr:bash: line 1: ntpq: command not found 2024-09-10T23:41:07.287 INFO:teuthology.orchestra.run.smithi038.stderr:bash: line 1: ntpq: command not found 2024-09-10T23:41:07.289 INFO:teuthology.orchestra.run.smithi194.stderr:bash: line 1: ntpq: command not found 2024-09-10T23:41:07.291 INFO:teuthology.orchestra.run.smithi003.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T23:41:07.291 INFO:teuthology.orchestra.run.smithi003.stdout:=============================================================================== 2024-09-10T23:41:07.292 INFO:teuthology.orchestra.run.smithi003.stdout:^* hv01.front.sepia.ceph.com 3 7 377 51 -268us[ -247us] +/- 47ms 2024-09-10T23:41:07.292 INFO:teuthology.orchestra.run.smithi003.stdout:^+ hv02.front.sepia.ceph.com 3 8 377 173 +416us[ +447us] +/- 76ms 2024-09-10T23:41:07.292 INFO:teuthology.orchestra.run.smithi003.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 43 +81us[ +81us] +/- 86ms 2024-09-10T23:41:07.292 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:41:07.294 INFO:teuthology.orchestra.run.smithi038.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T23:41:07.295 INFO:teuthology.orchestra.run.smithi038.stdout:=============================================================================== 2024-09-10T23:41:07.295 INFO:teuthology.orchestra.run.smithi038.stdout:^* hv01.front.sepia.ceph.com 3 6 377 46 -282us[ -277us] +/- 47ms 2024-09-10T23:41:07.295 INFO:teuthology.orchestra.run.smithi038.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 43 +396us[ +396us] +/- 78ms 2024-09-10T23:41:07.295 INFO:teuthology.orchestra.run.smithi038.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 45 +105us[ +105us] +/- 86ms 2024-09-10T23:41:07.295 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:41:07.296 INFO:teuthology.orchestra.run.smithi194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T23:41:07.297 INFO:teuthology.orchestra.run.smithi194.stdout:=============================================================================== 2024-09-10T23:41:07.297 INFO:teuthology.orchestra.run.smithi194.stdout:^* hv01.front.sepia.ceph.com 3 6 377 44 -280us[ -298us] +/- 47ms 2024-09-10T23:41:07.297 INFO:teuthology.orchestra.run.smithi194.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 45 +410us[ +393us] +/- 78ms 2024-09-10T23:41:07.297 INFO:teuthology.orchestra.run.smithi194.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 43 +95us[ +95us] +/- 86ms 2024-09-10T23:41:07.297 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:41:07.298 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T23:41:07.308 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T23:41:07.308 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T23:41:07.359 DEBUG:teuthology.orchestra.run.smithi003:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T23:41:07.494 DEBUG:teuthology.orchestra.run.smithi038:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T23:41:07.617 DEBUG:teuthology.orchestra.run.smithi194:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T23:41:07.737 DEBUG:teuthology.orchestra.run.smithi003:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T23:41:07.798 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:41:07.799 DEBUG:teuthology.orchestra.run.smithi038:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T23:41:07.860 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:41:07.860 DEBUG:teuthology.orchestra.run.smithi194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T23:41:07.921 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:41:07.921 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T23:41:07.932 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T23:41:07.968 INFO:teuthology.task.internal:Duration was 2085.923589 seconds 2024-09-10T23:41:07.968 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T23:41:08.015 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T23:41:08.016 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T23:41:08.022 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T23:41:08.026 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T23:41:08.106 INFO:teuthology.orchestra.run.smithi003.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:41:08.109 INFO:teuthology.orchestra.run.smithi038.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:41:08.113 INFO:teuthology.orchestra.run.smithi194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:41:08.548 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T23:41:08.549 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi003.front.sepia.ceph.com 2024-09-10T23:41:08.549 DEBUG:teuthology.orchestra.run.smithi003:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T23:41:08.599 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi038.front.sepia.ceph.com 2024-09-10T23:41:08.599 DEBUG:teuthology.orchestra.run.smithi038:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T23:41:08.650 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi194.front.sepia.ceph.com 2024-09-10T23:41:08.650 DEBUG:teuthology.orchestra.run.smithi194:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T23:41:08.707 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T23:41:08.707 DEBUG:teuthology.orchestra.run.smithi003:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T23:41:08.711 DEBUG:teuthology.orchestra.run.smithi038:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T23:41:08.715 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T23:41:08.774 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T23:41:08.774 DEBUG:teuthology.orchestra.run.smithi003:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T23:41:08.778 DEBUG:teuthology.orchestra.run.smithi038:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T23:41:08.784 DEBUG:teuthology.orchestra.run.smithi194:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T23:41:09.452 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T23:41:09.464 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T23:41:09.464 DEBUG:teuthology.orchestra.run.smithi003:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T23:41:09.520 DEBUG:teuthology.orchestra.run.smithi038:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T23:41:09.579 DEBUG:teuthology.orchestra.run.smithi194:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T23:41:09.638 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T23:41:09.649 DEBUG:teuthology.orchestra.run.smithi003:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T23:41:09.653 DEBUG:teuthology.orchestra.run.smithi038:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T23:41:09.657 DEBUG:teuthology.orchestra.run.smithi194:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T23:41:09.720 INFO:teuthology.orchestra.run.smithi003.stdout:kernel.core_pattern = core 2024-09-10T23:41:09.726 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern = core 2024-09-10T23:41:09.728 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = core 2024-09-10T23:41:09.763 DEBUG:teuthology.orchestra.run.smithi003:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T23:41:09.797 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:41:09.798 DEBUG:teuthology.orchestra.run.smithi038:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T23:41:09.831 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:41:09.831 DEBUG:teuthology.orchestra.run.smithi194:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T23:41:09.864 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:41:09.865 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T23:41:09.876 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T23:41:09.877 DEBUG:teuthology.misc:Transferring archived files from smithi003:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899776/remote/smithi003 2024-09-10T23:41:09.878 DEBUG:teuthology.orchestra.run.smithi003:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T23:41:09.960 DEBUG:teuthology.misc:Transferring archived files from smithi038:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899776/remote/smithi038 2024-09-10T23:41:09.960 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T23:41:10.033 DEBUG:teuthology.misc:Transferring archived files from smithi194:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899776/remote/smithi194 2024-09-10T23:41:10.033 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T23:41:10.098 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T23:41:10.099 DEBUG:teuthology.orchestra.run.smithi003:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T23:41:10.103 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T23:41:10.107 DEBUG:teuthology.orchestra.run.smithi194:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T23:41:10.142 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T23:41:10.155 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T23:41:10.155 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T23:41:10.182 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T23:41:10.182 DEBUG:teuthology.orchestra.run.smithi003:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T23:41:10.187 DEBUG:teuthology.orchestra.run.smithi038:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T23:41:10.191 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T23:41:10.218 INFO:teuthology.orchestra.run.smithi003.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 23:41 /home/ubuntu/cephtest 2024-09-10T23:41:10.221 INFO:teuthology.orchestra.run.smithi038.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 23:41 /home/ubuntu/cephtest 2024-09-10T23:41:10.225 INFO:teuthology.orchestra.run.smithi194.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 23:41 /home/ubuntu/cephtest 2024-09-10T23:41:10.227 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T23:41:10.239 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T23:41:10.336 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/fsync-tester}} duration: 2085.923588991165 flavor: default mon.a-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a mon.b-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a mon.c-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a owner: scheduled_hyelloji@teuthology success: true 2024-09-10T23:41:10.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T23:41:10.429 INFO:teuthology.run:pass